Surgical step video transmission method and system using same

Abstract

According to the present invention, there may be provided a surgical step video transmission system comprising: a content server configured to store a plurality of surgical videos; a video segment management server configured to receive operation-related information including an operation type, and divide and store a plurality of operation videos stored in the content server based on detailed operation steps, based on the operation-related information; the operation step determination server is configured to determine detailed operation steps based on the operation type of the operation patient and determine each video clip related to each detailed operation step; and a user terminal configured to receive the plurality of video segments based on the detailed surgical steps determined by the surgical step determination server.

Description

Technical Field

[0001] The present invention relates to a method for transmitting a video of a surgical procedure and a system using the method. More specifically, it relates to a method and a system capable of generating and providing a surgical video related to optimal detailed surgical steps based on surgical-related information. Background Art

[0002] Recently, with the rapid development of multimedia-related technologies and their application in various fields, the medical field has also developed technologies for making video recordings of a patient's surgical scene for doctors to present at medical-related academic conferences or for other purposes.

[0003] In addition, surgical videos are taken for surgical records and defense against possible medical disputes, or during surgeries such as arthroscopic surgeries, where a micro camera is used to visually confirm lesions while diagnosing and treating. In recent times, most medical devices are equipped with a video shooting function, leading to a sharp increase in the shooting of surgical videos.

[0004] The surgical videos recorded in this way have various utilization values for other doctors, patients, researchers, etc. In particular, if various medical information is added to the surgical video, its utilization value and asset value may increase.

[0005] Therefore, there is a need for a new method and system to prevent the forgery and tampering of medical video records, and to securely store and mediate transactions. In addition, there is a need for a method and system that can provide an uninterrupted medical video more quickly and stably during a surgical procedure. In addition, there is a need for a method and system that can more effectively provide a detailed surgical procedure video for reference to the doctor or medical staff performing the surgery. Summary of the Invention

[0006] Technical Problem

[0007] An object of the present invention is to provide a method and a system, for example, by dividing a video recording of a surgical scene into multiple video segments, and managing the connection link information and interval information of each video segment through a blockchain, thereby preventing the forgery and tampering of surgical videos, and preventing the tampering of the recorded surgical sequence or the destruction of surgical records.

[0008] In addition, another object of the present invention is to construct a system that effectively manages a surgical video recording while reducing the block data capacity by dividing the surgical video recording into multiple video segments and constructing blocks using a combination of connection link information and interval information.

[0009] In addition, another object of the present invention is to construct a medical video management system that transparently manages the use and transaction of recorded surgical videos through transactions based on smart contracts and can generate revenue therefrom.

[0010] In addition, another object of the present invention is to provide a method and system that use a cache server to reduce buffering when a doctor or medical staff performing a surgery references video playback and can transmit surgical videos more quickly and stably.

[0011] In addition, another object of the present invention is to provide a cache server system that can provide multiple segmented surgical video clips to a user terminal without delay in a stable streaming manner.

[0012] In addition, another object of the present invention is to provide a video transmission system that can generate and recommend the best surgical videos based on information related to the performed surgery.

[0013] In addition, another object of the present invention is to provide a surgical procedure video transmission system configured to determine detailed surgical procedures for a more effective and safer surgery based on past surgical record information and transmit multiple video clips generated based thereon.

[0014] In addition, another object of the present invention is to provide a method and system that use artificial intelligence technology to recommend the best detailed surgical procedures suitable for a surgical patient and sequentially provide detailed surgical procedure videos to medical staff based thereon.

[0015] The technical problems to be solved by the present invention are not limited to the above content, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art through the following description.

[0016] Technical Solution

[0017] According to an embodiment of the present invention, there is provided a surgical procedure video transmission system, which includes: a content server configured to store multiple surgical videos; a video clip management server configured to receive surgical-related information including the type of surgery and, based on the surgical-related information, segment and store the multiple surgical videos stored in the content server based on detailed surgical procedures; a surgical procedure determination server configured to determine detailed surgical procedures based on the type of surgery of a surgical patient and determine each video clip related to the detailed surgical procedures; and a user terminal configured to receive multiple video clips based on the detailed surgical procedures determined by the surgical procedure determination server.

[0018] In addition, the surgical procedure determination server may be configured to determine detailed surgical procedures based on the record information of multiple past surgical patients who have undergone the same type of surgery as the surgical patient.

[0019] In addition, the recorded information of the previous surgical patients may include at least one of gender, age, operation time, underlying diseases, other surgical histories, postoperative prognosis, and surgical recovery period.

[0020] In addition, the surgical procedure determination server may be configured to combine the detailed surgical procedures of a first previous surgical patient who has undergone the same type of surgery as the surgical patient and the detailed surgical procedures of a second previous surgical patient who has undergone the same type of surgery as the surgical patient to determine the detailed surgical procedures of the surgical patient.

[0021] In addition, the surgical procedure determination server may be configured to recommend the detailed surgical procedures of the surgical patient by using a learning model of artificial intelligence.

[0022] In addition, a cache server may be further included, which is configured to receive and store each video segment related to each detailed surgical procedure from the video segment management server, and transmit a plurality of video segments related to the detailed surgical procedure to the user terminal when receiving a detailed surgical procedure video request from the user terminal, and the cache server may be determined from a plurality of cache servers based on the proximity or response speed to the location of the user terminal.

[0023] In addition, the cache server may be configured to confirm the storage status of each video segment related to each detailed surgical procedure determined by the surgical procedure determination server, and for the video segments not stored in the cache server, receive and store the corresponding video segments from the video segment management server based on the surgical schedule of the surgical patient.

[0024] According to another embodiment of the present invention, there is provided a method for transmitting a surgical procedure video, which includes: storing a plurality of surgical videos in a content server; receiving surgical-related information including the type of surgery in a video segment management server, and based on the surgical-related information, segmenting and storing the plurality of surgical videos stored in the content server based on detailed surgical procedures; determining detailed surgical procedures based on the type of surgery of a surgical patient in a surgical procedure determination server, and determining each video segment related to each detailed surgical procedure; and receiving a plurality of video segments in a user terminal based on the detailed surgical procedures determined by the surgical procedure determination server.

[0025] Advantages of the Invention

[0026] According to the present invention, for example, by dividing a video recording of a surgical scene into multiple video segments and using blockchain to manage the connection link information and interval information of each video segment, a method and system can be provided that can prevent surgical videos from being forged and tampered with, and prevent the record of the surgical sequence from being tampered with or the surgical record from being destroyed.

[0027] In addition, according to the present invention, by dividing a surgical video recording into multiple video segments and constructing a block using a combination of connection link information and interval information, a system can be constructed that can effectively manage the surgical video recording while reducing the block data capacity.

[0028] In addition, according to the present invention, a medical video management system can be constructed by transparently managing the use and transaction of recorded surgical videos through transactions based on smart contracts and being able to generate revenue therefrom.

[0029] In addition, according to the present invention, a method and system can be provided that use a cache server to reduce buffering when a doctor or medical staff performing a surgery references video playback and can transmit the surgical video more quickly and stably.

[0030] In addition, according to the present invention, a cache server system can be provided that can provide multiple segmented surgical video segments to a user terminal without delay in a stable streaming manner.

[0031] In addition, according to the present invention, a video transmission system can be provided that can generate and recommend the best surgical video based on information related to the surgery being performed.

[0032] In addition, according to the present invention, a surgical procedure video transmission system can be provided that is configured to determine the detailed surgical procedure of a more effective and safer surgery based on past surgical record information and transmit multiple video segments generated based thereon.

[0033] In addition, according to the present invention, a method and system can be provided that use artificial intelligence technology to recommend the best detailed surgical procedure suitable for a surgical patient and sequentially provide detailed surgical procedure videos to medical staff based thereon.

[0034] The effects of the present invention are not limited to the above, and other effects not mentioned can be clearly understood by those of ordinary skill in the art through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is a conceptual diagram showing the configuration of a system for managing medical video records using blockchain according to an embodiment of the present invention.

[0036] Figure 2It is a block diagram for explaining the configuration of a medical video management server according to an embodiment of the present invention.

[0037] Figure 3 It is an example diagram showing the generation process of a block generated on a blockchain network for a plurality of video segments related to a medical video according to an embodiment of the present invention.

[0038] Figure 4 It is an example diagram for explaining the header structure of a block according to an embodiment of the present invention.

[0039] Figure 5 It is a flowchart for explaining a method for managing medical videos using a blockchain according to an embodiment of the present invention.

[0040] Figure 6 It is a conceptual diagram for explaining the configuration of a surgical video transmission system using a cache server according to an embodiment of the present invention.

[0041] Figure 7 It is a block diagram for explaining the configuration of a cache server according to an embodiment of the present invention.

[0042] Figure 8 It is an example diagram for explaining a method for providing a plurality of video segments related to a surgical video using a cache server according to an embodiment of the present invention.

[0043] Figure 9 It is a flowchart for explaining a surgical video transmission method using a cache server according to an embodiment of the present invention.

[0044] Figure 10 It is a conceptual diagram for explaining the configuration of a surgical step video transmission system using a cache server according to an embodiment of the present invention.

[0045] Figure 11 It is an example diagram for explaining the configuration of a detailed surgical step for recommending a surgical patient according to an embodiment of the present invention.

[0046] Figure 12 It is an example diagram for explaining a method for providing a detailed surgical step video using a cache server according to an embodiment of the present invention. Detailed Description of the Invention

[0047] Hereinafter, the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein.

[0048] The terms used in this specification are only for describing embodiments and are not intended to limit the present invention. In this specification, unless otherwise clearly stated in the text, the singular form also includes the plural form.

[0049] As used in this specification, "comprises" and "comprising" mean that the recited elements, steps, operations, and / or components are not excluded, and one or more other elements, steps, operations, and / or components may be present or added.

[0050] In addition, terms containing ordinal numbers (such as first, second, etc.) used in the present invention may be used to describe components, but the components should not be limited by these terms. These terms are only used to distinguish one component from another. In addition, when describing the present invention, if it is judged that the detailed description of related well-known technologies may obscure the gist of the present invention, the detailed description thereof will be omitted.

[0051] In addition, the components appearing in the embodiments of the present invention are independently shown to represent different characteristic functions from each other, and do not mean that each component is composed of separate hardware or a software component unit. That is, for convenience of description, each component is separately listed and described, and at least two components can be combined into one component, or one component can be divided into multiple components to perform functions. The combined embodiments and separated embodiments of these components are all included in the scope of the present invention as long as they do not depart from the essence of the present invention.

[0052] Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Through the following detailed description, the configuration of the present invention and its corresponding effects can be clearly understood.

[0053] Figure 1 It is a conceptual diagram showing the configuration of a system for managing medical video records using a blockchain according to an embodiment of the present invention.

[0054] The medical video management system may be composed of a medical video shooting unit (100), a medical video management server (200), and a blockchain network (300). The medical video shooting unit (100) can record videos related to surgeries, treatments, diagnoses, etc. in spaces such as operating rooms, treatment rooms, or diagnosis rooms within a hospital, and can be configured to transmit the medical videos recorded in this way to the medical video management server (200). The medical video shooting unit (100) can have multiple cameras in various forms or the form of a CCTV. For example, a head-mounted display (HMD) camera that medical staff such as doctors can wear, a camera installed in the operating room, an endoscope camera for endoscopic surgery, etc. For example, the camera installed in the operating room can be installed on the ceiling, specify the coordinates of each object in the initial real-time video to determine the initial position, and perform movement tracking by grasping the surgical scene and the actions of the surgeon in charge of the surgery, etc. In addition, image recognition technology can also be used to perform movement tracking on all objects such as surgical instruments captured, so as to automatically shoot and record the surgical scene.

[0055] The medical video management server (200) can be configured to receive medical videos related to surgeries or treatments recorded using the medical video shooting unit (100), generate a block on the blockchain network (300) based on the data related to the medical video, and update the block based on the new data related to the medical video. The medical video management server (200) can include a memory for storing and managing data, instructions, etc. related to each module configured for receiving and managing medical videos, and a processor for executing instructions, etc. A more specific configuration of the medical video management server (200) will be described with reference to Figure 2 be described.

[0056] The medical video management server (200) can be a server corresponding to any node among the blockchain nodes constituting the blockchain network (300), or can be a server for managing the blockchain network (300). Blockchain technology is a technology that stores and manages target data in a distributed data storage environment called a block, which is formed by connecting countless small-scale data in a chain-like form in a P2P (Peer-to-Peer) manner, so that no one can modify it arbitrarily, and anyone can view the change results. All transaction records or status information, etc. propagated to users before the block is discovered are recorded in the block, and this is also transmitted to all users in a P2P manner, so transaction records or status information, etc. cannot be modified or omitted arbitrarily. In the present invention, the data or data set used for medical video management stored and updated through the blockchain network (300) is called a "block".

[0057] Figure 2 is a block diagram for explaining the configuration of a medical video management server according to an embodiment of the present invention.

[0058] The medical video management server (200) may include a video receiving unit (210), a video segmentation unit (220), a connection link management unit (230), a block generation processing unit (240), a block update processing unit (250), a contract processing unit (260), etc. These components may include programs or program modules that can be executed by one or more processors. The programs or program modules included in the medical video management server (200) may be formed in the form of an operating system, an application program, or a program, etc., and may be physically stored on various widely used storage devices. Such programs or program modules may include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing specific tasks or processing specific data types, but are not limited to these forms.

[0059] First, the video receiving unit (210) is configured to receive medical videos related to surgeries or treatments recorded using the medical video shooting unit (100), and may be connected to the medical video shooting unit (100) via wired or wireless Internet.

[0060] The video segmentation unit (220) is configured to segment the medical video into multiple video clips, and may generate and sequentially record blocks corresponding to the information of each video clip through the block generation processing unit (240) based on the data related to the multiple segmented video clips. For example, the video segmentation unit (220) may sequentially generate multiple video clips from one medical video based on the timestamp information set in each interval within the medical video. For example, the timestamp information may be distinguished by the surgeon or medical staff performing the surgery according to the detailed steps within the surgery and set for each step, or may be automatically set using artificial intelligence technology, etc. In addition, the multiple video clips may further include tag information inserted into the recorded surgical video, and the tag information may include at least one of the surgical subject, comments related to the surgical situation, surgical sequence, surgical instruments, and surgical related events. Such tag information may be associated with each timestamp information and input by medical staff, etc., or relevant information may be automatically input using artificial intelligence technology, etc.

[0061] The block generation processing unit (240) can be configured to generate blocks on the blockchain network (300) based on data related to medical videos. For example, it can be configured to generate new blocks for each of multiple video segments. In addition, the header of the generated block can contain information related to the connection links that can access each of the multiple video segments. Further, the header of the generated block can further contain interval information generated based on timestamp information of the start and end time points of each of the multiple video segments.

[0062] The block update processing unit (250) can be configured to update block information of the generated block based on tag information, etc. For example, it can include additional information such as tag information corresponding to each video segment, viewing records, transaction records, usage records, etc. For example, it can track the log records of visitor information, access IP information, and access time information accessed through the connection link of the video segment, and record such access information in the body of the block corresponding to the video segment for update.

[0063] The contract processing unit (260) is configured to sign various transaction contracts for using medical videos and handle related processes, and such transaction contracts can be configured with smart contracts to settle fees according to preset transaction conditions. The contract processing unit (260) can be configured to generate blocks for smart contracts on the blockchain network (300) based on data related to the use of medical videos through smart contracts, and can include information on the usage period of the medical video, that is, information on the start date and end date, information related to the access and editing permissions of the video, etc.

[0064] Figure 3 It is an example diagram showing the generation process of blocks generated on the blockchain network for multiple video segments related to medical videos according to an embodiment of the present invention.

[0065] Refer to Figure 3 , for example, medical videos related to stent implantation or surgery can be segmented into 4 video segments according to each step, that is, 1) surgical preparation and anesthesia, 2) catheter insertion, 3) balloon dilation, 4) catheter removal and stent installation. Each video segment can contain interval information related to the start time and end time of t1t2, t2t3, t3t4, t4t5 as timestamp information, and different accessible connection links can be assigned to each of the segmented video segments, so as to generate information related to the connection links corresponding to each video segment, that is, connection link information. Multiple blocks containing their respective connection link information and time interval information can be generated for each of the multiple video segments of the medical video segmented in this way in sequence.

[0066] Figure 4 This is an example diagram for explaining the header structure of a block according to an embodiment of the present invention.

[0067] The structure of a block generally consists of a block hash that acts as a block identifier, a header with basic information, and a body with transaction information, etc. Here, the header usually contains information such as version, the hash of the previous block, Merkle root, time, difficulty target, nonce, etc. According to the block of the present invention, the header can further include connection link information related to connection links for accessing each of multiple video segments, and interval information generated based on timestamp information of the start and end time points of each of the multiple video segments.

[0068] Through such a block structure, the link information for accessing surgical video segments or static screenshots is matched with each of the segmented and dispersed ledgers and recorded using a blockchain, thereby preventing the medical video record from being tampered with. For example, the link information can be encrypted, and the storage space storing the video or static screenshot can be set to a non-modifiable read-only mode, so that the video at the access location cannot be changed.

[0069] The present invention divides a surgical video recording into multiple video segments and constructs blocks using a combination of connection link information and interval information, thereby providing a system that can effectively manage surgical video recordings while reducing the block data capacity, and can solve the problems of discarding surgical records due to the expiration of the storage period or tampering with the main content of related surgeries.

[0070] Figure 5 This is a flowchart for explaining a method for managing medical videos using a blockchain according to an embodiment of the present invention.

[0071] Referring to Figure 5 , first, the medical video captured and recorded by the medical video shooting unit (100) can be received by the video receiving unit (210) of the medical video management server (200) (S510).

[0072] The medical video management server (200) can sequentially divide the medical video into multiple video segments through the video segmentation unit (220) (S520).

[0073] The medical video management server (200) can generate connection links for multiple video segments through the connection link management unit (230) and can generate interval information for each video segment (S530).

[0074] The medical video management server (200) can sequentially record data related to a plurality of video segments in blocks through a block generation processing unit (240) (S540). At this time, the header of the block can include link information related to a link for accessing each of the plurality of video segments, and section information generated based on timestamp information of start and end time points of each of the plurality of video segments.

[0075] In addition, the medical video management server (200) can perform block update based on tag information related to a plurality of video segments through a block update processing unit (250) (S550). For example, the corresponding block can be updated based on additional information, viewing records, transaction records, usage records, etc. corresponding to the tag information of each video segment.

[0076] In addition, the medical video management server (200) can track log records of visitor information, access IP information, and access time information (S560). By tracking access-related information accessed through the link, access information can be monitored. In addition, the corresponding block can be updated based on such access-related information to prevent access records from being tampered with.

[0077] Figure 6 It is a conceptual diagram for explaining the configuration of a surgical video transmission system using a cache server according to an embodiment of the present invention.

[0078] Refer to Figure 6, the user terminal (400) is a device used by users such as doctors or medical staff who perform surgeries, treatments, diagnoses, etc. For example, it can be connected to a content server (600), a cache server (700), a video clip management server (800), etc. Specifically, it can be any one of a smart phone, a tablet computer, a desktop computer, a laptop computer, a notebook, a workstation, a personal digital assistant (PDA), a portable computer, a wireless phone, a mobile phone, an e-book, a portable multimedia player (PMP), a portable game console, a digital camera, a television, a wearable device, a head-mounted display (HMD), an artificial intelligence (AI) speaker, but not limited to these. In addition, the user terminal (400) may include a display unit for providing a medical video screen, or may have a form connected to and controllable by the display unit.

[0079] The user terminal (400) is configured to communicate with various servers, such as a content server (600), a cache server (700), and a video segment management server (800), via a network (500). The network (500) is a component for wired / wireless communication for data transmission and reception between the user terminal (400) and multiple servers (600, 700, 800). When the network is a wireless communication network, it may include cellular communication or short-range communication. For example, cellular communication may include at least one of LTE (Long-Term Evolution), LTE-A (LTE Advanced), 5G (5th Generation), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile Telecommunications System), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications). In addition, short-range communication may include at least one of Wi-Fi (Wireless Fidelity), Bluetooth, Zigbee, NFC (Near Field Communication), or RFID (Radio Frequency Identification). However, the communication method is not limited to this and will also include wireless communication technologies developed in the future.

[0080] Next, the content server (600) may be configured to store multiple surgical videos. For example, it may be configured to store videos related to surgeries, treatments, diagnoses, etc., recorded via various forms of cameras in spaces such as operating rooms, treatment rooms, or examination rooms in a hospital by the medical video capture unit (100).

[0081] The cache server (700) may be configured to receive and store at least a portion of the surgical videos related to the surgery from the content server (600), and transmit at least a portion of the surgical videos to the user terminal (400) when a reference video request is received from the user terminal (400). In addition, the cache server (700) may select the most favorable cache server from multiple cache servers based on the proximity or response speed to the location of the user terminal (400).

[0082] The video clip management server (800) can be configured to receive surgical-related information including the surgical date and the type of surgery, determine the surgical video related to the surgery among multiple surgical videos stored in the content server (600) based on the surgical-related information, and split the relevant surgical video into multiple video clips with a capacity below a predetermined value.

[0083] The multiple video clips split in this way are generated in sequence based on the timestamp information of each interval within the surgical video. The video clip management server (800) can be configured to transfer at least one video clip corresponding to the beginning part among the multiple video clips to the cache server (700).

[0084] In addition, the video clip management server (800) can be configured to transfer at least one video clip to the cache server (700) before the surgical date based on a predetermined surgical date. For example, based on a predetermined criterion, the corresponding video clip can be transferred to the cache server (700) one day or one hour before the corresponding surgical date for storage in the cache server (700).

[0085] In addition, the video clip management server (800) can be configured to determine the relevant surgical video among multiple surgical videos stored in the content server (600) based on the similarity judgment with the reference video information previously used by the user terminal (400). That is, the historical data previously referred to or searched by the user of the user terminal (400) can be used to determine the surgical video that may be referred to during the surgery.

[0086] In addition, when more than a predetermined proportion of at least one video clip is streamed on the user terminal (400), it is determined that the user is referring to the video clip. The cache server (700) can be configured to request, receive, and store the remaining video clips of the video clip except for the beginning part from the video clip management server (800). Thus, by pre-storing the remaining video clips in the cache server (700), the transmission delay when the user terminal (400) views the surgical video stream can be minimized.

[0087] In addition, when all the multiple video clips are completely streamed on the user terminal (400), the cache server (700) can be configured to transfer at least a part of the second surgical video corresponding to the next sequence of the transmitted surgical video to the user terminal (400). In addition, when more than a predetermined proportion of at least one video clip or all video clips of the second surgical video are streamed on the user terminal (400), it is determined that the user is referring to the video clip in the second surgical video. The cache server (700) can be configured to request, receive, and store the remaining video clips of the multiple video clips except for the above-mentioned beginning part from the video clip management server (800).

[0088] In addition, the video clip management server (800) can be configured to perform video analysis on multiple video clips through artificial intelligence technology or the like, and determine at least one main video clip among the multiple video clips based on at least one of the movement of surgical instruments, the amount of bleeding, and the degree of change of organs related to the surgery, and transmit the main video clip among the multiple video clips to the cache server (700). In this way, the video clip management server (800) determines the main video clip judged to be important among the multiple video clips, and transmits only the main video clip to the cache server (700), so that the limited storage space of the cache server (700) can be effectively utilized.

[0089] Figure 7 It is a block diagram for explaining the configuration of a cache server according to an embodiment of the present invention.

[0090] Referring to Figure 7 , the video clip management server (800) according to the present invention may include a surgical information receiving unit (810), a surgical video determining unit (820), a video segmentation processing unit (830), a video transmission processing unit (840), etc. These components may include programs or program modules that can be executed by one or more processors. The programs or program modules included in the video clip management server (800) may be formed in the form of an operating system, an application program, or a program, etc., and can be physically stored on various widely used storage devices. Such programs or program modules may include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing specific tasks or executing specific data types, but are not limited to these forms.

[0091] First, the surgical information receiving unit (810) can be configured to receive surgical-related information including relevant information such as the surgical date, surgical object, surgical location, and surgical type from the user terminal (400) or other servers or terminals that manage surgical information.

[0092] The surgical video determination unit (820) is configured to determine a surgical video to be provided to the user terminal (400) as a surgical reference video, and may be configured to determine a relevant surgical video from among a plurality of surgical videos stored in the content server (600) based on received surgical-related information. In addition, the surgical video determination unit (820) may use the previous history information of the user terminal (400) to determine a relevant surgical video from among a plurality of surgical videos stored in the content server (600) based on a similarity determination with the reference video information previously used by the user of the user terminal (400) for this type of surgery.

[0093] In addition, the surgical video determination unit (820) may be configured to, through artificial intelligence technology or the processing of an operator, use video analysis of a plurality of video segments to determine at least one main video segment from among the plurality of video segments based on at least one of the movement of surgical instruments, the amount of bleeding, and the degree of change in organs related to the surgery, and to transmit only the main video segment from among the plurality of video segments to the cache server (700). In this way, the main video segment determined to be important among the plurality of video segments is determined and only this main video segment is transmitted to the cache server (700), so that the limited storage space of the cache server (700) can be effectively utilized, and medical staff can refer only to the main video segment within a limited time, thus effectively utilizing time.

[0094] The video segmentation processing unit (830) may be configured to segment the relevant surgical video determined by the surgical video determination unit (820) into a plurality of video segments with a capacity below a predetermined value. At this time, the plurality of video segments are sequentially generated based on the timestamp information of each interval within the surgical video, and the video segment management server (800) may be configured to transmit at least one video segment corresponding to the beginning part among the sequentially generated plurality of video segments to the cache server (700) through the video transmission processing unit (840).

[0095] The video transmission processing unit (840) is configured to perform transmission processing and transmission plan management for transmitting videos to the cache server (700), and may determine one cache server connected to the user terminal (400) based on the proximity to the location of the user terminal (400) or the response speed of each cache server. In addition, the video transmission processing unit (840) may be configured to transmit at least one video segment to the cache server (700) before the surgery date based on the surgery date information included in the surgical-related information.

[0096] Figure 8 It is an example diagram for explaining a method for using a cache server to provide a plurality of video segments related to a surgical video according to an embodiment of the present invention.

[0097] For example, a scheduled surgery may include two types of surgeries and may include a plan to sequentially perform a first surgery video related to the first surgery and a second surgery video related to the second surgery.

[0098] First, the first surgery video related to the first surgery and determined as a reference video may be five video segments sequentially generated based on the timestamp information (t1 to t6) of each interval, and the first video segment and the second video segment corresponding to the beginning part may have been pre-stored in the cache server. At this time, if, for example, through the user terminal (400) beyond the time point t2, all the streaming transmissions of the first video segment are completed and watched, the cache server (700) may be configured to request and receive subsequent video segments, such as the third video segment, the fourth video segment, and the fifth video segment, from the video segment management server (800) and store them. In this way, according to the viewing status of the segmented video segments, subsequent video segments are pre-transferred to the cache server (700) and stored in advance, so that it is possible to ensure that the surgery video watched by the user can be played without delay.

[0099] On the other hand, if the video streaming ends before the predetermined standard, that is, the time point t2, through the user terminal (400), it is determined that the reference video is not needed, and the cache server (700) may be configured not to request subsequent video segments, such as video segments after the third video segment. In addition, in order to effectively manage the storage capacity of the cache server (700), for the corresponding video segments whose video streaming ends before a certain time point, it may be determined that they are not the objects of concern of the user and configured to be all deleted.

[0100] In addition, when the streaming viewing of the first surgery video is completed through the user terminal (400), the cache server (700) may be configured to transmit at least a part of the second surgery video corresponding to the next sequence, that is, the video segment of the beginning part, to the user terminal (400). At this time, if the video segment of the beginning part of the second surgery video is not stored in the cache server (700), for example, before the viewing of the first surgery video ends, for example, at the time point t4 or t5, the cache server (700) may be configured to request and receive the video segment of the beginning part of the second surgery video from the video segment management server (800) and pre-store it.

[0101] Figure 9 It is a flowchart for explaining a method for transmitting a surgery video using a cache server according to an embodiment of the present invention.

[0102] First, multiple surgery videos may be stored in the content server (600) (S910). At this time, the surgery video may simultaneously include the type of the surgery, the surgical object, the timestamp information of each interval, and the tag information, etc.

[0103] The video clip management server (800) can receive surgical-related information (S920) including the surgical date and surgical type through the surgical information receiving unit (810).

[0104] The video clip management server (800) can determine relevant surgical videos (S930) based on the surgical-related information through the surgical video determination unit (820).

[0105] The video clip management server (800) can divide the surgical video into multiple video clips (S940) through the video segmentation processing unit (830). For example, the surgical video can be multiple video clips sequentially generated based on the timestamp information of each interval.

[0106] The video clip management server (800) can determine a cache server (700) connected to the user terminal (400) based on the proximity to the user terminal (400) or the response speed of each cache server through the video transmission processing unit (840) (S950).

[0107] The determined cache server (700) can receive and store partial video clips of the relevant surgical video from the video clip management server (800) (S960).

[0108] When receiving a surgical reference video request from the user terminal (400), partial video clips can be provided in a streaming manner through the determined cache server (700) (S970).

[0109] In addition, the remaining video clips after the partial video clips can be requested from the user terminal (400) and provided in a streaming manner through the cache server (700) (S980). When streaming multiple clips at the beginning part of the surgical video through the user terminal (400) until exceeding a specific ratio, the cache server (700) can request and receive the subsequent remaining video clips from the video clip management server (800) and store them, so as to ensure that the entire video can be viewed without delay.

[0110] Figure 10 It is a conceptual diagram for explaining the configuration of a surgical step video transmission system using a cache server according to an embodiment of the present invention.

[0111] Figure 10 The surgical step video transmission system is in Figure 6 the form of adding a surgical step determination server (900) on the basis of the configuration of the surgical video transmission system using a cache server shown.

[0112] Here, the content server (600) can be configured to store multiple surgical videos.

[0113] The video clip management server (800) can be further configured to receive surgical-related information including the type of surgery, and based on the received surgical-related information, segment and store multiple surgical videos stored in the content server (600) based on detailed surgical steps.

[0114] The surgical step determination server (900) can be configured to determine detailed surgical steps based on the type of surgery of the surgical patient, and determine each video clip related to each detailed surgical step.

[0115] In addition, the surgical step determination server (900) can be configured to determine detailed surgical steps based on the record information of multiple previous surgical patients who have undergone the same type of surgery as the current surgical patient. In addition, the record information of the previous surgical patients can include at least one of gender, age, surgery time, underlying diseases, other surgical history, postoperative prognosis, and surgical recovery period. That is, when determining detailed surgical steps, the record information of previous surgical patients can be used to utilize surgical steps and conditions that are similar to the current patient's conditions and have good prognosis and recovery periods.

[0116] In addition, the surgical step determination server (900) can be configured to combine the detailed surgical steps of multiple previous surgical patients to determine detailed surgical steps. For example, it can be configured to combine the detailed surgical steps of a first previous surgical patient who has undergone the same type of surgery as the current surgical patient and the different detailed surgical steps of a second previous surgical patient who has undergone the same type of surgery as the current surgical patient to determine the detailed surgical steps of the current surgical patient.

[0117] In addition, the surgical step determination server (900) can use an artificial intelligence-based learning model, utilize the record information of previous patients, derive detailed surgical steps with the best prognosis and recovery period under conditions similar to the current patient, and be configured to recommend the best detailed surgical steps to the current surgical patient through the artificial intelligence learning model.

[0118] The cache server (700) can be configured to receive and store each of multiple video clips related to each detailed surgical step from the video clip management server (800), and when receiving a detailed surgical step video request from the user terminal (400), transmit multiple video clips related to the detailed surgical steps determined by the surgical step determination server (900) to the user terminal (400). At this time, the cache server (700) can determine the cache server located in the best position based on the proximity or response speed to the location of the user terminal (400).

[0119] In addition, the cache server (700) can be configured to confirm the storage status of each video segment related to each detailed surgical step determined by the surgical step determination server (900), and for video segments not stored in the cache server (700), based on the surgical schedule of the surgical patient, receive and store the corresponding video segments from the video segment management server (800). For example, the cache server (700) can confirm the storage status of each video segment related to each detailed surgical step, such as 1 hour or one day before the surgical date of the surgical patient. For non-stored video segments, it requests from the video segment management server (800) and pre-stores the corresponding video segments before the surgical date.

[0120] The user terminal (400) can be configured to receive multiple video segments based on the detailed surgical steps determined by the surgical step determination server (900).

[0121] Figure 11 It is an example diagram for explaining the configuration of recommending detailed surgical steps for a surgical patient according to an embodiment of the present invention.

[0122] One surgery can be divided into detailed surgical steps of multiple stages, and video segments can be segmented for each detailed surgical step. In Figure 11 it is assumed that Patient 1, Patient 2, and Patient 3 have records of having previously undergone the same type of surgery, while Patient 4 plans to undergo the same type of surgery.

[0123] For example, by viewing the previous surgical records of Patient 1, it has 3 stages of detailed surgical steps consisting of Step A, Step B, and Step C, while the previous surgical record of Patient 2 has added Step D between Step A and Step B, with a total of 4 stages of detailed surgical steps. In addition, in the previous surgical record of Patient 3, Step E has been added after Step A, Step B, and Step C, with a total of 4 stages of detailed surgical steps. Thus, even for the same type of surgery, depending on the patient's condition and surgical situation, it is possible that some detailed surgical steps may be added or changed, and by accumulating such surgical data, a probabilistic judgment can be made on the results of the detailed surgical steps.

[0124] For patient 4 who is scheduled to undergo the same type of surgery as patients 1 to 3, the detailed surgical steps determined by the surgical step determination server (900) are in the form of a combination of the detailed surgical steps of patients 1 to 3, including the detailed surgical steps of a total of 5 stages consisting of step A, step D, step B, step C, and step E, and detailed surgical step videos corresponding to these 5 stages can be provided to medical staff as reference videos. The recommendation and determination of such detailed surgical steps can, for example, use an artificial intelligence-based learning model, utilize the recorded information of previous patients, derive the detailed surgical steps with the best prognosis and recovery period under conditions similar to the current patient, and can find the detailed surgical step conditions with the best prognosis and recovery conditions under patient environmental conditions such as the same gender, similar age, and similar underlying diseases for recommendation.

[0125] Figure 12 It is an example diagram for explaining a method for using a cache server to provide a detailed surgical step video according to an embodiment of the present invention.

[0126] Refer to Figure 12 , the detailed surgical steps of patient 4 determined by the surgical step determination server (900) may include the A-step video, B-step video, and C-step video of the surgical video of patient 1, and may also include the D-step video in the surgical video of patient 2.

[0127] At this time, the cache server (700) can first confirm the storage status of the surgical video of patient 1 and the D-step video in the surgical video of patient 2 before the surgery date of the surgical patient. For example, as Figure 12 shown, if it is determined that although the A-step video, B-step video, and C-step video of the surgical video of patient 1 are stored, but the D-step video in the surgical video of patient 2, which is determined to be the detailed surgical step to be referred to, is not stored, the cache server (700) can request the video segment management server (800) to transmit the D-step video in the surgical video of patient 2. At this time, based on the surgical schedule of patient 4, the video transmission time can be arranged so that the D-step video of patient 2 can be received and stored by the cache server (700) before the surgery date.

[0128] Although the various methods and systems according to the embodiments of the present invention have been described as specific various embodiments above, this is only for illustration, and the present invention is not limited thereto, and should be interpreted as having the broadest scope following the basic idea disclosed in this specification. Those skilled in the art can combine and replace the disclosed embodiments to implement patterns of shapes that are not explicitly shown, but this also does not depart from the scope of the present invention. In addition, those skilled in the art can easily change or deform the disclosed embodiments based on this specification, and such changes or deformations also clearly belong to the scope of the rights of the present invention.

Claims

1. A surgical procedure video transmission system, characterized in that, it includes: A content server configured to store multiple surgical videos; A video segment management server configured to receive surgical-related information including the type of surgery, and based on the surgical-related information, segment and store the multiple surgical videos stored in the content server based on detailed surgical procedures; A surgical procedure determination server configured to determine detailed surgical procedures based on the type of surgery of the surgical patient, and determine each video segment related to each detailed surgical procedure; and A user terminal configured to receive multiple video segments based on the detailed surgical procedures determined by the surgical procedure determination server; and, It further includes a cache server, which is configured to receive and store each video segment related to each detailed surgical procedure from the video segment management server, and when receiving a detailed surgical procedure video request from the user terminal, transmit multiple video segments related to the detailed surgical procedure to the user terminal. The cache server is determined from multiple cache servers based on proximity or response speed to the location of the user terminal; The cache server is configured to confirm the storage status of each video segment related to each detailed surgical procedure determined by the surgical procedure determination server, and for video segments not stored in the cache server, based on the surgical schedule of the surgical patient, receive and store the corresponding video segments from the video segment management server before the surgical date of the surgical patient.

2. The surgical procedure video transmission system according to claim 1, characterized in that, The surgical procedure determination server is configured to determine detailed surgical procedures based on the record information of multiple previous surgical patients who have undergone the same type of surgery as the surgical patient.

3. The surgical procedure video transmission system according to claim 2, characterized in that, The record information of the previous surgical patients includes at least one of gender, age, surgical time, underlying diseases, other surgical histories, postoperative prognosis, and surgical recovery period.

4. The surgical procedure video transmission system according to claim 2, characterized in that, The surgical procedure determination server is configured to combine the detailed surgical procedures of a first previous surgical patient who has undergone the same type of surgery as the surgical patient and the detailed surgical procedures of a second previous surgical patient who has undergone the same type of surgery as the surgical patient to determine the detailed surgical procedures of the surgical patient.

5. The surgical procedure video transmission system according to claim 4, characterized in that, The surgical procedure determination server is configured to recommend the detailed surgical procedures of the surgical patient by using a learning model of artificial intelligence.

6. A surgical procedure video transmission method, characterized in that, it includes: The step of storing multiple surgical videos in a content server; The step of receiving surgical-related information including the type of surgery in a video segment management server, and based on the surgical-related information, segmenting and storing the multiple surgical videos stored in the content server based on detailed surgical procedures; The step of determining detailed surgical procedures based on the type of surgery of the surgical patient in the surgical procedure determination server, and determining each video segment related to each detailed surgical procedure; And The step of receiving multiple video segments in the user terminal based on the detailed surgical procedures determined by the surgical procedure determination server; And Further includes the step of receiving and storing in the cache server each video segment related to each detailed surgical procedure from the video segment management server, and when receiving a detailed surgical procedure video request from the user terminal, transmitting multiple video segments related to the detailed surgical procedure to the user terminal, and the cache server is determined from multiple cache servers based on the proximity or response speed to the location of the user terminal; Further includes the step of confirming the storage status of each video segment related to each detailed surgical procedure determined by the surgical procedure determination server in the cache server, and for the video segments not stored in the cache server, receiving and storing the corresponding video segments from the video segment management server before the surgical date of the surgical patient based on the surgical schedule of the surgical patient.

Images