Surgery stage video transmission method and system using the same

Abstract

According to the present invention, a surgery stage video transmission system can be provided, which includes: a content server configured to store a plurality of surgery videos; a video fragment management server configured to receive surgery-related information including a surgery type and divide and store the plurality of surgery videos stored in the content server based on the surgery-related information based on detailed surgery stages; a surgery stage determination server configured to determine detailed surgery stages based on the surgery type of a surgical patient and to determine video fragments associated with each detailed surgery stage; and a user terminal configured to receive a plurality of video fragments based on the detailed surgery stages determined by the surgery stage determination server.

Description

[Technical Field]

[0001] [1] The present invention relates to a method and system for transmitting surgical stage images, and more particularly to a method and system for generating and providing surgical images related to optimal detailed surgical stages based on surgery-related information. [Background technology]

[0002] [2] Recently, as multimedia technology has rapidly developed and is being used in various fields, technology has been developed in the medical field as well, allowing doctors to record surgical procedures on patients and present them at medical conferences or for other purposes.

[0003] [3] In addition, surgical footage is often recorded for surgical records and to protect against potential medical disputes. During endoscopic surgery, such as on joints, doctors often use ultra-small cameras to visually confirm lesions and perform diagnosis and treatment. Recently, most medical devices are equipped with video recording capabilities, and the number of surgical footage being recorded is rapidly increasing.

[0004] [4] Such recorded surgical videos can be used in a variety of ways by other doctors, patients, researchers, etc. In particular, if various medical information is added to the surgical videos, their use and asset value can increase.

[0005] [5] Accordingly, new methods and systems are needed to prevent tampering with medical video records and to enable safe storage and transaction. Also, methods and systems are needed to provide medical video more quickly and stably without interruption during surgery. Furthermore, methods and systems are needed to more effectively provide detailed surgical stage video for reference by surgeons and medical staff during surgery. Summary of the Invention [Problem to be solved by the invention]

[0006] [6] The present invention aims to provide a method and system that can prevent the forgery of surgical footage, for example, by separating recorded footage of a surgical scene into multiple fragmented footage and managing the connection link information and section information of each fragmented footage using a blockchain, and can prevent recording manipulation of the surgical procedure and the disposal of surgical records.

[0007] [7] The present invention also aims to construct a system that can efficiently manage surgical recording video while reducing the volume of block data by dividing the surgical recording video into multiple fragmented videos and configuring these into blocks using a combination of connection link information and section information.

[0008] [8] The present invention also aims to build a medical video management system that transparently manages the use and trading of recorded surgical videos through transactions via smart contracts, thereby enabling monetization.

[0009] [9] Another object of the present invention is to provide a method and system that can reduce buffering during video playback and transmit surgical video more quickly and stably using a cache server, which can be used as a reference by doctors and medical staff performing surgery.

[0010]

[10] Another object of the present invention is to provide a cache server system that can provide multiple fragmented surgical videos to a user terminal in a stable streaming manner without delay.

[0011]

[11] Another object of the present invention is to provide a video transmission system that can generate and recommend optimal surgical videos based on ongoing surgery-related information.

[0012]

[12] Another object of the present invention is to provide a surgical stage video transmission system configured to determine detailed surgical stages for more efficient and safer surgery based on past surgical record information and transmit multiple video fragments generated based on the determined detailed surgical stages.

[0013]

[13] Another object of the present invention is to provide a method and system that can use artificial intelligence technology to recommend the optimal detailed surgical steps suitable for a surgical patient and sequentially provide detailed surgical step images based on this to medical staff.

[0014]

[14] The problems to be solved by the present invention are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description. [Means for solving the problem]

[0015]

[15] According to one embodiment of the present invention, a surgical stage video transmission system can be provided, which includes: a content server configured to store a plurality of surgical videos; a video fragment management server configured to receive surgery-related information including a surgery type, and divide and store the plurality of surgical videos stored in the content server based on the surgery-related information based on detailed surgical stages; a surgical stage determination server configured to determine detailed surgical stages based on the surgery type of a surgical patient and to determine each video fragment associated with each detailed surgical stage; and a user terminal configured to receive a plurality of video fragments based on the detailed surgical stages determined by the surgical stage determination server.

[0016]

[16] The surgery stage determination server may also be configured to determine detailed surgery stages based on record information of multiple previous surgical patients who underwent the same surgery type as the surgical patient.

[0017]

[17] In addition, the record information of the past surgical patient may include at least one of the following: gender, age, time of surgery, underlying diseases, other surgical history, post-operative prognosis, and surgical recovery period.

[0018]

[18] The surgery stage determination server may be configured to determine the detailed surgery stage of the surgical patient by combining the detailed surgery stage of a first previous surgical patient who underwent the same surgery type as the surgical patient and the detailed surgery stage of a second previous surgical patient who underwent the same surgery type as the surgical patient.

[0019]

[19] The surgical staging server may also be configured to recommend detailed surgical staging for the surgical patient through an artificial intelligence learning model.

[0020]

[20] The system further includes a cache server configured to receive and store each video fragment related to each detailed surgical step from the video fragment management server, and, when a detailed surgical step video is requested from the user terminal, to transmit a plurality of video fragments related to the detailed surgical step to the user terminal, and the cache server may be determined from among a plurality of cache servers based on proximity to the location of the user terminal or response speed.

[0021]

[21] The cache server may also be configured to check whether each video fragment related to each detailed surgical stage determined by the surgical stage determination server is stored, and for video fragments that are not stored in the cache server, to receive and store the corresponding video fragments from the video fragment management server based on the surgical schedule of the surgical patient.

[0022]

[22] According to another embodiment of the present invention, there can be provided a method for transmitting surgical stage videos, including the steps of: storing a plurality of surgical videos in a content server; receiving surgery-related information including a surgery type in a video fragment management server, and dividing and storing the plurality of surgical videos stored in the content server based on the detailed surgical stages based on the surgery-related information; determining detailed surgical stages based on the surgery type of the surgical patient in a surgical stage determination server and determining each video fragment associated with each detailed surgical stage; and receiving a plurality of video fragments in a user terminal based on the detailed surgical stages determined by the surgical stage determination server. [Effects of the Invention]

[0023]

[23] According to the present invention, for example, by separating a recorded video of a surgical scene into multiple fragmented videos and managing the connection link information and section information of each fragmented video using a blockchain, it is possible to provide a method and system that can prevent the forgery of surgical videos and prevent recording manipulation of the surgical procedure order and the disposal of surgical records.

[0024]

[24] Furthermore, according to the present invention, by dividing the surgical recording video into multiple fragmented videos and configuring these into blocks using a combination of connection link information and section information, it is possible to construct a system that can efficiently manage the surgical recording video while reducing the volume of block data.

[0025]

[25] Furthermore, according to the present invention, a medical video management system can be constructed that transparently manages the use and trading of recorded surgical videos through transactions via smart contracts, thereby enabling monetization.

[0026]

[26] Furthermore, the present invention provides a method and system that can reduce buffering during video playback using a cache server, which can be used as a reference by doctors and medical staff performing surgery, and can transmit surgical videos more quickly and stably.

[0027]

[27] Furthermore, according to the present invention, it is possible to provide a cache server system that can provide multiple fragmented images of surgical videos to a user terminal in a stable streaming manner without delay.

[0028]

[28] Furthermore, according to the present invention, it is possible to provide a video transmission system that can generate and recommend optimal surgical videos based on information related to ongoing surgery.

[0029]

[29] Furthermore, according to the present invention, a surgical stage video transmission system can be provided that is configured to determine detailed surgical stages for a more efficient and safer surgery based on past surgical record information, and to transmit multiple video fragments generated based on the determined detailed surgical stages.

[0030]

[30] In addition, the present invention provides a method and system that uses artificial intelligence technology to recommend the optimal detailed surgical steps suitable for a surgical patient and sequentially provides detailed surgical step images based on the recommendation to medical staff.

[0031]

[31] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. [Brief explanation of the drawings]

[0032] [Figure 1]

[32] Figure 1 is a conceptual diagram showing the configuration of a system for managing medical video records using blockchain according to one embodiment of the present invention.

[0033] [Figure 2]

[33] FIG. 2 is a block diagram illustrating the configuration of a medical image management server according to one embodiment of the present invention.

[0034] [Figure 3]

[34] Figure 3 is an illustrative diagram showing the generation of blocks on a blockchain network for multiple video fragments related to medical video according to one embodiment of the present invention.

[0035] [Figure 4]

[35] FIG. 4 is an exemplary diagram illustrating a header structure of a block according to one embodiment of the present invention.

[0036] [Figure 5]

[36] Figure 5 is a flowchart illustrating a method for managing medical images using blockchain according to one embodiment of the present invention.

[0037] [Figure 6]

[37] FIG. 6 is a conceptual diagram illustrating the configuration of a surgical video transmission system using a cache server according to one embodiment of the present invention.

[0038] [Figure 7]

[38] FIG. 7 is a block diagram illustrating the configuration of a cache server according to one embodiment of the present invention.

[0039] [Figure 8]

[39] FIG. 8 is an exemplary diagram illustrating a method for providing multiple video fragments related to surgical videos using a cache server according to one embodiment of the present invention.

[0040] [Figure 9]

[40] FIG. 9 is a flowchart illustrating a surgical video transmission method using a cache server according to one embodiment of the present invention.

[0041] [Figure 10]

[41] FIG. 10 is a conceptual diagram illustrating the configuration of a surgery stage video transmission system using a cache server according to an embodiment of the present invention.

[0042] [Figure 11]

[42] FIG. 11 is an exemplary diagram illustrating a configuration for recommending detailed surgical steps for a surgical patient according to one embodiment of the present invention.

[0043] [Figure 12]

[43] FIG. 12 is an exemplary diagram illustrating a method for providing detailed surgical step images using a cache server according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0044]

[44] The present invention will now be described in detail with reference to the accompanying drawings so that those skilled in the art can easily practice the invention. However, the present invention may be embodied in many different forms and is not limited to the embodiments set forth herein.

[0045]

[45] The terms used herein are for the purpose of describing embodiments only and are not intended to limit the invention. In this specification, the singular forms "a," "an," and "the" include the plural forms unless the context clearly dictates otherwise.

[0046]

[46] As used herein, "comprises" and "comprising" mean that a referenced component, step, operation and / or element does not exclude the presence or addition of one or more other components, steps, operations and / or elements.

[0047]

[47] Furthermore, terms including ordinal numbers such as "first" and "second" used in the present invention may be used to describe elements, but the elements should not be limited by the terms. Such terms are used only to distinguish one element from another. Furthermore, in describing the present invention, if it is determined that a detailed description of related prior art may obscure the gist of the present invention, such a detailed description will be omitted.

[0048]

[48] ​​Furthermore, the components shown in the embodiments of the present invention are illustrated independently to demonstrate different characteristic functions, and do not mean that each component is composed of separate hardware or a single software component. That is, each component is described as a separate component for convenience of explanation, and at least two of the components may be combined into a single component, or one component may be divided into multiple components to perform its function. Such integrated and separated embodiments of each component are also within the scope of the present invention as long as they do not deviate from the essence of the present invention.

[0049]

[49] Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. The configuration and the effects of the present invention will be clearly understood through the following detailed description.

[0050]

[50]

[0051]

[51] Figure 1 is a conceptual diagram showing the configuration of a system for managing medical video records using blockchain according to one embodiment of the present invention.

[0052]

[52] The medical video management system may comprise a medical video capture unit (100), a medical video management server (200), and a blockchain network (300). The medical video capture unit (100) may be configured to record video related to surgery, treatment, and consultation in spaces such as operating rooms, treatment rooms, and examination rooms within a hospital, and transmit the recorded medical video to the medical video management server (200). The medical video capture unit (100) may have various types of cameras or CCTV, such as a head-mounted display (HMD) camera worn by medical staff such as doctors, a camera installed in an operating room, or an endoscopic camera used in endoscopic surgery. For example, a camera installed in an operating room may be mounted on the ceiling and specify the coordinates of each object in the initial real-time video to determine its initial position, and track the movement of the surgical scene and the surgeon's actions. In addition, the system may be configured to automatically capture and record the surgical scene by tracking the movement of all objects, such as surgical tools, captured using image recognition technology.

[0053]

[53] The medical video management server (200) may be configured to receive medical videos recorded in connection with surgery or treatment using the medical video capture unit (100), generate blocks on the blockchain network (300) based on data related to the medical videos, and update the blocks based on new data related to the medical videos. The medical video management server (200) may include a memory for storing data and instructions, a processor for executing instructions, and the like, for managing information related to each module configured to receive and manage medical videos. A more specific configuration of the medical video management server (200) is described with reference to FIG. 2.

[0054]

[54] The medical image management server (200) may be a server corresponding to one of the blockchain nodes constituting the blockchain network (300) or a server for managing the blockchain network (300). Blockchain technology is a technology based on a P2P (Peer-to-Peer) method that stores managed data in a distributed data storage environment called a block, formed by countless small pieces of data connected in a chain, so that no one can arbitrarily modify the data and anyone can view the results of changes. A block records all transaction history or status information transmitted to users before the discovery of the block. Since this information is transmitted to all users in the same way using a P2P method, transaction history or status information cannot be arbitrarily modified or deleted. In this invention, data or a set of data for medical image management stored and updated through the blockchain network (300) is referred to as a “block.”

[0055]

[55]

[0056]

[56] FIG. 2 is a block diagram illustrating the configuration of a medical image management server according to one embodiment of the present invention.

[0057]

[57] The medical image management server 200 may include an image receiving unit 210, an image dividing unit 220, a connection link management unit 230, a block generation processing unit 240, a block update processing unit 250, and a contract processing unit 260, and these components may include programs or program modules that can be executed by one or more processors. The programs or program modules included in the medical image management server 200 may be configured in the form of an operating system, an application program, or a program, and may be physically stored on various types of commonly used storage devices. Such programs or program modules may include, but are not limited to, one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing a specific task or executing a specific data type.

[0058]

[58] First, the video receiving unit (210) is configured to receive medical images recorded in connection with surgery or treatment using the medical video capturing unit (100), and can be connected to the medical video capturing unit (100) using a wired or wireless internet connection.

[0059]

[59] The video segmentation unit 220 is configured to segment a medical image into a plurality of video segments. Based on data related to the segmented video segments, the block generation processing unit 240 can generate blocks corresponding to each video segment and record them sequentially. For example, the video segmentation unit 220 can sequentially generate a plurality of video segments from a single medical image based on timestamp information set for each section within the medical image. For example, the timestamp information can be set for each stage by the surgeon or medical staff performing the surgery, dividing the detailed steps of the surgery into sections, or can be automatically set using artificial intelligence technology. In addition, the plurality of video segments can further include tag information inserted into the recorded surgical video. The tag information can include at least one of the surgeon, comments related to the surgical situation, the surgical sequence, surgical tools, and surgery-related events. Such tag information can be associated with each timestamp information and entered by the medical staff, or related information can be automatically entered using artificial intelligence technology.

[0060]

[60] The block generation processing unit (240) may be configured to generate blocks on the blockchain network (300) based on data related to the medical video, for example, to generate a new block for each of the multiple video segments. The header of the generated block may include information related to a connection link that can connect to each of the multiple video segments. The header of the generated block may further include section information generated based on timestamp information of the start and end points of each of the multiple video segments.

[0061]

[61] The block update processing unit (250) may be configured to update block information for the generated blocks based on tag information, etc. For example, the block information may include additional tag information, browsing history, transaction history, and usage history corresponding to each video fragment. For example, the block update processing unit (250) may track information on the user who connected through the connection link of the video fragment, connection IP information, and connection time information as a log record, and record and update such connection information in the body of the block corresponding to the video fragment.

[0062]

[62] The contract processing unit (260) is configured to conclude various transaction contracts for the use of medical images and process related processes, and such transaction contracts may be configured to settle fees according to pre-set transaction conditions using a smart contract. The contract processing unit (260) may be configured to generate blocks for smart contracts on the blockchain network (300) based on data related to the use of medical images through the smart contract, and may include information on the use period of the medical images, i.e., information on the start and end dates, and information related to access and editing rights for the images.

[0063]

[63]

[0064]

[64] Figure 3 is an illustrative diagram showing the generation of blocks on a blockchain network for multiple video fragments related to medical video according to one embodiment of the present invention.

[0065]

[65] Referring to Figure 3, for example, a medical image related to a stent procedure or surgery can be divided into four video segments according to four stages: 1) surgical preparation and anesthesia, 2) catheter insertion, 3) balloon inflation, and 4) catheter removal and stent placement. Each video segment can include section information related to the start and end times of t1-t2, t2-t3, t3-t4, and t4-t5 as timestamp information. A different connectable connection link can be assigned to each divided video segment, and connection link information, which is information related to the connection link corresponding to each video segment, can be generated. In this way, a plurality of blocks, each including connection link information and time section information, can be generated for each of the multiple video segments into which the medical image is sequentially divided.

[0066]

[66]

[0067]

[67] Figure 4 is an exemplary diagram illustrating a header structure of a block according to one embodiment of the present invention.

[0068]

[68] A block structure may be broadly composed of a block hash that serves as a block identifier, a header containing basic information, and a body containing transaction information, etc. Here, the header generally contains information such as a version, previous block hash, Merkle root, time, difficulty target, and nonce. A block according to the present invention may further contain, in the header, connection link information related to a connection link that can be connected to each of the multiple video fragments, and section information generated based on timestamp information of the start and end points of each of the multiple video fragments.

[0069]

[69] Through this block structure, link information that allows access to surgical video fragments and stills is matched and recorded using blockchain for each fragmented and distributed ledger, making it possible to prevent tampering with medical video records. For example, by encrypting the link information and setting the storage space where the video or stills are stored as read-only, it is possible to prevent the video at the connection location from being changed.

[0070]

[70] In this way, the present invention divides surgical recording video into multiple fragmented videos and configures them into blocks using a combination of connection link information and section information, thereby providing a system that can efficiently manage surgical recording video while reducing the size of block data, and solving problems such as surgical history being discarded when the retention period expires or key content related to related surgeries being tampered with.

[0071]

[71]

[0072]

[72] Figure 5 is a flowchart illustrating a method for managing medical images using blockchain according to one embodiment of the present invention.

[0073]

[73] Referring to FIG. 5, first, the medical image photographed and recorded by the medical image photographing unit 100 can be received through the image receiving unit 210 of the medical image management server 200 (S510).

[0074]

[74] The medical image management server 200 can sequentially divide the medical image into a plurality of fragmented images through the image dividing unit 220 (S520).

[0075]

[75] The medical image management server 200 can generate connection links for a plurality of video fragments through the connection link management unit 230 and generate section information for each video fragment (S530).

[0076]

[76] The medical image management server 200 may sequentially record data related to a plurality of video segments into blocks through the block generation processing unit 240 (S540). At this time, the header of the block may include connection link information related to a connection link connectable to each of the plurality of video segments and section information generated based on timestamp information of the start and end points of each of the plurality of video segments.

[0077]

[77] In addition, the medical image management server 200 can perform block update based on tag information related to a plurality of video segments through the block update processing unit 250 (S550). For example, the corresponding blocks can be updated based on tag information addition information, browsing history, transaction history, usage history, etc. corresponding to each video segment.

[0078]

[78] In addition, the medical image management server (200) can track accessor information, access IP information, and access time information as a log record (S560). By tracking connection-related information connected through the corresponding link in this way, connection information can be monitored. Furthermore, by updating the corresponding block based on such connection-related information, it is possible to prevent tampering with the connection record.

[0079]

[79]

[0080]

[80] FIG. 6 is a conceptual diagram illustrating the configuration of a surgical video transmission system using a cache server according to one embodiment of the present invention.

[0081]

[81] Referring to FIG. 6, the user terminal (400) is a device used by a user such as a doctor or medical staff who performs surgery, treatment, or medical examination, and is configured to be connectable to, for example, a content server (600), a cache server (700), and a video fragment management server (800), and may be, but is not limited to, any one of a smartphone, tablet computer, desktop computer, laptop computer, notebook, workstation, PDA (Personal Digital Assistant), portable computer, wireless phone, mobile phone, e-book, PMP (Portable Multimedia Player), portable game console, digital camera, television, wearable device, HMD (Head Mounted Display), and AI (Artificial Intelligence) speaker. The user terminal 400 may include a display unit for providing a medical image screen, or may be connected to a display unit and configured to be controllable.

[0082]

[82] The user terminal (400) is configured to be able to communicate with various servers, such as a content server (600), a cache server (700), and a video fragment management server (800), through a network (500). The network (500) is a component for implementing wired and wireless communications for transmitting and receiving data between the user terminal (400) and the multiple servers (600, 700, 800). When the network is a wireless communication network, it may include cellular communications or short-range communications. For example, the cellular communications may include at least one of Long-Term Evolution (LTE), LTE Advanced (LTE-A), 5th Generation (5G), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA), Universal Mobile Telecommunications System (UMTS), Wireless Broadband (WiBro), or Global System for Mobile Communications (GSM). Further, the short-range communication may include at least one of Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), Zigbee (registered trademark), NFC (Near Field Communication), RFID (Radio Frequency Identification), etc. However, the communication method is not limited to these and may also include wireless communication technologies that will be developed in the future.

[0083]

[83] Next, the content server (600) may be configured to store multiple surgical videos, for example, videos recorded in relation to surgery, treatment, medical examination, etc. in spaces such as operating rooms, treatment rooms, and examination rooms within a hospital using various types of cameras via the medical video capture unit (100).

[0084]

[84] The cache server (700) may be configured to receive and store at least a portion of the surgical video related to a corresponding surgery among the plurality of surgical videos stored from the content server (600), and, when a reference video is requested from the user terminal (400), to transmit at least a portion of the surgical video to the user terminal (400). In addition, the cache server (700) may be selected as the most advantageous cache server among the plurality of cache servers based on proximity to the location of the corresponding user terminal (400) or response speed.

[0085]

[85] The video fragment management server (800) may be configured to receive surgery-related information including the date and time of surgery and the type of surgery, determine the surgery video related to the surgery from among the plurality of surgery videos stored in the content server (600) based on the surgery-related information, and divide the related surgery video into a plurality of fragment videos of a predetermined capacity or less.

[0086]

[86] The multiple video fragments thus divided are generated sequentially based on the timestamp information of each section within the corresponding surgical video, and the video fragment management server (800) can be configured to transmit at least one video fragment corresponding to the beginning of the multiple video fragments to the cache server (700).

[0087]

[87] The video fragment management server 800 may be configured to transmit at least one video fragment to the cache server 700 before the surgery date and time based on a predetermined surgery date and time. For example, the video fragment management server 800 may be configured to transmit the video fragment to the cache server 700 one day or one hour before the surgery date and time based on a predetermined criterion and store the video fragment in the cache server 700.

[0088]

[88] The video fragment management server 800 may also be configured to determine relevant surgical videos from among the plurality of surgical videos stored in the content server 600 based on a similarity assessment with reference video information previously used by the user terminal 400. In other words, the surgical videos likely to be used as reference during the relevant surgery may be determined using historical data previously referred to or searched by the user of the user terminal 400.

[0089]

[89] In addition, if a predetermined percentage or more of at least one video fragment is streamed on the user terminal (400), it is determined that the user is referring to the video fragment, and the cache server (700) is configured to request, receive, and store the remaining video fragments excluding the first part of the video fragment from the video fragment management server (800). By storing the remaining video fragments in the cache server (700) in advance, transmission delays can be minimized when streaming and viewing the corresponding surgical video through the user terminal (400).

[0090]

[90] In addition, when a plurality of video fragments are all streamed to the user terminal (400), the cache server (700) may be configured to transmit at least a portion of the second surgical video corresponding to the next transmitted surgical video to the user terminal (400). In addition, when at least one video fragment of the second surgical video or a predetermined percentage or more of the entire video fragments are streamed to the user terminal (400), it is determined that the user is referring to the corresponding video fragment of the second surgical video, and the cache server (700) may be configured to request, receive, and store the remaining video fragments excluding the first portion of the plurality of video fragments from the video fragment management server (800).

[0091]

[91] In addition, the video fragment management server (800) may be configured to determine at least one major video fragment from the plurality of video fragments based on at least one of the movement of surgical tools, the amount of bleeding, and the degree of change in organs related to the corresponding surgery through video analysis of the plurality of video fragments using artificial intelligence technology, etc., and transmit the major video fragment from the plurality of video fragments to the cache server (700). In this way, the video fragment management server (800) can efficiently utilize the limited storage space of the cache server (700) by determining the major video fragment that is determined to be important from the plurality of video fragments and transmitting only the major video fragment to the cache server (700).

[0092]

[92]

[0093]

[93] Figure 7 is a block diagram illustrating the configuration of a cache server according to one embodiment of the present invention.

[0094]

[94] Referring to FIG. 7, the video fragment management server 800 according to the present invention may include a surgical information receiving unit 810, a surgical image determining unit 820, a video segmentation processing unit 830, and a video transmission processing unit 840. These components may include programs or program modules that can be executed by one or more processors. The programs or program modules included in the video fragment management server 800 may be configured in the form of an operating system, an application program, or a program, and may be physically stored on various types of commonly used storage devices. Such programs or program modules may include, but are not limited to, one or more routines, subroutines, programs, objects, components, instructions, data structures, and various other forms for performing a specific task or executing a specific data type.

[0095]

[95] First, the surgery information receiving unit (810) may be configured to receive surgery-related information, including information related to the date and time of surgery, the surgical subject, the location of the surgery site, and the type of surgery, from the user terminal (400) or other server or terminal that manages surgery information.

[0096]

[96] The surgical video determination unit 820 may be configured to determine a surgical video to be provided to the user terminal 400 as a surgical reference video, and may be configured to determine a relevant surgical video from among a plurality of surgical videos stored in the content server 600 based on the received surgery-related information. The surgical video determination unit 820 may also use previous history information of the user terminal 400 to determine a relevant surgical video from among a plurality of surgical videos stored in the content server 600 based on a similarity assessment between the reference video information previously used by the user of the user terminal 400 in relation to the corresponding type of surgery.

[0097]

[97] The surgical image determination unit 820 may be configured to determine at least one major fragment image from the plurality of fragment images based on at least one of the movement of surgical tools, the amount of bleeding, and the degree of change in organs related to the corresponding surgery, using image analysis of the plurality of fragment images through artificial intelligence technology or operator processing, and transmit only the major fragment image from the plurality of fragment images to the cache server 700. In this manner, by determining a major fragment image that is determined to be important from the plurality of fragment images and transmitting only the major fragment image to the cache server 700, the limited storage space of the cache server 700 can be efficiently utilized, and from the perspective of medical staff, time can be efficiently utilized by referring to only the major fragment image in limited time.

[0098]

[98] The video segmentation processing unit 830 may be configured to segment the related surgical video determined by the surgical video determination unit 820 into a plurality of video segments each having a predetermined capacity or less. In this case, the plurality of video segments may be sequentially generated based on timestamp information of each section within the surgical video, and the video segment management server 800 may be configured to transmit at least one video segment corresponding to the beginning of the plurality of sequentially generated video segments to the cache server 700 through the video transmission processing unit 840.

[0099]

[99] The video transmission processor 840 is configured to perform transmission processing and transmission schedule management of the video to be transmitted to the cache server 700, and can determine one cache server to be connected to the user terminal 400 based on proximity to the location of the user terminal 400 or the response speed of each cache server. The video transmission processor 840 can also be configured to transmit at least one video fragment to the cache server 700 before the surgery date and time based on surgery date and time information included in the surgery-related information.

[0100]

[0100]

[0101]

[0101] FIG. 8 is an exemplary diagram illustrating a method for providing a plurality of video fragments related to a surgical video using a cache server according to an embodiment of the present invention.

[0102]

[0102] For example, a scheduled surgery may include two types of surgery, with a plan to sequentially perform a first surgical video associated with the first surgery and a second surgical video associated with the second surgery.

[0103]

[0103] First, the first surgical video determined as the reference video for the first surgery may be composed of five video fragments sequentially generated based on timestamp information (t1 to t6) for each section, and the first and second video fragments corresponding to the initial portions may be pre-stored in a cache server. In this case, when the first video fragment is completely streamed and viewed through the user terminal (400), for example, past time t2, the cache server (700) may be configured to request and receive subsequent video fragments, for example, the third, fourth, and fifth video fragments, from the video fragment management server (800) and store them. By pre-transmitting and storing subsequent video fragments in the cache server (700) depending on whether the divided video fragments have been viewed, the surgical video to be viewed by the user can be viewed without delay.

[0104]

[0104] Meanwhile, if video streaming ends before time t2, which is a predetermined criterion through the user terminal 400, it may be determined that the reference video is unnecessary, and the cache server 700 may be configured not to request subsequent video fragments, for example, video fragments after the third video fragment. Also, in order to efficiently manage storage capacity in the cache server 700, it may be configured to determine that the video fragments whose video streaming ended before a certain time are not of interest to the user, and delete them all.

[0105]

[0105] Furthermore, when the streaming viewing of the first surgical video is completed through the user terminal 400, the cache server 700 may be configured to transmit a video fragment of the beginning portion as at least a part of the second surgical video corresponding to the next surgical video to the user terminal 400. In this case, if the video fragment of the beginning portion of the second surgical video is not stored in the cache server 700, the cache server 700 may be configured to request and receive the video fragment of the beginning portion of the second surgical video from the video fragment management server 800, for example, at time t4 or t5, before the viewing of the first surgical video is completed, and store it in advance.

[0106]

[0106]

[0107]

[0107] FIG. 9 is a flowchart illustrating a method for transmitting surgical images using a cache server according to an embodiment of the present invention.

[0108]

[0108] First, a plurality of surgical videos can be stored in the content server 600 (S910). At this time, the surgical video may include the type of surgery, the surgical subject, timestamp information for each section, tag information, and the like.

[0109]

[0109] The video fragment management server 800 can receive surgery-related information including the date and time of surgery and the type of surgery through the surgery information receiving unit 810 (S920).

[0110]

[0110] The video fragment management server 800 can determine the related surgery video based on the surgery-related information through the surgery video determination unit 820 (S930).

[0111]

[0111] The video fragment management server 800 can divide the surgical video into a plurality of video fragments through the video division processing unit 830 (S940). For example, the surgical video may be a plurality of video fragments sequentially generated based on timestamp information of each section.

[0112]

[0112] The video fragment management server (800) can determine one cache server to connect to the user terminal (400) through the video transmission processing unit (840) based on the proximity to the location of the user terminal (400) or the response speed of each cache server (S950).

[0113]

[0113] The determined cache server 700 can receive and store some of the relevant surgical video fragments from the video fragment management server 800 (S960).

[0114]

[0114] When a surgical reference video is requested from the user terminal (400), some video fragments can be provided by streaming through the determined cache server (700) (S970).

[0115]

[0115] In addition, the user terminal (400) can request the remaining video fragments after receiving some of the video fragments and provide them in streaming form through the cache server (700) (S980). When the user terminal (400) streams a certain percentage of the first few video fragments of the surgical video, the cache server (700) requests and receives the remaining video fragments from the video fragment management server (800) and stores them, thereby allowing the user to view the entire video without delay.

[0116]

[0116]

[0117]

[0117] FIG. 10 is a conceptual diagram for explaining the configuration of a surgery stage video transmission system using a cache server according to an embodiment of the present invention.

[0118]

[0118] The surgery stage video transmission system of FIG. 10 is a configuration in which a surgery stage determination server (900) is added to the configuration of the surgery video transmission system using the cache server shown in FIG.

[0119]

[0119] Here, the content server (600) can be configured to store multiple surgical videos.

[0120]

[0120] The video fragment management server (800) may be further configured to receive surgery-related information including the type of surgery, and to divide and store the multiple surgery videos stored in the content server (600) based on the received surgery-related information based on detailed surgery stages.

[0121]

[0121] The surgical stage determination server (900) may be configured to determine detailed surgical stages based on the surgical type of the surgical patient, and to determine respective video fragments associated with each detailed surgical stage.

[0122]

[0122] The surgery stage determination server 900 may be configured to determine detailed surgery stages based on record information of multiple previous surgical patients who underwent the same type of surgery as the current surgical patient. The record information of the previous surgical patients may include at least one of gender, age, time of surgery, underlying diseases, other surgical history, postoperative prognosis, and surgical recovery period. In other words, when determining detailed surgery stages, the record information of the previous surgical patients may be used to utilize surgery stages and conditions with similar conditions to the current patient and favorable prognosis and recovery period.

[0123]

[0123] The surgery stage determination server 900 may be configured to determine the detailed surgery stages by combining the detailed surgery stages of multiple past surgery patients. For example, the server may be configured to determine the detailed surgery stages of the current surgery patient by combining the detailed surgery stages of a first past surgery patient who underwent the same surgery type as the current surgery patient's surgery with different detailed surgery stages of a second past surgery patient who underwent the same surgery type as the current surgery patient's surgery.

[0124]

[0124] In addition, the surgical stage determination server (900) can utilize a learning model using artificial intelligence to utilize the record information of past patients to derive the detailed surgical stages with the best prognosis and recovery period for similar conditions of the current patient, and can be configured to recommend the optimal detailed surgical stages for the current surgical patient through the artificial intelligence learning model.

[0125]

[0125] The cache server 700 may be configured to receive and store a plurality of video fragments related to each detailed surgery stage from the video fragment management server 800, and transmit the plurality of video fragments related to the detailed surgery stage determined by the surgery stage determination server 900 to a user terminal 400 that has requested a detailed surgery stage video from the user terminal 400. In this case, the cache server 700 may determine the cache server that is optimally located among the plurality of cache servers based on proximity to the location of the user terminal 400 or response speed.

[0126]

[0126] In addition, the cache server 700 may be configured to check whether each video fragment related to each detailed surgery step determined by the surgery step determination server 900 is stored, and for video fragments that are not stored in the cache server 700, receive and store the corresponding video fragments from the video fragment management server 800 based on the surgery schedule of the surgery patient. For example, the cache server 700 may check whether each video fragment related to each detailed surgery step is stored before the surgery date and time of the surgery patient, for example, one hour or one day before, and request the video fragments that are not stored from the video fragment management server 800 to store the corresponding video fragments in advance before the surgery date and time.

[0127]

[0127] The user terminal (400) may be configured to receive a plurality of video fragments based on the detailed surgical stages determined by the surgical stage determination server (900).

[0128]

[0128]

[0129]

[0129] FIG. 11 is an exemplary diagram illustrating a configuration for recommending detailed surgery steps for a surgical patient according to an embodiment of the present invention.

[0130]

[0130] A surgery can be divided into several detailed surgery stages, and video fragments can be divided for each detailed surgery stage. In Figure 11, it is assumed that Patient 1, Patient 2, and Patient 3 have a record of having previously undergone the same type of surgery, and Patient 4 is scheduled to undergo the same type of surgery.

[0131]

[0131] For example, looking at the past surgical records of patient 1, the detailed surgical stages consist of three stages: stage A, stage B, and stage C. Patient 2's past surgical records have a stage D added between stages A and B, for a total of four detailed surgical stages. Also, patient 3's past surgical records have a stage E added after stages A, B, and C, for a total of four detailed surgical stages. In this way, even in the case of the same type of surgery, some detailed surgical stages may be added or changed depending on the patient's condition and the surgical situation, and by accumulating such surgical data, it becomes possible to make probabilistic judgments about the results of the detailed surgical stages.

[0132]

[0132] The detailed surgery stages determined by the surgery stage determination server 900 for patient 4, who is scheduled to undergo the same type of surgery as patients 1 to 3, are a combination of the detailed surgery stages for patients 1 to 3, and include a total of five detailed surgery stages consisting of stages A, D, B, C, and E. Detailed surgery stage videos corresponding to these five stages may be provided to medical staff as reference videos. Such detailed surgery stage recommendation and determination may utilize, for example, a learning model using artificial intelligence, utilizing record information of past patients to derive detailed surgery stages with the best prognosis and recovery period under similar conditions to the current patient, and may find and recommend detailed surgery stage conditions with the best prognosis and recovery conditions under patient environmental conditions such as the same gender, similar age, and similar underlying disease.

[0133]

[0133]

[0134]

[0134] FIG. 12 is an example diagram illustrating a method for providing detailed surgery step images using a cache server according to an embodiment of the present invention.

[0135]

[0135] Referring to Figure 12, the detailed surgical stages for patient 4 determined by the surgical stage determination server (900) may include stage A images, stage B images, and stage C images as surgical images for patient 1, and may also include stage D images among the surgical images for patient 2.

[0136]

[0136] In this case, the cache server (700) can first check whether the surgical video of patient 1 and the video of stage D of the surgical video of patient 2 are stored before the surgery date and time of the corresponding surgical patient. For example, as shown in Figure 12, if it is determined that the surgical video of patient 1, including the video of stage A, stage B, and stage C, has all been stored, but the video of stage D, which has been determined as a detailed surgical stage to be used as reference, among the surgical videos of patient 2, has not been stored, the cache server (700) can request the video fragment management server (800) to transmit the video of stage D of the surgical videos of patient 2. In this case, the video transmission date and time can be scheduled based on the surgery schedule of patient 4 so that the video of stage D of patient 2 is transmitted and stored in the cache server (700) before the surgery date and time.

[0137]

[0137]

[0138]

[0138] While various methods and systems according to the embodiments of the present invention have been described above as specific embodiments, these are merely examples, and the present invention is not limited thereto and should be construed as having the broadest scope in accordance with the basic concepts disclosed herein. Those skilled in the art may combine and substitute the disclosed embodiments to implement patterns of shapes not shown at appropriate times, but this does not depart from the scope of the present invention. In addition, those skilled in the art may easily modify or alter the embodiments disclosed herein, and it is clear that such modifications or alterations also fall within the scope of the present invention.

Claims

1. In the surgical stage video transmission system, a content server configured to store a plurality of surgical videos; a video fragment management server configured to receive surgery-related information including a surgery type, and to divide and store the plurality of surgery videos stored in the content server based on the surgery-related information, according to detailed surgery steps; a surgical stage determination server configured to determine detailed surgical stages based on a surgical type of the surgical patient and to determine respective video fragments associated with each detailed surgical stage; and a user terminal configured to receive a plurality of video fragments based on the detailed surgical steps determined by the surgical step determination server; Including, The system further includes a cache server configured to receive and store each video fragment related to each detailed surgery step from the video fragment management server, and to transmit a plurality of video fragments related to the detailed surgery step to the user terminal when a detailed surgery step video is requested from the user terminal, wherein the cache server is determined from a plurality of cache servers based on proximity to the location of the user terminal or response speed; The cache server is configured to check whether each video fragment related to each detailed surgery stage determined by the surgery stage determination server is stored, and for video fragments that are not stored in the cache server, receive and store the corresponding video fragments from the video fragment management server before the surgery date and time of the surgery patient based on the surgery schedule of the surgery patient.

2. 2. The surgical stage video transmission system according to claim 1, wherein the surgical stage determination server is configured to determine detailed surgical stages based on record information of multiple past surgical patients who underwent the same type of surgery as the surgical patient.

3. 3. The surgical stage video transmission system according to claim 2, wherein the recorded information of the past surgical patient includes at least one of the following: gender, age, time of surgery, underlying disease, other surgical history, post-operative prognosis, and surgical recovery period.

4. 3. The surgical stage video transmission system according to claim 2, wherein the surgical stage determination server is configured to determine the detailed surgical stage of the surgical patient by combining the detailed surgical stage of a first previous surgical patient who underwent the same type of surgery as the surgical patient and the detailed surgical stage of a second previous surgical patient who underwent the same type of surgery as the surgical patient.

5. 5. The surgical stage video transmission system of claim 4, wherein the surgical stage determination server is configured to recommend detailed surgical stages for the surgical patient through a learning model using artificial intelligence.

6. In the surgical stage video transmission method, storing a plurality of surgical videos in a content server; receiving surgery-related information including a surgery type from a video fragment management server, and dividing and storing the plurality of surgery videos stored in the content server based on the surgery-related information according to detailed surgery steps; determining detailed surgery steps based on the surgery type of the surgical patient in a surgery step determination server, and determining respective image fragments associated with each detailed surgery step; and receiving a plurality of image fragments at a user terminal based on the detailed surgery steps determined by the surgery step determination server; Including, The method further includes receiving and storing each video fragment related to each detailed surgery step from the video fragment management server in a cache server, and transmitting a plurality of video fragments related to the detailed surgery step to the user terminal when a detailed surgery step video is requested from the user terminal, wherein the cache server is determined from a plurality of cache servers based on proximity to the location of the user terminal or response speed, The surgery stage video transmission method further includes a step of checking in the cache server whether each video fragment related to each detailed surgery stage determined by the surgery stage determination server is stored, and for video fragments that are not stored in the cache server, receiving and storing corresponding video fragments from the video fragment management server before the surgery date and time of the surgery patient based on the surgery schedule of the surgery patient.

Images