Medical image recording management method using block chain and system using the same

By segmenting medical images into multiple fragments and using blockchain to manage their connection information, the problems of medical image records tampering and secure storage are solved, and rapid image transmission is achieved through a cache server, meeting the needs of image transmission during the operation.

CN120077444APending Publication Date: 2025-05-30MEDITHINQ CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202380073920.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-10-20
Filing Date
2023-09-19
Publication Date
2025-05-30

AI Technical Summary

Technical Problem

The prior art is difficult to effectively prevent medical image records from being tampered with, safely kept and intermediary transactions, and it is difficult to provide uninterrupted medical images quickly and stably during the operation.

Method used

By dividing the captured surgical scene video into multiple image segments, and using blockchain to manage the connection link information and interval information of each image segment, surgical images are prevented from being forged and tampered. At the same time, the cache server is used to reduce the buffering during image playback to achieve faster and more stable image transmission.

Benefits of technology

Effectively prevent surgical image records from being tampered with and discarded, realize safe storage and transparent transactions of images, and provide fast and stable image transmission during the operation, supporting real-time references from doctors and medical teams.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120077444A_ABST
    Figure CN120077444A_ABST
Patent Text Reader

Abstract

According to the present invention, provided is a medical image recording management method for managing medical images using a block chain, the method comprising the steps of: receiving, in a medical image management server, recorded medical images related to surgery or treatment; a step in which the medical image management server generates a block on a block chain network on the basis of data relating to the medical image; and a step of updating, by the medical image management server, the block on the basis of new data relating to the medical image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a method for managing medical image records using a blockchain and a system using the method. More specifically, it relates to a method and system for preventing the tampering of medical image records by dividing medical images through a blockchain network and recording multiple generated image segments. Background Art

[0002] In recent years, with the rapid development of multimedia technology and its wide application in various fields, the medical field has also developed technologies for making videos of patient surgery scenes for doctors to present at medical-related academic conferences or for other purposes.

[0003] In addition, for surgical records and to deal with possible medical disputes, there are also many cases where surgical images are taken, or in surgeries such as those on joints, an ultra-small camera is used during endoscopic surgery to visually confirm the lesion site and perform diagnosis and treatment. Recently, most medical devices are equipped with an image capture function, and the amount of surgical image capture is increasing rapidly.

[0004] The surgical images recorded in this way have various utilization values for other doctors, patients, researchers, etc. In particular, if various medical information is added to the surgical images, their utilization value and asset value may increase.

[0005] Therefore, there is a need for a new method and system that can prevent the tampering of medical image records, securely store them, and mediate transactions. In addition, there is a need for a method and system that can more quickly and stably provide uninterrupted medical images during surgery. Additionally, there is a need for a method and system that can more effectively provide detailed surgical step images that doctors or medical teams can refer to during surgery. Summary of the Invention

[0006] Technical Problem

[0007] The present invention aims to provide a method and system that, for example, prevent the forgery and tampering of surgical images and the tampering of the recorded surgical sequence or the abandonment of surgical records by dividing the video of the surgical scene into multiple image segments and using the blockchain to manage the connection link information and interval information of each image segment.

[0008] In addition, the present invention aims to construct a system that effectively manages surgical videos while reducing the block data capacity by dividing the surgical video into multiple image segments and forming blocks using a combination of connection link information and interval information.

[0009] In addition, the present invention aims to construct a medical image management system that transparently manages the use and transaction of recorded surgical images and realizes monetization through transactions using a smart contract.

[0010] In addition, the present invention aims to provide a method and system that utilize a cache server to reduce buffering during the playback of images that doctors or medical teams can refer to during a surgery, and to transmit surgical images more quickly and stably.

[0011] In addition, the present invention aims to provide a cache server system that can provide multiple image segments obtained by splitting a surgical image to a user terminal without delay in a stable streaming manner.

[0012] In addition, the present invention aims to provide an image transmission system that can generate and recommend the best surgical images based on information related to the ongoing surgery.

[0013] In addition, the present invention aims to provide a surgical step image transmission system that can determine the detailed surgical steps of a more effective and safe surgery based on past surgical record information, and transmit multiple generated image segments according to these steps.

[0014] In addition, the present invention aims to provide a method and system that utilize artificial intelligence technology to recommend the best detailed surgical steps suitable for a surgical patient, and sequentially provide detailed surgical step images to the medical team according to these steps.

[0015] The technical problems of the present invention are not limited to the above, and other technical problems not mentioned can be clearly understood by those skilled in the art through the following description.

[0016] Technical Solution

[0017] According to an embodiment of the present invention, there is provided a method for managing medical images using blockchain, including: receiving recorded medical images related to a surgery or treatment in a medical image management server; generating a block on a blockchain network by the medical image management server according to data related to the medical image; and updating the block by the medical image management server according to new data related to the medical image.

[0018] Wherein, it may further include the step of the medical image management server splitting the medical image into multiple image segments and sequentially recording them in the block according to data related to the multiple image segments.

[0019] In addition, the multiple image segments may be sequentially generated according to timestamp information of each interval within the medical image.

[0020] In addition, the multiple image segments may further include tag information inserted into the recorded surgical image.

[0021] In addition, the block header of the block may include information related to connection links capable of accessing each of the plurality of video segments, i.e., connection link information.

[0022] In addition, the block header of the block may further include interval information generated based on timestamp information of start and end time points of each of the plurality of video segments.

[0023] In addition, the tag information may include at least one of a surgical subject, a comment related to the surgical situation, a surgical order, a surgical tool, and a surgical related event.

[0024] In addition, the medical image management server may be configured to track visitor information, access IP information, and access time information for accessing the connection link in the form of a log.

[0025] In addition, it may further include a step of signing a transaction contract for using the medical image through the medical image management server, and the transaction contract may be configured to use a smart contract to settle fees according to preset transaction conditions.

[0026] In addition, according to another embodiment of the present invention, there is provided a medical image management server for managing medical images using a blockchain, including: an image receiving unit configured to receive recorded medical images related to surgery or treatment; a block generation processing unit configured to generate a block on a blockchain network based on data related to the medical image; and a block update processing unit configured to update the block through the medical image management server based on new data related to the medical image.

[0027] Advantages of the Invention

[0028] According to the present invention, a method and system can be provided. For example, by splitting a video of a surgical scene into a plurality of video segments and using a blockchain to manage connection link information and interval information of each video segment, it is possible to prevent surgical images from being forged and tampered with, and prevent the record of the surgical sequence from being tampered with or the surgical record from being discarded.

[0029] In addition, according to the present invention, a system can be constructed. By splitting a surgical video into a plurality of video segments and using a combination of connection link information and interval information to form a block, the block data capacity can be reduced while effectively managing the surgical video.

[0030] In addition, according to the present invention, a medical image management system can be constructed. By conducting transactions through a smart contract, the use and transaction of recorded surgical images can be transparently managed and monetized.

[0031] In addition, according to the present invention, a method and system can be provided that utilize a cache server to reduce buffering during the playback of images that doctors or medical teams can refer to during surgery, and transmit surgical images more quickly and stably.

[0032] In addition, according to the present invention, a cache server system can be provided that can provide multiple image segments obtained by splitting surgical images to a user terminal without delay in a stable streaming manner.

[0033] In addition, according to the present invention, an image transmission system can be provided that can generate and recommend the best surgical images based on information related to the ongoing surgery.

[0034] In addition, according to the present invention, a surgical step image transmission system can be provided that can determine the detailed surgical steps of a more effective and safe surgery based on past surgical record information, and transmit multiple generated image segments according to these steps.

[0035] In addition, according to the present invention, a method and system can be provided that utilize artificial intelligence technology to recommend the best detailed surgical steps suitable for a surgical patient, and sequentially provide detailed surgical step images to the medical team according to these steps.

[0036] The effects of the present invention are not limited to the above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 is a schematic diagram showing the structure of a system for managing medical image records using a blockchain according to an embodiment of the present invention.

[0038] Figure 2 is a block diagram for explaining the structure of a medical image management server according to an embodiment of the present invention.

[0039] Figure 3 is an example diagram showing the generation of a block on a blockchain network for multiple image segments related to medical images according to an embodiment of the present invention.

[0040] Figure 4 is an example diagram for explaining the block header structure of a block according to an embodiment of the present invention.

[0041] Figure 5 is a flowchart for explaining a method of managing medical images using a blockchain according to an embodiment of the present invention.

[0042] Figure 6 is a schematic diagram showing the structure of a surgical image transmission system using a cache server according to an embodiment of the present invention.

[0043] Figure 7 It is a block diagram showing the structure of a cache server for explaining an embodiment of the present invention.

[0044] Figure 8 It is an example diagram for explaining a method of using a cache server to provide multiple image segments related to surgical images in an embodiment of the present invention.

[0045] Figure 9 It is a flowchart for explaining a surgical image transmission method using a cache server in an embodiment of the present invention.

[0046] Figure 10 It is a schematic diagram showing the structure of a surgical step image transmission system using a cache server in an embodiment of the present invention.

[0047] Figure 11 It is an example diagram for explaining the structure of detailed surgical steps for recommending surgical patients in an embodiment of the present invention.

[0048] Figure 12 It is an example diagram for explaining a method of using a cache server to provide detailed surgical step images in an embodiment of the present invention. Detailed implementation mode

[0049] Hereinafter, with reference to the accompanying drawings, the present invention will be described in detail so that those skilled in the art to which the present invention pertains can easily implement it. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein.

[0050] The terms used in this specification are for explaining the embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless otherwise clearly stated in the context.

[0051] The expressions "comprises" and "comprising" used in this specification mean that the mentioned 'elements, steps, operations, and / or devices' do not exclude the existence or addition of one or more other 'elements, steps, operations, and / or devices'.

[0052] In addition, the ordinal terms such as the first and the second used in the present invention can be used to explain the elements, but the elements should not be limited by these terms. These terms are only used to distinguish one element from other elements. In addition, when explaining the present invention, if the detailed description of related known technologies is considered likely to obscure the gist of the present invention, its detailed description will be omitted.

[0053] In addition, the components appearing in the embodiments of the present invention are independently displayed to represent different characteristic functions from each other, and do not mean that each component is composed of separate hardware or a software component unit. That is, for ease of explanation, each component is separately listed and described, and at least two of the components can be combined into one component, or one component can be divided into multiple components to perform functions. These combined embodiments and separated embodiments of each component are all included within the scope of the rights of the present invention as long as they do not depart from the essence of the present invention.

[0054] Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail. The configuration of the present invention and the effects produced thereby can be clearly understood through the following detailed description.

[0055] Figure 1 It is a schematic diagram showing the structure of a system for managing medical image records using blockchain according to an embodiment of the present invention.

[0056] The medical image management system may be composed of a medical image capturing unit (100), a medical image management server (200), and a blockchain network (300). The medical image capturing unit (100) can record images related to surgeries, treatments, diagnoses, etc. in spaces such as operating rooms, treatment rooms, or examination rooms within a hospital, and can be configured to transmit the recorded medical images to the medical image management server (200). The medical image capturing unit (100) can have multiple cameras or CCTVs of various forms. For example, a head-mounted display (HMD) camera that medical teams such as doctors can wear, a camera installed in the operating room, an endoscope camera for endoscopic surgery, etc. For example, the camera installed in the operating room can be installed on the ceiling, specify the coordinates of each object in the initial real-time image to grasp the initial position, and grasp the surgical scene and the actions of the surgeon, etc., so as to perform movement tracking. In addition, the movement of all objects such as the surgical tools captured can be tracked by using image recognition technology, so as to automatically capture and record the surgical scene.

[0057] The medical image management server (200) can be configured to receive medical images related to surgeries or treatments recorded by the medical image capturing unit (100), generate a block on the blockchain network (300) according to the data related to the medical images, and update the block according to new data related to the medical images. The medical image management server (200) can include a memory for storing data, commands, etc. related to information of each module configured for receiving and managing medical images, and a processor for executing commands, etc. The more specific structure of the medical image management server (200) will be referred to Figure 2A description will be given.

[0058] The medical image management server (200) can be a server corresponding to any one of the blockchain nodes constituting the blockchain network (300), or a server for managing the blockchain network (300). Blockchain technology is a technology that stores and manages target data in a distributed data storage environment called a block, which is formed by connecting small-scale data in a chain in a peer-to-peer (P2P) manner, so that no one can modify it arbitrarily, and anyone can view the change results. All transaction records or status information, etc., that were propagated to users before the block was discovered are recorded in the block, and this information is transmitted to all users in the same way by P2P, so transaction records or status information, etc. cannot be modified or omitted arbitrarily. In the present invention, the data or data packets for medical image management stored and updated through the blockchain network (300) are called "blocks".

[0059] Figure 2 It is a block diagram for explaining the structure of a medical image management server according to an embodiment of the present invention.

[0060] The medical image management server (200) can include an image receiving unit (210), an image segmentation unit (220), a connection link management unit (230), a block generation processing unit (240), a block update processing unit (250), a contract processing unit (260), etc. These constituent elements can include programs or program modules executed by one or more processors. The programs or program modules included in the medical image management server (200) can be in the form of an operating system, an application program, or a program, etc., and can be physically stored on various types of widely used storage devices. Such programs or program modules can include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing specific tasks or executing specific data types, but are not limited to these forms.

[0061] First, the image receiving unit (210) is configured to receive medical images related to surgery or treatment recorded by the medical image capturing unit (100), and can be connected to the medical image capturing unit (100) through wired or wireless Internet.

[0062] The image segmentation unit (220) is configured to segment a medical image into multiple image segments, and based on data related to such segmented multiple image segments, generate blocks corresponding to each image segment information through the block generation processing unit (240) and record them sequentially. For example, the image segmentation unit (220) can sequentially generate multiple image segments from a single medical image according to the timestamp information set for each interval within the medical image. For example, the timestamp information can be distinguished by the surgeon or medical team performing the surgery, etc., according to the detailed procedures within the surgery and set for each step, or can be automatically set using artificial intelligence technology, etc. In addition, the multiple image segments can also include tag information inserted into the recorded surgical image, and the tag information can include at least one of the surgical subject, comments related to the surgical situation, surgical order, surgical tools, and surgical related events. Such tag information can be associated with each timestamp information and input by the medical team, etc., or relevant information can be automatically input using artificial intelligence technology, etc.

[0063] The block generation processing unit (240) can be configured to generate blocks on the blockchain network (300) based on data related to the medical image. For example, it can be configured to generate a new block for each of the multiple image segments. In addition, the block header of the generated block can include information related to the connection link that can access each of the multiple image segments. In addition, the block header of the generated block can also include interval information generated according to the timestamp information of the start and end time points of each of the multiple image segments.

[0064] The block update processing unit (250) can be configured to update the block information of the generated block according to tag information, etc. For example, it can include additional information of tag information corresponding to each image segment, viewing records, transaction records, usage records, etc. For example, it can track visitor information, access IP information, and access time information accessed through the connection link of the image segment in the form of a log record, and record such access information in the block body of the block corresponding to the image segment for update.

[0065] The contract processing unit (260) is configured to sign various transaction contracts using the medical image and process related processes. Such transaction contracts can be configured to use a smart contract to settle fees according to preset transaction conditions. The contract processing unit (260) can be configured to generate a block for the smart contract on the blockchain network (300) based on data related to the use of the medical image through the smart contract, and can include information related to the usage period information of the medical image, that is, start date and end date, information related to the access and editing permissions of the image, etc.

[0066] Figure 3 This is an example diagram showing the generation of a block on a blockchain network for multiple image segments related to medical images according to an embodiment of the present invention.

[0067] Referring to Figure 3 , for example, medical images related to stent implantation or surgery can be segmented into 4 image segments according to the respective steps, namely 1) surgical preparation and anesthesia, 2) catheter insertion, 3) balloon dilation, and 4) catheter removal and stent installation. Each image segment can include interval information related to the start time point and end time point of t1t2, t2t3, t3t4, and t4t5 as timestamp information, and different accessible connection links can be assigned to each segmented image segment, thereby generating information related to the connection links corresponding to each image segment, that is, connection link information. In this way, multiple blocks containing connection link information and time interval information can be generated for each of the multiple image segments of the sequentially segmented medical images.

[0068] Figure 4 This is an example diagram showing the block header structure of a block for explaining an embodiment of the present invention.

[0069] The structure of a block can be generally divided into a block hash as an identifier of the block, a block header with basic information, and a block body with transaction information, etc. Among them, the block header usually includes information such as version, previous block hash, Merkle root, time, difficulty target, nonce, etc. According to the present invention, the block can further include connection link information related to the connection links that can access each of the multiple image segments, and interval information generated based on the timestamp information of the start and end time points of each of the multiple image segments in the block header.

[0070] Through this block structure, the link information of surgical image segments or still images that can access distributed individual ledgers is matched and recorded using the blockchain, thereby preventing the tampering of medical image records. For example, the link information can be encrypted, and the storage space storing the image or still image can be set to read-only, thereby preventing the modification of the image at the access location.

[0071] The present invention segments surgical videos into multiple image segments and uses a combination of connection link information and interval information to form blocks, thereby providing a system that can effectively manage surgical videos while reducing the block data capacity, and can solve the problems that surgical records are discarded due to the expiration of the storage period or the main content related to the relevant surgery is tampered with.

[0072] Figure 5It is a flowchart of a method for managing medical images using blockchain to illustrate an embodiment of the present invention.

[0073] Referring to Figure 5 , first, the medical images captured and recorded by the medical image capturing unit (100) can be received by the image receiving unit (210) of the medical image management server (200). (S510)

[0074] The medical image management server (200) can sequentially divide the medical image into multiple image segments through the image segmentation unit (220). (S520)

[0075] The medical image management server (200) can generate connection links for the multiple image segments through the connection link management unit (230) and generate interval information for each image segment. (S530)

[0076] The medical image management server (200) can sequentially record the data related to the multiple image segments in the block through the block generation processing unit (240). (S540) At this time, the block header of the block can include connection link information related to the connection links that can access each of the multiple image segments, and interval information generated based on the timestamp information of the start and end time points of each of the multiple image segments.

[0077] In addition, the medical image management server (200) can perform block update according to the tag information related to the multiple image segments through the block update processing unit (250). (S550) For example, the block can be updated by adding information, viewing records, transaction records, usage records, etc. according to the tag information corresponding to each image segment.

[0078] In addition, the medical image management server (200) can track visitor information, access IP information, and access time information in the form of a log record. (S560) By tracking the access-related information accessed through this link, the access information can be monitored. In addition, the block can be updated according to this access-related information, thereby preventing the access record from being tampered with.

[0079] Figure 6 It is a schematic diagram of the structure of a surgical image transmission system using a cache server to illustrate an embodiment of the present invention.

[0080] Referring to Figure 6, the user terminal (400) is a device used by users such as doctors or medical teams during surgeries, treatments, diagnoses, etc. For example, it can be configured to be able to access a content server (600), a cache server (700), an image segment management server (800), etc. Specifically, it can be any one of a smart phone, a tablet computer, a desktop computer, a laptop computer, a notebook computer, a workstation, a Personal Digital Assistant (PDA), a portable computer, a wireless phone, a mobile phone, an e-book, a portable multimedia player (PMP), a portable game console, a digital camera, a television, a wearable device, a head-mounted display (HMD), artificial intelligence (AI), and a speaker, but is not limited to these. In addition, the user terminal (400) may include a display unit for providing a medical image screen, or may be connected to a display unit and configured to be controllable.

[0081] The user terminal (400) can be configured to communicate with various servers, such as a content server (600), a cache server (700), and a video clip management server (800), via a network (500). The network (500) is a component for data transmission and reception between the user terminal (400) and multiple servers (600, 700, 800), and is used to perform wired or wireless communication. When the network is a wireless communication network, it may include cellular communication or short-range communication. For example, cellular communication may include at least one of LTE (Long-Term Evolution), LTE-A (LTE Advanced), 5G (5th Generation), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile Telecommunications System), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications). In addition, short-range communication may include at least one of Wi-Fi (Wireless Fidelity), Bluetooth, Zigbee, Near Field Communication (NFC), or Radio Frequency Identification (RFID). However, the communication method is not limited to this, and also includes wireless communication technologies developed in the future.

[0082] Next, the content server (600) can be configured to store multiple surgical images. For example, it can be configured to store images related to surgeries, treatments, diagnoses, etc., recorded by the medical imaging unit (100) using various types of cameras in spaces such as operating rooms, treatment rooms, or examination rooms in a hospital.

[0083] The cache server (700) can be configured to receive and store at least a part of the surgical images related to the surgery from the multiple surgical images stored in the content server (600), and transmit at least a part of the surgical images to the user terminal (400) when the user terminal (400) requests a reference image. In addition, the cache server (700) can select the most favorable cache server from multiple cache servers according to the proximity or response speed to the location of the user terminal (400).

[0084] The video clip management server (800) can be configured to receive surgical-related information including the surgical date and type of surgery, determine the surgical images related to the surgery from multiple surgical images stored in the content server (600) according to the surgical-related information, and segment the relevant surgical images into multiple video clips with a capacity below a predetermined value.

[0085] The multiple video clips segmented in this way can be sequentially generated within the surgical image according to the timestamp information of each interval. The video clip management server (800) can be configured to transmit at least one of the multiple video clips corresponding to the previous ones to the cache server (700).

[0086] In addition, the video clip management server (800) can be configured to transmit at least one video clip to the cache server (700) before the surgical date according to a predetermined surgical date. For example, according to a predetermined criterion, the video clip can be pre-transmitted to the cache server (700) one day or one hour before the surgical date and set to be stored in the cache server (700).

[0087] In addition, the video clip management server (800) can be configured to determine relevant surgical images from multiple surgical images stored in the content server (600) according to the similarity judgment with the reference image information previously used by the user terminal (400). That is, the past historical data previously referred to or searched by the user of the user terminal (400) can be used to determine the surgical images with a high possibility of being referred to during the surgery.

[0088] In addition, when more than a predetermined proportion of the content in at least one video clip is streamed on the user terminal (400), it can be determined that the user is referring to the video clip. The cache server (700) can be configured to request, receive, and store the remaining video clips of the video clip except for the previous part from the video clip management server (800). Thus, by pre-storing the remaining video clips in the cache server (700), the transmission delay can be minimized when the user terminal (400) views the surgical image through streaming.

[0089] In addition, when all multiple video clips are streamed in the user terminal (400), the cache server (700) may be configured to transmit at least a part of the second surgical image in the next sequence of the transmitted surgical images to the user terminal (400). In addition, when a predetermined proportion or more of at least one video clip or all video clips of the second surgical image are streamed in the user terminal (400), it may be determined that the user is referring to the video clip in the second surgical image, and the cache server (700) may be configured to request, receive, and store the remaining video clips other than the foregoing front part among the multiple video clips from the video clip management server (800).

[0090] In addition, the video clip management server (800) may perform video analysis on the multiple video clips through artificial intelligence technology or the like, and determine at least one main video clip among the multiple video clips based on at least one of the movement of the surgical tool, the amount of bleeding, and the degree of change of the organ related to the surgery, and transmit the main video clip among the multiple video clips to the cache server (700). In this way, the video clip management server (800) can determine the main video clip among the multiple video clips determined to be important and transmit only the main video clip to the cache server (700), so that the limited storage space of the cache server (700) can be effectively utilized.

[0091] Figure 7 It is a block diagram showing the structure of a cache server for explaining an embodiment of the present invention.

[0092] Referring to Figure 7 , the video clip management server (800) according to the present invention may include a surgical information receiving unit (810), a surgical image determining unit (820), a video clip segmentation processing unit (830), an image transmission processing unit (840), etc., and these components may include programs or program modules executed by one or more processors. The programs or program modules included in the video clip management server (800) may be configured in the form of an operating system, an application program, or a program, etc., and may be physically stored on various types of widely used storage devices. Such programs or program modules may include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing specific tasks or executing specific data types, but are not limited to these forms.

[0093] First, the surgical information receiving unit (810) may be configured to receive surgical-related information including information such as the surgical date, surgical subject, surgical site location, and surgical type from a user terminal (400) or a server or terminal that manages other surgical information.

[0094] The surgical image determination unit (820) is configured to determine a surgical image to be provided to the user terminal (400) as a surgical reference image, and may be configured to determine a relevant surgical image from among a plurality of surgical images stored in the content server (600) based on the received surgical-related information. In addition, the surgical image determination unit (820) may use the previous history information of the user terminal (400) to determine a relevant surgical image from among a plurality of surgical images stored in the content server (600) based on a similarity determination with the reference image information previously used by the user of the user terminal (400) associated with the surgical type.

[0095] In addition, the surgical image determination unit (820) may, through artificial intelligence technology or the processing of an operator, use the image analysis of a plurality of image segments to determine at least one main image segment among the plurality of image segments based on at least one of the movement of the surgical tool, the amount of bleeding, and the degree of change of the organ related to the surgery, and transmit only the main image segment among the plurality of image segments to the cache server (700). In this way, the main image segment among the plurality of image segments determined to be important can be determined and only the main image segment can be transmitted to the cache server (700), so that the limited storage space of the cache server (700) can be effectively utilized, and from the perspective of the medical team, only the main image segment can be referred to within a limited time, thus effectively utilizing time.

[0096] The image segmentation processing unit (830) may be configured to segment the relevant surgical image determined in the surgical image determination unit (820) into a plurality of image segments having a capacity below a predetermined value. At this time, the plurality of image segments may be sequentially generated in the surgical image according to the timestamp information of each interval, and the image segment management server (800) may be configured to transmit at least one of the sequentially generated image segments corresponding to the previous ones to the cache server (700) through the image transmission processing unit (840).

[0097] The image transmission processing unit (840) may be configured to perform transmission processing and transmission scheduling management of the images transmitted to the cache server (700), and may determine a single cache server connected to the user terminal (400) based on the proximity to the location of the user terminal (400) or the response speed of each cache server. In addition, the image transmission processing unit (840) may be configured to transmit at least one image segment to the cache server (700) before the surgical date based on the surgical date information included in the surgical-related information.

[0098] Figure 8 It is an example diagram for explaining a method of using a cache server to provide multiple video clips related to surgical images in an embodiment of the present invention.

[0099] For example, a predetermined surgery may include two surgeries, and may include a plan to sequentially perform a first surgical image related to the first surgery and a second surgical image related to the second surgery.

[0100] First, the first surgical image determined as a reference image associated with the first surgery may be five video clips sequentially generated according to the timestamp information (t1 to t6) of each interval. First, the first video clip and the second video clip corresponding to the front may be pre-stored in the cache server. At this time, when, through the user terminal (400), at a time point exceeding, for example, t2, all of the first video clips are viewed through streaming, the cache server (700) may request, receive, and store subsequent video clips, such as the third video clip, the fourth video clip, and the fifth video clip, from the video clip management server (800). In this way, according to whether the segmented video clips are viewed or not, subsequent video clips are transmitted to the cache server (700) in advance and stored, so that the surgical images viewed by the user can be viewed without delay.

[0101] On the other hand, when the streaming of the video is ended through the user terminal (400) before a predetermined reference, that is, at the time point of t2, it may be determined that the reference image is not needed, and the cache server (700) may be configured not to request subsequent video clips, such as video clips after the third video clip. In addition, in order to effectively manage the storage capacity of the cache server (700), it may be determined that the video clips whose streaming is ended before a certain time point are not the objects of concern of the user, and all these video clips are deleted.

[0102] In addition, when the user terminal (400) finishes viewing the first surgical image through streaming, the cache server (700) may be configured to transmit at least a part of the next sequential second surgical image as a previous video clip to the user terminal (400). At this time, if the previous video clip of the second surgical image is not stored in the cache server (700), for example, before the viewing of the first surgical image ends, for example, at the time points of t4 or t5, the cache server (700) may request, receive, and pre-store the previous video clip of the second surgical image from the video clip management server (800).

[0103] Figure 9 It is a flowchart of a surgical image transmission method using a cache server for explaining an embodiment of the present invention.

[0104] First, multiple surgical images can be stored in the content server (600). (S910) At this time, the surgical images can together include the type of the surgery, the surgical object, timestamp information and label information for each interval, etc.

[0105] The image segment management server (800) can receive surgery-related information including the surgery date and the type of the surgery through the surgery information receiving unit (810). (S920)

[0106] The image segment management server (800) can determine relevant surgical images according to the surgery-related information through the surgery image determination unit (820). (S930)

[0107] The image segment management server (800) can divide the surgical image into multiple image segments through the image segmentation processing unit (830). (S940) For example, the surgical image can be multiple image segments sequentially generated according to the timestamp information for each interval.

[0108] The image segment management server (800) can determine a cache server connected to the user terminal (400) according to the proximity to the position of the user terminal (400) or the response speed of each cache server through the image transmission processing unit (840). (S950)

[0109] The determined cache server (700) can receive and store a part of the image segments in the relevant surgical images from the image segment management server (800). (S960)

[0110] When the user terminal (400) requests a surgical reference image, a part of the image segments can be provided to the user terminal (400) in a streaming manner through the determined cache server (700). (S970)

[0111] In addition, the remaining image segments after a part of the image segments are requested from the user terminal (400) can be requested and provided to the user terminal (400) in a streaming manner through the cache server (700). (S980) When the streaming of multiple image segments at the previous position of the surgical image through the user terminal (400) exceeds a specific ratio, the cache server (700) can request, receive, and store the remaining image segments after that from the image segment management server (800), so that the entire image can be viewed without delay.

[0112] Figure 10 It is a schematic diagram showing the structure of a surgical step image transmission system using a cache server according to an embodiment of the present invention.

[0113] Figure 10 The surgical step image transmission system is Figure 6In the structure of the surgical image transmission system using a cache server shown, a surgical procedure determination server (900) is added in the form.

[0114] Among them, the content server (600) can be configured to store multiple surgical images.

[0115] The image segment management server (800) can be further configured to receive surgical-related information including the type of surgery, and according to the received surgical-related information, segment and store the multiple surgical images stored in the content server (600) according to the detailed surgical procedures.

[0116] The surgical procedure determination server (900) can be configured to determine the detailed surgical procedures according to the type of surgery of the surgical patient, and determine each image segment related to each detailed surgical procedure.

[0117] In addition, the surgical procedure determination server (900) can be configured to determine the detailed surgical procedures according to the record information of multiple previous surgical patients who have undergone the same type of surgery as the surgical patient. In addition, the record information of the previous surgical patients can include at least one of gender, age, surgery time, underlying diseases, other surgical experiences, postoperative prognosis, and postoperative recovery period. That is, when determining the detailed surgical procedures, the record information of the previous surgical patients can be used, and the surgical procedures and conditions with good prognosis and recovery period under conditions similar to the current patient can be used.

[0118] In addition, the surgical procedure determination server (900) can be configured to combine the detailed surgical procedures of multiple previous surgical patients to determine the detailed surgical procedures. For example, it can be configured to combine the detailed surgical procedures of the first previous surgical patient who has undergone the same type of surgery as the current surgical patient and the different detailed surgical procedures of the second previous surgical patient who has undergone the same type of surgery as the current surgical patient to determine the detailed surgical procedures of the current surgical patient.

[0119] In addition, the surgical procedure determination server (900) can use an artificial intelligence learning model, use the record information of the previous patients, and obtain the detailed surgical procedures with the best prognosis and recovery period under conditions similar to the current patient, so that the best detailed surgical procedures suitable for the current surgical patient can be recommended through the artificial intelligence learning model.

[0120] The cache server (700) can be configured to receive and store each of a plurality of video segments related to respective detailed surgical procedures from the video segment management server (800), and when the user terminal (400) requests a detailed surgical procedure video, transmit the plurality of video segments related to the detailed surgical procedure determined in the surgical procedure decision server (900) to the user terminal (400). At this time, the cache server (700) can determine the cache server at the optimal location from among a plurality of cache servers based on the proximity to or response speed of the location of the user terminal (400).

[0121] In addition, the cache server (700) can confirm whether each video segment related to respective detailed surgical procedures determined in the surgical procedure decision server (900) is stored or not. For video segments not stored in the cache server (700), it can receive and store the video segment from the video segment management server (800) according to the surgical schedule of the surgical patient. For example, the cache server (700) can confirm whether each video segment related to respective detailed surgical procedures is stored or not, for example, 1 hour or one day before the surgical date of the surgical patient. For non-stored video segments, it can request from the video segment management server (800) and pre-store the video segment before the surgical date.

[0122] The user terminal (400) can be configured to receive a plurality of video segments according to the detailed surgical procedures determined in the surgical procedure decision server (900).

[0123] Figure 11 It is an example diagram of the structure for recommending the detailed surgical procedures of a surgical patient for explaining an embodiment of the present invention.

[0124] One surgery can be divided into detailed surgical procedures in multiple stages, and video segments can be segmented in each detailed surgical procedure. In Figure 11 it is assumed that patients 1, 2, and 3 have records of previously undergoing the same type of surgery, and patient 4 plans to undergo the same type of surgery.

[0125] For example, if looking at the previous surgical record of patient 1, it has detailed surgical procedures consisting of 3 steps: step A, step B, and step C. The previous surgical record of patient 2 added step D between step A and step B, for a total of 4 stages of detailed surgical procedures. In addition, in the previous surgical record of patient 3, step E was added after steps A, B, and C, for a total of 4 stages of detailed surgical procedures. Thus, even for the same type of surgery, depending on the patient's condition and the circumstances of the surgery, there may be cases where some detailed surgical procedures are added or changed. By accumulating such surgical data, probability judgments can be made on the results of the detailed surgical procedures.

[0126] For patient 4 who is scheduled for the same type of surgery as patients 1 to 3, the detailed surgical steps determined by the surgical step determination server (900) are in a form that combines the detailed surgical steps of patients 1 to 3, including a total of 5 stages of detailed surgical steps consisting of step A, step D, step B, step C, and step E, and the detailed surgical step images corresponding to these 5 stages can be provided to the medical team as reference images. For the recommendation and determination of such detailed surgical steps, for example, an artificial intelligence learning model can be used to utilize the recorded information of previous patients to obtain the detailed surgical steps with the best prognosis and recovery period under conditions similar to the current patient, and under patient environmental conditions such as the same gender, similar age, and similar underlying diseases, the detailed surgical step conditions with the best prognosis and recovery conditions can be found and recommended.

[0127] Figure 12 It is an example diagram for explaining a method of providing detailed surgical step images using a cache server in an embodiment of the present invention.

[0128] Refer to Figure 12 The detailed surgical steps of patient 4 determined in the surgical step determination server (900) may include the A-step image, B-step image, and C-step image of the surgical image of patient 1. In addition, it may also include the D-step image in the surgical image of patient 2.

[0129] At this time, the cache server (700) can first confirm whether the surgical images of patient 1 and the D-step image in the surgical image of patient 2 are stored before the surgery date of this surgical patient. For example, as Figure 12 shown, if it is determined that all the images of the surgical images of patient 1, namely the A-step image, B-step image, and C-step image, are stored, but the D-step image of the detailed surgical steps determined as a reference in the surgical image of patient 2 is not stored, then the cache server (700) can request the image segment management server (800) to transmit the D-step image in the surgical image of patient 2. At this time, according to the surgical schedule of patient 4, the image transmission date can be arranged so that the D-step image of patient 2 can be received and stored from the cache server (700) before the surgery date.

[0130] As described above, various methods and systems of the embodiments of the present invention have been described as specific embodiments, but these are only examples. The present invention is not limited to these examples and should be construed as having the broadest scope based on the basic ideas disclosed in this specification. Those skilled in the art can combine and replace the embodiments disclosed in the specification and implement patterns of shapes not explicitly described, but this also does not depart from the scope of the present invention. In addition, it is obvious that those skilled in the art can easily change or modify the disclosed embodiments according to this specification, and such changes or modifications also fall within the scope of the rights of the present invention.

Claims

1. A medical image recording and management method that uses blockchain to manage medical images, characterized in that, it includes: the step of receiving recorded medical images related to surgery or treatment in a medical image management server; the step of the medical image management server generating a block on a blockchain network according to data related to the medical image; and the step of updating the block by the medical image management server according to new data related to the medical image, wherein, it further includes: the step of the medical image management server splitting the medical image into multiple image segments and sequentially recording them in the block according to data related to the multiple image segments, the multiple image segments are sequentially generated within the medical image according to timestamp information of each interval, the block header of the block includes information related to a connection link capable of accessing each of the multiple image segments, that is, connection link information, and interval information generated according to timestamp information of the start and end time points of each of the multiple image segments.

2. The medical image recording and management method according to claim 1, characterized in that, the multiple image segments further include tag information inserted into the recorded surgical image.

3. The medical image recording and management method according to claim 2, characterized in that, the tag information includes at least one of a surgical subject, a comment related to the surgical situation, a surgical order, a surgical tool, and a surgical related event.

4. The medical image recording and management method according to claim 1, characterized in that, the medical image management server is configured to trace visitor information, access IP information, and access time information for accessing the connection link in the form of a log.

5. The medical image recording and management method according to claim 1, characterized in that it further includes the step of signing a transaction contract for using the medical image through the medical image management server, and the transaction contract is configured to use a smart contract to perform fee settlement according to preset transaction conditions.

6. A medical image management server for using blockchain to manage medical images, characterized in that, it includes: an image receiving unit configured to receive recorded medical images related to surgery or treatment; a block generation processing unit configured to generate a block on a blockchain network according to data related to the medical image; and a block update processing unit configured to update the block by the medical image management server according to new data related to the medical image, wherein, it further includes: an image splitting unit configured to split the medical image into multiple image segments, the block generation processing unit is configured to sequentially record them in the block according to data related to the multiple image segments, the multiple image segments are sequentially generated within the medical image according to timestamp information of each interval, the block header of the block includes information related to a connection link capable of accessing each of the multiple image segments, that is, connection link information, and interval information generated according to timestamp information of the start and end time points of each of the multiple image segments.

Citation Information

Patent Citations

  • Medical image data security management method and system based on block chain

    CN112699406A

  • Traffic accident responsibility determination method and device, computer equipment and storage medium

    CN114550053A

  • Method for manufacturing a leather having a natural skin pattern and a leather produced by the method

    KR102402460B1

  • Methods, systems, apparatuses and devices for facilitating data management of medical imaging data

    US20200327978A1