Tagging device for treatment video

The device automatically tags and anonymizes treatment videos by analyzing medical equipment and processes, addressing inefficiencies in manual bookmarking and ensuring easy database management and privacy.

JP2024162572AActive Publication Date: 2024-11-21QUOTOMY INC
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023078206
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-21
Estimated Expiration
2043-05-10

AI Technical Summary

Technical Problem

Existing video recording devices for surgical operations and medical image diagnostic apparatuses require manual input of bookmark data, making them inefficient for processing large amounts of treatment videos.

Method used

A device that automatically adds tags to treatment videos by analyzing medical equipment and processes within the videos, while making individual-identifying images invisible, using image analysis and machine learning to facilitate database compilation.

Benefits of technology

Enables efficient tagging and compilation of treatment videos into databases, allowing easy searching and enhanced anonymity through automatic tagging and image processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162572000001_ABST
    Figure 2024162572000001_ABST
Patent Text Reader

Abstract

To provide a device which can automatically tag a treatment image.SOLUTION: A tagging device for a treatment video has a treatment video input part into which a treatment video is input, a tagging part which analyzes used medical equipment which is medical equipment included in the treatment video, and tags the treatment video in association with the used medical equipment on the basis of the used medical equipment. The tagged treatment video in which the tag is provided can be replayed from a tagged part.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a tagging device for treatment videos. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2006-43209 describes a video recording device for surgical procedures. This device stores name data for surgical procedures or instruments, selects and designates a specific surgical procedure or instrument present in an index title storage unit, and records an index image corresponding to the operation timing. This device makes it possible to store recorded videos of surgical procedures in a state that allows for quick search. This device is therefore useful because it makes the surgical procedures videos searchable and can also display index images. However, this device requires that each video be made searchable by a person. This means that this device cannot process a large number of surgical procedures videos.

[0003] Japanese Patent No. 5044069 describes a medical image diagnostic device. This device can obtain a treatment video associated with a type of bookmark data at any timing on a time scale. This bookmark is a marker for accessing the video. This device requires a person to manually input bookmark data for each video. For this reason, this device cannot process a large amount of treatment videos. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2006-43209 A [Patent Document 2] Patent No. 5044069 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a device that can automatically provide tags to treatment videos. Another object of the present invention is to provide a device that can make image areas that identify an individual in a treatment video invisible. [Means for solving the problem]

[0006] This invention is based on the knowledge that by analyzing images of medical equipment included in a treatment video, tags can be automatically added to the treatment video based on the medical equipment. This invention is also based on the knowledge that it is preferable to make image parts that identify individuals invisible, because this makes it easier to create a database of the treatment video.

[0007] The treatment video tagging device 1 has a treatment video input unit 3 and a tag setting unit 5. The treatment video input unit 3 is an element for inputting treatment videos into the device 1. The tag setting unit 5 is an element for analyzing medical equipment included in the treatment video (referred to as "medical equipment used") and setting tags relating to the medical equipment used in the treatment video based on the medical equipment used. Treatment videos that have been tagged (also referred to as "tagged treatment videos") can be cue-started from the portion where the tag has been set.

[0008] A preferred example of the tag setting unit 7 is one that can analyze the performed treatment process, which is the treatment process of the treatment video, based on the treatment video, and further set a tag related to the performed treatment process in the treatment video. Then, the treatment video with the tag can be started from the part where the tag related to the performed treatment process is set, using the treatment process name related to the performed treatment process.

[0009] A preferred example of the tag setting unit 7 is one that can analyze the performed treatment technique, which is the treatment technique of the treatment video, based on the treatment video, and add identification information related to the performed treatment technique to the treatment video. Then, the treatment video to which the identification information related to the performed treatment technique is added can be searched for using the treatment technique name related to the performed treatment technique.

[0010] A preferred example of the tag setting unit 7 is one that can further add link information for displaying information about the medical equipment used to the portion of the medical equipment used in the treatment video.

[0011] A preferred example of the treatment video tagging device 1 further includes a person specific part removal unit 7. The person specific part 7 is an element for analyzing a person specific part, which is an image part that identifies a patient or a medical worker included in the treatment video, and for processing the treatment video so that the person specific part is not visible if the treatment video includes the person specific part.

[0012] Another invention described in this specification relates to a program for causing a computer to function as the above-mentioned treatment video tagging device, and a non-transitory recording medium readable by a computer that stores such a program. Effect of the Invention

[0013] According to this invention, by performing image analysis of the medical equipment included in the treatment video, tags can be automatically added to the treatment video based on the medical equipment. In addition, a preferred embodiment of this invention makes it possible to make the image parts that identify individuals invisible, so that the treatment video can be more easily compiled into a database. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram for explaining a tagging device for treatment videos. [Diagram 2] FIG. 2 is a flowchart showing an example of tagging a treatment video. [Diagram 3] FIG. 3 is a conceptual diagram showing an example of a treatment video to which tags have been added. [Figure 4] FIG. 4 is a conceptual diagram showing an example in which information for accessing information about a medical device is added to a medical device portion in a treatment video. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, the embodiments for carrying out the present invention will be described with reference to the drawings. The present invention is not limited to the embodiments described below, and includes appropriate modifications of the embodiments described below within the scope obvious to those skilled in the art.

[0016] FIG. 1 is a block diagram for explaining a treatment video tagging device. As shown in FIG. 1, this treatment video tagging device 1 has a treatment video input unit 3 and a tag installation unit 5. This device 1 may further have a person specific part removal unit 7. This device 1 may further have any one or more of a medical device storage unit 11, a hand information storage unit 13, a treatment process storage unit 15, a treatment target part storage unit 17, a treatment technique storage unit 19, and a person specific part storage unit 21. The treatment video tagging device 1 is implemented by a computer. In other words, each element constituting the treatment video tagging device 1 may be implemented by a computer.

[0017] The computer has an input unit, an output unit, a control unit, a calculation unit, and a storage unit, and each element is connected by a bus or the like so as to be able to exchange information. For example, the storage unit may store a control program or various information. When predetermined information is input from the input unit, the control unit reads out the control program stored in the storage unit. Then, the control unit appropriately reads out the information stored in the storage unit and transmits it to the calculation unit. The control unit also appropriately transmits the input information to the calculation unit. The calculation unit performs calculation processing using the various information received and stores it in the storage unit. The control unit reads out the calculation results stored in the storage unit and outputs them from the output unit. In this way, various processes and each step are executed. The various parts and means execute these various processes. The computer may have a processor, and the processor may realize various functions and various steps. The computer may be standalone. A part of the computer's functions may be distributed to a server and a terminal. In that case, it is preferable that the server and the terminal are able to exchange information through a network such as the Internet or an intranet. The computer may include a processor and a memory coupled to the processor. The memory may store instructions that, when executed by the processor, cause the computer to perform various processes or function as various elements. The computer may be provided with various teaching data to build a learning model and realize various calculations by machine learning. In this case, the computer may perform various analyses using a learning model created by machine learning and deep learning of AI (artificial intelligence).

[0018] The storage unit of the computer may store, for example, an analysis model (trained model) used when analyzing the video. The analysis model is preferably a model that has learned the medical equipment used in the surgery (which may include the position change of the equipment), the surgical procedure in which the medical equipment is used, and the surgical procedure. The analysis model may further be a model that has learned the position of the hand or arm included in the surgical video (which may include the position change of the hand or arm), the surgical procedure corresponding to the position of the hand or arm, and the surgical procedure. The computer preferably analyzes the surgical video of the surgery and performs at least one of identifying the surgical procedure of the surgery included in the surgical video data and classifying the surgical procedure. The computer may classify the procedure from the surgical video based on the medical equipment used in the surgery and the position of the medical equipment (which may include the position change). The computer may also classify the surgical procedure from the position change of the hand or arm handling the medical equipment in addition to the medical equipment used in the surgery. Since it is possible to identify the surgical procedure from a combination of surgical procedures including the order, the computer may identify the surgical procedure of the surgery based on the combination of the procedures including the classified order. At this time, the surgical procedure may be identified by referring to information associating a combination of steps including an order with the surgical procedure. In this manner, the computer may learn various learning models by machine learning and perform various processes using the learned models.

[0019] The treatment video tagging device 1 is a device for attaching a tag to a treatment video for cueing a predetermined point in the treatment video so that the treatment video can be viewed. The treatment video may be a video related to surgery or treatment. An example of a surgery is a surgical operation. An example of a treatment is a beauty treatment or a massage. A tag is also called an index or a bookmark, and is information attached to a video so that the video can be viewed from the part where the tag is added. It is preferable that the device 1 is capable of searching for a treatment video using tags. For example, a video can be viewed from the point where a certain medical device is used in a certain step of a certain treatment. It is preferable that the tag is stored in the storage unit in association with the name of a certain medical device used in the treatment video. The name of the medical device stored in association with the tag may be displayed together with the tag portion when the treatment video is displayed. The treatment video with the tag can be cue-started from the part where the tag related to the used medical device is provided, using the name of the medical device related to the used medical device.

[0020] The treatment video input unit 3 is an element into which the treatment video is input. The treatment video tagging device 1 is connected to a shooting unit (e.g., a camera or video camera) that shoots videos, and when the treatment video is shot, the treatment video may be input into the treatment video tagging device 1. Also, a video file related to the treatment video may be input into the treatment video tagging device 1 by drag and drop. Furthermore, the treatment video tagging device 1 may search for treatment videos on the Internet and automatically input the treatment videos that are found. In this way, the treatment video is input into the treatment video tagging device 1.

[0021] The tag installation unit 5 is an element for analyzing the medical equipment used, which is the medical equipment included in the treatment video, and providing tags related to the medical equipment used in the treatment video based on the medical equipment used. This device 1 further includes a medical equipment storage unit 11. The medical equipment storage unit 11 associates and stores the name of the medical equipment and the image data of the medical equipment. The medical equipment storage unit 11 may further store the ID of the medical equipment. For example, the tag installation unit 5 may perform machine learning on image data related to various medical equipment, create a learning model related to the medical equipment, and store it in the storage unit. Then, the tag installation unit 5 may analyze the medical equipment included in the treatment video using the learning model related to the medical equipment. For example, the tag installation unit 5 may perform machine learning on video data related to various treatment steps and various treatments, create a learning model related to various treatment steps and various treatments, and store it in the storage unit. Then, the tag installation unit 5 may analyze each treatment step in the treatment video and the treatment performed in the treatment video using the learning model related to various treatment steps and various treatments.

[0022] For example, the tag installation unit 5 reads out an image (treatment image) included in the treatment video from the storage unit, and reads out image data of the medical device from the medical device storage unit 11. Then, the tag installation unit 5 compares the treatment image with the image data of the first medical device. If the tag installation unit 5 determines that the treatment image includes image data of the first medical device, it determines that the first medical device is the medical device used. If the tag installation unit 5 determines that the treatment image does not include the first medical device as a result of the comparison process by the tag installation unit 5 using the treatment image and the image data of the first medical device, the tag installation unit 5 reads out image data of the second medical device, which is the next medical device, from the medical device storage unit 11. Then, the tag installation unit 5 repeats the comparison process between this treatment image and the image data of the medical device. In this way, the tag installation unit 5 can identify the medical device in the image included in the treatment video. In other words, the tag installation unit 5 can identify the medical device used at a certain timing in the treatment video.

[0023] A preferred example of the tag installation unit 5 is one that performs image analysis of the practitioner's hand included in the treatment video (treatment image) and sets the medical device held by the practitioner's hand as the medical device in use. For example, the treatment video may include medical devices that are not used in the treatment. In this example, even in such a case, a tag can be set for the medical device actually used in the treatment. In this example, the treatment video tagging device 1 may have a hand information storage unit 13. Then, the tag installation unit 5, for example, reads out an image (treatment image) included in the treatment video from the storage unit and reads out image data of the hand from the hand information storage unit 13. Then, the tag installation unit 5 compares the treatment image with the image data of the hand. In this way, the practitioner's hand in the image (treatment image) included in the treatment video can be grasped. Then, when multiple medical devices are included in the treatment video (treatment image), the tag installation unit 5 may set the medical device closest to the practitioner's hand in the treatment video (treatment image) as the medical device in use. Furthermore, when the hand information storage unit 13 stores image data of a hand in a state where the hand is holding a medical device, the medical device analyzed as being held in the hand in that state may be determined as the medical device in use.

[0024] A preferred example of the tag installation unit 5 is one that performs image analysis of the practitioner's hand and the assistant's hand included in the treatment video (treatment image), and sets the medical device held by the practitioner's hand as the medical device to be used. For example, the tag installation unit 5 reads out an image (treatment image) included in the treatment video from the storage unit, and reads out image data of the hand from the hand information storage unit 13. Then, the tag installation unit 5 compares the treatment image with the image data of the hand. When the treatment image includes multiple hands, the tag installation unit 5 may analyze which hand is the practitioner's hand using the position of the hand in the treatment image and information about the medical device near the hand in the treatment image. For example, the hand information storage unit 13 stores image data of the right hand and image data of the left hand. Then, the tag installation unit 5 uses the image data of the right hand and the image data of the left hand to analyze whether the hand included in the treatment image is the right hand or the left hand. Then, for example, the tag installation unit 5 may determine that, among multiple pairs of hands, the pair that is closest to the center of the image is the practitioner's hand (pair of hands). Also, the set that is farther from the center of the screen may be determined to be the assistant's hand (set). The tag installation unit 5 may then analyze the medical equipment that is close to the practitioner's hand included in the treatment image or that is image-analyzed to be held by the practitioner's hand as the medical equipment used by the practitioner, and store this in the storage unit. The tag installation unit 5 may also analyze the medical equipment that is close to the assistant's hand included in the treatment image or that is image-analyzed to be held by the assistant's hand as the medical equipment used by the assistant, and store this in the storage unit.

[0025] A preferred example of the tag setting unit 7 is one that can analyze the performed treatment technique, which is the treatment technique of the treatment video, based on the treatment video, and add identification information related to the performed treatment technique to the treatment video. Then, the treatment video to which the identification information related to the performed treatment technique is added can be searched for using the treatment technique name related to the performed treatment technique.

[0026] The surgical procedure refers to each step in a surgical procedure. Examples of the surgical procedure are exposure (e.g., lumbar exposure), fixation, screw insertion, decompression, disk manipulation, and wound closure. The surgical procedure is not limited to these examples and may be various steps in various surgeries and procedures.

[0027] The tag installation unit 5 may analyze the treatment process based on, for example, the type of medical equipment included in the treatment video (treatment image). The tag installation unit 5 may analyze the treatment process based on, for example, the movement of the medical equipment included in the treatment video (treatment image). The tag installation unit 5 may analyze the treatment process based on, for example, the type of medical equipment and the treatment target area included in the treatment video (treatment image). The tag installation unit 5 may analyze the treatment process from, for example, information on the medical equipment used by the practitioner and the medical equipment used by the assistant among the medical equipment included in the treatment video (treatment image).

[0028] The treatment process storage unit 15 stores the treatment process and the medical equipment in association with each other. The tag installation unit 5 may read information on the medical equipment used from the storage unit, and may read the treatment process stored in association with the medical equipment used from the treatment process storage unit 15. In this way, the tag installation unit 5 may read the treatment process from the treatment process storage unit 15, which stores information required for analyzing the treatment process, using information required for analyzing the treatment process. For example, the treatment process storage unit 15 stores the treatment process in association with the medical equipment used by the practitioner and the medical equipment used by the assistant. In this case, the tag installation unit 5 reads the medical equipment used by the practitioner and the medical equipment used by the assistant from the storage unit, and reads the treatment process stored in the treatment process storage unit 15 in association with these pieces of information. The read treatment process may be appropriately stored in the storage unit.

[0029] Table 1 is a conceptual diagram for explaining the treatment process storage unit. As shown in Table 1, the treatment process storage unit 15 stores the treatment process in association with the medical equipment. Also, as shown in Table 1, the treatment process storage unit 15 may store the treatment process in association with the medical equipment and the target site. In this way, the device 1 can read out the performed treatment process from the treatment process storage unit 15 using information on the medical equipment. For example, in the example of Table 1, when the medical equipment used is A1, A2, A3, and A4, A may be read out as the performed treatment process. Also, in the example of Table 1, when the medical equipment used is A1, A2, A3, and A4 and the target site is A5, A may be read out as the performed treatment process.

[0030] [Table 1]

[0031] The treatment target part storage unit 17 stores, for example, a target part during treatment and an image of the target part in association with each other. The tag installation unit 5 may specify the treatment target part included in the treatment video (treatment image) by, for example, comparing an image included in the treatment video (treatment image) with an image of the target part stored in the treatment target part storage unit 17. Examples of treatment target parts are the femur, clavicle, skull, large intestine, small intestine, and eyes. Such a comparison work can be performed by the tag installation unit 5 using machine learning.

[0032] A preferred example of the tag setting unit 7 is one that can analyze the performed treatment technique, which is the treatment technique of the treatment video, based on the treatment video, and further set a tag related to the performed technique in the treatment video. Then, the treatment video with the tag can be searched for using the treatment technique name related to the performed treatment process. The treatment technique storage unit 19 may store the treatment technique in association with multiple treatment processes. Also, the treatment technique storage unit 19 may store the treatment technique in association with multiple treatment processes and multiple medical devices. The tag setting unit 7 may read information on the treatment process and multiple medical devices related to the treatment video from the treatment technique storage unit 19, compare it with the treatment technique storage unit 19, and read the treatment technique stored in association with these treatment processes and medical devices. The read treatment technique may be stored in the storage unit in association with the treatment video.

[0033] Table 2 is a conceptual diagram for explaining the treatment technique storage unit. As shown in Table 2, the treatment technique storage unit 19 stores the treatment technique in association with the treatment process and the medical equipment. Also, as shown in Table 2, the treatment technique storage unit 19 may store the treatment technique in association with the treatment process, the medical equipment, and the target site. In this way, the device 1 can read out the performed treatment technique from the treatment technique storage unit 19 using the necessary information. For example, in the example of Table 2, when the treatment process is B1, B2, B3, and B4, and the medical equipment used is B5, B6, B7, and B8, B may be read out as the performed treatment technique. Also, in the example of Table 2, when the treatment process is B1, B2, B3, and B4, the medical equipment used is B5, B6, B7, and B8, and the target site is B9, B may be read out as the performed treatment technique.

[0034] [Table 2]

[0035] A preferred example of the tag setting unit 7 is one that can further add link information for displaying information about the medical equipment used to the medical equipment used portion in the treatment video. The treatment video tagging device 1 stores, for example, in a storage unit, explanatory text, explanatory image, explanatory material, access information (URL) to a website, and purchase information related to the medical equipment in association with the medical equipment. The treatment video tagging device 1 then grasps the medical equipment portion in the treatment image of the treatment video. When the medical equipment portion is supported by an instruction using a touch panel or a mouse, an input indicating the medical equipment used is made to the treatment video tagging device 1. Then, the treatment video tagging device 1 reads out link information related to the medical equipment used stored in the storage unit, reads out data related to the link information, and is made to be able to access a website related to the link information. Then, information about the medical equipment used is displayed on the user's display unit. In this way, for example, a user who views the treatment video can receive information about the medical equipment actually used and immediately purchase the medical equipment.

[0036] A preferred example of the treatment video tagging device 1 further includes a person specific part removal unit 7. The person specific part 7 is an element for analyzing a person specific part, which is an image part that identifies a patient or a medical worker included in the treatment video, and processing the treatment video so that the person specific part is not visible when the treatment video includes a person specific part. Since the person specific part removal unit 7 is further included, when the treatment video (treatment image) includes a patient's face, tattoos, a medical worker's face, a nameplate, a hospital name, etc., it is possible to ensure anonymity by masking or mosaic these. In this way, a large number of videos can be databased while increasing anonymity. Examples of person specific parts are a patient's face, tattoos, a medical worker's face, a nameplate, and a hospital name.

[0037] For example, the human specific part removal unit 7 constructs a learning model and performs machine learning using past treatment videos, examples of identifying human specific parts in treatment videos, and examples of processing in treatment videos so that the human specific parts are not visible as training data. Then, the human specific part removal unit 7 uses the learning model obtained by machine learning to identify human specific parts in the input treatment video and processes the treatment video so that the human specific parts are not visible. The treatment video tagging device 1 may store the processed treatment video in a storage unit as appropriate.

[0038] The human specific part storage unit 21 may store a learning model for identifying the human specific part of the treatment video described above. The human specific part storage unit 21 may also store image data related to the human specific part. In this case, the human specific part removal unit 7 may compare the input treatment video (treatment image) with image data related to the human specific part stored in the human specific part storage unit 21, and if the input treatment video (treatment image) contains an image portion related to the human specific part, identify that portion as the human specific part. Then, the human specific part removal unit 7 may perform image processing so that the image portion related to the human specific part included in the treatment video (treatment image) cannot be viewed by other companies. Examples of image processing include applying a mosaic, performing a blurring process, and overwriting a mask image on the image portion.

[0039] The treatment video tagging device 1 may create a database including information such as the performed treatment procedure, the performed treatment process, and the medical equipment used for the tagged treatment video, and may make the treatment video searchable by this information. In this way, the medical equipment used can be indexed, making it easy to watch the required treatment video.

[0040] Another invention described in this specification relates to a program for causing a computer to function as the above-mentioned treatment video tagging device, and a computer-readable non-transitory recording medium storing such a program. Examples of the recording medium are a hard disk, a CD, a CD-ROM, a floppy disk, a Blu-ray disk, a USB memory, and an SD card.

[0041] The computer may include a processor and a memory coupled to the processor. The memory stores instructions (programs), and when the instructions are executed by the processor, the computer receives a treatment video, analyzes the medical equipment used, which is the medical equipment included in the treatment video, and provides a tag related to the medical equipment used in the treatment video based on the medical equipment used. The program may also cause the computer to analyze the performed treatment process, which is the treatment process of the treatment video, based on the treatment video, and further provide a tag related to the performed treatment process in the treatment video. Furthermore, the program may cause the computer to analyze the performed treatment technique, which is the treatment technique of the treatment video, and further add identification information related to the performed technique to the treatment video. Furthermore, the program may cause the computer to analyze a person-specific part, which is an image part that identifies a patient or medical worker included in the treatment video, and when the person-specific part is included in the treatment video, the computer may process the treatment video so that the person-specific part is not visible.

[0042] Figure 2 is a flow chart showing an example of tagging a treatment video. In the figure, S stands for step (process).

[0043] Video input process (S101) Treatment video is input from the treatment video input unit 3 to the treatment video tagging device 1.

[0044] Medical device analysis process (S102) The tag installation unit 7 analyzes whether each treatment image included in the treatment video includes an image portion related to a medical device. At this time, the tag installation unit 7 may refer to a learning model that has been machine-learned on medical devices. The tag installation unit 7 may also analyze the presence or absence of a medical device included in the treatment video by analyzing whether the treatment image includes image data related to the medical device using image data related to the medical device. If it is analyzed that the treatment image does not include a medical device, information that a medical device does not exist may be stored in the storage unit together with the treatment image. If the tag installation unit 7 analyzes that the treatment image includes a medical device, information related to the medical device used, such as the name of the medical device used, may be stored in the storage unit together with the treatment image (and the time of the treatment image in the treatment video).

[0045] Tagging process for medical devices used (S103) When the tag setting unit 7 determines that a new medical device is included in the treatment video (when a certain medical device is included in a treatment image for the first time), a tag can be set together with identification information of the treatment image, such as the broadcast time of the treatment image. Specifically, the tag setting unit 7 associates the tag with the identification information of the treatment image and stores it in the memory unit. Information regarding the medical device used may be stored in association with the tag. In this way, the tag setting unit 7 can obtain a treatment video with a tag (referred to as a "tagged treatment video").

[0046] Analysis of treatment process (S104) The tag setting unit 7 analyzes the performed treatment process, which is the treatment process of the treatment video, based on the treatment video, and further provides a tag related to the performed treatment process in the treatment video. At this time, the tag setting unit 7 may refer to a learning model that has been machine-learned regarding the treatment process. In addition, the tag setting unit 7 may analyze the treatment process by referring to the information stored in the treatment process storage unit 15 or the treatment target site storage unit 17, using information regarding the medical equipment or target site included in the treatment video (treatment image).

[0047] Tag assignment process for the performed treatment process (S105) When the tag setting unit 7 determines that a new treatment step is included in the treatment video (when a treatment image includes a treatment step for the first time), a tag may be set together with the identification information of the treatment image, such as the broadcast time of the treatment image. Information regarding the treatment step may be stored in association with the tag. In this way, the tag setting unit 7 can obtain a treatment video to which a tag related to the treatment step is set.

[0048] Performed treatment technique analysis process (S106) The tag setting unit 7 analyzes the performed treatment technique, which is the treatment technique of the treatment video, based on the treatment video, and adds identification information related to the performed treatment technique to the treatment video. At this time, the tag setting unit 7 may refer to a learning model that has been machine-learned regarding the treatment technique. In addition, the tag setting unit 7 may read out the performed treatment technique stored in the performed treatment technique storage unit 19 in association with the performed treatment technique using information related to the performed treatment process.

[0049] Performed treatment procedure information assignment process (S107) The device 1 (tag installation unit 7) may add identification information related to the surgical technique of the performed treatment to the treatment video in relation to the treatment video and store it in the storage unit. Since the identification information related to the surgical technique of the performed treatment is also searchable information, it may be treated as a kind of tag.

[0050] Person specific part determination process (S108) The human specific part removal unit 7 uses a learning model obtained by machine learning to identify human specific parts in the input treatment video (treatment image). If the human specific part removal unit 7 determines that the treatment image does not include a human specific part, it does not remove the human specific part. On the other hand, if the human specific part removal unit 7 determines that the treatment image includes a human specific part, it removes the human specific part.

[0051] Human specific part removal process (S109) When the person specific part removal unit 7 determines that the treatment image includes a person specific part, it processes the treatment image so that the person specific part in the treatment image cannot be seen. For example, the person specific part removal unit 7 may perform a process of turning the person specific part into a mask image. In this way, the person specific part is processed so that it cannot be seen from the treatment video.

[0052] FIG. 3 is a conceptual diagram showing an example of a treatment video with tags. In this example, tags are displayed at specific times in the treatment video. By clicking on the tag, the treatment video can be viewed from the tagged position. The medical equipment used may be displayed in association with the tag. In the example of FIG. 3, a representative treatment image for each treatment process is displayed with the monkey's name (displayed small at the bottom of the video).

[0053] FIG. 4 is a conceptual diagram showing an example in which information for accessing information about a medical device is added to a medical device portion in a treatment video. [Industrial Applicability]

[0054] The present invention can be used in the field of providing medical information. [Explanation of symbols]

[0055] 1. Treatment video tagging device 3 Treatment video input section 5 Tag installation section 7 Human specific part removal department 11 Medical Device Memory Section 13 Hand information storage section 15 Treatment process memory unit 17 Treatment target area memory section 19. Treatment procedure memory section 21 Person specific body part storage unit

Claims

1. A treatment video input unit into which a treatment video is input; A tag setting unit that analyzes a medical device used, which is a medical device included in the treatment video, and sets a tag related to the medical device used in the treatment video based on the medical device used; having The tagged treatment video, which is a treatment video with the tag, can be cue-captured from the part where the tag is provided. A tagging device for treatment videos.

2. 2. The apparatus of claim 1, The device further includes a human-specific part removal unit that analyzes human-specific parts, which are image parts that identify patients or medical professionals included in the treatment video, and if the treatment video contains a human-specific part, processes the treatment video so that the human-specific part is not visible.

3. 2. The apparatus of claim 1, The tag setting unit can analyze the performed treatment process, which is the treatment process of the treatment video, based on the treatment video, and further provide a tag related to the performed treatment process to the treatment video. Device.

4. 2. The apparatus of claim 1, The tag installation unit can analyze the performed treatment technique, which is the treatment technique of the treatment video, based on the treatment video, and further add identification information regarding the performed technique to the treatment video. Device.

5. An apparatus according to any one of claims 1 to 4, The tag setting unit can further add link information for displaying information about the medical equipment used to the medical equipment used portion in the treatment video. Device.

6. Computer, A treatment video input unit into which a treatment video is input; A tag setting unit that analyzes a medical device used, which is a medical device included in the treatment video, and sets a tag related to the medical device used in the treatment video based on the medical device used; having The tagged treatment video, which is a treatment video with the tag, can be cue-captured from the part where the tag is provided. A program that functions as a tagging device for treatment videos.

7. A non-transitory computer-readable recording medium storing the program according to claim 6.

Citation Information

Patent Citations

  • Medical apparatus management system

    JP2009279193A

  • Medical device management system

    JP2009291308A

  • Mobile display device for medical images

    JP2014178458A

  • Systems and methods for analysis of surgical videos

    JP2022520701A

  • Image record playback device and endoscopic system

    WO2020039593A1