Medical image processing system and encoding device

Abstract

Provided are a medical image processing system for alleviating changes in image quality of medical images caused by encoding processing and an encoding device used in the medical image processing system. The medical image system (1000) is characterized by comprising a monitor group (300) to which medical images are input from various transmission paths via a switch (100) and an encoding device (400), wherein the encoding device (400) performs encoding processing on the input medical images and image quality adjustment processing.

Description

Technical Field

[0001] The invention relates to a medical image processing system and a coding device used in the medical image processing system. Background Art

[0002] In recent years, during medical surgery, surgery is generally performed while images of the surgical field, measurement results of biological information, and the like are displayed on a plurality of monitors installed in the operating room or recorded on a recorder.

[0003] As such a system for processing medical images, the present inventors have filed a patent application for the invention according to Patent Document 1 listed below.

[0004] In Patent Document 1, medical images captured by a plurality of cameras are synchronously displayed, and editing processing (processing of cutting out a portion of the capturing period, processing of adding annotations to desired moments, etc.) is implemented for the synchronously displayed medical images.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent No. 639706 Summary of the invention

[0008] Problem that the invention aims to solve

[0009] In addition, Patent Document 1 describes an encoding device that performs encoding processing on medical images before transmitting them to a server device and storing them.

[0010] When the encoding device performs encoding processing on medical images, the image quality of the medical images stored in the server device (medical images after encoding processing) sometimes changes, and sometimes there is a problem that the impression is different from the medical images confirmed through the monitor during the operation (medical images before encoding processing).

[0011] The present invention is made in view of the above-mentioned problems, and provides a medical image processing system for alleviating changes in the image quality of medical images caused by encoding processing, and an encoding device used in the medical image system.

[0012] Solutions for solving problems

[0013] According to the present invention, a medical image processing system is provided for processing medical images generated by medical equipment, the medical image processing system comprising: a monitor, which receives the medical image from a first transmission path and displays the input medical image; and an encoding device, which receives the medical image from a second transmission path different from the first transmission path and performs encoding processing and image quality adjustment processing on the input medical image, wherein the encoding device comprises: an operation receiving unit, which is capable of receiving user operations for the image quality adjustment processing; an image quality adjustment unit, which performs the image quality adjustment processing based on the user operations received by the operation receiving unit; a recording unit, which records the medical image that has been subjected to the image quality adjustment processing and the encoding processing; and a first display area, which displays the medical image that has been subjected to the image quality adjustment processing and has not been subjected to the encoding processing, and when the operation receiving unit receives the user's operation during the recording process by the recording unit, the medical image displayed in the first display area becomes an image reflecting the image quality adjustment processing based on the user's operation after the time point when the user's operation is received.

[0014] In addition, a coding device for the medical image processing system is provided.

[0015] According to the above invention, the encoding device to which the medical image is input via a transmission path (second transmission path) different from the transmission path (first transmission path) of the medical image displayed on the monitor has a picture quality adjustment function, so that the picture quality adjustment is performed in advance (before storage in the server device) in consideration of the picture quality change caused by the encoding process, thereby alleviating the picture quality change.

[0016] In addition, a first display unit is provided in the encoding device, so that the user can purely confirm the effect of the image quality adjustment processing by performing the image quality adjustment processing while visually confirming the medical image that has not undergone image quality changes due to the encoding processing.

[0017] Effects of the Invention

[0018] According to the present invention, a medical image processing system for alleviating changes in image quality of medical images caused by encoding processing and an encoding device used in the medical image system are provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a structural diagram showing the structure of the medical imaging system involved in this embodiment.

[0020] Figure 2 FIG. 1 is a diagram showing an operation screen for operating the encoding device.

[0021] Figure 3 It is a flowchart showing the flow of processing performed by the encoding device. DETAILED DESCRIPTION

[0022] Hereinafter, the embodiments of the present invention will be described using the drawings. In addition, in all the drawings, the same components are given the same reference numerals, and the description thereof will be appropriately omitted.

[0023] <About Each Component Included in Medical Imaging System 1000>

[0024] First, use Figure 1 The components included in the medical imaging system 1000 are described below. Figure 1 1 is a structural diagram showing the structure of the medical imaging system 1000 involved in this embodiment.

[0025] also, Figure 1 The arrows shown in the figure indicate the output source and input destination of the images sent and received between the components. Therefore, the sending and receiving of information and data other than the images may not necessarily be consistent with the contents indicated by the arrows.

[0026] The medical imaging system 1000 according to this embodiment (the medical imaging system according to the present invention) is used to process medical images generated by the medical device group 200 (the medical device according to the present invention).

[0027] The medical imaging system 1000 includes at least a monitor group 300 (monitors according to the present invention) and an encoding device 400 (encoding device according to the present invention).

[0028] The monitor group 300 receives the medical image from the first transmission path and displays the received medical image.

[0029] On the other hand, the encoding device 400 is characterized in that a medical image is input from a second transmission path different from the first transmission path, the input medical image is encoded, and the input medical image is adjusted in image quality.

[0030] In the medical imaging system 1000 , the encoding device 400 has an image quality adjustment function, and therefore can take into account image quality changes caused by encoding processing and perform image quality adjustment before storing in the server device 600 , thereby alleviating the image quality changes.

[0031] From another point of view, the device (medical equipment group 200, switch 100) on the upstream side of the encoding device 400 can also have the image quality adjustment function. However, even if the device has the image quality adjustment function, the medical image displayed on the monitor group 300 (medical image before encoding) and the medical image stored in the server device 600 (medical image after encoding) are also affected by the image quality adjustment, so it can be said that the image quality change caused by the encoding process cannot be alleviated.

[0032] In addition, the device (server device 600, audio-visual terminal group 700) downstream of the encoding device 400 can also have a picture quality adjustment function. However, even if the device has a picture quality adjustment function, it is difficult to perform picture quality adjustment that takes into account the operator's intention because the device is set in a place (outside the operating room) isolated by the network 500. Therefore, if the system is used to review medical images after surgery (for example, in a meeting), the above-mentioned system structure is inconvenient.

[0033] Next, the specific contents of the medical imaging system 1000 according to this embodiment will be described.

[0034] The medical imaging system 1000 includes a switch 100, a medical device group 200 connected to an input channel of the switch 100, and a monitor group 300 and an encoding device 400 connected to an output channel of the switch 100. In addition, the medical imaging system 1000 includes a server device 600 that downloads and stores images supplied from the encoding device 400 via a network 500, and an audio-visual terminal group 700 that requests images from the server device 600 via the network 500, receives streaming media distribution from the server device 600 via the network 500, and displays (reproduces) the requested images.

[0035] The switch 100 is a device that receives medical-related images from any one of a plurality of input channels (medical device group 200 ) and outputs the images from an output channel connected to the input channel among a plurality of output channels.

[0036] In this embodiment, as specific examples of the medical equipment group 200 , there are illustrated an operation field camera 201 , a head mounted camera 202 , an electronic medical record 203 , a biological measuring instrument 204 , an endoscope 205 , a microscope 206 , an ultrasonic diagnostic device 207 , and a fluoroscopic imaging device 208 .

[0037] The surgical field camera 201 is a camera that captures the surgical field from a position facing the surgical field and outputs the captured image to the switcher 100 .

[0038] The head-mounted camera 202 is a camera that is mounted on the head of a surgeon (operating doctor) and outputs captured images to the switch 100 .

[0039] The electronic medical record 203 is a computer device that stores medical records (cases) related to the patient (patient) undergoing surgery and outputs the stored medical records to the switch 100. In this embodiment, the medical records output from the electronic medical record 203 are not limited to one, but may be multiple. In the case where there are multiple medical records output from the electronic medical record 203, the electronic medical record 203 can output the medical records separately according to the input channels of the switch 100.

[0040] The biological measuring device 204 is a measuring device that measures biological information (blood pressure, pulse rate, electrocardiogram, respiratory rate, body temperature, etc.) of the subject and outputs the measured biological information to the switch 100 .

[0041] The endoscope 205 is a medical device that has a camera lens, a forceps hole, etc. provided at the distal end of a tube inserted into the body of the patient, and outputs images captured by the camera to the switch 100 .

[0042] The microscope 206 is a medical device that magnifies tiny parts (nerves, blood vessels, etc. of the patient) to a size visible to the naked eye and displays and photographs them, and can output the magnified and photographed images to the switch 100 .

[0043] The ultrasound diagnostic device 207 is a medical device that irradiates an object (such as the chest or abdomen of the patient) with ultrasound waves and converts the echoes into images, and is sometimes referred to as an “echo.” The ultrasound diagnostic device 207 can output images based on reflected ultrasound waves to the switch 100 .

[0044] The fluoroscopic imaging device 208 is a medical device that irradiates an object (the patient) with X-rays and generates an X-ray image based on the transmitted X-rays, and can output the generated X-ray image to the switch 100 .

[0045] The medical device group 200 listed here is a specific example. In the implementation of the present invention, some of them may be missing, and other medical devices not listed here may also be included.

[0046] In addition, below, in this embodiment, it is assumed that image data related to images generated by the medical equipment group 200 (including medical records, measurement results of biological information), images displayed by a device into which the image data is input (the monitor group 300 and audio-visual terminal group 700 described later), etc. are all equivalent to the "medical images" involved in the present invention for explanation.

[0047] The monitor group 300 is a display device that receives medical images output from the medical device group 200 via the switch 100 and displays the input medical images.

[0048] In addition, the number of display devices corresponding to the monitor group 300 is not particularly limited, and a single display device may be sufficient.

[0049] The encoding device 400 receives medical images output from the medical equipment group 200 via the switch 100 , and performs encoding processing and image quality adjustment processing on the input medical images to convert them into a format suitable for transmission to and storage in the server device 600 .

[0050] In addition, the encoding device involved in the present invention only needs to have the function of receiving an input medical image and performing encoding processing and image quality adjustment processing on the input medical image, and other functions are allowed. Therefore, the encoding device involved in the present invention does not need to be a device dedicated to these functions. For example, the encoding device 400 may also have a recording function of recording medical images into a built-in storage device not shown in the figure, a reproduction function of reproducing the medical images recorded in the storage device, or a screenshot function of capturing each frame constituting the medical image as a still image, etc.

[0051] The encoding device 400 in this embodiment has four input systems, and can input medical images from each of the four output channels of the switch 100, and can store the medical images in the server device 600 after encoding them.

[0052] In addition, the number of input systems of the encoding device 400 is not particularly limited, and may be less than four or more than four.

[0053] The encoding device 400 can also perform image quality adjustment processing on the input medical image. Specifically, the encoding device 400 accepts the user's operation and performs image quality adjustment processing based on the accepted operation. Therefore, the user can store the medical image adjusted to any image quality in the server device 600.

[0054] The user's operation and the image quality adjustment process corresponding to the operation will be described later.

[0055] In the following description, it is assumed that the encoding device 400 according to the present embodiment has a function of adjusting image quality based on a user operation. However, this does not deny an embodiment having a function of adjusting image quality without accepting a user operation.

[0056] The encoding device 400 has four input systems and can be input with medical images from each of the four output channels of the switch 100 .

[0057] The encoding device 400 can perform encoding and image quality adjustment processing on each of the medical images input from each input system. Here, the encoding device 400 does not necessarily need to perform image quality adjustment processing on all input systems, and can perform image quality adjustment processing according to user operations.

[0058] In addition, the number of input systems of the encoding device 400 is not particularly limited, and may be less than four or more than four.

[0059] The network 500 can be formed of various computer networks such as the Internet and a LAN (Local Area Network) or a combination thereof. In addition, the communication connection between the components included in the network 500 may be wired communication, wireless communication, or a combination thereof.

[0060] The server device 600 can store the medical image transmitted from the encoding device 400 .

[0061] The server device 600 can selectively perform normal streaming distribution (streaming distribution after the recording of medical images is completed) and real-time streaming distribution (streaming distribution of recorded medical images in parallel with the recording of medical images) to the audio-visual terminal group 700.

[0062] In addition, Figure 1 , the medical imaging system 1000 is illustrated as being constituted by one server device 600, but the medical imaging system 1000 may also be constituted by a plurality of server devices 600. For example, the medical imaging system 1000 may also constitute the server device 600 for normal streaming media distribution and the server device 600 for real-time streaming media distribution as different devices.

[0063] The audio-visual terminal group 700 is a computer device having access rights to the server device 600, and can request the display (reproduction) of medical images stored in the server device 600 based on the access rights. In response to the display request of the audio-visual terminal group 700, the server device 600 distributes the requested images via the network 500 (performing either normal real-time streaming distribution or real-time streaming distribution).

[0064] like Figure 1 As shown, with respect to the medical imaging system 1000 involved in this embodiment, a transmission path for transmitting medical images from the medical equipment group 200 to the monitor group 300 and a transmission path for transmitting medical images from the medical equipment group 200 to the encoding device 400 are separated from each other by a switch 100.

[0065] Therefore, the monitor group 300 and the encoding device 400 are input with medical images via different transmission paths (the first transmission path and the second transmission path involved in the present invention).

[0066] The monitor group 300 can be said to be a device that displays an input medical image. On the other hand, the encoding device 400 can be said to be a device that performs encoding processing and image quality adjustment processing on an input medical image.

[0067] In addition, in the implementation of the present invention, in order to separate the transmission path for transmitting medical images from the medical device to the monitor and the transmission path for transmitting medical images from the medical device to the encoding device, it is not necessary to use a switch. For example, the medical device itself as the output source can distribute and output the medical images to the monitor and the encoding device.

[0068] As described above, the medical imaging system 1000 according to the present embodiment includes the server device 600 (the server device according to the present invention) and the viewing terminal group 700 (the viewing terminals according to the present invention).

[0069] The server device 600 stores the medical images that have been subjected to image quality adjustment processing and encoding processing by the encoding device 400 .

[0070] The audio-visual terminal group 700 can receive streaming distribution (either normal streaming distribution or real-time streaming distribution) of medical images stored in the server device 600 from the server device 600 .

[0071] In addition, in this embodiment, it is assumed that the display device equivalent to the monitor group 300 and the encoding device 400 is installed in the operating room, and the computer equipment equivalent to the server device 600 and the audio-visual terminal group 700 is installed outside the operating room.

[0072] However, in the implementation of the present invention, at least a part of the display device corresponding to the monitor group 300 may be installed outside the operating room, and at least a part of the computer equipment corresponding to the audio-visual terminal group 700 may be installed in the operating room.

[0073] <About the Operation Screen of Encoding Device 400>

[0074] Figure 2 2 is a diagram showing an operation screen for operating the encoding device 400 .

[0075] Figure 2 The operation screen shown can be roughly divided into three areas: a display area D1 , a display area D2 , and a display area D3 .

[0076] The display area D1 displays the original medical image (medical image before encoding processing) input to the encoding device 400.

[0077] The display area D2 displays the medical image after the encoding process performed by the encoding device 400.

[0078] The display area D3 displays check boxes and slide bars for accepting user operations related to the image quality adjustment process.

[0079] In addition, Figure 2 In the figure, the medical images displayed in the display area D1 and the display area D2 are assumed to be images captured by the surgical field camera 201. In addition, the following description assumes that the medical images displayed in the display area D1 and the display area D2 are images that have been subjected to image quality adjustment processing.

[0080] Figure 2 The operation screen shown in the figure is an operation screen related to the image quality adjustment that can be performed by the encoding device 400, and can also be an operation screen related to other functions (such as the above-mentioned recording function, playback function, and screenshot function, etc.) that can be displayed separately.

[0081] Here, “capable of separately displaying an operation screen” can be Figure 2 In the operation screen shown in the figure, other operation screens may be displayed in parallel with the operation screen (overlapping in time series), or the other operation screens may be displayed in a different display area from the operation screen shown in the figure. Figure 2 In another state after the state of the operation screen shown in the figure is changed, another operation screen is displayed (separated in time series).

[0082] Figure 2 The illustrated operation screen (left side of the display area D3 ) displays check boxes for accepting user operations related to the following processing.

[0083] When the user checks the Deinterlacing checkbox, if the image displayed in the display area D1 is in an interlaced format, deinterlacing (de-interlacing) is performed on the image, and the deinterlaced image is displayed in the display area D1 and the display area D2.

[0084] When the user checks the checkbox of the automatic level correction (Auto Levels), the image quality level of the input image is automatically corrected, and the corrected image is displayed in the display area D1 and the display area D2. Here, the image quality level that becomes the object of correction is at least one of brightness, gamma value, contrast value, saturation, and hue. That is, the items that become the object of the automatic level correction are at least a part of the items that become the object of the image quality adjustment process that can be performed by operating the checkbox and the slide bar on the right side of the display area D3 described later.

[0085] When the user checks the Mirror check box, image processing is performed to mirror the input image so that the image is displayed in the display area D1 and the display area D2.

[0086] When the user checks the Flip check box, image processing is performed to flip the input image upside down, so that the image obtained by flipping the image upside down is displayed in the display area D1 and the display area D2.

[0087] When the user checks the checkbox of Luminance Level Fix, the brightness of the input image is automatically corrected, and the corrected image is displayed in the display area D1 and the display area D2. In addition, the luminance correction is also described as one of the image quality adjustment processes in this embodiment.

[0088] Figure 2 The illustrated operation screen (right side of the display area D3 ) displays check boxes and slide bars for accepting user operations related to the following processing.

[0089] When the user checks the Brightness checkbox, a slider bar becomes operable to adjust the brightness of the input image. Specifically, when the user operates the slider bar to the right, the brightness increases, and when the user operates the slider bar to the left, the brightness decreases. In addition, when the checkbox is unchecked, the slider bar becomes inoperable.

[0090] When the user checks the Gamma checkbox, a slider bar becomes operable to adjust the gamma value of the input image. Specifically, when the user operates the slider bar to the right, the gamma value increases, and when the user operates the slider bar to the left, the gamma value decreases. In addition, when the checkbox is unchecked, the slider bar becomes inoperable.

[0091] When the user checks the contrast value (Contrast) checkbox, a slider bar for adjusting the contrast value of the input image becomes operable. Specifically, when the user operates the slider bar to the right, the contrast value increases, and when the user operates the slider bar to the left, the contrast value decreases. In addition, when the checkbox is unchecked, the slider bar becomes inoperable.

[0092] When the user checks the Saturation checkbox, a slider bar becomes operable to adjust the saturation of the input image. Specifically, when the user operates the slider bar to the right, the saturation increases, and when the user operates the slider bar to the left, the saturation decreases. In addition, when the checkbox is unchecked, the slider bar becomes inoperable.

[0093] When the user checks the Hue checkbox, a slider bar becomes operable for adjusting the hue of the input image. Specifically, when the user operates the slider bar to the right, the hue moves up (red moves closer to yellow, green moves closer to cyan, and blue moves closer to magenta), and when the user operates the slider bar to the left, the hue moves down (red moves closer to magenta, green moves closer to yellow, and blue moves closer to cyan). In addition, when the checkbox is unchecked, the slider bar becomes inoperable.

[0094] When the brightness, gamma value, contrast value, saturation, and hue of the input image are adjusted using the above-mentioned slide bars, the adjusted image is displayed in the display area D1 and the display area D2.

[0095] The medical image that has been subjected to the above-described image quality adjustment process is further subjected to encoding processing and then recorded by the encoding device 400 .

[0096] The recording performed by the encoding device 400 refers to the process of saving the medical image that has been subjected to the image quality adjustment process and the encoding process in a certain storage medium. The storage medium for saving can be a storage medium built into the encoding device 400, or a storage medium possessed by an external device of the encoding device 400. In terms of this embodiment, the process of the encoding device 400 saving the medical image in the built-in storage, and the process of saving the medical image transmitted from the encoding device 400 to the server device 600 in the server device 600, are both regarded as the recording performed by the encoding device 400.

[0097] Here, the processing related to the encoding device 400 described so far is summarized.

[0098] The encoding device 400 includes a display area D3 capable of accepting user operations for image quality adjustment processing, and the display area D3 corresponds to the operation accepting means involved in the present invention.

[0099] The encoding device 400 has a function of performing image quality adjustment processing based on the user operation received in the display area D3, and this function corresponds to the image quality adjustment means involved in the present invention.

[0100] The encoding device 400 has a function of recording a medical image that has undergone image quality adjustment processing and encoding processing into a storage device built into the encoding device 400 and the server device 600. This function is equivalent to the recording unit involved in the present invention.

[0101] The encoding device 400 has a display area D1 and a display area D2 for displaying a medical image subjected to image quality adjustment processing by the image quality adjustment unit, and these areas correspond to the display area involved in the present invention.

[0102] The display area D3 can accept user operations regardless of whether the encoding device 400 is recording or not recording.

[0103] Assuming that a user operation is accepted during the recording process, the recorded medical image changes from midway (after the time when the user operation is accepted) to an image reflecting the image quality adjustment process based on the user operation.

[0104] In addition, when a user operation is received during a period when the video is not being recorded, the recorded medical image changes from the beginning (after the start of recording) to an image reflecting the image quality adjustment process based on the user operation.

[0105] In addition, the image quality adjustment processing performed based on the user's operation on the display area D3 is linearly reflected in the medical images displayed in the display area D1 and the display area D2. However, since the display area D1 displays the medical image before the encoding processing, the display area D1 displays the medical image regardless of whether the encoding device 400 is recording or not recording. On the other hand, since the display area D2 displays the medical image after the encoding processing, the display area D2 displays the medical image while the encoding device 400 is recording, but does not display the medical image during the period when the encoding device 400 is not recording.

[0106] In other words, when the display area D3 receives a user operation during the recording process by the encoding device 400, the display area D1 and the display area D2 display a medical image that reflects the image quality adjustment process based on the user's operation after the time point when the user's operation is received. The details are described later, but with respect to the display area D2 during the recording process, an image equivalent to the medical image being recorded (a medical image that has been encoded) is displayed, so the user can confirm the effect of the image quality adjustment while performing appropriate operations by viewing the display area D2. In addition, with respect to the display area D1 during the recording process, although a medical image that has not been encoded (a medical image that is brighter than the display area D2) is displayed, the image quality adjustment process is reflected in the same way as the display area D2, so the user can confirm the effect of the image quality adjustment even if viewing the display area D1.

[0107] In addition, when the display area D3 receives a user operation during the period when the encoding device 400 is not recording, the display area D1 also displays the medical image reflecting the image quality adjustment process based on the user's operation after the time point when the user's operation is received. Therefore, the user can perform image adjustment while confirming in the display area D1 before recording the medical image. In addition, the display area D2 does not display the medical image during the period when the recording is not in progress.

[0108] As described above, the encoding device 400 has a display area D1 for displaying medical images before encoding (the first display area involved in the present invention) and a display area D2 for displaying medical images after encoding (the second display area involved in the present invention).

[0109] Here, it is preferred that the medical image displayed in the display area D1 and the medical image displayed in the display area D2 are synchronized (the display timing of the images is consistent to such an extent that the user does not feel a delay).

[0110] Since the encoding device 400 is configured as described above, the user can perform a desired image quality adjustment process while viewing and comparing the image in the display area D1 and the image in the display area D2. For example, the user can perform an operation so that the image quality of the medical image displayed in the display area D2 is close to the image quality of the medical image displayed in the display area D1 before the operation.

[0111] However, preferably, the delay generated between the display of the medical image in display area D1 and the display of the medical image in display area D2 is smaller than the delay generated between the display of the medical image in display area D1 and the display of the medical image in audio-visual terminal group 700 when the same medical image is received by audio-visual terminal group 700 through real-time streaming distribution.

[0112] In other words, if the time when the encoding device 400 displays the medical image in the display area D1 is used as a reference, it is expected that the time when the encoding device 400 displays the medical image in the display area D2 is earlier than the time when the audio-visual terminal group 700 displays the medical image received from the server device 600 through real-time streaming distribution.

[0113] Furthermore, the image quality adjustment processing performed by the encoding device 400 does not need to be all of the above-mentioned processing, and it is sufficient as long as a part thereof (for example, at least one of brightness adjustment, gamma adjustment, contrast adjustment, saturation adjustment, and hue adjustment) can be performed. In addition, the image quality adjustment processing performed by the encoding device 400 is not limited to the above-mentioned processing, and a certain processing of the known image quality adjustment processing may be added.

[0114] Set as Figure 2 The operation screen shown in the figure is a screen for accepting user operations to adjust the image quality of medical images input from one input system, but the encoding device 400 can also adjust the image quality of each medical image input from multiple input systems. Here, it is preferred that the encoding device 400 can perform different image quality adjustment processes for each input system. This is because the optimal degree of image quality adjustment process is different for each medical image.

[0115] When implementing this modification, it is also desirable that each input system of the encoding device 400 has a means for accepting user operations regarding the operation screen related to the image quality adjustment process.

[0116] <Regarding the Processing Flow of Encoding Device 400>

[0117] Next, the processing flow of the encoding device 400 is described.

[0118] Figure 3 is a flowchart showing the flow of processing performed by the encoding device 400.

[0119] The encoding device 400 receives input of a medical image from the switch 100 (step S102), decodes the input medical image (step S104), writes the decoded image data into a memory (step S106), performs image quality adjustment processing on the image data (step S110), and proceeds to steps S112 and S114.

[0120] In addition, the process of step S110 is at least one of the image quality adjustment processes based on the user's operation on the display area D3 described above, and may be a process combining a plurality of image quality adjustment processes.

[0121] The encoding device 400 displays the video data subjected to the image quality adjustment process in the display area D1 (step S112 ), and this processing flow ends.

[0122] In addition, in parallel with the process of step S112, the encoding device 400 performs the following process.

[0123] The encoding device 400 performs encoding processing on the video data subjected to the image quality adjustment processing, writes the encoded video data into the memory (step S114), and proceeds to the processing of steps S116 and S120.

[0124] The encoding device 400 decodes the image data that has been subjected to the image quality adjustment process and the encoding process (step S116), and displays the image data in the display area D2 (step S118), and the processing flow ends.

[0125] In parallel with the processing of step S116 and step S118, the encoding device 400 writes the image data that has undergone image quality adjustment processing and encoding processing to the storage built into the encoding device 400 (step S120), and transmits the image data written to the storage to the server device 600 (step S122), and the processing flow ends.

[0126] In addition, when the image data transmitted to the server device 600 is distributed in the case of normal streaming distribution, it is distributed in response to the request of the audio-visual terminal group 700 after being stored in the server device 600 (after recording). In addition, when the image data transmitted to the server device 600 is distributed in real-time streaming distribution, it is distributed to the audio-visual terminal group 700 in parallel with being stored in the server device 600 (recording).

[0127] The encoding device 400 performs the processing of causing the display area D1 to display the medical image, the processing of causing the display area D2 to display the medical image, and the processing of writing the image data that has undergone image quality adjustment processing and encoding processing to the storage in parallel (displaying the medical image in the display area D2 without waiting for the completion of writing to the server device 600), so that no delay occurs between the display time of the display area D1 and the display time of the display area D2 (at most there is a delay to an extent that the user cannot recognize).

[0128] Furthermore, since the encoding device 400 performs the above-described processing, when real-time streaming is distributed from the server device 600, the delay (the difference from the display timing in the display area D1) generated in the viewing terminal group 700 is extremely small.

[0129] also, Figure 3 The processing flow shown in the figure is a specific example, and within the scope of achieving the purpose of the present invention, the procedure of each processing may be changed, part of the processing shown in the figure may be omitted, and other processing not shown in the figure may be added.

[0130] For example, in Figure 3 In the embodiment, a processing flow is disclosed in which the image quality adjustment process (step S110) is performed on both the medical image displayed in the display area D1 and the medical image displayed in the display area D2. However, even if the processing flow is performed only on the medical image displayed in the display area D2, the purpose of the present invention can be achieved. In addition, the image quality adjustment process and the encoding process in this modification example can be performed either first or integrated into one process.

[0131] This embodiment includes the following technical ideas.

[0132] (1) A medical image processing system for processing medical images generated by medical equipment, the medical image processing system comprising: a monitor, which receives the medical image from a first transmission path and displays the input medical image; and an encoding device, which receives the medical image from a second transmission path different from the first transmission path and encodes the input medical image, wherein the encoding device performs image quality adjustment on the input medical image.

[0133] (2) The medical image processing system described in (1), wherein the encoding device comprises: an operation accepting unit capable of accepting a user's operation regarding the image quality adjustment process; an image quality adjustment unit, which performs the image quality adjustment process based on the user's operation accepted by the operation accepting unit; and a recording unit, which records the medical image that has been subjected to the image quality adjustment process and the encoding process, and when the operation accepting unit accepts a user's operation during the recording process by the recording unit, the recorded medical image is changed from midway to an image reflecting the image quality adjustment process based on the user's operation.

[0134] (3) A medical image processing system as described in (2), wherein the encoding device has a display area for displaying the medical image that has been subjected to the image quality adjustment processing by the image quality adjustment unit, and when the operation acceptance unit accepts an operation of a user during the process of recording by the recording unit, the display area displays the medical image reflecting the image quality adjustment processing based on the user's operation after the time point when the operation of the user is accepted.

[0135] (4) The medical image processing system described in (3), wherein the encoding device is configured to display the medical image in the display area even when the recording unit is not recording, and when the operation acceptance unit accepts an operation of the user during the period when the recording unit is not recording, the display area displays the medical image reflecting the image quality adjustment processing based on the user's operation after the time point when the user's operation is accepted.

[0136] (5) A medical image processing system as described in (3) or (4), wherein the display area comprises: a first display area which displays the medical image before the encoding process; and a second display area which displays the medical image after the encoding process.

[0137] (6) The medical image processing system described in (5) comprises: a server device, which receives and stores the medical image that has undergone the image quality adjustment processing and the encoding processing from the encoding device; and an audio-visual terminal, which is capable of receiving real-time streaming distribution of the medical image stored by the server device from the server device, wherein, when the time when the encoding device displays the medical image in the first display area is used as a reference, the time when the encoding device displays the medical image in the second display area is earlier than the time when the audio-visual terminal displays the medical image through real-time streaming distribution.

[0138] (7) A medical image processing system as described in any one of (1) to (6), wherein the image quality adjustment processing performed by the encoding device includes at least one of brightness adjustment, gamma adjustment, contrast adjustment, color saturation adjustment, and hue adjustment.

[0139] (8) A coding device used in the medical image processing system described in any one of (1) to (7).

[0140] This application claims priority based on Japanese patent application No. 2020-018659 filed on February 6, 2020, the disclosure of which is incorporated herein in its entirety.

[0141] Description of Reference Numerals

[0142] 1000: medical imaging system; 100: switch; 200: medical equipment group; 201: surgical field camera; 202: head-mounted camera; 203: electronic medical record; 204: biological measuring instrument; 205: endoscope; 206: microscope; 207: ultrasonic diagnostic device; 208: fluoroscopic photography device; 300: monitor group; 400: encoding device; 500: network; 600: server device; 700: audio-visual terminal group; D1, D2, D3: display area.

Claims

1. A medical image processing system for processing medical images generated by a medical device, the medical image processing system comprising: a monitor that receives the medical image from the first transmission path and displays the received medical image; and an encoding device that receives the medical image from a second transmission path different from the first transmission path and performs encoding processing and image quality adjustment processing on the input medical image, in, The encoding device has: an operation accepting unit capable of accepting a user's operation for the image quality adjustment process; an image quality adjustment unit that performs the image quality adjustment process based on the user operation accepted by the operation acceptance unit; A video recording unit, which records the medical image that has been subjected to the image quality adjustment processing and the encoding processing; as well as a first display area, which displays the medical image that has been subjected to the image quality adjustment processing and has not been subjected to the encoding processing; When the operation accepting unit accepts the user's operation during the recording process by the recording unit, the medical image displayed in the first display area becomes an image reflecting the image quality adjustment processing based on the user's operation after the time point when the user's operation is accepted.

2. The medical image processing system according to claim 1, wherein: The encoding device further includes a second display area for displaying the medical image that has undergone the image quality adjustment process and the encoding process. When the operation accepting unit accepts the user's operation during the recording process by the recording unit, the medical image displayed in the first display area and the medical image displayed in the second display area are changed to images reflecting the image quality adjustment processing based on the user's operation after the time point when the user's operation is accepted.

3. The medical image processing system according to claim 2, comprising: A server device that receives the medical image that has been subjected to the image quality adjustment process and the encoding process from the encoding device and stores the medical image; and an audio-visual terminal capable of receiving real-time streaming media distribution of the medical image stored by the server device from the server device, in, When the time when the encoding device displays the medical image in the first display area is taken as a reference, the time when the encoding device displays the medical image in the second display area is earlier than the time when the audio-visual terminal displays the medical image through real-time streaming distribution.

4. The medical image processing system according to any one of claims 1 to 3, wherein: The image quality adjustment processing performed by the encoding device includes at least one of brightness adjustment, gamma adjustment, contrast adjustment, saturation adjustment, and hue adjustment. 5 . An encoding device used in the medical image processing system according to any one of claims 1 to 4 .

Images