Medical system, processor, and method for operating medical system

Abstract

[Problem] To provide an endoscope system 1 with which it is possible to ascertain that a user is dissatisfied with a processed image processed on a server 30. [Solution] This endoscope system 1 comprises: a processor 10 that includes an acquisition unit 12 for acquiring a primary image P1 from an endoscope device 2, a first reception unit 15 for receiving the primary image P1, and a dissatisfaction signal generation unit 16 for generating a dissatisfaction signal when a user is dissatisfied with a secondary image P2 obtained by processing the primary image P1; and a server 30 that includes a second reception unit 31 for receiving the primary image P1 and the dissatisfaction signal, a processing unit 32 for processing the primary image P1 on the basis of a first processing condition and thus generating the secondary image P2, and a storage unit 35 for storing at least one primary image P1 when the dissatisfaction signal is received.

Description

Medical system, processor, and method of operating a medical system

[0001] The present invention relates to a medical system for processing medical images, a processor for a medical system for processing medical images, and a method of operating a medical system for processing medical images.

[0002] The images acquired by the medical device are processed, and the processed images are displayed on a monitor.

[0003] Japanese Patent Application Publication No. 2022-42011 discloses a signal processing device that processes images output by a medical device on a server located in a different location and displays the processed images on a monitor located near the medical device.

[0004] Japanese Patent Application Laid-Open No. 2022-42011

[0005] With the above-mentioned signal processing device, even if a user operating the medical device was dissatisfied with the processed images processed on the server, it was not easy for the server administrator to understand the user's dissatisfaction, let alone resolve the dissatisfaction.

[0006] An embodiment of the present invention aims to provide a medical system that can grasp user dissatisfaction with processed images processed in a server, a processor that can grasp user dissatisfaction with processed images processed in a server, and a method of operating a medical system that can grasp user dissatisfaction with processed images processed in a server.

[0007] The medical system of an embodiment includes a processor having an acquisition unit that acquires a primary image from a medical device, a first transmission unit that transmits the primary image, a first receiving unit that receives a secondary image obtained by processing the primary image, and a dissatisfaction signal generation unit that generates a dissatisfaction signal to be transmitted from the first transmission unit when a user is dissatisfied with the secondary image; a second receiving unit that receives the primary image and the dissatisfaction signal, a processing unit that processes the primary image based on first processing conditions to generate the secondary image, a second transmission unit that transmits the secondary image, and a memory unit that stores at least one of the primary images when the dissatisfaction signal is received.

[0008] The processor of the embodiment has an acquisition unit that acquires a primary image from a medical device, a first transmission unit that transmits the primary image to a server, a first receiving unit that receives a secondary image from the server that has been processed from the primary image, and a dissatisfaction signal generation unit that generates a dissatisfaction signal that is transmitted from the first transmission unit to the server when a user is dissatisfied with the secondary image.

[0009] In one embodiment, a method of operating a medical system includes an acquisition unit of a processor acquiring a primary image from a medical device, a first transmission unit of the processor transmitting the primary image to a server, a second receiving unit of the server receiving the primary image, a processing unit of the server processing the primary image to generate a secondary image, a second transmission unit of the server transmitting the secondary image to the processor, a first receiving unit of the processor receiving the secondary image, and when a user is dissatisfied with the secondary image, a dissatisfaction signal generating unit of the processor generating a dissatisfaction signal, the first transmission unit transmitting the dissatisfaction signal to the server, and when the second receiving unit of the server receives the dissatisfaction signal, a memory unit of the server storing the primary image.

[0010] According to an embodiment of the present invention, a medical system capable of understanding user dissatisfaction with processed images processed on a server, a processor capable of understanding user dissatisfaction with processed images processed on a server, and a method of operating a medical system capable of understanding user dissatisfaction with processed images processed on a server can be provided.

[0011] FIG. 1 is a configuration diagram of a medical system according to a first embodiment. FIG. 2 is a flowchart of an operation method of the medical system according to the first embodiment. FIG. 3 is a configuration diagram of a medical system according to a second embodiment. FIG. 4 is a flowchart of an operation method of the medical system according to the second embodiment. FIG. 5 is a configuration diagram of a medical system according to a third embodiment. FIG. 6 is a configuration diagram of a medical system according to a fourth embodiment.

[0012] 1, a medical system 1 of this embodiment includes an endoscope device 2, which is a medical device, a processor 10, a server 30, and a monitor 20. In the following description, drawings based on the embodiment are schematic, and some components are not shown or labeled.

[0013] The server 30 is placed in a room separate from the endoscope device 2, the processor 10, and the monitor 20. The processor 10 and the server 30 are connected via, for example, an internet line.

[0014] The endoscopic device 2 includes an endoscope 9 and a light source 5 that illuminates a subject. The light source 5 may be a component of the processor 10. The endoscope 9 includes a camera unit 8, an operation button 7, and a release switch (release SW) 6. As will be described later, the operation button 7 is pressed by the user when the user is dissatisfied with the image displayed on the monitor 20. The release SW 6 is operated by the user when acquiring a still image (freeze image) during video processing. The operation button 7 and the release SW 6 are located, for example, on a grip portion (not shown) of the endoscope 9 that is held by the user. The endoscope 9 may be a flexible or rigid endoscope.

[0015] The light source 5 generates illumination light to be supplied to the endoscope 9. The light source 5 is a lamp such as a white LED (Light Emitting Diode), a xenon lamp, or a halogen lamp, or a laser light source. The light source 5 may include a plurality of LEDs that each emit light of a different color.

[0016] Although not shown, the illumination light generated by the light source 5 is emitted from the tip of the elongated insertion portion of the endoscope 9 to illuminate the subject. The camera unit 8 converts the subject image into an electrical signal and transmits a primary image P1 to the processor 10. The primary image P1 is an image equivalent to one frame of a moving image, and for example, 60 primary images P1 are transmitted to the processor 10 per second. If the light source 5 is of the frame sequential type, the primary image P1 changes sequentially from an R image to a G image to a B image.

[0017] The processor 10 includes a CPU 11, an acquisition unit 12, a first transmission unit 14, a first reception unit 15, and a dissatisfaction signal generation unit 16. The CPU 11 controls the entire processor 10. The acquisition unit 12 acquires a primary image P1 from the endoscope device 2 and also acquires setting data of the endoscope device 2.

[0018] The setting data includes at least one of a user setting mode, endoscope individual parameters, light source individual parameters, and the dimming state of the light source. The user setting mode is an image processing mode selected by the user, such as observation mode information, color tone mode information, noise reduction intensity mode information, and structure emphasis mode information. The endoscope individual parameters are, for example, defective pixel position information and spectral information of the imaging element, and the setting values ​​differ depending on the endoscope individual. The light source individual parameters are, for example, spectral information of the light source 5, and the setting values ​​differ depending on the light source individual. The light source dimming state is image processing gain information required when there is insufficient light, and changes depending on the shooting scene.

[0019] The first transmitting unit 14 transmits the primary image P1 and setting data of the endoscope device 2 to the server 30. The first receiving unit 15 receives from the server 30 a secondary image P2 obtained by processing the primary image.

[0020] As already explained, the monitor 20 is placed in the same room as the endoscope device 2 and the processor 10. The monitor 20 is, for example, a liquid crystal display that displays the secondary image P2 etc. from the processor 10. The user operates the endoscope 9 while viewing the secondary image P2 displayed on the monitor 20.

[0021] The dissatisfaction signal generating unit 16 generates a dissatisfaction signal when the user is dissatisfied with the secondary image P2 displayed on the monitor 20. For example, when the user presses the operation button 7 of the endoscope 9, the dissatisfaction signal generating unit 16 generates a dissatisfaction signal. The dissatisfaction signal is transmitted from the first transmitting unit 14 to the server 30.

[0022] The server 30 has a second receiving unit 31, a processing unit 32, a second transmitting unit 33, a storage unit 35, and a buffer memory 34. The second receiving unit 31 receives the primary image P1, the dissatisfaction signal, etc. from the processor 10. The buffer memory 34 is a RAM or the like that temporarily stores a plurality of primary images P1.

[0023] The processing unit 32 generates a secondary image P2 by performing a first process on the primary image P1 under a first processing condition. The first process is, for example, defective pixel correction, demosaicing, white balance processing, brightness correction, noise reduction, color correction, gamma processing, scaling, and structure enhancement. The first processing condition is a standard condition for generating a secondary image P2 that satisfies a standard user.

[0024] The second transmission unit 33 transmits the secondary image P2 to the processor 10.

[0025] The storage unit 35 extracts and records from the buffer memory 34 a plurality of primary images P1 captured during a certain period of time immediately prior to receiving the dissatisfaction signal, as well as setting data for the endoscope device 2. The storage unit 35 is a non-transitory storage device such as a hard disk drive (HDD), a solid state drive (SSD), or an optical disk.

[0026] At least one of the multiple configurations of the processor 10 and the server 30 may be configured with an internal circuit of a semiconductor device operated by software, may be configured with a dedicated hardware circuit, or may include an internal circuit of a semiconductor device and a dedicated hardware circuit. For example, the processing unit 32 may include an FPGA (Field Programmable Gate Array) including a hardware circuit and a GPU (Graphics Processing Unit) which is a software circuit.

[0027] The medical system 1 has a storage unit 35 that, when a dissatisfaction signal is received, stores the primary image P1 and setting data of the endoscope device 2. Therefore, the administrator of the server 30 can grasp the image that the user was dissatisfied with and can accurately grasp the process of generating the secondary image P2 that the user was dissatisfied with, and can appropriately consider improving the processing unit 32.

[0028] It is preferable that the storage unit 35 further stores the secondary image P2 in addition to the primary image P1 and the setting data of the endoscope device 2 when the dissatisfaction signal is received.

[0029] Furthermore, it is preferable that the storage unit 35 stores, in addition to the primary image P1, for example, the date, time, the user's name, and the name of the affiliated institution.

[0030] The processor 10, which is commercially available as a stand-alone product, has an acquisition unit 12 that acquires a primary image P1 from a medical device, a first transmission unit 14 that transmits the primary image P1 to a server 30, a first receiving unit 15 that receives a secondary image P2 from the server 30 that is a processed version of the primary image P1, and a dissatisfaction signal generation unit 16 that generates a dissatisfaction signal that is transmitted from the first transmission unit 14 to the server 30 when a user is dissatisfied with the secondary image P2.

[0031] <Operation Method of Medical System 1> The operation method of the medical system 1 will be described with reference to the flowchart of FIG.

[0032] <Step S10> Primary Image Input When processing by the endoscope device 2, which is a medical device, is started, the acquisition unit (acquisition circuit) 12 of the processor 10 acquires a primary image P1 from the endoscope device 2.

[0033] <Step S14> Primary Image Transmission The first transmission unit (first transmission circuit) 14 of the processor 10 transmits the primary image P1 to the server 30.

[0034] <Step S16> Receiving Primary Image The second receiving unit (second receiving circuit) 31 of the server 30 receives the primary image P1.

[0035] <Step S18> Primary Image Storage The primary image P1 is stored in the buffer memory 34. As the process progresses, a plurality of primary images P1 are stored in the buffer memory 34.

[0036] <Step S20> Image Processing The processing unit (processing circuit) 32 of the server 30 processes the primary image P1 to generate a secondary image P2. The secondary image P2 may be stored in the buffer memory 34. In order to store many images, old images may be erased to store new images depending on the storage capacity of the buffer memory 34.

[0037] <Step S22> Secondary Image Transmission The second transmission unit (second transmission circuit) 33 of the server 30 transmits the secondary image P2 to the processor 10.

[0038] <Step S24> Receiving Secondary Image The first receiving unit (first receiving circuit) 15 of the processor 10 receives the secondary image P2.

[0039] <Step S26> Secondary Image Display The secondary image P2 is displayed on the monitor 20.

[0040] <Step S28> Dissatisfied? If the user is dissatisfied with the secondary image P2 (YES), the user presses the operation button 7 of the endoscope 9. If the user is not dissatisfied (NO), the process proceeds to step S99.

[0041] <Step S30> Generate a dissatisfaction signal When the operation button 7 is pressed, the dissatisfaction signal generating section (dissatisfaction signal generating circuit) 16 of the processor 10 generates a dissatisfaction signal.

[0042] <Step S32> Sending a dissatisfaction signal The first sending unit 14 sends a dissatisfaction signal to the server 30.

[0043] <Step S34> Receive complaint signal The second receiving unit 31 of the server 30 receives the complaint signal.

[0044] <Step S36> Image storage At the time of receiving the dissatisfaction signal, i.e., a plurality of primary images P1 from a certain period of time immediately before the generation of the dissatisfaction signal, are extracted from the buffer memory 34 and stored in the storage unit 35. The setting data of the endoscope device 2 is also stored in the storage unit 35. The number of the plurality of images from the certain period of time is preferably, for example, 600 or more.

[0045] <Step S99> End? Until the processing by the endoscope device 2 is completed (YES), the processing from step S10 to step S36 is repeated, for example, 60 times per second.

[0046] According to the operation method of the medical system 1, the administrator of the server 30 can know which images processed in the server 30 caused dissatisfaction among users.

[0047] <Modification of First Embodiment> A medical system 1A of this modification is similar to the medical system 1 of the first embodiment and has the same effects. Therefore, in the following description, components with the same functions as those in the medical system 1 are denoted by the same reference numerals as those in the medical system 1, and descriptions thereof will be omitted.

[0048] When the release switch 6 is operated during video processing, one secondary image (freeze image) is stored in the buffer memory 34 and continuously displayed. The freeze image is the most preferable image selected based on predetermined conditions from a predetermined number of secondary images taken immediately before the release switch 6 was operated.

[0049] When the memory unit 35 of the server 30A receives a dissatisfaction signal regarding a freeze image acquired by the user's release operation, it stores the still image, as well as the primary image before processing of the still image, the first processing conditions, and the setting data of the medical device.

[0050] In addition to the same effects as the medical system 1 of the first embodiment, the medical system 1A allows the administrator of the server 30A to grasp the user's dissatisfaction with the predetermined conditions for selecting a freeze image.

[0051] Second Embodiment Medical systems 1B-1D of the following embodiments are similar to and have the same effects as the medical system 1 of the first embodiment. Therefore, in the following description, components with the same functions as those of the medical system 1 are assigned the same reference numerals as those of the medical system 1, and descriptions thereof will be omitted.

[0052] 3, the processor 10B of the medical system 1B has a selection unit (selection circuit) 17. As will be described later, the selection unit 17 is an operation means for the user to select a more preferable image.

[0053] The operation of the medical system 1B will now be described with reference to the flowchart of FIG.

[0054] <Steps S10 to S34> These are the same as steps S10 to S34 in FIG.

[0055] <Step S38> The processing unit 32 of the server 30B performs a second process under second processing conditions on the secondary image P2, thereby outputting a tertiary image P3. The second processing conditions are experimental conditions that the administrator of the server 30B has improved based on past complaint data. This improvement may be an improvement to the process itself or a change to the user setting mode.

[0056] <Step S40> The second transmission unit 33 transmits the 3D image P3 to the processor 10.

[0057] <Step S42> Having received the three-dimensional image P3, the processor 10B displays the two-dimensional image P2 and the three-dimensional image P3 side by side on the monitor 20.

[0058] <Step S44> As already described, the processor 10B further includes a selection unit 17 that allows the user to select a preferred image from the secondary image P2 and the tertiary image P3. The monitor 20, which is a touch panel, may have the function of the selection unit 17.

[0059] If the user selects the three-dimensional image P3 (YES), the first process is replaced with the second process as a result of the selection in step S46. If the user does not select the three-dimensional image P3 (NO), the process proceeds to step S99.

[0060] It should be noted that even if the user does not select the three-dimensional image P3 (NO), the fact that it was not selected may be stored in the storage unit 35.

[0061] In addition to the same effects as the medical system 1 of the first embodiment, the medical system 1B may be able to resolve dissatisfaction of the user if the user is dissatisfied.

[0062] 5, a medical system 1C of this embodiment includes a management device 40 connected to a server 30C. The management device 40 includes an input unit (input device) 41.

[0063] The management device 40 is, for example, a device common to multiple endoscope devices 2 and multiple processors 10C that is used after a user or a third party has used the endoscope device 2. The management device 40 may include a monitor or the like (not shown).

[0064] The management device 40 creates more appropriate first processing conditions by using not only the selection result but also the reason for dissatisfaction. The reason for dissatisfaction is input from the input unit 41. The reason for dissatisfaction may be in a descriptive format, but is preferably in a multiple-choice format so that it can be easily input by the user or a third party and also simplifies the processing by the analysis unit 42. For example, the management device 40 displays a screen on which the user can choose between "too bright" and "too dark" together with the secondary image P2 in which the dissatisfaction signal has occurred.

[0065] In addition to the same effects as the medical system 1 of the first embodiment, the medical system 1C can improve the first processing conditions, thereby reducing user dissatisfaction as the system is used.

[0066] Fourth Embodiment A medical system 1D of this embodiment is similar to the medical system 1-1C and has the same effects. Therefore, in the following description, components having the same functions as those in the medical system 1-1C are denoted by the same reference numerals and will not be described again.

[0067] In the medical system 1D of this embodiment shown in Fig. 6, a processor 10D has a pre-processing unit 13. The processor 10D pre-processes a primary image P1 acquired from the endoscope device 2 and transmits the pre-processed primary image P1A to a server 30D. A processing unit 32 of the server 30D processes the pre-processed primary image P1A to generate a secondary image P2.

[0068] The pre-processing includes, for example, defective pixel correction, white balance processing, brightness correction processing, etc. It is preferable that the pre-processing is processing that can completely restore the image to its pre-processing state.

[0069] In addition to the same effects as the medical system 1 of the first embodiment, the medical system 1D transmits less image data to the processor 10D than the medical system 1, which reduces the load on the line.

[0070] Although not shown, the processor 10-10D according to the embodiment of the present invention may also have a post-processing unit that processes the image received from the server into a display format suitable for the monitor 20.

[0071] In the above description, an endoscope device has been used as an example of a medical device, but the medical device may also be a medical microscope device.

[0072] The ranges of the numerical values ​​described above are not limited to the ranges described above and can be increased or decreased as appropriate. Furthermore, the present invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the present invention.

[0073] REFERENCE SIGNS LIST 1 Medical system 1, 1A-1D Endoscope system 5 Light source 6 Release switch 7 Operation button 8 Camera unit 9 Endoscope 10 Processor 11 CPU 12 Acquisition unit 13 First processing unit 14 First transmission unit 15 First receiving unit 16 Dissatisfaction signal generation unit 17 Selection unit 20 Monitor 30 Server 31 Second receiving unit 32 Second processing unit 33 Second transmission unit 34 Buffer memory 35 Storage unit 40 Management device 41 Input unit 42 Analysis unit

Claims

1. A medical system comprising: a processor having an acquisition unit that acquires primary images from a medical device, a first transmission unit that transmits the primary images, a first reception unit that receives secondary images obtained by processing the primary images, and a dissatisfaction signal generation unit that generates a dissatisfaction signal to be transmitted from the first transmission unit when a user is dissatisfied with the secondary images; and a server having a second reception unit that receives the primary images and the dissatisfaction signal, a processing unit that processes the primary images based on first processing conditions to generate the secondary images, a second transmission unit that transmits the secondary images, and a memory unit that stores at least one of the primary images when the dissatisfaction signal is received.

2. The medical system described in claim 1, characterized in that the primary image is an image of one frame of a video, and the memory unit stores multiple primary images immediately before the occurrence of the dissatisfaction signal when the dissatisfaction signal is received during video processing.

3. The medical system described in claim 2, characterized in that the memory unit further stores the plurality of primary images before processing the plurality of secondary images and setting data of the medical device when the dissatisfaction signal is received.

4. The medical system described in claim 1, characterized in that when the memory unit receives the dissatisfaction signal for a still image acquired and stored by the user's release operation, it stores the still image, along with the primary image before processing of the still image, the first processing conditions, and the setting data of the medical device.

5. The medical system according to claim 3, wherein the medical device is an endoscopic device including a light source and an endoscope, and the setting data of the medical device includes at least one of a user setting mode, an endoscope individual parameter, a light source individual parameter, and a dimming state of the light source.

6. The medical system according to claim 1, wherein the first processing conditions are standard conditions that generate the secondary image that is satisfactory to a standard user.

7. The medical system of claim 1, wherein when the server receives the dissatisfaction signal, the processing unit processes the primary image based on second processing conditions and outputs a tertiary image; the processor that displays the secondary image and the tertiary image on a monitor further has a selection unit that allows the user to select the secondary image or the tertiary image; the first transmission unit transmits the selection result of the selection unit to the server; and the selection result and the tertiary image are stored in the memory unit.

8. The medical system according to claim 7, wherein the second processing conditions are test conditions obtained by modifying the first processing conditions.

9. The medical system according to claim 7, further comprising an analysis unit that creates the second processing conditions based on the data stored in the storage unit.

10. The medical system according to claim 1, wherein the data stored in said storage unit includes a reason for dissatisfaction with said secondary image for which said dissatisfaction signal was generated.

11. The medical system according to claim 10, further comprising a management device connected to said server and having an input section for inputting said reason for dissatisfaction.

12. The medical system according to claim 9, characterized in that the memory unit stores the name of the user, and the analysis unit creates the second processing conditions dedicated to the user.

13. The medical system according to claim 1, wherein the medical device is an endoscope device.

14. The medical system of claim 1, wherein the processor further comprises a pre-processing unit that pre-processes the primary image; the first transmitting unit transmits the pre-processed primary image; the second receiving unit receives the pre-processed primary image; and the processing unit processes the pre-processed primary image to generate the secondary image.

15. A processor comprising: an acquisition unit that acquires a primary image from a medical device; a first transmission unit that transmits the primary image to a server; a first reception unit that receives a secondary image from the server that is a processed version of the primary image; and a dissatisfaction signal generation unit that generates a dissatisfaction signal that is transmitted from the first transmission unit to the server when a user is dissatisfied with the secondary image.

16. A method for operating a medical system, characterized in that an acquisition unit of a processor acquires a primary image from a medical device, a first transmission unit of the processor transmits the primary image to a server, a second receiving unit of the server receives the primary image, a processing unit of the server processes the primary image to generate a secondary image, a second transmission unit of the server transmits the secondary image to the processor, a first receiving unit of the processor receives the secondary image, when a user is dissatisfied with the secondary image, a dissatisfaction signal generation unit of the processor generates a dissatisfaction signal and the first transmission unit transmits the dissatisfaction signal to the server, and when the second receiving unit of the server receives the dissatisfaction signal, a memory unit of the server stores the primary image.

Images