CONTROL DEVICE, MEDICAL OBSERVATION SYSTEM, CONTROL METHOD, AND PROGRAM

The control device addresses the issue of frame disturbance detection in medical imaging devices without vertical synchronization by using horizontal synchronization signals to monitor frame abnormalities, ensuring reliable frame cycle monitoring across different devices.

JP7616897B2Active Publication Date: 2025-01-17SONY OLYMPUS MEDICAL SOLUTIONS
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2021019386
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-02-09
Publication Date
2025-01-17
Estimated Expiration
2041-02-09

AI Technical Summary

Technical Problem

Conventional medical imaging devices lacking a vertical synchronization signal in video data cannot detect frame disturbances, leading to the inability to monitor periodic disturbances in video data.

Method used

A control device that generates a field signal and detects horizontal synchronization signals to monitor frame abnormalities, utilizing a first detection unit to identify frame cycles based on the polarity switch of the field signal, and a monitoring unit to detect abnormalities in the frame cycle.

Benefits of technology

Enables the detection and monitoring of periodic disturbances in video data frames regardless of the type of medical imaging device, ensuring reliable frame cycle monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007616897000001
    Figure 0007616897000001
  • Figure 0007616897000002
    Figure 0007616897000002
  • Figure 0007616897000003
    Figure 0007616897000003
Patent Text Reader

Abstract

To provide a controller capable of monitoring periodic disturbance of 1 frame regardless of the kind of a medical imaging apparatus, a medical observation system, a control method, and a program.SOLUTION: A controller 9 includes: a generation part 91 outputting a field signal to a camera head 5; a horizontal synchronization signal detection part 941 detecting a horizontal synchronization signal from video data outputted from the camera head 5 and including at least the horizontal synchronization signal; and a monitoring part 96 monitoring whether or not abnormality has occurred to a 1 frame period of the video data on the basis of a period of the horizontal synchronization signal detected by the horizontal synchronization signal detection part 941 at a prescribed n-th time after the polarity of the field signal is switched.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a control device, a medical observation system, a control method, and a program. [Background technology]

[0002] Conventionally, in a medical endoscope system, video data including a vertical synchronization signal is transmitted from an endoscope to a control device (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-158159 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, in a medical endoscope system such as that disclosed in the above-mentioned Patent Document 1, a vertical synchronization signal contained in video data is detected, and based on the detection result, it is monitored to see whether or not there is any disruption in the period of one frame of the video data.

[0005] In addition, some medical imaging devices, such as endoscopes and surgical microscopes with imaging functions, do not include a vertical synchronization signal in the video data they transmit to a control device. For this reason, in a medical imaging device that transmits video data that does not include a vertical synchronization signal, a control device such as that described in Patent Document 1 above cannot detect the vertical synchronization signal, and thus cannot monitor for disruptions to the period of one frame of video data.

[0006] The present disclosure has been made in consideration of the above, and aims to provide a control device, a medical observation system, a control method, and a program that are capable of monitoring periodic disruptions in one frame of video data regardless of the type of medical imaging device. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems and achieve the objective, the control device of the present disclosure includes a generating unit that outputs a field signal to a medical imaging device, a first detecting unit that detects a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal, and a monitoring unit that monitors whether an abnormality has occurred in one frame period of the video data based on the period of the horizontal synchronizing signal detected by the first detecting unit a predetermined nth time after the polarity of the field signal is switched.

[0008] In addition, a medical observation system according to the present disclosure includes a medical imaging device that images a subject and outputs video data, and a control device to which the medical imaging device can be connected, the control device including: a generation unit that outputs a field signal to the medical imaging device; a first detection unit that detects a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; and a monitoring unit that monitors whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronizing signal detected by the first detection unit a predetermined nth time after the polarity of the field signal is switched.

[0009] In addition, the control method disclosed herein is a control method executed by a control device that has a processor having hardware and is connected to a medical imaging device, which outputs a field signal to the medical imaging device, detects a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal, and monitors whether or not an abnormality has occurred in one frame period of the video data based on the period of the horizontal synchronizing signal detected a predetermined nth time after the polarity of the field signal is switched.

[0010] In addition, the program disclosed herein includes a processor having hardware, and outputs a field signal to a control device to which a medical imaging device is connected, detects a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal, and monitors whether or not an abnormality has occurred in one frame period of the video data based on the period of the horizontal synchronizing signal detected a predetermined nth time after the polarity of the field signal is switched. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an endoscope system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating a functional configuration of the control device according to the first embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an overview of a video data format generated by the first camera head according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an overview of another video data format generated by the second camera head according to the first embodiment. [Diagram 5] FIG. 5 is a timing chart when the first camera head according to the first embodiment is connected. [Figure 6] FIG. 6 is a diagram showing the timing of the horizontal synchronization signal to be monitored according to the first embodiment. [Figure 7] FIG. 7 is a timing chart when the second camera head according to the first embodiment is connected. [Figure 8] FIG. 8 is a flowchart showing an outline of the process executed by the control device according to the first embodiment. [Figure 9] FIG. 9 is a flowchart showing an outline of the first monitoring process in FIG. [Figure 10] FIG. 10 is a flowchart showing an outline of the second monitoring process in FIG. [Figure 11]FIG. 11 is a diagram showing a schematic configuration of an endoscope system according to the second embodiment. [Figure 12] FIG. 12 is a diagram showing a schematic configuration of a surgical microscope system according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments for carrying out the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited to the following embodiments. Furthermore, each drawing referred to in the following description merely shows the shape, size, and positional relationship in a schematic manner to the extent that the contents of the present disclosure can be understood. That is, the present disclosure is not limited to only the shape, size, and positional relationship exemplified in each drawing. Furthermore, in the description of the drawings, the same parts are denoted by the same reference numerals. Furthermore, an endoscope system equipped with a rigid endoscope will be described as an example of a medical observation system according to the present disclosure.

[0013] (Embodiment 1) [Overall configuration of endoscope system] Fig. 1 is a diagram showing a schematic configuration of an endoscope system according to a first embodiment. The endoscope system 1 shown in Fig. 1 is a system used in the medical field, inserted into a living body of a subject, such as a human or animal, and observing the subject by displaying an image of the inside. Note that in the first embodiment, a rigid endoscope system using a rigid scope (insertion section 2) shown in Fig. 1 will be described as the endoscope system 1, but the endoscope system is not limited to this and may be, for example, a flexible endoscope system.

[0014] 1 includes an insertion section 2, a light source device 3, a light guide 4, a first camera head 5A (an endoscopic imaging device) and a second camera head 5B (an endoscopic imaging device) having imaging elements with different functions, a first transmission cable 6, a display device 7, a second transmission cable 8, a control device 9, and a third transmission cable 10. In the following description, when referring to either the first camera head 5A or the second camera head 5B, the term will be simply referred to as camera head 5.

[0015] The insertion section 2 is hard or at least partially soft and has an elongated shape. The insertion section 2 is inserted into a subject such as a patient. The insertion section 2 is provided with an optical system that is configured using one or more lenses and combines an observation image.

[0016] One end of a light guide 4 is connected to the light source device 3. Under the control of a control device 9, the light source device 3 emits (supplies) white light for illuminating the inside of the subject to one end of the light guide 4, and excitation light or infrared light to a drug administered or sprayed to the subject. The light source device 3 is configured using a semiconductor laser element such as an LED (Light Emitting Diode) light source or an LD (Laser Diode). The light source device 3 and the control device 9 may be configured to communicate individually as shown in FIG. 1, or may be configured as an integrated device.

[0017] One end of the light guide 4 is detachably connected to the light source device 3, and the other end is detachably connected to the insertion portion 2. The light guide 4 guides the light emitted from the light source device 3 from one end to the other end, and supplies it to the insertion portion 2.

[0018] The eyepiece 21 of the insertion section 2 is detachably connected to the camera head 5. Under the control of the control device 9, the camera head 5 captures an observation image formed by the insertion section 2 to generate video data (imaging signal) and outputs the video data. The camera head 5 also includes an operation ring section 51 that is rotatable in the circumferential direction, and a plurality of input sections 52 that accept input of instruction signals that instruct various operations of the endoscope system 1. In the first embodiment, the camera head 5 and the insertion section 2 function as an endoscope. In the first embodiment, either the first camera head 5A or the second camera head 5B is connected to the control device 9.

[0019] One end of the first transmission cable 6 is detachably connected to the control device 9 via a first connector portion 61, and the other end is connected to the camera head 5 via a second connector portion 62. The first transmission cable 6 transmits video data output from the camera head 5 to the control device 9, and also transmits control signals, synchronization signals, clock signals, power, and the like output from the control device 9 to the camera head 5.

[0020] The display device 7 can be connected to the control device 9 via a second transmission cable 8, and displays an image based on video data processed in the control device 9 under the control of the control device 9.

[0021] One end of the second transmission cable 8 is detachably connected to the display device 7, and the other end is detachably connected to the control device 9. The second transmission cable 8 transmits a display image based on the video data processed in the control device 9 to the display device 7.

[0022] The control device 9 is configured using a processor having hardware such as a memory and a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), and a field programmable gate array (FPGA). The control device 9 comprehensively controls the operations of the light source device 3, the camera head 5, and the display device 7 via the first transmission cable 6, the second transmission cable 8, and the third transmission cable 10, according to a program recorded in the memory. The control device 9 also performs various image processing on the video data input from the camera head 5 via the first transmission cable 6, and outputs the data to the second transmission cable 8.

[0023] One end of the third transmission cable 10 is detachably connected to the light source device 3, and the other end is detachably connected to the control device 9. The third transmission cable 10 transmits a control signal from the control device 9 to the light source device 3.

[0024] [Detailed configuration of the control device] Next, a description will be given of the functional configuration of the control device 9. Fig. 2 is a block diagram showing the functional configuration of the control device 9. Note that, although the following description will be given of a case where the first camera head 5A is connected to the control device 9, the second camera head 5B can also be connected to the control device 9.

[0025] The control device 9 shown in Figure 2 includes a generation unit 91, a receiving unit 92, a switching unit 93, a first image processing unit 94, a second image processing unit 95, a monitoring unit 96, a recording unit 97, a control unit 98, and an input unit 99.

[0026] Under the control of the control unit 98, the generation unit 91 generates a field signal that is a reference for one field of video data generated by the camera head 5, and outputs this field signal to the camera head 5. The generation unit 91 is configured using, for example, a timing generator or a clock generator.

[0027] Under the control of the control unit 98, the receiving unit 92 receives the video data transmitted from the camera head 5, and outputs the received video data to the switching unit 93 and the control unit 98. For example, when the video data transmitted from the camera head 5 is a parallel signal, the receiving unit 92 is configured using a parallel-serial conversion module that performs parallel-serial conversion processing, etc. Also, when the video data transmitted from the camera head 5 is an optical signal, the receiving unit 92 is configured using an O / E conversion module that performs O / E conversion, etc.

[0028] The switching unit 93 has one end electrically connected to the receiving unit 92, and the other end electrically connected to the first image processing unit 94 or the second image processing unit 95. The switching unit 93 electrically connects the receiving unit 92 to either the first image processing unit 94 or the second image processing unit 95 under the control of the control unit 98. Specifically, when the first camera head 5A is connected to the control device 9, the switching unit 93 electrically connects the receiving unit 92 to the first image processing unit 94 under the control of the control unit 98. On the other hand, when the second camera head 5B is connected to the control device 9, the switching unit 93 electrically connects the receiving unit 92 to the second image processing unit 95 under the control of the control unit 98. The switching unit 93 is configured using, for example, a semiconductor switch or the like.

[0029] The first image processing unit 94, under the control of the control unit 98, performs a predetermined image processing on the video data input from the switching unit 93 and outputs the data to the display device 7. Here, the predetermined image processing is, for example, a complementation process, a white balance adjustment process, etc. The first image processing unit 94 is configured using, for example, a memory and a processor having hardware such as an FPGA or a GPU. The first image processing unit 94 also has a horizontal synchronization signal detection unit 941.

[0030] The horizontal synchronizing signal detector 941 detects the horizontal synchronizing signal included in the video data, and outputs the detection result to the monitor 96. In the first embodiment, the horizontal synchronizing signal detector 941 functions as a first detector.

[0031] The second image processing unit 95, under the control of the control unit 98, performs a predetermined image processing on the video data input from the switching unit 93 and outputs the result to the display device 7. The second image processing unit 95 is configured using a memory and a processor having hardware such as an FPGA or a GPU. The second image processing unit 95 also has a vertical synchronization signal detection unit 951.

[0032] The vertical synchronization signal detection unit 951 detects a vertical synchronization signal included in the video data, and outputs the detection result to the monitoring unit 96. In the first embodiment, the vertical synchronization signal detection unit 951 functions as a second detection unit.

[0033] The monitoring unit 96, under the control of the control unit 98, monitors whether or not an abnormality occurs in one frame period corresponding to the video data based on the period of the horizontal synchronization signal detected by the horizontal synchronization signal detection unit 941 for the first time after the polarity of the field signal input from the generation unit 91 is switched, and outputs the monitoring result to the control unit 98. Furthermore, under the control of the control unit 98, the monitoring unit 96 recognizes a handshake signal included in the video data and then detects the switching of the polarity of the field signal. Moreover, under the control of the control unit 98, the monitoring unit 96 monitors whether or not an abnormality occurs in one frame period corresponding to the video data based on the vertical synchronization signal detected by the vertical synchronization signal detection unit 951 after the polarity of the field signal input from the generation unit 91 is switched, and outputs the monitoring result to the control unit 98. Under the control of the control unit 98, the monitoring unit 96 recognizes a handshake signal included in the video data, and then detects a change in polarity of the field signal.

[0034] The recording unit 97 records various information related to the endoscope system 1 and various data being processed. The recording unit 97 has a program recording unit 971. The program recording unit 971 records various programs executed by the endoscope system 1. The recording unit 97 is configured using a recording medium such as a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), or an SSD (Solid State Drive).

[0035] The control unit 98 controls each unit constituting the endoscope system 1. The control unit 98 is configured using a memory and a processor having hardware such as a CPU. The control unit 98 also acquires an identification signal (identification information) for identifying the type of the camera head 5, and determines whether or not the video data includes a vertical synchronization signal based on the identification signal. Thereafter, when the video data output from the camera head 5 does not include a vertical synchronization signal, the control unit 98 causes the switching unit 93 to connect the receiving unit 92 and the first image processing unit 94, thereby causing the switching unit 93 to output the video data to the horizontal synchronization signal detection unit 941 of the first image processing unit 94. On the other hand, when the video data output from the camera head 5 includes a vertical synchronization signal, the control unit 98 causes the switching unit 93 to connect the receiving unit 92 and the second image processing unit 95, thereby causing the switching unit 93 to output the video data to the vertical synchronization signal detection unit 951 of the second image processing unit 95. The control unit 98 also detects switching of the polarity of the handshake signal and the field signal from the video data output from the camera head 5. Furthermore, in a case where the control unit 98 detects a change in polarity of the field signal after detecting a handshake signal from the video data, and the horizontal synchronization signal detection unit 941 detects a horizontal synchronization signal, the control unit 98 causes the monitoring unit 96 to monitor one frame period of the video data. Conversely, in a case where the control unit 98 detects a handshake signal from the video data and the vertical synchronization signal detection unit 951 detects a vertical synchronization signal, the control unit 98 causes the monitoring unit 96 to monitor one frame period of the video data.

[0036] The input unit 99 is configured using a mouse, a keyboard, a touch panel, etc., and receives input of instruction signals in response to operations by an operator, and outputs the received instruction signals to the control unit 98.

[0037] [Outline of video data format] Next, the video data format generated by each of the first camera head 5A and the second camera head 5B will be described. First, the video data format generated by the first camera head 5A will be described. Fig. 3 is a diagram for explaining an outline of the video data format generated by the first camera head 5A.

[0038] As shown in Fig. 3, the video data format F1 generated by the first camera head 5A has a horizontal synchronization code D1, an effective image area D2, and an invalid area D3. The horizontal synchronization code D1 has a horizontal synchronization signal. The effective image area D2 has at least video data of the effective image area of ​​the imaging element, a handshake signal, and image correction data. The invalid area D3 has at least various information related to the imaging element and black correction data transmitted during a blanking period.

[0039] That is, the video data format F1 generated by the first camera head 5A does not include a vertical synchronization signal. Therefore, in the conventional medical observation system, the vertical synchronization signal cannot be detected from the video data format F1, and the disturbance of one frame period, that is, the abnormality of one frame period cannot be monitored.

[0040] Next, the format of the video data generated by the second camera head 5B will be described below. Fig. 4 is a diagram for explaining an outline of the video data format generated by the second camera head 5B.

[0041] As shown in Fig. 4, the video data format F2 generated by the second camera head 5B has a horizontal synchronization code D1, an effective image area D2, and an invalid area D3. Furthermore, the invalid area D3 has a vertical synchronization code D4 in which a vertical synchronization signal is embedded. Therefore, in the conventional medical observation system, the disturbance of one frame period, that is, an abnormality of one frame period, can be monitored by monitoring the vertical synchronization signal.

[0042] [Processing when the first camera head is connected] Next, the process when the first camera head 5A is connected to the control device 9 will be described. Fig. 5 is a diagram showing a timing chart when the first camera head 5A is connected. Note that Fig. 5 explains the monitoring start timing for one frame period. In Fig. 5, from the top, (a) shows a clock signal, (b) shows a scope connection signal, (c) shows an identification signal, (d) shows video data, (e) shows a handshake signal, (f) shows a horizontal synchronization signal, and (d) shows a field signal.

[0043] As shown in FIG. 5, the control unit 98 first acquires a scope type identification signal from the first camera head 5A when the first camera head 5A is connected to the control device 9 and a scope connection signal is received from the first camera head 5A in accordance with the clock signal (time t1).

[0044] Next, after the polarity of the field signal from the generation unit 91 is switched, i.e., when the field signal rises (time t2), the control unit 98 detects a handshake code contained in the video data transmitted from the first camera head 5A (time t3).

[0045] Thereafter, the control unit 98 enables the handshake signal (sets the pulse to a HIGH state) (time t4) after a predetermined time (eg, delay Td) has elapsed since the rising edge of the field signal (the pulse is in a HIGH state).

[0046] Next, the control unit 98 causes the monitoring unit 96 to wait until the horizontal synchronization signal detection unit 941 detects the first horizontal synchronization signal (time t5) after the handshake signal is enabled (time t4).

[0047] 6 is a diagram showing the timing of the horizontal sync signal to be monitored, in which (a) from the top shows the field signal, (b) shows the video data, and (c) shows the horizontal sync signal detection timing.

[0048] As shown in FIG. 6, after the polarity of the field signal changes (time t 11 ), the detection timing (time t 12 ), the horizontal sync signal detector 941 detects the second horizontal sync signal (time t 13 ) as one frame period (=one field (1V)). As a result, even if the video data generated by the first camera head 5A includes only a horizontal synchronization signal, the monitoring unit 96 can detect a disturbance in the one frame period, that is, an abnormality in the one frame period.

[0049] [Processing when a second camera head is connected] Next, a process when the second camera head 5B is connected to the control device 9 will be described. Fig. 7 is a diagram showing a timing chart when the second camera head 5B is connected. In Fig. 7, from the top, (a) shows a clock signal, (b) shows a scope connection signal, (c) shows an identification signal, (d) shows video data, (e) shows a handshake signal, (f) shows an image correction data reception signal, (g) shows a vertical synchronization signal, and (h) shows a field signal.

[0050] As shown in FIG. 7, the control unit 98 first receives an identification signal from the second camera head 5B when the second camera head 5B is connected to the control device 9 and receives a scope connection signal from the second camera head 5B in accordance with the clock signal (at time t 21 ).

[0051] Next, the control unit 98 enables the handshake signal (sets the pulse to a HIGH state) (at time t 22 ).

[0052] After that, the control unit 98 detects that the handshake signal is enabled (at time t 22 ), the timing when the image correction data signal rises (time t 23 ) from the timing at which the vertical synchronization signal detection unit 951 detects the first vertical synchronization signal (time t 24 ) causes the monitoring unit 96 to monitor for one frame period.

[0053] In this way, the monitoring unit 96 can monitor one frame period based on the vertical synchronization signal included in the video data of the second camera head 5B.

[0054] [Control device processing] Next, a description will be given of the processing executed by the control device 9. Fig. 8 is a flow chart showing an outline of the processing executed by the control device 9.

[0055] As shown in FIG. 8, first, when the camera head 5 is connected to the control device 9, the control unit 98 acquires an identification signal indicating the type of the camera head 5 from the camera head 5 (step S101).

[0056] Next, the control unit 98 judges whether the video data transmitted by the camera head 5 contains only a horizontal synchronizing signal as a synchronizing signal based on the identification signal acquired from the camera head 5 (step S102). Specifically, the control unit 98 judges whether the camera head 5 connected to the control device 9 is the first camera head 5A that transmits video data in a video data format F1 containing only a horizontal synchronizing signal. If the control unit 98 judges that the video data transmitted by the camera head 5 contains only a horizontal synchronizing signal as a synchronizing signal (step S102: Yes), the control device 9 proceeds to step S103, which will be described later. On the other hand, if the control unit 98 judges that the video data transmitted by the camera head 5 does not contain only a horizontal synchronizing signal as a synchronizing signal (step S102: No), the control device 9 proceeds to step S104, which will be described later.

[0057] In step S103, the control device 9 executes a first monitoring process to determine whether or not an abnormality occurs in the period of one frame corresponding to the video data based on the horizontal synchronization signal included in the video data. After step S103, the control device 9 ends this process. The details of the first monitoring process will be described later.

[0058] In step S104, the control device 9 executes a second monitoring process to determine whether or not an abnormality occurs in the period of one frame corresponding to the video data based on the vertical synchronization signal included in the video data. After step S104, the control device 9 ends this process. The second monitoring process will be described in detail later.

[0059] [First monitoring process] Next, the first monitoring process described in step S103 of Fig. 8 will be described in detail. Fig. 9 is a flowchart showing an outline of the first monitoring process. Note that Fig. 9 describes the process when the first camera head 5A is connected to the control device 9.

[0060] As shown in FIG. 9, first, the control unit 98 controls the switching unit 93 to connect the receiving unit 92 to the first image processing unit 94 (step S201).

[0061] Next, the control unit 98 determines whether or not the handshake signal has been enabled based on the handshake signal included in the video data output from the receiving unit 92 (step S202). If the control unit 98 determines that the handshake signal has been enabled (step S202: Yes), the control device 9 proceeds to step S203, which will be described later. On the other hand, if the control unit 98 determines that the handshake signal has not been enabled (step S202: No), the control device 9 continues this determination until the handshake signal is enabled.

[0062] In step S203, the control unit 98 determines whether or not the polarity of the field signal generated by the generation unit 91 has changed. If the control unit 98 determines that the polarity of the field signal generated by the generation unit 91 has changed (step S203: Yes), the control device 9 proceeds to step S204, which will be described later. On the other hand, if the control unit 98 determines that the polarity of the field signal generated by the generation unit 91 has not changed (step S203: No), the control device 9 continues this determination until the polarity of the field signal changes.

[0063] In step S204, the control unit 98 judges whether or not the horizontal synchronizing signal detection unit 941 has detected a horizontal synchronizing signal from the video data transmitted from the first camera head 5A. If the control unit 98 judges that the horizontal synchronizing signal detection unit 941 has detected a horizontal synchronizing signal from the video data transmitted from the first camera head 5A (step S204: Yes), the control device 9 proceeds to step S205. On the other hand, if the control unit 98 judges that the horizontal synchronizing signal detection unit 941 has not detected a horizontal synchronizing signal from the video data transmitted from the first camera head 5A (step S204: No), the control device 9 continues this judgment until the horizontal synchronizing signal detection unit 941 detects a horizontal synchronizing signal from the video data.

[0064] In step S205, the control unit 98 causes the monitoring unit 96 to monitor the period of one frame of the video data.

[0065] Next, the control unit 98 judges whether or not the horizontal synchronizing signal detection unit 941 has detected a horizontal synchronizing signal from the video data transmitted from the first camera head 5A. If the control unit 98 judges that the horizontal synchronizing signal detection unit 941 has detected a horizontal synchronizing signal from the video data transmitted from the first camera head 5A (step S206: Yes), the control device 9 proceeds to step S207. On the other hand, if the control unit 98 judges that the horizontal synchronizing signal detection unit 941 has not detected a horizontal synchronizing signal from the video data transmitted from the first camera head 5A (step S206: No), the control device 9 continues this judgment until the horizontal synchronizing signal detection unit 941 detects a horizontal synchronizing signal from the video data.

[0066] The monitor 96 judges whether or not an abnormality occurs in the one-frame period of the video data based on the timing of the horizontal synchronizing signal detected by the horizontal synchronizing signal detector 941 in step S204 and the timing of the horizontal synchronizing signal detected by the horizontal synchronizing signal detector 941 in step S206 (step S207). Specifically, the monitor 96 judges whether or not an abnormality occurs in the one-frame period by judging whether or not a time based on the rising timing of the horizontal synchronizing signal detected by the horizontal synchronizing signal detector 941 in step S204 and the rising timing of the horizontal synchronizing signal detected by the horizontal synchronizing signal detector 941 in step S206 is shorter or longer than a predetermined time (for example, the time of one field period ±10%). If the monitor 96 judges that an abnormality occurs in the one-frame period of the video data (step S207: Yes), the control device 9 proceeds to step S208, which will be described later. On the other hand, if the monitoring unit 96 determines that no abnormality occurs in the cycle of one frame of the video data (step S207: No), the control device 9 proceeds to step S209, which will be described later.

[0067] In step S208, the control unit 98 causes the display device 7 to display a warning that an abnormality has occurred in the first camera head 5A.

[0068] Next, the control unit 98 judges whether or not an instruction signal to end the examination of the subject has been input via the input unit 99 (step S209). If the control unit 98 judges that an instruction signal to end the examination of the subject has been input (step S209: Yes), the control device 9 returns to the main routine of Fig. 8 and ends this process. On the other hand, if the control unit 98 judges that an instruction signal to end the examination of the subject has not been input (step S209: No), the control device 9 returns to the above-mentioned step S205.

[0069] [Second monitoring process] Next, the second monitoring process described in step S104 of Fig. 8 will be described in detail. Fig. 10 is a flowchart showing an outline of the second monitoring process. Note that Fig. 10 describes the process when the second camera head 5B is connected to the control device 9.

[0070] As shown in FIG. 10, first, the control unit 98 controls the switching unit 93 to connect the receiving unit 92 to the second image processing unit 95 (step S301).

[0071] Next, the control unit 98 determines whether or not the handshake signal has been enabled based on the handshake signal included in the video data output from the receiving unit 92 (step S302). If the control unit 98 determines that the handshake signal has been enabled (step S302: Yes), the control device 9 proceeds to step S303, which will be described later. On the other hand, if the control unit 98 determines that the handshake signal has not been enabled (step S302: No), the control device 9 continues this determination until the handshake signal is enabled.

[0072] In step S303, the control unit 98 determines whether or not reception of the image correction data contained in the video data from the second camera head 5B has been completed, based on the video data output from the receiving unit 92. If the control unit 98 determines that reception of the image correction data contained in the video data from the second camera head 5B has been completed (step S303: Yes), the control device 9 proceeds to step S304, which will be described later. On the other hand, if the control unit 98 determines that reception of the image correction data contained in the video data from the second camera head 5B has not been completed (step S303: No), the control device 9 continues this determination until reception of the image correction data is completed.

[0073] In step S304, the control unit 98 judges whether or not the vertical synchronization signal detection unit 951 has detected a vertical synchronization signal from the video data transmitted from the second camera head 5B. If the control unit 98 judges that the vertical synchronization signal detection unit 951 has detected a vertical synchronization signal from the video data transmitted from the second camera head 5B (step S204: Yes), the control device 9 proceeds to step S305. On the other hand, if the control unit 98 judges that the vertical synchronization signal detection unit 951 has not detected a vertical synchronization signal from the video data transmitted from the second camera head 5B (step S304: No), the control device 9 continues this judgment until the vertical synchronization signal detection unit 951 detects a vertical synchronization signal from the video data.

[0074] In step S305, the control unit 98 causes the monitoring unit 96 to monitor the period of one frame of the video data.

[0075] Next, the control unit 98 judges whether or not the vertical synchronization signal detection unit 951 has detected a vertical synchronization signal from the video data transmitted from the second camera head 5B. If the control unit 98 judges that the vertical synchronization signal detection unit 951 has detected a vertical synchronization signal from the video data transmitted from the second camera head 5B (step S306: Yes), the control device 9 proceeds to step S307. On the other hand, if the control unit 98 judges that the vertical synchronization signal detection unit 951 has not detected a vertical synchronization signal from the video data transmitted from the second camera head 5B (step S306: No), the control device 9 continues this judgment until the vertical synchronization signal detection unit 951 detects a vertical synchronization signal from the video data.

[0076] The monitor 96 judges whether or not an abnormality occurs in the one-frame period of the video data based on the timing of the vertical synchronizing signal detected by the vertical synchronizing signal detector 951 in step S304 and the timing of the vertical synchronizing signal detected by the vertical synchronizing signal detector 951 in step S306 (step S307). Specifically, the monitor 96 judges whether or not an abnormality occurs in the one-frame period of the video data by judging whether or not a time based on the rising timing of the vertical synchronizing signal detected by the vertical synchronizing signal detector 951 in step S304 and the rising timing of the vertical synchronizing signal detected by the vertical synchronizing signal detector 951 in step S306 is shorter or longer than a predetermined time (for example, the time of one field period ±10%). If the monitor 96 judges that an abnormality occurs in the one-frame period of the video data (step S307: Yes), the control device 9 proceeds to step S308 described later. On the other hand, if the monitoring unit 96 determines that no abnormality occurs in the cycle of one frame of the video data (step S307: No), the control device 9 proceeds to step S309, which will be described later.

[0077] In step S308, the control unit 98 causes the display device 7 to display a warning that an abnormality has occurred in the second camera head 5B.

[0078] Next, the control unit 98 judges whether or not an instruction signal to end the subject examination has been input via the input unit 99 (step S309). If the control unit 98 judges that an instruction signal to end the subject examination has been input (step S309: Yes), the control device 9 returns to the main routine of Fig. 8 and ends this process. On the other hand, if the control unit 98 judges that an instruction signal to end the subject examination has not been input (step S309: No), the control device 9 returns to the above-mentioned step S305.

[0079] According to the above-described first embodiment, after the polarity of the field signal is switched, the monitor unit 96 monitors whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronization signal detected for the predetermined nth time by the horizontal synchronization signal detector 941. As a result, it is possible to monitor for disruptions to the one frame period of the video data regardless of the type of camera head 5 (medical imaging device).

[0080] Furthermore, according to embodiment 1, immediately after the polarity of the field signal is switched, the monitoring unit 96 monitors whether or not an abnormality has occurred in the one-frame period based on the period of the horizontal synchronization signal detected for the first time by the horizontal synchronization signal detection unit 941, so that it is possible to monitor for disruptions to the period of one frame of video data regardless of the type of camera head 5 (medical imaging device).

[0081] According to the first embodiment, the control unit 98 acquires an identification signal (identification information) for identifying the type of the camera head 5, and determines whether or not the video data includes a vertical synchronization signal based on the identification signal. If the video data output from the camera head 5 does not include a vertical synchronization signal, the control unit 98 connects the receiving unit 92 to the first image processing unit 94, thereby causing the switching unit 93 to output the video data to the horizontal synchronization signal detection unit 941 of the first image processing unit 94. On the other hand, if the video data output from the camera head 5 includes a vertical synchronization signal, the control unit 93 connects the receiving unit 92 to the second image processing unit 95, thereby causing the switching unit 93 to output the video data to the vertical synchronization signal detection unit 951 of the second image processing unit 95. As a result, regardless of the type of the camera head 5 (medical imaging device), i.e., the first camera head 5A or the second camera head 5B, it is possible to monitor the periodic disruption of one frame of the video data.

[0082] Furthermore, according to the first embodiment, the control unit 98 detects a change in polarity of the handshake signal and the field signal from the video data output from the camera head 5, and when the control unit 98 detects a change in polarity of the field signal after detecting the handshake signal from the video data, the control unit 98 causes the monitoring unit 96 to monitor one frame period of the video data when the horizontal synchronization signal detection unit 941 detects a horizontal synchronization signal, and causes the monitoring unit 96 to monitor one frame period of the video data when the vertical synchronization signal detection unit 951 detects a vertical synchronization signal after detecting the handshake signal from the video data. As a result, it is possible to monitor for disruptions in the period of one frame of the video data regardless of the type of camera head 5 (medical imaging device), i.e., the first camera head 5A or the second camera head 5B.

[0083] (Embodiment 2) Next, a description will be given of embodiment 2. In the above-mentioned embodiment 1, a case where the present invention is applied to a rigid endoscope system using a rigid endoscope is described, whereas in the embodiment 2, a case where the present invention is applied to a flexible endoscope system using a flexible endoscope is described. Note that the same components as those in the endoscope system 1 according to the above-mentioned embodiment 1 are given the same reference numerals, and detailed description thereof will be omitted.

[0084] [Overall configuration of endoscope system] Fig. 11 is a diagram showing a schematic configuration of an endoscope system according to embodiment 2. The endoscope system 200 shown in Fig. 11 includes an endoscope 201 that captures an in-vivo image of an observation site by inserting an insertion section 202 into a subject to generate video data, a light source device 210 that supplies white light or infrared light to the endoscope 201, a control device 220 that performs predetermined image processing on an imaging signal acquired by the endoscope 201 and comprehensively controls the operation of the entire endoscope system 200, and a display device 230 that displays the in-vivo image that has been image-processed by the control device 220.

[0085] The control device 220 includes at least the above-mentioned generation unit 91, receiving unit 92, switching unit 93, first image processing unit 94, second image processing unit 95, monitoring unit 96, recording unit 97, control unit 98, and input unit 99.

[0086] According to the second embodiment described above, even if the endoscope system 200 is flexible, it is possible to obtain the same effects as those of the first embodiment described above.

[0087] (Embodiment 3) Next, a third embodiment will be described. In the first and second embodiments described above, an endoscope system is described, but in the third embodiment, a case where the system is applied to a surgical microscope system is described. Note that the same components as those in the endoscope system 1 according to the first embodiment described above are given the same reference numerals, and detailed description thereof will be omitted.

[0088] [Configuration of surgical microscope system] Fig. 12 is a diagram showing a schematic configuration of a surgical microscope system according to embodiment 3. The surgical microscope system 300 shown in Fig. 12 includes a microscope device 310, which is a medical imaging device that captures and obtains images for observing a subject, and a display device 311 that displays video data captured by the microscope device 310. It is also possible to configure the display device 311 and the microscope device 310 as an integrated unit.

[0089] The microscope device 310 includes a microscope unit 312 that magnifies and captures a minute part of a subject, a support unit 313 that is connected to the base end of the microscope unit 312 and includes an arm that rotatably supports the microscope unit 312, and a base unit 314 that rotatably holds the base end of the support unit 313 and is movable on a floor surface. The base unit 314 includes a control device 315 that controls the operation of the surgical microscope system 300, and a light source device 316 that generates white light or infrared light to be irradiated from the microscope device 310 to the subject. The control device 315 includes at least the above-mentioned generation unit 91, reception unit 92, switching unit 93, first image processing unit 94, second image processing unit 95, monitoring unit 96, recording unit 97, control unit 98, and input unit 99. The base unit 314 may be fixed to a ceiling, a wall, or the like to support the support unit 313, instead of being movably provided on a floor surface.

[0090] The microscope unit 312 has, for example, a cylindrical shape. A switch is provided on the side of the microscope unit 312 for receiving input of an operation instruction for the microscope device 310. A cover glass (not shown) for protecting the inside is provided on the opening surface at the lower end of the microscope unit 312.

[0091] In the surgical microscope system 300 configured in this manner, a user such as a surgeon moves the microscope unit 312, performs zoom operations, and switches the illumination light while operating various switches while holding the microscope unit 312. Note that the shape of the microscope unit 312 is preferably elongated and extends in the observation direction so that the user can easily hold it and change the viewing direction. For this reason, the shape of the microscope unit 312 may be a shape other than a cylindrical shape, and may be, for example, a polygonal prism shape.

[0092] According to the above-described third embodiment, the surgical microscope system 300 can also achieve the same effects as those of the first embodiment.

[0093] (Other embodiments) By appropriately combining a plurality of components disclosed in the medical observation system according to the embodiment of the present disclosure described above, various inventions can be formed. For example, some components may be deleted from all the components described in the medical observation system according to the embodiment 1 of the present disclosure described above. Furthermore, the components described in the medical observation system according to the embodiment 1 of the present disclosure described above may be appropriately combined.

[0094] Furthermore, in the medical observation system according to the first embodiment of the present disclosure, the above-mentioned "unit" can be read as "means" or "circuit," etc. For example, the control unit can be read as control means or control circuit.

[0095] In addition, the program to be executed by the medical observation system according to the first embodiment of the present disclosure is provided as file data in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, a digital versatile disk (DVD), a USB medium, or a flash memory.

[0096] Furthermore, the program executed by the medical observation system according to the first embodiment of the present disclosure may be configured to be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.

[0097] In the description of the flowcharts in this specification, the order of processing between steps is clearly indicated using expressions such as "first," "then," and "continue," but the order of processing required to implement the present invention is not uniquely determined by these expressions. In other words, the order of processing in the flowcharts described in this specification can be changed as long as there is no contradiction.

[0098] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present disclosure can be implemented in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the present disclosure section.

[0099] The present technology can also be configured as follows. (Appendix 1) a generator for outputting a field signal to a medical imaging device; a first detector for detecting a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; a monitoring unit that monitors whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronization signal detected by the first detection unit a predetermined n-th time after the polarity of the field signal is switched; A control device comprising: (Appendix 2) A control device according to (Supplementary Note 1), The monitoring unit is immediately after the polarity of the field signal is switched, monitoring is performed based on the period of the horizontal synchronizing signal detected for the first time by the first detection unit to determine whether or not an abnormality occurs in the one frame period. Control device. (Appendix 3) A control device according to (Supplementary Note 1) or (Supplementary Note 2), a second detection unit that detects a vertical synchronization signal; a switching unit that outputs the video data to the first detection unit or the second detection unit; a control unit that acquires an identification signal that identifies a type of the medical imaging device, determines whether or not the video data includes the vertical synchronizing signal based on the identification signal, and, if the video data does not include the vertical synchronizing signal, causes the switching unit to output the video data to the first detection unit, while, if the video data includes the vertical synchronizing signal, causes the switching unit to output the video data to the second detection unit; Equipped with Control device. (Appendix 4) A control device according to (Supplementary Note 3), The medical imaging device includes: a first image sensor capable of outputting the image data including the horizontal synchronizing signal or a second image sensor capable of outputting the image data including the vertical synchronizing signal; The identification signal is The information includes information for identifying the first imaging element or the second imaging element, The control unit is based on the identification signal, when the medical imaging device includes the first imaging element, cause the switching unit to output the image data to the first detection unit, and when the medical imaging device includes the second imaging element, cause the switching unit to output the image data to the second detection unit; Control device. (Appendix 5) A control device according to (Appendix) 3 or (Appendix 4), The monitoring unit is when the second detection unit detects the vertical synchronization signal, monitoring whether or not an abnormality occurs in the one frame period based on the vertical synchronization signal; Control device. (Appendix 6) A control device according to any one of (Supplementary Note 3) to (Supplementary Note 5), The video data is a handshake signal indicating that communication between the medical imaging device and the controller has been established; The control unit is Detecting polarity changes of the handshake signal and the field signal from the video data; when detecting a change in polarity of the field signal after detecting the handshake signal, when the first detection unit detects the horizontal synchronization signal, the monitoring unit is caused to monitor the one frame period; when the second detection unit detects the vertical synchronization signal after detecting the handshake signal, the monitoring unit monitors the one frame period. Control device. (Appendix 7) A control device according to any one of (Supplementary Note 1) to (Supplementary Note 6), The medical imaging device includes: An endoscope or surgical microscope device, Control device. (Appendix 8) a medical imaging device that images a subject and outputs video data; a control device to which the medical imaging device can be connected; Equipped with The control device includes: a generator for outputting a field signal to the medical imaging device; a first detector for detecting a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; a monitoring unit that monitors whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronization signal detected by the first detection unit a predetermined n-th time after the polarity of the field signal is switched; Equipped with Medical observation system. (Appendix 9) A control method executed by a control device having a processor having hardware and connected to a medical imaging device, comprising: outputting a field signal to the medical imaging device; Detecting a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; monitoring whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronizing signal detected a predetermined n-th time after the polarity of the field signal is switched; Control methods. (Appendix 10) a control device having a processor having hardware, the control device being connected to a medical imaging device, outputting a field signal to the medical imaging device; Detecting a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; monitoring whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronizing signal detected a predetermined n-th time after the polarity of the field signal is switched; A program to make that happen. [Explanation of symbols]

[0100] 1,200 Endoscope Systems 2,202 Insertion section 3,210,316 Light source device 4 Light Guide 5 Camera Head 5A First Camera Head 5B Second Camera Head 6 First Transmission Cable 7,230,311 Display device 8 Second Transmission Cable 9,220,315 Control device 10. Third Transmission Cable 21 Eyepiece 51 Operation ring section 52,99 Input section 61 First connector part 62 Second connector part 91 Generation part 92 Receiving section 93 Switching section 94 First image processing section 95 Second image processing section 96 Monitoring Department 97 Recording Section 98 Control Unit 201 Endoscope 300 Surgical Microscope System 310 Microscope Equipment 312 Microscope Section 313 Support part 314 Base 941 Horizontal sync signal detector 951 Vertical sync signal detector 971 Program Recording Section F1,F2 video data format

Claims

1. a generator that outputs a field signal that is a reference for one field of video data generated by the medical imaging device and whose polarity changes every field period; a first detector for detecting a horizontal synchronizing signal from the image data output from the medical imaging device, the image data including at least a horizontal synchronizing signal; a monitoring unit that monitors whether or not an abnormality occurs in one frame period of the video data based on a period of the horizontal synchronization signal detected by the first detection unit a predetermined n-th time after the polarity of the field signal input from the generation unit is switched; A control device comprising:

2. The control device according to claim 1 , The monitoring unit is immediately after the polarity of the field signal is switched, monitoring is performed to see whether or not an abnormality occurs in the one frame period based on the period of the horizontal synchronizing signal detected for the first time by the first detection unit. Control device.

3. The control device according to claim 1 , A second detector that detects a vertical synchronization signal; a switching unit that outputs the video data to the first detection unit or the second detection unit; a control unit that acquires an identification signal that identifies a type of the medical imaging device, determines whether or not the video data includes the vertical synchronizing signal based on the identification signal, and, if the video data does not include the vertical synchronizing signal, causes the switching unit to output the video data to the first detection unit, while, if the video data includes the vertical synchronizing signal, causes the switching unit to output the video data to the second detection unit; Equipped with Control device.

4. A control device as claimed in claim 3, The medical imaging device includes: a first image pickup element capable of outputting the image data including the horizontal synchronizing signal and not including the vertical synchronizing signal, or a second image pickup element capable of outputting the image data including the horizontal synchronizing signal and the vertical synchronizing signal; The identification signal is The information includes information for identifying the first imaging element or the second imaging element, The control unit is based on the identification signal, when the medical imaging device includes the first imaging element, the switching unit outputs the image data to the first detection unit, and when the medical imaging device includes the second imaging element, the switching unit outputs the image data to the second detection unit. Control device.

5. The control device according to claim 3, The monitoring unit is when the second detection unit detects the vertical synchronization signal, monitoring whether or not an abnormality occurs in the one frame period based on the vertical synchronization signal; Control device.

6. The control device according to claim 3, The video data is a handshake signal indicating that communication between the medical imaging device and the controller has been established; The control unit is Detecting the handshake signal from the video data; when the first detection unit detects the horizontal sync signal in a case where the polarity of the field signal is switched after the handshake signal is detected, the monitoring unit is caused to monitor the one frame period; when the second detection unit detects the vertical synchronization signal after detecting the handshake signal, the monitoring unit is caused to monitor the one frame period. Control device.

7. The control device according to claim 1 , The medical imaging device includes: An endoscope or surgical microscope device, Control device.

8. a medical imaging device that images a subject and outputs video data; a control device to which the medical imaging device can be connected; Equipped with The control device includes: a generator that outputs a field signal that is a reference for one field of video data generated by the medical imaging device and whose polarity changes every field period; a first detector for detecting a horizontal synchronizing signal from image data output from the medical imaging device, the image data including at least a horizontal synchronizing signal; a monitoring unit that monitors whether or not an abnormality occurs in one frame period of the video data based on a period of the horizontal synchronization signal detected by the first detection unit a predetermined n-th time after the polarity of the field signal input from the generation unit is switched; Equipped with Medical observation system.

9. A control method executed by a control device having a processor having hardware and connected to a medical imaging device, comprising: outputting a field signal which is a reference for one field of image data generated by the medical imaging device and whose polarity changes every field period; Detecting a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; monitoring whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronizing signal detected a predetermined n-th time after the polarity of the output field signal is switched; Control methods.

10. a control device having a processor having hardware, the control device being connected to a medical imaging device, outputting a field signal which is a reference for one field of image data generated by the medical imaging device and whose polarity changes every field period; Detecting a horizontal synchronizing signal from video data output from the medical imaging device, the video data including at least a horizontal synchronizing signal; monitoring whether or not an abnormality occurs in one frame period of the video data based on the period of the horizontal synchronizing signal detected a predetermined n-th time after the polarity of the output field signal is switched; A program to make that happen.

Citation Information

Patent Citations

  • Transmission device and introduction system into subject

    JP2005319097A

  • Receiving device and system for acquiring information on inside of subject

    JP2007075161A

  • Image processor

    JP2007318558A

  • Endoscopic system

    JP2008086666A

  • Electronic endoscope and endoscope apparatus

    JP2009045113A