Control devices and medical observation systems

Abstract

In the control device disclosed in the present invention for electrically controlling a medical observation device for an observation target, the control device includes: a voice recognition unit for recognizing voice input from the outside; a recognition information processing unit for determining a process to be performed by the medical observation device based on a recognition result of the voice recognition unit; a switch input receiving unit for receiving an input of an operation signal in response to an operation performed on a switch; and a control unit for starting voice recognition processing by the voice recognition unit upon detecting a first operation signal received by the switch input receiving unit or upon acquiring information related to the process determined by the recognition information processing unit, and allowing the medical observation device to perform the process determined by the recognition information processing unit, and stopping the process to be performed by the medical observation device by detecting a second operation signal.

Description

Technical Field

[0001] The present disclosure relates to a control device that controls a medical observation device for observing, for example, a microscopic portion of an observation target. The present disclosure also relates to a medical observation system. Background Art

[0002] In the past, optical microscope systems were known as medical observation systems for observing a microscopic part of an observation target (such as a patient's brain or heart) during surgery on the microscopic part. Existing optical microscope systems include a support and a microscope. The support includes a plurality of arms and has a total of six degrees of freedom of movement, i.e., three degrees of freedom of translation and three degrees of freedom of rotation. The microscope is arranged on the front end of the support and is provided with an imaging element and a magnifying optical system for magnifying the microscopic part.

[0003] Incidentally, the above optical microscope system is required to be controlled by the surgeon's voice without the surgeon having to move his sight away from the surgical site or the monitor. However, functions that require continuous drive (such as zoom ratio and focal length adjustment and field of view movement) are difficult to be fully controlled by voice alone. It is known that there is a technology that solves the above control problem by using a combination of a voice input device and a continuous input device (such as a foot switch) (for example, refer to PTL 1). This technology enables the surgeon to control functions that require continuous drive, which are not easily controlled by voice alone.

[0004] [Citation List]

[0005] [Patent Document]

[0006] [PTL 1]

[0007] JP 2004-24869A Summary of the invention

[0008] [Technical issues]

[0009] However, according to PTL 1, a microphone is connected to a voice recognition device, and a foot switch is connected to a control device for controlling a microscope section. Since the microphone and the foot switch are connected to different devices, the resulting device configuration is complicated.

[0010] Further, after calling the function through voice recognition, the operation is input through a foot switch or other input devices. Therefore, a lot of time is required to perform the operation.

[0011] The present disclosure has been made in view of the above circumstances. An object of the present disclosure is to provide a control device and a medical observation system which can complete speech recognition and processing based on speech recognition in a short period of time by using a simple configuration and easily stop processing.

[0012] [Solution to the problem]

[0013] In order to solve the above problems and achieve the above purposes, according to the present disclosure, a control device is provided, which electrically controls a medical observation device configured to capture an image of an observation target, and the control device includes a voice recognition unit, an identification information processing unit, a switch input receiving unit, and a control unit. The voice recognition unit recognizes voice input from the outside. Based on the recognition result of the voice recognition unit, the identification information processing unit determines the processing to be performed by the medical observation device. Based on the operation of the switch, the switch input receiving unit receives the input of an operation signal. When a first operation signal received by the switch input receiving unit is detected or when information related to the processing determined by the identification information processing unit is obtained, the control unit causes the voice recognition unit to start voice recognition processing and causes the medical observation device to perform the processing determined by the identification information processing unit. Further, when a second operation signal is detected, the control unit stops the processing to be performed by the medical observation device.

[0014] According to the above-mentioned present disclosure, the control device is configured so that: based on the operation of the switch, the switch input receiving unit receives the input of the input value as the operation signal; and when a first change in the input value received by the switch input receiving unit is detected, the control unit causes the voice recognition unit to start the voice recognition processing and causes the medical observation device to perform the processing determined by the recognition information processing unit, and when a second change in the input value is detected, the control unit stops the processing to be performed by the medical observation device.

[0015] According to the present disclosure described above, the control device is configured so that the first operation signal and the second operation signal serve as different operation signals and correspond to different operations performed on the switch.

[0016] According to the present disclosure described above, the control device is configured so that the first operation signal and the second operation signal serve as the same operation signal and correspond to similar operations performed on the switch.

[0017] According to the above-mentioned present disclosure, the control device is configured so that: when the input value changes from the initial value of the switch to a value other than the initial value, the control unit starts voice recognition processing and causes the medical observation device to perform processing; and when the input value changes to the initial value, the control unit stops the processing to be performed by the medical observation device.

[0018] According to the present disclosure described above, the control device is configured such that, according to the operation signal received by the switch input receiving section, the control section changes the driving speed of the medical observation device.

[0019] According to the present disclosure described above, the control device is configured so that, when the input value changes from the initial value within a preset time period after stopping the processing to be performed by the medical observation device due to the input value changing to the initial value, the control unit causes the medical observation device to perform processing opposite to the previous processing performed before stopping.

[0020] According to the above-mentioned present disclosure, the control device is configured so that: when the input value changes from the initial value of the switch to a value other than the initial value, the control unit starts voice recognition processing and causes the medical observation device to perform processing; and when the input value changes from the initial value to a value other than the initial value again, the control unit stops the processing to be performed by the medical observation device.

[0021] According to the present disclosure described above, the control device is configured so that: when the switch is pressed, the switch input receiving unit receives the input of the output operation signal; when the switch is continuously pressed, the control unit causes the medical observation device to continuously execute the processing determined by the identification information processing unit; and when the switch is released, the control unit causes the medical observation device to stop the processing determined by the identification information processing unit.

[0022] According to the above-mentioned present disclosure, the control device is configured to: enable subsequent voice recognition processing when the voice recognition result of the voice recognition unit is consistent with the first recognition information; and disable subsequent voice recognition processing when the voice recognition result of the voice recognition unit is consistent with the second recognition information.

[0023] According to the above-mentioned present disclosure, the control device is configured to: enable subsequent voice recognition processing when the voice recognition result of the voice recognition unit is consistent with the first recognition information; and disable the voice recognition results other than the first recognition information after a preset time period has passed since the voice recognition processing of the voice recognition unit was enabled.

[0024] According to the present disclosure described above, the control device is configured to: enable the recognition information processing unit to determine the direction in which the medical observation device moves the imaging area based on the recognition result of the voice recognition unit; and enable the control unit to move the medical observation device to the imaging area based on the moving direction determined by the recognition information processing unit.

[0025] According to the present disclosure described above, the control device is configured to: enable the recognition information processing unit to determine the image magnification of the medical observation device based on the recognition result of the voice recognition unit; and enable the control unit to change the image magnification of the medical observation device based on the magnification determined by the recognition information processing unit.

[0026] According to the present disclosure, a medical observation system is provided, which includes an imaging unit, a support unit, a voice recognition unit, an identification information processing unit, a switch, a switch input receiving unit, and a control unit. The imaging unit is capable of capturing an enlarged image of an observation target. The support unit includes a plurality of arms and a plurality of joints connecting the plurality of arms, and supports the imaging unit at the front end of the support unit. The voice recognition unit recognizes voice input from the outside. Based on the recognition result of the voice recognition unit, the identification information processing unit determines the processing to be performed by the imaging unit or the support unit. Based on the operation performed on the switch, the switch outputs an operation signal. The switch input receiving unit receives input from the switch. When a first operation signal received by the switch input receiving unit is detected or when information related to the processing determined by the identification information processing unit is obtained, the control unit causes the voice recognition unit to start the voice recognition processing and causes the imaging unit or the support unit to perform the processing determined by the identification information processing unit. When a second operation signal is detected, the control unit stops the processing to be performed by the imaging unit or the support unit.

[0027] [Effect of disclosure]

[0028] The present disclosure makes it possible to complete speech recognition and processing based on speech recognition in a short period of time by using a simple configuration, and to easily stop the processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] [ Figure 1 ] Figure 1 is a perspective view showing the external configuration of the medical observation system according to the first embodiment.

[0030] [ Figure 2 ] Figure 2 : is a block diagram showing the configuration of a control device in the medical observation system according to the first embodiment.

[0031] [ Figure 3 ] Figure 3 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the first embodiment.

[0032] [ Figure 4 ] Figure 4 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the second embodiment.

[0033] [ Figure 5 ] Figure 5 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the third embodiment of the present disclosure.

[0034] [ Figure 6 ] Figure 6: is a timing chart showing an example of a driving process performed by using the medical observation system according to the fourth embodiment of the present disclosure.

[0035] [ Figure 7 ] Figure 7 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the fifth embodiment of the present disclosure.

[0036] [ Figure 8 ] Figure 8 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the modification example of the fifth embodiment.

[0037] [ Fig. 9 ] Fig. 9 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the sixth embodiment of the present disclosure.

[0038] [ Fig.10 ] Fig.10 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the modification example of the sixth embodiment.

[0039] [ Fig.11 ] Fig.11 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the seventh embodiment of the present disclosure.

[0040] [ Fig.12 ] Fig.12 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the eighth embodiment of the present disclosure.

[0041] [ Fig.13 ] Fig.13 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the modification example of the eighth embodiment.

[0042] [ Fig.14 ] Fig.14 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the ninth embodiment of the present disclosure. DETAILED DESCRIPTION

[0043] The best mode for carrying out the present disclosure (hereinafter referred to as an embodiment) will now be described with reference to the accompanying drawings. It should be noted that the drawings are only schematic and differ from each other in dimensional relationships and ratios.

[0044] (First Embodiment)

[0045] Figure 1is a diagram showing the configuration of a medical observation system according to the first embodiment. Figure 1 The medical observation system 1 depicted in FIG. 1 includes a medical observation device (hereinafter referred to as an observation device) 2, a control device 3, and a display device 4. The observation device 2 can be used as a microscope for capturing an enlarged image of a microstructure of an observation target. The control device 3 provides comprehensive control of the operation of the medical observation system 1. The display device 4 displays the image captured by the observation device 2.

[0046] The observation device 2 includes a base portion 5, a support portion 6, and a microscope portion 7. The base portion 5 is movable on a floor surface. The support portion 6 is supported by the base portion 5. The microscope portion 7 is columnar, arranged on the front end of the support portion 6, and is configured to capture an enlarged image of a microscopic portion of an observation target. Further, the observation device 2 is connected to a light source device 8. The light source device 8 supplies illumination light to the observation device 2 through a light guide member 81 including, for example, an optical fiber. The light source device 8 emits illumination light under the control of the control device 3.

[0047] In the observation device 2, a transmission cable including a signal line (coaxial cable) for signal transmission between the control device 3 and the microscope section 7, a light guide cable for guiding illumination light from the light source device 8 to the microscope section 7, and various other cables are arranged between the base section 5 and the microscope section 7. The cables are arranged along the support section 6. The diameter of the coaxial cable formed of a thin wire is smaller than that of the light guide cable.

[0048] The support portion 6 includes a first engaging portion 11 , a first arm 21 , a second engaging portion 12 , a second arm 22 , a third engaging portion 13 , a third arm 23 , a fourth engaging portion 14 , a fourth arm 24 , a fifth engaging portion 15 , a fifth arm 25 , and a sixth engaging portion 16 .

[0049] The support portion 6 includes four groups of two arms and one joint. The joint pivotally couples one arm (positioned toward the front end) with another arm (positioned toward the base end). More specifically, the four groups include: a group having a first arm 21, a second joint 12, and a second arm 22; a group having a second arm 22, a third joint 13, and a third arm 23; a group having a third arm 23, a fourth joint 14, and a fourth arm 24; and a group having a fourth arm 24, a fifth joint 15, and a fifth arm 25.

[0050] The first joint 11 is held by the first arm 21 in a state where the front end of the first joint 11 pivotally holds the microscope section 7 and the base end is fastened to the front end of the first arm 21. The first joint 11 has a cylindrical shape and holds the microscope section 7 in a manner that allows it to pivot around the first axis O1. The first axis O1 is a central axis in the height direction. The first arm 21 has a shape that extends from the side of the first joint 11 in a direction orthogonal to the first axis O1.

[0051] The second engaging portion 12 is held by the second arm portion 22 in a state where the front end of the second engaging portion 12 pivotally holds the first arm portion 21 and the base end is fastened to the front end of the second arm portion 22. The second engaging portion 12 has a cylindrical shape and holds the first arm portion 21 in a manner that allows it to pivot around the second axis O2. The second axis O2 is a central axis in the height direction and is orthogonal to the first axis O1. The second arm portion 22 is shaped substantially similar to the letter L and is coupled to the second engaging portion 12 at the end of the L-shaped vertical straight line portion.

[0052] The third engaging portion 13 is held by the third arm portion 23 in a state where the front end of the third engaging portion 13 pivotally holds the L-shaped horizontal line portion of the second arm portion 22 and the base end is fastened to the front end of the third arm portion 23. The third engaging portion 13 has a cylindrical shape and holds the second arm portion 22 in a manner that pivots around the third axis O3. The third axis O3 is a central axis in the height direction, is orthogonal to the second axis O2, and is parallel to the direction in which the second arm portion 22 extends. The front end of the third arm portion 23 is cylindrical, and the base end has a through hole formed in a direction orthogonal to the height direction of the cylindrical front end. The third engaging portion 13 is pivotally held by the fourth engaging portion 14 via the through hole.

[0053] The fourth engaging portion 14 is held by the fourth arm portion 24 in a state where the front end of the fourth engaging portion 14 pivotally holds the third arm portion 23 and the base end is fastened to the fourth arm portion 24. The fourth engaging portion 14 has a cylindrical shape and holds the third arm portion 23 in such a manner as to pivot around the fourth axis O4. The fourth axis O4 is a central axis in the height direction and is orthogonal to the third axis O3.

[0054] The fifth joint 15 is installed in a state where the front end pivotally holds the fourth joint 24 and the base end is fastened to the fifth arm 25. The fifth joint 15 has a cylindrical shape and holds the fourth arm 24 in a manner that it pivots around the fifth axis O5. The fifth axis O5 is the central axis in the height direction and is parallel to the fourth axis O4. The fifth arm 25 has an L-shaped portion and a rod-shaped portion. The rod-shaped portion extends downward from the L-shaped horizontal line portion. The base end of the fifth joint 15 is installed on the end of the L-shaped vertical line portion of the fifth arm 25.

[0055] The sixth joint 16 is installed in a state where the front end pivotally holds the fifth arm 25 and the base end is fastened to the upper surface of the base 5. The sixth joint 16 has a cylindrical shape and holds the fifth arm 25 in a manner that makes it pivot around the sixth axis O6. The sixth axis O6 is the center axis in the height direction and is orthogonal to the fifth axis O5. The base end of the rod-shaped portion of the fifth arm 25 is installed on the front end of the sixth joint 16.

[0056] The support section 6 having the above-described configuration provides a total of six degrees of freedom of movement in the microscope section 7 , ie, three degrees of freedom of translation and three degrees of freedom of rotation.

[0057] The first to sixth engaging portions 11 to 16 have electromagnetic brakes that respectively prohibit the microscope section 7 and the first to fifth arm sections 21 to 25 from pivoting. When an arm operation switch (described later) attached to the microscope section 7 is pressed, the electromagnetic brakes are released to allow the microscope section 7 and the first to fifth arm sections 21 to 25 to pivot. It should be noted that an air brake may be used instead of the electromagnetic brake.

[0058] In addition to the above-mentioned electromagnetic brake, the joint also includes an encoder and an actuator. For example, when the encoder is included in the first joint 11, the encoder detects the rotation angle around the first axis O1. The actuator includes a motor (such as a servo motor), and under the control of the control device 3, the actuator is driven to rotate the associated joint by a predetermined angle. For example, according to the rotation angle around each of the rotation axes (the first to sixth axes O1 to O6), the rotation angle in each joint is set by the control device 3 to a value required by the microscope section 7. As described above, when the drive of the actuator is controlled, the joint having an active drive mechanism (such as an actuator) forms an active rotation axis.

[0059] The microscope section 7 has a cylindrical housing and includes an imaging section, an arm-operated switch, and a lever. The imaging section captures a magnified image of the observation target. The arm-operated switch receives an operation input of the electromagnetic brake that releases the first to sixth joints 11 to 16 so as to allow the joint to pivot. The lever is capable of changing the magnification of the imaging section 72 and the focal length relative to the observation target. The imaging section includes two imaging elements formed by a CCD (charge coupled device) or a CMOS (complementary metal oxide semiconductor). The imaging element generates an imaging signal having mutual parallax and used for three-dimensional image generation. The imaging signal is output as a digital signal. An alternative configuration may be adopted to include only one imaging element and generate an imaging signal for two-dimensional image generation. For example, the imaging section also includes: an optical system for guiding light to the imaging element; an amplifying optical system for changing the image magnification (zoom ratio); and a shutter for controlling the exposure time. In addition, the imaging section includes an actuator and an encoder for moving the lens of the optical system. The optical system in the imaging section is capable of changing the zoom ratio, adjusting the focal length, and changing some other imaging settings by allowing the lens to move under the control of the control device 3. Further, the microscope section 7 is provided with an arm-operated switch as a push button switch When the arm-operated switch is pressed by the user, the electromagnetic brakes of the first to sixth engaging portions 11 to 16 are released.

[0060] The control device 3 receives the imaging signal output from the observation device 2 and performs predetermined signal processing on the received imaging signal to generate three-dimensional image data for display purposes. It should be noted that the control device 3 can be installed in the base portion 5 and used as a component of the observation device 2. The control device 3 is connected to a microphone 91 and a foot switch 92. The microphone 91 inputs the user's voice. The foot switch 92 is operated (i.e., pressed) by the user's foot so as to input a signal based on the pressing.

[0061] Figure 2 3 is a block diagram showing the configuration of the control device in the medical observation system according to the first embodiment. The control device 3 includes an image processing section 31, a voice recognition section 32, a recognition information processing section 33, an input section 34, a foot switch input receiving section 35, an output section 36, a storage section 37, and a control section 38. It should be noted that, for example, the control device 3 may additionally include a power supply section (not depicted) that generates a power supply voltage for driving the observation device 2, the control device 3, the microphone 91, and the foot switch 92 and supplies the generated power supply voltage to each section of the control device 3 and the observation device 2.

[0062] The image processing section 31 performs noise removal processing or other signal processing on the imaging signal output from the microscope section 7, and performs A / D conversion signal processing if necessary. Based on the imaging signal after the signal processing, the image processing section 31 generates an image signal for display purposes by the display device 4. The image processing section 31 performs predetermined signal processing on the imaging signal to generate an image signal including an image signal for display purposes, which corresponds to a signal of the subject image. In this case, the image processing section 31 performs known various image processing (such as detection processing, interpolation processing, color correction processing, color enhancement processing, and contour enhancement processing). The image processing section 31 outputs the generated image signal to the display device 4.

[0063] Further, the image processing section 31 may additionally include an AF processing section and an AF calculation section. The AF processing section outputs a predetermined AF evaluation value for each frame based on the input frame imaging signal. The AF calculation section performs AF calculation processing to select the most suitable frame or focus lens position as the focus position based on the AF evaluation value for each frame output from the AF processing section.

[0064] The speech recognition section 32 detects the speech inputted by the user to the microphone 91, and performs recognition processing on the inputted speech. The speech recognition section 32 compares the feature quantity of the speech inputted to the microphone 91 with the recognition model stored in the storage section 37 and associated with the recognition result, and receives a language series as the recognition result. More specifically, in the case where "rightward" is inputted to the microphone 91, the speech recognition section 32 recognizes the inputted speech as "rightward" based on the feature quantity and the recognition model, and then outputs the recognition result to the recognition information processing section 33.

[0065] The recognition information processing unit 33 obtains the recognition result from the voice recognition unit 32, and determines the processing based on the recognition result. The recognition information processing unit 33 refers to the storage unit 37 to determine the processing based on the recognition result. The recognition information processing unit 33 outputs the processing description determined based on the recognition result to the control unit 38. For example, in the case where "right" is indicated by the recognition result, the control unit 38 moves the imaging area of ​​the microscope unit 7 to the right. When the microscope unit 7 moves, the imaging area used by the microscope unit 7 moves. In this case, based on the relationship between the imaging element and the display orientation of the display device 4, the orientation (right, left, upward, or downward) of the microscope unit 7 relative to its imaging area is preset. Without changing the operating distance and zoom ratio of the microscope unit 7, the control unit 38 drives each joint to move the position of the microscope unit 7 in a manner that only the imaging area moves to the right. Further, in the case where "zoom in" or "zoom out" is indicated by the recognition result, the control unit 38 drives the magnification optical system of the microscope unit 7. For example, in the case where "zoom in" is indicated by the recognition result, the control unit 38 provides control to increase the zoom ratio of the magnification optical system. This changes the magnification of the image formed by the microscope section 7 .

[0066] The input section 34 is realized by using a user interface such as a keyboard, a mouse, a touch panel, and is configured to receive input of various information.

[0067] The foot switch input receiving section 35 detects depression of the foot switch 92 by the user, and then receives an input from the foot switch 92. The foot switch input receiving section 35 inputs an operation signal based on the depression to the control section 38.

[0068] For example, the output section 36 is realized by a speaker, a printer, a display, etc., and is configured to output various information.

[0069] The storage unit 37 is composed of a semiconductor memory (such as a flash memory or a DRAM (dynamic random access memory)), and is configured to record, for example, a speech recognition table and a processing table. The speech recognition table is created by associating communication information data (e.g., communication format information) with a speech feature quantity and a recognition model. The processing table is created by associating a speech recognition result with a processing description. It should be noted that, for example, the storage unit 37 can record various programs to be executed by the control unit 38.

[0070] The control section 38 provides control such as drive control of each component section including the control device 3 and the observation device 2 and input / output control of information with respect to each component section. The control section 38 refers to the communication information data (e.g., communication format information) recorded in the storage section 37, generates a control signal, and thus transmits the generated control signal to the observation device 2.

[0071] It should be noted that the control section 38 generates a synchronization signal and a clock for the microscope section 7 and the control device 3. The synchronization signal (for example, a synchronization signal for specifying the imaging time) and the clock for the microscope section 7 are transmitted to the microscope section 7 via a cable not depicted. The microscope section 7 is then driven based on the transmitted synchronization signal and clock.

[0072] The above-mentioned image processing unit 31, voice recognition unit 32, recognition information processing unit 33, foot switch input receiving unit 35 and control unit 38 are each implemented by using a dedicated processor (such as various operation circuits for performing specific functions). For example, the dedicated processor can be a general-purpose processor or an ASIC (application-specific integrated circuit), such as a CPU (central processing unit) having an internal memory (not depicted) in which a program is recorded. Further, the dedicated processor can be an FPGA (field programmable gate array (not depicted)), a programmable integrated circuit. It should be noted that in the case of using an FPGA for configuration, the FPGA of the programmable integrated circuit can be configured by using configuration data read from the included memory.

[0073] The display device 4 receives the three-dimensional image data generated by the control device 3 and displays a three-dimensional image corresponding to the three-dimensional image data. The above-mentioned display device 4 is provided with a display panel including a liquid crystal or an organic EL (electroluminescence). It should be noted that in addition to the display device 4, an output device for outputting information by using, for example, a speaker or a printer may be included.

[0074] The following provides an overview of an operation performed by using a medical observation system 1 configured as described above. In the case where a user (i.e., a surgeon) performs an operation on a patient's head, the surgeon wears three-dimensional image viewing glasses, grasps the microscope section 7, and moves the microscope section 7 to a desired position while pressing the arm operation switch of the microscope section 7 and viewing the three-dimensional image displayed by the display device 4. When the imaging area of ​​the microscope section 7 is determined, the surgeon releases the arm operation switch. This activates the electromagnetic brakes of the first to sixth joints 11 to 16 to fix the imaging area of ​​the microscope section 7. After this, for example, the surgeon adjusts the magnification and focal length to the observation target. Since the display device 4 displays a three-dimensional image, the surgeon is able to grasp the surgical site three-dimensionally through the three-dimensional image. After this, the surgeon operates the microphone 91 and the foot switch 92 as needed to adjust the position, magnification and focal length of the microscope section 7.

[0075] Now refer to Figure 3 The operation processing performed by the control device 3 on the microphone 91 (voice recognition) and the foot switch 92 will be described. Figure 3 : is a timing chart showing an example of a driving process performed by using the medical observation system according to the first embodiment. Figure 3The timing diagram shows the input value (analog value), speech, and control signal (speed) input by the foot switch 92. The first embodiment starts the voice input recognition process when the foot switch 92 is pressed, and performs the process based on the recognition result. While the foot switch 92 is pressed, the process based on the recognition result is maintained.

[0076] More specifically, upon detecting that the foot switch 92 is pressed (stepped on), the foot switch input receiving section 35 outputs an analog value to the control section 38 based on the amount of pressing. Figure 3 In the example, the user at time T 11 The foot switch 92 is depressed. In this case, the increase in the depression amount of the foot switch 92 causes the analog value (initial value V0) to decrease from the analog value used when the foot switch 92 is not depressed.

[0077] Upon detection at time T 11 When the foot switch 92 is pressed, the control section 38 starts the voice recognition process by using the microphone 91. The user presses the foot switch 92 and then inputs a voice to the microphone 91. Figure 3 In the example depicted in , the user inputs “right” into microphone 91 .

[0078] When at time T 12 When "right" is input to microphone 91, until time T 13 In the time period, the speech recognition unit 32 performs recognition processing, and the recognition information processing unit 33 determines the processing to be performed. In the first embodiment, the speech signal "right" corresponds to the first operation signal. The first operation signal is a signal generated when speech is input.

[0079] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 13 Then, the control signal is output to each part to drive each joint part as needed to move the microscope part 7 to the right. In this case, the control part 38 provides control so that the driving speed for moving the microscope part 7 increases as the pressing amount of the foot switch 92 increases (as the analog value decreases). It should be noted that, for example, when the input speech is recognized as "right" and the microscope part 7 is moved to the right at the time T 13 With time T 14 When a different word is input while the cursor moves to the right, and the input different word is recognized as "Upward", the control unit 38 may perform one of the following processes, for example:

[0080] - Ignore voice input other than the initial voice input received after the foot switch 92 is depressed.

[0081] - Switch to the control for moving the microscope section 7 "upwards".

[0082] - Move the microscope part 7 obliquely “Upper Rightward”.

[0083] After this, when at time T 14 When the foot switch 92 is released, the microscope 7 stops moving. 14 Thereafter, even if a voice (e.g., "right") is uttered toward the microphone 91, the voice recognition process or the recognition information process is not performed. In the first embodiment, the second operation signal corresponds to a detection signal obtained when the initial value V0 is detected when the foot switch 92 is released. The first embodiment provides control by using a first operation signal based on the voice input and a second operation signal based on the operation of the foot switch 92.

[0084] As described above, the first embodiment is configured such that, in the case where the analog value inputted when the foot switch 92 is stepped on changes to a value other than the initial value V0, the control section 38 detects the first change and starts the voice recognition process. Meanwhile, in the case where the analog value returns to the initial value V0 when the foot switch 92 is released, the control section 38 detects the second change and stops the process based on the voice recognition.

[0085] In the state where the foot switch 92 is pressed, the first embodiment which has been described above receives the voice input from the microphone 91 and performs processing based on the recognition result. After that, the first embodiment maintains the processing based on the recognition result when the foot switch 92 is pressed, and stops the processing when the foot switch 92 is released. According to the first embodiment, when the foot switch 92 is pressed, the processing performed in the time period between starting the voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0086] It should be noted that the first embodiment has been described with reference to an example in which the movement speed of the microscope section 7 varies with the amount of depression of the foot switch 92. However, the microscope section 7 may alternatively move at a predetermined constant speed. Further, the foot switch 92 may output a digital value (such as a binary or ternary value) instead of a digital value. Figure 3 The simulated values ​​depicted in .

[0087] Further, the first embodiment has been described with reference to the example in which the control device 3 includes the foot switch input receiving section 35, the voice recognition section 32, the recognition information processing section 33, and the storage section 37. Alternatively, however, some or all of the foot switch input receiving section 35, the voice recognition section 32, the recognition information processing section 33, and the storage section 37 may be separated from the control device 3.

[0088] (Second Embodiment)

[0089] Now refer to Figure 4 A second embodiment is described. Figure 4 1 is a timing chart showing an example of a driving process performed by using a medical observation system according to a second embodiment. The configuration of the medical observation system according to the second embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0090] When it is detected that the foot switch 92 is pressed (stepped on), the foot switch input receiving unit 35 outputs an analog value based on the amount of pressing to the control unit 38. Figure 4 In the example, the user at time T 21 The foot switch 92 is depressed. In this case, the increase in the depression amount of the foot switch 92 causes the analog value (initial value V0) used when the foot switch 92 is not depressed to decrease.

[0091] Upon detection at time T 21 When the foot switch 92 is pressed, the control section 38 starts the voice recognition process by using the microphone 91. The user presses the foot switch 92 and then inputs a voice to the microphone 91. Figure 4 In the example depicted in , the user inputs “right” into microphone 91 .

[0092] When at time T 22 When "right" is input to microphone 91, until time T 23 During the time period, the speech recognition section 32 performs recognition processing, and the recognition information processing section 33 determines the processing to be performed.

[0093] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 23 Then, the control signal is output to each part to drive each joint part as needed to move the microscope part 7 to the right. In this case, the control part 38 provides control so that the speed for moving the microscope part 7 increases as the amount of depression of the foot switch 92 increases (as the analog value decreases).

[0094] After this, when at time T 24 When the foot switch 92 is released, the microscope 7 stops moving.

[0095] When at time T 24 After the preset time range (time period R T ) at time T 25 When the foot switch 92 is depressed again, the control section 38 resumes moving the microscope section 7. In this case, the control section 38 moves the microscope section 7 in the direction opposite to the direction in which the microscope section 7 moved before the foot switch was depressed again (in this case, "leftward"). Even when the microscope section 7 is moved in the opposite direction, the control section 38 provides control so that the speed for moving the microscope section 7 increases as the depression amount of the foot switch 92 increases (as the analog value decreases).

[0096] The time range (time period R) during which the microscope section 7 moves in the opposite direction when the foot switch 92 is pressed again T ) is set to a value between 0.5 seconds and 2.0 seconds, for example. The time period R can be set after the waiting time. T Used to avoid recognition errors caused by jitter.

[0097] After this, when at time T 26 When the foot switch 92 is released, the microscope 7 stops moving.

[0098] The second embodiment described above receives the voice input from the microphone 91 in the state where the foot switch 92 is pressed, and performs processing based on the recognition result. After that, the second embodiment maintains the processing based on the recognition result while the foot switch 92 is pressed, and stops the processing when the foot switch 92 is released. Further, when the voice input is received within a preset time range (time period R T ), the second embodiment performs a process opposite to the previous process. According to the second embodiment, when the foot switch 92 is pressed, the process performed in the time period between starting voice recognition and stopping the process is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the process from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the process. In addition, when the foot switch 92 is pressed again, the second embodiment performs the opposite process. Therefore, by operating the foot switch 92, it is possible to simply fine-tune the process.

[0099] (Third Embodiment)

[0100] Now refer to Figure 5 A third embodiment is described. Figure 51 is a timing chart showing an example of a drive process performed by using a medical observation system according to a third embodiment. The configuration of the medical observation system according to the third embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0101] When it is detected that the foot switch 92 is pressed (stepped down), the foot switch input receiving unit 35 outputs an analog value based on the amount of pressing to the control unit 38. Figure 5 In the example, the user at time T 31 The foot switch 92 is depressed. In this case, the increase in the depression amount of the foot switch 92 causes the analog value to decrease from the analog value (initial value V0) used when the foot switch 92 is not depressed.

[0102] Upon detection at time T 31 When the foot switch 92 is pressed, the control section 38 starts the voice recognition process by using the microphone 91. The user presses the foot switch 92 and then inputs a voice to the microphone 91. Figure 5 In the example depicted in , the user inputs “right” into microphone 91 .

[0103] When at time T 32 When "right" is input to microphone 91, until time T 23 During the time period, the speech recognition section 32 performs recognition processing, and the recognition information processing section 33 determines the processing to be performed.

[0104] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 33 Then, the control signal is output to each part to drive each joint part as needed to move the microscope part 7 to the right. In this case, the control part 38 provides control so that the speed for moving the microscope part 7 increases as the amount of depression of the foot switch 92 increases (as the analog value decreases).

[0105] After this, when at time T 34 When the foot switch 92 is released, the microscope 7 stops moving.

[0106] When at time T 34 After the preset time range (time period R T ) at time T 35When the foot switch 92 is pressed again, the control section 38 resumes moving the microscope section 7. In this case, the control section 38 moves the microscope section 7 in a direction opposite to the direction in which the microscope section 7 moved before the foot switch was pressed again (in this case, "to the left"). When moving the microscope section 7 in the opposite direction, the third embodiment moves the microscope section 7 at a constant speed regardless of the amount of pressing of the foot switch 92. In this case, the speed to be set is, for example, the maximum or minimum controllable speed, 50% of the maximum speed, or the maximum speed or minimum speed used for the last drive. It should be noted that in Figure 5 In the example depicted in , a maximum controllable speed is set.

[0107] After this, when at time T 36 When the foot switch 92 is released, the microscope 7 stops moving.

[0108] The third embodiment described above receives the voice input from the microphone 91 in the state where the foot switch 92 is pressed, and performs processing based on the recognition result. After that, the third embodiment maintains the processing based on the recognition result when the foot switch 92 is pressed, and stops the processing when the foot switch 92 is released. Further, when the preset time range (time period R T ), the third embodiment performs a process opposite to the previous process. According to the third embodiment, when the foot switch 92 is pressed, the process performed in the time period between starting voice recognition and stopping the process is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the process from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the process. In addition, when the foot switch 92 is pressed again, the third embodiment performs the opposite process. Therefore, by operating the foot switch 92, it is possible to simply fine-tune the process.

[0109] (Fourth Embodiment)

[0110] Now refer to Figure 6 A fourth embodiment is described. Figure 6 1 is a timing chart showing an example of a driving process performed by using a medical observation system according to a fourth embodiment. The configuration of the medical observation system according to the fourth embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0111] When it is detected that the foot switch 92 is pressed (stepped down), the foot switch input receiving unit 35 outputs an analog value based on the amount of pressing to the control unit 38. Figure 6 In the example, the user at time T 41The foot switch 92 is stepped on and immediately released. Therefore, the input value (analog value) input by the foot switch 92 is temporarily reduced from the initial value (V0), and then returns to the initial value (V0).

[0112] Upon detection at time T 41 When the foot switch 92 is pressed, the control section 38 starts the voice recognition process by using the microphone 91. The user presses the foot switch 92 and then inputs a voice to the microphone 91. Figure 6 In the example depicted in , the user inputs “right” into microphone 91 .

[0113] When at time T 42 When "right" is input to microphone 91, until time T 43 During the time period, the speech recognition section 32 performs recognition processing, and the recognition information processing section 33 determines the processing to be performed.

[0114] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 43 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0115] After that, upon detecting that at time T 44 When the foot switch 92 is pressed, the control section 38 stops the movement of the microscope section 7 .

[0116] As described above, the fourth embodiment is configured such that when the analog value inputted when the foot switch 92 is stepped on changes to a value other than the initial value V0, the control section 38 detects a first change and starts the voice recognition process. Meanwhile, when the analog value inputted when the foot switch 92 is pressed changes again to a value other than the initial value V0, the control section 38 detects a second change and stops the process based on the voice recognition.

[0117] The fourth embodiment described above receives voice input from the microphone 91 when the pressing of the foot switch 92 is detected, and performs processing based on the recognition result. After that, the fourth embodiment maintains the processing based on the recognition result, and stops the processing when the foot switch 92 is detected to be pressed again. According to the fourth embodiment, when the foot switch 92 (which serves as a trigger) is pressed, the processing performed in the time period between starting voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0118] (Fifth Embodiment)

[0119] Now refer to Figure 7 A fifth embodiment is described. Figure 7 1 is a timing chart showing an example of a drive process performed by using a medical observation system according to a fifth embodiment. The configuration of the medical observation system according to the fifth embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0120] In the fifth embodiment, voice input reception is always allowed. More specifically, unlike the first to fourth embodiments described earlier, which determine whether to process voice input based on the pressing of the foot switch 92, the fifth embodiment always allows voice recognition processing of the input voice.

[0121] When at time T 51 When "right" is input to microphone 91, until time T 52 During the time period, the control section 38 causes the speech recognition section 32 to perform recognition processing and causes the recognition information processing section 33 to determine processing to be performed.

[0122] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 52 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0123] After that, upon detecting that at time T 53 When the foot switch 92 is pressed, the control unit 38 stops the movement of the microscope unit 7. In the fifth embodiment, the movement of the microscope unit 7 is stopped immediately after the pressing of the foot switch 92 is detected.

[0124] The fifth embodiment described above receives a voice input from the microphone 91 and performs processing based on the recognition result. After that, the fifth embodiment maintains the processing based on the recognition result, and stops the processing when the foot switch 92 is detected to be pressed. According to the fifth embodiment, the processing performed in the time period between starting voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time by using a simple structure, and to easily stop the processing.

[0125] (Variation of the Fifth Embodiment)

[0126] Now refer to Figure 8 A modification of the fifth embodiment will be described. Figure 8 1 is a timing chart showing an example of a driving process performed by using a medical observation system according to a modification of Embodiment 5. In this modification, as in the case of Embodiment 5, voice input reception is in a state where it is always permitted.

[0127] When at time T 51 When "right" is input to microphone 91, until T 52 During the period of time, the control section 38 causes the speech recognition section 32 to perform recognition processing and causes the recognition information processing section 33 to determine processing to be performed.

[0128] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 52 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0129] After that, when the control unit 38 detects that the foot switch 92 is pressed, the control unit 38 stops the movement of the microscope unit 7. 54 When the foot switch 92 is released, the movement of the microscope section 7 stops immediately.

[0130] The above-mentioned modification receives the voice input from the microphone 91, and performs processing based on the recognition result. After that, the modification maintains the processing based on the recognition result, and stops the processing when the pressing of the foot switch 92 is detected. According to the modification, the processing performed in the time period between starting the voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0131] (Sixth Embodiment)

[0132] Now refer to Fig. 9 A sixth embodiment is described. Fig. 9 1 is a timing chart showing an example of a driving process performed by using a medical observation system according to a sixth embodiment. The configuration of the medical observation system according to the sixth embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0133] The sixth embodiment allows driving-related voice recognition processing when the word or word sequence (i.e., a combination of multiple words) indicated by the recognized voice matches a preset word or word sequence. More specifically, unlike the first to fourth embodiments described earlier in which the voice recognition processing is started based on pressing the foot switch 92, the sixth embodiment is capable of performing recognition processing on the input voice after recognition based on voice input. In this case, words such as "ON" or "Start" can be used as words that allow voice recognition, and word sequences such as "Enable voice recognition" can be used as word sequences that allow voice recognition. It should be noted that it is assumed that the words include, for example, postpositioned particles and auxiliary verbs. The word or word sequence used to indicate that the voice recognition processing is allowed corresponds to the first recognition information. The sixth embodiment is described below using the input "ON" as an example.

[0134] When at time T 61 When “ON” is input to the microphone 91 , the control section 38 allows the voice recognition section 32 to perform recognition processing and allows the recognition information processing section 33 to perform processing.

[0135] After this, when at time T 62 When "right" is input to microphone 91, until time T 63 Within the time period, the control section 38 causes the speech recognition section 32 to perform recognition processing and causes the recognition information processing section 33 to determine processing to be performed.

[0136] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 63 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0137] After that, upon detecting that at time T 64 When the foot switch 92 is pressed, the control unit 38 stops the movement of the microscope unit 7. In the sixth embodiment, the movement of the microscope unit 7 is stopped immediately after the pressing of the foot switch 92 is detected.

[0138] The sixth embodiment described above receives a voice input from the microphone 91 and performs processing based on the recognition result. After that, the sixth embodiment maintains the processing based on the recognition result, and stops the processing when the foot switch 92 is detected to be pressed. According to the sixth embodiment, the processing performed in the time period between starting voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0139] (Variation of Sixth Embodiment)

[0140] Now refer to Fig.10 A modification of the sixth embodiment is described. Fig.10 : is a timing chart showing an example of a driving process performed by using a medical observation system according to a modification of the sixth embodiment. As in the case of the sixth embodiment, this modification allows recognition processing of input voice based on a preset word or an input sentence.

[0141] When at time T 61 When “ON” is input to the microphone 91 , the control section 38 allows the voice recognition section 32 to perform recognition processing and allows the recognition information processing section 33 to perform processing.

[0142] After this, when at time T 62 When "right" is input to microphone 91, until time T 63 Within the time period, the control section 38 causes the speech recognition section 32 to perform recognition processing and causes the recognition information processing section 33 to determine processing to be performed.

[0143] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 63Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0144] After this, when at time T 64 When the control section 38 detects that the foot switch 92 is pressed, it stops the movement of the microscope section 7 .

[0145] At time T after the driving is stopped by the foot switch 92 65 When "OFF" is input to the microphone 91, the control unit 38 prohibits the voice recognition unit 32 from performing subsequent recognition processing. This disables the recognition result specified by the voice input. Alternatively, for example, "Terminate" or "Disable voice recognition" can be set. The word or word sequence that specifies the prohibition of voice recognition processing corresponds to the second recognition information. During the time period during which the voice recognition processing is prohibited, only the recognition of the word or word sequence that enables voice recognition and the execution of processing based on such recognition are enabled (voice recognition enablement setting).

[0146] The above-mentioned modification receives the voice input from the microphone 91, and performs processing based on the recognition result. After that, the modification maintains the processing based on the recognition result, and stops the processing when the pressing of the foot switch 92 is detected. According to the modification, the processing performed in the time period between starting the voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0147] (Seventh Embodiment)

[0148] Now refer to Fig.11 A seventh embodiment is described. Fig.11 1 is a timing chart showing an example of a drive process performed by using the medical observation system according to the seventh embodiment. The configuration of the medical observation system according to the seventh embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0149] As in the case of the sixth embodiment, the seventh embodiment allows the voice recognition processing related to driving based on a preset word or word sequence. Further, when a preset time period has passed after starting to allow the voice recognition processing or stopping driving the microscope section 7, the control section 38 prohibits the voice recognition processing again.

[0150] It should be noted that the seventh embodiment stops the movement of the microscope section 7 when a preset time period has passed after the start of movement. The seventh embodiment prohibits the voice recognition processing again when a preset time period has passed after permission or when a preset time period has passed after stopping the driving of the microscope section 7.

[0151] When at time T 71 When “ON” is input to the microphone 91 , the control section 38 allows the voice recognition section 32 to perform recognition processing and allows the recognition information processing section 33 to perform processing.

[0152] After this, when at time T 72 When "right" is input to microphone 91, until time T 73 Within the time period, the control section 38 causes the speech recognition section 32 to perform recognition processing and causes the recognition information processing section 33 to determine processing to be performed.

[0153] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 73 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0154] After this, at time T 73 After a preset time period, the time T is reached 74 , the control unit 38 stops the movement of the microscope unit 7 and prohibits the voice recognition unit 32 from performing subsequent recognition processing. In the seventh embodiment, the signal indicating the elapsed time corresponds to the second operation signal.

[0155] The seventh embodiment described above receives the voice input from the microphone 91 and performs processing based on the recognition result. After that, the seventh embodiment maintains the processing based on the recognition result, and stops the processing when a preset time period has passed. According to the seventh embodiment, the processing performed in the time period between starting voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and easily stop the processing.

[0156] It should be noted that the control unit 38 in the seventh embodiment may 74 After the movement of the microscope unit 7 is stopped, the voice input is prohibited.

[0157] (Eighth Embodiment)

[0158] Now refer to Fig.12 An eighth embodiment is described. Fig.12 1 is a timing chart showing an example of a drive process performed by using the medical observation system according to the eighth embodiment. The configuration of the medical observation system according to the eighth embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0159] As in the case of the sixth embodiment, the eighth embodiment allows the voice recognition processing related to the driving based on the preset word or word sequence. Further, as in the case of the seventh embodiment, when a preset time period has passed after starting to allow the voice recognition processing or stopping the driving of the microscope section 7, the control section 38 prohibits the voice recognition processing again.

[0160] When at time T 81 When “ON” is input to the microphone 91 , the control section 38 allows the voice recognition section 32 to perform recognition processing and allows the recognition information processing section 33 to perform processing.

[0161] After this, when at time T 82 When "right" is input to microphone 91, until time T 84 In the time period of T, the control unit 38 causes the speech recognition unit 32 to perform recognition processing and causes the recognition information processing unit 33 to determine the processing to be performed. In this case, setting is made to prohibit 84 Early time T 83 Even within the time period set as the prohibition period, the control unit allows the recognition information processing unit 33 to continue the processing as long as the relevant voice input starts within the time period allowed for the voice recognition processing.

[0162] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 84 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0163] After this, when at time T 85When it is detected that the foot switch 92 is pressed, the control section 38 stops the movement of the microscope section 7. As described above, the eighth embodiment continues the stop processing based on the input from the foot switch 92 even during the time period during which the voice recognition processing is prohibited. Enabling the instruction to stop the drive during the time period during which the voice recognition processing is prohibited is particularly useful in emergency situations such as when a malfunction occurs or the microscope section 7 is about to come into contact with other equipment or a patient. It should be noted that the drive of the microscope section 7 can be stopped when a preset time period has passed after the start of the drive. Further, at time T 83 Thereafter, the driving of the microscope section 7 may be stopped.

[0164] The eighth embodiment described above receives a voice input from the microphone 91 and performs processing based on the recognition result. After that, the eighth embodiment maintains the processing based on the recognition result, and stops the processing when the foot switch 92 is detected to be pressed. According to the eighth embodiment, the processing performed in the time period between starting voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to driving based on voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0165] (Variation of the Eighth Embodiment)

[0166] Now refer to Fig.13 A modification of the eighth embodiment is described. Fig.13 1 is a timing diagram showing an example of a drive process performed by using a medical observation system according to a modification of the eighth embodiment. As in the case of the eighth embodiment, this modification continues to process the voice input during the time period during which the voice recognition process is allowed. Further, this modification stops the movement of the microscope section 7 according to the voice recognition.

[0167] When at time T 81 When “ON” is input to the microphone 91 , the control section 38 allows the voice recognition section 32 to perform recognition processing and allows the recognition information processing section 33 to perform processing.

[0168] After this, when at time T 82 When "right" is input to microphone 91, until time T 84 In the time period of T, the control unit 38 causes the speech recognition unit 32 to perform recognition processing and causes the recognition information processing unit 33 to determine the processing to be performed. 84 Early time T 83 In the case of the voice recognition processing being performed, the control unit 38 allows the recognition information processing unit 33 to continue the processing even during the time period during which the voice recognition processing is prohibited.

[0169] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 84 Then, a control signal is output to each section to drive each joint section as necessary to move the microscope section 7 to the right.

[0170] After this, when at time T 86 When "stop" is recognized, the control unit 38 stops the movement of the microscope unit 7. As described above, even in the time period during which the voice recognition processing is prohibited, this modification continues to perform recognition processing on the voice command related to the processing during the driving period. In this modification, both the first operation signal and the second operation signal are used as signals generated when the voice is input and based on the same operation.

[0171] Enabling the instruction for the process during driving during the time period during which the voice recognition process is disabled is particularly useful in an emergency situation such as when a malfunction is caused by a voice recognition error or when the microscope section 7 is about to come into contact with other equipment or a patient. It should be noted that the driving of the microscope section 7 may be stopped when a preset time period has passed after the start of the driving. Further, at time T 83 Thereafter, the driving of the microscope section 7 may be stopped.

[0172] The above-mentioned modification receives the voice input from the microphone 91, and performs processing based on the recognition result. Herein, the modification maintains the processing based on the recognition result, and stops the processing when the stop instruction of the voice recognition is detected. According to the modification, the processing performed in the time period between starting the voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope section 7 and the support section 6). This makes it possible to complete the processing from voice recognition to the driving based on the voice recognition in a short period of time with a simple configuration, and to easily stop the processing.

[0173] (Ninth Embodiment)

[0174] Now refer to Fig.14 A ninth embodiment is described. Fig.14 1 is a timing chart showing an example of a drive process performed by using the medical observation system according to the ninth embodiment. The configuration of the medical observation system according to the ninth embodiment is the same as the configuration of the medical observation system 1 according to the first embodiment described earlier, and a repeated description is omitted. The difference from the process of the first embodiment is described below.

[0175] In the ninth embodiment, as in the case of the fifth embodiment, the voice input reception is always allowed. Further, the control section 38 controls the start and stop of the driving of the microscope section 7 according to the voice recognition.

[0176] When at time T 91 When "right" is input to microphone 91, until time T 92 During the time period, the control section 38 causes the speech recognition section 32 to perform recognition processing and causes the recognition information processing section 33 to determine processing to be performed.

[0177] The identification information processing section 33 determines the processing to be executed. In this case, when the determined processing is for moving the microscope section 7 to the right, the control section 38 performs the following operation at time T. 92 Then, a control signal is output to each section to drive each joint section as required to move the microscope section 7 to the right. In this case, the control section 38 moves the microscope section 7 at a constant speed. The constant speed is set in a similar manner to the third embodiment that has been described earlier.

[0178] After this, when at time T 93 When “stop” is recognized, the control section 38 stops the movement of the microscope section 7 .

[0179] The ninth embodiment described above receives the voice input from the microphone 91 and performs processing based on the recognition result. After that, the ninth embodiment maintains the processing based on the recognition result, and stops the processing when the stop instruction of the voice recognition is detected. According to the ninth embodiment, the processing performed in the time period between starting the voice recognition and stopping the processing is uniformly controlled in the control device 3 (which controls the microscope part 7 and the support part 6). This makes it possible to complete the processing from voice recognition to the driving based on voice recognition in a short period of time with a simple configuration, and easily stop the processing.

[0180] Although the embodiment for practicing the present invention has been described, the present invention is not limited to the foregoing embodiment. For example, it is sufficient that the support portion 6 instead includes at least one set of two arm portions and one joint portion adapted to pivotally couple one arm portion to the other arm portion.

[0181] It should be noted that the first to fourth embodiments have been described with reference to an example in which the processing performed during the time period between the start of voice recognition and the stop of driving is controlled by operating the foot switch 92. However, an alternative configuration may be adopted to use, for example, a manually operated switch instead of a foot operated switch. Further, the foot switch 92 may also be replaced by, for example, a pressure sensor or an acceleration sensor.

[0182] Further, the first to fourth embodiments have been described with reference to an example in which the input value input by pressing the foot switch 92 is less than the initial value. However, an alternative configuration may be adopted so that the input value depending on the pressing amount is greater than the initial value. Another alternative configuration may be adopted so that the foot switch 92 outputs a digital value (such as a binary or ternary value) instead of an analog value.

[0183] Further, the first to fourth embodiments may alternatively be configured such that the control section 38 keeps the microphone 91 turned on during the time period between the start of speech recognition and the stop of driving, and keeps the microphone 91 turned off during other time periods. This prevents input of speech during time periods other than the speech recognition time period. Another alternative is to increase the input volume of the microphone 91 during the speech recognition time period, and to lower the input volume of the microphone 91 or mute the microphone 91 (silent) during time periods other than the speech recognition time period.

[0184] Further, the first to fourth embodiments have been described with reference to an example in which the microphone 91 and the foot switch 92 are wiredly connected to the control device 3. However, an alternative configuration may be adopted so that the microphone 91 and the foot switch 92 are wirelessly connected to the control device 3. It should be noted that the observation device 2 and the control device 3 may be connected either wirelessly or by wire.

[0185] Further, the first to fourth embodiments have been described with reference to an example in which one set of microphones 91 and foot switches 92 are included. However, a plurality of sets of microphones 91 and foot switches 92 may be included. For example, an alternative is to provide a first set for surgeons, a second set for assistant surgeons, and a third set for nurses, and define the priority of each operation input.

[0186] Further, the first to fourth embodiments may alternatively be configured such that when an utterance is recognized, the control device 3 emits light or voice from the output section 36 to notify the user that the utterance is recognized. It should also be noted that the display device 4 may display a message indicating utterance recognition.

[0187] Further, an alternative configuration may be employed such that the medical observation device is suspended from the ceiling of the room in which the medical observation device is installed.

[0188] Further, the first to fourth embodiments have been described with reference to the example in which the control device 3 is arranged separately from the observation device 2 . However, the control device 3 may be built in the base portion 5 .

[0189] Further, the first to fourth embodiments have been described with reference to the example in which the support portion 6 holds the microscope portion 7. However, instead of the microscope portion 7, the support portion 6 may hold a member configured to be able to capture an image. For example, the front end of the support portion 6 may also be adapted to hold a rigid endoscope or a flexible endoscope. In the case where the support portion 6 holds an endoscope, the base portion 5 and the support portion 6 serve as an endoscope holder.

[0190] As described above, the present invention can include, for example, various embodiments without departing from the technical concept described in the appended claims.

[0191] [Industrial Applicability]

[0192] As described above, the control device and the medical observation system according to the present disclosure are useful in adopting a simple configuration, completing the process from voice recognition to driving based on voice recognition in a short period of time, and easily stopping driving.

[0193] [reference numerals list]

[0194] 1: Medical observation system

[0195] 2: Medical observation device

[0196] 3: Control device

[0197] 4: Display device

[0198] 5: Base

[0199] 6: Support Department

[0200] 7: Microscope Department

[0201] 8: Light source equipment

[0202] 11: First joint

[0203] 12: Second joint

[0204] 13: The third joint

[0205] 14: Fourth joint

[0206] 15: Fifth joint

[0207] 16: Sixth joint

[0208] 21: First arm

[0209] 22: Second arm

[0210] 23: Third arm

[0211] 24: Fourth arm

[0212] 25: Fifth arm

[0213] 31: Image processing unit

[0214] 32: Speech Recognition Department

[0215] 33: Identification information processing unit

[0216] 34: Input

[0217] 35: Foot switch input receiving unit

[0218] 36: Output

[0219] 37: Storage

[0220] 38: Control Department

[0221] 91: Microphone

[0222] 92: Foot switch.

Claims

1. A control device for electrically controlling a medical observation device for capturing an observation object, the control device comprising: A speech recognition unit for recognizing speech input from the outside; a recognition information processing unit that determines a process to be performed by the medical observation device based on the recognition result of the voice recognition unit; a switch input receiving unit that receives an input of an operation signal based on an operation performed on the switch; as well as a control section which, when detecting a first operation signal received by the switch input receiving section or when acquiring information related to a process determined by the identification information processing section, causes the speech recognition section to start speech recognition processing and causes the medical observation device to execute the process determined by the identification information processing section, and when detecting a second operation signal, stops the process to be executed by the medical observation device, wherein the control unit changes the driving speed of the medical observation device according to the operation signal received by the switch input receiving unit in the process determined by the identification information processing unit, The switch input receiving unit receives an input value based on an operation performed on the switch as the operation signal, and upon detecting a first change in the input value received by the switch input receiving section, the control section causes the voice recognition section to start voice recognition processing and causes the medical observation device to execute processing determined by the recognition information processing section, and upon detecting a second change in the input value, the control section stops processing to be executed by the medical observation device, When the input value changes to the initial value of the switch, the control unit stops the processing to be performed by the medical observation device, wherein, within a preset time period after the processing to be performed by the medical observation device is stopped due to the input value changing to the initial value, when the input value changes from the initial value, the control unit causes the medical observation device to perform processing opposite to the previous processing performed before the stop.

2. The control device according to claim 1, in, The first operation signal and the second operation signal serve as different operation signals and correspond to different operations performed on the switch.

3. The control device according to claim 1, in, The first operation signal and the second operation signal serve as the same operation signal and correspond to similar operations performed on the switch.

4. The control device according to claim 1, in, When the input value is changed from an initial value of the switch to a value other than the initial value, the control section starts the voice recognition process and causes the medical observation apparatus to execute a process.

5. The control device according to claim 1, in, When the input value changes from the initial value of the switch to a value other than the initial value, the control section starts the voice recognition process and causes the medical observation device to execute a process, and The control section stops processing to be performed by the medical observation apparatus when the input value is changed again from the initial value to a value other than the initial value.

6. The control device according to claim 1, in, The switch input receiving unit receives an input of an operation signal output when the switch is pressed. When the switch is continuously pressed, the control unit causes the medical observation device to continuously execute the processing determined by the identification information processing unit, and When the switch is released, the control unit causes the medical observation apparatus to stop a process determined by the identification information processing unit.

7. The control device according to claim 1, in, When the speech recognition result of the speech recognition unit is consistent with the first recognition information, the control unit starts a subsequent speech recognition process, and When the speech recognition result of the speech recognition unit is consistent with the second recognition information, the control unit disables subsequent speech recognition processing.

8. The control device according to claim 1, in, When the speech recognition result of the speech recognition unit is consistent with the first recognition information, the control unit starts a subsequent speech recognition process, and The control section disables the speech recognition results other than the first recognition information after a preset period of time has passed since the speech recognition process of the speech recognition section was enabled.

9. The control device according to claim 1, in, The recognition information processing section determines a direction in which the medical observation device moves an imaging region based on a recognition result of the voice recognition section, and The control unit causes the medical observation device to move the imaging region based on the movement direction determined by the identification information processing unit.

10. The control device according to claim 1, in, The recognition information processing unit determines the imaging magnification of the medical observation device based on the recognition result of the voice recognition unit, and The control section changes the imaging magnification of the medical observation device based on the magnification determined by the identification information processing section.

11. A medical observation system, comprising: An imaging unit capable of capturing a magnified image of an observation target; a supporting portion including a plurality of arm portions and a plurality of joint portions connecting the plurality of arm portions, and supporting the imaging portion at a front end of the supporting portion; A control device according to claim 1.

Images