Insertion state detection system, insertion state detection method, and program
The endoscope apparatus uses dual sensors to correct for gripping section rotation and non-uniform subjects, ensuring precise rotation detection and enhanced insertion operation efficiency.
Patent Information
- Application Number
- JP2022102793
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-27
- Publication Date
- 2025-12-04
- Estimated Expiration
- 2042-06-27
AI Technical Summary
Existing endoscope technologies fail to accurately detect the amount of rotation of the insertion section due to the influence of gripping section rotation and sensor installation challenges, particularly in non-uniform subject shapes.
An endoscope apparatus with a first sensor on the insertion unit and a second sensor on a fixed unit, calculating a corrected rotation amount by considering the relative movement and attitude of the insertion section, and recording insertion state information for accurate rotation detection.
Accurately detects the rotation and movement of the insertion section, improving insertion operations and examination efficiency by providing real-time operation assistance.
Smart Images

Figure 0007780396000001 
Figure 0007780396000002 
Figure 0007780396000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an insertion state detection system, an insertion state detection method, and a program. [Background technology]
[0002] Industrial endoscope devices are used to inspect the interior of boilers, pipes, aircraft engines, and the like for abnormalities and corrosion. The endoscope device has an insertion section for acquiring images. A user inserts the insertion section into a subject to acquire images of the inspection site within the subject. The user observes the images and inspects the inspection site. If an abnormality is found in the inspection site, the user measures the size of the abnormality.
[0003] The user performs an insertion operation to insert the insertion portion into the subject. The insertion operation includes an operation to push or pull the insertion portion, an operation to rotate the insertion portion, an operation to adjust the attitude of the insertion portion, and an operation to bend the tip of the insertion portion. These operations are combined depending on the internal structure of the subject.
[0004] The user observes the images acquired by the insertion section and performs the insertion operation. If the user is not skilled, the tip of the insertion section may come into contact with the wall inside the subject, preventing the insertion section from advancing. Alternatively, the insertion section may have a tendency to bend in a certain direction. Therefore, even if a user with low skill pushes the insertion section into the subject, the tip may bend, preventing the insertion section from advancing.
[0005] To solve the above problem, the technology disclosed in Patent Document 1 provides a navigation function that outputs insertion assistance information according to the state of the insertion section. This technology uses a sensor that detects the amount of rotation of the insertion section relative to the grip section, a sensor that detects the positional relationship between the insertion section and the subject, and a sensor that detects the curvature of the insertion section. This positional relationship indicates the length of the insertion section inserted into the subject, the amount of rotation of the insertion section relative to the subject, and the orientation of the insertion section relative to the subject. This technology processes the information detected by these sensors and generates insertion assistance information.
[0006] By referring to the insertion assistance information provided by the navigation function, even less skilled users can perform the operations necessary to insert the insertion section into the subject, thereby improving work efficiency and examination quality.
[0007] In addition, by using the information detected by each sensor, the following effects are expected: In an examination using an endoscopic device, the examination results are recorded. The examination results include still images of the examination site and measurement results. In addition, the examination results and the status of the insertion unit are associated with each other, and the examination results and the status of the insertion unit are recorded. By referring to the examination results and the status of the insertion unit, the user can confirm that the examination was performed according to the examination plan. In addition, the next time an examination is performed, the user can easily find the examination site of interest. [Prior art documents] [Patent documents]
[0008] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-113352 Summary of the Invention [Problem to be solved by the invention]
[0009] The gripping section in the technology disclosed in Patent Document 1 has a sensor that detects the amount of rotation of the insertion section relative to the gripping section. However, the influence of rotation of the gripping section due to operations performed by the user is not taken into consideration. When the gripping section itself rotates, the amount of rotation detected by the sensor does not accurately indicate the amount of rotation of the insertion section.
[0010] On the other hand, in the technology disclosed in Patent Document 1, an insertion section is inserted into a subject through an opening formed in the subject, and a sensor that detects the positional relationship between the insertion section and the subject is placed in the opening. Because the sensor itself does not move, the amount of rotation detected by the sensor indicates the accurate amount of rotation of the insertion section. Objects to be inspected by industrial endoscope devices include engines, water pipes, and piping within plants, and there are a wide variety of objects to be inspected. Therefore, the shape of the subject near the opening through which the insertion section is inserted is not necessarily uniform, which poses a problem of making it difficult to install the sensor.
[0011] An object of the present invention is to provide an insertion state detection system, an insertion state detection method, and a program that can accurately detect the amount of rotation of an insertion portion. [Means for solving the problem]
[0012] The present invention provides an endoscope apparatus comprising: a sensor unit having a first sensor that detects a first amount of rotation indicating an amount of rotation of an elongated insertion unit around a central axis of the insertion unit when the insertion unit is inserted into a subject, and having a hole through which the insertion unit passes; a second sensor that is disposed on the sensor unit or an object fixed to the sensor unit and that detects a second amount of rotation indicating an amount of rotation of the sensor unit around the central axis when the insertion unit is inserted into the subject; and a control unit; the insertion section is movable relative to the sensor section, The control unit is an insertion state detection system that acquires the first rotation amount and the second rotation amount, and calculates a corrected rotation amount by correcting the first rotation amount based on the second rotation amount.
[0013] In the insertion state detection system of the present invention, the first sensor further detects a movement amount indicating an amount by which the insertion portion moves in the longitudinal direction of the insertion portion when the insertion portion is inserted into the subject.
[0014] In the insertion state detection system of the present invention, the control unit further records insertion state information including the mutually associated correction rotation amount and movement amount on a recording medium.
[0015] In the insertion state detection system of the present invention, the control unit further records insertion state information including the second rotation amount and the movement amount that are associated with each other on a recording medium.
[0016] In the insertion state detection system of the present invention, the second sensor further detects the attitude of the sensor unit, and the insertion state information further includes attitude information that is associated with the amount of movement and indicates the attitude.
[0017] In the insertion state detection system of the present invention, the insertion section has a third sensor arranged at a tip portion including the tip of the insertion section and detecting the attitude of the tip portion, and the insertion state information further includes attitude information associated with the amount of movement and indicating the attitude.
[0018] In the insertion state detection system of the present invention, the tip portion including the tip of the insertion section can be bent inside the subject based on a bending instruction input through operation of the operation section, and the insertion state information further includes a bending amount that is associated with the movement amount and indicates the amount by which the tip portion is bent.
[0019] In the insertion state detection system of the present invention, the control unit further generates operation information indicating the operation required to insert the insertion portion into the subject by using the correction rotation amount calculated in real time and the correction rotation amount included in the insertion state information recorded on the recording medium.
[0020] In the insertion state detection system of the present invention, the control unit calculates the difference between the correction rotation amount calculated in real time and the correction rotation amount included in the insertion state information recorded on the recording medium, and generates the operation information by using the difference.
[0021] In the insertion state detection system of the present invention, the insertion section has a third sensor arranged at a tip portion including the tip of the insertion section and detecting a third amount of rotation indicating the amount of rotation of the insertion section around the central axis of the insertion section, and the control section further resets the relative amount of rotation of the insertion section with respect to the sensor section by using the second amount of rotation and the third amount of rotation.
[0022] In the insertion state detection system of the present invention, the tip portion including the tip of the insertion portion can be bent inside the subject based on a bending instruction input through operation of an operation unit, and the second sensor is arranged in the operation unit.
[0023] In the insertion state detection system of the present invention, the operation unit is detachable from the sensor unit, and when the operation unit is attached to the sensor unit, the second sensor detects the second amount of rotation.
[0024] In the insertion state detection system of the present invention, the control unit calculates the correction rotation amount by performing addition or subtraction using the first rotation amount and the second rotation amount.
[0025] The present invention provides a method for detecting a rotation amount of an elongated insertion section of an endoscope apparatus, the method comprising: acquiring a first rotation amount indicating a rotation amount of the insertion section around a central axis of the insertion section when the insertion section is inserted into a subject; and detecting the first rotation amount by a first sensor disposed in a sensor section having a hole through which the insertion section passes. The insertion section is movable relative to the sensor section.a step in which the control unit acquires a second rotation amount indicating the rotation amount of the sensor unit around the central axis when the insertion unit is inserted into the subject, the second rotation amount being detected by a second sensor disposed on the sensor unit or an object fixed to the sensor unit; and a step in which the control unit calculates a corrected rotation amount by correcting the first rotation amount based on the second rotation amount.
[0026] The present invention provides an endoscope system for detecting a rotation amount of an elongated insertion section of an endoscope apparatus around a central axis of the insertion section when the insertion section is inserted into a subject, the first rotation amount being detected by a first sensor disposed in a sensor section having a hole through which the insertion section passes. The insertion section is movable relative to the sensor section. a step of acquiring a second rotation amount indicating the rotation amount of the sensor unit around the central axis when the insertion portion is inserted into the subject, the second rotation amount being detected by a second sensor disposed on the sensor unit or an object fixed to the sensor unit; and a step of calculating a corrected rotation amount by correcting the first rotation amount based on the second rotation amount. [Effects of the Invention]
[0027] According to the present invention, the insertion state detection system, the insertion state detection method, and the program can accurately detect the amount of rotation of the insertion portion. [Brief explanation of the drawings]
[0028] [Figure 1] 1 is a perspective view showing the overall configuration of an endoscope apparatus according to a first embodiment of the present invention. [Figure 2] 3A and 3B are diagrams illustrating a state of a sensor unit in the first embodiment of the present invention. [Figure 3] 3A and 3B are diagrams illustrating a state of a sensor unit in the first embodiment of the present invention. [Figure 4] 1 is a block diagram showing the internal configuration of an endoscope apparatus according to a first embodiment of the present invention. [Figure 5] 1 is a cross-sectional view showing the configuration of a sensor unit in a first embodiment of the present invention. [Figure 6] FIG. 1 is a diagram illustrating a configuration of an optical sensor according to a first embodiment of the present invention. [Figure 7] 1 is a cross-sectional view showing the configuration of a sensor unit in a first embodiment of the present invention. [Figure 8] 1 is a cross-sectional view showing the configuration of an operation unit and a sensor unit in a first embodiment of the present invention. [Figure 9] 5 is a graph showing an example of changes in state of the insertion section and the sensor section in the first embodiment of the present invention. [Figure 10] 1 is a flowchart showing the overall procedure of an insertion operation in the first embodiment of the present invention. [Figure 11] 5 is a flowchart showing the procedure of a state recording process in the first embodiment of the present invention. [Figure 12] 3 is a cross-sectional view showing the positional relationship between an insertion section and a sensor section in the first embodiment of the present invention. FIG. [Figure 13] 2 is a cross-sectional view showing the positional relationship between a subject and an insertion section in the first embodiment of the present invention. FIG. [Figure 14] 5 is a flowchart showing the procedure of a history recording process in the first embodiment of the present invention. [Figure 15] 5 is a graph showing an example of changes in state of the insertion section and the sensor section in the first embodiment of the present invention. [Figure 16] 5 is a flowchart showing the procedure of a device setting process according to the first embodiment of the present invention. [Figure 17] FIG. 3 is a diagram showing information displayed on a display unit in the first embodiment of the present invention. [Figure 18] 5 is a flowchart showing the procedure of an insertion support process in the first embodiment of the present invention. [Figure 19] FIG. 3 is a diagram showing information displayed on a display unit in the first embodiment of the present invention. [Figure 20]10 is a flowchart showing the procedure of a state recording process in the second embodiment of the present invention. [Figure 21] FIG. 10 is a cross-sectional view showing the positional relationship between an insertion section and a sensor section in a second embodiment of the present invention. [Figure 22] FIG. 10 is a cross-sectional view showing the positional relationship between an insertion section and a sensor section in a second embodiment of the present invention. [Figure 23] 10 is a flowchart showing the procedure of a device setting process in the second embodiment of the present invention. [Figure 24] FIG. 10 is a diagram showing information displayed on a display unit in a second embodiment of the present invention. [Figure 25] FIG. 10 is a diagram showing information displayed on a display unit in a second embodiment of the present invention. [Figure 26] FIG. 10 is a cross-sectional view showing the configuration of an operation unit and a sensor unit according to a third embodiment of the present invention. [Figure 27] FIG. 10 is a cross-sectional view showing the configuration of an operation unit and a sensor unit in a fourth embodiment of the present invention. [Figure 28] FIG. 10 is a block diagram showing the internal configuration of an endoscope apparatus according to a fifth embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0029] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0030] (First embodiment) 1 shows the appearance of an endoscope device 1 (insertion state detection system) according to a first embodiment of the present invention. The endoscope device 1 shown in FIG. 1 includes an insertion section 2, a main body section 3, an operation section 4, a display section 5, and a sensor section 6.
[0031] The insertion portion 2 is inserted into the inside of the subject. The user (examiner) performs an insertion operation and inserts the insertion portion 2 into the subject. The insertion portion 2 is a long, thin tube. The insertion portion 2 has a tip portion 2a. The tip portion 2a has an imaging portion 20 and a bending portion 21. The imaging portion 20 includes the tip of the insertion portion 2 and is formed of a hard material. An optical adapter 7 is attached to the imaging portion 20. The bending portion 21 is arranged on the base end side of the imaging portion 20. The bending portion 21 can be bent in a predetermined direction. The insertion portion 2 converts an optical image of the subject into an imaging signal and outputs the imaging signal to the main body portion 3.
[0032] The main body 3 is a control device that includes a storage section for storing the insertion section 2. The operation section 4 accepts user operations on the endoscope device 1. The display section 5 has a display screen, and displays an image of the subject acquired by the insertion section 2 on the display screen.
[0033] The operation unit 4 is a user interface (input device). For example, the operation unit 4 is at least one of a button, a switch, a key, a mouse, a joystick, a touchpad, a trackball, and a touch panel. The user bends the bending portion 21 by performing a bending operation using the operation unit 4. Alternatively, the user controls the state of lighting by operating the operation unit 4. Furthermore, the user inputs information for setting the state of the endoscope device 1 into the endoscope device 1 by operating the operation unit 4. The input device having the operation unit 4 may be connected to the main body 3 by wire or wirelessly.
[0034] The display unit 5 is a monitor (display) such as an LCD (Liquid Crystal Display). The display unit 5 may be a touch panel. In this case, the operation unit 4 and the display unit 5 are integrated. The user touches the screen of the display unit 5 using a part of their body (for example, a finger) or a tool. The display unit 5 may be connected to the main body 3 by wire or wirelessly. An information terminal such as a tablet, smartphone, or personal computer may be used as a terminal including the operation unit 4 and the display unit 5.
[0035] A cylindrical hole through which the insertion portion 2 passes is formed in the sensor unit 6. The insertion portion 2 is movable within the sensor unit 6. The sensor unit 6 detects an insertion length that indicates the length of the portion of the insertion portion 2 inserted into the space inside the subject. The insertion length corresponds to the position of the imaging unit 20. The sensor unit 6 also detects the amount of rotation of the insertion portion 2 around the central axis of the insertion portion 2.
[0036] The user performs bending and insertion operations while viewing the image displayed on the display unit 5. When the insertion unit 2 is inserted into the subject, the endoscope device 1 assists the insertion operation. The user finds the examination site and positions the imaging unit 20 so that the examination site is captured in an appropriate state in the image. The user then performs an examination of the subject. For example, the user determines the degree of deterioration of the subject during the examination.
[0037] 2 and 3 show the state of the sensor unit 6 during an examination. Fig. 2 shows a first example, and Fig. 3 shows a second example. The user U1 inserts the insertion unit 2 into the subject SB1.
[0038] 2, the user U1 holds the sensor unit 6 in his left hand and the insertion unit 2 in his right hand. The user U1 may also hold the sensor unit 6 in his right hand and the insertion unit 2 in his left hand. Because the sensor unit 6 is not fixed to the subject SB1, the sensor unit 6 can be placed in any position, not limited to the vicinity of the subject SB1.
[0039] In the second example shown in FIG. 3, the operation unit 4 and the sensor unit 6 are integrated. The user U1 holds either or both of the operation unit 4 and the sensor unit 6 in the left hand, and holds the insertion unit 2 in the right hand. The user U1 may also hold either or both of the operation unit 4 and the sensor unit 6 in the right hand, and hold the insertion unit 2 in the left hand. The user U1 can operate the operation unit 4 and hold the sensor unit 6 simultaneously.
[0040] When the shape of the object to be inspected is known in advance, such as when the object is an aircraft engine, the sensor unit 6 may be configured to be fixed to the surface of the object to be inspected. An auxiliary part may be used to fix the sensor unit 6. For example, the auxiliary part may be fixed to the surface of the object to be inspected, and the sensor unit 6 may be fixed to the auxiliary part.
[0041] 4 shows the internal configuration of the endoscope device 1. The imaging unit 20 of the insertion portion 2 has a lens 22, an imaging element 23, and a posture sensor 24.
[0042] The main body 3 has an image processing unit 30, a recording unit 31, an external IF (interface) 32, an operation processing unit 33, a state detection unit 34, an attitude detection unit 35, a light source 36, an illumination control unit 37, a motor 38, a bending control unit 39, an information processing unit 40, a memory 41, an insertion support unit 42, and a power supply unit 43.
[0043] The optical adapter 7 has a lens 70. Light incident on the lens 70 passes through the lens 70 and enters the lens 22. The lenses 70 and 22 constitute an observation optical system. Light incident on the lens 22 passes through the lens 22 and enters the image sensor 23. The image sensor 23 is an image sensor such as a CCD sensor or a CMOS sensor. The image sensor 23 has an image surface 23a onto which the light that has passed through the lens 22 is incident. The image sensor 23 converts the light that has entered the image surface 23a into an image signal.
[0044] The imaging signal generated by the imaging element 23 includes an image of the subject. Therefore, the imaging element 23 acquires an optical image of the subject and generates an image of the subject. The image generated by the imaging element 23 is output to the main body 3.
[0045] The attitude sensor 24 has at least one of a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor. The attitude sensor 24 detects a value related to the attitude of the imaging unit 20 and outputs the detected value to the main body 3. The value indicates at least one of acceleration, angular velocity, and geomagnetism.
[0046] The attitude sensor 24 may include only one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. The attitude sensor 24 may include two or three of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. For example, the attitude sensor 24 may include an acceleration sensor and a gyro sensor. Alternatively, the attitude sensor 24 may include an acceleration sensor, a gyro sensor, and a geomagnetic sensor. The attitude sensor 24 may not be necessary.
[0047] The image processing unit 30 processes the image signal output from the imaging element 23 to process the image of the subject. For example, the image processing unit 30 performs processes such as noise removal, brightness adjustment, and color adjustment to improve image quality. The image processing unit 30 may perform self-localization estimation such as Simultaneous Localization and Mapping (SLAM) to calculate the position and orientation of the imaging unit 20. Furthermore, the image processing unit 30 superimposes insertion assistance information generated by the insertion assistance unit 42 on the image of the subject.
[0048] The image processed by the image processing unit 30 is output to the display unit 5 or the recording unit 31. The display unit 5 displays the image processed by the image processing unit 30. The recording unit 31 has a recording medium and records the image processed by the image processing unit 30 on the recording medium.
[0049] The external IF 32 is connected to an external PC 8. The external PC 8 is a general-purpose personal computer. An information terminal such as a tablet or a smartphone may be used instead of the external PC 8. The external IF 32 may be connected to a server on a network (cloud). The external IF 32 may be connected to a recording medium such as a memory card.
[0050] The operation processing unit 33 is connected to the operation unit 4. The operation unit 4 outputs information according to the operation performed by the user. The operation processing unit 33 sets the state of the endoscope device 1 to a state according to the information output from the operation unit 4.
[0051] The sensor unit 6 is a housing that houses an optical sensor 60 and a posture sensor 61. The optical sensor 60 detects a value related to the amount of movement of the insertion unit 2 in the longitudinal direction of the insertion unit 2. As a result, the optical sensor 60 detects a value related to the insertion length of the insertion unit 2. The optical sensor 60 also detects a value related to the amount of rotation of the insertion unit 2 around the central axis of the insertion unit 2. The optical sensor 60 can detect a value related to the amount of movement and the amount of rotation of the insertion unit 2 without coming into contact with the insertion unit 2.
[0052] The attitude sensor 61 detects a value related to the amount of rotation of the sensor unit 6 around the central axis of the insertion unit 2. The attitude sensor 61 also detects a value related to the attitude of the sensor unit 6. The sensor unit 6 outputs the detected value to the state detection unit 34. Details of the sensor unit 6 will be described later.
[0053] The state detection unit 34 calculates the insertion length and rotation amount of the insertion unit 2 based on the values output from the sensor unit 6. The state detection unit 34 also calculates the attitude of the sensor unit 6 based on the values output from the sensor unit 6, and generates attitude information indicating the attitude. Because the insertion unit 2 passes through a hole formed in the sensor unit 6, the attitude information of the sensor unit 6 indicates the attitude of the insertion unit 2 at the hole. For example, the attitude information indicates the angle of the central axis of the insertion unit 2.
[0054] The attitude detection unit 35 detects the attitude of the image capture unit 20 based on the value output from the attitude sensor 24, and generates attitude information indicating the attitude.
[0055] The light source 36 is a light emitting diode (LED) or the like, and generates illumination light. The illumination light is guided to the imaging unit 20 via a light guide 25 disposed in the insertion unit 2. The illumination light is irradiated onto the subject from the imaging unit 20. The illumination control unit 37 controls the light source 36 based on information output from the operation unit 4, thereby turning the illumination on or off and setting the illumination intensity.
[0056] The motor 38 is connected to the plurality of angle wires 26. The plurality of angle wires 26 are arranged in the insertion section 2 and connected to the bending section 21. The motor 38 bends the bending section 21 by pulling the plurality of angle wires 26. The bending control section 39 controls the angle of the bending section 21 by controlling the motor 38 based on information output from the operation section 4. In other words, the bending control section 39 controls the attitude of the imaging section 20.
[0057] The information processing unit 40 processes the information generated by the state detection unit 34. Specifically, the information processing unit 40 correlates the insertion length of the insertion unit 2, the rotation amount of the insertion unit 2, and the posture information of the sensor unit 6 to generate insertion state information. The insertion state information may include posture information of the imaging unit 20. The insertion state information may include a bending amount indicating the amount by which the bending portion 21 is bent. The information processing unit 40 records the insertion state information in the memory 41.
[0058] The memory 41 stores insertion status information including the insertion length, the rotation amount, and the posture information. The memory 41 is a non-volatile recording medium. For example, the memory 41 is at least one of a static random access memory (SRAM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), and a flash memory.
[0059] The insertion support unit 42 generates insertion support information. The insertion support information includes information for supporting the insertion operation. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. As a result, the insertion support unit 42 displays the insertion support information on the display unit 5.
[0060] The power supply unit 43 supplies driving power to each unit of the endoscope device 1.
[0061] At least one of the image processing unit 30, the operation processing unit 33, the state detection unit 34, the posture detection unit 35, the illumination control unit 37, the bending control unit 39, the information processing unit 40, and the insertion support unit 42 may be configured with at least one of a processor and a logic circuit. For example, the processor is at least one of a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit). For example, the logic circuit is at least one of an ASIC (Application Specific Integrated Circuit) and an FPGA (Field-Programmable Gate Array). The image processing unit 30, etc. may include one or more processors. The image processing unit 30, etc. may include one or more logic circuits.
[0062] The computer of the endoscope device 1 may load and execute a program. The program includes instructions that define the operation of the image processing unit 30, etc. In other words, the functions of the image processing unit 30, etc. may be realized by software.
[0063] The above program may be provided by a "computer-readable recording medium" such as a flash memory. The program may be transmitted from a computer storing the program to the endoscope device 1 via a transmission medium or by transmission waves in the transmission medium. A "transmission medium" that transmits the program is a medium that has the function of transmitting information. Media that have the function of transmitting information include networks (communication networks) such as the Internet and communication lines (communication lines) such as telephone lines. The above program may realize some of the functions described above. Furthermore, the above program may be a difference file (difference program). The functions described above may be realized by combining a program already recorded on a computer with a difference program.
[0064] 5 shows the configuration of the sensor unit 6. FIG. 5 shows a cross section of the sensor unit 6. FIG. 5 corresponds to the first example shown in FIG.
[0065] The sensor unit 6 has an optical sensor 60 and an attitude sensor 61. The optical sensor 60 and the attitude sensor 61 are disposed inside the sensor unit 6 and fixed to the sensor unit 6.
[0066] A hole H1 through which the insertion portion 2 passes is formed in the sensor unit 6. In the hole H1, the insertion portion 2 can move in a direction parallel to the central axis CA1 of the insertion portion 2. In other words, the insertion portion 2 can move in the longitudinal direction D1 of the insertion portion 2 in the hole H1.
[0067] Furthermore, the insertion portion 2 can rotate around the central axis CA1 in the hole H1. For example, when the sensor unit 6 rotates around the central axis CA1, the insertion portion 2 rotates together with the sensor unit 6. When the sensor unit 6 rotates, the insertion portion 2 may be fixed to the sensor unit 6. The sensor unit 6 may have a mechanism for fixing the insertion portion 2 to the sensor unit 6 when the sensor unit 6 rotates. The insertion portion 2 may rotate without rotating the sensor unit 6. The sensor unit 6 may rotate without rotating the insertion portion 2. In this case, the endoscope device 1 can detect that the insertion portion 2 is not rotating.
[0068] The inner diameter of the hole H1 is approximately the same as the outer diameter of the insertion section 2. For example, the central axis of the hole H1 coincides with the central axis CA1 of the insertion section 2. The inner diameter of the hole H1 may be larger than the outer diameter of the insertion section 2. It is preferable that the inner diameter of the hole H1 is close to the outer diameter of the insertion section 2 so that the optical sensor 60 and the posture sensor 61 can each accurately detect values related to the state of the insertion section 2.
[0069] The optical sensor 60 detects a value related to the amount of movement of the insertion portion 2 in the longitudinal direction D1. As a result, the optical sensor 60 detects a value related to the insertion length of the insertion portion 2. The optical sensor 60 also detects a value related to the amount of rotation of the insertion portion 2 around the central axis CA1. The amount of rotation corresponds to the amount of rotation of the insertion portion 2 relative to the sensor unit 6.
[0070] The attitude sensor 61 detects a value related to the amount of rotation of the sensor unit 6 around the central axis CA1. When the central axis of the hole H1 coincides with the central axis CA1 of the insertion unit 2, the attitude sensor 61 detects a value related to the amount of rotation of the sensor unit 6 around the central axis CA1 by detecting a value related to the amount of rotation of the sensor unit 6 around the central axis of the hole H1. The attitude sensor 61 also detects a value related to the attitude of the sensor unit 6. Because the insertion unit 2 is inserted into the hole H1, the value related to the attitude of the sensor unit 6 indicates the attitude of the insertion unit 2 in the hole H1.
[0071] 6 shows the configuration of the optical sensor 60. The optical sensor 60 has a light-emitting device 60a and a light-receiving device 60b. The light-emitting device 60a irradiates light onto the insertion portion 2. The light reflected by the surface of the insertion portion 2 is incident on the light-receiving device 60b.
[0072] The light receiving device 60b has a plurality of light receiving elements arranged two-dimensionally. A large number of metal wires are woven on the surface of the insertion section 2. The surface of the insertion section 2 has a pattern formed by the metal wires. The light receiving device 60b generates a signal according to the amount of light, thereby detecting the pattern on the surface of the insertion section 2 as an image. The optical sensor 60 outputs a signal indicating the image.
[0073] The state detection unit 34 calculates a temporal change in the signal output from the optical sensor 60. As a result, the state detection unit 34 calculates a first movement amount of the insertion unit 2 in the longitudinal direction D1, and calculates a second movement amount of the insertion unit 2 in a direction D2 perpendicular to the longitudinal direction D1. The first movement amount and the second movement amount indicate the relative movement amount of the insertion unit 2 with respect to the sensor unit 6. The first movement amount corresponds to the insertion length of the insertion unit 2. The second movement amount corresponds to the rotation amount of the insertion unit 2 around the central axis CA1.
[0074] Like the attitude sensor 24, the attitude sensor 61 has at least one of a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor. If the attitude sensor 61 has an acceleration sensor, the attitude sensor 61 can detect a physical quantity based on the direction of gravity. If the attitude sensor 61 has a geomagnetic sensor, the attitude sensor 61 can detect a physical quantity based on the direction of geomagnetism. If the attitude sensor 61 has a three-axis acceleration sensor and a three-axis gyro sensor, the state detection unit 34 can accurately calculate the amount of rotation in the three axial directions, i.e., roll, pitch, and yaw.
[0075] The sensor unit 6 may have a locking mechanism for fixing the insertion unit 2 to the sensor unit 6. The locking mechanism may be switchable between a state in which the insertion unit 2 is fixed to the sensor unit 6 and a state in which the insertion unit 2 is movable in the longitudinal direction D1. By twisting the sensor unit 6 in a state in which the insertion unit 2 is fixed to the sensor unit 6, the user can reduce the amount of force required to twist the insertion unit 2.
[0076] A sensor unit 6a shown in Fig. 7 may be used in place of the sensor unit 6. Fig. 7 shows the configuration of the sensor unit 6a. Fig. 7 shows a cross section of the sensor unit 6a.
[0077] The sensor unit 6a has a main body 62, a screw portion 63, and a screw portion 64. The main body 62 has an optical sensor 60 and a posture sensor 61. The screw portion 63 and the screw portion 64 are connected to the main body 62. Male threads are formed on the surfaces of the screw portion 63 and the screw portion 64. A hole H2 through which the insertion portion 2 passes is formed in the main body 62, the screw portion 63, and the screw portion 64.
[0078] The insertion section 2 is inserted into the subject SB2. An access port AP1 is formed in the subject SB2. A female thread is formed in the access port AP1. The male thread of the screw section 64 fits into the female thread of the access port AP1, and the sensor section 6a is fixed to the subject SB2.
[0079] The operation unit 4 may be fixed to the sensor unit 6. Fig. 8 shows a state in which the operation unit 4 is fixed to the sensor unit 6. Fig. 8 shows cross sections of the operation unit 4 and the sensor unit 6. Fig. 8 corresponds to the second example shown in Fig. 3.
[0080] The operation unit 4 has a joystick 45 and a circuit board 46. The joystick 45 accepts a bending operation to bend the bending portion 21. The user operates the joystick 45 to input a bending instruction to bend the bending portion 21. The circuit board 46 accepts the bending instruction input through the bending operation and outputs the bending instruction to the operation processing unit 33. The operation processing unit 33 outputs the bending instruction to the bending control unit 39. The bending control unit 39 controls the motor 38 based on the bending instruction to bend the bending portion 21. The bending control unit 39 detects the amount of bending of the bending portion 21.
[0081] The user inserts the insertion portion 2 into the subject SB1. The user can perform a bending operation and an insertion operation at the same time. The operation portion 4 may be detachable from the sensor portion 6.
[0082] A hole through which the insertion portion 2 passes may be formed in the operation portion 4. The operation portion 4 may be fixed to the sensor portion 6, and the insertion portion 2 may pass through the inside of the operation portion 4 and the sensor portion 6.
[0083] An example of state changes in the insertion unit 2 and the sensor unit 6 will be described using Figure 9. Figure 9 shows an example of state changes in the insertion unit 2 and the sensor unit 6. Figure 9 shows graphs of rotation amount G1, rotation amount G2, rotation amount G3, and attitude G4. The horizontal axis of each graph represents time, and the vertical axis of each graph represents the rotation amount or attitude.
[0084] The rotation amount G1 indicates the absolute rotation amount of the insertion portion 2. The rotation amount G2 indicates the rotation amount of the insertion portion 2 calculated based on the signal output from the optical sensor 60. The rotation amount G2 indicates the relative rotation amount of the insertion portion 2 with respect to the sensor unit 6. The rotation amount G3 indicates the rotation amount of the sensor unit 6 calculated based on the value detected by the posture sensor 61.
[0085] The orientation G4 indicates the orientation of the sensor unit 6 calculated based on the value detected by the orientation sensor 61. The orientation of the sensor unit 6 is the same as the orientation of the insertion unit 2 in the hole H1 through which the insertion unit 2 passes. For example, the orientation G4 indicates the angle of the central axis CA1 of the insertion unit 2 with respect to the horizontal plane. The orientation G4 may also indicate the angle of the central axis CA1 of the insertion unit 2 with respect to the direction of gravity.
[0086] The insertion section 2 rotates, and the amount of rotation G1 gradually increases. Before time T1, the amount of rotation G2 increases in the same manner as the amount of rotation G1. Before time T1, the amount of rotation G3 is 0. In other words, the sensor section 6 does not rotate. Before time T1, the sensor section 6 does not rotate, and only the insertion section 2 rotates.
[0087] After time T1, the user rotates the insertion section 2 and the sensor section 6 together in the same direction. Therefore, the rotation amount G2 remains constant, and the rotation amount G3 increases. At this time, the rotation amount G3 indicates the rotation amount of the insertion section 2 and the sensor section 6.
[0088] Since the rotation amount G2 indicates the relative rotation amount of the insertion unit 2 with respect to the sensor unit 6, the rotation amount G2 after time T1 is different from the absolute rotation amount G1 of the insertion unit 2. The information processing unit 40 calculates the rotation amount G1 by correcting the rotation amount G2 based on the rotation amount G3. Specifically, the information processing unit 40 adds the rotation amount G3 to the rotation amount G2.
[0089] In order to properly insert the insertion portion 2 into the subject, the user may adjust the angle of the insertion portion 2 relative to the hole (access port) in the subject. By making such an adjustment, the user can set the direction of the imaging unit 20 inserted into the subject to the intended direction. Orientation G4 indicates the orientation of the insertion portion 2 outside the subject.
[0090] The information processing unit 40 calculates a correction rotation amount by using the first rotation amount and the second rotation amount. The first rotation amount indicates the relative rotation amount of the insertion unit 2 with respect to the sensor unit 6. In the example shown in FIG. 9, the first rotation amount corresponds to the rotation amount G2. The second rotation amount indicates the rotation amount of the sensor unit 6. In the example shown in FIG. 9, the second rotation amount corresponds to the rotation amount G3. The correction rotation amount indicates the absolute rotation amount of the insertion unit 2.
[0091] For example, when the direction of rotation of the sensor unit 6 detected by the posture sensor 61 (first direction) is the same as the direction of rotation of the insertion unit 2 detected by the optical sensor 60 (second direction), the information processing unit 40 calculates the correction amount of rotation by adding the second amount of rotation to the first amount of rotation. When the first direction is opposite to the second direction, the information processing unit 40 calculates the correction amount of rotation by subtracting the second amount of rotation from the first amount of rotation.
[0092] If the first direction is opposite to the second direction and the second rotation amount is the same as the first rotation amount, the correction rotation amount is 0. In this case, the insertion section 2 does not rotate, and only the sensor section 6 rotates.
[0093] When the second rotation amount is 0, the sensor unit 6 is not rotated. In this case, the information processing unit 40 acquires the first rotation amount as the correct rotation amount of the insertion unit 2.
[0094] Each of the first rotation amount and the second rotation amount may have a sign corresponding to the direction of rotation. The sign is a positive sign (+ sign) or a negative sign (- sign). If the second direction is the same as the first direction, the sign of the second rotation amount is the same as the sign of the first rotation amount. If the second direction is opposite to the first direction, the sign of the second rotation amount is different from the sign of the first rotation amount. If each of the first rotation amount and the second rotation amount has a sign, the information processing unit 40 may calculate the corrected rotation amount by adding the second rotation amount to the first rotation amount.
[0095] As described above, when the sensor unit 6 rotates, the information processing unit 40 corrects the amount of rotation of the insertion unit 2 by using the amount of rotation of the sensor unit 6. The information processing unit 40 can calculate the accurate amount of rotation of the insertion unit 2.
[0096] The process for the insert operation will be explained using Figures 10 to 19. Figure 10 shows the overall procedure for the insert operation.
[0097] An expert who is skilled in the inspection performs the inspection, and then an unskilled person who is not skilled in the inspection performs the inspection. While the expert is performing the inspection, the status of the insertion operation performed by the expert is recorded. Insertion support information is generated using this status. The unskilled person performs the insertion operation by referring to the insertion support information and imitating the insertion operation of the expert. By the unskilled person imitating the insertion operation of the expert, the efficiency of the inspection is improved.
[0098] First, the skilled person performs device setting (operation O1). At this time, the skilled person sets the positional relationship between the insertion portion 2 and the sensor unit 6 to an initial state, and also sets the positional relationship between the subject and the insertion portion 2 to an initial state. The endoscope device 1 executes a state recording process and records the states of the insertion portion 2 and the sensor unit 6 in the initial state (step S1).
[0099] After the device settings are performed, the skilled person performs the insertion operation and performs the examination (operation O2). The endoscope device 1 executes a history recording process and records the states of the insertion section 2 and the sensor unit 6 during the insertion operation (step S2).
[0100] The unskilled person performs the work after a certain period of time has passed since the skilled person completed the work, which may be several days, weeks, or months.
[0101] First, the unskilled person performs equipment setting (operation O3). At this time, the unskilled person sets the positional relationship between the insertion portion 2 and the sensor unit 6 to an initial state, and sets the positional relationship between the subject and the insertion portion 2 to an initial state. The endoscope device 1 executes equipment setting processing. At this time, the endoscope device 1 supports the operation of the unskilled person to set the state of the equipment to the initial state (step S3).
[0102] After the device settings are performed, the unskilled person performs the insertion operation and performs the examination (operation O4). The endoscope device 1 executes the insertion support process to support the unskilled person's insertion operation (step S4).
[0103] For example, the endoscope device 1 has a first mode for learning the operation of an expert and a second mode for assisting an unexperienced person in the insertion operation. The endoscope device 1 can switch between the first mode and the second mode by using, for example, a processor.
[0104] 11 shows the procedure of the status recording process (step S1) executed by the endoscope device 1 when an expert performs device setting (operation O1). When the first mode is set in the endoscope device 1, the endoscope device 1 executes the status recording process.
[0105] The skilled worker aligns the position of the insertion section 2 with the position of the sensor section 6. FIG. 12 shows the positional relationship between the insertion section 2 and the sensor section 6 at this time. FIG. 12 shows a cross section of the sensor section 6. For example, the skilled worker aligns the distal end surface SF1 of the insertion section 2 with the end surface SF2 of the sensor section 6. At this time, the skilled worker operates the operation section 4 to input an origin setting command to the endoscope device 1.
[0106] The operation processing unit 33 outputs an origin setting instruction to the state detection unit 34. The state detection unit 34 receives the origin setting instruction (step S100).
[0107] After step S100, the state detection unit 34 resets the insertion length calculated based on the value output from the optical sensor 60 to 0 (step S101). After the insertion length is reset to 0, the newly calculated insertion length indicates the movement amount of the insertion unit 2 in the longitudinal direction D1 of the insertion unit 2 after step S101.
[0108] The skilled person inserts the insertion portion 2 into the subject and sets the relative state of the insertion portion 2 with respect to the subject to an initial state. Figure 13 shows the positional relationship between the subject SB1 and the insertion portion 2 at this time. Figure 13 shows cross sections of the subject SB1 and the sensor unit 6.
[0109] The skilled person adjusts the position of the insertion portion 2 so that the image sensor 23 can acquire an image of the site SP1 inside the subject SB1. The skilled person also adjusts the posture of the insertion portion 2 so that the insertion portion 2 can move forward smoothly.
[0110] While the skilled person is performing the above adjustment, the state detection unit 34 acquires values detected by the optical sensor 60 and the posture sensor 61. The state detection unit 34 calculates the insertion length of the insertion unit 2. The state detection unit 34 also calculates the posture of the sensor unit 6 and generates posture information of the sensor unit 6.
[0111] After the state of the insertion portion 2 is set to the desired state, the skilled person operates the operation portion 4 to input a setting end instruction to the endoscope device 1. The operation processing portion 33 outputs the setting end instruction to the information processing portion 40. The information processing portion 40 accepts the setting end instruction (step S102).
[0112] After step S102, the information processing unit 40 acquires the image processed by the image processing unit 30, and records the image in the memory 41 as a reference image (step S103).
[0113] After step S103, the information processing unit 40 acquires the insertion length of the insertion unit 2 and the posture information of the sensor unit 6 from the state detection unit 34 (step S104). For example, when the state of the insertion unit 2 is set to the state shown in Fig. 13, the insertion length of the insertion unit 2 is L0, and the value indicating the posture (tilt) of the sensor unit 6 is S0.
[0114] After step S104, the information processing unit 40 records the insertion length of the insertion unit 2 and the posture information of the sensor unit 6 in the memory 41 (step S105).
[0115] To start an examination, the skilled person operates the operation unit 4 to input an examination start instruction to the endoscope device 1. The operation processing unit 33 outputs the examination start instruction to the state detection unit 34, the attitude detection unit 35, and the information processing unit 40. The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 accept the examination start instruction (step S106). When the examination start instruction is accepted, the state recording process shown in FIG. 11 ends.
[0116] The insertion length is calculated based on the value output from the optical sensor 60. If the distance between the sensor unit 6 and the subject changes, the change in distance may be erroneously detected as the movement amount of the insertion section 2, and the insertion length may contain an error. After the insertion length is reset in step S101, it is preferable that the distance between the sensor unit 6 and the subject be kept constant. Therefore, the sensor unit 6 may have a distance sensor that measures the distance between the sensor unit 6 and the subject. The state detection unit 34 may output distance information indicating the distance to the display unit 5 via the image processing unit 30. The skilled person may refer to the distance information displayed on the display unit 5 to keep the distance between the sensor unit 6 and the subject constant.
[0117] FIG. 14 shows the procedure of the history recording process (step S2) executed by the endoscope device 1 when an expert performs an examination (operation O2).
[0118] The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 reset various values (step S200). The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 execute the following processes in step S200.
[0119] The state detection unit 34 resets the insertion length calculated based on the value output from the optical sensor 60 to 0. The state detection unit 34 resets the attitude calculated based on the value output from the attitude sensor 61 to 0. The attitude detection unit 35 resets the attitude calculated based on the value output from the attitude sensor 24 to 0.
[0120] After the insertion length is reset to 0, the newly calculated insertion length indicates the amount of movement of the insertion unit 2 in the longitudinal direction D1 of the insertion unit 2 after step S200. After the attitude of the sensor unit 6 is reset to 0, the newly calculated attitude indicates the amount of change in the attitude of the sensor unit 6 after step S200. After the attitude of the imaging unit 20 is reset to 0, the newly calculated attitude indicates the amount of change in the attitude of the imaging unit 20 after step S200.
[0121] The information processing unit 40 acquires the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6 from the state detection unit 34. The information processing unit 40 calculates a correction amount of rotation by using the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6. The correction amount of rotation indicates the absolute amount of rotation of the insertion unit 2. The information processing unit 40 converts the calculated correction amount of rotation to 0, thereby resetting the correction amount of rotation to 0. The information processing unit 40 holds the conversion formula used for this conversion.
[0122] The skilled person performs an insertion operation and advances the insertion portion 2 inside the subject. The state detection unit 34 acquires values detected by each of the optical sensor 60 and the attitude sensor 61. The state detection unit 34 calculates the insertion length of the insertion portion 2, the amount of rotation of the insertion portion 2, and the amount of rotation of the sensor unit 6. The state detection unit 34 calculates the attitude of the sensor unit 6 and generates attitude information about the sensor unit 6. The attitude detection unit 35 acquires values detected by the attitude sensor 24. The attitude detection unit 35 calculates the attitude of the imaging unit 20 and generates attitude information about the imaging unit 20.
[0123] After step S200, the information processing unit 40 acquires the insertion length of the insertion unit 2, the rotation amount of the insertion unit 2, the rotation amount of the sensor unit 6, and the attitude information of the sensor unit 6 from the state detection unit 34 (step S201).
[0124] After step S201, the information processing unit 40 calculates the amount of correction rotation by using the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6. The information processing unit 40 converts the amount of correction rotation into a new value by using the conversion formula used in step S200 (step S202). The new value indicates the change in the amount of correction rotation after step S200 and is used as the amount of correction rotation in the processing after step S202.
[0125] After step S202, the information processing unit 40 records the insertion length of the insertion unit 2, the amount of corrected rotation, and the posture information of the sensor unit 6 as insertion state information in the memory 41 (step S203). The insertion length of the insertion unit 2, the amount of corrected rotation, and the posture information of the sensor unit 6 are associated with time information.
[0126] After step S203, the information processing unit 40 acquires the bending amount of the bending portion 21 from the bending control unit 39 (step S204). For example, the bending amount indicates the bending amount in the upward direction (U) or downward direction (D), and also indicates the bending amount in the leftward direction (L) or rightward direction (R).
[0127] After step S204, the information processing unit 40 records the bending amount of the bending portion 21 in the memory 41 (step S205). The bending amount is included in the insertion state information and is associated with the time information.
[0128] After step S205, the information processing unit 40 acquires the attitude information of the image capturing unit 20 from the attitude detection unit 35 (step S206).
[0129] After step S206, the information processing unit 40 records the attitude information of the imaging unit 20 in the memory 41 (step S207). The attitude information is included in the insertion state information and is associated with time information.
[0130] When the examination is completed, the skilled person operates the operation unit 4 to input an examination end instruction to the endoscope device 1. The operation processing unit 33 outputs the examination end instruction to the state detection unit 34, the attitude detection unit 35, and the information processing unit 40. The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 accept the examination end instruction (step S208).
[0131] When the instruction to end the examination is accepted, the history recording process shown in Fig. 14 is completed. Steps S201 to S207 are repeated until the instruction to end the examination is accepted.
[0132] Steps S202 and S203 may be executed at any timing between steps S201 and S208. Steps S204 and S205 may be executed at any timing between steps S200 and S208. Steps S206 and S207 may be executed at any timing between steps S200 and S208.
[0133] An example of state changes in the insertion section 2 and the sensor section 6 will be described using Figure 15. Figure 15 shows an example of state changes in the insertion section 2 and the sensor section 6. Figure 15 shows graphs of the corrected rotation amount G5, attitude G6, bending amount G7, and attitude G8. The horizontal axis of each graph indicates the insertion length, and the vertical axis of each graph indicates the rotation amount, etc.
[0134] The corrected rotation amount G5 indicates a corrected rotation amount calculated using the rotation amount of the insertion portion 2 and the rotation amount of the sensor unit 6. The orientation G6 indicates the orientation of the sensor unit 6 calculated based on the value detected by the orientation sensor 61. The orientation of the sensor unit 6 is the same as the orientation of the insertion portion 2 in the hole H1 through which the insertion portion 2 passes. For example, the orientation G6 indicates the angle of the central axis CA1 of the insertion portion 2 with respect to the horizontal plane. The orientation G6 may also indicate the angle of the central axis CA1 of the insertion portion 2 with respect to the direction of gravity. For example, the bending amount G7 indicates the bending amount of the bending portion 21 in each of the upward (U) and downward (D) directions. The orientation G8 indicates the orientation of the imaging unit 20 calculated based on the value detected by the orientation sensor 24.
[0135] The insertion length, the corrective rotation amount G5, the attitude G6, the bending amount G7, and the attitude G8 are associated with one another by the same time information. Therefore, the information processing unit 40 can convert the corrective rotation amount G5, the attitude G6, the bending amount G7, and the attitude G8 into values corresponding to the insertion length. The insertion state information recorded in the memory 41 includes the rotation amount of the insertion section 2, the rotation amount of the sensor unit 6, the corrective rotation amount, attitude information of the sensor unit 6, the bending amount of the bending section 21, and attitude information of the imaging unit 20. These are associated with the insertion length.
[0136] 16 shows the procedure of the device setting process (step S3) executed by the endoscope device 1 when a non-expert performs device setting (operation O3). When the second mode is set in the endoscope device 1, the endoscope device 1 executes the device setting process.
[0137] The unskilled person aligns the position of the insertion portion 2 with the position of the sensor unit 6. At this time, the work performed by the unskilled person is the same as the work performed by the skilled person ( FIG. 12 ). For example, the unskilled person aligns the distal end surface of the insertion portion 2 with the end surface of the sensor unit 6. At this time, the unskilled person operates the operation unit 4 to input an origin setting command to the endoscope device 1.
[0138] The operation processing unit 33 outputs an origin setting instruction to the state detection unit 34. The state detection unit 34 receives the origin setting instruction (step S300).
[0139] After step S300, the state detection unit 34 resets the insertion length calculated based on the value output from the optical sensor 60 to 0 (step S301). After the insertion length is reset to 0, the newly calculated insertion length indicates the movement amount of the insertion unit 2 in the longitudinal direction D1 of the insertion unit 2 after step S301.
[0140] The unskilled person inserts the insertion portion 2 into the subject and sets the relative state of the insertion portion 2 with respect to the subject to an initial state. At this time, the unskilled person performs the work so as to achieve the same state as the initial state set by the expert. The endoscope device 1 executes a process to support the work of the unskilled person. The details of this process will be described below.
[0141] The unskilled person operates the operation unit 4 to input a setting execution instruction to the endoscope device 1. The operation processing unit 33 outputs the setting execution instruction to the insertion support unit 42. The insertion support unit 42 accepts the setting execution instruction (step S302).
[0142] The insertion support unit 42 acquires the reference image recorded in the memory 41 in step S103, and outputs the reference image to the display unit 5 via the image processing unit 30. The display unit 5 displays the reference image (step S303).
[0143] The state detection unit 34 acquires values detected by the optical sensor 60 and the attitude sensor 61. The state detection unit 34 calculates the insertion length of the insertion unit 2. The state detection unit 34 also calculates the attitude of the sensor unit 6 and generates attitude information of the sensor unit 6.
[0144] After step S303, the insertion support unit 42 acquires the insertion length of the insertion unit 2 and the posture information of the sensor unit 6 from the state detection unit 34 (step S304).
[0145] After step S304, the insertion support unit 42 acquires the information recorded in the memory 41 in step S105. That is, the insertion support unit 42 acquires the insertion length (L0) of the insertion unit 2 and the posture information (S0) of the sensor unit 6. The insertion support unit 42 generates insertion support information by using the information acquired from the memory 41 and the information acquired from the state detection unit 34 in step S304. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information related to the insertion length and posture information (step S305).
[0146] 17 shows information displayed on the display unit 5. The display unit 5 displays a live image IMG10, a reference image IMG11, insertion support information AI10, and a button B10.
[0147] The live image IMG10 is a current image generated in real time by the image sensor 23. The reference image IMG11 is obtained from the memory 41 in step S303.
[0148] The insertion assistance information AI10 includes insertion length information L10. The insertion length information L10 indicates the difference between the previous insertion length (L0) and the current insertion length. The previous insertion length (L0) is obtained from the memory 41 in step S305. The current insertion length is obtained from the status detection unit 34 in step S304. The insertion length information L10 is displayed as a line having a length corresponding to the magnitude of the difference. The insertion length information L10 is displayed on the right or left side of the axis AX10 depending on the relationship between the previous insertion length (L0) and the current insertion length.
[0149] The insertion assistance information AI10 includes posture information S10. The posture information S10 indicates the difference between a past value (S0) of the posture information of the sensor unit 6 and the current value of the posture information of the sensor unit 6. The past value (S0) of the posture information is acquired from the memory 41 in step S305. The current value of the posture information is acquired from the state detection unit 34 in step S304. The posture information S10 is displayed as a line having a length according to the magnitude of the difference. The posture information S10 is displayed to the right or left of the axis AX10 depending on the relationship in magnitude between the past value (S0) of the posture information and the current value of the posture information. The posture information S10 indicates the posture of the insertion unit 2 in the hole H1 through which the insertion unit 2 passes.
[0150] The non-expert compares the live image IMG10 with the reference image IMG11. The non-expert adjusts the amount of rotation of the insertion portion 2 so that the composition of the live image IMG10 matches the composition of the reference image IMG11. The non-expert also refers to the insertion support information AI10. The non-expert adjusts the position of the insertion portion 2 so that the difference corresponding to the insertion length information L10 matches 0. The non-expert adjusts the attitude of the insertion portion 2 so that the difference corresponding to the attitude information S10 matches 0. While the non-expert adjusts the amount of rotation, position, and attitude of the insertion portion 2, the insertion length information L10 and attitude information S10 are updated according to the operation performed by the non-expert.
[0151] When the above adjustments are completed, in order to start the examination, the non-skilled person operates the operation unit 4 to input an examination start command to the endoscope device 1. For example, the non-skilled person presses button B10 by operating the operation unit 4. This allows the non-skilled person to input an examination start command to the endoscope device 1.
[0152] The operation processing unit 33 outputs an examination start instruction to the state detection unit 34, the attitude detection unit 35, and the insertion support unit 42. The state detection unit 34, the attitude detection unit 35, and the insertion support unit 42 receive the examination start instruction (step S306). When the examination start instruction is received, the device setting process shown in Fig. 16 ends. Steps S304 and S305 are repeated until the examination start instruction is received.
[0153] The insertion support unit 42 may determine whether the current insertion length matches the previous insertion length (L0) and whether the current value of the posture information matches the previous value (S0) of the posture information. When the insertion support unit 42 determines that the current insertion length matches the previous insertion length (L0) and the current value of the posture information matches the previous value (S0) of the posture information, the insertion support unit 42 may automatically accept an examination start instruction and output the examination start instruction to the state detection unit 34 and the posture detection unit 35.
[0154] FIG. 18 shows the procedure of the insertion support process (step S4) that the endoscope device 1 executes when an unskilled person performs an examination (operation O4).
[0155] The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 reset various values (step S400). The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 execute the following processes in step S400.
[0156] The state detection unit 34 resets the insertion length calculated based on the value output from the optical sensor 60 to 0. The state detection unit 34 resets the attitude calculated based on the value output from the attitude sensor 61 to 0. The attitude detection unit 35 resets the attitude calculated based on the value output from the attitude sensor 24 to 0.
[0157] After the insertion length is reset to 0, the newly calculated insertion length indicates the amount of movement of the insertion unit 2 in the longitudinal direction D1 of the insertion unit 2 after step S400. After the attitude of the sensor unit 6 is reset to 0, the newly calculated attitude indicates the amount of change in the attitude of the sensor unit 6 after step S400. After the attitude of the imaging unit 20 is reset to 0, the newly calculated attitude indicates the amount of change in the attitude of the imaging unit 20 after step S400.
[0158] The information processing unit 40 acquires the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6 from the state detection unit 34. The information processing unit 40 calculates a correction amount of rotation by using the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6. The correction amount of rotation indicates the absolute amount of rotation of the insertion unit 2. The information processing unit 40 converts the calculated correction amount of rotation to 0, thereby resetting the correction amount of rotation to 0. The information processing unit 40 holds the conversion formula used for this conversion.
[0159] The non-skilled person performs the insertion operation and advances the insertion portion 2 inside the subject. The state detection unit 34 acquires values detected by each of the optical sensor 60 and the attitude sensor 61. The state detection unit 34 calculates the insertion length of the insertion portion 2, the amount of rotation of the insertion portion 2, and the amount of rotation of the sensor unit 6. The state detection unit 34 calculates the attitude of the sensor unit 6 and generates attitude information about the sensor unit 6. The attitude detection unit 35 acquires values detected by the attitude sensor 24. The attitude detection unit 35 calculates the attitude of the imaging unit 20 and generates attitude information about the imaging unit 20.
[0160] After step S400, the insertion support unit 42 acquires the insertion length of the insertion unit 2, the rotation amount of the insertion unit 2, the rotation amount of the sensor unit 6, and the attitude information of the sensor unit 6 from the state detection unit 34 (step S401).
[0161] After step S401, the information processing unit 40 acquires the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6 from the state detection unit 34. The information processing unit 40 calculates the amount of correction rotation by using the amount of rotation of the insertion unit 2 and the amount of rotation of the sensor unit 6. The information processing unit 40 converts the amount of correction rotation into a new value by using the conversion formula used in step S400 (step S402). The new value indicates the change in the amount of correction rotation after step S400 and is used as the amount of correction rotation in the processing after step S402.
[0162] After step S402, the insertion support unit 42 outputs the insertion length acquired from the state detection unit 34 in step S401 to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion length (step S403).
[0163] After step S403, the insertion support unit 42 acquires the correction rotation amount recorded in the memory 41 in step S203. At this time, the insertion support unit 42 acquires the correction rotation amount associated with the same insertion length as the insertion length acquired from the state detection unit 34 in step S401. The insertion support unit 42 acquires the correction rotation amount calculated in step S402 from the information processing unit 40. The insertion support unit 42 generates insertion support information by using the correction rotation amount acquired from the memory 41 and the correction rotation amount calculated in real time in step S402. For example, the insertion support unit 42 calculates the difference between the two correction rotation amounts. The insertion support unit 42 generates insertion support information according to the difference. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information related to the rotation amount of the insertion unit 2 (step S404).
[0164] After step S404, the insertion support unit 42 acquires the posture information of the sensor unit 6 recorded in the memory 41 in step S203. At this time, the insertion support unit 42 acquires posture information associated with the same insertion length as the insertion length acquired from the state detection unit 34 in step S401. The insertion support unit 42 generates insertion support information by using the posture information acquired from the memory 41 and the posture information acquired from the state detection unit 34 in step S401. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information related to the posture information of the sensor unit 6 (step S405).
[0165] After step S405, the insertion support unit 42 acquires the bending amount of the bending section 21 from the bending control unit 39 (step S406). For example, the bending amount indicates the bending amount in the upward direction (U) or downward direction (D), and also indicates the bending amount in the leftward direction (L) or rightward direction (R).
[0166] After step S406, the insertion support unit 42 acquires the bending amount recorded in the memory 41 in step S205. At this time, the insertion support unit 42 acquires the bending amount associated with the same insertion length as the insertion length acquired from the state detection unit 34 in step S401. The insertion support unit 42 generates insertion support information by using the bending amount acquired from the memory 41 and the bending amount acquired from the bending control unit 39 in step S406. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information related to the bending amount (step S407).
[0167] After step S407, the insertion support unit 42 acquires the attitude information of the imaging unit 20 from the attitude detection unit 35 (step S408).
[0168] After step S408, the insertion support unit 42 acquires the posture information of the imaging unit 20 recorded in the memory 41 in step S207. At this time, the insertion support unit 42 acquires posture information associated with the same insertion length as the insertion length acquired from the state detection unit 34 in step S401. The insertion support unit 42 generates the insertion support information by using the posture information acquired from the memory 41 and the posture information acquired from the posture detection unit 35 in step S408. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information related to the posture information of the imaging unit 20 (step S409).
[0169] 19 shows information displayed on the display unit 5. The display unit 5 displays a live image IMG12, an insertion length IL10, a rotation target RT10, a posture target PT10, a bending target BT10, and a posture target PT11.
[0170] The live image IMG12 is a current image generated in real time by the image sensor 23. The insertion length IL10, the rotation target RT10, the posture target PT10, the curvature target BT10, and the posture target PT11 are displayed on the live image IMG12.
[0171] The insertion length IL10 is displayed in step S403.
[0172] The rotation target RT10 indicates a target amount of rotation of the insertion unit 2. The rotation target RT10 corresponds to the insertion support information displayed in step S404. For example, the rotation target RT10 is displayed as an arrow corresponding to the difference calculated in step S404. The direction of the arrow corresponds to the positive or negative sign of the difference. The length of the arrow corresponds to the magnitude of the difference. The arrow may be displayed in a color corresponding to the magnitude of the difference. The arrow may have a thickness corresponding to the magnitude of the difference.
[0173] The method of displaying the target rotation amount of the insertion section 2 is not limited to the method shown in Fig. 19. For example, the insertion support unit 42 may display on the display unit 5 the corrected rotation amount recorded in the memory 41 in step S203 and the corrected rotation amount calculated in step S402.
[0174] The posture target PT10 indicates a target posture of the sensor unit 6. The posture of the sensor unit 6 is the same as the posture of the insertion unit 2 in the hole H1 through which the insertion unit 2 passes. The posture target PT10 corresponds to the insertion support information displayed in step S405. The posture target PT10 includes a line VL10, a line HL10, and a mark M10.
[0175] Line VL10 indicates the value of the attitude information of the sensor unit 6 in the vertical direction. Line HL10 indicates the value of the attitude information of the sensor unit 6 in the horizontal direction. The intersection of line VL10 and line HL10 indicates the value of the attitude information recorded in memory 41 in step S203. Mark M10 indicates the current value of the attitude information of the sensor unit 6. The vertical position of mark M10 corresponds to the difference between the current value of the attitude information in the vertical direction and the previous value of the attitude information in the vertical direction. The horizontal position of mark M10 corresponds to the difference between the current value of the attitude information in the horizontal direction and the previous value of the attitude information in the horizontal direction.
[0176] The method of displaying the target posture of the sensor unit 6 is not limited to the method shown in Fig. 19. For example, the insertion support unit 42 may calculate the difference between the posture information value recorded in the memory 41 in step S203 and the current posture information value. The insertion support unit 42 may display an arrow on the display unit 5 having a length corresponding to the magnitude of the difference.
[0177] The bending target BT10 indicates a target bending amount of the bending portion 21. The insertion support unit 42 refers to the bending amount (first bending amount) recorded in the memory 41 in step S205, and also refers to the bending amount (second bending amount) acquired from the bending control unit 39 in step S406. The insertion support unit 42 calculates the bending direction and bending amount required to change the bending portion 21 from a state having the second bending amount to a state having the first bending amount.
[0178] The insertion support unit 42 displays an arrow indicating the calculated bending direction and bending amount as the bending target BT10 on the display unit 5. The direction of the arrow indicates the bending direction. The length of the arrow indicates the bending amount. The arrow may be displayed in a color corresponding to the bending amount. The arrow may have a thickness corresponding to the bending amount.
[0179] The method of displaying the target bending amount of the bending section 21 is not limited to the method shown in Fig. 19. For example, the insertion support section 42 may display an arrow indicating the first bending amount and an arrow indicating the second bending amount on the display section 5.
[0180] The orientation target PT11 indicates an orientation target of the imaging unit 20. The orientation target PT11 corresponds to the insertion support information displayed in step S409. For example, the insertion support unit 42 refers to the orientation information (first orientation information) recorded in the memory 41 in step S207 and the orientation information (second orientation information) acquired from the orientation detection unit 35 in step S408. The insertion support unit 42 calculates a difference (first difference) between the vertical component of the first orientation information and the vertical component of the second orientation information. Furthermore, the insertion support unit 42 calculates a difference (second difference) between the horizontal component of the first orientation information and the horizontal component of the second orientation information.
[0181] The insertion support unit 42 displays on the display unit 5 a first arrow having a length corresponding to the first difference, and a second arrow having a length corresponding to the second difference. In the example shown in FIG. 19, the second difference is 0. Therefore, the second arrow is not displayed, and only the first arrow is displayed. The first arrow may be displayed in a color corresponding to the magnitude of the first difference, or may have a thickness corresponding to the magnitude of the first difference. The second arrow may be displayed in a color corresponding to the magnitude of the second difference, or may have a thickness corresponding to the magnitude of the second difference.
[0182] The method of displaying the posture target of the imaging unit 20 is not limited to the method shown in Fig. 19. For example, the insertion support unit 42 may use a method similar to the method of displaying the posture target PT10.
[0183] The non-expert person refers to the information shown in Fig. 19 and adjusts the amount of rotation of the insertion portion 2, etc. The non-expert person adjusts the amount of rotation of the insertion portion 2 according to the rotation target RT10. The non-expert person adjusts the posture of the sensor unit 6 according to the posture target PT10. The non-expert person adjusts the amount of bending of the bending portion 21 according to the bending target BT10.
[0184] After the amount of rotation of the insertion unit 2, the attitude of the sensor unit 6, and the amount of bending of the bending unit 21 have been adjusted, the non-skilled person checks the direction of the insertion unit 2 according to the attitude target PT11. The path taken by the insertion unit 2 may branch into two or more paths at a branching point. If the current attitude of the imaging unit 20 differs from the target attitude of the imaging unit 20, the insertion unit 2 may have been inserted into the wrong path. In this case, the non-skilled person can return the insertion unit 2 to the branching point and insert the insertion unit 2 into the correct path.
[0185] When the examination is completed, the unskilled person operates the operation unit 4 to input an examination end instruction to the endoscope device 1. The operation processing unit 33 outputs the examination end instruction to the state detection unit 34, the attitude detection unit 35, and the insertion support unit 42. The state detection unit 34, the attitude detection unit 35, and the insertion support unit 42 accept the examination end instruction (step S410).
[0186] When the instruction to end the examination is received, the insertion support process shown in Fig. 18 ends. Steps S401 to S409 are repeated until the instruction to end the examination is received.
[0187] Step S403 may be executed at any timing between step S401 and step S410. Steps S402 and S404 may be executed at any timing between step S401 and step S410. Step S405 may be executed at any timing between step S401 and step S410. Steps S406 and S407 may be executed at any timing between step S400 and step S410. Steps S408 and S409 may be executed at any timing between step S400 and step S410.
[0188] The insertion support unit 42 may display a three-dimensional model of the insertion unit 2 on the display unit 5. The insertion support unit 42 may display a target rotation amount and a target attitude of the insertion unit 2 on the three-dimensional model. This improves the visibility of information required to adjust the rotation amount and attitude of the insertion unit 2.
[0189] The bending control unit 39 may bend the bending portion 21 without relying on a bending operation performed by the user. For example, the insertion support unit 42 calculates the bending direction and bending amount required to change the bending portion 21 from a state having a second bending amount to a state having a first bending amount. The insertion support unit 42 outputs a bending instruction including the bending direction and bending amount to the bending control unit 39. The bending control unit 39 bends the bending portion 21 based on the bending instruction.
[0190] The rotation state of the insertion portion 2 during an examination performed by a non-skilled person may differ from the rotation state of the insertion portion 2 during a previous examination performed by a skilled person. In such cases, it is difficult for the non-skilled person to perform a correct bending operation. Therefore, the insertion support unit 42 may calculate a bending direction and bending amount required to bring the rotation direction of the insertion portion 2 closer to the rotation direction used in the previous examination and to bring the rotation amount of the insertion portion 2 closer to the rotation amount used in the previous examination. The insertion support unit 42 may output a bending instruction including the bending direction and bending amount to the bending control unit 39. The bending control unit 39 may bend the bending portion 21 based on the bending instruction. Since the non-skilled person does not need to consider both the rotation amount of the insertion portion 2 and the bending amount of the bending portion 21, operability is improved.
[0191] The state detection unit 34 may output the insertion length of the insertion unit 2, the rotation amount of the insertion unit 2, the rotation amount of the sensor unit 6, and attitude information of the sensor unit 6 to the external IF 32. The attitude detection unit 35 may output attitude information of the imaging unit 20 to the external IF 32. The external IF 32 may transmit this information to the external PC 8.
[0192] The external PC 8 may execute steps S105, S202, S203, S205, and S207. The external PC 8 may generate insertion support information in step S305 and transmit the generated insertion support information to the endoscope device 1. The external PC 8 may calculate the correction rotation amount in step S402. The external PC 8 may generate insertion support information in steps S404, S405, S407, and S409 and transmit the generated insertion support information to the endoscope device 1. A server or the like may be used instead of the external PC 8.
[0193] An insertion state detection system (endoscopic device 1) according to each aspect of the present invention includes a sensor unit 6, a posture sensor 61 (second sensor), an information processing unit 40 (control unit), and an insertion support unit 42 (control unit). The sensor unit 6 includes an optical sensor 60 (first sensor) that detects a first rotation amount indicating the amount of rotation of the elongated insertion unit 2 of the endoscope device 1 around a central axis CA1 of the insertion unit 2 when the insertion unit 2 is inserted into a subject. A hole H1 through which the insertion unit 2 passes is formed in the sensor unit 6. The posture sensor 61 is disposed in the sensor unit 6. The posture sensor 61 detects a second rotation amount indicating the amount of rotation of the sensor unit 6 around the central axis CA1 when the insertion unit 2 is inserted into the subject. The information processing unit 40 acquires the first rotation amount and the second rotation amount. The information processing unit 40 calculates a corrected rotation amount by correcting the first rotation amount based on the second rotation amount.
[0194] The insertion state detection method of each aspect of the present invention includes a first acquisition step, a second acquisition step, and a calculation step. In the first acquisition step (step S401), the information processing unit 40 (control unit) acquires a first amount of rotation. In the second acquisition step (step S401), the information processing unit 40 acquires a second amount of rotation. In the calculation step (step S402), the information processing unit 40 calculates a corrected amount of rotation by correcting the first amount of rotation based on the second amount of rotation.
[0195] Each aspect of the present invention may include the following modifications: The optical sensor 60 (first sensor) detects a movement amount (insertion length) indicating the amount of movement of the insertion portion 2 in the longitudinal direction D1 of the insertion portion 2 when the insertion portion 2 is inserted into the subject.
[0196] Each aspect of the present invention may include the following modifications: The information processing unit 40 (control unit) records insertion state information including the correction rotation amount and movement amount (insertion length) that are associated with each other in the memory 41 (recording medium).
[0197] Each aspect of the present invention may include the following modifications: The posture sensor 61 (second sensor) detects the posture of the sensor unit 6. The insertion state information is associated with the amount of movement (insertion length) and includes posture information indicating the posture of the sensor unit 6.
[0198] Each aspect of the present invention may include the following modifications. The insertion section 2 has a posture sensor 24 (third sensor) that is disposed at a distal end portion 2a including the distal end of the insertion section 2 and detects the posture of the distal end portion 2a. The insertion state information is associated with the amount of movement (insertion length) and includes posture information that indicates the posture of the distal end portion 2a.
[0199] Each aspect of the present invention may include the following modifications: The distal end portion 2a including the tip of the insertion portion 2 can be bent inside the subject based on a bending instruction input through operation of the operation unit 4. The insertion state information includes a bending amount that is associated with the movement amount (insertion length) and indicates the amount by which the distal end portion 2a is bent.
[0200] Each aspect of the present invention may include the following modifications: The insertion support unit 42 (control unit) generates operation information (insertion support information) indicating operations required to insert the insertion unit 2 into the subject by using the correction rotation amount calculated in real time and the correction rotation amount included in the insertion state information recorded in the memory 41 (recording medium).
[0201] Each aspect of the present invention may include the following modifications: The insertion support unit 42 (control unit) calculates the difference between the amount of correction rotation calculated in real time and the amount of correction rotation included in the insertion state information recorded in the memory 41 (recording medium), and generates operation information (insertion support information) by using the difference.
[0202] Each aspect of the present invention may include the following modifications: The insertion support unit 42 (control unit) calculates the correction rotation amount by performing addition or subtraction using the first rotation amount and the second rotation amount.
[0203] In the first embodiment, the endoscope device 1 calculates the corrected rotation amount by correcting the relative rotation amount of the insertion portion 2 with respect to the sensor unit 6 based on the rotation amount of the sensor unit 6. Therefore, the endoscope device 1 can accurately detect the rotation amount of the insertion portion 2.
[0204] The sensor unit 6 does not need to be fixed to the subject. As described above, the user may hold the sensor unit 6 in his / her hand. Even in this case, the endoscope device 1 can accurately detect the amount of rotation of the insertion portion 2.
[0205] The insertion status information is recorded in the memory 41. The insertion status information includes the amount of correction rotation of the insertion portion 2, etc. The endoscope device 1 can record the details of the insertion operation during the examination. By referring to the insertion status information, the user can confirm whether the examination was carried out according to the plan.
[0206] The insertion support unit 42 generates insertion support information by using information included in the insertion state information recorded in the memory 41, and outputs the generated insertion support information to the display unit 5. Even if the user is an inexperienced person, the user can easily perform the insertion operation according to the insertion support information under various examination conditions. The user can easily reach the examination site with the insertion unit 2.
[0207] (Second embodiment) A second embodiment of the present invention will be described. The technology disclosed in the aforementioned Patent Document 1 does not disclose a method for reproducing the reference position (origin of rotation) of the rotation amount of the insertion section for each test. Unless this origin of rotation is determined, it is difficult to calculate the rotation amount of the insertion section. In this technology, the gripping section and the insertion section are integrated. Therefore, it is assumed that the gripping section and the insertion section have a specific structure or sensor. The structure fixes the relative position of the insertion section with respect to the gripping section. The sensor detects the positional relationship between the gripping section and the insertion section when the gripping section and the insertion section are in close proximity to each other.
[0208] It is preferable that the gripping portion can be removed from the insertion portion. However, if the gripping portion is removed from the insertion portion, it is difficult to use the above structure or sensor. As described above, a large number of metal wires are woven into the surface of the insertion portion. The surface of the insertion portion has a uniform pattern formed by the metal wires. It is difficult to form a mark indicating the rotation origin or the like on the surface of the insertion portion.
[0209] In the first embodiment described above, when an expert performs device setting (operation O1), a reference image is recorded in memory 41. When an inexperienced person performs device setting (operation O3), display unit 5 displays the reference image and also displays a live image generated in real time by image sensor 23. The inexperienced person adjusts the amount of rotation of insertion portion 2 so that the composition of the live image matches the composition of the reference image. This adjusts the relative rotation position of insertion portion 2 with respect to the subject.
[0210] However, the above adjustment does not necessarily adjust the relative rotational position of the sensor unit 6 with respect to the subject. Therefore, even when the composition of the live image matches the composition of the reference image, the relative rotational position (rotation origin) of the insertion unit 2 with respect to the sensor unit 6 does not necessarily match the rotational position in the composition of the reference image.
[0211] On the other hand, the second embodiment provides a method for adjusting the rotation origin of the insertion portion 2 without using an image. The attitude sensor 61 and the attitude sensor 24 detect physical quantities based on the direction of gravity. When the object to be inspected is a pipe in a factory or an aircraft engine, the attitude of the object to be inspected based on the direction of gravity hardly changes. Therefore, the endoscope device 1 can suppress changes in the rotation origin according to the timing of the inspection by setting the rotation origin based on the direction of gravity.
[0212] The endoscope device 1 sets the relationship between the rotational positions of the insertion portion 2 and the sensor unit 6 by using the values detected by the attitude sensor 24 of the insertion portion 2 and the attitude sensor 61 of the sensor unit 6. In this way, the endoscope device 1 adjusts the rotation origin of the insertion portion 2 relative to the sensor unit 6.
[0213] The attitude sensor 24 may include only an acceleration sensor. The attitude sensor 24 may detect a physical quantity based on the direction of geomagnetic field. Therefore, the attitude sensor 24 may include only a geomagnetic sensor. The attitude sensor 24 may include any two or three of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. For example, the attitude sensor 24 may include an acceleration sensor and a gyro sensor. Alternatively, the attitude sensor 24 may include an acceleration sensor, a gyro sensor, and a geomagnetic sensor.
[0214] The attitude sensor 61 may include only an acceleration sensor. The attitude sensor 61 may detect a physical quantity based on the direction of geomagnetism. Therefore, the attitude sensor 61 may include only a geomagnetic sensor. The attitude sensor 61 may include any two or three of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. For example, the attitude sensor 61 may include an acceleration sensor and a gyro sensor. Alternatively, the attitude sensor 61 may include an acceleration sensor, a gyro sensor, and a geomagnetic sensor.
[0215] The status recording process shown in Fig. 11 is changed to the status recording process shown in Fig. 20. Fig. 20 shows the procedure of the status recording process. A description of the same processes as those shown in Fig. 11 will be omitted.
[0216] The skilled worker aligns the position of the insertion section 2 with the position of the sensor section 6. FIG. 21 shows the positional relationship between the insertion section 2 and the sensor section 6 at this time. FIG. 21 shows a cross section of the sensor section 6. For example, the skilled worker aligns the tip surface of the insertion section 2 with the end surface of the sensor section 6. At this time, the skilled worker operates the operation section 4 to input an origin setting command to the endoscope device 1.
[0217] In step S100, the operation processing unit 33 outputs an origin setting instruction to the state detection unit 34, the attitude detection unit 35, and the information processing unit 40. In step S100, the state detection unit 34, the attitude detection unit 35, and the information processing unit 40 receive the origin setting instruction.
[0218] The coordinate system CS1 of the attitude sensor 24 and the coordinate system CS2 of the attitude sensor 61 are shown in FIG. 21. The coordinate system CS1 has an X1 axis, a Y1 axis, and a Z1 axis. The Y1 axis coincides with the central axis CA1 of the insertion section 2. The coordinate system CS2 has an X2 axis, a Y2 axis, and a Z2 axis. The coordinate systems CS1 and CS2 are set in advance so that the Y1 axis coincides with the Y2 axis when the tip surface of the insertion section 2 coincides with the end surface of the sensor unit 6. The X1 axis does not necessarily coincide with the X2 axis. The Z1 axis does not necessarily coincide with the Z2 axis.
[0219] After step S100, the state detection unit 34 resets the insertion length calculated based on the value output from the optical sensor 60 to 0. The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 execute processing related to the amount of rotation (step S110).
[0220] After the insertion length is reset to 0, the newly calculated insertion length indicates the movement amount of the insertion portion 2 in the longitudinal direction D1 of the insertion portion 2 after step S110. Because the attitude sensor 61 and the attitude sensor 24 detect a physical quantity based on the direction of gravity, the state detection unit 34 does not need to reset the attitude calculated based on the values output from each of the attitude sensor 61 and the attitude sensor 24 to 0.
[0221] In step S110, the state detection unit 34, the attitude detection unit 35, and the information processing unit 40 execute the following processing related to the amount of rotation.
[0222] The posture sensor 24 can detect the direction of gravity. Therefore, the relationship between the direction of gravity and the direction of the Y1 axis in the posture sensor 24 is known. The posture detection unit 35 calculates the amount of rotation R1 of the insertion unit 2 around the Y1 axis based on the value output from the posture sensor 24.
[0223] The orientation sensor 61 can detect the direction of gravity. Therefore, the relationship between the direction of gravity and the direction of the Y2 axis in the orientation sensor 61 is known. The state detection unit 34 calculates the amount of rotation R2 of the sensor unit 6 around the Y2 axis based on the value output from the orientation sensor 61.
[0224] The information processing unit 40 acquires the amount of rotation R1 of the insertion unit 2 from the attitude detection unit 35, and acquires the amount of rotation R2 of the sensor unit 6 from the state detection unit 34. The information processing unit 40 calculates the amount of relative rotation (ΔRp) by subtracting the amount of rotation R2 of the sensor unit 6 from the amount of rotation R1 of the insertion unit 2. The amount of relative rotation (ΔRp) indicates the rotational positional relationship between the insertion unit 2 and the sensor unit 6. The information processing unit 40 may calculate the amount of relative rotation (ΔRp) by subtracting the amount of rotation R1 of the insertion unit 2 from the amount of rotation R2 of the sensor unit 6. The information processing unit 40 records the amount of relative rotation (ΔRp) in the memory 41.
[0225] The skilled person inserts the insertion portion 2 into the subject and sets the relative state of the insertion portion 2 with respect to the subject to an initial state. Figure 22 shows the positional relationship between the subject SB1 and the insertion portion 2 at this time. Figure 22 shows cross sections of the subject SB1 and the sensor unit 6.
[0226] The skilled person adjusts the position of the insertion portion 2 so that the image sensor 23 can acquire an image of a site inside the subject SB1. The skilled person also adjusts the posture of the insertion portion 2 so that the insertion portion 2 can move forward smoothly.
[0227] While the skilled person is performing the above adjustment, the state detection unit 34 acquires values detected by the optical sensor 60 and the attitude sensor 61. The state detection unit 34 calculates the insertion length of the insertion unit 2 and the amount of rotation R2 of the sensor unit 6. The state detection unit 34 calculates the attitude of the sensor unit 6 and generates attitude information about the sensor unit 6. While the skilled person is performing the above adjustment, the attitude detection unit 35 calculates the amount of rotation R1 of the insertion unit 2.
[0228] After the state of the insertion portion 2 is set to the desired state, the skilled person operates the operation portion 4 to input a setting end instruction to the endoscope device 1. In step S102, the operation processing portion 33 outputs the setting end instruction to the information processing portion 40. In step S102, the information processing portion 40 receives the setting end instruction.
[0229] After step S102, the state detection unit 34 resets the rotation amount RE of the insertion unit 2, which is calculated based on the value output from the optical sensor 60, to 0 (step S111). The rotation amount RE indicates the relative rotation amount of the insertion unit 2 with respect to the sensor unit 6. The state detection unit 34 calculates the rotation amount RE. After the rotation amount RE is reset to 0, the newly calculated rotation amount RE indicates the rotation amount of the insertion unit 2 after step S111.
[0230] After step S111, the information processing unit 40 acquires the insertion length of the insertion unit 2, the rotation amount RE of the insertion unit 2, the rotation amount R2 of the sensor unit 6, and the attitude information of the sensor unit 6 from the state detection unit 34 (step S112). For example, when the state of the insertion unit 2 is set to the state shown in Fig. 22, the insertion length of the insertion unit 2 is L0, and the rotation amount RE of the insertion unit 2 is RE0. Furthermore, the value indicating the attitude (tilt) of the sensor unit 6 is S0, and the rotation amount R2 of the sensor unit 6 is R20.
[0231] After step S112, the information processing unit 40 records the insertion length of the insertion unit 2, the rotation amount RE of the insertion unit 2, the rotation amount R2 of the sensor unit 6, and the attitude information of the sensor unit 6 in the memory 41 (step S113).
[0232] To start an examination, the skilled person operates the operation unit 4 to input an examination start instruction to the endoscope device 1. In step S106, the operation processing unit 33 outputs the examination start instruction to the state detection unit 34, the attitude detection unit 35, and the information processing unit 40. In step S106, the state detection unit 34, the attitude detection unit 35, and the information processing unit 40 accept the examination start instruction. When the examination start instruction is accepted, the state recording process shown in FIG. 20 ends.
[0233] The device setting process shown in Fig. 16 is changed to the device setting process shown in Fig. 23. Fig. 23 shows the procedure of the device setting process. Description of the same processes as those shown in Fig. 16 will be omitted.
[0234] The unskilled person aligns the position of the insertion portion 2 with the position of the sensor unit 6. At this time, the work performed by the unskilled person is the same as the work performed by the skilled person ( FIG. 21 ). For example, the unskilled person aligns the distal end surface of the insertion portion 2 with the end surface of the sensor unit 6. At this time, the unskilled person operates the operation unit 4 to input an origin setting command to the endoscope device 1.
[0235] In step S300, the operation processing unit 33 outputs an origin setting instruction to the state detection unit 34, the attitude detection unit 35, and the information processing unit 40. In step S300, the state detection unit 34, the attitude detection unit 35, and the information processing unit 40 receive the origin setting instruction.
[0236] After step S300, the state detection unit 34 resets the insertion length calculated based on the value output from the optical sensor 60 to 0. The state detection unit 34, the attitude detection unit 35, and the information processing unit 40 execute processing related to the amount of rotation (step S310).
[0237] After the insertion length is reset to 0, the newly calculated insertion length indicates the movement amount of the insertion portion 2 in the longitudinal direction D1 of the insertion portion 2 after step S310. Because the attitude sensor 61 and the attitude sensor 24 detect a physical quantity based on the direction of gravity, the state detection unit 34 does not need to reset the attitude calculated based on the values output from each of the attitude sensor 61 and the attitude sensor 24 to 0.
[0238] In step S310, the state detection unit 34, the attitude detection unit 35, and the information processing unit 40 execute the following processing related to the amount of rotation.
[0239] The attitude detection unit 35 calculates the amount of rotation R1 of the insertion unit 2 around the Y1 axis based on the value output from the attitude sensor 24. The state detection unit 34 calculates the amount of rotation R2 of the sensor unit 6 around the Y2 axis based on the value output from the attitude sensor 61.
[0240] The information processing unit 40 acquires the amount of rotation R1 of the insertion unit 2 from the attitude detection unit 35, and acquires the amount of rotation R2 of the sensor unit 6 from the state detection unit 34. The information processing unit 40 calculates the amount of relative rotation (ΔRc) by subtracting the amount of rotation R2 of the sensor unit 6 from the amount of rotation R1 of the insertion unit 2. The amount of relative rotation (ΔRc) indicates the rotational positional relationship between the insertion unit 2 and the sensor unit 6. The information processing unit 40 may calculate the amount of relative rotation (ΔRc) by subtracting the amount of rotation R1 of the insertion unit 2 from the amount of rotation R2 of the sensor unit 6.
[0241] The unskilled person performs the same work as the skilled person and achieves the same state as that shown in FIG. 21. The unskilled person sets the rotation state of the insertion portion 2 to the same state as the rotation state of the insertion portion 2 in the work performed by the skilled person. The endoscope device 1 executes a process to support the work of the unskilled person. The process will be described in detail below.
[0242] The insertion support unit 42 acquires the amount of relative rotation (ΔRp) recorded in the memory 41 in step S110. The insertion support unit 42 generates insertion support information relating to the amount of relative rotation (ΔRp) acquired from the memory 41 and the amount of relative rotation (ΔRc) calculated in step S310. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information (step S311).
[0243] 24 shows information displayed on the display unit 5. The display unit 5 displays a live image IMG10, insertion support information AI11, and a button B11.
[0244] The live image IMG10 is a current image generated in real time by the image sensor 23.
[0245] The insertion support information AI11 includes difference information D10. The difference information D10 indicates the difference between the relative rotation amount (ΔRp) and the relative rotation amount (ΔRc). The relative rotation amount (ΔRp) is obtained from the memory 41 in step S311. The relative rotation amount (ΔRc) is calculated in step S310. The difference information D10 is displayed as a line having a length corresponding to the difference between the relative rotation amount (ΔRp) and the relative rotation amount (ΔRc). The difference information D10 is displayed on the right or left side of the axis AX11 depending on the relationship in magnitude between the relative rotation amount (ΔRp) and the relative rotation amount (ΔRc).
[0246] The non-skilled person refers to the insertion support information AI11. The non-skilled person adjusts the rotation amount of the insertion portion 2 so that the difference corresponding to the difference information D10 matches 0. While the non-skilled person is adjusting the rotation amount of the insertion portion 2, the difference information D10 is updated according to the operation performed by the non-skilled person.
[0247] When the above adjustments are completed, the non-skilled person operates the operation unit 4 to input a setting execution instruction to the endoscope device 1. For example, the non-skilled person presses button B11 by operating the operation unit 4. This allows the non-skilled person to input a setting execution instruction to the endoscope device 1.
[0248] In step S302, the operation processing unit 33 outputs a setting execution instruction to the insertion support unit 42. In step S302, the insertion support unit 42 receives the setting execution instruction.
[0249] The state detection unit 34 acquires values detected by the optical sensor 60 and the attitude sensor 61. The state detection unit 34 calculates the insertion length of the insertion unit 2 and the amount of rotation R2 of the sensor unit 6. The state detection unit 34 calculates the attitude of the sensor unit 6 and generates attitude information of the sensor unit 6.
[0250] After step S302, the state detection unit 34 resets the rotation amount RE of the insertion unit 2, which is calculated based on the value output from the optical sensor 60, to 0 (step S312). The rotation amount RE indicates the relative rotation amount of the insertion unit 2 with respect to the sensor unit 6. The state detection unit 34 calculates the rotation amount RE. After the rotation amount RE is reset to 0, the newly calculated rotation amount RE indicates the rotation amount of the insertion unit 2 after step S312.
[0251] After step S312, the insertion support unit 42 acquires the insertion length of the insertion unit 2, the rotation amount RE of the insertion unit 2, the rotation amount R2 of the sensor unit 6, and the attitude information of the sensor unit 6 from the state detection unit 34 (step S313).
[0252] After step S313, the insertion support unit 42 acquires the information recorded in the memory 41 in step S113. That is, the insertion support unit 42 acquires the insertion length (L0) of the insertion unit 2, the rotation amount RE (RE0) of the insertion unit 2, the rotation amount R2 (R20) of the sensor unit 6, and the posture information (S0) of the sensor unit 6. The insertion support unit 42 generates insertion support information by using the information acquired from the memory 41 and the information acquired from the state detection unit 34 in step S313. The insertion support unit 42 outputs the insertion support information to the display unit 5 via the image processing unit 30. The display unit 5 displays the insertion support information (step S314).
[0253] 25 shows information displayed on the display unit 5. The display unit 5 displays a live image IMG10, insertion support information AI12, and a button B10.
[0254] The live image IMG10 is a current image generated in real time by the image sensor 23.
[0255] The insertion support information AI12 includes insertion length information L11. The insertion length information L11 indicates the difference between the previous insertion length (L0) and the current insertion length. The previous insertion length (L0) is obtained from the memory 41 in step S314. The current insertion length is obtained from the status detection unit 34 in step S313. The insertion length information L11 is displayed as a line having a length corresponding to the magnitude of the difference. The insertion length information L11 is displayed on the right or left side of the axis AX12 depending on the relationship between the previous insertion length (L0) and the current insertion length.
[0256] The insertion support information AI12 includes rotation amount information R11. The rotation amount information R11 indicates the difference between the past rotation amount RE (RE0) and the current rotation amount RE. The past rotation amount RE (RE0) is acquired from the memory 41 in step S314. The current rotation amount RE is acquired from the state detection unit 34 in step S313. The rotation amount information R11 is displayed as a line having a length according to the magnitude of the difference. The rotation amount information R11 is displayed on the right or left side of the axis AX12 depending on the relationship in magnitude between the past rotation amount RE (RE0) and the current rotation amount RE.
[0257] The insertion support information AI12 includes posture information S11. The posture information S11 indicates the difference between a past value (S0) of the posture information of the sensor unit 6 and the current value of the posture information of the sensor unit 6. The past value (S0) of the posture information is acquired from the memory 41 in step S314. The current value of the posture information is acquired from the state detection unit 34 in step S313. The posture information S11 is displayed as a line having a length according to the magnitude of the difference. The posture information S11 is displayed on the right or left side of the axis AX12 depending on the relationship in magnitude between the past value (S0) of the posture information and the current value of the posture information. The posture information S11 indicates the posture of the insertion unit 2 in the hole H1.
[0258] The insertion support information AI12 includes rotation amount information R12. The rotation amount information R12 indicates the difference between the past rotation amount R2 (R20) of the sensor unit 6 and the current rotation amount R2 of the sensor unit 6. The past rotation amount R2 (R20) is acquired from the memory 41 in step S314. The current rotation amount R2 is acquired from the state detection unit 34 in step S313. The rotation amount information R12 is displayed as a line having a length corresponding to the magnitude of the difference. The rotation amount information R12 is displayed on the right or left side of the axis AX12 depending on the relationship between the past rotation amount R2 (R20) and the current rotation amount R2.
[0259] The non-skilled person refers to the insertion support information AI12. The non-skilled person adjusts the position of the insertion portion 2 so that the difference corresponding to the insertion length information L11 matches 0. The non-skilled person adjusts the amount of rotation of the insertion portion 2 so that the difference corresponding to the rotation amount information R11 matches 0. The non-skilled person adjusts the attitude of the insertion portion 2 so that the difference corresponding to the attitude information S11 matches 0. The non-skilled person adjusts the amount of rotation of the sensor unit 6 so that the difference corresponding to the rotation amount information R12 matches 0. While the non-skilled person adjusts the position, amount of rotation, and attitude of the insertion portion 2 and adjusts the amount of rotation of the sensor unit 6, the insertion length information L11, rotation amount information R11, attitude information S11, and rotation amount information R12 are updated according to the operation performed by the non-skilled person.
[0260] When the difference corresponding to the rotation amount information R11 is equal to 0, the relative rotation amount (ΔRc) is equal to the relative rotation amount (ΔRp). After the rotation amount RE of the insertion portion 2 is reset to 0 in step S312, the non-expert adjusts the rotation amount of the insertion portion 2 so that the current rotation amount RE is equal to the previous rotation amount RE (RE0). When the current rotation amount RE is equal to the previous rotation amount RE (RE0), the reference positions of the rotation amounts of the insertion portion 2 and the sensor unit 6 around the central axis CA1 of the insertion portion 2 are set to the same as the previous reference positions. In other words, the rotation origin of the insertion portion 2 relative to the sensor unit 6 is set to the same as the previous rotation origin. At this time, the current rotational positional relationship between the insertion portion 2 and the sensor unit 6 is equal to the rotational positional relationship between the insertion portion 2 and the sensor unit 6 in the previous examination performed by the expert.
[0261] When the difference corresponding to the rotation amount information R12 is equal to 0, the current rotation amount R2 of the sensor unit 6 is equal to the rotation amount R2 (R20) of the sensor unit 6 in the previous test. At this time, the current rotation state of the sensor unit 6 matches the rotation state of the sensor unit 6 in the previous test. This allows the unskilled person to reproduce the hand movements of the skilled person.
[0262] When the above adjustments are completed, in order to start the examination, the non-skilled person operates the operation unit 4 to input an examination start command to the endoscope device 1. For example, the non-skilled person presses button B10 by operating the operation unit 4. This allows the non-skilled person to input an examination start command to the endoscope device 1.
[0263] In step S306, the operation processing unit 33 outputs an examination start instruction to the state detection unit 34, the attitude detection unit 35, and the insertion support unit 42. In step S306, the state detection unit 34, the attitude detection unit 35, and the insertion support unit 42 accept the examination start instruction. When the examination start instruction is accepted, the device setting process shown in Fig. 23 ends. Steps S313 and S314 are repeated until the examination start instruction is accepted.
[0264] The insertion support unit 42 may display a three-dimensional model of the insertion unit 2 on the display unit 5. The insertion support unit 42 may display a target rotation amount and a target attitude of the insertion unit 2 on the three-dimensional model. This improves the visibility of information required to adjust the rotation amount and attitude of the insertion unit 2.
[0265] The procedure of the history recording process in the second embodiment is the same as the procedure shown in Fig. 14. The procedure of the insertion support process in the second embodiment is the same as the procedure shown in Fig. 18.
[0266] The information processing unit 40 may record the rotation amount R2 of the sensor unit 6 in the memory 41 in step S203 of the history recording process in the first or second embodiment. This records the hand movement of the expert holding the sensor unit 6. In the insertion support process in the first or second embodiment, the insertion support unit 42 may generate insertion support information related to the rotation amount R2 of the sensor unit 6 recorded in the memory 41 and the rotation amount R2 of the sensor unit 6 acquired from the state detection unit 34 in step S401. In the insertion support process in the first or second embodiment, the insertion support unit 42 may display the insertion support information on the display unit 5. This allows the non-expert to know the timing when the expert twisted the sensor unit 6.
[0267] Each aspect of the present invention may include the following modifications: The information processing unit 40 (control unit) records insertion state information including a second rotation amount (rotation amount R2) and a movement amount (insertion length) that are associated with each other in the memory 41 (recording medium).
[0268] Each aspect of the present invention may include the following modifications. The insertion section 2 has a posture sensor 24 (third sensor) that is disposed at a distal end portion 2a including the distal end of the insertion section 2 and detects a third rotation amount (rotation amount R1) that indicates the rotation amount of the insertion section 2 around the central axis CA1 of the insertion section 2. The information processing section 40 resets the relative rotation amount of the insertion section 2 with respect to the sensor section 6 by using the second rotation amount and the third rotation amount.
[0269] In the second embodiment, the endoscope device 1 can adjust the rotation origin of the insertion portion 2 relative to the sensor unit 6 by using the rotation amount R1 of the insertion portion 2 and the rotation amount R2 of the sensor unit 6. The endoscope device 1 does not need to use the image generated by the image sensor 23 to adjust the rotation origin. This reduces the number of elements that the user (examiner) must visually check, improving the accuracy and efficiency of adjusting the rotation origin.
[0270] When the operation unit 4 is fixed to the sensor unit 6 as shown in Figure 8, the structure including the operation unit 4 and the sensor unit 6 does not have rotational symmetry with respect to the central axis CA1 of the insertion unit 2. Furthermore, if the insertion unit 2 has a tendency to bend easily in a certain direction, the insertion unit 2 does not have rotational symmetry with respect to the central axis CA1. In order to properly insert the insertion unit 2 into the subject, the user needs to perform a bending operation and rotate the insertion unit 2 taking into account the bending tendency of the insertion unit 2.
[0271] The unskilled person needs to match the rotational positional relationship between the insertion portion 2 and the sensor unit 6 with the positional relationship in a previous test performed by an expert. Even if the unskilled person rotates the insertion portion 2 in the same way as the expert, when the positional relationship in the current test does not match the positional relationship in the previous test, there is a possibility that the unskilled person will not be able to successfully insert the insertion portion 2 into the subject.
[0272] In the second embodiment, the non-expert adjusts the rotation origin of the insertion portion 2 relative to the sensor portion 6. The non-expert also adjusts the rotation amount of the insertion portion 2 and the sensor portion 6 so that the rotation amount R2 of the sensor portion 6 in the current examination matches the rotation amount R2 of the sensor portion 6 in the previous examination. This increases the likelihood that the non-expert will be able to successfully insert the insertion portion 2 into the subject.
[0273] (Third embodiment) A third embodiment of the present invention will be described. The operation unit 4 shown in Fig. 1 etc. is changed to an operation unit 4b shown in Fig. 26. The sensor unit 6 shown in Fig. 1 etc. is changed to a sensor unit 6b shown in Fig. 26. Fig. 26 shows cross sections of the operation unit 4b and the sensor unit 6b.
[0274] The operation unit 4b is fixed to the sensor unit 6b. The operation unit 4b has a joystick 45, a substrate 46, and an attitude sensor 47. The joystick 45 is the same as the joystick 45 shown in FIG. 8. The substrate 46 is the same as the substrate 46 shown in FIG. 8. The attitude sensor 47 is the same as the attitude sensor 61 shown in FIG. 5 etc. The attitude sensor 47 is arranged inside the operation unit 4b and is fixed to the operation unit 4b.
[0275] The attitude sensor 47 is disposed on the substrate 46. A value detected by the attitude sensor 47 is output to the operation processing unit 33 via the substrate 46. The attitude sensor 47 may generate a bending instruction according to the attitude or movement of the operation unit 4b. The operation processing unit 33 may output the bending instruction generated by the attitude sensor 47 to the bending control unit 39.
[0276] The sensor unit 6b has an optical sensor 60. The sensor unit 6b does not have the attitude sensor 61 shown in FIG.
[0277] A hole H1 through which the insertion portion 2 passes is formed in the sensor portion 6b. In the hole H1, the insertion portion 2 can move in the longitudinal direction D1 of the insertion portion 2. In addition, in the hole H1, the insertion portion 2 can rotate around the central axis CA1 of the insertion portion 2.
[0278] The operation processing unit 33 acquires the value detected by the attitude sensor 47. The operation processing unit 33 calculates the attitude of the operation unit 4b and generates attitude information of the operation unit 4b. Because the operation unit 4b is fixed to the sensor unit 6b, the attitude information of the operation unit 4b indicates the attitude of the sensor unit 6b. Because the insertion unit 2 passes through a hole H1 formed in the sensor unit 6b, the attitude of the sensor unit 6b is the same as the attitude of the insertion unit 2 in the hole H1. Therefore, the attitude information of the operation unit 4b indicates the attitude of the insertion unit 2 in the hole H1.
[0279] The operation unit 4b may be detachable from the sensor unit 6b. The operation unit 4b may have a sensor that detects the connection state between the operation unit 4b and the sensor unit 6b. The substrate 46 may have a control circuit that determines the connection state between the operation unit 4b and the sensor unit 6b based on a value output from the sensor.
[0280] Only when the operation unit 4b is attached to the sensor unit 6b, the control circuit may output the value detected by the attitude sensor 47 to the operation processing unit 33. Alternatively, the control circuit may output information indicating the connection state between the operation unit 4b and the sensor unit 6b to the operation processing unit 33. The operation processing unit 33 may determine the connection state between the operation unit 4b and the sensor unit 6b by using the information. Only when the operation unit 4b is attached to the sensor unit 6b, the operation processing unit 33 may determine that the value detected by the attitude sensor 47 is valid and process the value.
[0281] Each aspect of the present invention may include the following modifications. The distal end portion 2a including the distal end of the insertion portion 2 can be bent inside the subject based on a bending instruction input through operation of the operation portion 4b. The attitude sensor 47 (second sensor) is disposed in the operation portion 4b.
[0282] Each aspect of the present invention may include the following modifications: The operation unit 4b is detachable from the sensor unit 6b. When the operation unit 4b is attached to the sensor unit 6b, the attitude sensor 47 (second sensor) detects a second amount of rotation of the sensor unit 6b.
[0283] In the third embodiment, the sensor unit 6b does not have the attitude sensor 61, and the operation unit 4b has the attitude sensor 47. The sensor unit 6b is smaller than the sensor unit 6.
[0284] (Fourth embodiment) A fourth embodiment of the present invention will be described. The operation unit 4 shown in FIG. 1 etc. is changed to an operation unit 4b shown in FIG. 27. The sensor unit 6 shown in FIG. 1 etc. is changed to a sensor unit 6c shown in FIG. 27. FIG. 27 shows cross sections of the operation unit 4b and the sensor unit 6c. The operation unit 4b is the same as the operation unit 4b shown in FIG. 26.
[0285] The sensor unit 6c has a main body 62 and a screw portion 64. The main body 62 has an optical sensor 60. The screw portion 64 is connected to the main body 62. A male screw is formed on the surface of the screw portion 64. A hole H3 through which the insertion portion 2 passes is formed in the main body 62 and the screw portion 64.
[0286] The sensor unit 6c is connected to a guide tube 9. The guide tube 9 is a cylindrical auxiliary member. A hole through which the insertion unit 2 passes is formed in the guide tube 9. The male thread of the screw portion 64 fits into the female thread of the guide tube 9, and the sensor unit 6c is fixed to the guide tube 9.
[0287] The insertion section 2 is inserted into the subject SB1. An access port AP2 is formed in the subject SB1. The guide tube 9 is inserted into the subject SB1 through the access port AP2.
[0288] When the structure of the subject SB1 near the access port AP2 is complex, the guide tube 9 is used to preliminarily limit the position of the tip of the insertion portion 2. The guide tube 9 can maintain the posture of the insertion portion 2.
[0289] In the fourth embodiment, the operation section 4b, the sensor section 6c, and the guide tube 9 are fixed to one another. The posture of the insertion section 2 is easily maintained, improving operability.
[0290] If the distance between the sensor unit 6c and the subject SB1 changes, the change in distance may be erroneously detected as the movement amount of the insertion section 2, and the insertion length may include an error. By using the guide tube 9, the distance between the sensor unit 6c and the subject SB1 is likely to be fixed.
[0291] A scale may be displayed on the side surface of the guide tube 9. The user may refer to the scale to maintain the distance between the sensor unit 6c and the subject SB1.
[0292] (Fifth embodiment) A fifth embodiment of the present invention will be described. The endoscope device 1 shown in Fig. 4 is changed to an endoscope device 1d shown in Fig. 28. Fig. 28 shows the internal configuration of the endoscope device 1d. Description of the same configuration as that shown in Fig. 4 will be omitted.
[0293] The main body 3 shown in Fig. 4 is changed to a main body 3d shown in Fig. 28. The main body 3d has an image processing unit 30, a recording unit 31, an external IF (interface) 32, an operation processing unit 33, a state detection unit 34, an attitude detection unit 35, a light source 36, an illumination control unit 37, a motor 38, a bending control unit 39, an information processing unit 40, a memory 41, an insertion support unit 42, a power supply unit 43, and a drive control unit 48.
[0294] The sensor unit 6 shown in Fig. 4 is changed to a sensor unit 6d. The sensor unit 6d has an optical sensor 60, an attitude sensor 61, and a drive unit 65. The optical sensor 60 is the same as the optical sensor 60 shown in Fig. 4. The attitude sensor 61 is the same as the attitude sensor 61 shown in Fig. 4.
[0295] The drive unit 65 has a motor, gears, and rollers. The rollers contact the sides of the insertion unit 2. The drive unit 65 drives the rollers by using the motor and gears. Frictional force is generated between the rollers and the insertion unit 2. In response to the frictional force, the insertion unit 2 moves in the longitudinal direction D1 of the insertion unit 2 or rotates around the central axis CA1 of the insertion unit 2. The drive control unit 48 outputs a drive signal to the drive unit 65 to control the drive unit 65.
[0296] The rollers may slip on the surface of the insertion section 2. In such cases, the amount of rotation of the rollers cannot be detected correctly. Therefore, it is difficult to correctly detect the amount of rotation of the insertion section 2 from the amount of rotation of the rollers.
[0297] In the fifth embodiment, the endoscope device 1d has an optical sensor 60 that detects the amount of rotation of the insertion portion 2 without contacting the insertion portion 2. Therefore, the endoscope device 1d can accurately detect the amount of rotation of the insertion portion 2.
[0298] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and their modifications. Addition, omission, substitution, and other modifications of the configuration are possible within the scope of the spirit of the present invention. Furthermore, the present invention is not limited by the above description, but is limited only by the scope of the appended claims. [Explanation of symbols]
[0299] 1,1d Endoscopic device 2 Insertion section 2a Tip 3,3d,62 Main body 4,4b Operation section 5 Display section 6, 6a, 6b, 6c, 6d Sensor section 7 Optical adapter 9 Guide Tube 20 Imaging unit 21 Curved section 22,70 lens 23 Image sensor 23a Imaging surface 24,47,61 Attitude sensor 25 Light Guide 26 Angle wire 30 Image processing section 31 Recording Section 32 External IF 33 Operation processing section 34 Status detection unit 35 Attitude detection unit 36 Light source 37 Lighting control unit 38 Motor 39 Bending control section 40 Information Processing Department 41 memory 42 Insertion support unit 43 Power supply section 45 Joystick 46 PCB 48 Drive control unit 60 Optical Sensor 60a Light-emitting device 60b Light receiving device 63,64 Threaded part 65 Drive unit
Claims
1. a sensor unit having a first sensor that detects a first rotation amount indicating a rotation amount of an elongated insertion portion of an endoscope device around a central axis of the insertion portion when the insertion portion is inserted into a subject, and having a hole through which the insertion portion passes; a second sensor that is disposed on the sensor unit or an object fixed to the sensor unit and that detects a second amount of rotation that indicates an amount of rotation of the sensor unit around the central axis when the insertion unit is inserted into the subject; A control unit; and the insertion section is movable relative to the sensor section, The control unit obtaining the first amount of rotation and the second amount of rotation; Calculating a corrected rotation amount by correcting the first rotation amount based on the second rotation amount Insertion status detection system.
2. The first sensor further detects a movement amount indicating an amount of movement of the insertion portion in a longitudinal direction of the insertion portion when the insertion portion is inserted into the subject. The insertion state detection system according to claim 1 .
3. The control unit further records insertion state information including the mutually associated correction rotation amount and movement amount on a recording medium. The insertion state detection system according to claim 2 .
4. The control unit further records insertion state information including the second rotation amount and the movement amount associated with each other on a recording medium. The insertion state detection system according to claim 2 .
5. The second sensor further detects the attitude of the sensor unit, The insertion state information further includes posture information that is associated with the movement amount and indicates the posture.
5. The insertion state detection system according to claim 3 or 4.
6. the insertion section has a third sensor that is disposed at a tip section including a tip of the insertion section and detects the attitude of the tip section; The insertion state information further includes posture information that is associated with the movement amount and indicates the posture.
5. The insertion state detection system according to claim 3 or 4.
7. a distal end portion including a distal end of the insertion portion is bendable inside the subject based on a bending instruction input through operation of an operation unit, The insertion state information further includes a bending amount that is associated with the movement amount and indicates an amount by which the tip portion is bent.
5. The insertion state detection system according to claim 3 or 4.
8. The control unit further generates operation information indicating an operation required to insert the insertion unit into the subject by using the corrective rotation amount calculated in real time and the corrective rotation amount included in the insertion state information recorded on the recording medium.
5. The insertion state detection system according to claim 3 or 4.
9. The control unit calculates a difference between the amount of correction rotation calculated in real time and the amount of correction rotation included in the insertion state information recorded on the recording medium, and generates the operation information by using the difference. The insertion state detection system according to claim 8 .
10. the insertion section has a third sensor that is disposed at a distal end portion including a distal end of the insertion section and detects a third rotation amount that indicates a rotation amount of the insertion section around a central axis of the insertion section; The control unit further resets the amount of rotation of the insertion unit relative to the sensor unit by using the second amount of rotation and the third amount of rotation. The insertion state detection system according to claim 1 .
11. a distal end portion including a distal end of the insertion portion is bendable inside the subject based on a bending instruction input through operation of an operation unit, The second sensor is disposed in the operation unit. The insertion state detection system according to claim 1 .
12. the operation unit is detachable from the sensor unit, When the operation unit is attached to the sensor unit, the second sensor detects the second amount of rotation. The insertion state detection system according to claim 11.
13. The control unit calculates the correction rotation amount by performing addition or subtraction using the first rotation amount and the second rotation amount. The insertion state detection system according to claim 1 .
14. a step in which a control unit acquires a first rotation amount indicating a rotation amount of the insertion unit around a central axis of the insertion unit when the elongated insertion unit of the endoscope device is inserted into a subject, the first rotation amount being detected by a first sensor disposed in a sensor unit having a hole through which the insertion unit passes, and the insertion unit is movable relative to the sensor unit; acquiring, by the control unit, a second rotation amount indicating a rotation amount of the sensor unit around the central axis when the insertion unit is inserted into the subject, the second rotation amount being detected by a second sensor disposed on the sensor unit or an object fixed to the sensor unit; a step of calculating a corrected rotation amount by correcting the first rotation amount based on the second rotation amount by the control unit; The insertion state detection method includes:
15. acquiring a first rotation amount indicating a rotation amount of an elongated insertion portion of an endoscope device around a central axis of the insertion portion when the insertion portion is inserted into a subject, the first rotation amount being detected by a first sensor disposed in a sensor unit having a hole through which the insertion portion passes, the insertion portion being movable relative to the sensor unit; acquiring a second rotation amount indicating a rotation amount of the sensor unit around the central axis when the insertion unit is inserted into the subject, the second rotation amount being detected by a second sensor disposed on the sensor unit or an object fixed to the sensor unit; calculating a corrected rotation amount by correcting the first rotation amount based on the second rotation amount; A program that causes a computer to execute the following.
Citation Information
Patent Citations
Insertion-assist information detection system for endoscopic apparatus, and endoscopic apparatus
JP2014113352A
Insertion system
US20180292199A1
Insertion system
WO2017104080A1