Intraluminal device system, method for operating an intraluminal device system, and computer program storage medium for storing a program for controlling an intraluminal device

Abstract

An operation detection unit detects a first operation on the basis of the movement of an object that contacts a contact detection device. A drive control unit performs shape control that changes at least some of the shape of an endoluminal device, on the basis of the first operation. The operation detection unit detects a second operation, on the basis of the movement of the object for the period that the contact with the contact detection device continues from when the first operation was detected. The drive control unit performs shape control that maintains the changed shape of at least some of the endoluminal device, on the basis of the second operation.

Description

[Technical field]

[0001] The present disclosure relates to techniques for controlling the operation of endoluminal devices such as endoscopes. This application claims priority to U.S. Provisional Patent Application No. 63 / 281,796, provisionally filed in the United States on November 22, 2021, and U.S. Provisional Patent Application No. 63 / 310,756, provisionally filed in the United States on February 16, 2022, the contents of which are incorporated herein by reference. [Background technology]

[0002] In an endoscopic examination, a long and thin flexible insertion section is inserted into the patient's body. A bending section that can be bent up, down, left and right is provided at the tip of the flexible insertion section, and the shape of the bending section can be freely bent in response to the operation of the endoscope operation section by the doctor. During the examination, the doctor operates the angle knob of the endoscope operation section to point the tip of the bending section in a desired direction, and then locks the angle fixing lever of the endoscope operation section to fix the bending section in a bent state, and the lesion is photographed by the imaging section. When the doctor has finished photographing the lesion and unlocks the angle fixing lever, the bending section gradually returns to its original straight shape from its curved shape due to its elastic force.

[0003] In recent years, electric endoscopes have been developed that use actuators to bend the bending section of the endoscope for the purpose of efficiently observing and treating lesions. Patent Document 1 discloses a technique for bending the bending section in the direction of stroking a touch panel with a finger. Patent Document 1 also discloses that when the touch panel is tapped with a finger, the bending section is bent so that the tapped position is in the center of the image display area, and the shape of the bending section is fixed (angle lock). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] U.S. Pat. No. 10,666,854 Summary of the Invention [Problem to be solved by the invention]

[0005] Compared to a doctor bending the bending section by operating the angle knob and angle fixing lever of the endoscope operation section, being able to control the bending operation of the bending section by operating a touch panel is expected to greatly reduce the fatigue of the doctor during an examination. Therefore, there is a need for the development of technology that allows users to easily control the operation of intraluminal devices such as endoscopes by using a contact detection device such as a touch panel.

[0006] The present disclosure has been made in consideration of the above-mentioned circumstances, and aims to provide a technique that allows a user to easily control the operation of an intraluminal device. [Means for solving the problem]

[0007] In order to solve the above problems, an intraluminal device system according to an embodiment of the present invention includes an intraluminal device inserted into a lumen, a contact detection device that detects contact of an object, and one or more processors having hardware. The one or more processors detect a first operation based on a movement of the object that contacts the contact detection device, perform a shape control that changes a shape of at least a part of the intraluminal device based on the first operation, detect a second operation based on the movement of the object while it continues to contact the contact detection device after starting to detect the first operation, and perform a first control that maintains the changed shape of at least a part of the intraluminal device based on the second operation.

[0008] Another aspect of the present invention relates to a method for controlling an intraluminal device in an intraluminal device system including an intraluminal device inserted into a lumen and a contact detection device that detects contact of an object, the control method comprising: detecting a first operation based on a movement of an object contacting the contact detection device, performing a shape control for changing a shape of at least a part of the intraluminal device based on the first operation, detecting a second operation based on a movement of the object while the object continues to contact the contact detection device after starting to detect the first operation, and performing a first control for maintaining the changed shape of at least a part of the intraluminal device based on the second operation.

[0009] Yet another aspect of the present invention relates to a computer program storage medium storing a program for controlling an intraluminal device inserted into a lumen, the storage medium storing a program for causing a computer to realize a function of detecting a first operation based on a movement of an object contacting a contact sensing device, a function of performing a shape control for changing a shape of at least a part of the intraluminal device based on the first operation, a function of detecting a second operation based on a movement of the object while the object continues to contact the contact sensing device after starting to detect the first operation, and a function of performing a first control for maintaining the changed shape of at least a part of the intraluminal device based on the second operation.

[0010] Any combination of the above components, and conversion of the present disclosure into a method, device, system, recording medium, computer program, etc. are also valid aspects of the present disclosure. Effect of the Invention

[0011] The intraluminal device system, the intraluminal device control method, and the computer program storage medium storing a program for controlling an intraluminal device of the present invention enable a user to easily control the operation of an intraluminal device. [Brief description of the drawings]

[0012] [Figure 1]FIG. 1 is a diagram showing a configuration of an intraluminal device system according to an embodiment. [Diagram 2] FIG. 4 is a diagram showing the internal cross-sectional structure of a curved portion. [Diagram 3] FIG. [Figure 4] FIG. [Diagram 5] FIG. 4 is a cross-sectional view of a second curved portion. [Figure 6] FIG. 2 is a diagram showing functional blocks of a control device. [Figure 7] FIG. 2 is a diagram showing how a user's finger moves on an input surface. [Figure 8] 6(a) to 6(c) are diagrams illustrating how the shape of a bending portion changes. [Figure 9] 5 is a diagram illustrating the relationship between finger movements and control performed by a drive control unit in the first embodiment. FIG. [Figure 10] FIG. 11 is a flowchart showing how the operation of the bending portion is controlled. [Figure 11] 13 is a diagram illustrating the relationship between finger movements and control performed by a drive control unit in the second embodiment. FIG. [Figure 12] 13 is a diagram illustrating the relationship between finger movements and control performed by a drive control unit in the third embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] 1 shows the configuration of an intraluminal device system 1 according to an embodiment. The intraluminal device system 1 is a medical system installed in a medical facility such as a hospital, and includes an intraluminal device 2, a display device 3, a control device 10, a drive device 12, and a contact detection device 14. The intraluminal device 2 is a medical instrument that is inserted into a patient's cavity to observe and / or treat a lesion. The intraluminal device 2 according to the embodiment is an endoscope, and the intraluminal device system 1 may be installed in an endoscopy examination room.

[0014] The intraluminal device 2 includes an insertion section 18, an extracorporeal soft section 26, a connecting section 30 that connects the insertion section 18 and the extracorporeal soft section 26, a connecting section 28a that connects to the driving device 12, and a connecting section 28b that connects to the control device 10. The insertion section 18 is a long, thin member that can be inserted into a patient's lumen, and has a distal end 20, a bending section 22 that can change its shape, and an internal soft section 24 that is connected to the base end of the bending section 22. The internal soft section 24 and the external soft section 26 are flexible and soft members that can be deformed when subjected to an external force. The connecting section 30 connects the internal soft section 24 and the external soft section 26 rotatably around a rotation axis that extends in the longitudinal direction. Therefore, even if a doctor or user rotates the internal soft section 24, the external soft section 26 does not rotate. The intraluminal device 2 is connected to the driver 12 at connection 28a and to the controller 10 at connection 28b.

[0015] The distal end portion 20 includes an opening for advancing and retracting a treatment tool, an illumination window for emitting illumination light transmitted by a light guide into the lumen, and an imaging unit that captures images of the inside of the lumen at a predetermined period and outputs an imaging signal to the control device 10. The imaging unit includes a solid-state imaging element (e.g., a CCD image sensor or a CMOS image sensor) that converts incident light into an electrical signal. When the intraluminal device 2 is a device other than an endoscope, the distal end portion 20 may be equipped with various types of end effectors.

[0016] 2 shows the internal cross-sectional structure of the bending portion 22. The bending portion 22 has a first bending portion 113 on the distal end side, a second bending portion 114 on the proximal end side, and an outer sheath 118 (see FIG. 3) that protects the internal structure of the bending portion 22. The first bending portion 113 and the second bending portion 114 can be bent in different directions. In the embodiment, in order to express the relative positional relationship in the longitudinal direction A of the intraluminal device 2, the side closer to the distal end 20 may be referred to as the "distal end side (A1)" and the side closer to the connection portion 28 may be referred to as the "proximal end side (A2)."

[0017] The first bending portion 113 has a plurality of node rings (also referred to as "bending pieces") 115 and a first tip portion 116 connected to the leading node ring 115. The plurality of node rings 115 and the first tip portion 116 are connected in the longitudinal direction A inside the outer sheath 118. The shape and number of node rings 115 of the first bending portion 113 are not limited to the shape and number of node rings 115 shown in FIG.

[0018] Fig. 3 shows an enlarged view of the node ring 115 in the region R shown in Fig. 2. The node ring 115 is a short cylindrical member made of metal, and has a first node ring 115a on the tip side and a second node ring 115b on the base end side. The first node ring 115a and the second node ring 115b are connected by a first rotation pin 115p so as to be rotatable in the up-down direction (also called the "UD direction") perpendicular to the longitudinal direction A.

[0019] The multiple nodal rings 115 are connected so that the internal spaces of adjacent nodal rings 115 are continuous. In adjacent nodal rings 115, the second nodal ring 115b in the nodal ring 115 on the tip side and the first nodal ring 115a in the nodal ring 115 on the base side are connected by the second rotating pin 115q so as to be rotatable in the left-right direction (also called the "LR direction") perpendicular to the longitudinal direction A and the up-down direction (UD direction). The first nodal ring 115a and the second nodal ring 115b are alternately connected by the first rotating pin 115p and the second rotating pin 115q, and the first bending portion 113 is freely bendable in a desired direction.

[0020] FIG. 4 shows a cross-sectional view of the bending portion 22 along the C1-C1 line in FIG. 2 and FIG. 3. An upper wire guide 115u and a lower wire guide 115d are formed on the inner peripheral surface of the second nodal ring 115b. The upper wire guide 115u and the lower wire guide 115d are arranged on both sides in the up-down direction (UD direction) with the central axis O in the longitudinal direction A in between. A left wire guide 115l and a right wire guide 115r are formed on the inner peripheral surface of the first nodal ring 115a. The left wire guide 115l and the right wire guide 115r are arranged on both sides in the left-right direction (LR direction) with the central axis O in the longitudinal direction A in between. A through hole through which the bending wire 160 is inserted is formed along the longitudinal direction A in the upper wire guide 115u, the lower wire guide 115d, the left wire guide 115l, and the right wire guide 115r.

[0021] The second bending portion 114 has a plurality of node rings 115 and a second tip portion 117 connected to the leading node ring 115. The plurality of node rings 115 and the second tip portion 117 are connected in the longitudinal direction A inside the outer sheath 118. The second tip portion 117 is connected to the node ring 115 at the base end of the first bending portion 113, and the node ring 115 at the base end of the second bending portion 114 is attached to the tip of the internal flexible portion 24. The shape and number of the node rings 115 of the second bending portion 114 are not limited to the shape and number of the node rings 115 shown in FIG.

[0022] In the bending portion 22 of the embodiment, the length in the longitudinal direction A of the first bending portion 113 may be shorter than the length in the longitudinal direction A of the second bending portion 114. Even with the same bending angle, the shorter the bending length, the higher the tip precision. Therefore, by making the length in the longitudinal direction A of the first bending portion 113 shorter than the longitudinal length of the bending portion of an existing general endoscope, the tip portion 20 can be moved more accurately. The ratio of the length in the longitudinal direction A of the first bending portion 113 to the length in the longitudinal direction A of the second bending portion 114 may be within a range of, for example, 2:3 to 1:4.

[0023] The bending wire 160 is a wire that bends the bending portion 22, and includes a first bending wire 161 that bends the first bending portion 113 and a second bending wire 162 that bends the second bending portion 114. The first bending wire 161 and the second bending wire 162 extend through the internal path 101 to the connection portion 28a.

[0024] As shown in Fig. 2 and Fig. 5, the first bending wire 161 has a first upward bending wire 161u, a first downward bending wire 161d, a first left bending wire 161l, and a first right bending wire 161r. The first upward bending wire 161u, the first downward bending wire 161d, the first left bending wire 161l, and the first right bending wire 161r are each inserted into a first wire sheath 161s. The tip of the first wire sheath 161s is attached to the second tip portion 117. The first wire sheath 161s extends to the connection portion 28a.

[0025] The first upward bending wire 161u and the first downward bending wire 161d are wires that bend the first bending portion 113 in the up-down direction (UD direction). As shown in Fig. 4, the first upward bending wire 161u is inserted through the upper wire guide 115u, and the first downward bending wire 161d is inserted through the lower wire guide 115d. The tips of the first upward bending wire 161u and the first downward bending wire 161d are fixed to the first tip portion 116 as shown in Fig. 2. The tips of the first upward bending wire 161u and the first downward bending wire 161d fixed to the first tip portion 116 are disposed on both sides in the up-down direction (UD direction) with the central axis O in the longitudinal direction A in between.

[0026] The first left bending wire 161l and the first right bending wire 161r are wires that bend the first bending portion 113 in the left-right direction (LR direction). As shown in Fig. 4, the first left bending wire 161l is inserted through the left wire guide 115l, and the first right bending wire 161r is inserted through the right wire guide 115r. As shown in Fig. 2, the tips of the first left bending wire 161l and the first right bending wire 161r are fixed to the first tip portion 116. The tips of the first left bending wire 161l and the first right bending wire 161r fixed to the first tip portion 116 are disposed on both sides in the left-right direction (LR direction) with the central axis O in the longitudinal direction A in between.

[0027] The first bending portion 113 can be bent in a desired direction by pulling or relaxing the first bending wires 161 (the first upward bending wire 161u, the first downward bending wire 161d, the first left bending wire 161l, and the first right bending wire 161r).

[0028] FIG. 5 shows a cross-sectional view of the second bending portion 114 along the C2-C2 line in FIG. 2. As shown in FIG. 2 and FIG. 5, the second bending wire 162 has a second upward bending wire 162u, a second downward bending wire 162d, a second left bending wire 162l, and a second right bending wire 162r. As shown in FIG. 2, the second upward bending wire 162u, the second downward bending wire 162d, the second left bending wire 162l, and the second right bending wire 162r are inserted into the second wire sheath 162s. The tip of the second wire sheath 162s is attached to the node ring 115 at the base end of the second bending portion 114. The second wire sheath 162s extends to the connecting portion 28a.

[0029] The second upward bending wire 162u and the second downward bending wire 162d are wires that bend the second bending portion 114 in the up-down direction (UD direction). As shown in Fig. 5, the second upward bending wire 162u is inserted through the upper wire guide 115u, and the second downward bending wire 162d is inserted through the lower wire guide 115d. The tips of the second upward bending wire 162u and the second downward bending wire 162d are fixed to the second tip portion 117 as shown in Fig. 2. The tips of the second upward bending wire 162u and the second downward bending wire 162d fixed to the second tip portion 117 are disposed on both sides in the up-down direction (UD direction) with the central axis O in the longitudinal direction A in between.

[0030] The second left bending wire 162l and the second right bending wire 162r are wires that bend the second bending portion 114 in the left-right direction (LR direction). As shown in Fig. 5, the second left bending wire 162l is inserted through the left wire guide 115l, and the second right bending wire 162r is inserted through the right wire guide 115r. The tips of the second left bending wire 162l and the second right bending wire 162r are fixed to the second tip portion 117 as shown in Fig. 2. The tips of the second left bending wire 162l and the second right bending wire 162r fixed to the second tip portion 117 are disposed on both sides in the left-right direction (LR direction) with the central axis O in the longitudinal direction A in between.

[0031] The second bending portion 114 can be bent freely in a desired direction by pulling or relaxing the second bending wires 162 (the second upward bending wire 162u, the second downward bending wire 162d, the second left bending wire 162l, and the second right bending wire 162r).

[0032] As shown in FIGS. 4 and 5, the bending wire 160, a channel tube 171, an imaging cable 173, and a light guide 174 are inserted through an internal path 101 formed inside the bending portion 22.

[0033] 1, the imaging cable 173 and the light guide 174 may be connected to the control device 10 via the connection portion 28b. Furthermore, the bending wire 160 and the channel tube 171 may be connected to the drive device 12 via the connection portion 28a.

[0034] In the embodiment, the connection portion 28a has a first vertical bending wire connection portion, a first left-right bending wire connection portion, a second vertical bending wire connection portion, and a second left-right bending wire connection portion. The first vertical bending wire connection portion is a mechanism for detachably connecting the wires (the first upward bending wire 161u and the first downward bending wire 161d) that bend the first bending portion 113 in the vertical direction to the driving device 12. The first left-right bending wire connection portion is a mechanism for detachably connecting the wires (the first left bending wire 161l and the first right bending wire 161r) that bend the first bending portion 113 in the horizontal direction to the driving device 12. The second vertical bending wire connection portion is a mechanism for detachably connecting the wires (the second upward bending wire 162u and the second downward bending wire 162d) that bend the second bending portion 114 in the vertical direction to the driving device 12. The second left / right bending wire connection section is a mechanism for detachably connecting wires (second left bending wire 162l and second right bending wire 162r) for bending the second bending section 114 in the left / right direction to the driving device 12. When the intraluminal device 2 is connected to the driving device 12 via the connection section 28a, an actuator (including at least an electric motor) provided in the driving device 12 can pull or relax the first bending wire 161 and the second bending wire 162 in response to a user operation to change the shape of the bending section 22. Note that in the embodiment, the bending section 22 is composed of two bending sections, the first bending section 113 and the second bending section 114, but may be composed of three or more independent bending sections, or may be composed of one bending section.

[0035] The contact sensing device 14 is a device that detects contact with an object and accepts a user input for operating the bending portion 22. The contact sensing device 14 may include a touch-sensitive input surface 14a for accepting the user input. During an endoscopic examination, a user inserts the intraluminal device 2 into the patient's body using one hand and inputs an operation to the contact sensing device 14 using the fingers of the other hand. For example, as shown in FIG. 1, the user may input an operation to the contact sensing device 14 by moving the thumb. The contact sensing device 14 is a position information input device that detects a contact point (touch position) of an object, and may be any of the types of a projected capacitive type, a surface capacitive type, a resistive film type, an infrared type, and an ultrasonic surface acoustic wave type. Note that the contact sensing device 14 may be a position information input device of a type that uses another type as long as it has a function of detecting a contact point of an object.

[0036] The contact sensing device 14 detects the position on the input surface 14a where the object is in contact, and outputs position information including the position coordinates of the contact point to the control device 10. If there is no contact point, that is, if the object is not in contact with the input surface 14a, the contact sensing device 14 outputs position information indicating that there is no contact point to the control device 10. The contact sensing device 14 may output position information to the control device 10 at a predetermined period. The contact sensing device 14 may include a pressure sensor that detects the pressing force of the object, and may output position information including the detected pressing force together with the position coordinates of the contact point to the control device 10. The contact sensing device 14 may detect the area where the object is in contact, and output position coordinates representing the area from the area of ​​contact to the control device 10, or may output position coordinates indicating the outline of the area of ​​contact to the control device 10. In the embodiment, the contact sensing device 14 is equipped with a wireless communication module, and transmits position information regarding the contact point to the control device 10 by wirelessly connecting to the control device 10 directly or via a wireless repeater, but may also be connected to the control device 10 by a cable.

[0037] The object touching the input surface 14a may be the user's finger, a gloved finger, or a touch pen such as a stylus pen. The user may touch the touch sensing device 14 with any object. The following describes a case where the user touches the touch sensing device 14 with a finger.

[0038] 6 shows functional blocks of the control device 10. The control device 10 includes a communication unit 38 and a processing unit 40, and the processing unit 40 includes an image processing unit 42, a light source control unit 44, an operation detection unit 46, and a drive control unit 48. The communication unit 38 is wirelessly connected to the contact sensing device 14 and receives position information related to the contact point from the contact sensing device 14. The operation detection unit 46 acquires the position information related to the contact point received by the communication unit 38 and detects an operation input by the user.

[0039] The control device 10 includes a computer, and the computer executes a program to realize various functions shown in Fig. 6. The computer includes hardware such as a memory into which the program is loaded, one or more processors that execute the loaded program, an auxiliary storage device, and other LSIs. The processor is composed of multiple electronic circuits including a semiconductor integrated circuit and an LSI, and the multiple electronic circuits may be mounted on one chip or multiple chips. The functional blocks shown in Fig. 6 are realized by cooperation between hardware and software, and therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various forms by hardware alone, software alone, or a combination thereof.

[0040] The image processing unit 42 performs image processing on the imaging signal photoelectrically converted by the imaging unit of the intraluminal device 2 to generate an endoscopic image, which is displayed in real time on the display device 3. The image processing unit 42 may have a function of performing special image processing for the purpose of highlighting or the like, in addition to normal image processing such as A / D conversion and noise removal. By incorporating the special image processing function, the image processing unit 42 can generate an endoscopic image that has not been subjected to special image processing and an endoscopic image that has been subjected to special image processing, from an imaging signal captured using normal light.

[0041] The light source control unit 44 supplies illumination light to the light guide according to the imaging mode. The light source control unit 44 may supply normal light (white light) or special light such as narrow band light or excitation light to the light guide according to the observation mode.

[0042] The operation detection unit 46 identifies the movement of the user's fingers from the position information of the contact point, and detects the user operation based on the movement of the user's fingers. In the embodiment, the operation detection unit 46 detects a user operation that changes the shape of the bending portion 22 based on the movement of the user's fingers sliding on the input surface 14a. Hereinafter, the user operation that changes the shape of the bending portion 22 is called a "bending operation (first operation)". The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46 to perform shape control that changes the shape of the bending portion 22. Specifically, the drive control unit 48 causes the drive device 12 to pull or relax the first bending wire 161 and the second bending wire 162, respectively, to bend the bending portion 22 in a desired direction at a desired angle.

[0043] The operation detection unit 46 detects a user operation for maintaining the curved shape of the bending portion 22 based on the movement of the user's fingers while the user continues to touch the contact sensing device 14 after starting detection of the bending operation. Specifically, the operation detection unit 46 detects a user operation for maintaining the curved shape of the bending portion 22 based on the movement of the user's fingers pressing in or the movement of the user's fingers stopping for a predetermined period of time or more. Hereinafter, a user operation for maintaining the curved shape of the bending portion 22 is referred to as an "angle lock operation (second operation)." The drive control unit 48 controls the drive device 12 based on the angle lock operation detected by the operation detection unit 46 to perform a first control (angle lock control) for maintaining the shape of the bending portion 22.

[0044] In an examination using a conventional non-electrically driven endoscope (an endoscope of a type in which the bending portion is bent manually), the user operates the angle knob of the endoscope operation unit to point the tip of the bending portion in the desired direction, then locks the angle fixing lever of the endoscope operation unit to maintain the curved shape of the bending portion (angle lock), and captures an image of the site where the lesion is present with the imaging unit. After capturing an image of the lesion, when the doctor unlocks the angle fixing lever, the bending portion gradually returns from the curved shape to its original straight shape due to its elastic force.

[0045] In the intraluminal device 2 of the embodiment, the bending portion 22 is covered with an elastic outer sheath 118 and a tube or sheath is also provided inside, so that the bent bending portion 22 has an elastic force for returning to a straight shape. However, the intraluminal device 2 of the embodiment is electrically driven, and the first bending wire 161 and the second bending wire 162 are connected to the actuator of the drive unit 12, so that when the angle lock is released, this connection structure acts as a resistance to the elastic force. Therefore, when the angle lock is released, the bent shape of the electrically driven bending portion 22 cannot be quickly returned to the original straight shape, unlike a non-electrically driven bending portion. Therefore, when a user who is accustomed to operating a non-electrically driven endoscope uses the electrically driven intraluminal device 2, it is preferable to give the user an operating feeling equivalent to that of a non-electrically driven endoscope when the angle lock is released.

[0046] Hereinafter, the operation for bending the bending portion 22 (bending operation, first operation) will be described. 7 shows how a user's finger touching the input surface 14a of the contact sensing device 14 slides (moves) on the input surface 14a. First, the user touches the finger at position P1, and then slides the finger downward to position P3. The contact sensing device 14 periodically (with a period T) transmits position information of the contact point to the control device 10. Such a movement of sliding the finger on the input surface 14a may be called a swipe gesture.

[0047] In the control device 10, the operation detection unit 46 acquires position information (position coordinates) of the contact point. When the contact point positions are continuous in time, the operation detection unit 46 detects that the user's input is a bending operation that changes the shape of the bending portion 22. When two conditions are satisfied: (Condition 1) position information including position coordinates is continuously and periodically acquired, and (Condition 2) the movement distance in one period is equal to or less than a predetermined threshold, the operation detection unit 46 may determine that the contact point positions are continuous in time and detect that the user's input is a bending operation.

[0048] The operation detection unit 46 derives the moving distance and moving direction of the contact point from the time-series contact point position information (position coordinates). The detected moving distance may be the moving distance per unit time, in which case the operation detection unit 46 may derive the moving speed of the contact point. The operation detection unit 46 notifies the drive control unit 48 that a bending operation is being performed and the moving distance and moving direction of the contact point. When the drive control unit 48 is notified that a bending operation is being performed, it controls the actuator of the drive device 12 based on at least one of the moving distance and moving direction of the contact point.

[0049] 8(a) to 8(c) are diagrams for explaining how a user's bending operation changes the shape of the bending section 22, which is a part of the intraluminal device 2. It is assumed that the contact point shown in Fig. 7 moves at a constant speed from position P1 to P3.

[0050] Fig. 8(a) shows a state in which the curved portion 22 is in a straight line shape. The state shown in Fig. 8(a) is, for example, a state at the moment when the user's finger touches the position P1 of the input surface 14a.

[0051] FIG. 8(b) shows a state in which the shape of the bending portion 22 has changed. When the contact point moves from position P1 to position P2, the drive control unit 48 controls the actuator of the drive device 12 based on the moving distance and moving direction to perform shape control to change the shape of the bending portion 22. The drive control unit 48 may determine the bending amount (bending angle) and bending direction of the bending portion 22 based on the moving distance and moving direction of the contact point. In this example, since the moving direction of the contact point is downward, the drive control unit 48 relaxes the first upward bending wire 161u and the second upward bending wire 162u and pulls the first downward bending wire 161d and the second downward bending wire 162d, thereby bending the bending portion 22 so that the tip portion 20 faces downward.

[0052] Fig. 8(c) shows a state in which the shape of the bending portion 22 has further changed. When the contact point moves from position P2 to position P3, the drive control unit 48 controls the actuator of the drive device 12 based on the moving distance and moving direction to change the shape of the bending portion 22. In this example, the drive control unit 48 further relaxes the first upward bending wire 161u and the second upward bending wire 162u and further pulls the first downward bending wire 161d and the second downward bending wire 162d, thereby bending the bending portion 22 to a larger bending angle than in the bending state shown in Fig. 8(b).

[0053] During an endoscopic examination, the user bends the bending section 22 to direct the imaging section arranged at the distal end portion 20 toward the lesion, and maintains the curved shape of the bending section 22 (angle lock) when the lesion is positioned approximately in the center of the angle of view of the imaging section. Therefore, it is preferable that the user performs the bending operation while viewing the endoscopic image displayed on the display device 3, and can easily and quickly perform the operation to maintain the curved shape (angle lock operation) at the desired timing, that is, when the lesion is positioned approximately in the center of the angle of view.

[0054] For example, if an operation button for inputting an angle lock operation is provided on the outer frame of the contact detection device 14, the user can input the angle lock operation by pressing the operation button after completing the bending operation. However, since the user inputs the operation to the contact detection device 14 with one hand, in order to press the operation button, it is necessary to remove the finger from the input surface 14a once after the bending operation. Therefore, the bending portion 22 that is not angle locked may move between the time when the finger leaves the input surface 14a and the time when the operation button is pressed, and the positional relationship between the angle of view and the lesion may be shifted. For this reason, providing an operation button for inputting an angle lock operation on the outer frame of the contact detection device 14 is not a suitable input means.

[0055] Therefore, a method is proposed below that allows the user to perform the angle lock operation without removing his / her fingers from the input surface 14a. Example 1 9 shows the relationship between the movement of the finger with respect to the contact sensing device 14 and the control performed by the drive control unit 48 in the first embodiment. In the first embodiment, the contact sensing device 14 includes a pressure sensor that detects the pressure with which the finger presses the input surface 14a. The contact sensing device 14 periodically transmits position information including the position coordinates of the contact point and the pressure of the finger to the control device 10. In the first embodiment, the user can perform an angle lock operation by strongly pressing the finger against the input surface 14a and then releasing it at a position where the movement of the finger has ended.

[0056] The contact sensing device 14 detects contact with a user's finger at time t1. The operation detection unit 46 determines that the contact point positions are continuous over time based on the time-series position information of the contact point between times t1 and t2, and detects that the user's input is a bending operation that changes the shape of the bending portion 22. The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46, and performs shape control that changes the shape of the bending portion 22.

[0057] When the pressing force exceeds a predetermined threshold value Fth at time t2, the operation detection unit 46 detects the start of an angle lock operation that maintains the curved shape of the bending portion 22. At this point, the angle lock operation is not yet valid. After the angle lock operation starts, the operation detection unit 46 detects the end of the angle lock operation at the timing (time t3) when the finger leaves the input surface 14a, and recognizes it as a valid angle lock operation. In other words, the operation detection unit 46 detects a valid angle lock operation by detecting a pressure change in which the pressing force detected on the input surface 14a exceeds the threshold value Fth and the pressing force becomes substantially zero.

[0058] Thus, in the first embodiment, the finger movement for the angle lock operation is a movement of pressing the finger into the input surface 14a so that the pressing force exceeds a predetermined threshold value Fth, and then releasing the finger from the input surface 14a. The finger movement for the angle lock operation may be called a hold gesture. The user can easily realize the change in shape of the bending portion 22 and the maintenance of the shape by performing a swipe gesture and a hold gesture continuously and seamlessly without releasing the finger from the input surface 14a. The threshold value Fth may be set for each user. Note that the hold gesture and the swipe gesture may be performed simultaneously. For example, when a swipe gesture is performed in a state where the pressing force exceeds a predetermined threshold value Fth, a bending operation is detected during the swipe, and when the finger is released from the input surface 14a, a valid angle lock operation is detected.

[0059] Note that even after detecting the start of the angle lock operation, the operation detection unit 46 continues to detect the bending operation because the contact point position is continuous over time. However, if the position of the contacting finger does not move (movement distance is zero) between the start (time t2) and end (time t3) of the angle lock operation, the curved shape of the bending portion 22 does not change. When the finger is released from the input surface 14a at time t3, the operation detection unit 46 determines the end of the bending operation and detects a valid angle lock operation.

[0060] The operation detection unit 46 may determine whether the angle lock operation is valid based on the time from when the pressure falls below the threshold Fth to when it becomes zero, on the condition that the pressure exceeds the threshold Fth. In Fig. 9, the pressure falls below the threshold Fth at time ta and becomes zero at time t3, but if (t3-ta) is equal to or less than a predetermined time (for example, 1 second), the operation detection unit 46 may determine that the angle lock operation is valid. In this case, if (t3-ta) exceeds the predetermined time, the operation detection unit 46 may determine that the angle lock operation is invalid.

[0061] When the angle lock operation is detected, the drive control unit 48 controls the drive device 12 to implement a first control (angle lock control) for maintaining the changed shape of the bending portion 22. The drive control unit 48 may control the drive device 12 so as to maintain the shape of the bending portion 22 at the time when the bending operation is completed or when a valid angle lock operation is detected. The drive control unit 48 may implement the first control by using the following method.

[0062] (1) Bending angle control method The drive control unit 48 estimates the bending angle of the bending portion 22 at the start of angle locking from the tension of each of the first bending wire 161 and the second bending wire 162. The drive control unit 48 performs control to maintain the bending angle of the bending portion 22 by maintaining the tension of each of the first bending wire 161 and the second bending wire 162. (2) Motor angle control method The drive control unit 48 stores the motor angle in the drive device 12 at the start of angle locking, and performs control to maintain the bending angle of the bending portion 22 by maintaining the motor angle. (3) Motor lock control method When the angle lock is started, the drive control unit 48 shorts the motor terminals in the drive device 12 to apply a brake to the motor, thereby maintaining the bending angle of the bending portion 22. The drive control unit 48 may employ any of the above techniques or other techniques to maintain the curved shape of the bending portion 22.

[0063] The angle lock state may be released the moment the user's finger touches the input surface 14a. In other words, when the drive control unit 48 is executing the first control (angle lock control), if the operation detection unit 46 acquires position information including the position coordinates of the contact point from the contact sensing device 14, the drive control unit 48 may immediately stop executing the first control.

[0064] The contact sensing device 14 detects contact with the user's finger at time t4. At this moment, the drive control unit 48 immediately stops the first control. The operation detection unit 46 determines that the contact point positions are continuous over time based on the time-series position information of the contact point between times t4 and t5, and detects that the user's input is a bending operation. The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46, and performs shape control to change the shape of the bending portion 22.

[0065] If the operation detection unit 46 detects a bending operation based on the time-series position information of the contact point after time t4 and then ends the bending operation without detecting an angle lock operation, the drive control unit 48 ends the shape control at time t5 and then performs a second control different from the first control. A specific example of the second control will be described below.

[0066] (a) Linearization control The drive control unit 48 controls the bent bending portion 22 to return to a straight shape. For example, as shown in FIG. 8(b) and FIG. 8(c), when the distal end portion 20 faces downward and the bending portion 22 is bent, the first upward bending wire 161u and the second upward bending wire 162u are relaxed, and the first downward bending wire 161d and the second downward bending wire 162d are pulled. Therefore, the drive control unit 48 pulls the first upward bending wire 161u and the second upward bending wire 162u and relaxes the first downward bending wire 161d and the second downward bending wire 162d so that the bending portion 22 becomes a straight shape. By the drive control unit 48 performing the straightening control, it is possible to provide a behavior in which the bending portion 22 returns from a curved shape to a straight shape to a user who has finished the bending operation.

[0067] (b) Straightening control + external force monitoring The drive control unit 48 controls the curved bending portion 22 to return to a straight shape, and stops the straightening control when an external force acts on the bending portion 22. In this case, the intraluminal device 2 or the drive unit 12 may have an external force sensor that detects the external force acting on the bending portion 22. For example, one embodiment of the external force sensor may be a plurality of pressure-sensitive sensors provided on the surface or inside the bending portion 22.

[0068] When an external force acts on the bending portion 22, the drive control unit 48 immediately stops the straightening control, thereby preventing excessive force from being applied to the lumen. At this time, the drive control unit 48 may perform a second control to maintain the shape of the bending portion 22 at the time when the external force was detected. Note that when the external force sensor detects that no external force is acting, the drive control unit 48 may resume the straightening control.

[0069] (c) Wire-free control The drive control unit 48 prevents the movement of the bending portion 22 from being restricted by the bending wires 160 connected to the bending portion 22, allowing the bending portion 22 to change its shape in response to an external force. For example, the drive control unit 48 may shorten the wire path length and sufficiently relax all of the bending wires 160, thereby releasing the restriction on the movement of the bending portion 22 caused by the bending wires 160. For example, when the bending wires 160 are connected to the bending portion 22 via pulleys, the drive control unit 48 may shorten the wire path length by shifting the position of the pulley.

[0070] Furthermore, in the case where the traction device of the bending wire 160 is connected to the motor via an electric clutch, the drive control unit 48 may cut off the power transmission by the electric clutch, thereby allowing the bending wire 160 to move freely. Furthermore, the drive control unit 48 may open the electric circuit of the motor, thereby allowing the motor to rotate passively, thereby allowing the bending wire 160 to move freely. By the drive control unit 48 executing the wire-free control, the bending portion 22 that is bent can return to its original straight shape by its elastic force without being restrained by the bending wire 160.

[0071] As described above, when the operation detection unit 46 does not detect the angle lock operation from the start to the end of the bending operation, the drive control unit 48 may perform a second control different from the angle lock control to return the curved bending portion 22 to its original linear shape. The second control to be performed may be any one of (a) to (c), or may be another control. For example, the intraluminal device 2 or the drive unit 12 may have an external force sensor that detects an external force acting on the bending portion 22, and the drive control unit 48 may control the shape of the bending portion 22 according to the magnitude and direction of the external force detected by the external force sensor. In this case, when an external force is applied to the bending portion 22, the drive control unit 48 may estimate the shape of the bending portion 22 that will be deformed by the external force, and control the shape of the bending portion 22 to the estimated shape.

[0072] FIG. 10 shows a flowchart for controlling the operation of the bending section 22. The operation detection unit 46 acquires contact information of the user's finger from the contact detection device 14 and monitors the presence or absence of contact (S10). When the operation detection unit 46 detects contact of the user's finger (Y in S10), the operation detection unit 46 acquires position information from the contact detection device 14 in a time series manner and detects a bending operation. The drive control unit 48 performs shape control for changing the shape of at least a part of the intraluminal device 2 based on the bending operation (S12). Note that if there is no change in the contact position, the drive control unit 48 executes shape control with a control amount of 0, and the shape does not change substantially. In an embodiment, the drive control unit 48 may control the bending angle of the bending section 22.

[0073] When the operation detection unit 46 detects a valid angle lock operation (Y in S14), the drive control unit 48 performs a first control (angle lock control) for maintaining the shape of the bending portion 22. Thus, according to the embodiment, the user can input bending operations and angle lock operations with seamless movements. Until the operation detection unit 46 detects contact with the user's fingers (N in S10), the drive control unit 48 continues to perform the first control, and when the operation detection unit 46 detects contact with the user's fingers (Y in S10), the drive control unit 48 ends the first control and performs shape control (S12).

[0074] In S14, if the operation detection unit 46 does not detect a valid angle lock operation (N in S14) but continues to detect the touch of the user's fingers (Y in S20), the drive control unit 48 continues to perform the shape control (S12). On the other hand, if the operation detection unit 46 no longer detects the touch of the user's fingers (N in S20), the drive control unit 48 ends the shape control and performs the second control (S22). Until the operation detection unit 46 detects the touch of the user's fingers (N in S10), the drive control unit 48 continues to perform the second control, and when the operation detection unit 46 detects the touch of the user's fingers (Y in S10), the drive control unit 48 ends the second control and performs the shape control (S12).

[0075] Example 2 11 shows the relationship between the movement of the finger with respect to the contact sensing device 14 and the control performed by the drive control unit 48 in the second embodiment. In the second embodiment, the contact sensing device 14 has a function of deriving the area of ​​contact of the finger with the input surface 14a. The contact sensing device 14 periodically transmits position information including the position coordinates of the contact point and the contact area of ​​the finger to the control device 10. In the second embodiment, the angle lock operation can be performed by making a hold gesture of pressing the finger against the input surface 14a and then releasing it at the position where the user has finished moving the finger.

[0076] The contact sensing device 14 detects contact with a user's finger at time t11. The operation detection unit 46 determines that the contact point positions are continuous over time based on the time-series position information of the contact point between times t11 and t12, and detects that the user's input is a bending operation. The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46, and performs shape control to change the shape of the bending portion 22.

[0077] When the contact area exceeds a predetermined threshold value Sth at time t12, the operation detection unit 46 detects the start of an angle lock operation that maintains the curved shape of the bending portion 22. At this point, the angle lock operation is not yet valid. After the angle lock operation starts, the operation detection unit 46 detects the end of the angle lock operation at the timing (time t13) when the finger leaves the input surface 14a, and recognizes it as a valid angle lock operation. In other words, the operation detection unit 46 detects a valid angle lock operation by detecting a change in area in which the contact area of ​​the finger exceeds Sth and the contact area becomes substantially zero. When a valid angle lock operation is detected, the drive control unit 48 starts angle lock control.

[0078] In this manner, in the second embodiment, the finger motion for the angle lock operation is a motion of pressing the finger into the input surface 14a so that the contact area exceeds a predetermined threshold Sth, and then releasing the finger from the input surface 14a. The user can easily change the shape of the bending portion 22 and maintain the shape by continuously and seamlessly performing a swipe gesture and a hold gesture without releasing the finger from the input surface 14a. The threshold Sth may be set for each user.

[0079] Note that even after detecting the start of the angle lock operation, the operation detection unit 46 continues to detect the bending operation because the contact point position is continuous over time. However, if the position of the contacting finger does not move (movement distance is zero) between the start and end of the angle lock operation, the curved shape of the bending portion 22 does not change. When the finger is released from the input surface 14a at time t13, the operation detection unit 46 determines the end of the bending operation and detects a valid angle lock operation.

[0080] The operation detection unit 46 may determine whether the angle lock operation is valid based on the time from when the contact area falls below the threshold Sth to when it becomes zero, on the condition that the contact area exceeds the threshold Sth. In Fig. 11, the contact area falls below the threshold Sth at time tb and becomes zero at time t13, but if (t13-tb) is equal to or less than a predetermined time (for example, 1 second), the operation detection unit 46 may determine that the angle lock operation is valid.

[0081] The contact sensing device 14 detects contact with a user's finger at time t14. The operation detection unit 46 determines that the contact point positions are continuous over time based on the time-series position information of the contact point between times t14 and t15, and detects that the user's input is a bending operation. The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46, and performs shape control to change the shape of the bending portion 22.

[0082] If the operation detection unit 46 detects a bending operation based on time-series position information of the contact point after time t14 and then ends the bending operation without detecting an angle lock operation, the drive control unit 48 may perform a second control different from the first control after ending the shape control at time t15. In other words, if the operation detection unit 46 does not detect an angle lock operation from the start to the end of the bending operation, the drive control unit 48 may perform the above-mentioned second control.

[0083] Example 3 12 shows the relationship between the movement of the hand and fingers relative to the contact sensing device 14 in the third embodiment and the control performed by the drive control unit 48. The contact sensing device 14 in the third embodiment does not need to have a pressure detection function or a contact area measurement function. The contact sensing device 14 periodically transmits position information of the contact point to the control device 10, and the operation detection unit 46 derives the moving speed of the contact point in real time. In the third embodiment, the angle lock operation can be performed by making a hold gesture in which the user stops the movement of the hand and fingers for a predetermined period of time or more at the position where the movement of the hand and fingers has ended and then releases the hand and fingers.

[0084] The contact sensing device 14 detects contact with a user's finger at time t21. The operation detection unit 46 determines that the contact point positions are continuous over time based on the time-series position information of the contact point between times t21 and t22, and detects that the user's input is a bending operation. The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46, and performs shape control to change the shape of the bending portion 22.

[0085] At time t22, when the moving speed of the contact point falls below a predetermined threshold Vth, the operation detection unit 46 detects the start of an angle lock operation that maintains the curved shape of the bending portion 22. At this point, the angle lock operation is not yet valid. After the start of the angle lock operation, the operation detection unit 46 detects the end of the angle lock operation at the timing (time t23) when the finger leaves the input surface 14a, and recognizes it as a valid angle lock operation. The operation detection unit 46 detects that the finger leaves the input surface 14a after a period in which the moving speed of the finger falls below Vth continues for a predetermined time or more, thereby detecting a valid angle lock operation, and the drive control unit 48 starts the angle lock control. The threshold Vth is set to a value for determining that the finger is substantially still, and the predetermined time for determining that the finger is still may be, for example, about 2 seconds.

[0086] In this manner, in the third embodiment, the finger motion for the angle lock operation is a motion in which the finger is held still on the input surface 14a for a predetermined period of time or more, and then the finger is released from the input surface 14a. The user can easily change the shape of the bending portion 22 and maintain the shape by continuously and seamlessly performing a swipe gesture and a hold gesture without releasing the finger from the input surface 14a.

[0087] Note that even after detecting the start of the angle lock operation, the operation detection unit 46 continues to detect the bending operation because the contact point position is continuous over time. However, in the third embodiment, the position of the contacting finger is stationary (movement speed is substantially zero) between the start and end of the angle lock operation, so the curved shape of the bending portion 22 does not change. When the finger is released from the input surface 14a at time t23, the operation detection unit 46 determines the end of the bending operation and detects a valid angle lock operation.

[0088] The contact sensing device 14 detects contact with a user's finger at time t24. The operation detection unit 46 determines that the contact point positions are continuous over time based on the time-series position information of the contact point between times t24 and t25, and detects that the user's input is a bending operation. The drive control unit 48 controls the drive device 12 based on the bending operation detected by the operation detection unit 46, and performs shape control to change the shape of the bending portion 22.

[0089] If the operation detection unit 46 detects a bending operation based on time-series position information of the contact point after time t24 and then ends the bending operation without detecting an angle lock operation, the drive control unit 48 may perform a second control different from the first control after ending the shape control at time t25. In other words, if the operation detection unit 46 does not detect an angle lock operation from the start to the end of the bending operation, the drive control unit 48 may perform the above-mentioned second control.

[0090] The present disclosure has been described above based on a number of examples. These embodiments and examples are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present disclosure. In the embodiment, the bending section 22 is composed of two bending sections, the first bending section 113 and the second bending section 114, but it may be composed of one bending section, or three or more bending sections. [Industrial Applicability]

[0091] The present invention can be applied to a medical system for observing and treating the inside of a hollow organ or the like. [Explanation of symbols]

[0092] 1. Intraluminal Device System 2. Intraluminal Devices 3 Display device 10 Control device 12 Drive unit 14 Contact detection device 18 Insertion section 20 Tip 22 Curved section 24 Soft parts of the body 26 Extracorporeal soft parts 28 Connection 30 Connecting part 38 Communications Department 40 Processing section 42 Image processing section 44 Light source control unit 46 Operation detection unit 48 Drive control unit 101 Internal Route 113 First curve 114 Second curved section

Claims

1. an intraluminal device for insertion into a lumen; A contact detection device that detects contact with an object; and one or more processors having hardware, The one or more processors: Detecting a first operation based on a movement of the object contacting the touch sensing device; performing shape control to change a shape of at least a portion of the intraluminal device based on the first operation; Detecting a second operation based on a movement of the object while the object continues to be in contact with the touch sensing device from when detection of the first operation is started; performing a first control to maintain the changed shape of at least a portion of the endoluminal device based on the second operation; An intraluminal device system comprising:

2. The one or more processors: When the first operation is ended without detecting the second operation after starting detection of the first operation, a second control different from the first control is performed. The intraluminal device system of claim 1 .

3. The one or more processors: implementing the first control to maintain the changed shape of at least a portion of the endoluminal device upon completion of the first manipulation or upon detection of the second manipulation; The intraluminal device system of claim 1 .

4. The intraluminal device has a bending portion capable of changing a shape and a flexible portion connected to a proximal end of the bending portion, The one or more processors: performing the first control such that the bending portion maintains the curved shape; The intraluminal device system of claim 1 .

5. The intraluminal device has a bending portion capable of changing a shape and a flexible portion connected to a proximal end of the bending portion, The one or more processors: performing the second control to allow the bending portion to change its shape in response to an external force; The intraluminal device system of claim 2 .

6. The intraluminal device has a bending portion capable of changing a shape and a flexible portion connected to a proximal end of the bending portion, The one or more processors: performing the second control to return the curved portion to a straight shape; The intraluminal device system of claim 2 .

7. An external force sensor for detecting an external force acting on the curved portion is further provided. The one or more processors: When the external force sensor detects an external force, the second control is performed so as to maintain the shape of the bent portion at the time when the external force was detected. The intraluminal device system of claim 6 .

8. An external force sensor for detecting an external force acting on the intraluminal device, The one or more processors: performing the second control to control a shape of at least a part of the intraluminal device in accordance with a magnitude and a direction of the external force detected by the external force sensor; The intraluminal device system of claim 2 .

9. The one or more processors: Detecting the first operation based on a sliding motion of the object; The second operation is detected based on a movement of pushing the object or a movement of keeping the object still for a predetermined period of time or longer. The intraluminal device system of claim 2 .

10. The one or more processors: Detecting a distance and a direction of movement of the contact point of the object; performing the shape control to change a shape of at least a part of the intraluminal device based on at least one of the moving distance and the moving direction; The intraluminal device system of claim 9 .

11. the contact sensing device includes a pressure sensor that detects a pressing force of the object; The one or more processors: detecting the second operation based on the pressing force detected by the pressure sensor; The intraluminal device system of claim 2 .

12. The one or more processors: detecting the second operation based on an area of ​​a contact point of the object or a moving speed of the contact point; The intraluminal device system of claim 10 .

13. An intraluminal device system including an intraluminal device to be inserted into a lumen and a contact detection device to detect contact with an object, comprising: The touch sensing device detects a first operation based on a movement of the object touching the touch sensing device; The intraluminal device changes at least a portion of its shape according to a shape control based on the first operation; the touch sensing device detects a second operation based on a movement of the object while the object continues to be in contact with the touch sensing device from when detection of the first operation starts; the intraluminal device maintains at least a portion of the changed shape according to a first control based on the second operation. A method of operation of an endoluminal device system.

14. When the first operation is ended without detecting the second operation after starting detection of the first operation, the intraluminal device operates according to a second control different from the first control. A method for operating an intraluminal device system according to claim 13.

15. The intraluminal device maintains the changed shape of at least a portion of the intraluminal device at the end of the first operation or at the detection of the second operation in accordance with the first control. A method for operating an intraluminal device system according to claim 13.

16. The intraluminal device has a bending portion capable of changing a shape and a flexible portion connected to a proximal end of the bending portion, The intraluminal device maintains the curved shape of the curved portion in accordance with the first control. A method for operating an intraluminal device system according to claim 13.

17. A computer program storage medium for storing a program for controlling an intraluminal device to be inserted into a lumen, the computer comprising: detecting a first operation based on a movement of an object touching the touch sensing device; a function of performing shape control to change a shape of at least a part of the intraluminal device based on the first operation; a function of detecting a second operation based on a movement of the object while the object continues to be in contact with the touch sensing device after starting detection of the first operation; A computer program storage medium storing a program for realizing a function of performing first control to maintain the changed shape of at least a portion of the intraluminal device based on the second operation.

18. The computer includes: The computer program storage medium according to claim 17, storing a program that realizes a function of performing a second control different from the first control when the first operation ends without detecting the second operation after starting detection of the first operation.

19. The computer includes: The computer program storage medium of claim 17, storing a program that realizes a function of implementing the first control to maintain the changed shape of at least a portion of the intraluminal device upon completion of the first operation or detection of the second operation.

20. The intraluminal device has a bending portion capable of changing a shape and a flexible portion connected to a proximal end of the bending portion, The computer includes: The computer program storage medium according to claim 17, storing a program for implementing a function of performing the first control for maintaining the curved shape of the bending portion.

Images