Endoscope device, image output method for display, computer-readable medium, and endoscope system
By acquiring channel and angle information from endoscopic images to generate display images, the problem of difficulty in controlling the direction of instruments when endoscopic images are rotated is solved, enabling convenient guidance for surgical operators.
Patent Information
- Application Number
- CN201980101975.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-11-05
- Publication Date
- 2025-11-11
- Estimated Expiration
- 2039-11-05
AI Technical Summary
When the endoscopic image is rotating, it is difficult for the surgeon to accurately determine the direction of insertion of the instruments.
By acquiring the channel information and display angle information of the endoscopic image, the system generates endoscopic images and channel guidance images for display and outputs them to the display device to help the surgeon understand the direction of instrument entry.
Even when the endoscopic image is rotated, the surgeon can easily control the direction of insertion of the instruments.
Smart Images

Figure CN114667093B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to an endoscope device, an image output method for display, a computer-readable medium, and an endoscope system. Background Technology
[0002] Previously, endoscopic devices capable of generating endoscopic images based on camera signals generated by an endoscope and displaying them on a monitor were known. Furthermore, endoscopes equipped with a channel (instrument channel) for guiding instruments to the target site were also known. When using such an endoscope, the surgeon can simultaneously observe the instruments and target site reflected in the endoscopic image displayed on the monitor while using the instruments to treat the target site. The direction in which the instruments enter the endoscopic image is determined by the positional relationship between the objective lens on the endoscope's tip and the exit of the instrument channel. Moreover, the objective lens is part of an optical system that images the subject onto a camera element located at the tip of the endoscope.
[0003] However, in endoscopic devices that allow the endoscopic image displayed on the monitor to be rotated according to the surgeon's instructions, the direction in which the instruments enter the endoscopic image varies depending on the rotation of the endoscopic image. Therefore, when using endoscopes with multiple channels, it is not easy for the surgeon to immediately determine the direction in which the instruments enter the endoscopic image.
[0004] On the other hand, there are known endoscope systems that do not cause the surgical operator to feel unnatural about the direction of entry of the instrument in the image (see Patent Document 1). In this endoscope system, when the user specifies the direction in which the instrument enters the displayed image (the direction in which the instrument appears), the image is magnified and / or reduced as if the instrument were appearing from that direction to create a rotated magnified image.
[0005] Existing technical documents
[0006] Patent documents
[0007] Patent Document 1: Japanese Patent Application Publication No. 2013-192803 Summary of the Invention
[0008] The problem the invention aims to solve
[0009] In view of the above-mentioned circumstances, the object of the present invention is to provide an endoscope device, an image output method for display, a computer-readable medium, and an endoscope system that allows the surgeon to easily control the direction in which instruments or the like enter the endoscope image, even when the endoscope image displayed on the monitor is rotated in response to the surgeon's instructions.
[0010] Solution for solving the problem
[0011] One aspect of the present invention is an endoscope device comprising a processor configured to perform the following processes: generating an endoscope image based on an image signal generated by an image-sensing unit provided at the front end of an insertion section; acquiring channel information related to a channel formed in the insertion section; acquiring angle information related to the display angle of the endoscope image; and outputting a display image comprising a display endoscope image and a channel guidance image, wherein the display endoscope image is an image generated based on the angle information and the endoscope image, and the channel guidance image is an image generated based on the angle information and the channel information.
[0012] Another aspect of the present invention is a display image output method, which generates an endoscope image based on a camera signal generated by a camera unit provided at the front end of the insertion part, acquires channel information related to a channel formed in the insertion part, acquires angle information related to the display angle of the endoscope image, and outputs a display image including a display endoscope image and a channel guidance image, wherein the display endoscope image is an image generated based on the angle information and the endoscope image, and the channel guidance image is an image generated based on the angle information and the channel information.
[0013] Another aspect of the present invention is a computer-readable medium containing a program that causes a computer to perform the following processes: generating an endoscopic image based on a camera signal generated by a camera unit located at the front end of the insertion portion; acquiring channel information related to a channel formed in the insertion portion; acquiring angle information related to the display angle of the endoscopic image; and outputting a display image including a display endoscopic image and a channel guidance image, wherein the display endoscopic image is an image generated based on the angle information and the endoscopic image, and the channel guidance image is an image generated based on the angle information and the channel information.
[0014] Another aspect of the present invention is an endoscope system comprising an endoscope and an endoscope device, wherein the endoscope includes: an imaging element at a front end of an insertion portion; a channel formed in the insertion portion; and a memory storing channel information related to the channel; and the endoscope device includes a processor configured to perform the following processes: generating an endoscope image based on an imaging signal output from the imaging element; acquiring the channel information; acquiring angle information related to the display angle of the endoscope image; and outputting a display image including a display endoscope image and a channel guidance image, wherein the display endoscope image is an image generated based on the angle information and the endoscope image, and the channel guidance image is an image generated based on the angle information and the channel information.
[0015] The effects of the invention
[0016] According to the present invention, even when the endoscopic image displayed on the monitor is rotated in response to the surgeon's instructions, the surgeon can easily control the direction in which instruments and the like enter the endoscopic image. Attached Figure Description
[0017] Figure 1 This is a diagram illustrating the structure of an endoscope system including an endoscope device according to one embodiment.
[0018] Figure 2 This is a diagram illustrating the functional structures in an endoscope system related to the display of images.
[0019] Figure 3 This is an example of a channel guide image included in the channel information.
[0020] Figure 4 This is a flowchart illustrating the display image output processing performed in an endoscope device according to one embodiment.
[0021] Figure 5 This is an example of passing. Figure 4 The illustrated diagram shows the endoscopic image before and after rotation indication, output by the image output processing and displayed by the display device.
[0022] Figure 6 This is a diagram illustrating the hardware structure of a computer. Detailed Implementation
[0023] The embodiments of the present invention will now be described with reference to the accompanying drawings.
[0024] Figure 1 This is a diagram illustrating the structure of an endoscope system including an endoscope device according to one embodiment.
[0025] Figure 1 The illustrated endoscope system 1 includes an endoscope 10, an endoscope device 20, and a display device 30, with the endoscope 10 and display device 30 connected to the endoscope device 20. In this embodiment, the endoscope 10 and the endoscope device 20, and the endoscope device 20 and the display device 30, exchange signals (data, information) via a wired connection, but they can also be exchanged wirelessly.
[0026] Endoscope 10 is a flexible endoscope having an operating part 101 operated by a surgical operator and an insertion part 102 inserted into the patient's body.
[0027] The operating unit 101 includes operating components for the surgical operator to control the endoscope 10, such as an angle knob for controlling the bending of the insertion section 102 upwards, downwards, leftwards, and rightwards, an air / water supply button for controlling air / water supply, and a suction button for controlling suction. Additionally, the operating unit 101 also includes a channel inlet (e.g., a forceps jaw) for inserting treatment instruments and operating components for indicating the endoscope device 20.
[0028] The insertion section 102 has multiple channels (pipelines) formed inside. These channels include channels for handling devices, channels for supplying air or water, and channels for suction. Furthermore, the insertion section 102 has an imaging unit (image unit 103 described later) at its front end 102a, and an optical system for imaging the subject onto the imaging element. Additionally, the insertion section 102 has multiple channel outlets and an objective lens at its front end surface 102b. The objective lens is part of the optical system for imaging the subject onto the imaging element.
[0029] The endoscope device 20 generates an endoscopic image based on the imaging signal generated by the imaging unit of the endoscope 10. Furthermore, the endoscope device 20 also generates a display endoscopic image after rotating the endoscopic image in response to an endoscope image rotation instruction from the surgeon, generates a channel guidance image for determining the exit position (exit direction) of the channel, generates a display image including the display endoscopic image and the channel guidance image, and outputs the display image. Moreover, the endoscope image rotation instruction from the surgeon is an instruction to rotate and display the endoscopic image on the display device 30 at a desired angle, and can be performed by operating the operation unit 101 of the endoscope 10 and the operation unit (operation unit 202 described later) of the endoscope device 20. This angle can be freely specified by the surgeon, or it can be selected by the surgeon from multiple different angles.
[0030] The display device 30 is a liquid crystal display device or the like, which displays images and the like output from the endoscope device 20.
[0031] Figure 2 This is a diagram illustrating the functional structures related to the display of images in the endoscope system 1.
[0032] exist Figure 2 In the illustrated endoscope system 1, the endoscope 10 includes an operation unit 101, an imaging unit 103, and a storage unit 104.
[0033] As described above, the operation unit 101, for example, when an operation is performed to instruct the endoscope device 20, outputs a signal (operation signal) corresponding to that operation to the endoscope device 20.
[0034] The imaging unit 103 includes an imaging element and a signal processing unit. The imaging element, for example, is a CCD (Charge Coupled Device), which converts the image of the subject imaged by an optical system including an objective lens into an electrical signal. The signal processing unit performs prescribed signal processing, such as gain adjustment and AD (Analog-to-Digital) conversion, on the electrical signal converted by the imaging element to generate an imaging signal. Alternatively, the signal processing unit can also be implemented using a circuit. In this case, the imaging unit 103 can also be configured as an imaging circuit including an imaging element and a signal processing circuit.
[0035] Storage unit 104 is a non-volatile memory storing information related to endoscope 10. This information includes endoscope type information and channel information related to the channel formed in insertion unit 102. The channel information includes information related to the channel's exit position (exit direction) when the endoscope image display angle (rotation angle) is a predetermined angle, or a channel guidance image when the endoscope image display angle is a predetermined angle. Here, the predetermined angle is 0°, or various angles from multiple different angles. Specific examples of the channel information will be described later.
[0036] The endoscope device 20 includes a storage unit 201, an operation unit 202, and a control unit 203.
[0037] The storage unit 201 is a non-volatile memory that stores various types of information, which is read by the control unit 203 as needed. The various types of information include channel information related to the channel formed in the insertion section 102 of the endoscope 10, or channel information for each type of endoscope.
[0038] The operation unit 202 is an operation panel, touch panel, etc., which accepts user input operations and outputs the corresponding signal (operation signal) to the control unit 203.
[0039] The control unit 203 controls the overall operation of the endoscope device 20. The control unit 203 includes a camera signal acquisition unit 204, a channel information acquisition unit 205, an operation signal processing unit 206, an angle information acquisition unit 207, an endoscope image generation unit 208, a channel guidance image generation unit 209, a display image generation unit 210, and a display image output unit 211.
[0040] The camera signal acquisition unit 204 acquires the camera signal generated by the camera unit 103 of the endoscope 10.
[0041] The channel information acquisition unit 205 acquires channel information related to the channel formed in the insertion section 102 of the endoscope 10. For example, the channel information acquisition unit 205 can acquire this channel information from the storage section 104 of the endoscope 10, or it can acquire it from the storage section 201. For example, if acquired from the storage section 201, the type information of the endoscope 10 can be acquired from the storage section 104 of the endoscope 10, and the channel information corresponding to that type information can be acquired from the storage section 201. Alternatively, for example, the channel information acquisition unit 205 can also acquire the channel information from a server (not shown) connected to the endoscope device 20 via a network. In this case, for example, the type information of the endoscope 10 can be acquired from the storage section 104 of the endoscope 10, and the channel information corresponding to that type information can be acquired by querying the server. Thus, for example, it is possible to solve the problem that if the channel information is stored in the endoscope device 20, it is difficult to support new endoscopes, or the problem that it is undesirable to install additional functions in the endoscope in order to achieve low-cost endoscope implementation.
[0042] The operation signal processing unit 206 receives operation signals output from the operation unit 202 and the operation unit 101 of the endoscope 10, and performs processing corresponding to the operation signals. For example, if the input operation signal is an operation signal related to the rotation indication of the endoscope image, angle information related to the rotation angle (display angle) of the endoscope image indicated by the indication is output to the angle information acquisition unit 207.
[0043] The angle information acquisition unit 207 acquires the angle information output from the operation signal processing unit 206.
[0044] The endoscope image generation unit 208 generates an endoscope image based on the camera signal acquired by the camera signal acquisition unit 204. Furthermore, the endoscope image generation unit 208 generates a display endoscope image based on the generated endoscope image and the angle information acquired by the angle information acquisition unit 207. The display endoscope image is an image obtained by rotating the endoscope image by the display angle represented by the angle information. Additionally, if the angle information acquisition unit 207 does not acquire angle information, the generated endoscope image is set as the display endoscope image.
[0045] The channel guidance image generation unit 209 generates a channel guidance image based on the channel information acquired by the channel information acquisition unit 205 and the angle information acquired by the angle information acquisition unit 207. The channel guidance image is an image used to guide the exit position (exit direction) of the channel when the display angle of the endoscope image is the display angle represented by the angle information. Furthermore, if the angle information acquisition unit 207 does not acquire angle information, the channel guidance image is generated only when the angle information acquisition unit 207 acquires angle information indicating a display angle of 0°.
[0046] The display image generation unit 210 generates a display image, which includes a display endoscope image generated by the endoscope image generation unit 208 and a channel guide image generated by the channel guide image generation unit 209.
[0047] The display image output unit 211 outputs the display image generated by the display image generation unit 210 to the display device 30.
[0048] The display device 30 includes a display section 301, which displays images and the like output from the display image output section 211 of the endoscope device 20.
[0049] Here is a specific example of the channel information mentioned above.
[0050] In this specific example, the number of channels formed in the insertion portion 102 of the endoscope 10 is two. Furthermore, based on the positional relationship between the two channel outlets on the front end face 102b of the insertion portion 102 and the objective lens, the direction from which the treatment instrument or the like enters the endoscope image displayed on the display device 30 at a display angle of 0° is 90° (right direction) and 225° (lower left direction). In this specific example, the directions 0°, 90°, 180°, and 270° are designated as up, right, down, and left, respectively.
[0051] In this case, the channel information may, for example, include information relating to the angles (90°, 225°) of the two channel exit positions when the endoscope image is displayed at 0°. Alternatively, the channel information may also include information relating to the angles (90°, 225°) of the two channel exit positions when the endoscope image is displayed at 0°, and information relating to the angles (270°, 45°) of the two channel exit positions when the endoscope image is displayed at 180°. In this way, the channel information may include information relating to the angles of the channel exit positions when the endoscope image is displayed at one or more specified angles.
[0052] Alternatively, the channel information may include, for example, a channel guide image when the endoscopic image is displayed at a 0° angle. Alternatively, the channel information may include, for example, a channel guide image when the endoscopic image is displayed at a 0° angle and a channel guide image when the endoscopic image is displayed at a 180° angle. In this way, the channel information may include channel guide images when the endoscopic image is displayed at one or more specified angles.
[0053] Figure 3 This is an example of a channel guide image included in the channel information.
[0054] exist Figure 3 In the diagram, channel guide image 401 is the channel guide image when the endoscope image is displayed at a 0° angle, and channel guide image 402 is the channel guide image when the endoscope image is displayed at a 180° angle. Guides 401a and 401b within channel guide image 401 are used to guide the exit position of the channel when the endoscope image is displayed at a 0° angle, and guides 402a and 402b within channel guide image 402 are used to guide the exit position of the channel when the endoscope image is displayed at a 180° angle.
[0055] Figure 4 This is a flowchart illustrating the display image output processing performed in the endoscope device 20. This display image output processing is also performed via… Figure 2 The processing of the functional structure of the illustrated endoscope device 20.
[0056] exist Figure 4 In the illustrated display image output processing, when the processing starts, the channel information acquisition unit 205 first acquires channel information related to the channel formed in the insertion part 102 of the endoscope 10 from the storage unit 104 or the storage unit 201 of the endoscope 10 (S11).
[0057] Next, the control unit 203 determines whether there is an endoscope image rotation instruction from the surgical operator or others (S12). For example, this determination is made based on whether an operation signal related to the endoscope image rotation instruction is input to the operation signal processing unit 206.
[0058] If the determination result of S12 is "yes", the operation signal processing unit 206 outputs angle information related to the rotation angle (display angle) of the endoscope image shown by the endoscope image rotation indicator of the input operation signal to the angle information acquisition unit 207, and the angle information acquisition unit 207 acquires the angle information (S13).
[0059] After S13, or if the determination result of S12 is "no", the camera signal acquisition unit 204 acquires the camera signal generated by the camera unit 103 of the endoscope 10 (S14).
[0060] Next, the endoscope image generation unit 208 generates an endoscope image based on the camera signal acquired in S14 (S15), and generates a display endoscope image based on the endoscope image and the angle information last acquired in S13 (the angle information last acquired in S13 after the start of the display image output processing) (S16). However, if the processing in S13 is not performed even once after the start of the display image output processing, the endoscope image generated in S15 is set as the display endoscope image.
[0061] Next, the channel guide image generation unit 209 generates a channel guide image (S17) based on the channel information obtained in S11 and the angle information obtained last in S13. However, if the processing of S13 is not performed even once after the display image output processing starts, the angle information obtained last in S13 is regarded as the angle information representing the display angle of 0°, and a channel guide image is generated.
[0062] Next, the display image generation unit 210 generates a display image, which includes the display endoscope image generated in S16 and the channel guidance image generated in S17 (S18).
[0063] Next, the display image output unit 211 outputs the display image generated in S18 to the display device 30 (S19). When the display device 30 is input with the display image output from the endoscope device 20 in S19, the display unit 301 displays the display image. Thus, a display image including the display endoscope image and the channel guidance image is displayed.
[0064] Next, the control unit 203 determines whether to end the process (S20). For example, this determination is made based on whether an operation signal related to the power cut-off indication of the endoscope device 20 is input to the operation signal processing unit 206.
[0065] If the determination result of S20 is "no", the processing returns to S12; if the determination result of S20 is "yes", the image output processing for display ends.
[0066] Figure 5 This is an example of passing. Figure 4 The illustrated diagram shows the endoscopic image before and after the rotation indicator of the image output from the image output processing and displayed by the display device 30.
[0067] In this example, three channels are formed in the insertion section 102 of the endoscope 10. Furthermore, as an endoscope image rotation indicator, an instruction is provided to rotate the endoscope image 180° (rotation display).
[0068] exist Figure 5 In the example shown on the upper side, the display image 501a is the display image before the endoscope image rotation indication, including the display endoscope image (endoscope image with a display angle of 0°) 502a and the channel guide image 503a. The guides 504a, 505a, and 506a within the channel guide image 503a are guides for the exit position of the channel at a time point before the endoscope image rotation indication (when the display angle of the endoscope image is 0°).
[0069] The display image 501b shown below is a display image after the endoscope image rotation indication, including a display endoscope image (endoscope image at a display angle of 180°) 502b and a channel guide image 503b. The guides 504b, 505b, and 506b within the channel guide image 503b are guides for the exit position of the channel at a time point after the endoscope image rotation indication (when the display angle of the endoscope image is 180°).
[0070] like Figure 5 As illustrated, in response to an endoscope image rotation instruction, the endoscope image 502a is rotated 180°, and the positions of the guides 504a, 505a, and 506a in the channel guide image 503a are changed. Furthermore, the three values in the channel guide image 503a represent the diameters of the three channel exits. Information related to the diameter of these channel exits is included, for example, in the channel information described above.
[0071] Therefore, by confirming the channel guide images 503a and 503b, the surgical operator can determine the channel exit position not only before but also after the endoscope image rotation indicator. For example, when the channel with a diameter of "3.6" is for the instrument, before the endoscope image rotation indicator, it is easy to determine that the instrument enters the display endoscope image 502a from above. Furthermore, after the endoscope image rotation indicator, it is easy to determine that the instrument enters the display endoscope image 502b from below.
[0072] Furthermore, the display images generated by the endoscope device 20 and displayed on the display device 30 are not limited to... Figure 5 the way exemplified.
[0073] For example, the display image may also include an endoscope information window that displays information related to the endoscope 10 (name, model, etc.), and a channel guidance image is displayed within this endoscope information window. In this case, only when the endoscope image is rotated can an icon indicating that the endoscope image has been rotated be further displayed within the endoscope information window, or the icon itself may also be rotated to match the rotation angle of the endoscope image. Such an endoscope information window can be displayed in a position that does not overlap with the display endoscope image.
[0074] Additionally, for example, the display image may also include a channel information window that displays channel information, within which a channel guidance image is displayed. In this case, only when the endoscopic image is rotated can an icon indicating that the endoscopic image has been rotated be further displayed within the channel information window, or the icon itself may also be rotated to match the rotation angle of the endoscopic image. Such a channel information window can be placed in a position that does not obstruct observation, and it can also be overlaid on the display endoscopic image.
[0075] Alternatively, for example, the displayed image may include both an endoscope information window and a channel information window. In this case, the structure can be configured such that the display of the channel information window can be selected from, for example, always displayed, displayed for 2 seconds, or not displayed, according to the settings of the surgical operator, etc.
[0076] Furthermore, in the images used for display described above, the shape of the endoscopic image is not limited to an octagon; for example, it can also be a circle. In this case, the shape of the channel guidance image can also be circular.
[0077] As described above, according to this embodiment, even when the endoscopic image displayed on the display device 30 is rotated in response to the instructions of the surgical operator, the surgical operator can easily control the direction in which the instruments enter the endoscopic image.
[0078] Furthermore, in this embodiment, the control unit 203 of the endoscope device 20 can also be implemented using integrated circuits such as ASIC (Application Specific Integrated Circuit) and FPGA (Field Programmable Gate Array).
[0079] Furthermore, the storage unit 201, operation unit 202, and control unit 203 of the endoscope device 20 can also be connected via a device having Figure 6 The illustrated hardware structure is implemented by a computer.
[0080] Figure 6 This is a diagram illustrating the hardware structure of a computer.
[0081] like Figure 6As illustrated, the computer 700 includes a processor 701 (such as a CPU, Central Processing Unit), a memory 702, an auxiliary storage device 703, an input device 704, a display device 705, an input / output interface 706, a communication control device 707, and a media drive device 708. These elements 701 to 708 in the computer 700 are interconnected via a bus 709, enabling data exchange between the elements.
[0082] The processor 701 controls the overall operation of the computer 700 by executing programs. For example, the processor 701 executes programs to implement... Figure 2 The program for the functions of the illustrated control unit 203. Based on this, for example, it executes... Figure 4 The illustrated display uses image output processing.
[0083] The memory 702 includes ROM (Read Only Memory) and RAM (Random Access Memory), which are not shown. The ROM of the memory 702 pre-stores programs and other data to be executed by the processor 701. The ROM of the memory 702 can be used to record data for implementing... Figure 2 The program for the functions of the illustrated control unit 203. The RAM of the memory 702 is used as the working area of the processor 701, etc.
[0084] The auxiliary storage device 703 is, for example, a hard disk such as an HDD (Hard Disk Drive) or a non-volatile memory such as flash memory. The auxiliary storage device 703 can store programs executed by the processor 701. The auxiliary storage device 703 can also be used to record data used for implementation... Figure 2 The procedure for the functions of the illustrated control unit 203.
[0085] Input device 704 may be, for example, a keyboard, mouse, or touch panel. When the operator of computer 700 performs a specified operation on input device 704, input device 704 sends input information corresponding to the content of the operation to processor 701. Input device 704 can be used as operation unit 202.
[0086] Display device 705 is, for example, a liquid crystal display device. Display device 705 can also be used as display device 30.
[0087] The input / output interface 706 connects the computer 700 to electronic components or external devices. The input / output interface 706 can be used to connect to the endoscope 10 or the display device 30.
[0088] The communication control device 707 connects the computer 700 to a network and controls various communications between the computer 700 and external devices (servers, etc.) via the network. The communication control device 707 can also connect the endoscope device 20 to a network for controlling various communications between the endoscope device 20 and the server via the network.
[0089] The media driving device 708 reads programs or data recorded in the removable recording medium 710, or writes data stored in the auxiliary storage device 703 to the removable recording medium 710. The removable recording medium 710 can also be used to record data used to implement… Figure 2 The program describes the functions of the control unit 203. For example, a Secure Digital (SD) standard memory card (flash memory) can be used as a removable recording medium 710. Furthermore, if the computer 700 is equipped with an optical disc drive that can be used as a media drive 708, various optical discs that the optical disc drive can recognize can be used as removable recording media 710. Examples of optical discs that can be used as removable recording media 710 include Compact Discs (CDs), Digital Versatile Discs (DVDs), and Blu-ray Discs (Blu-ray is a registered trademark).
[0090] Furthermore, in this embodiment, the endoscope system 1 is not limited to... Figure 1 The illustrated configuration can also integrate the endoscope 10, endoscope device 20, and display device 30 into a single unit, similar to a portable flexible endoscope. Alternatively, in the endoscope system 1, the endoscope 10 and endoscope device 20 can be integrated, as can the endoscope device 20 and display device 30. Furthermore, the endoscope system 1 can be configured such that the endoscope device 20 is implemented via a computer (server, etc.) connected to a network, and the endoscope 10 and endoscope device 20, as well as the endoscope device 20 and display device 30, are connected via the network.
[0091] The embodiments have been described above, but the present invention is not limited to the embodiments described above. During implementation, the constituent elements can be modified to be more specific without departing from the spirit of the invention. Furthermore, various inventions can be formed through appropriate combinations of the multiple constituent elements disclosed in the above embodiments. For example, some constituent elements may be deleted from all the constituent elements shown in the embodiments.
[0092] Explanation of reference numerals in the attached figures
[0093] 1: Endoscopic system; 10: Endoscope; 20: Endoscopic device; 30: Display device; 101: Operation unit; 102: Insertion unit; 102a: Front end; 102b: Front end face; 103: Camera unit; 104: Storage unit; 201: Storage unit; 202: Operation unit; 203: Control unit; 204: Camera signal acquisition unit; 205: Channel information acquisition unit; 206: Operation signal processing unit; 207: Angle information acquisition unit; 208: Endoscopic image generation unit; 209: Channel guidance image generation unit; 210: Display image generation unit; 211: Display image output unit; 301: Display unit; 401, 402: Channel guide image; 401a, 401b, 402a, 402b: guide; 501a, 501b: display image; 502a, 502b: display endoscopic image; 503a, 503b: channel guide image; 504a, 504b, 505a, 505b: guide; 506a, 506b: guide; 700: computer; 701: processor; 702: memory; 703: auxiliary storage device; 704: input device; 705: display device; 706: input / output interface; 707: communication control device; 708: media driving device; 709: bus; 710: removable recording medium.
Claims
1. An endoscope device comprising a processor, the processor being configured to perform the following processes: An endoscopic image is generated based on a camera signal generated by a camera unit located at the front end of the insertion section; Acquire channel information relating to each of the at least two channels formed in the insertion portion of the endoscope; Obtain angle information related to the display angle of the endoscopic image; Generate a display endoscope image based on the angle information and the endoscope image; Based on the angle information and the channel information, a channel guidance image is generated that is separated from the endoscopic image; as well as The output includes a display image of the endoscope image and the channel guide image. The channel information includes information related to the angle of the channel's exit position when the endoscope image is displayed at a specified angle, or the channel guide image when the endoscope image is displayed at a specified angle.
2. The endoscopic device according to claim 1, characterized in that, The endoscopic image for display is obtained by rotating the endoscopic image by the display angle represented by the angle information. The channel guidance image is an image used to guide the exit position of the channel when the display angle of the endoscope image is the display angle represented by the angle information.
3. The endoscopic device according to claim 1, characterized in that, The processor acquires the channel information from an endoscope having the insertion portion.
4. The endoscopic device according to claim 1, characterized in that, It also has a storage unit for storing the channel information. The processor obtains the channel information from the storage unit.
5. The endoscopic device according to claim 4, characterized in that, The storage unit stores channel information according to the type of endoscope. The processor obtains channel information from the storage unit corresponding to the type of endoscope having the insertion part.
6. The endoscopic device according to claim 1, characterized in that, The specified angle is 0°, or any of a number of different angles.
7. The endoscopic device according to claim 1, characterized in that, The channel information includes information related to the first channel and the second channel formed in the insertion part. The channel guidance image is an image used to guide the exit positions of the first channel and the second channel when the display angle of the endoscope image is the display angle represented by the angle information.
8. The endoscopic device according to claim 2, characterized in that, The channel guidance image is an image used to guide the exit position and diameter of the channel when the display angle of the endoscope image is the display angle represented by the angle information.
9. The endoscopic device according to claim 1, characterized in that, The processor performs the following processing: Acquire operational signals related to the rotation indication of the endoscopic image; Angle information is obtained based on the operation signal; The display endoscope image is updated based on the angle information and the endoscope image. The channel guidance image is updated based on the angle information and the channel information. as well as The output includes the updated display endoscope image and the updated channel guide image of the display image.
10. A method for outputting an image for display, characterized in that, An endoscopic image is generated based on the imaging signal produced by the imaging unit located at the front end of the insertion section. Obtain channel information relating to each of the at least two channels formed in the insertion portion of the endoscope. Obtain angle information related to the display angle of the endoscopic image. An endoscope image for display is generated based on the angle information and the endoscope image. Based on the angle information and the channel information, a channel-guided image is generated that is separated from the endoscopic image. The output includes a display image of the endoscopic image and the channel guide image. The channel information includes information related to the angle of the channel's exit position when the endoscope image is displayed at a specified angle, or the channel guide image when the endoscope image is displayed at a specified angle.
11. A computer-readable medium containing a program, characterized in that, The computer will perform the following processes: An endoscopic image is generated based on the camera signal generated by the camera unit located at the front end of the insertion section; Acquire channel information relating to each of the at least two channels formed in the insertion portion of the endoscope; Obtain angle information related to the display angle of the endoscopic image; Generate a display endoscope image based on the angle information and the endoscope image; Based on the angle information and the channel information, a channel guidance image is generated that is separated from the endoscopic image; as well as The output includes a display image of the endoscopic image and the channel guide image. The channel information includes information related to the angle of the channel's exit position when the endoscope image is displayed at a specified angle, or the channel guide image when the endoscope image is displayed at a specified angle.
12. An endoscope system comprising an endoscope and an endoscope device, wherein, The endoscope has the following features: A camera element is provided at the front end of the insertion part; The channel formed in the insertion part; and The memory stores channel information related to the channel. The endoscope device includes a processor configured to perform the following processes: An endoscopic image is generated based on the imaging signal output from the imaging element; Acquire channel information relating to each of the at least two channels formed in the insertion section; Obtain angle information related to the display angle of the endoscopic image; Generate a display endoscope image based on the angle information and the endoscope image; Based on the angle information and the channel information, a channel guidance image is generated that is separated from the endoscopic image; as well as The output includes a display image of the endoscopic image and the channel guide image. The channel information includes information related to the angle of the channel's exit position when the endoscope image is displayed at a specified angle, or the channel guide image when the endoscope image is displayed at a specified angle.
13. A computer program product comprising a computer program that, when executed by a processor, performs the display image output method according to claim 10.
Citation Information
Patent Citations
Endoscope system
JP2013192803A
Ultrasonic diagnosis apparatus
US20070078343A1