Method for user-friendly playback of a video and associated endoscopic image acquisition system

Abstract

In summary, a simplified approach for user-friendly playback of a video (5) pre-recorded with an endoscopic image acquisition system (1) is proposed. To offer the user a high degree of safety when using the image acquisition system (1) while simultaneously providing good usability, it is proposed that in a replay mode (37), which the user can switch to, for example, via a replay user input (22), a live video image (6) currently being recorded is visualized with the image acquisition system (1), and that the user can simultaneously view a playback of the previously recorded video (5) on a display device (8) of the system (1).

Description

[0001] The invention relates to a method for playing back a video in a user-friendly manner, wherein the video was previously recorded with an endoscopic imaging system, and wherein this imaging system can be configured as described herein. The video can, for example, visualize an infiltration process carried out with a fluorophore in tissue. Furthermore, the invention is particularly advantageous when the video is recorded in an advanced imaging mode (i.e., a fluorescence imaging mode or an infrared (IR) imaging mode) that differs from a standard white light imaging mode and serves to display extended image information.

[0002] The invention further relates to an endoscopic image acquisition system comprising an endoscope, at least one image sensor, and a memory, which can be configured as external or internal storage, in particular in the form of a buffer. At least one image sensor of the system can preferably be configured to capture fluorescent light and / or extended image information. The memory serves to store videos that are / were recorded with the at least one image sensor.

[0003] An exemplary application in which the invention becomes relevant is a typical surgical situation in which the patient's body has already been opened and a fluorophore is introduced into a previously surgically treated organ or other tissue by the surgeon using a syringe. The tissue / organ is then irradiated with excitation light, and the fluorescence wavelengths generated by the fluorophore in response to the excitation are recorded as fluorescence images using an endoscope as part of fluorescence imaging. This process is referred to as an influx process because the fluorophore slowly spreads through the blood vessels into all branches of the organ / tissue.This dynamic process typically lasts about one minute, during which the surgeon can first observe the spread of the fluorophore in the larger vessels live on the screen using the fluorescence signal recorded by the endoscope.

[0004] This type of advanced imaging serves the surgeon for quality control of the surgical procedure performed: If, for example, the fluorescence images reveal that a specific part of the organ / tissue is not receiving sufficient blood flow, the surgeon can correct this through surgical intervention. This helps prevent certain parts of the tissue from receiving an inadequate blood supply and subsequently dying or becoming necrotic, which would necessitate further surgery later on.

[0005] Based on this, the invention aims to enable improved handling and operation of an endoscopic image acquisition system for the surgeon during surgical procedures.

[0006] To solve this problem, the invention provides the features of claim 1 in a method for playing back a video using an endoscopic image acquisition system. In particular, the invention proposes that, after recording the video, the system switches to a replay mode in which the video is displayed. This switch can preferably occur automatically or in response to a user input (e.g., manually, by voice input, or by means of a foot switch).

[0007] Furthermore, the solution involves storing the video in the image capture system's memory and loading it from this memory for playback in replay mode. Finally, in replay mode, a live video image currently being recorded by the image capture system is displayed simultaneously with the previously recorded video being played back.

[0008] This method can be particularly advantageous when the live video image is a white light image and / or is being captured in a white light imaging mode (WLI mode) with the image capture system in the current situation.

[0009] In the application mentioned at the beginning, following the concept of the invention, a surgeon can first record a short video clip (e.g., approximately one minute in length) in a fluorescence imaging mode using an endoscope of the image acquisition system. Subsequently, this video can be viewed in detail in replay mode, allowing the surgeon to repeatedly observe and / or magnify specific phases of the infusion process on a display device of the image acquisition system and analyze them precisely. This enables very accurate and reliable monitoring of the surgical outcome to date, specifically the blood flow to the treated tissue. Simultaneously, the surgeon maintains a constant overview of the current surgical scene using the live video image, allowing them, for example, to see and stop any bleeding that may occur.

[0010] The invention allows the surgeon to quickly and easily access the previously recorded video, enabling him to inspect individual time periods of an inflow process or other processes recorded in an "advanced imaging mode" in detail, particularly repeatedly, during the operation.

[0011] This allows the surgeon, for example, to check step by step whether all areas of previously surgically treated tissue are adequately perfused. It is important to consider that tissue sections permeated by very fine blood vessels are only flushed with fluorophore at the end of the infusion process, meaning these areas will only show a relevant fluorescence signal at the end of the video, while at that point other tissue sections permeated by larger blood vessels may already show a fading or completely disappeared fluorescence signal.Therefore, the surgeon must have access to the entire video in high temporal resolution because, depending on the different times the images were captured, they need to inspect different areas of the image very closely to ensure that all parts of the tissue are adequately perfused, meaning that at some point within the video, a sufficiently high fluorescence signal is shown. Using the video, which is recorded with parameters optimized for playback and played back in replay mode with optimized settings, the surgeon can cognitively grasp the perfusion process in the tissue step by step and thus verify the outcome of the previous surgical procedure in order to rule out the aforementioned risks.

[0012] A key characteristic of the operating philosophy according to the invention is that the range of functions accessible to the surgeon, which he can modify via controls, is deliberately limited to those functions that are useful and necessary in the respective situation. The quick switch to replay mode with preset playback parameters eliminates the need for time-consuming manual navigation through submenus, thus significantly simplifying operation. In particular, the surgeon can switch to replay mode at any time without losing control over the surgical field, as he can still see it in the live video image. This significantly improves the system's usability.

[0013] An automatic switch to replay mode can occur, for example, as soon as the user stops recording, or when video recording automatically ends after a set period of time, or later via a user-defined replay input.

[0014] A key characteristic of the invention is that the live video image is recorded and played back live in a second imaging mode (or image capture mode), which differs from a first imaging mode in which the video played back in replay mode was previously recorded. The two imaging modes or image capture modes can differ, in particular, with regard to the lighting used during the respective image capture and / or in the imaging path and / or in the image sensor used in the respective imaging mode.

[0015] According to the invention, the problem can also be solved by further advantageous embodiments according to the dependent claims.

[0016] For example, the pre-recorded video may have been captured with a first image sensor of the image acquisition system, while the live video image was or is captured with a second image sensor of the same system. The first image sensor may be preferably configured for advanced imaging, such as fluorescence imaging. The second image sensor, on the other hand, may preferably be configured for white light imaging.

[0017] As an alternative to using at least two image sensors, the method can also provide for both the video and the subsequent live video image to be recorded with the same image sensor of the image acquisition system. In this case, the video is / was recorded with an image sensor of the image acquisition system that is also used to record the live video image during replay mode.

[0018] In the first variant of using two spatially separated image sensors (or at least two spatially separated areas of a common image sensor surface), it is possible to use both imaging modes simultaneously, so that different types of images can be recorded at the same time.

[0019] The pre-recorded video and the live video image can be displayed to a user in parallel playback, either on separate displays or on a single display. In the latter case, the video and the live video image can be displayed, for example, in a split-screen view, a side-by-side view, or a picture-in-picture view. Parallel playback, in this context, means that both video streams (i.e., the video retrieved from memory and the live video image) can be played back simultaneously and thus viewed by the user at the same time (either on a single display or on two separate displays).

[0020] Depending on the design of the method, the pre-recorded video can be based in particular on the sensorial detection of fluorescence light emitted by a fluorophore (especially the one mentioned above) in response to optical excitation with excitation light, which can occur in particular during a fluxing process as described above.

[0021] However, it is also possible that the recorded video visualizes at least some enhanced image information calculated from sensor-acquired image data. For example, it is possible to read signals from individual color channels of the respective image sensor and process them together in such a way that a specific physical quantity can be visualized, such as the presence of a particular chromophore in tissue. In this way, for example, local blood oxygen saturation can be visualized, which is not directly accessible from the image data without such a calculation.

[0022] A particularly preferred embodiment of the method provides that the replay mode is one view mode in a series of different view modes, which a user can select on the image acquisition system by means of a view mode user input. For example, it may be possible to switch between the different view modes by repeatedly executing such a view mode user input, preferably in a predefined sequence. Particularly simple operation is possible, for example, if the individual view modes of the series can be selected in an endless loop by repeatedly executing the view mode user input.

[0023] Furthermore, it is preferred if a control element allows switching between at least three different view modes of the series, and if these view modes include at least one white light view mode, at least one advanced view mode (based on an enhanced imaging mode), and the aforementioned replay mode. To improve usability, the control element may be manually operated. It is also advantageous if the control element is located on an endoscope of the imaging system.

[0024] Each of the aforementioned view modes in the series can include an imaging mode, which is currently used to generate the live video image, and a display mode, in which the live video image is visualized on a display device. Furthermore, each individual view mode can define parameters for both the respective imaging mode and the respective display mode.

[0025] Furthermore, it is advantageous if the white light view mode defines parameters of a white light imaging mode, and the advanced view mode, in turn, defines parameters of an advanced imaging mode (i.e., in particular, a fluorescence imaging mode or an imaging mode that enables the visualization of extended image information, such as the spatial distribution of oxygen saturation). Moreover, as already mentioned, the replay mode can define parameters of a white light imaging mode for the live video image and a display mode for the simultaneous playback of the previously saved video and the live video image.

[0026] The method may further provide that a user in replay mode can navigate within the video using navigation input to display different time periods of the video. For example, it may be possible to use navigation input to jump forward or backward in the video by a defined period of time. Preferably, the video can be played back in a continuous loop in replay mode during this process.

[0027] Instead of designing a control element in such a way that three different user inputs can be made with this control element (e.g. by pressing for different durations and / or by moving the manual control element in different directions (e.g. pressing and sliding left or right)), it is also possible to design at least two control elements in the grip area in order to be able to make the three desired different user inputs.

[0028] Other possible control elements that can be used for user input according to the invention are foot switches or other input devices that can be operated, for example, by assistants in the operating room. Furthermore, voice input is also conceivable and can be implemented if the image acquisition system has a microphone. It should be noted that all of the aforementioned possible user inputs serve to control the video, which is loaded from the internal memory of the image acquisition system and played back in replay mode.

[0029] Naturally, user input for functions such as playback, pausing, fast-forwarding, rewinding, and other playback options can be entered in a variety of ways, as is generally known. This can be achieved using handheld controls, foot switches, or input devices like keyboards, which can be operated by support staff during surgery, for example. Such input devices also allow users to annotate the video with additional information, such as highlighting specific areas of the image.

[0030] It can therefore be provided that the image acquisition system is triggered to record the video by means of a recording / recording start user input. The video can be recorded in a preset advanced imaging mode, particularly a fluorescence imaging mode. Preferably, all parameters are preset and thus fixed during video recording in an image acquisition mode, so that the user does not have to make time-consuming manual adjustments to recording parameters. Using the recording / recording start user input, the user can thus start recording the video in a preset image acquisition mode that differs from the white light imaging mode used in a normal recording mode. This latter white light imaging mode can be the same imaging mode in which the live video is recorded by the system.

[0031] Therefore, it may also be provided that the enhanced imaging mode, and in particular the aforementioned fluorescence imaging mode, defines at least two, but preferably all, of the following parameters: spatial image resolution; temporal frame rate during video recording; compression of the video file; with regard to video compression, selected parameters of an algorithm used during video recording may also be relevant, as these can influence subsequent navigation within the video. Furthermore, other parameters may also be defined by the enhanced imaging mode, such as: the color of a fluorescence image display (e.g., monochrome or color in a false color) and / or the degree of edge enhancement in the image by means of signal processing and / or the application of noise reduction;

[0032] The extended imaging mode, and in particular the aforementioned fluorescence imaging mode in which the video is recorded, can define at least one, but preferably all, of the following parameters: color distribution; image brightness;

[0033] In contrast, the replay mode can set the following parameters when playing back a video retrieved from memory: frame rate during playback and / or speed of video playback and / or display mode in which the video is shown;

[0034] To further simplify operation, it may be possible to enter the replay user input or the recording user input together with the view mode user input and / or together with the navigation user input via one and the same manual control element. Furthermore, it is preferred if such a manual control element is located within easy reach of the endoscope of the image acquisition system.

[0035] As an alternative to one or more manual controls on the endoscope, navigation within the video playback in replay mode, as well as other user inputs, can be performed, for example, via a touchscreen. This could be located, for instance, on a central control unit, particularly a camera control unit (CCU) of the image acquisition system. However, using manual controls on the endoscope for inputting these user commands offers the surgeon a significant advantage: improved hand-eye coordination, reduced distraction, and the elimination of the need for verbal guidance from another person to navigate the video. This substantially improves usability and greatly facilitates the surgeon's quick review and verification of the previously recorded video.

[0036] According to the invention, the replay mode always plays back the most recently recorded and stored video. This operating principle of the invention can relieve the user, as they no longer have to search for and retrieve the video file in internal memory or even on an external server, as was the case with previously known approaches. Instead, the most recently recorded and (for example, stored in a buffer) last stored video is always played back (automatically) in replay mode. Furthermore, both the recording parameters when recording the video and the playback parameters when playing back this video in replay mode can preferably be predefined (e.g., before the start of a surgical procedure), so that these parameters no longer need to be manually adjusted by the surgeon during the operation.

[0037] When saving the video to memory, it can preferably be compressed in such a way that, taking into account the processing power of the image capture system, lag-free playback without judder is possible in replay mode, and different still images can be displayed with a time interval of less than 1 second (preferably even less than 500 milliseconds). Such compression thus enables sufficiently fine temporal resolution during video replay without any judder.

[0038] Unlike previously known concepts, the invention also proposes that a user can start playback of the video stored in the memory by switching to replay mode, independently of the live video image currently being captured and displayed by the image recording system. This makes operation more flexible.

[0039] The replay mode, as well as the playback of the saved video, can therefore be started by a user at any time. This can be done, in particular, by stopping the video recording and / or by means of a replay user input and / or, preferably, by switching the (current) view mode.

[0040] Switching to replay mode will preferably also entail a change in display mode and / or imaging mode: Firstly, two video streams must now be displayed simultaneously (the video loaded from memory and the live video image). Secondly, live imaging should no longer take place in the fluorescence imaging mode or in an advanced imaging mode, but in a white light imaging / WLI mode.

[0041] When recording videos with the image acquisition system, particularly in a fluorescence imaging mode or an advanced imaging mode, several different scenarios are conceivable: (a) For example, for documentation purposes, it may be useful to record videos with a comparatively low resolution to limit the storage space required for these videos. (b) If, on the other hand, specific surgical situations are to be recorded with the system, for example for scientific publications, then a particularly high resolution should be achieved, while storage space is then of secondary importance.(c) As a third scenario, there is the requirement to record an inflow process with the constraint that this video should be meaningfully displayed live on the image acquisition system together with another live image of the operation scene, which has particular implications for the necessary compression and temporal and spatial resolution of the video image data stream to be recorded.

[0042] In other words, the recording settings can be optimized for replay mode when recording video in a first recording mode. To accommodate other scenarios, it may be possible to record videos in at least one second mode, different from the first. This second recording mode can be designed as part of a specific view mode within a series of different view modes. By selecting the corresponding view mode, the user can put the image capture system into a state where the (potentially specific) second recording mode can be started to record a video with the desired settings. The respective view mode can therefore also include preset recording parameters that are applied by the system when recording videos in that view mode.Both the first recording mode and the second recording mode can be based on enhanced imaging (so that the respective videos are not recorded in a white light imaging mode).

[0043] To solve the problem, an endoscopic image acquisition system is proposed, as already mentioned at the outset. This system is characterized in particular by the fact that the endoscope of the image acquisition system includes a control element with which a replay mode can be activated. When the image acquisition system is in replay mode, it displays a video previously recorded with the image sensor and stored in the aforementioned memory, together with a live video image, using a method as described above and / or according to one of the claims directed to a method.

[0044] The image recording system according to the invention can also include at least one display device on which the video can be displayed simultaneously with the live video image that has just been recorded (either on two separate display devices or on a common display device).

[0045] Furthermore, the image acquisition system according to the invention can be configured to take white light images and at least one other type of image, for example fluorescence images or images taken in an “advanced imaging mode” (such images typically provide additional image information compared to white light images, for example a local distribution of oxygen saturation or other parameters that can be detected optically).

[0046] The aforementioned storage device can be designed, in particular, as an (internal) buffer. Such a buffer can be used to temporarily store live video data being recorded by the image capture system, especially before it is continuously transmitted to a display unit.

[0047] An image acquisition system according to the invention can, for example, have only a single image sensor. In this case, this single image sensor is used to record both the video in an extended imaging mode (this can be, in particular, a fluorescence imaging mode using excitation light) and the live video image, which is then recorded as a white light image in a white light imaging mode with the same image sensor.

[0048] An alternative configuration, however, may provide that the image acquisition system has a first image sensor capable of recording the video in an extended imaging mode, such as a fluorescence imaging mode. In this configuration, the image information reaches the first image sensor via a first imaging path. The system may also include a second image sensor designed and configured to record white light images, particularly in the form of live video images or a live video data stream (live video stream), via a second imaging path that differs spatially from the first.

[0049] The invention will now be described in more detail with reference to exemplary embodiments, but is not limited to these embodiments. Further embodiments of the invention can be derived from the following description of a preferred embodiment in conjunction with the general description, the claims, and the drawings.

[0050] In the following description of various preferred embodiments of the invention, elements that are identical in function are given identical reference numerals even if they differ in design or shape.

[0051] It shows: Fig. 1 a first example of an endoscopic image acquisition system according to the invention, which is used specifically to record white light images in a white light imaging mode, Fig. 2 the image acquisition system of the Fig. 1, where, in an extended imaging mode using excitation light, fluorescence light images are recorded with the system, Fig. 3 a schematic view of the display device 8 of the image acquisition system according to the Fig. 1 and Fig. 2, illustrating a change in view mode, Fig. 4 a further endoscopic image acquisition system according to the invention, which, however, differs from that of the Fig. 1 only has a single image sensor 3, and finally Fig. 5 another possible embodiment of an endoscopic image acquisition system according to the invention, comprising two display devices 8a and 8b and a chip-in-tip (CIT) endoscope.

[0052] The Fig. Figure 1 shows an endoscopic image acquisition system, designated as a whole by 1, which comprises an endoscope 2 with an attached camera head 38 having two image sensors 3a and 3b, a camera control unit 13 with an internal buffer 16, a display device 8 in the form of a single monitor, and an external storage device 11, the latter being primarily intended for storing larger video image files. The in Fig. The schematic data connections 15 shown in Figure 1, as well as the video cable 14 shown, could of course also be implemented via wireless communication connections. The endoscope 2 shown could, without affecting the invention, also be designed as a video endoscope in which at least one image sensor 3 is arranged either in a handle of the endoscope or in a distal end region of the endoscope shaft.

[0053] In the situation of Fig. 1. An object 17 is observed with the endoscope 2, and white light images 12 are continuously recorded as a live video image data stream 6 using the second image sensor 3b and white light illumination. More precisely, this video image data is first transmitted from the endoscope 2 to the camera control unit 13 via a data connection, processed there, and temporarily stored in the internal memory 16 before being transmitted to the display device 8. Furthermore, video image files captured in this way can also be stored in the external memory 11 via the data connection 15, which could, for example, be implemented using a server.

[0054] In Fig. 1 can also be clearly seen that in the grip area 45 of the endoscope 2 on the camera head 38 there are four manual controls 9a to 9d, with which the image display as well as different imaging modes can be set.

[0055] For example, if a user activates the second control element 9b, then, as will be explained in more detail below... Fig. As will be explained in section 3, a change 24 of the currently set view mode 35 is performed. By means of such a view mode user input 41, the image acquisition system 1 can thus be switched to the in Fig. The system is switched to the extended imaging mode 26 illustrated in Figure 2, in which a fluorescent image (FL) video stream 20 is continuously recorded, now using the first image sensor 3a, which is configured for fluorescence imaging. For this purpose, a fluorophore 7 is inserted into the tissue 40 observed with the endoscope 2, and the tissue 40 is irradiated with excitation light 27 in the UV wavelength range. In response to this optical excitation, the fluorophore 7 emits fluorescent light 28, which can be detected by the first image sensor 3a. Accordingly, in this situation, a live video image 6 is also displayed on the display device 8, but now fluorescent images 19 are visualized on the monitor.

[0056] By manually operating the first control element 9a, a user can make a recording user input 42, which triggers the recording of a video 5 in fluorescence light imaging mode 26. The video 5 recorded in this way, which visualizes an influx process carried out with the fluorophore 7 in the tissue 40, is stored in the external memory 11, via the intermediate memory 16.

[0057] After the operator has successfully recorded video 5 in this manner and stored it in memory 4, he can, for example, by pressing the second control 9b again to change the view mode and thus also the imaging mode, and thus switch back to white light imaging mode 25, as in Fig. 1 illustrated.

[0058] However, the user can also trigger a replay user input 22 by pressing the second control element 9b, which puts the image capture system 1 into a replay mode 37, which in Fig. Figure 3 is illustrated on the far right. If the image acquisition system 1 is in replay mode 37, a live video image 6 is continuously recorded by the image acquisition system 1 in a white light imaging mode 25, as shown in Fig. 1 is illustrated, recorded, and this live video image 6 is displayed on the display device 8. In addition, the previously recorded video 5 is loaded from memory 4 and displayed simultaneously with the live video image 6 in replay mode 37, as in the example of the Fig. 3 by means of a split-screen view 23 on the same monitor.

[0059] As in Fig. As illustrated in Figure 2, the video 5 recorded with the image acquisition system 1 is thus based on a sensorial detection of fluorescence light 28, which is emitted by the fluorophore 7 in response to the optical excitation with the excitation light 27 during the fluxing process.

[0060] In the design example according to the Fig. 4 is different from the one that Fig. 1 and Fig. 2 such that the single image sensor 3 there is used both to record the WLI live video image 6 and to record the video 5 stored in memory 4. It can further be seen that this image recording system 1 according to the invention has only one internal memory 4, 16 from which the video 5 is loaded. The in Fig. The display mode shown in 4 corresponds to a side-by-side display mode, in which the live video image 6 (which is currently being recorded live in a white light mode) and the video 5 previously recorded in a fluorescence image mode are displayed side by side on the monitor 8.

[0061] In the Fig. Figure 4 further illustrates the situation in which the image acquisition system 1 is currently in Replay mode 37. It can be seen that the manual controls 9a, 9c, and 9d are now assigned different functions compared to the situation when the image acquisition system 1 is in a WLI View mode 35 or an Advanced View mode 36 (see Figure 4). Fig. (3 left and middle illustrations). As soon as the user switches to Replay mode 37, the function assignment of the manual controls 9 changes automatically. In this way, the range of functions relevant to the respective View mode is always available. This also facilitates operation when viewing pre-recorded videos 5 in Replay mode 37.

[0062] In the design example according to the Fig. In Figure 5, the endoscope 2 again features two image sensors 3a and 3b, which are now arranged in a distal tip region of the endoscope 2. In other words, this endoscope 2 is thus designed as a chip-in-tip (CIT) endoscope. Furthermore, this image acquisition system 1 according to the invention also has two separate display devices 8a and 8b. Therefore, in replay mode 37, the pre-recorded video 5 and the live video image 6 are displayed in parallel but on separate display devices 8a and 8b. The live video image 6 is thus displayed simultaneously on a first monitor 8a and the pre-recorded fluorescence video 5 on a second monitor 8b. As illustrated, the endoscopic image acquisition system 1 is also implemented here using a chip-in-tip endoscope 2.

[0063] The different possibilities for displaying the live video image 6 and the pre-recorded video 5 on the respective display device 8, as shown in the figures, are fundamentally interchangeable and can be adapted to the wishes of the end user according to the requirements of the respective medical procedure.

[0064] Based on the illustration of Fig. Figure 3 clearly shows that Replay Mode 37 is one of a series of three different View Modes 35, 36, 37. Using the second control 9b, a user can select the desired View Mode by entering a View Mode user input 21, 41. Repeatedly entering this user input 41 cycles through the different View Modes in the sequence shown, in the endless loop 43 illustrated by the dotted arrow.

[0065] The in Fig. Figure 3, far left, illustrates the white-light view mode 35, which defines parameters of a white-light imaging mode currently used by system 1 to generate the live video image 6, and simultaneously an associated display mode in which this live video image 6 is displayed on the monitor. If the user switches to the subsequent advanced-view mode 36, the image acquisition system 1 records in a fluorescence imaging mode (which is described in Figure 35). Fig. (2 illustrated) continuously displays fluorescent light images 19 in the form of a live video image data stream 6, which is now visualized in a second display mode on the (same) monitor 8. A further activation of the control element 9b then takes the user to replay mode 37, in which the video 5 last stored in memory 4 is displayed simultaneously with a currently recorded live video image stream 6 on the same monitor 8. In replay mode, the live video image stream 6 is generated by means of white light imaging.

[0066] The major advantage of simultaneously visualizing both the pre-recorded video 5 and the WLI live video image 6 becomes clear, for example, from the Fig. 4 and Fig. 5, where it can be seen that the operator can, on the one hand, continue to observe the scene observed with the endoscope 2 using the live video image 6 and, at the same time, calmly and in high temporal resolution, analyze the inflow process using the now displayed, previously recorded video 5 on the respective display device 8. In the example of the Fig. Several additional control elements 9 are visible on the second display device 8b, which is designed as a touchscreen. Using these control elements 9, the surgeon can navigate within the video 5 by means of respective navigation user inputs 44, for example, quickly forward using the FF function 30 or quickly backward using the FB function 31. The system 1 can also display / visually visualize the current function of the control elements 9 (designed as graphical elements) on the respective display device 8 to simplify their use.

[0067] When recording video 5, numerous parameters of the extended imaging mode 26, in which video 5 is recorded, are predefined, in particular the spatial image resolution, the temporal frame rate, and also the compression of the video file belonging to video 5. Likewise, once the user switches to replay mode 37, they do not need to laboriously adjust individual parameters for playing back video 5 retrieved from memory, as these are also predefined, in particular the frame rate, the playback speed, the display mode in which video 5 is shown, and also the image brightness.

[0068] The user can initiate the recording of a new video 5 at any time using a recording user input 42 on System 1, whereby the last saved video 5 in memory 4 is automatically overwritten. In replay mode 37, the video 5 most recently stored in memory 4 is therefore always played back. This avoids the time-consuming search for and retrieval of the video file, which further improves the usability of System 1.

[0069] The user can also switch to Replay Mode 37 at any time, in particular regardless of the image capture or imaging mode currently in use.

[0070] In system 1 according to Fig. 5. System 1 is designed to automatically switch to replay mode 37 as soon as the second monitor 8b is connected, or as soon as the camera control unit (CCU) 13 detects that two monitors 8a and 8b are connected. If, however, only one monitor is connected to the CCU 13, the user can manually switch to replay mode 37, in which the video 5 and the live video image 6 are then displayed simultaneously in a side-by-side view on the single monitor.

[0071] As in Fig. As indicated in Figure 3, a switch to Replay Mode 37 can occur either when the user makes a View Mode user input 41 via control 9b. Additionally or alternatively, it can also be provided that a switch to Replay Mode 37 is performed automatically by System 1 as soon as the Recording Mode (i.e., the recording of the video 5) is terminated, either by the user (in the example by pressing control 9a) or automatically by System 1 itself (after a defined period of time). Such an automatic stop of the recording of the video 5 is indicated at the bottom of the Fig. Figure 2 illustrates this: here, the user simply needs to start the recording using control 5a; the system 1 then automatically records a video 5 of a preset length (e.g., 60 seconds). It may be possible for the user to initially set or change the length of the video to be recorded.

[0072] In summary, a simplified approach for user-friendly playback of a video 5, pre-recorded with an endoscopic image acquisition system 1, is proposed. To offer the user a high degree of safety when using the endoscopic image acquisition system 1 while simultaneously providing good usability, it is proposed that in a replay mode 37, which the user can access, for example, via a replay user input 22, a live video image 6 currently being recorded is visualized with the image acquisition system 1, and that at the same time the user can view a playback of the previously recorded video 5 on a display device 8 of the system 1 (cf. Fig. 3). Reference symbol list 1 Endoscopic imaging system 2 Endoscope 3 Image sensor 4 Storage (internal or external storage) 5 (pre-recorded) video 6 Live video image 7 Fluorophore 8 Display device (e.g. display or monitor) 9 Control element (preferably manual control element) 10 WLI (white light imaging) video stream 11 external storage (for WLI image data) 12 White light image (WLI) 13 Camera control unit 14 video cables 15 Data connection 16 buffers 17 objects 18 Chip-in-tip (CIT) endoscope 19 Fluorescence light image (FLI = fluorescence image) 20 FL (fluorescence image) video stream 21 User input 22 Replay user input 23 split-screen view 24 Changing the View Mode 25 White light imaging mode 26 Extended imaging mode (e.g., FL / IR imaging mode) 27 Excitation light 28 Fluorescence light 29 Start / Stop 30 Fast Forward (FF) 31 Fast Backward (FB) 32 Replay Mode (RM) 33 video recording 34 screenshot 35 WLI View Mode 36 Advanced-view mode (especially FL / IR-view mode) 37 Replay Mode 38 Camera head 39 extended image information 40 tissues / organ 41 View Mode User Input 42 Recording / Recording start user input 43 Endless loop 44 Navigation user input 45 Grip area (out of 1)

Claims

[1] Method for user-friendly playback of a video (5) which was previously recorded with an endoscopic image acquisition system (1), in particular designed according to one of claims 15-18, - in particular, wherein the video (5) visualizes an influx process carried out with a fluorophore (7) in tissue (40) and / or is recorded in an advanced imaging mode (26) different from a white light imaging mode (25), characterized by , - that after recording the video (5), preferably automatically or in response to a replay user input (21, 22), a switch is made to a replay mode (37) in which the video (5) is displayed, - that the video (5) was stored in a memory (4) of the image capture system (1) and is loaded from the memory (4) for playback in replay mode (37), and - that in replay mode (37) a live video image (6) just recorded by the image capture system (1) is displayed simultaneously with the played and pre-recorded video (5), - preferably wherein the live video image (6) is a white light image (12) and / or is being captured in a white light imaging mode (25) with the image acquisition system (1). [2] Method according to claim 1, - wherein the pre-recorded video (5) was captured with a first image sensor (3a) of the image acquisition system (1), preferably one that is set up for advanced imaging, in particular fluorescence imaging, and - wherein the live video image (6) is captured by a second image sensor (3a) of the image acquisition system (1), preferably the one configured for white light imaging, or - wherein the video (5) was recorded with an image sensor (3) of the image recording system (1) which also records the live video image (6) during replay mode. [3] Method according to one of the preceding claims, wherein the pre-recorded video (5) and the live video image (6) are displayed in parallel - on separate display devices (8a, 8b) or - on a common display device (8), in particular in a split-screen view (23) or in a side-by-side view or in a picture-in-picture view, be displayed to a user. [4] Method according to one of the preceding claims, wherein the pre-recorded video (5) is based on a sensory detection of fluorescence light (28) emitted by a / the fluorophore (7) in response to optical excitation with excitation light (27), in particular during a / the fluxing process, or wherein the recorded video (5) visualizes at least one enhanced image information (39) calculated from sensorially detected image data. [5] Method according to any one of the preceding claims, - wherein the Replay mode (37) is a View mode of a series of different View modes (35,36,37) which a user can set on the image acquisition system (1) by means of a View mode user input (21,41), - in particular wherein, by repeatedly executing the view mode user input (21,41), it is possible to switch between the different view modes (35,36,37), preferably in a predetermined order, most preferably and in an endless loop (43), - particularly preferably wherein, in particular by means of a manual control element (9) arranged preferably on an endoscope (2) of the image acquisition system (1), it is possible to switch between at least three different view modes (35, 36, 37) of the series, which include a white light view mode (35), an advanced view mode (36) and the replay mode (37). [6] Method according to the preceding claim, wherein each of the view modes (35, 36, 37) of the series - an imaging mode currently being used to generate the live video image (6), and - a display mode in which the live video image (6) is visualized on a display device (8), and / or - where - the white light view mode (35) parameter of a white light imaging mode (25) defines and - the Advanced View mode (36) parameters of an advanced imaging mode (26), in particular - a fluorescence imaging mode or - an imaging mode that enables visualization of extended image information (39) such as a spatial distribution of oxygen saturation, and wherein - the replay mode (37) defines parameters of a white light imaging mode (25) for the live video image (6) and a display mode for parallel playback of the video (5) and the live video image (6). [7] Method according to one of the preceding claims, wherein a user in replay mode (37) can navigate within the video (5) by means of a navigation user input (44) to display different time sections of the video (5), - in particular, wherein the navigation user input (44) allows the user to jump forward or backward in the video (5) by a specified time period, preferably while the video (5) is being played in a video loop in replay mode (37). [8] Method according to one of the preceding claims, wherein the image acquisition system (1) is caused to record the video (5) by means of a recording / recording start user input (42), preferably in a preset extended imaging mode (26), in particular in a fluorescence imaging mode, - preferably wherein the enhanced imaging mode (26) / the fluorescence imaging mode specifies at least two, preferably all, of the following parameters: - spatial image resolution; - temporal frame rate during recording; - Compression of the video file belonging to the video (5); - Color distribution; - Image brightness; [9] Method according to any of the preceding claims, wherein the replay mode (37) sets at least two, preferably all, of the following parameters when playing back the video (5) retrieved from the memory (4): - Frame rate during playback; - Video playback speed; - Display mode in which the video (5) is displayed; [10] Method according to any of the preceding claims, wherein the replay user input (22) or the recording user input (42) - together with the View Mode user input (41) and / or - together with the navigation user input (44) via one and the same manual control element (9b), preferably which is located in a grip area (45) of one / the endoscope (2) of the image acquisition system (1). [11] Method according to one of the preceding claims, wherein in replay mode (37) the video (5) that was last recorded and stored in memory (4) is always played back. [12] Method according to one of the preceding claims, wherein the video (5) is compressed when stored in memory (4) such that, taking into account the computing power of the image acquisition system (1) in replay mode (37), a delay-free playback of the video (5) without image judder is possible and different still images can be displayed simultaneously with a time interval of less than 1 sec, preferably less than 500 ms. [13] Method according to one of the preceding claims, wherein a user can start the playback of the video (5) stored in the memory (4) by switching to the replay mode (37) independently of the live video image (6) currently being recorded and displayed by the image capture system (1). [14] Method according to one of the preceding claims, wherein the replay mode (37) and the playback of the video (6) by a user, in particular - by stopping the video recording (5) and / or - by means of a Replay user input (22) and / or - can be started at any time by switching between the View modes (35, 36, 37). [15] Endoscopic imaging system (1) comprising - an endoscope (2), - at least one image sensor (3), preferably one designed for the sensorial detection of fluorescent light (28) and / or extended image information (39), and - a memory (4) for storing videos (5) which are recorded with the at least one image sensor (3), characterized by , - that the endoscope (2) comprises a control element (9b), preferably manual, with which it is possible to switch to a replay mode (37) in which the image acquisition system (1) displays a video (5) previously recorded with the image sensor (3) and stored in the memory (4) together with a live video image (6) by means of a method according to one of the preceding claims. [16] Image acquisition system (1) according to the previous claim, wherein the memory (4) is configured as an intermediate memory (16) in which live video data from the image acquisition system (1) can be temporarily stored before a continuous transmission to a display unit (8). [17] Image acquisition system (1) according to one of the two preceding claims, wherein the image acquisition system (1) has only a single image sensor (3) with which both - the video (5) in an extended imaging mode (26), in particular in a fluorescence imaging mode using excitation light (17), - as well as a live video image (6) can be recorded as a white light image (12) in a white light imaging mode (25). [18] Image acquisition system (1) according to any one of claims 15 to 16, wherein the image acquisition system (1) - has a first image sensor (3a) which can record the video (5) via a first imaging path, in particular in a fluorescence imaging mode or an enhanced imaging mode (26) and - a second image sensor (3b) which can record white light images (12) as a live video image (6) via a second imaging path that is spatially different from the first imaging path.

Images