Endoscope image processing and display method and system

Abstract

The application discloses an endoscope image processing and display method and system, and the method comprises the following steps: acquiring a target display mode and corresponding layer configuration information according to a received display mode switching instruction; performing picture content pre-rendering in a second buffer based on the target display mode and the corresponding layer configuration information, and continuing to output picture content matched with a current display mode through a first buffer during the picture content pre-rendering; and switching the picture content output through the first buffer to picture content matched with the target display mode based on the pre-rendered picture content in the second buffer within a frame interval window between a current vertical synchronization signal and a next vertical synchronization signal. The method and system of the embodiment of the application realize synchronous output partition display of dual or more image data based on the display mode, and can realize seamless switching during the display mode switching process, so that the switching process is ensured to be free of black screen, picture tearing and lag.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to an endoscopic image processing and display method and system, computing device, and storage medium. Background Technology

[0002] Traditional medical endoscope systems generally adopt a working architecture of "single-channel image input, single-screen output, and one-to-one matching display," with a single host supporting only the connection of a single endoscope probe for image acquisition and display. However, in diverse clinical scenarios such as complex minimally invasive surgeries, simultaneous exploration of multiple sites, and doctor-patient comparative observation, it is often necessary to operate dual or even multiple endoscopes simultaneously. To meet the demand for simultaneous operation of dual or even multiple endoscopes, a common solution is to equip two or more independent host units to achieve dual or multiple endoscope observation. However, this solution suffers from high equipment procurement costs, messy on-site wiring, large equipment footprint, and extreme inconvenience in clinical use and equipment maintenance. Furthermore, this solution has a fixed and singular display mode, which cannot achieve flexible screen switching, thus failing to meet the diagnostic and treatment needs of intraoperative dual-view simultaneous comparison and local detail comparative observation, resulting in insufficient scenario adaptability and intelligence. To address this, Chinese invention patent application number 202111524438.6 proposed a dual-channel combined endoscope system. While this system achieves dual-channel display and screen switching, its technical concept involves first converting the video signal input from the electronic endoscope into an HDMI signal via the electronic endoscope control board and then outputting the HDMI signal to the laparoscopy control board. Subsequently, the laparoscopy control board fuses the received HDMI signal from the electronic endoscope and the video signal from the laparoscopy. After fusion processing, the fused signal is sent to the display system for display. In other words, this system adopts a "screen fusion first, then processing" approach. The image quality parameters of each channel are interdependent and cannot be adjusted independently, resulting in poor image adaptation flexibility. During screen switching, black screens, screen tearing, and stuttering are prone to occur, severely affecting image quality. Summary of the Invention

[0003] To address at least one of the problems in existing dual-channel or even multi-channel endoscopic synchronous display schemes, such as poor image adaptation flexibility due to the mutual binding of image quality parameters of each channel and the easy occurrence of black screen, screen tearing, and stuttering during screen switching, embodiments of the present invention provide an endoscopic image processing and display method and system.

[0004] According to a first aspect of the present invention, an endoscopic image processing and display method is provided, the method being applicable to the image partitioning display of dual-channel or multi-channel endoscopes, the method comprising: According to the received display mode switching command, the target display mode and its corresponding layer configuration information are obtained. The display modes include full-screen display mode with only one video layer enabled and partition display mode with at least two video layers enabled at the same time. Each video layer is bound to one image data stream. Each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. Based on the target display mode and its corresponding layer configuration information, the screen content is pre-rendered in the second buffer, and while the screen content is pre-rendered, the screen content matching the current display mode is output through the first buffer. Within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, the pre-rendered image content in the second buffer will be switched to match the image content output from the first buffer to match the target display mode.

[0005] According to a second aspect of the present invention, an endoscopic image processing and display system is provided, the system being capable of displaying images from dual-channel or multi-channel endoscopes in partitions, the system comprising: The configuration information loading module is used to obtain the target display mode and its corresponding layer configuration information according to the received display mode switching instruction. The display modes include a full-screen display mode that enables only one video layer and a partitioned display mode that enables at least two video layers at the same time. Each video layer is bound to one image data stream, and each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. The buffer data processing module is used to pre-render the screen content in the second buffer based on the target display mode and its corresponding layer configuration information, and to continue to output the screen content that matches the current display mode through the first buffer while pre-rendering the screen content. The mode switching module is used to switch the screen content output through the first buffer to match the target display mode within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, based on the pre-rendered screen content in the second buffer.

[0006] According to a third aspect of the present invention, an endoscopic image processing and display system is provided, comprising at least one endoscopic probe, a host computer, and a display device, wherein the endoscopic probes are all connected to the host computer and the images are displayed through the display device; wherein the host computer is configured to perform the following method steps to achieve partitioned display of images from dual or multiple endoscopic probes on the display device: According to the received display mode switching command, the target display mode and its corresponding layer configuration information are obtained. The display modes include full-screen display mode with only one video layer enabled and partition display mode with at least two video layers enabled at the same time. Each video layer is bound to one image data stream. Each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. Based on the target display mode and its corresponding layer configuration information, the screen content is pre-rendered in the second buffer, and while the screen content is pre-rendered, the screen content matching the current display mode is output through the first buffer. Within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, the pre-rendered image content in the second buffer will be switched to match the image content output from the first buffer to match the target display mode.

[0007] According to a fourth aspect of the present invention, a computing device is provided, comprising: a processor and a memory communicatively connected, the memory storing instructions executable by the processor, the instructions being executed by the processor to enable the processor to perform the steps of the method described in the first aspect.

[0008] According to a fifth aspect of the present invention, a storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in the first aspect.

[0009] The method and system of this invention utilize the configurable feature of the video output channel (VO channel, VO being an abbreviation for Video Output) layer. By binding the image data streams generated by each independent endoscopic channel to a separate video layer, multiple independent endoscopic channels can be simultaneously mounted to the same set of video output channels. This allows multiple independent endoscopic channels to share screen display output resources, enabling synchronous output and partitioned display of dual or more image data channels based on display modes. This method does not require additional host equipment or wiring, resulting in low hardware and maintenance costs. Furthermore, each endoscopic channel is independent and can perform independent image processing, thus allowing for differentiated calibration based on the imaging characteristics of different probes. This solves the problem of traditional multi-channel solutions where image quality parameters are bound and cannot be individually adapted. Additionally, the method and system of this invention employ a double-buffered architecture, i.e., in video output... The channel is configured with dual frame buffers (first buffer and second buffer). When switching display modes, the second buffer first pre-renders the content corresponding to the target display mode. During this period, the first buffer continues to output the content corresponding to the display mode before the switch (i.e., the current mode). Thus, the foreground display does not switch immediately. Instead, it waits for the next vertical synchronization signal (also known as VSYNC) to arrive. The display switch is then performed based on the content of the two buffers within the frame gap window (also known as the vertical blanking period). Since the screen does not display any content during the vertical blanking period, the buffer exchange process is imperceptible to the user. This enables seamless and unobtrusive switching, ensuring that there is no black screen, no screen tearing, and no stuttering during the switching process, thereby improving the display quality during the switching process. Attached Figure Description

[0010] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 A flowchart illustrating an endoscopic image processing and display method according to one embodiment of the present invention is shown schematically. Figure 2 A flowchart illustrating another embodiment of the endoscopic image processing and display method of the present invention is shown schematically; Figure 3 A schematic block diagram of an endoscopic image processing and display system according to an embodiment of the present invention is shown. Figure 4 A schematic block diagram of an endoscopic image processing and display system according to another embodiment of the present invention is shown. Figure 5 A schematic diagram of the system architecture of an endoscopic image processing and display system according to an embodiment of the present invention is shown. Figure 6 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention is shown. Detailed Implementation

[0012] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0013] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other.

[0014] In the description of this application, it should be understood that the use of terms such as "center," "middle," "longitudinal," "transverse," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "axial," "radial," and "circumferential" to indicate orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings is solely for the convenience of describing this application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application. Features defined with "first" and "second" are used to distinguish feature names and do not have special meanings. Furthermore, features defined with "first" and "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "multiple" means two or more.

[0015] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0016] It should also be noted that, in this document, the terms "comprising" or "including" include not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element. The terminology used herein is generally that commonly used by those skilled in the art; in case of any discrepancy with commonly used terminology, the terminology used herein shall prevail.

[0017] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] The present invention will now be described in further detail with reference to the accompanying drawings.

[0019] Figure 1 The illustration schematically depicts the flow of an endoscopic image processing and display method according to one embodiment of the present invention. The execution entity of this method can be, for example, a processor of a computer, cloud server, server in a cluster, PC, smart mobile terminal, endoscope host, or other similar device. This embodiment of the invention does not limit this to such devices. Figure 1 As shown, the method includes: Operation S1 obtains the target display mode and its corresponding layer configuration information according to the received display mode switching instruction. The display modes include full-screen display mode with only one video layer enabled and partitioned display mode with at least two video layers enabled simultaneously. Each video layer is bound to one image data stream. Each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. Operation S2: Based on the target display mode and its corresponding layer configuration information, pre-render the screen content in the second buffer, and continue to output the screen content that matches the current display mode through the first buffer while pre-rendering the screen content; Operation S3: Within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, the pre-rendered image content in the second buffer is switched to match the image content output from the first buffer to match the target display mode.

[0020] In this embodiment of the invention, the display mode currently in use before receiving the switching command is referred to as the current display mode, and the display mode to which the switching command intends to switch is referred to as the target display mode. That is, the display mode switching command is used to switch the display mode from the current display mode to the target display mode. The display mode switching command can be set by the user through a graphical user interface or physical buttons, etc. The switching command includes an identifier of the target display mode. For example, when the user selects full-screen display mode through the graphical user interface, the display mode switching command can carry the identifier of full-screen display mode. Thus, in operation S1, the target display mode can be determined based on the received display mode switching command.

[0021] In this embodiment of the invention, each independent endoscopic pathway includes a set of independent endoscopic probes, a MIPI (Mobile Industry Processor Interface) image input interface, a video input unit (also known as a VI video input unit, where VI is short for Video Input), and a VPSS (Video Processing Sub-System) image processing unit. There can be one, two, or multiple independent endoscopic pathways. The MIPI image input interface, video input unit, and VPSS image processing unit in each independent endoscopic pathway are provided by a system-on-a-chip (SoC) or image processor on the host computer, while the endoscopic probes are external components connected to the SoC or image processor on the host computer. It should be noted that existing host system-on-a-chips or image processors can provide single, dual, or multiple MIPI image input interfaces, video input units, and VPSS image processing units. Therefore, one, dual, or multiple endoscope pathways can be constructed by relying on the native image receiving and processing hardware resources of the endoscope host. For example, third-party host hardware chips that include dual high-speed differential image input interfaces (MIPI_RX0 and MIPI_RX1), two independent video input units, and two independent VPSS image processing units can be directly selected, such as Rockchip's RK3562, RK3568, and RK3399 chips, and Hisilicon's HI3519DV500 and SS928V100 chips, to construct dual independent endoscope pathways. This embodiment of the invention does not limit this. In this case, the host hardware natively supports parallel reception, decoding, and preprocessing of dual 4K images. Preferably, a third-party host hardware chip can be selected that has two MIPI interfaces that are both compatible with the MIPI CSI-2 protocol standard, support different data rates, and can connect to endoscope probes with different resolutions (such as 1080P, 2K, 4K) and different frame rates (such as 30fps, 60fps). In this case, when the host system is powered on and initialized, each MIPI interface can automatically configure the corresponding receiving parameters according to the MIPI data rate of the connected probe, including the number of lanes, clock frequency, data packet format, etc., to achieve hardware-level plug-and-play compatibility for heterogeneous probes.Therefore, two or more endoscope probes of different models and specifications can be simultaneously connected to the host's dual or multiple MIPI interfaces. The two or more raw image signals are transmitted to the main controller through independent MIPI differential channels. The corresponding video input units complete image reception, decoding, and format preprocessing. The transmission of each signal is independent and does not interfere with each other. The images processed by the video input units enter their respective dedicated independent VPSS image processing units, thereby realizing that each independent endoscope path generates an image data stream. That is to say, in this embodiment of the invention, the image data stream is the image processing result output by the VPSS image processing unit after image processing through an independent endoscope path. The processing process can refer to the existing processing algorithms of the corresponding modules. Therefore, the specific generation process of the image data stream is not described in detail in this embodiment of the invention.

[0022] In this embodiment of the invention, the image data streams generated by each independent endoscopic pathway are bound to a video layer, meaning each video layer corresponds to one image data stream. Preferably, the video layer is generated based on the configurable attributes of the video layer in the video output module (also known as the VO module). This allows the image data streams generated by different independent endoscopic pathways to be simultaneously mounted to the same set of video output channels, sharing screen display output resources. For example, taking two independent endoscopic pathways as an example, two video layers, such as Video Layer 0 and Video Layer 1, can be created through the video output module. The image data stream generated by one independent endoscopic pathway is bound to Video Layer 0, while the image data stream generated by the other independent endoscopic pathway is bound to Video Layer 1. Thus, the two video layers can share the same VO channel's display timing and output interface, ensuring that both images are synchronously output to the same display device. It should be noted that the VO (Video Output) module is an existing core module provided in the endoscope host hardware architecture. It is responsible for reading video and image data from memory and converting it into display signals for output through the display device. Its video layer attribute is a configurable independent data stream channel. The creation of video layers and their binding with image data streams can be achieved by calling the corresponding API interface.

[0023] The full-screen display mode in operation S1 refers to a display mode that uses only one video layer. In this mode, a single endoscope feed occupies the entire screen area; that is, one video layer covers the entire screen, thus achieving full-screen display of a single endoscope feed. The partitioned display mode refers to a display mode that uses two or more video layers. In this mode, multiple feeds from two or more endoscopes occupy different screen areas. In other words, in partitioned display mode, the content output by the display device includes at least two spliced ​​feeds, each corresponding to a separate video layer, thus achieving partitioned display of two or more endoscope feeds.

[0024] One possible implementation is to assign different layer configuration information to different display modes, thereby achieving screen display adapted to the display mode based on the layer configuration information. The layer configuration information can include the display position of the video layer, the corresponding ISP (Image Signal Processor) parameter group for the video layer, and layer configuration parameters. The display position of a video layer can be determined by its display coordinates and size parameters. For example, in full-screen display mode, assuming a full-screen resolution of 3840×2160, the display position of the corresponding video layer can be configured as (X=0, Y=0, W=3840, H=2160), thus enabling a single-channel image to occupy the entire screen area and achieve single-camera full-screen display. In partitioned display mode, assuming a full-screen resolution of 3840×2160, two endoscope channels, and two corresponding video layers Layer0 and Layer1, the display position of the corresponding video layer can be configured to include the display position of Layer 0 (X=0, Y=0, W=1920, H=2160) and the display position of Layer 1 (X=1920, Y=0, W=1920, H=2160), thus enabling the two channels to occupy the left and right halves of the screen respectively and achieve dual-camera side-by-side display. In other implementations, the display positions of the two video layers, Layer0 and Layer1, can also be configured to include the display position of Layer0 (X=0, Y=0, W=3840, H=1080) and the display position of Layer1 (X=0, Y=1080, W=3840, H=1080), thereby enabling the two video feeds to occupy the upper and lower halves of the screen respectively, achieving dual-camera simultaneous display. It is easy to understand that in other possible implementations, the display positions of the video layers can be set to other values ​​according to expectations and needs to achieve the desired full-screen or partitioned display effect. The display positions of the video layers can be pre-associated with the display mode for automatic matching based on the display mode, or they can be dynamically obtained based on user settings and changes made in the graphical user interface.Taking pre-associating and binding with display modes for automatic matching based on the display mode as an example, for full-screen display mode, the display position of the video layer can be pre-configured as (X=0, Y=0, W=3840, H=2160); for partitioned display mode, it can be further subdivided into upper and lower partitions and left and right partitions. For upper and lower partitioned display mode, the display position of the video layer can be pre-configured as follows: the display position of the video layer corresponding to the upper partition is (X=0, Y=0, W=3840, H=1080), and the display position of the video layer corresponding to the lower partition is (X=0, Y=1080, W=3840, H=1080); a similar configuration can be made for left and right partitioned display mode; and it is easy to understand that, according to needs and expectations, more partition coordinate positions and size parameters can be pre-set and each partition can be associated with each video layer one by one, so as to realize the display of the image data streams associated with each video layer in the corresponding partition, that is, a partition is set as the display area of ​​one path of image data on the display screen, thereby achieving the effect of multi-path screen display in partitioned mode. In this implementation, after determining the target display mode via a display mode switching command, the display position of the pre-associated and adapted video layer can be directly obtained through the target display mode. Taking dynamically obtaining the display position of the video layer based on user settings and changes made in the graphical user interface as an example, the user can customize the number and ratio of partitions (e.g., two partitions, asymmetrical ratios such as 6:4 or 7:3) and the correspondence between each partition and the video layer while triggering the display mode switching command through a user interface such as a touch menu. Therefore, the coordinates and size parameters of each video layer can be dynamically recalculated based on the user-defined number and ratio values ​​of the partitions to obtain the coordinate position of each video layer. It should be noted that the correspondence between partitions and video layers can actually be set by the user to correspondence between partitions and endoscopes. Since the endoscope corresponds to the endoscope path, and the image data stream output by the endoscope path is bound to the video layer, the user only needs to associate the partition with the endoscope during settings to determine the correspondence between the partition and the video layer after obtaining the association between the partition and the endoscope. It should also be noted that the values ​​of W and H in the display position of the video layer in the previous example are size parameters set according to the resolution of the display device. The previous example used a resolution of 3840*2160. If the resolution of the display device used changes, the set size parameters will also change accordingly.

[0025] The ISP parameter group corresponding to the video layer refers to the ISP parameter group set on the endoscope path that generates the corresponding image data stream bound to that video layer. As one possible implementation, the user can set different ISP parameter groups for each endoscope probe through the operation interface when the display mode switching command is triggered. This allows each endoscope path to perform image processing using its matching ISP parameter group. Furthermore, since each endoscope path is associated with the video layer through the image data stream, after obtaining the correspondence between the ISP parameter group and each endoscope path, the correspondence between the ISP parameters and the video layer can be further determined. This allows the output display to be based on the ISP parameter group adapted to the corresponding video layer for image rendering. In this embodiment of the invention, each endoscope path independently completes ISP intelligent calibration for the image in its corresponding path through its dedicated VPSS image processing unit. This includes image processing logic such as noise reduction, color correction, brightness and exposure adjustment, sharpness enhancement, and distortion correction. Therefore, by setting different ISP parameter groups for each endoscope path, the image quality parameters of each path can be configured independently according to needs and expectations. This enables differentiated calibration based on the imaging characteristics of different probes, solving the problem of image quality parameter binding and inability to adapt independently in traditional multi-path solutions, and ensuring that each path achieves the optimal imaging effect.

[0026] Layer configuration parameters refer to the attribute parameters of video layers, such as overlay level and order (Z-Order), geometric transformation, pixel format and memory mapping, timing configuration, etc., all of which can be configured and changed. As one possible implementation, the user can also set the layer configuration parameters for the target display mode through the user interface simultaneously with triggering the display mode switching command. Thus, while obtaining the target display mode based on the display mode switching command, the target display mode and its corresponding layer configuration information can be obtained simultaneously based on the parameters carried by the switching command. For example, for a partitioned display mode, the overlay level and order (Z-Order) can be set to control the order in which video layers are stacked. For instance, in a partitioned display mode including two video layers, a lower Layer Z-Order can be assigned to one video layer as a background layer, and a higher Z-Order can be assigned to the other video layer as a foreground layer. This allows the former to be displayed full-screen as the main image, while the latter is displayed as a small window overlaid on top of the main image, achieving a picture-in-picture display effect.

[0027] This invention employs a dual-frame buffer configuration in the video output channel. At any given time, one buffer (referred to as the first buffer in this invention) acts as a foreground buffer, outputting the currently displayed frame in real time. The other buffer (referred to as the second buffer in this invention) acts as a background buffer, pre-rendering the next frame. Upon receiving a user-triggered display mode switching command, this invention does not immediately switch the currently displayed content. Instead, after acquiring the target display mode and its corresponding layer configuration information, the second buffer pre-renders the next frame to match the target display mode, according to the layer configuration information corresponding to the target display mode, including the coordinates of the video layer, the ISP parameter group of the video layer, and the layer configuration parameters. During pre-rendering, the first buffer continues to output the current frame content of the current mode. The display mode switch is completed via operation S3 while waiting for the next vertical synchronization signal, i.e., within the inter-frame window (approximately 0.4ms at a 60Hz refresh rate). Preferably, operation S3 can be implemented by swapping the pointers of the front and back buffers, i.e., the first buffer and the second buffer, within the inter-frame window. For example, swapping the pointers of the first buffer and the second buffer means replacing the memory address pointers corresponding to the first buffer and the second buffer. After the pointer swap is completed, the memory address corresponding to the first buffer at this time stores the pre-rendered screen content adapted to the target display mode. Therefore, the video output channel continues to output screen content based on the first buffer after the pointer swap. In fact, the output is the pre-rendered screen content matching the target display mode in the second buffer before the swap. Thus, the switching of screen content between different display modes is realized within the inter-frame window. In other words, the determination of the target display mode and its corresponding layer configuration information, as well as the pre-rendering of the screen content adapted to the target display mode in the second buffer, in this embodiment of the invention are all performed after the switching command is triggered and before the arrival of the next vertical synchronization signal. The pointer exchange in the buffer occurs within the inter-frame window between the two vertical synchronization signals. Therefore, when the next vertical synchronization signal arrives, the screen continues to be output through the first buffer, displaying the pre-rendered screen content adapted to the target display mode in the second buffer. Thus, this embodiment of the invention utilizes a dual-buffer mechanism and the vertical blanking period of the vertical synchronization signal to achieve vertical synchronization switching of screen content for different display modes. Since no content is displayed on the screen during the vertical blanking period, the buffer exchange process performed at this time is not perceived by the user, thereby achieving seamless switching and ensuring that there are no black screens, screen tearing, or stuttering during the switching process.Furthermore, in this embodiment of the invention, after the switching command is triggered and before the next vertical synchronization signal arrives, the ISP parameter group and layer configuration parameters required for the target display mode are preloaded synchronously in the second buffer. This further ensures that the screen content is immediately output with optimal image quality after the mode switch is completed, avoiding brief parameter misalignment. It should be noted that the vertical synchronization signal (VSYNC) is a timing pulse that controls the alignment of the image sensor and the display device at the start of frame scanning. It is generated by the image sensor (CMOS / CCD) or FPGA processing circuit in the endoscope camera unit (CCU) and transmitted along with the video stream (such as SDI, HDMI, or parallel interface). It is located in the vertical blanking period between two frames of valid image data, and the pulse width is usually a few microseconds to milliseconds. No valid pixels are transmitted during this period. In the case of dual-lens or primary and secondary lens comparison display, the vertical synchronization signal can also be used to force the alignment of multiple video frames to avoid dynamic distortion caused by time difference in split-screen images.

[0028] Therefore, the method of this embodiment of the invention binds one image data stream to one video layer, and defines the video layer as different display modes through layer configuration information. This enables the partitioned display of images from dual or more endoscopic channels on the same display screen, eliminating the need for multiple hosts and display devices. The parameters of each image channel can be adjusted independently, and the display mode can be switched as needed. Furthermore, the method of this embodiment of the invention utilizes a double buffering mechanism to ensure the display quality during display mode switching, avoiding problems such as black screens and stuttering during the switching process.

[0029] As one possible implementation, in the partitioned display mode, embodiments of the present invention also output visual dividing lines between different spliced ​​screens. Specifically, visual dividing lines can be output between different spliced ​​screens based on the obtained dividing gap configuration information. The dividing gap configuration information can be pre-set and associated with a specific partitioned display mode, or it can be customized by the user through a graphical user interface. For example, the dividing gap configuration information includes the width and fill color of the dividing gap between different spliced ​​screens; for example, it can be 2 pixels wide and filled with black. Since one spliced ​​screen actually corresponds to one video layer, and one video layer corresponds to one image data stream, when the user customizes the dividing gap configuration information through the graphical user interface, the dividing gap configuration information can be directly mapped to each endoscope probe. Therefore, based on the user's settings, it can be determined which endoscope path's spliced ​​screen the dividing gap configuration information is compatible with, facilitating user customization and avoiding confusion regarding the correspondence between different spliced ​​screens and endoscope probes.

[0030] In the partitioned display mode, there may be a mismatch between the aspect ratio of the image from a certain probe and the aspect ratio of the display area set on the screen for that probe's image. For example, if two probes are connected simultaneously, one with an image aspect ratio of 4:3 and the other with an image aspect ratio of 16:9, and the corresponding partitioned display mode is a vertical partitioned mode, the display area on the screen is divided into two equally vertical display areas. In this case, the image display effect of one of the probes will be relatively poor. To solve this problem, in a preferred embodiment, before outputting the image content, the aspect ratio of the image data stream bound to the video layer and the aspect ratio of the display area of ​​the spliced ​​image corresponding to the video layer can be determined. Based on the matching of the aspect ratio of the image data stream bound to the video layer and the aspect ratio of the display area of ​​the spliced ​​image corresponding to the video layer, if the aspect ratio of the image data stream bound to the video layer and the aspect ratio of the display area of ​​the spliced ​​image corresponding to the video layer do not match, a proportional scaling mode or a stretching adaptation mode is used to fill the display area of ​​the corresponding spliced ​​image. The proportional scaling mode maintains the original aspect ratio of the output image content (i.e., the aspect ratio of the image data stream processed by the endoscope remains unchanged) while proportionally scaling the image to the display area of ​​the corresponding stitched image (i.e., the display area of ​​the video layer bound to the image data stream). Excess areas in the display area are filled with black borders. This proportional scaling mode ensures no image distortion. The stretch adaptation mode stretches the image content to fill the entire display area of ​​the corresponding stitched image. This mode may produce slight distortion but no black borders. In practical applications, the adaptation mode can be selected or set by the user through a graphical user interface.

[0031] In a preferred embodiment, the present invention can further dynamically allocate hardware resources to each independent endoscopic pathway to meet the display quality and requirements of different scenarios. For example... Figure 2 As shown, the method of this embodiment of the invention is in Figure 1 Based on the method flow shown, it can be further implemented to include: Operation S10 sets the priority of each independent endoscopic pathway according to the received image type setting instruction; Operator S100 allocates VPSS processing time slices and DDR bus bandwidth quotas to each independent endoscope channel according to the priority of each independent endoscope channel.

[0032] In operation S10, the screen type is categorized based on the function provided by the screen. For example, it can be divided into a screen used to provide a basis for key observation or operation (referred to as the main screen in this embodiment) and a screen used to provide basic auxiliary observation basis (referred to as the secondary screen in this embodiment). It should be noted that the main screen and secondary screen here are not necessarily in picture-in-picture display mode, but can adopt other partitioned display modes such as top-bottom partitioned display mode or left-right partitioned display mode. Preferably, in this embodiment, the independent endoscopic pathway corresponding to the main screen is assigned a higher priority, and the independent endoscopic pathway corresponding to the secondary screen is assigned a lower priority. The independent endoscopic pathway corresponding to the main screen refers to the screen content generated by the corresponding independent endoscopic pathway. The corresponding independent endoscopic pathway can be determined by the video layer corresponding to the main screen. Similarly, the corresponding independent endoscopic pathway can also be determined by the video layer corresponding to the secondary screen. It should also be noted that... Figure 2 The sequence of operation steps shown is not a limitation on the order of operation steps, but only a possible sequence of operation steps. Under different circumstances, operation S10 and operation S100 may occur at any stage of the entire method.

[0033] After determining the priority of each independent endoscope channel, in operation S100, this embodiment of the invention allocates VPSS processing time slices and DDR bus bandwidth quotas to each independent endoscope channel according to the priority. Specifically, more VPSS processing time slices and DDR (Double Data Rate) bus bandwidth quotas can be allocated to high-priority endoscope channels to ensure high frame rate (such as 4K / 60fps full frame rate), low latency, and high image quality output of the main screen; the remaining resources are allocated to low-priority endoscope channels, as long as the sub-screen of the corresponding channel can maintain a stable output of 4K / 30fps frame rate to meet the basic auxiliary observation requirements. For example, this can be implemented by: firstly establishing two task scheduling queues and assigning different priorities to the two queues; upon receiving a resource request from a VPSS image processing unit, placing the resource request from the VPSS image processing unit of the high-priority endoscope path into the high-priority queue, and placing the resource request from the VPSS image processing unit of the low-priority endoscope path into the low-priority queue. Specifically, for the resource requests of the VPSS image processing units in the high-priority queue, more VPSS processing time slices and DDR bus bandwidth quotas are allocated, such as allocating more than 70% of the hardware computing power, VPSS processing time slices, and bus bandwidth to the VPSS image processing units in the high-priority queue, thereby ensuring a full frame rate of 4K / 60fps, ultra-low latency, and high-quality image output for the main screen; while for the resource requests of the VPSS image processing units in the low-priority queue, the remaining resources are allocated. Therefore, by adopting a dual-queue priority scheduling strategy, this embodiment of the invention can dynamically allocate resources according to different screen types set by the user, thereby meeting the screen usage requirements of different scenarios. Preferably, users can set the screen type for different endoscopic pathways through graphical user interface such as the device touch menu or physical buttons, thereby setting the priority of their screens. For example, the endoscopic pathway set as the main screen will be assigned a high priority, while the endoscopic pathway set as the secondary screen will be assigned a low priority.

[0034] In some possible implementations, the method of this invention further includes dynamically adjusting the resource allocation of the corresponding endoscope pathways based on the user's switching of the screen type. Specifically, the user can switch the screen type of different endoscope pathways through a graphical user interface such as the device's touch menu or physical buttons. For example, if the original screen type of endoscope pathway A is the main screen and the screen type of endoscope pathway B is the secondary screen, the user can switch the screen type of endoscope pathway A to the secondary screen and switch the screen type of endoscope pathway B to the main screen. After receiving the screen type switching instruction, this invention also switches the priority of each independent endoscope pathway and, within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, reallocates the VPSS processing time slice and DDR bus bandwidth quota to each independent endoscope pathway according to the priority of each independent endoscope pathway after the switch, thereby realizing the dynamic adjustment of resource allocation according to the screen type. Specifically, upon receiving a screen type switching command, the priority of the corresponding endoscope pathway can be adjusted according to the user's switched screen type. Then, based on the adjusted endoscope pathway priority, the resource requests of the VPSS image processing units in the priority queue can be adjusted. Resource requests of VPSS image processing units corresponding to high-priority endoscope pathways are moved to the high-priority queue, while resource requests of VPSS image processing units corresponding to low-priority endoscope pathways are moved to the low-priority queue. Preferably, the adjustment of VPSS image processing unit resource requests in the priority queue is completed within the inter-frame window of the vertical synchronization signal, thereby avoiding screen stuttering caused by resource contention during the transition period. When the next vertical synchronization signal arrives, resource allocation continues according to the adjusted priority queue, and new VPSS image processing unit resource requests are enqueued according to the priority level of their corresponding pathways.

[0035] In a preferred embodiment, the allocation of DDR bus bandwidth quotas to each independent endoscope pathway based on priority can also be implemented using a weighted round-robin arbitration mechanism. For example, a weighted round-robin arbitration mechanism can be used to configure corresponding bus access weights, such as 70%, for high-priority independent endoscope pathways to ensure priority response to bus requests from high-priority endoscope pathways. Simultaneously, a fixed bandwidth quota is configured for low-priority independent endoscope pathways, preferably reserving a minimum bandwidth guarantee (e.g., 20% of the total bandwidth). This ensures low latency in the main screen data pathway and prevents screen interruptions or stuttering in the secondary screen due to resource starvation. It should be noted that the weighted round-robin (WRR) arbitration mechanism is a scheduling strategy that introduces the concept of weights into the basic round-robin algorithm. It aims to allocate resources or bandwidth according to a preset weight ratio. The specific implementation process of resource allocation can be found in relevant existing technologies and will not be elaborated here.

[0036] In other embodiments, the method of this invention can also be implemented by canceling the designation of the screen type, so that each endoscope path has equal priority and can share resource allocation on an equal footing. In this case, the user can directly cancel the screen type setting through a graphical user interface such as the device touch menu or physical buttons. After receiving the user's cancellation of the screen type setting, the method of this invention can further include transferring the resource requests of the VPSS image processing units in the high-priority queue and the low-priority queue to the ordinary task queue within the inter-frame gap window of the vertical synchronization signal, and allocating resources such as VPSS processing time slices and DDR bus bandwidth quotas to the resource requests in the ordinary task queue according to the default resource allocation strategy.

[0037] In other possible implementations, when the display mode is in a partitioned display mode, the method of this embodiment further includes, in response to a received screen linkage operation command, performing screen synchronization processing on at least two spliced ​​screens in the partitioned display mode. The screen synchronization processing can be a synchronous zoom-in operation, a synchronous zoom-out operation, or a synchronous movement operation on the specified spliced ​​screens, depending on the operation type and linked screen specified in the screen linkage operation command. Specifically, a synchronous zoom-in operation means that when one screen is zoomed in, the other screens simultaneously zoom in at the same magnification. A synchronous zoom-out operation means that when one screen is zoomed out, the other screens simultaneously zoom out at the same magnification. A synchronous movement operation means that when one screen is moved (e.g., dragging to view an edge area), the other screens simultaneously move, and the centers of view of at least two synchronously moving screens remain aligned. For example, the specified linked screen can be a specified independent endoscopic pathway that needs to be linked. The synchronous magnification operation can be implemented by determining the video layer bound to the linked screen according to the linked screen specified in the received screen linkage operation instruction, and configuring the magnification parameters of the video layer corresponding to the linked screen to be the same according to the magnification parameter settings of one of the linked screens. The magnification parameters can be the magnification center point and the magnification factor. For example, if the operation type specified in the screen linkage operation instruction is synchronous magnification and the specified linked screens are the screens of independent endoscopic pathway A and independent endoscopic pathway B, after receiving the screen linkage operation instruction, the video layer corresponding to independent endoscopic pathway A and the video layer corresponding to independent endoscopic pathway B will be determined according to the specified linked screens. Then, the magnification center point and magnification factor of the two video layers will be set to be the same. That is, when the magnification center point and magnification factor of the video layer of one of the pathways, such as independent endoscopic pathway A, are changed, the magnification center point and magnification factor of the video layer of independent endoscopic pathway B will also be modified synchronously, thereby realizing the synchronous magnification of the specified linked screen. Similarly, for synchronized zoom-out, the video layer bound to the linked screen is determined based on the linked screen specified in the obtained screen linkage operation instruction. Then, based on the zoom-out parameter settings for one of the linked screens, the zoom-out parameters (such as the zoom-out center point and zoom-out factor) of all video layers corresponding to the linked screen are configured to be the same. Correspondingly, synchronized movement can be implemented by determining the video layer bound to the linked screen based on the linked screen specified in the obtained screen linkage operation instruction, and setting the change in the visible area of ​​all video layers corresponding to the linked screen to the same amount based on the change in the visible area of ​​one of the linked screens. This ensures that when the visible area of ​​one screen changes, the change is synchronously applied to all linked screens, keeping the observation center point of all linked screens consistent.The screen linkage operation commands can be triggered via a graphical user interface or physical input buttons. Setting or modifying the zoom parameters and visible area changes of the linked screen can be done via the graphical user interface or triggered by touch operation. When triggered by touch operation, mouse events can be monitored to obtain the settings or modifications of the zoom parameters and visible area changes of the linked screen. Therefore, this embodiment of the invention also provides a screen linkage mode for spliced ​​screens in a partitioned display mode, allowing users to view details of one screen while other specified screens are automatically zoomed in / moved to the corresponding position. That is, the specified linked screens display the same anatomical location, enabling doctors to simultaneously compare and observe the same area from multiple perspectives during surgery, improving diagnostic efficiency.

[0038] In other embodiments, the method of this invention further includes exiting the video linkage mode in response to a received instruction to cancel video linkage. Exiting the video linkage mode simply requires ceasing to synchronize and modify the parameters of the video layers to restore the independence of each video frame.

[0039] Figure 3 The schematic diagram illustrates the principle block diagram of an endoscopic image processing and display system according to one embodiment of the present invention, such as... Figure 3 As shown, the endoscopic image processing and display system 30 includes: The configuration information loading module 31 is used to obtain the target display mode and its corresponding layer configuration information according to the received display mode switching instruction. The display modes include a full-screen display mode that enables only one video layer and a partitioned display mode that enables at least two video layers at the same time. Each video layer is bound to one image data stream. Each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels and the same display device. All video layers share the display timing and output interface of the video output channels. The buffer data processing module 32 is used to pre-render the screen content in the second buffer based on the target display mode and its corresponding layer configuration information, and to continue to output the screen content that matches the current display mode through the first buffer while pre-rendering the screen content. The mode switching module 33 is used to switch the screen content output through the first buffer to match the target display mode based on the pre-rendered screen content in the second buffer within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal.

[0040] Figure 4 The schematic diagram illustrates the principle block diagram of an endoscopic image processing and display system according to another embodiment of the present invention, such as... Figure 4 As shown, it is in Figure 3The embodiment shown further includes: Resource allocation module 34 is used to determine the priority of each independent endoscope channel according to the received image type setting instruction, and to allocate resources to each independent endoscope channel according to the priority of each independent endoscope channel, including allocating VPSS processing time slices and DDR bus bandwidth quotas; and The priority switching module 35 is used to adjust the priority of each independent endoscope channel according to the received screen type switching command, and reallocate resources for each independent endoscope channel according to the adjusted priority of each independent endoscope channel within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, including reallocating VPSS processing time slices and DDR bus bandwidth quotas for them.

[0041] In other possible implementations, the endoscopic image processing and display system may further include: The visual separation module is used to output visual separation lines between different spliced ​​images based on the obtained separation gap configuration information.

[0042] In some other possible implementations, the endoscopic image processing and display system may further include: The aspect ratio coordination module is used to fill the display area of ​​the corresponding spliced ​​image by using a proportional scaling mode or a stretching adaptation mode when the aspect ratio of the image data stream bound to the video layer does not match the aspect ratio of the display area of ​​the spliced ​​image corresponding to the video layer.

[0043] It should be noted that the specific implementation processes of the configuration information loading module 31, buffer data processing module 32, mode switching module 33, resource allocation module 34, priority switching module 35, visual separation module, and proportion coordination module in this embodiment of the invention can all refer to the method section described above, and will not be repeated here.

[0044] Figure 5 The illustration schematically depicts an endoscopic image processing and display system according to one embodiment of the present invention, such as... Figure 5 As shown, it can be implemented as including at least one endoscope probe 100, a host 200 and a display device 300, wherein at least one endoscope probe is connected to the host and the image is displayed through the display device; wherein the host is configured to perform the method process described in any of the foregoing method embodiments to realize the partitioned display of images from dual or multiple endoscope probes on the display device.

[0045] In some embodiments, the present invention provides a non-volatile computer-readable storage medium storing one or more programs including execution instructions, which can be read and executed by electronic devices (including but not limited to computers, servers, or network devices) to perform the endoscopic image processing and display method of any of the above embodiments of the present invention.

[0046] In some embodiments, the present invention also provides a computer program product, the computer program product including a computer program stored on a non-volatile computer-readable storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the endoscopic image processing and display method of any of the above embodiments.

[0047] In some embodiments, the present invention also provides an electronic device comprising: at least one processor and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the endoscopic image processing and display method of any of the above embodiments.

[0048] In some embodiments, the present invention also provides a computing device comprising: at least one processor and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the endoscopic image processing and display method of any of the above embodiments.

[0049] In some embodiments, the present invention also provides a storage medium storing a computer program that, when executed by a processor, implements the endoscopic image processing and display method of any of the above embodiments.

[0050] Figure 6 This is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. The aforementioned endoscopic image processing and display system can be implemented using the structure shown in this diagram, as follows: Figure 6 As shown, the electronic device includes: One or more processors 610 and memory 620, Figure 6 Take the 610 processor as an example.

[0051] The electronic device may also include an input device 630 and an output device 640.

[0052] The processor 610, memory 620, input device 630, and output device 640 can be connected via a bus or other means. Figure 6 Taking the example of a connection between China and Israel via a bus.

[0053] The memory 620, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the endoscopic image processing and display method in the embodiments of the present invention. The processor 610 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions, and modules stored in the memory 620, thereby implementing the endoscopic image processing and display method of the above-described method embodiments.

[0054] The memory 620 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of endoscopic image processing and display methods, etc. Furthermore, the memory 620 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 620 may optionally include memory remotely located relative to the processor 610, and these remote memories can be connected to the electronic device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0055] Input device 630 can receive input digital or character information and generate signals related to user settings and function control of the image processing device. Output device 640 may include display devices such as a display screen.

[0056] The one or more modules are stored in the memory 620, and when executed by the one or more processors 610, they perform the endoscopic image processing and display method in any of the above method embodiments.

[0057] The above-described product can execute the method provided in the embodiments of the present invention, and has the corresponding functional modules and beneficial effects for executing the method. Technical details not described in detail in this embodiment can be found in the method provided in the embodiments of the present invention.

[0058] The electronic devices of this invention exist in various forms, including but not limited to: (1) Mobile communication devices: These devices are characterized by their mobile communication capabilities and primarily aim to provide voice and data communication. These terminals include: smartphones (e.g., iPhones), multimedia phones, feature phones, and low-end phones, etc.

[0059] (2) Ultra-mobile personal computer devices: These devices fall under the category of personal computers, possessing computing and processing capabilities, and generally also have mobile internet access features. These terminals include PDAs, MIDs, and UMPCs, such as the iPad.

[0060] (3) Portable entertainment devices: These devices can display and play multimedia content. This category includes audio and video players (such as iPods), handheld game consoles, e-book readers, as well as smart toys and portable car navigation devices.

[0061] (4) Server: A device that provides computing services. The components of a server include a processor, hard disk, memory, system bus, etc. Servers are similar to general computer architectures, but because they need to provide highly reliable services, they have higher requirements in terms of processing power, stability, reliability, security, scalability, and manageability.

[0062] (5) Other electronic devices with data interaction functions.

[0063] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0064] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0065] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for processing and displaying endoscopic images, characterized in that, The method enables the display of images from dual-channel or multi-channel endoscopes in partitioned format. The method includes: According to the received display mode switching command, the target display mode and its corresponding layer configuration information are obtained. The display modes include full-screen display mode with only one video layer enabled and partition display mode with at least two video layers enabled at the same time. Each video layer is bound to one image data stream. Each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. Based on the target display mode and its corresponding layer configuration information, the screen content is pre-rendered in the second buffer, and while the screen content is pre-rendered, the screen content matching the current display mode is output through the first buffer. Within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, the pre-rendered image content in the second buffer will be switched to match the image content output from the first buffer to match the target display mode.

2. The method according to claim 1, characterized in that, Within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, the screen content output from the first buffer, based on the pre-rendered screen content in the second buffer, is switched to match the target display mode, including: Within the inter-frame window, pointers to the first and second buffers are swapped, replacing the memory address pointers corresponding to the first and second buffers. After the pointer swap is completed, the video output channel outputs the video based on the pre-rendered image content matching the target display mode in the swapped memory address corresponding to the first buffer.

3. The method according to claim 1, characterized in that, The method further includes: Based on the received image type setting instructions, determine the priority of each independent endoscopic pathway; Resource allocation is performed on each independent endoscope path according to its priority, including allocating VPSS processing time slices and DDR bus bandwidth quotas. The allocation of DDR bus bandwidth quotas to each independent endoscope path is implemented by using a weighted round-robin arbitration mechanism to configure corresponding bus access weights for high-priority independent endoscope paths and to configure fixed bandwidth quotas for low-priority independent endoscope paths.

4. The method according to claim 3, characterized in that, The method further includes: Based on the received screen type switching command, the priority of each independent endoscope channel is adjusted, and within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, resources are reallocated to each independent endoscope channel according to the adjusted priority, including reallocating VPSS processing time slices and DDR bus bandwidth quotas.

5. The method according to claim 1, characterized in that, The layer configuration information includes the display position of the video layer, the ISP parameter group corresponding to the video layer, and the layer configuration parameters. Each independent endoscope path includes an independent set of endoscope probes, MIPI image input interface, video input unit, and VPSS image processing unit.

6. The method according to claim 1, characterized in that, The screen content output by the display device in the partitioned display mode includes at least two spliced ​​screens, each spliced ​​screen corresponding to a video layer. The method further includes: Based on the obtained separation gap configuration information, visual dividing lines are output between different spliced ​​images; Based on the matching of the aspect ratio of the image data stream bound to the video layer and the aspect ratio of the display area of ​​the spliced ​​image corresponding to the video layer, when the aspect ratio of the image data stream bound to the video layer and the aspect ratio of the display area of ​​the spliced ​​image corresponding to the video layer do not match, the display area of ​​the corresponding spliced ​​image is filled using a proportional scaling mode or a stretching adaptation mode.

7. An endoscopic image processing and display system, characterized in that, The system is capable of displaying images from dual-channel or multi-channel endoscopes in partitions. The system includes: The configuration information loading module is used to obtain the target display mode and its corresponding layer configuration information according to the received display mode switching instruction. The display modes include a full-screen display mode that enables only one video layer and a partitioned display mode that enables at least two video layers at the same time. Each video layer is bound to one image data stream, and each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. The buffer data processing module is used to pre-render the screen content in the second buffer based on the target display mode and its corresponding layer configuration information, and to continue to output the screen content that matches the current display mode through the first buffer while pre-rendering the screen content. The mode switching module is used to switch the screen content output through the first buffer to match the target display mode within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, based on the pre-rendered screen content in the second buffer.

8. An endoscopic image processing and display system, characterized in that, The system includes at least one endoscope probe, a main unit, and a display device. All endoscope probes are connected to the main unit and their images are displayed on the display device. The main unit is configured to perform the following method steps to partition and display images from two or more endoscope probes on the display device: According to the received display mode switching command, the target display mode and its corresponding layer configuration information are obtained. The display modes include full-screen display mode with only one video layer enabled and partition display mode with at least two video layers enabled at the same time. Each video layer is bound to one image data stream. Each image data stream is generated by an independent endoscope path. All video layers share the same set of video output channels for display timing and output interface. Based on the target display mode and its corresponding layer configuration information, the screen content is pre-rendered in the second buffer, and while the screen content is pre-rendered, the screen content matching the current display mode is output through the first buffer. Within the frame gap window between the current vertical synchronization signal and the next vertical synchronization signal, the pre-rendered image content in the second buffer will be switched to match the image content output from the first buffer to match the target display mode.

9. A storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the steps of the method described in any one of claims 1 to 6.

10. A computing device, characterized in that, include: A processor and a memory are communicatively connected, the memory storing instructions executable by the processor to enable the processor to perform the steps of the method according to any one of claims 1 to 6.

Images