A multi-channel medical image fusion same-screen display method and platform

Abstract

The present invention belongs to the technical field of multi-screen display, and provides a multi-channel medical image fusion same-screen display method and platform, which performs multi-screen display of image files through multiple display screens, performs modification operations to obtain modification operation positions, and when a user drags an image displayed on a display screen containing the modification operation position, generates a drag virtual channel, performs response missing judgment on the drag virtual channel along the dragging direction to identify the response missing position, and displays a corrected image of the modification operation position; through two different response missing position identifications of delayed type and flickering type, the above-mentioned delay and smoothness, large tail shadow dragging display defects, and frame loss and flickering display defects are corrected according to different situations, thereby further avoiding the problems of inaccurate window boundaries, partial image loss or misalignment caused by different screen sizes, resolutions and refresh rates during dragging.

Description

Technical Field

[0001] The present invention belongs to the technical field of multi-screen display, and in particular relates to a method and platform for multi-channel medical image fusion and same-screen display. Background Art

[0002] As the performance of the display card of the equipment is gradually improved, the display output ports of more and more equipment can support multiple LCD display devices and high-definition display devices. This display terminal with multiple display outputs is suitable for occasions that require multiple different display outputs, and can be connected to different display screens respectively. In the hospital scenario, the role of this device is particularly obvious. More and more doctors use multi-screen display devices to simultaneously analyze the pathological images of different parts of the patient for comprehensive diagnosis, or display CT, MRI, microscopic images, etc. on different screens. However, the current screen size is limited, and excessive reduction on the same screen display will make it difficult to see the lesion location of the pathological image. In actual use, in order to observe the lesion and the affected position around the lesion, the doctor often zooms in, drags the image, or marks the new problem location on the image. When some positions of the pathological image are switched from one image to another position on the screen, the later zoomed in position and the newly added position If the device is moved to another position, the display may freeze when switching, or the marked position may be lost, and the original seam position of the image may be displayed as quasi-mismatched on the new screen. The reason for this phenomenon is that the multi-screen display of the server's splicing processor divides the video signal of one channel into multiple display units, outputs the divided display unit signals to multiple display terminals, and completes the splicing of multiple display screens to form a complete image. Although improving the performance of the splicing processor can improve the data synchronization between multiple display screens, the frame rate will decrease between display screens with different resolutions and scaling ratios under the multi-screen setting of high resolution and refresh rate; and when quickly dragging the image to other display screens, input delay may occur, affecting the smoothness of user operation, and asynchronism may occur during signal transmission, resulting in flickering or delay of the image when switching quickly, large tail shadow dragging, and image frame loss. Summary of the invention

[0003] The purpose of the present invention is to propose a multi-channel medical image fusion same-screen display method and platform to solve one or more technical problems existing in the prior art and at least provide a beneficial choice or create conditions.

[0004] In order to achieve the above object, according to one aspect of the present invention, a multi-channel medical image fusion and same-screen display method is provided, and the multi-channel medical image fusion and same-screen display method comprises the following steps:

[0005] S100, displaying the image file on multiple screens through multiple display screens;

[0006] S200, the user performs a modification operation on an image displayed on any display screen to obtain a modification operation position, and pre-segments the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain a left linkage loading area, a right linkage loading area, an upper linkage loading area, and a lower linkage loading area;

[0007] S300, when the user drags the image displayed on the display screen including the modification operation position, a drag virtual channel is generated in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction;

[0008] S400, performing response missing judgment on the dragged virtual channel along the dragging direction to identify the response missing position;

[0009] S500, displaying a corrected image of the modification operation position when the modification operation position is dragged to the response missing position.

[0010] Furthermore, in S100, the method for performing multi-screen display of image files through multiple display screens is: connecting the multiple display screens to a multi-screen display card of a server, the multi-screen display card can allow each display screen to display a part of the picture separately to form a picture together, or can allow each display screen to display a different picture; wherein each display screen is a liquid crystal display screen or a touch display, and the image in the picture is scaled, dragged, marked or modified by a mouse or gesture touch.

[0011] Preferably, the image is a combination of any one or more of a pathological picture, a CT image, an MRI image, and an X-ray image.

[0012] Furthermore, in S200, the user is a doctor, an administrator of a hospital management information system HIS, or a nurse.

[0013] Further, in S200, the modification operation is to mark, select, add text and graphics, rotate and flip, and deform any image area in the image, and this position is used as the modification operation position.

[0014] Due to the following problems that may occur when dragging an image from one screen to another on a multi-screen display platform: different screens of the spliced ​​screen may have different screen sizes, resulting in inaccurate window boundaries, partial loss or misalignment of the image, and may cause inconsistent frame rates when the image is displayed on different screens, resulting in visual asynchrony. For this reason, the present application performs pre-segmentation through the following method, and ensures accurate identification of the positional relationship of displays of different sizes through division according to the positional relationship of the target display.

[0015] Further, in S200, the method of pre-segmenting the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area is as follows: the display screen where the modification operation position is located is taken as the current display screen; the remaining display screens except the current display screen are recorded as linkage display screens; the adjacent linkage display screens in the horizontal direction (left and right sides) of the current display screen are horizontal linkage display screens; the adjacent linkage display screens in the vertical direction (upper and lower sides) of the current display screen are vertical linkage display screens; (Note that the sizes of the vertical linkage display screens are not necessarily the same, so there are not necessarily two left and right in the horizontal direction. For example, if the current display screen is a larger display screen than the display screen in the horizontal direction, there may be multiple horizontal linkage display screens (for example, there are 3 left display screens spliced ​​with the edge of the current display screen), and the same is true for the vertical linkage display screens. It is also possible that the current display screen is a smaller display screen).

[0016] The two points with the largest distance in the horizontal direction on the boundary of the modification operation position are recorded as the left point on the left side and the right point on the right side; the vertical lines drawn through the left point and the right point in the vertical direction are the left line and the right line respectively; the two points with the largest distance in the vertical direction on the boundary of the modification operation position are recorded as the upper point on the upper side and the lower point on the lower side; the horizontal lines drawn through the upper point and the lower point in the horizontal direction are the upper line and the lower line respectively; the rectangular area formed by the left line, the right line, the upper line and the lower line is the preloading window; the boundaries coincident with the left line and the right line in the preloading window are the left boundary and the right boundary respectively, and the boundaries coincident with the upper line and the lower line in the preloading window are the upper boundary and the lower boundary;

[0017] If the length of the left boundary LD is less than or equal to the length HBLD of the adjacent boundary HBL between the left horizontal linkage display screen and the current display screen, HBL is divided into multiple left adjacent boundaries from top to bottom with a length of [HBLD / LD]; multiple left linkage loading areas are divided on one side of the left horizontal linkage display screen with each left adjacent boundary as the right side and the size of the preloading window;

[0018] If the length of the right border RD is less than or equal to the length HBRD of the adjacent border HBR between the right horizontal linkage display screen and the current display screen, HBR is divided into multiple right adjacent borders from top to bottom by the length [HBRD / RD]; multiple right linkage loading areas are divided on one side of the right horizontal linkage display screen by using each right adjacent border as the left side and the size of the preloading window;

[0019] If the length UD of the upper boundary is less than or equal to the length VBUD of the adjacent boundary VBU between the upper vertical linkage display screen and the current display screen, the VBU is divided into multiple upper adjacent boundaries from left to right by the length [VBUD / UD]; multiple upper linkage loading areas are divided on one side of the upper vertical linkage display screen by using each upper adjacent boundary as the lower side and the size of the preloading window;

[0020] If the length DD of the lower boundary is less than or equal to the length VBDD of the adjacent boundary VBD between the lower vertical linkage display screen and the current display screen, VBD is divided into multiple lower adjacent boundaries from left to right with a length of [VBDD / DD]; multiple lower linkage loading areas are divided on one side of the lower vertical linkage display screen with each lower adjacent boundary as the upper side and the size of the preloading window;

[0021] Among them, [] is the rounding function.

[0022] Since the dragged image is to another screen, dragging can often affect the modification operation position within a channel. For the subsequent image display correction, the following steps estimate a drag virtual channel based on the different linkage loading areas divided in the previous article, so as to accurately plan a range that can be affected by the modification operation position, accurately identify input delays, affect the smoothness of user operations, and cause large tail shadow dragging, frame loss, and flickering areas.

[0023] Further, in S300, the method of generating a drag virtual channel in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction includes:

[0024] The left point is recorded as the left point, and the right point is recorded as the right point, of the two points with the largest distance in the horizontal direction on the boundary of the modification operation position; the upper point is recorded as the upper point, and the lower point is recorded as the lower point, of the two points with the largest distance in the vertical direction on the boundary of the modification operation position; the geometric center of gravity of the modification operation position is recorded as AP; a ray APL is formed in the dragging direction starting from point AP, and any one of the left linkage loading area, right linkage loading area, upper linkage loading area, or lower linkage loading area passed by the ray APL is recorded as the pointing area;

[0025] If the pointing area is an upper linkage loading area or a lower linkage loading area, the longest point from the left point to the four corners of the pointing area constitutes the first line segment; the longest point from the right point to the four corners of the pointing area constitutes the second line segment; the distance between the upper point and the lower point is recorded as the sliding length, and the interval formed by the first line segment and the second line segment is recorded as the drag virtual channel;

[0026] If the pointing area is a left linkage loading area or a right linkage loading area, the longest point from the upper side point to the four corner points of the pointing area constitutes the third line segment; the longest point from the lower side point to the four corner points of the pointing area constitutes the second line segment; the distance between the left point and the right point is recorded as the sliding length, and the interval formed by the first line segment and the second line segment is recorded as the drag virtual channel;

[0027] Note: In the dragging virtual channel, the image of the operation position is displayed in real time at the dragging center point in chronological order as the user drags, starting from the AP point, until the image of the modified operation position is displayed in the pointing interval. Therefore, the path of the dragging virtual channel is likely to appear in the dragging virtual channel. Since the speed at which each pixel in the dragging virtual channel responds to the input signal is different, that is, the time required for the pixel to change from dark to bright or from bright to dark is different (the principle is to apply voltage to the liquid crystal molecules to twist and restore the liquid crystal molecules), especially when the boundary between the switching screens in the dragging virtual channel is different, the black and white response time between the two screens is different. Therefore, in order to accurately calculate the position that needs to be compensated in advance, it is necessary to identify the response missing position through the following method.

[0028] Further, in S400, the method of performing response missing judgment on the dragged virtual channel along the dragging direction to identify the response missing position includes:

[0029] Starting from the AP point, the dragging virtual channel is divided into multiple compensation recognition intervals at every sliding length along the dragging direction;

[0030] The average rise time of the black and white response time of all pixels in the compensation identification interval is recorded as the average rise time of the compensation identification interval;

[0031] The average falling time of the black and white response time of all pixels in the compensation identification interval is recorded as the average falling time of the compensation identification interval;

[0032] The compensation identification intervals are arranged in a front-to-back order along the dragging direction starting from the AP point, and a response missing judgment is performed on each compensation identification interval along the dragging direction starting from the AP point. Specifically, when a compensation identification interval meets the response missing condition, the position of the compensation identification interval is marked as the response missing position.

[0033] Specifically, the response missing condition is: if the average falling time of the current compensation identification interval is greater than the average falling time of the previous compensation identification interval and the average falling time of the next compensation identification interval, and the average rising time of the current compensation identification interval is greater than the average rising time of the previous compensation identification interval and the average rising time of the next compensation identification interval; (that is, in the current compensation identification interval, the average rising time and the average falling time are slower than those of the adjacent compensation identification intervals. At this time, the input is delayed, affecting the smoothness of the user's operation and causing a large tail shadow drag). When the response missing condition is met, the current compensation identification interval is marked as a response missing position, and the type of the response missing position is recorded as a delayed type.

[0034] Preferably, the response missing condition also includes: if the average falling time of the current compensation identification interval is less than the average falling time of the previous compensation identification interval and the average falling time of the next compensation identification interval, and the average rising time of the current compensation identification interval is less than the average rising time of the previous compensation identification interval and the average rising time of the next compensation identification interval; (that is, in the current compensation identification interval, the average rising time and the average falling time are faster than those of the adjacent compensation identification intervals, and frame loss and flickering are prone to occur at this time), when the response missing condition is met, the current compensation identification interval is marked as a response missing position, and the type of the response missing position is recorded as a flickering type.

[0035] Further, in S500, when the modification operation position is dragged to the response missing position, the method of displaying the correction image of the modification operation position includes:

[0036] The image at the segmentation and modification operation position is segmented using the Sobel operator or the watershed algorithm to obtain multiple image sub-regions, and the average gray value of all pixels in the image sub-region is recorded as the gray mean of the image sub-region; the image sub-region with the smallest difference between the gray mean of each image sub-region and the gray mean of the current image sub-region is recorded as the paired sub-region of the current image sub-region;

[0037] When the modification operation position is dragged to the response missing position, if the type of the response missing position is delayed type, the brightness of each image sub-area of ​​the image at each modification operation position is dynamically adjusted in turn to obtain a corrected image: if the paired sub-area of ​​the current image sub-area is adjacent to the current image sub-area (in order to improve the difference contrast while reducing the brightness, the difference between the high brightness values ​​of the adjacent areas is better, especially at the junction of the response missing position between displays. Since the resolution and refresh rate of each screen may be inconsistent, the visual difference between adjacent areas will become larger when crossing the screen), then the difference between the maximum grayscale of the pixels in the current image sub-area and the maximum grayscale of the pixels in the paired sub-area is recorded as the adjusted grayscale; otherwise, the difference between the grayscale mean of the current image sub-area and the grayscale mean of the paired sub-area is recorded as the adjusted grayscale; all pixel values ​​in the current image sub-area are subtracted from the adjusted grayscale to update the pixel values ​​of all pixels to obtain a corrected image.

[0038] When the modification operation position is dragged to the response missing position, if the type of the response missing position is a flashing type, the brightness of each image sub-area of ​​the image at each modification operation position is dynamically adjusted in turn: if the paired sub-area of ​​the current image sub-area is adjacent to the current image sub-area (in order to enhance the contrast while improving the brightness, the difference between the low brightness values ​​of the adjacent areas is better, especially at the junction of the response missing position between displays. Since the resolution and refresh rate of each screen may be inconsistent, the visual difference between adjacent areas will become larger when crossing the screen), then the difference between the minimum grayscale of the pixels in the current image sub-area and the minimum grayscale of the pixels in the paired sub-area is recorded as the adjusted grayscale; otherwise, the difference between the grayscale mean of the current image sub-area and the grayscale mean of the paired sub-area is recorded as the adjusted grayscale; all pixel values ​​in the current image sub-area are increased by the adjusted grayscale to update the pixel values ​​of all pixels to obtain a corrected image.

[0039] Preferably, in S500, when the modification operation position is dragged to the response missing position, if the type of the response missing position is a flashing type, no image is displayed at the response missing position. (The problem of partial image loss or misalignment can be solved).

[0040] Note: The larger the grayscale value, the higher the brightness of the image, and the smaller the grayscale value, the lower the brightness. If the type of the response missing position is delayed, reduce the display brightness; if the type of the response missing position is flickering, increase the display brightness. This will correct the above-mentioned delays and smoothness, large tail shadow dragging, and display defects such as frame loss and flickering, and further avoid the problems of inaccurate window boundaries, partial image loss or misalignment caused by different screen sizes, resolutions and refresh rates when dragging.

[0041] The present invention also provides a multi-channel medical image fusion same-screen display platform, the system comprising: multiple display screens, a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the computer program running in the following system units:

[0042] A multi-screen display unit, used for displaying image files on multiple screens through multiple display screens;

[0043] A boundary segmentation unit is used for obtaining a modification operation position when a user performs a modification operation on an image displayed on any display screen, and pre-segmenting the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain a left linkage loading area, a right linkage loading area, an upper linkage loading area, and a lower linkage loading area;

[0044] A channel construction unit, for generating a drag virtual channel in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction when the user drags the image displayed on the display screen including the modification operation position;

[0045] A missing identification unit is used to judge the missing response of the dragged virtual channel along the dragging direction and identify the missing response position;

[0046] The missing response unit is used to display a correction image of the modification operation position when the modification operation position is dragged to the response missing position.

[0047] The beneficial effects of the present invention are as follows: the present invention provides a multi-channel medical image fusion same-screen display method and platform, which recognizes two different response missing positions, namely, delayed type and flickering type, and corrects the above-mentioned delay and smoothness, display defects of large tail shadow dragging, and display defects of frame loss and flickering according to different situations, thereby further avoiding the problems of inaccurate window boundaries, partial image loss or misalignment caused by different screen sizes, resolutions and refresh rates during dragging. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The above and other features of the present invention will become more obvious by describing in detail the embodiments shown in the accompanying drawings. The same reference numerals in the accompanying drawings of the present invention represent the same or similar elements. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work. In the accompanying drawings:

[0049] Figure 1 Shown is a flow chart of a method for displaying multi-channel medical images by fusion on the same screen;

[0050] Figure 2 Shown is a structural diagram of a multi-channel medical image fusion same-screen display platform. DETAILED DESCRIPTION

[0051] The following will be combined with the embodiments and drawings to clearly and completely describe the concept, specific structure and technical effects of the present invention, so as to fully understand the purpose, scheme and effect of the present invention. It should be noted that the embodiments and features in the embodiments of this application can be combined with each other without conflict.

[0052] like Figure 1 The figure shows a flowchart of a multi-channel medical image fusion and same-screen display method. Figure 1 A method for displaying multi-channel medical images by fusion on the same screen according to an embodiment of the present invention is described below. The method comprises the following steps:

[0053] S100, multi-screen display of image files through 4 displays;

[0054] S200, the user performs a modification operation on an image displayed on any display screen to obtain a modification operation position, and pre-segments the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain a left linkage loading area, a right linkage loading area, an upper linkage loading area, and a lower linkage loading area;

[0055] S300, when the user drags the image displayed on the display screen including the modification operation position, a drag virtual channel is generated in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction;

[0056] S400, performing response missing judgment on the dragged virtual channel along the dragging direction to identify the response missing position;

[0057] S500, displaying a corrected image of the modification operation position when the modification operation position is dragged to the response missing position.

[0058] Furthermore, in S100, the method for performing multi-screen display of the image file through four display screens is: connecting the four display screens to a multi-screen display card of a server, the multi-screen display card can allow each display screen to display a part of the picture separately to form a picture together, or can allow each display screen to display a different picture; wherein each display screen is a touch display.

[0059] Preferably, the image is a pathological picture.

[0060] Further, in S200, the user is a doctor.

[0061] Furthermore, in S200, the modification operation is to mark any image area in the image, and the marked position is used as the modification operation position.

[0062] Further, in S200, the method of pre-segmenting the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area is as follows: the display screen where the modification operation position is located is the current display screen; the remaining display screens except the current display screen are the linkage display screens; the adjacent linkage display screens in the horizontal direction of the current display screen are the horizontal linkage display screens; the adjacent linkage display screens in the vertical direction of the current display screen are the vertical linkage display screens;

[0063] The two points with the largest distance in the horizontal direction on the boundary of the modification operation position are recorded as the left point on the left side and the right point on the right side; the vertical lines drawn through the left point and the right point in the vertical direction are the left line and the right line respectively; the two points with the largest distance in the vertical direction on the boundary of the modification operation position are recorded as the upper point on the upper side and the lower point on the lower side; the horizontal lines drawn through the upper point and the lower point in the horizontal direction are the upper line and the lower line respectively; the rectangular area formed by the left line, the right line, the upper line and the lower line is the preloading window; the boundaries coincident with the left line and the right line in the preloading window are the left boundary and the right boundary respectively, and the boundaries coincident with the upper line and the lower line in the preloading window are the upper boundary and the lower boundary;

[0064] If the length of the left boundary LD is less than or equal to the length HBLD of the adjacent boundary HBL between the left horizontal linkage display screen and the current display screen, HBL is divided into multiple left adjacent boundaries from top to bottom with a length of [HBLD / LD]; multiple left linkage loading areas are divided on one side of the left horizontal linkage display screen with each left adjacent boundary as the right side and the size of the preloading window;

[0065] If the length of the right border RD is less than or equal to the length HBRD of the adjacent border HBR between the right horizontal linkage display screen and the current display screen, HBR is divided into multiple right adjacent borders from top to bottom by the length [HBRD / RD]; multiple right linkage loading areas are divided on one side of the right horizontal linkage display screen by using each right adjacent border as the left side and the size of the preloading window;

[0066] If the length UD of the upper boundary is less than or equal to the length VBUD of the adjacent boundary VBU between the upper vertical linkage display screen and the current display screen, the VBU is divided into multiple upper adjacent boundaries from left to right by the length [VBUD / UD]; multiple upper linkage loading areas are divided on one side of the upper vertical linkage display screen by using each upper adjacent boundary as the lower side and the size of the preloading window;

[0067] If the length DD of the lower boundary is less than or equal to the length VBDD of the adjacent boundary VBD between the lower vertical linkage display screen and the current display screen, VBD is divided into multiple lower adjacent boundaries from left to right with a length of [VBDD / DD]; multiple lower linkage loading areas are divided on one side of the lower vertical linkage display screen with each lower adjacent boundary as the upper side and the size of the preloading window;

[0068] Among them, [] is the rounding function.

[0069] Further, in S300, the method of generating a drag virtual channel in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction includes:

[0070] The left point is recorded as the left point, and the right point is recorded as the right point, of the two points with the largest distance in the horizontal direction on the boundary of the modification operation position; the upper point is recorded as the upper point, and the lower point is recorded as the lower point, of the two points with the largest distance in the vertical direction on the boundary of the modification operation position; the geometric center of gravity of the modification operation position is recorded as AP; a ray APL is formed in the dragging direction starting from point AP, and any one of the left linkage loading area, right linkage loading area, upper linkage loading area, or lower linkage loading area passed by the ray APL is recorded as the pointing area;

[0071] If the pointing area is an upper linkage loading area or a lower linkage loading area, the longest point from the left point to the four corners of the pointing area constitutes the first line segment; the longest point from the right point to the four corners of the pointing area constitutes the second line segment; the distance between the upper point and the lower point is recorded as the sliding length, and the interval formed by the first line segment and the second line segment is recorded as the drag virtual channel;

[0072] If the pointing area is a left linkage loading area or a right linkage loading area, the longest point from the upper side point to the four corner points of the pointing area constitutes the third line segment; the longest point from the lower side point to the four corner points of the pointing area constitutes the second line segment; the distance between the left point and the right point is recorded as the sliding length, and the interval formed by the first line segment and the second line segment is recorded as the drag virtual channel;

[0073] Further, in S400, the method of performing response missing judgment on the dragged virtual channel along the dragging direction to identify the response missing position includes:

[0074] Starting from the AP point, the dragging virtual channel is divided into multiple compensation recognition intervals at every sliding length along the dragging direction;

[0075] The average rise time of the black and white response time of all pixels in the compensation identification interval is recorded as the average rise time of the compensation identification interval;

[0076] The average falling time of the black and white response time of all pixels in the compensation identification interval is recorded as the average falling time of the compensation identification interval;

[0077] The compensation identification intervals are arranged in a front-to-back order along the dragging direction starting from the AP point, and a response missing judgment is performed on each compensation identification interval along the dragging direction starting from the AP point. Specifically, when a compensation identification interval meets the response missing condition, the position of the compensation identification interval is marked as the response missing position.

[0078] Specifically, the response missing condition is: if the average falling time of the current compensation identification interval is greater than the average falling time of the previous compensation identification interval and the average falling time of the next compensation identification interval, and the average rising time of the current compensation identification interval is greater than the average rising time of the previous compensation identification interval and the average rising time of the next compensation identification interval; when the response missing condition is met, the current compensation identification interval is marked as a response missing position, and the type of the response missing position is recorded as delayed type.

[0079] Preferably, the response missing condition also includes: if the average falling time of the current compensation identification interval is less than the average falling time of the previous compensation identification interval and the average falling time of the next compensation identification interval, and the average rising time of the current compensation identification interval is less than the average rising time of the previous compensation identification interval and the average rising time of the next compensation identification interval; when the response missing condition is met, the current compensation identification interval is marked as a response missing position, and the type of the response missing position is recorded as a flashing type.

[0080] Further, in S500, when the modification operation position is dragged to the response missing position, the method of displaying the correction image of the modification operation position includes:

[0081] The image at the segmentation and modification operation position is segmented using the Sobel operator or the watershed algorithm to obtain multiple image sub-regions, and the average gray value of all pixels in the image sub-region is recorded as the gray mean of the image sub-region; the image sub-region with the smallest difference between the gray mean of each image sub-region and the gray mean of the current image sub-region is recorded as the paired sub-region of the current image sub-region;

[0082] When the modification operation position is dragged to the response missing position, if the type of the response missing position is a delayed type, the brightness of each image sub-area of ​​the image at each modification operation position is dynamically adjusted in turn to obtain a corrected image: if the paired sub-area of ​​the current image sub-area is adjacent to the current image sub-area, the difference between the maximum grayscale of the pixels in the current image sub-area and the maximum grayscale of the pixels in the paired sub-area is recorded as the adjusted grayscale; otherwise, the difference between the grayscale mean of the current image sub-area and the grayscale mean of the paired sub-area is recorded as the adjusted grayscale; all pixel values ​​in the current image sub-area are subtracted from the adjusted grayscale to update the pixel values ​​of all pixels to obtain a corrected image.

[0083] When the modification operation position is dragged to the response missing position, if the type of the response missing position is a flashing type, the brightness of each image sub-area of ​​the image at each modification operation position is dynamically adjusted in turn: if the paired sub-area of ​​the current image sub-area is adjacent to the current image sub-area, the difference between the minimum grayscale of the pixels in the current image sub-area and the minimum grayscale of the pixels in the paired sub-area is recorded as the adjusted grayscale; otherwise, the difference between the grayscale mean of the current image sub-area and the grayscale mean of the paired sub-area is recorded as the adjusted grayscale; all pixel values ​​in the current image sub-area are increased by the adjusted grayscale to update the pixel values ​​of all pixels to obtain a corrected image.

[0084] Preferably, in S500, when the modification operation position is dragged to the response missing position, if the type of the response missing position is a blinking type, no image is displayed at the response missing position.

[0085] Preferably, in S500, no image is displayed at the response missing position.

[0086] In addition, the present invention also provides an embodiment of a multi-channel medical image fusion same-screen display platform, such as Figure 2 The figure shows a structural diagram of a multi-channel medical image fusion same-screen display platform of the present invention. The multi-channel medical image fusion same-screen display platform of this embodiment includes: multiple display screens, a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps in the above-mentioned multi-channel medical image fusion same-screen display platform embodiment are implemented.

[0087] The system comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to run in the following units of the system:

[0088] A multi-screen display unit, used for displaying image files on multiple screens through multiple display screens;

[0089] A boundary segmentation unit is used for obtaining a modification operation position when a user performs a modification operation on an image displayed on any display screen, and pre-segmenting the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain a left linkage loading area, a right linkage loading area, an upper linkage loading area, and a lower linkage loading area;

[0090] A channel construction unit, for generating a drag virtual channel in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction when the user drags the image displayed on the display screen including the modification operation position;

[0091] A missing identification unit is used to judge the missing response of the dragged virtual channel along the dragging direction and identify the missing response position;

[0092] The missing response unit is used to display a correction image of the modification operation position when the modification operation position is dragged to the response missing position.

[0093] The multi-channel medical image fusion same-screen display platform can be run on computing devices such as desktop computers, notebooks, PDAs and cloud servers. The multi-channel medical image fusion same-screen display platform can run on systems that may include, but are not limited to, processors and memories. Those skilled in the art will understand that the example is only an example of a multi-channel medical image fusion same-screen display platform and does not constitute a limitation on a multi-channel medical image fusion same-screen display platform. It may include more or fewer components than the example, or a combination of certain components, or different components. For example, the multi-channel medical image fusion same-screen display platform may also include input and output devices, network access devices, buses, etc.

[0094] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the multi-channel medical image fusion same-screen display platform operating system, and uses various interfaces and lines to connect the various parts of the entire multi-channel medical image fusion same-screen display platform operating system.

[0095] The memory can be used to store the computer program and / or module, and the processor realizes various functions of the multi-channel medical image fusion same-screen display platform by running or executing the computer program and / or module stored in the memory, and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SmartMediaCard, SMC), a secure digital (SecureDigital, SD) card, a flash card (FlashCard), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0096] Although the description of the present invention has been quite detailed and has been described in particular with respect to several described embodiments, it is not intended to be limited to any of these details or embodiments or any particular embodiment, so as to effectively cover the intended scope of the present invention. In addition, the present invention is described above with the embodiments foreseeable by the inventors, and its purpose is to provide a useful description, and those non-substantial changes to the present invention that are not currently foreseen may still represent equivalent changes of the present invention.

Claims

1. A method for displaying multi-channel medical images by fusion on the same screen, characterized in that: The method comprises the following steps: S100, displaying the image file on multiple screens through multiple display screens; S200, the user performs a modification operation on an image displayed on any display screen to obtain a modification operation position, and pre-segments the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain a left linkage loading area, a right linkage loading area, an upper linkage loading area, and a lower linkage loading area; S300, when the user drags the image displayed on the display screen including the modification operation position, a drag virtual channel is generated in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area in the drag direction; S400, performing response missing judgment on the dragged virtual channel along the dragging direction to identify the response missing position; S500, displaying a corrected image of the modification operation position when the modification operation position is dragged to the response missing position; In S400, the method of performing response missing judgment on the dragged virtual channel along the dragging direction to identify the response missing position includes: Starting from the AP point, the dragging virtual channel is divided into multiple compensation recognition intervals at every sliding length along the dragging direction; The average rise time of the black and white response time of all pixels in the compensation identification interval is recorded as the average rise time of the compensation identification interval; The average falling time of the black and white response time of all pixels in the compensation identification interval is recorded as the average falling time of the compensation identification interval; Arrange the compensation recognition intervals in a front-to-back order along the dragging direction starting from the AP point, and perform response missing judgment on each compensation recognition interval along the dragging direction starting from the AP point, specifically: when a compensation recognition interval meets the response missing condition, mark the position of the compensation recognition interval as the response missing position; The response missing condition is: if the average falling time of the current compensation identification interval is greater than the average falling time of the previous compensation identification interval and the average falling time of the next compensation identification interval, and the average rising time of the current compensation identification interval is greater than the average rising time of the previous compensation identification interval and the average rising time of the next compensation identification interval; when the response missing condition is met, the current compensation identification interval is marked as a response missing position, and the type of the response missing position is recorded as delayed type; The response missing condition also includes: if the average falling time of the current compensation identification interval is less than the average falling time of the previous compensation identification interval and the average falling time of the next compensation identification interval, and the average rising time of the current compensation identification interval is less than the average rising time of the previous compensation identification interval and the average rising time of the next compensation identification interval; when the response missing condition is met, the current compensation identification interval is marked as a response missing position, and the type of the response missing position is recorded as a flickering type; In S500, the method of displaying a correction image of the modification operation position when the modification operation position is dragged to the response missing position includes: The image at the segmentation and modification operation position is segmented using the Sobel operator or the watershed algorithm to obtain multiple image sub-regions, and the average gray value of all pixels in the image sub-region is recorded as the gray mean of the image sub-region; the image sub-region with the smallest difference between the gray mean of each image sub-region and the gray mean of the current image sub-region is recorded as the paired sub-region of the current image sub-region; When the modification operation position is dragged to the response missing position, if the type of the response missing position is a delayed type, the brightness of each image sub-area of ​​the image at each modification operation position is dynamically adjusted in turn to obtain a corrected image: if the paired sub-area of ​​the current image sub-area is adjacent to the current image sub-area, the difference between the maximum grayscale of the pixels in the current image sub-area and the maximum grayscale of the pixels in the paired sub-area is recorded as the adjusted grayscale; otherwise, the difference between the grayscale mean of the current image sub-area and the grayscale mean of the paired sub-area is recorded as the adjusted grayscale; all pixel values ​​in the current image sub-area are subtracted from the adjusted grayscale to update the pixel values ​​of all pixels to obtain a corrected image; When the modification operation position is dragged to the response missing position, if the type of the response missing position is a flashing type, the brightness of each image sub-area of ​​the image at each modification operation position is dynamically adjusted in turn: If the paired sub-area of ​​the current image sub-area is adjacent to the current image sub-area, the difference between the minimum grayscale of the pixels in the current image sub-area and the minimum grayscale of the pixels in the paired sub-area is recorded as the adjusted grayscale; otherwise, the difference between the grayscale mean of the current image sub-area and the grayscale mean of the paired sub-area is recorded as the adjusted grayscale; the adjusted grayscale is increased for all pixel values ​​in the current image sub-area to update the pixel values ​​of all pixels to obtain a corrected image.

2. The method for displaying multi-channel medical images by fusion on the same screen according to claim 1, characterized in that: In S100, the method for displaying an image file on multiple screens through multiple display screens is as follows: the multiple display screens are connected to a multi-screen display card of a server, and the multi-screen display card can allow each display screen to display a part of the picture separately to form a picture together, or allow each display screen to display a different picture; wherein each display screen is a liquid crystal display screen or a touch display, and the image in the picture is scaled, dragged, marked or modified by a mouse or gesture touch.

3. The method for displaying multi-channel medical images by fusion on the same screen according to claim 1, characterized in that: In S200, the method of pre-segmenting the boundaries of the remaining display screens except the display screen according to the modification operation position to obtain the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area is as follows: the display screen where the modification operation position is located is the current display screen; the remaining display screens except the current display screen are linkage display screens; the adjacent linkage display screens in the horizontal direction of the current display screen are horizontal linkage display screens; the adjacent linkage display screens in the vertical direction of the current display screen are vertical linkage display screens; The two points with the largest distance in the horizontal direction on the boundary of the modification operation position are recorded as the left point on the left side and the right point on the right side; the vertical lines drawn through the left point and the right point in the vertical direction are the left line and the right line respectively; the two points with the largest distance in the vertical direction on the boundary of the modification operation position are recorded as the upper point on the upper side and the lower point on the lower side; the horizontal lines drawn through the upper point and the lower point in the horizontal direction are the upper line and the lower line respectively; the rectangular area formed by the left line, the right line, the upper line and the lower line is the preloading window; the boundaries coincident with the left line and the right line in the preloading window are the left boundary and the right boundary respectively, and the boundaries coincident with the upper line and the lower line in the preloading window are the upper boundary and the lower boundary; If the length of the left boundary LD is less than or equal to the length HBLD of the adjacent boundary HBL between the left horizontal linkage display screen and the current display screen, HBL is divided into multiple left adjacent boundaries from top to bottom with a length of [HBLD / LD]; multiple left linkage loading areas are divided on one side of the left horizontal linkage display screen with each left adjacent boundary as the right side and the size of the preloading window; If the length of the right border RD is less than or equal to the length HBRD of the adjacent border HBR between the right horizontal linkage display screen and the current display screen, HBR is divided into multiple right adjacent borders from top to bottom by the length [HBRD / RD]; multiple right linkage loading areas are divided on one side of the right horizontal linkage display screen by using each right adjacent border as the left side and the size of the preloading window; If the length UD of the upper boundary is less than or equal to the length VBUD of the adjacent boundary VBU between the upper vertical linkage display screen and the current display screen, the VBU is divided into multiple upper adjacent boundaries from left to right by the length [VBUD / UD]; multiple upper linkage loading areas are divided on one side of the upper vertical linkage display screen by using each upper adjacent boundary as the lower side and the size of the preloading window; If the length DD of the lower boundary is less than or equal to the length VBDD of the adjacent boundary VBD between the lower vertical linkage display screen and the current display screen, VBD is divided into multiple lower adjacent boundaries from left to right with a length of [VBDD / DD]; multiple lower linkage loading areas are divided on one side of the lower vertical linkage display screen with each lower adjacent boundary as the upper side and the size of the preloading window; wherein [] is a rounding function.

4. The method for displaying multi-channel medical images by fusion on the same screen according to claim 1, characterized in that: In S300, the method for generating a drag virtual channel in the drag direction in the corresponding directions of the left linkage loading area, the right linkage loading area, the upper linkage loading area, and the lower linkage loading area includes: The left point is recorded as the left point, and the right point is recorded as the right point, of the two points with the largest distance in the horizontal direction on the boundary of the modification operation position; the upper point is recorded as the upper point, and the lower point is recorded as the lower point, of the two points with the largest distance in the vertical direction on the boundary of the modification operation position; the geometric center of gravity of the modification operation position is recorded as AP; a ray APL is formed in the dragging direction starting from point AP, and any one of the left linkage loading area, right linkage loading area, upper linkage loading area, or lower linkage loading area passed by the ray APL is recorded as the pointing area; If the pointing area is an upper linkage loading area or a lower linkage loading area, the longest point from the left point to the four corners of the pointing area constitutes the first line segment; the longest point from the right point to the four corners of the pointing area constitutes the second line segment; the distance between the upper point and the lower point is recorded as the sliding length, and the interval formed by the first line segment and the second line segment is recorded as the drag virtual channel; If the pointing area is a left-linked loading area or a right-linked loading area, the third line segment is formed by the longest point from the upper side point to the points at the four corners of the pointing area; the second line segment is formed by the longest point from the lower side point to the points at the four corners of the pointing area; the distance between the left point and the right point is recorded as the sliding length, and the interval formed by the first line segment and the second line segment is recorded as the dragging virtual channel.

5. A multi-channel medical image fusion same-screen display platform, characterized in that: The multi-channel medical image fusion same-screen display platform includes: multiple display screens, a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps in the multi-channel medical image fusion same-screen display method described in any one of claims 1-4 are implemented.

Images