A method, device and storage medium for displaying images on multiple display screens

Abstract

The present application discloses a multi-display screen image display method, device and storage medium, which relates to the field of endoscope imaging technology and is used to display richer and more logical image information on multiple display screens. The method includes: determining a mapping relationship between multiple display combinations and multiple display screens; wherein a display combination includes a functional image; or a display combination includes an image fused from multiple functional images; the functional image is an image obtained by image processing the original image taken by the endoscope; the mapping relationship refers to the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens; according to the display levels of multiple display screens in the mapping relationship, display combinations of corresponding display levels are sent to multiple display screens respectively, so that multiple display screens respectively display display combinations of different display levels.

Description

Technical Field

[0001] The present application relates to the field of endoscopic imaging technology, and in particular to a multi-display screen image display method, device and storage medium. Background Art

[0002] Currently, in the field of medical endoscopic imaging, images captured by an endoscope inside the body can be displayed on multiple display screens, so that users such as doctors can check the internal condition of the patient.

[0003] However, in the related art, only the same image can be displayed on multiple display screens. If the user wants to watch different image screens at the same time, the multiple display screens need to be manually adjusted separately, which is troublesome to operate and brings a poor user experience and cannot meet the diverse needs of users. Summary of the invention

[0004] The present application provides a multi-display screen image display method, device and storage medium, which are used to display richer and more logical image information on multiple display screens.

[0005] In a first aspect, the present application provides a multi-display image display method, which is applied to a host in a multi-display display system, wherein the multi-display display system also includes: an endoscope and multiple display screens; the method includes: determining a mapping relationship between multiple display combinations and multiple display screens; wherein a display combination includes a functional image; or, a display combination includes an image fused from multiple functional images; the functional image is an image obtained by performing image processing on an original image taken by the endoscope; the mapping relationship refers to a mapping relationship between display levels of multiple display combinations and display levels of multiple display screens; according to the display levels of multiple display screens in the mapping relationship, display combinations of corresponding display levels are sent to the multiple display screens respectively, so that the multiple display screens respectively display display combinations of different display levels.

[0006] It can be understood that in the method provided by the present application, the mapping relationship between multiple display combinations (one display combination includes one functional image; or, one display combination includes an image after the fusion of multiple functional images) and multiple display screens is first determined; wherein, the mapping relationship is the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens; then, according to the mapping relationship, the multiple display combinations are matched with the multiple display screens step by step, and then the display combinations of the corresponding display levels are sent to each of the multiple display screens respectively, so that the multiple display screens respectively display display combinations of different display levels. In this way, compared with the method in the related art in which multiple display screens repeatedly display a single screen, the embodiment of the present application can provide users with richer display screens; at the same time, multiple display combinations are made to correspond to multiple display screens one by one according to the display levels, so as to achieve the effect of hierarchical display, so that the display combinations displayed on the multiple display screens are logical and relevant, which can meet the diverse needs of users.

[0007] As a possible implementation manner, before determining the mapping relationship between multiple display combinations and multiple display screens, the method further includes: performing image processing on the original image taken by the endoscope to obtain a functional image; wherein the image processing includes one or more of the following: image staining processing, image enhancement processing, target detection, target recognition and target segmentation.

[0008] As another possible implementation, the above-mentioned determination of the mapping relationship between multiple display combinations and multiple display screens includes: determining the display levels of multiple functional images; the display level of the functional image is determined by the visibility and / or informativeness of the functional image; determining the display level of each display combination in the multiple display combinations according to the display levels of each functional image constituting each display combination; the display level of the display combination reflects the importance of the display combination; matching the display level of each display combination in the multiple display combinations with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship; the display level of the display screen is determined by the position of the display screen and the viewing object of the display screen.

[0009] As another possible implementation manner, after determining the display level of each display combination in the multiple display combinations according to the display levels of the various functional images constituting each display combination, the method further includes: identifying repeated display combinations from the multiple display combinations; a repeated display combination refers to a display combination with a non-highest display level among the display combinations having the same functional image; adjusting the display levels of the multiple display combinations according to the repeated display combinations; wherein the adjusted display levels of the repeated display combinations are lower than the adjusted display levels of the non-repeated display combinations; the above-mentioned matching the display level of each display combination in the multiple display combinations with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship includes: matching the adjusted display level of each display combination in the multiple display combinations with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship.

[0010] As another possible implementation manner, the above method also includes: receiving a first trigger operation; the first trigger operation is used to instruct the display combination corresponding to each display screen in the multiple display screens to switch step by step; wherein the step-by-step switching includes: switching the display combination corresponding to each display screen to a display combination with a high display level; or, switching the display combination corresponding to each display screen to a display combination with a low display level; in response to the first trigger operation, switching the display combination corresponding to each display screen in the multiple display screens step by step.

[0011] As another possible implementation, before determining the mapping relationship between the multiple display combinations and the multiple display screens, the method further includes: receiving a second trigger operation, the second trigger operation being used to instruct the multiple display screens to display according to the first display mode; in the first display mode, the multiple display screens include a main display screen and multiple sub-display screens; the main display screen is used to display the original image taken by the endoscope; the multiple sub-display screens are used to respectively display different display combinations; or, receiving a third trigger operation; the third trigger operation is used to instruct the multiple display screens to display according to the second display mode; in the second display mode, the first display screen among the multiple display screens is used to display the original image taken by the endoscope; the other display screens among the multiple display screens except the first display screen are used to respectively display different display combinations.

[0012] In a second aspect, the present application provides a multi-display image display device, which is applied to a host in a multi-display display system, and the multi-display display system also includes an endoscope and multiple display screens; the device includes: a determination module, which is used to determine the mapping relationship between multiple display combinations and multiple display screens; wherein a display combination includes a functional image; or, a display combination includes an image after a fusion of multiple functional images; the functional image is an image obtained after image processing of the original image taken by the endoscope; the mapping relationship refers to the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens; a sending module, which is used to send display combinations of corresponding display levels to multiple display screens according to the display levels of multiple display screens in the mapping relationship, so that the multiple display screens respectively display display combinations of different display levels.

[0013] As a possible implementation method, the multi-display image display device also includes: a processing module, which is used to perform image processing on the original image taken by the endoscope to obtain a functional image; wherein the image processing includes one or more of the following: image staining processing, image enhancement processing, target detection, target recognition and target segmentation.

[0014] As another possible implementation, a determination module is specifically used to determine display levels of multiple functional images; the display level of the functional image is determined by the visibility and / or informativeness of the functional image; the display level of each display combination in the multiple display combinations is determined according to the display levels of the individual functional images constituting each display combination; the display level of the display combination reflects the importance of the display combination; the display level of each display combination in the multiple display combinations is matched step by step with the display level of each display screen in the multiple display screens to obtain a mapping relationship; the display level of the display screen is determined by the position of the display screen and the viewing object of the display screen.

[0015] As another possible implementation, the determination module is further used to identify repeated display combinations from multiple display combinations; a repeated display combination refers to a display combination with a non-highest display level among display combinations having the same functional image; the display levels of multiple display combinations are adjusted according to the repeated display combinations; wherein the display levels of the adjusted repeated display combinations are lower than the display levels of the adjusted non-repeated display combinations; the determination module is specifically used to match the display level of each display combination in the multiple display combinations after adjustment with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship.

[0016] As another possible implementation, the multi-display image display device also includes: a receiving module and a switching module; the receiving module is used to receive a first trigger operation; the first trigger operation is used to instruct the display combination corresponding to each display screen in the multiple display screens to switch step by step; wherein the step-by-step switching includes: switching the display combination corresponding to each display screen to a display combination with a high display level; or, switching the display combination corresponding to each display screen to a display combination with a low display level; the switching module is used to switch the display combination corresponding to each display screen in the multiple display screens step by step in response to the first trigger operation.

[0017] As another possible implementation, the receiving module is further used to receive a second trigger operation, the second trigger operation is used to instruct multiple display screens to display according to a first display mode; in the first display mode, the multiple display screens include a main display screen and multiple sub-display screens; the main display screen is used to display the original image taken by the endoscope; the multiple sub-display screens are used to respectively display different display combinations; or, receive a third trigger operation; the third trigger operation is used to instruct multiple display screens to display according to a second display mode; in the second display mode, the first display screen among the multiple display screens is used to display the original image taken by the endoscope; the other display screens among the multiple display screens except the first display screen are used to respectively display different display combinations.

[0018] In a third aspect, the present application provides a multi-display image display device, comprising: one or more processors; one or more memories; wherein the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the multi-display image display device executes any one of the multi-display image display methods provided in the first aspect above.

[0019] In a fourth aspect, the present application provides a computer-readable storage medium, which stores computer execution instructions. When the computer execution instructions are executed on a computer, the computer executes any one of the multi-display image display methods provided in the first aspect above.

[0020] The descriptions of the second to fourth aspects in this application can refer to the detailed description of the first aspect; and the beneficial effects of the descriptions of the second to fourth aspects can refer to the beneficial effect analysis of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic diagram of the structure of a multi-display system provided in an embodiment of the present application;

[0022] Figure 2 A process of a multi-display screen image display method provided in an embodiment of the present application Figure 1;

[0023] Figure 3 A process of a multi-display screen image display method provided in an embodiment of the present application Figure 2 ;

[0024] Figure 4 A schematic diagram of personnel positions provided in an embodiment of the present application;

[0025] Figure 5 A schematic diagram of a host interface provided in an embodiment of the present application Figure 1 ;

[0026] Figure 6 A display mode diagram of a display device provided in an embodiment of the present application Figure 1 ;

[0027] Figure 7 A schematic diagram of a host interface provided in an embodiment of the present application Figure 2 ;

[0028] Figure 8 A display mode diagram of a display device provided in an embodiment of the present application Figure 2 ;

[0029] Fig. 9 A schematic diagram of a host interface provided in an embodiment of the present application Figure 3 ;

[0030] Fig.10 A schematic diagram of a display level switching provided in an embodiment of the present application Figure 1 ;

[0031] Fig.11 A schematic diagram of a display level switching provided in an embodiment of the present application Figure 2 ;

[0032] Fig.12 A schematic diagram of a multi-display image display device provided in an embodiment of the present application Figure 1 ;

[0033] Fig.13 A schematic diagram of a multi-display image display device provided in an embodiment of the present application Figure 2 . DETAILED DESCRIPTION

[0034] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0035] The terms "first" and "second" and the like in the specification and drawings of this application are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.

[0036] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0037] It should be noted that, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0038] In the description of this application, unless otherwise specified, the meaning of "plurality" refers to two or more than two. For example, the meaning of "plurality of display combinations" refers to two or more than two display combinations.

[0039] As described in the background art, currently, in the field of medical endoscopic imaging, images captured by an endoscope inside the body can be displayed through multiple display screens, so that users such as doctors can check the internal condition of the patient.

[0040] However, in the related art, only the same image can be displayed on multiple display screens. If the user wants to watch different image screens at the same time, the multiple display screens need to be manually adjusted separately, which is troublesome to operate and brings a poor user experience and cannot meet the diverse needs of users.

[0041] In response to the above technical problems, the embodiment of the present application provides a multi-display screen image display method, the idea of ​​which is to: determine the mapping relationship between multiple display combinations (one display combination includes one functional image; or, one display combination includes an image after the fusion of multiple functional images) and multiple display screens; wherein, the mapping relationship is the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens; according to the mapping relationship, the multiple display combinations are matched with the multiple display screens step by step, and then the display combinations of the corresponding display levels are sent to each of the multiple display screens respectively, so that the multiple display screens respectively display display combinations of different display levels. In this way, compared with the method in the related art in which multiple display screens repeatedly display a single screen, the embodiment of the present application can provide users with richer display screens; at the same time, multiple display combinations are made to correspond to multiple display screens one by one according to the display levels, so as to achieve the effect of hierarchical display, so that the display combinations displayed on the multiple display screens are logical and relevant, which can meet the diverse needs of users.

[0042] The embodiments provided in this application are described in detail below in conjunction with the accompanying drawings.

[0043] Please refer to Figure 1 , which shows a multi-display system provided by an embodiment of the present application. Figure 1 As shown, the multi-display system 100 may include: an endoscope 110 , a host 120 and a display device 130 .

[0044] The endoscope 110 is used to be introduced into the interior of a living body through a natural passage of the living body to capture image information of the interior of the living body.

[0045] In some embodiments, the endoscope 110 can be combined with a light source device ( Figure 1 The light source device is connected to a light source (not shown) for emitting illumination light so that the endoscope 110 can capture a clear image. Optionally, white light can be emitted for visible light imaging.

[0046] The host 120, also called the camera system host, is used to receive the image sent by the endoscope 110, process the image, and send the processed image to the display device 130. Optionally, the host 120 is also used to control the endoscope 110 to send the acquired image to the host 120; the host 120 is also used to control the light source device to turn on or off the light source, etc. It should be understood that the host 120 can generate an operation control signal based on the instruction operation code and the timing signal to instruct other devices in the implementation environment to execute the control instruction. In addition, the host 120 itself has an image processing function, or the host 120 is integrated with other devices with image processing.

[0047] Understandably, Figure 1The host 120 shown in is only an example, and the present application does not limit the specific existence form of the host 120. For example, the host 120 can be a server; or, the host 120 can be a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose processor network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD) or any combination thereof. The host 120 can also be other devices with processing functions, such as circuits, devices or software modules, and the present application does not impose any restrictions on this.

[0048] The display device 130 is used to receive the processed image information sent by the host 120 and display the processed image information on the display device 130 .

[0049] In some embodiments, the display device 130 includes one or more display screens. Figure 1 As shown, the display device 130 may include: display screen 1, ..., display screen n, where n is an integer greater than 1.

[0050] Optionally, the models, sizes, display parameters, etc. of the multiple display screens may be different. The embodiment of the present application does not specifically limit the specific type, size, resolution, etc. of the display device 130.

[0051] Exemplarily, the display device 130 may be a liquid crystal display, an organic light-emitting diode (OLED) display, or the like.

[0052] The following is a detailed introduction to a multi-display screen image display method provided in an embodiment of the present application.

[0053] The method for hierarchical image display provided in the embodiment of the present application is applied to a multi-display system, and the multi-display system includes: a plurality of display screens (for example, Figure 1 ) and a host (e.g., as shown in Figure 1 host 120 shown in FIG.

[0054] Optionally, the method provided in the embodiment of the present application may be executed by a host. Figure 2 As shown, the method comprises the following steps:

[0055] S101: Determine a mapping relationship between a plurality of display combinations and a plurality of display screens.

[0056] Wherein, one display combination includes one functional image; or one display combination includes an image obtained by merging multiple functional images. The functional image is an image obtained by image processing the original image taken by the endoscope.

[0057] In some embodiments, before executing the above step S101, the method further includes: performing image processing on the original image captured by the endoscope to obtain a functional image. The image processing includes but is not limited to: image staining processing, image enhancement processing and intelligent image processing (target detection, target recognition and target segmentation).

[0058] Exemplarily, the original image captured by the endoscope is subjected to intelligent image processing to obtain a functional image containing intelligent information, wherein the intelligent image processing includes: target segmentation, target recognition, target detection, etc.

[0059] In another exemplary embodiment, the original image captured by the endoscope is subjected to image dyeing processing to obtain a dyed functional image. The above-mentioned image dyeing processing includes: fluorescence dyeing, spectral dyeing, electronic dyeing, etc. For example, the fluorescence dyeing processing of the original image captured by the endoscope includes: obtaining a fluorescence image of the original image, determining the dyeing depth value of each pixel point according to the fluorescence concentration of each pixel point in the fluorescence image (for example, the dyeing depth value may be proportional to the fluorescence concentration), and then dyeing each pixel point in the original image according to the dyeing depth value of each pixel point to obtain a fluorescent dyed functional image.

[0060] In another exemplary embodiment, the original image captured by the endoscope is subjected to image enhancement processing to obtain an enhanced functional image. The above-mentioned image enhancement processing includes: clarity enhancement, brightness enhancement, etc. For example, the brightness enhancement processing of the original image captured by the endoscope includes: enhancing the brightness component of each pixel point of the original image to obtain a functional image with enhanced brightness.

[0061] It can be understood that the method provided in the embodiment of the present application can perform different image processing on the original image taken by the endoscope to obtain multiple functional images to meet the different needs of users.

[0062] In some embodiments, the method provided by the embodiment of the present application further includes: determining a display combination. Optionally, the functional images that can be fused and displayed among the multiple functional images are used as a display combination, and the functional images that cannot be fused and displayed are used as a single display combination.

[0063] The functional image that can be fused and displayed refers to a fused image obtained after image fusion, which does not affect the display effects of each functional image.

[0064] For example, assuming that there are N functional images, theoretically there are

[0065] display combinations, assuming there are 4 functional images, then theoretically

[0066] ; Eliminate the display combinations that cannot be fused, and obtain T display combinations. Among them, the display combinations that cannot be fused are display combinations that affect their respective functional effects after fusion, for example, display combinations generated by different data streams cannot be fused (for example, a single-channel fluorescence image and a visible light image data stream cannot be fused).

[0067] In some embodiments, the above mapping relationship refers to the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens. Figure 3 As shown, the above step S101 can specifically implement the following steps:

[0068] S1011. Determine display levels of multiple functional images.

[0069] Optionally, the display level of the functional image is determined by the visibility and / or informativeness of the functional image. Visibility reflects the visual effect of the functional image; informativeness reflects the amount of information contained in the functional image. For example, the better the visual effect of the functional image, the higher the display level of the functional image; and / or, the more information contained in the functional image, the higher the display level of the functional image.

[0070] In some embodiments, determining the display levels of the plurality of functional images may be implemented as follows:

[0071] Step a1: score multiple functional images according to preset evaluation rules to obtain a score for each functional image.

[0072] The preset evaluation rules are used to evaluate one or more of the visibility, informativeness or importance of the functional image.

[0073] In some embodiments, the above-mentioned preset evaluation rules include one or more evaluation indicators, such as: visibility evaluation indicators, and / or information evaluation indicators, etc.

[0074] Among them, the visibility evaluation index is an index for evaluating the visibility of the functional image (the degree of visibility and visual effect of the functional image). It can be understood that the less the visual loss of the functional image and the closer it is to the original image, the better the visibility of the functional image. For example, some functional images need to be displayed in a frame over the original image, and the target frame will affect the visibility of the image; for another example, some functional images are converted from the original image to an image in other color domains, thereby highlighting some information, which will also reduce the visibility of the functional image.

[0075] For example, the method of evaluating the functional image using the visibility evaluation index may satisfy the following formula (1):

[0076] SSIM(x,y)=((2μ_x·μ_y+c_1)(σ_xy+c_2)) / ((μ_x 2 +μ_y 2 +c_1)(σ_x 2 +σ_y 2 +c_2)) Formula (1)

[0077] Among them, x represents the original image, y represents the functional image, μ_x represents the average color component of the GRB channel of each pixel in the original image, μ_y represents the average color component of the GRB channel of each pixel in the functional image, σ_x represents the standard deviation of the color component of the RGB channel of each pixel in the original image, σ_y represents the standard deviation of the color component of the RGB channel of each pixel in the functional image, σ_xy is the covariance, c_1 and c_2 are both constants (used to avoid the denominator being 0 and ensure the validity of the fraction).

[0078] The informativeness evaluation index is an index for evaluating the informativeness of a functional image (the degree of additional information provided by the functional image). Generally, the more additional information a functional image provides, the higher the informativeness score of the functional image.

[0079] Exemplarily, the evaluation of functional images using information evaluation indicators includes: determining the score of the amount of information provided by the functional image according to the type of the functional image. For example, intelligent information category (including target recognition, target segmentation, target detection, etc.) is 3 points per item, image staining category (including fluorescent staining, spectral staining, electronic staining, etc.) is 2 points per item, image enhancement category (clarity enhancement, brightness enhancement, etc.) is 1 point per item, and other categories are 0.5 points per item.

[0080] The category of the functional image is determined according to the attribute flag corresponding to the image processing. For example, the attribute flag corresponding to the intelligent information processing is 1, the flag corresponding to the image dyeing processing is 2, and the flag corresponding to the image enhancement processing is 3. Therefore, when the functional image is obtained through image processing, the category of the functional image can be determined according to the attribute flag corresponding to the image processing category.

[0081] In some embodiments, the preset evaluation rules may further include: an importance evaluation index. The importance evaluation index is an index for evaluating the importance of the functional image. The importance of the functional image is determined by the visibility and informativeness of the functional image, that is, importance (S) = visibility (V) + informativeness (I).

[0082] For example, the importance of the functional image can be evaluated by using the importance evaluation index to satisfy the following formula (2):

[0083] S i =α i *V i +β i *I i Formula (2)

[0084] Among them, α i and β i is the modulation weight.

[0085] It can be understood that, in the case where both the visibility and informativeness of a functional image are required, the importance of the functional image is determined by the rule for evaluating the importance of the functional image. For example, in the case where the user attaches more importance to the visibility of the functional image, the weight of visibility is increased by α i , to improve the importance score of functional images with good visibility; for example, if users attach more importance to the informativeness of functional images, then the weight of informativeness β is increased. i , to score the importance of highly informative functional images.

[0086] In some embodiments, for each functional image among the multiple functional images, the score of each evaluation indicator of each functional image is determined according to a preset evaluation rule, and the sum of the scores of each evaluation indicator is used as the score of the functional image.

[0087] Exemplarily, assuming that the preset evaluation rules include: visibility evaluation index, informativeness evaluation index and importance evaluation index; assuming that the score of the visibility evaluation index of functional image 1 is 2 points, the score of the informativeness evaluation index is 3 points, and the importance evaluation index is 3 points, then the score of functional image 1 is 8 points.

[0088] Step a2: sort the score of each functional image to obtain the display level of multiple functional images.

[0089] In some embodiments, the score of each functional image is sorted in order from high to low to obtain display levels of the multiple functional images, wherein a functional image with a high score corresponds to a high display level, and a functional image with a low score corresponds to a low display level.

[0090] Exemplarily, assuming that the multiple functional images include: functional image 1, functional image 2, functional image 3 and functional image 4; wherein the score of functional image 1 is 5 points, the score of functional image 2 is 8 points, the score of functional image 3 is 9 points, and the score of functional image 4 is 6 points, then the scores of the functional images and the display levels corresponding to the functional images may be in the form shown in Table 1:

[0091] Table 1

[0092] Functional images score Sorting Display level Functional image 1 5 4 Four-level image Functional image 2 8 2 Secondary Image Functional image 3 9 1 First level image Functional image 4 6 3 Tertiary Image

[0093] It can be understood that the embodiment of the present application adopts preset evaluation rules to score the image quality of multiple functional images, and then determines the display levels of the multiple functional images according to the scores. In this way, the multiple functional images are arranged in order through grading, thereby improving the reference effect.

[0094] S1012: Determine the display level of each display combination in the plurality of display combinations according to the display levels of the functional images constituting each display combination.

[0095] Among them, the display level of the display combination reflects the importance of the display combination.

[0096] In some embodiments, the score of each display combination is determined according to the scores of the functional images constituting each display combination, and then the display levels of the multiple display combinations are determined according to the scores of each display combination in the multiple display combinations.

[0097] Exemplarily, assume that multiple display combinations include: display combination 1, display combination 2, display combination 3, display combination 4, display combination 5, and display combination 6. Among them, display combination 1 includes function image 1 (score of 5); display combination 2 includes function image 2 (score of 8); display combination 3 includes function image 3 (score of 9); display combination 4 includes function image 4 (score of 6); display combination 5 includes function image 2 (score of 8) and function image 3 (score of 9); display combination 6 includes function image 3 (score of 9) and function image 4 (score of 6). Then the scores and display levels of multiple display combinations meet the following Table 2:

[0098] Table 2

[0099] Display combination score Sorting Display level Display combination 1 5 6 Level 6 Display combination 2 8 4 Level 4 Display combination 3 9 3 Level 3 Display combination 4 6 5 Level 5 Display combination 5 (Functional image 2 & Functional image 3) 17 1 Level 1 Display combination 6 (Functional image 3 & Functional image 4) 15 2 Level 2

[0100] It can be understood that the embodiment of the present application determines the display level of each display combination in multiple display combinations according to the display level of each functional image constituting each display combination. In this way, multiple display combinations are arranged in order through a hierarchical manner, which has logic and relevance, thereby improving the reference effect.

[0101] In some embodiments, after step S1012, the method further includes:

[0102] Step b1: Identify repeated display combinations from multiple display combinations.

[0103] The repeated display combination refers to a display combination having a same functional image but not having the highest display level.

[0104] Exemplarily, assuming that display combination 2 includes: functional image 2 (score is 8); display combination 5 includes functional image 2 (score is 8) and functional image 3 (score is 9), it can be seen that the display level of display combination 5 is higher than the display level of display combination 2, and display combination 2 and display combination 5 have the same functional image 2, then display combination 2 is a duplicate display combination.

[0105] Step b2: adjusting the display levels of the multiple display combinations according to the repeated display combinations.

[0106] The display levels of the adjusted repeated display combinations are lower than the display levels of the adjusted non-repeated display combinations.

[0107] In some embodiments, the display levels of the multiple display combinations before adjustment are called initial display levels, and the display levels of the multiple display combinations after adjustment are called target display levels. Then the above step b2 can be implemented as follows: first, the non-repeated display combinations are sorted according to the initial display levels to obtain the target display levels of the non-repeated display combinations; then, the repeated display combinations are sorted according to the initial display levels and arranged after the non-repeated display combinations to obtain the target display levels of the repeated display combinations.

[0108] Exemplarily, among the multiple display combinations shown in Table 2 above, display combination 2 and display combination 5 both include function image 2, and the display level of display combination 5 is higher, so display combination 2 is a repeated display combination; display combination 3 and display combination 5 both include function image 3, and the display level of display combination 5 is higher, so display combination 3 is a repeated display combination; display combination 6 and display combination 5 both include function image 3, and the display level of display combination 5 is higher, so display combination 6 is a repeated display combination; then according to the repeated display combinations, the display levels of the multiple display combinations are adjusted, and the scores and display levels of the multiple display combinations after adjustment meet the following Table 3:

[0109] Table 3

[0110] Display combination score Sorting Display level Display combination 1 5 3 Level 3 Display combination 2 (repeated) 8 6 Level 6 Display combination 3 (repeated) 9 5 Level 5 Display combination 4 6 2 Level 2 Display combination 5 (Functional image 2 & Functional image 3) 17 1 Level 1 Display combination 6 (repeat) (Functional image 3 & Functional image 4) 15 4 Level 4

[0111] As shown in Table 3, the display levels of the adjusted non-repeated display combination 1, display combination 4 and display combination 5 are all higher than the display levels of the adjusted repeated display combination 2, display combination 3 and display combination 6.

[0112] It is understandable that the display combination is obtained by image fusion of multiple functional images. Since there are multiple ways to fuse multiple functional images, it is inevitable that there are repeated display combinations in multiple display combinations. If the display levels of multiple display combinations are determined only according to the display levels of each functional image that constitutes each display combination, repeated display combinations may be displayed on a high-level display screen, resulting in a waste of display resources. Therefore, after determining the display levels of multiple display combinations, the embodiment of the present application can also adjust the display levels of multiple display combinations according to the repeated display combinations in the multiple display combinations to ensure that the display levels of the non-repeated display combinations after adjustment are higher than the display levels of the repeated display combinations after adjustment, which can meet the diverse needs of users, provide users with richer image information, and improve the user experience.

[0113] S1013: Match the display level of each display combination in the multiple display combinations with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship.

[0114] In some embodiments, when the above method includes: adjusting the display levels of multiple display combinations according to repeated display combinations, the above step S1013 can also be implemented as: matching the display level of each display combination in the adjusted multiple display combinations with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship.

[0115] The display level of the display screen is determined by the position of the display screen and the viewing object of the display screen. For example, assuming that the main viewing object of the multi-display system is object A, when determining the display levels of multiple display screens, the viewing needs of object A should be met first, that is, the display level of the display screen viewed by object A is higher, and the display screen with better visual effects among the display screens viewed by object A has a higher display level.

[0116] It is understandable that, taking the surgical scene as an example, multiple display screens can be set up in the operating room to meet the viewing needs of different users in the operating room, for example, Figure 4 As shown in the figure, in the operating room, the surgeon and the assistant stand in different positions. In order to enable each user to see the images taken by the endoscope, display screen 1, display screen 2 and display screen 3 are set. If it is assumed that the main viewing object of the multi-display system is the surgeon, then when setting the display level of the multi-display, the viewing needs of the surgeon should be met first. Among them, the display screens watched by the surgeon are display screen 1 and display screen 2, and the visual effect of display screen 1 is better. Therefore, the display level of display screen 1 is higher than that of display screen 2, and the display level of display screen 2 is higher than that of display screen 3.

[0117] Exemplarily, it is assumed that the multiple display combinations include: display combination 1, display combination 2, display combination 3, display combination 4, display combination 5 and display combination 6; wherein the display levels of the multiple display combinations are shown in Table 3. Assuming that the multiple display screens include (arranged in descending order of display level): display screen 1, display screen 2, display screen 3, display screen 4, display screen 5, display screen 6 and display screen 7, wherein display screen 1 is used to display the original image, then the mapping relationship between the multiple display combinations and the multiple display screens can be: match the display screens of the corresponding display levels according to the display levels from high to low. Exemplarily, the mapping relationship between the multiple display combinations and the multiple display screens can satisfy the following Table 4:

[0118] Table 4

[0119] Display combination Display level Corresponding display screen Display combination 1 Level 3 Display 4 Display combination 2 Level 6 Display 7 Display combination 3 Level 5 Display 6 Display combination 4 Level 2 Display 3 Display combination 5 Level 1 Display 2 Display combination 6 Level 4 Display 5

[0120] It can be understood that the method provided in the embodiment of the present application determines the display level of the display combination and the display level of the display screen respectively, and then through the step-by-step matching method, the display combination with a high display level is displayed on the display screen with a high display level. In this way, on the one hand, multiple display screens can display different display combinations respectively, providing users with richer image information; on the other hand, multiple display combinations are arranged in order step by step, so that the images displayed on multiple display screens are logical and relevant, improving the reference effect.

[0121] In some embodiments, the method further includes: before the above step S101, the method further includes: setting display modes of the multiple display screens. Exemplarily, setting the display modes of the multiple display screens includes the following two methods.

[0122] As a possible implementation manner, a second trigger operation is received; and in response to the second trigger operation, the display modes of the multiple display screens are set to the first display mode.

[0123] Among them, the second trigger operation is used to instruct multiple display screens to display according to the first display mode. Exemplarily, the host (that is, the camera system host) includes a human-computer interaction module (such as a display screen and an input device, or a touch screen, etc.), and the host can receive a second trigger operation issued by the user through the human-computer interaction module. Optionally, the above-mentioned second trigger operation can be a touch screen operation (when the human-computer interaction module is a touch screen); or, the second trigger operation can be a key operation (when the input device of the human-computer interaction module is a key); or, the second trigger operation can be a remote control operation (when the input device of the human-computer interaction module is a remote control), etc., and the embodiments of the present application do not limit this. For example, taking the human-computer interaction module of the host as a touch screen, the human-computer interaction module can display as follows Figure 5 In the interface for setting the display mode shown, the user instructs multiple display screens to display in the first display mode through touch screen operation.

[0124] For example, Figure 6 As shown, in the first display mode, the multiple display screens include a main display screen and multiple sub-display screens; the main display screen is used to display the original image taken by the endoscope; and the multiple sub-display screens are used to respectively display different display combinations (specifically, the multiple sub-display screens are used to respectively display display combinations of different display levels).

[0125] As another possible implementation manner, a third trigger operation is received; and in response to the third trigger operation, the display modes of the multiple display screens are set to the second display mode.

[0126] The third trigger operation is used to instruct the multiple display screens to display in the second display mode. For example, taking the human-computer interaction module of the host as a touch screen, the human-computer interaction module can display the following: Figure 7 In the interface for setting the display mode shown, the user instructs multiple display screens to display in the second display mode through touch screen operation.

[0127] For example, Figure 8As shown, in the second display mode, a first display screen among multiple display screens (the first display screen can be any one of the multiple display screens, such as display screen 1) is used to display the original image taken by the endoscope; other display screens among the multiple display screens except the first display screen (such as display screen 1) are used to respectively display different display combinations (specifically, other display screens among the multiple display screens except the first display screen are used to respectively display display combinations of different display levels).

[0128] It is understandable that in order to meet the user's usage needs, the embodiment of the present application provides two display modes, wherein, when the user has a fixed demand for the original image (i.e., the original image is the main one, and other display combinations are supplementary), display mode 1 can be selected; when the user has a demand for multiple display combinations (i.e., the user needs to watch multiple combinations at the same time), display mode 2 can be selected. In this way, based on the method provided in the embodiment of the present application, the user can select the corresponding display mode according to actual needs to meet the user's usage needs.

[0129] S102: According to the display levels of the multiple display screens in the mapping relationship, display combinations of corresponding display levels are respectively sent to the multiple display screens, so that the multiple display screens respectively display display combinations of different display levels.

[0130] Exemplarily, assuming that the mapping relationship between multiple display combinations and multiple display screens is in the form shown in Table 4, display combination 1 is displayed on display screen 4, display combination 2 is displayed on display screen 7, display combination 3 is displayed on display screen 6, display combination 4 is displayed on display screen 3, display combination 5 is displayed on display screen 2, and display combination 6 is displayed on display screen 5. Among them, display screen 1 is the main screen, and the original image is displayed on display screen 1.

[0131] In some embodiments, the method further includes: switching the display combinations displayed on the multiple display screens step by step according to the received switching instruction. Exemplarily, it can be implemented as the following steps:

[0132] Step c1: receiving a first trigger operation.

[0133] Among them, the first trigger operation is used to instruct the display combination corresponding to each display screen in the multiple display screens to switch step by step. The above-mentioned first trigger operation is issued by the user to the multiple display screens through the host. Optionally, the first trigger operation can be issued by the user through the input device of the host (for example, a keyboard, a remote control, etc.); or, the first trigger operation can be issued by the user through voice control; or, the first trigger operation can be issued by the user through gesture control. The embodiment of the present application does not specifically limit the form of the first trigger operation.

[0134] For example, taking the human-computer interaction module of the host as a touch screen, the human-computer interaction module can display the following Fig. 9 As shown in the display combination switching interface, the user can use touch screen operations to instruct the display combinations corresponding to multiple display screens to switch step by step.

[0135] Optionally, the step-by-step switching includes: switching the display combination corresponding to each display screen among the multiple display screens to a display combination with a high display level; or, switching the display combination corresponding to each display screen among the multiple display screens to a display combination with a low display level.

[0136] Step c2: in response to the first trigger operation, the display combination corresponding to each of the multiple display screens is switched step by step.

[0137] In some embodiments, when the display mode of multiple display screens is the first display mode, in response to a first trigger operation, the original image displayed on a main display screen among the multiple display screens does not change, and the display combinations displayed on sub-display screens among the multiple display screens are switched step by step according to the display level; when the display mode of the multiple display screens is the second display mode, in response to the first trigger operation, the display combinations displayed on the multiple display screens are switched step by step according to the display level.

[0138] For example, Fig.10 As shown, when the display mode of multiple display screens is the first display mode, in response to the first trigger operation, sub-screen 1 is switched from the first-level display combination to the second-level display combination, sub-screen 2 is switched from the second-level display combination to the third-level display combination, ..., sub-screen M is switched from the M-level display combination to the first-level display combination.

[0139] Another exemplary example is Fig.11 As shown, when the display mode of multiple display screens is the second display mode, in response to the first trigger operation, display screen 1 switches from the original image to the M-level display combination, display screen 2 switches from the first-level display combination to the original image, display screen 3 switches from the second-level display combination to the first-level display combination, ..., and ring screen M+1 switches from the M-level display combination to the M-1-level display combination.

[0140] It is understandable that when the user needs to watch display combinations of other display levels, a first trigger operation can be issued to instruct the display combinations displayed on multiple display screens to switch step by step. Since multiple display combinations are arranged step by step according to the display levels, the user can quickly switch to the desired display combination when switching. For example, assuming that the display screens watched by the user include: display screen 1 and display screen 2, wherein the display combination on display screen 1 is level one, and the display combination displayed on display screen 2 is level two; when the user needs to watch the display combinations of level three and level four, only two level switching steps are required, which can quickly meet the user's usage needs.

[0141] Based on the method provided in the embodiment of the present application, at least the following beneficial effects can be produced: determining the mapping relationship between multiple display combinations (one display combination includes one functional image; or, one display combination includes an image after the fusion of multiple functional images) and multiple display screens; wherein, the mapping relationship is the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens; according to the mapping relationship, multiple display combinations are matched with multiple display screens step by step, and then the display combinations of the corresponding display levels are sent to each of the multiple display screens respectively, so that the multiple display screens respectively display display combinations of different display levels. In this way, compared with the method in the related art in which multiple display screens repeatedly display a single screen, the embodiment of the present application can provide users with richer display screens; at the same time, multiple display combinations are made to correspond to multiple display screens one by one according to the display levels, so as to achieve the effect of hierarchical display, so that the display combinations displayed on multiple display screens are logical and relevant, which can meet the diverse needs of users.

[0142] like Fig.12 As shown, the embodiment of the present application provides a multi-display screen image display device for performing the following Figure 2 The multi-display image display method shown. The multi-display image display device 300 includes: a determination module 301 and a sending module 302. In other embodiments, the multi-display image display device 300 also includes: a processing module 303, a receiving module 304 and a switching module 305.

[0143] Determine module 301, used to determine the mapping relationship between multiple display combinations and multiple display screens; wherein, one display combination includes a functional image; or, one display combination includes an image obtained by fusion of multiple functional images; the functional image is an image obtained by image processing the original image taken by the endoscope; the mapping relationship refers to the mapping relationship between the display levels of multiple display combinations and the display levels of multiple display screens.

[0144] The sending module 302 is used to send display combinations of corresponding display levels to the multiple display screens according to the display levels of the multiple display screens in the mapping relationship, so that the multiple display screens respectively display display combinations of different display levels.

[0145] As a possible implementation method, the processing module 303 is used to perform image processing on the original image taken by the endoscope to obtain a functional image; wherein the image processing includes one or more of the following: image staining processing, image enhancement processing, target detection, target recognition and target segmentation.

[0146] As another possible implementation, the determination module 301 is specifically used to determine the display level of multiple functional images; the display level of the functional image is determined by the visibility and / or informativeness of the functional image; the display level of each display combination in the multiple display combinations is determined according to the display levels of the individual functional images constituting each display combination; the display level of the display combination reflects the importance of the display combination; the display level of each display combination in the multiple display combinations is matched step by step with the display level of each display screen in the multiple display screens to obtain a mapping relationship; the display level of the display screen is determined by the position of the display screen and the viewing object of the display screen.

[0147] As another possible implementation, the determination module 301 is also used to identify repeated display combinations from multiple display combinations; a repeated display combination refers to a display combination with a non-highest display level among display combinations having the same functional image; the display levels of the multiple display combinations are adjusted according to the repeated display combination; wherein the adjusted display levels of the repeated display combinations are lower than the adjusted display levels of the non-repeated display combinations; the determination module 301 is specifically used to match the display level of each display combination in the multiple display combinations after adjustment with the display level of each display screen in the multiple display screens step by step to obtain a mapping relationship.

[0148] As another possible implementation, the receiving module 304 is used to receive a first trigger operation; the first trigger operation is used to instruct the display combination corresponding to each display screen in the multiple display screens to switch step by step; wherein the step-by-step switching includes: switching the display combination corresponding to each display screen to a display combination with a high display level; or, switching the display combination corresponding to each display screen to a display combination with a low display level; the switching module 305 is used to switch the display combination corresponding to each display screen in the multiple display screens step by step in response to the first trigger operation.

[0149] As another possible implementation, the receiving module 304 is also used to receive a second trigger operation, the second trigger operation is used to instruct multiple display screens to display according to the first display mode; in the first display mode, the multiple display screens include a main display screen and multiple sub-display screens; the main display screen is used to display the original image taken by the endoscope; the multiple sub-display screens are used to respectively display different display combinations; or, receive a third trigger operation; the third trigger operation is used to instruct multiple display screens to display according to the second display mode; in the second display mode, the first display screen among the multiple display screens is used to display the original image taken by the endoscope; the other display screens among the multiple display screens except the first display screen are used to respectively display different display combinations.

[0150] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present application provides another possible structural schematic diagram of the multi-display screen image display device involved in the above-mentioned embodiment. Fig.13 As shown, the multi-display screen image display device 400 includes: a processor 402 , a communication interface 403 , and a bus 404 . Optionally, the multi-display screen image display device 400 may further include a memory 401 .

[0151] The processor 402 may be a processor that implements or executes various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of the present application. The processor 402 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of the present application. The processor 402 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0152] The communication interface 403 is used to connect with other devices via a communication network, which may be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0153] The memory 401 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0154] As a possible implementation, the memory 401 may exist independently of the processor 402, and the memory 401 may be connected to the processor 402 via a bus 404 to store instructions or program codes. When the processor 402 calls and executes the instructions or program codes stored in the memory 401, the multi-display image display method provided in the embodiment of the present application can be implemented.

[0155] In another possible implementation, the memory 401 may also be integrated with the processor 402 .

[0156] The bus 404 may be an extended industry standard architecture (EISA) bus, etc. The bus 404 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.13 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0157] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the multi-display image display device is divided into different functional modules to complete all or part of the functions described above.

[0158] The embodiment of the present application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be completed by computer instructions to instruct the relevant hardware, and the program can be stored in the above computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be any of the above embodiments or memory. The above computer-readable storage medium can also be an external storage device of the above multi-display image display device, such as a plug-in hard disk, a smart memory card (smart media card, SMC), a secure digital (secure digital, SD) card, a flash card (flash card), etc. equipped on the above multi-display image display device. Further, the above computer-readable storage medium can also include both the internal storage unit of the above multi-display image display device and an external storage device. The above computer-readable storage medium is used to store the above computer program and other programs and data required by the above multi-display image display device. The above computer-readable storage medium can also be used to temporarily store data that has been output or is to be output.

[0159] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program product is run on a computer, the computer is enabled to execute any one of the multi-display image display methods provided in the above embodiments.

[0160] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other changes to the disclosed embodiments by viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "one" or "an" does not exclude multiple situations. A single processor or other unit may implement several functions listed in a claim. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0161] Although the present application has been described in conjunction with specific features and embodiments thereof, it is obvious that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely exemplary illustrations of the present application as defined by the appended claims, and are deemed to have covered any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

[0162] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A multi-display image display method, characterized in that: A host applied to a multi-display system, wherein the multi-display system further comprises: an endoscope and a plurality of display screens; the method comprises: Determine a mapping relationship between a plurality of display combinations and the plurality of display screens; wherein a display combination includes a functional image; or a display combination includes an image obtained by fusion of a plurality of functional images; the functional image is an image obtained by image processing an original image captured by the endoscope; the mapping relationship refers to a mapping relationship between display levels of the plurality of display combinations and display levels of the plurality of display screens; According to the display levels of the multiple display screens in the mapping relationship, display combinations of corresponding display levels are respectively sent to the multiple display screens, so that the multiple display screens respectively display display combinations of different display levels; wherein, when there are repeated display combinations in the multiple display combinations, the display levels of the multiple display combinations are readjusted, and the display levels of the adjusted repeated display combinations are all lower than the display levels of the adjusted non-repeated display combinations; the repeated display combination refers to a display combination with a non-highest display level among display combinations having the same functional image.

2. The method according to claim 1, characterized in that Before determining the mapping relationship between the plurality of display combinations and the plurality of display screens, the method further includes: The original image captured by the endoscope is processed to obtain a functional image; wherein the image processing includes one or more of the following: image staining processing, image enhancement processing, target detection, target recognition and target segmentation.

3. The method according to claim 1, characterized in that The determining of the mapping relationship between the plurality of display combinations and the plurality of display screens includes: Determining a display level of a plurality of functional images; the display level of the functional images is determined by the visibility and / or informativeness of the functional images; determining a display level of each display combination in the plurality of display combinations according to the display levels of the respective functional images constituting each display combination; the display level of the display combination reflects the importance of the display combination; The display level of each display combination in the multiple display combinations is matched step by step with the display level of each display screen in the multiple display screens to obtain the mapping relationship; the display level of the display screen is determined by the position of the display screen and the viewing object of the display screen.

4. The method according to claim 3, characterized in that When there are repeated display combinations in the multiple display combinations, readjusting the display levels of the multiple display combinations includes: From the plurality of display combinations, identifying a repeated display combination; According to the repeated display combinations, adjusting the display levels of the multiple display combinations; The step of matching the display level of each display combination in the plurality of display combinations with the display level of each display screen in the plurality of display screens step by step to obtain the mapping relationship includes: The adjusted display level of each display combination in the multiple display combinations is matched step by step with the display level of each display screen in the multiple display screens to obtain the mapping relationship.

5. The method according to claim 1, characterized in that The method further comprises: Receive a first trigger operation; the first trigger operation is used to instruct the display combination corresponding to each of the multiple display screens to switch step by step; wherein the step by step switching includes: switching the display combination corresponding to each of the multiple display screens to a display combination with a high display level; or switching the display combination corresponding to each of the multiple display screens to a display combination with a low display level; In response to the first trigger operation, the display combination corresponding to each of the multiple display screens is switched step by step.

6. The method according to claim 1, characterized in that Before determining the mapping relationship between the plurality of display combinations and the plurality of display screens, the method further includes: receiving a second trigger operation, wherein the second trigger operation is used to instruct the multiple display screens to display according to a first display mode; in the first display mode, the multiple display screens include a main display screen and multiple sub-display screens; the main display screen is used to display an original image captured by the endoscope; and the multiple sub-display screens are used to display different display combinations respectively; Alternatively, a third trigger operation is received; the third trigger operation is used to instruct the multiple display screens to display according to a second display mode; in the second display mode, the first display screen among the multiple display screens is used to display the original image taken by the endoscope; the other display screens among the multiple display screens except the first display screen are used to display different display combinations respectively.

7. A multi-display screen image display device, characterized in that: A host used in a multi-display system, wherein the multi-display system further includes an endoscope and multiple display screens; the device includes: A determination module, used to determine a mapping relationship between a plurality of display combinations and the plurality of display screens; wherein a display combination includes a functional image; or a display combination includes an image obtained by fusion of a plurality of functional images; the functional image is an image obtained by image processing an original image captured by the endoscope; the mapping relationship refers to a mapping relationship between display levels of the plurality of display combinations and display levels of the plurality of display screens; A sending module, used for sending display combinations of corresponding display levels to the multiple display screens respectively according to the display levels of the multiple display screens in the mapping relationship, so that the multiple display screens respectively display display combinations of different display levels; wherein, when there are repeated display combinations in the multiple display combinations, the display levels of the multiple display combinations are readjusted, and the display levels of the adjusted repeated display combinations are all lower than the display levels of the adjusted non-repeated display combinations; the repeated display combination refers to a display combination with a non-highest display level among the display combinations having the same functional image.

8. The device according to claim 7, characterized in that The device further comprises: a processing module, which is used to perform image processing on the original image taken by the endoscope to obtain a functional image; wherein the image processing comprises one or more of the following: image staining processing, image enhancement processing, target detection, target recognition and target segmentation; The determination module is specifically used to determine the display levels of multiple functional images; the display level of the functional images is determined by the visibility and / or information of the functional images; the display level of each display combination in the multiple display combinations is determined according to the display levels of each functional image constituting each display combination; the display level of the display combination reflects the importance of the display combination; the display level of each display combination in the multiple display combinations is matched step by step with the display level of each display screen in the multiple display screens to obtain the mapping relationship; the display level of the display screen is determined by the position of the display screen and the viewing object of the display screen; The determination module is further configured to identify a repeated display combination from the multiple display combinations; and adjust the display levels of the multiple display combinations according to the repeated display combination; The determining module is specifically configured to match the adjusted display level of each display combination in the multiple display combinations with the display level of each display screen in the multiple display screens step by step to obtain the mapping relationship; The device further comprises: a receiving module and a switching module; the receiving module is used to receive a first trigger operation; the first trigger operation is used to instruct the display combination corresponding to each of the multiple display screens to switch step by step; wherein the step-by-step switching comprises: switching the display combination corresponding to each of the multiple display screens to a display combination with a high display level; or switching the display combination corresponding to each of the multiple display screens to a display combination with a low display level; the switching module is used to switch the display combination corresponding to each of the multiple display screens step by step in response to the first trigger operation; The receiving module is further used to receive a second trigger operation, and the second trigger operation is used to instruct the multiple display screens to display according to the first display mode; in the first display mode, the multiple display screens include a main display screen and multiple sub-display screens; the main display screen is used to display the original image taken by the endoscope; the multiple sub-display screens are used to respectively display different display combinations; or, receive a third trigger operation; the third trigger operation is used to instruct the multiple display screens to display according to the second display mode; in the second display mode, the first display screen among the multiple display screens is used to display the original image taken by the endoscope; the other display screens among the multiple display screens except the first display screen are used to respectively display different display combinations.

9. A multi-display screen image display device, characterized in that: include: one or more processors; one or more memories; Wherein, the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the image grading display device executes the multi-display screen image display method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed on a computer, the computer executes the multi-display screen image display method according to any one of claims 1 to 6.

Images