Image fusion system and method, computer equipment, storage medium and program product

Abstract

The invention relates to the technical field of endoscopes, and discloses an image fusion system and method, computer equipment, a storage medium and a program product. The system comprises a first processing chip and a second processing chip, the first processing chip is used for acquiring a preset interface image and a playing picture to be played, and copying the preset interface image to obtain two same interface image copies; the first processing chip is also used for fusing the second interface image and the playing picture, and the fused data is determined as fused data; the second processing chip is used for acquiring a real-time picture acquired by the endoscope, receiving the first interface image and the fusion data, identifying the first interface image and the fusion data, and fusing the first interface image with the real-time picture to generate a first target picture when the first interface image is identified. By implementing the technical scheme of the invention, the first target picture after the image fusion operation can keep the transparency of the preset interface, and the transparency characteristic cannot be lost due to fusion.

Description

Technical Field

[0001] The present invention relates to the technical field of endoscopes, and particularly to an image fusion system, method, computer device, storage medium and program product. Background Art

[0002] Image fusion is the process of synthesizing multiple input images into an output image, aiming to extract more valuable information to improve image quality or enhance the performance of specific applications. Currently, the technical services of field-programmable gate arrays (FPGAs) usually adopt the method of providing image fusion application software for users to use. Users can choose to input images with transparency information or images without transparency information into the image fusion application software for processing. However, when performing image fusion operations, the image fusion application software often has difficulty in retaining the transparency information of the input images, resulting in the loss of image transparency. Summary of the Invention

[0003] In view of this, the present invention provides an image fusion system, method, computer device, storage medium and program product to solve the problem of image transparency loss caused by image fusion.

[0004] In a first aspect, the present invention provides an image fusion system, including a first processing chip and a second processing chip; the first processing chip is configured to obtain a preset interface image and a playback screen to be played, and the preset interface image has a transparent effect; the first processing chip is further configured to copy the preset interface image to obtain two identical interface image copies; wherein, the two identical interface image copies include a first interface image and a second interface image, and the first interface image and the second interface image have a transparent effect; the first processing chip is further configured to fuse the second interface image with the playback screen, and determine the fused data as the fusion data; the first processing chip is further configured to send the first interface image and the fusion data to the second processing chip; the second processing chip is configured to obtain a real-time screen collected by an endoscope; the second processing chip is further configured to receive the first interface image and the fusion data, and when it is recognized as the first interface image, fuse the first interface image with the real-time screen to generate a first target screen.

[0005] In the image fusion system provided by the embodiment of the present invention, the operation of fusing the second interface image with the playback screen does not affect the transparency effect of the first interface image corresponding to the preset interface image, so that when the first interface image is fused with the real-time screen, the underlying real-time screen can be displayed and the transparency information will not be lost due to the fusion. At the same time, the collaborative work between the first processing chip and the second processing chip enables the system to complete complex image processing tasks. The first processing chip is responsible for fusing the second interface image with the playback screen and sending the result to the second processing chip, while the second processing chip is responsible for fusing the first interface image with the real-time screen. This division of labor and cooperation can improve the efficiency and performance of the system.

[0006] In an optional implementation manner, the first processing chip is further configured to add a first frame header to the first interface image and a second frame header to the fusion data to identify the first interface image and the fusion data.

[0007] In the image fusion system provided by the embodiment of the present invention, by adding frame headers, the first interface image and the fusion data can be identified, enabling the system to accurately recognize and distinguish these two types of data. Therefore, during data transmission and processing, corresponding processing and operations can be performed on different types of data, improving the efficiency and accuracy of the system. Adding frame headers can help the system correctly identify and parse the data, ensuring that the data will not be lost or in error during transmission and processing.

[0008] In an optional implementation manner, the second processing chip is further configured to identify the first interface image and the fusion data, including: the second processing chip is further configured to identify the first frame header corresponding to the first interface image and the second frame header corresponding to the fusion data.

[0009] In the image fusion system provided by the embodiment of the present invention, by identifying the frame headers corresponding to the first interface image and the fusion data, the system can accurately determine the type of the received data and can process the data accordingly. This helps to ensure that the data is correctly used for the intended purpose, thereby improving the reliability and stability of the system. By performing frame header identification on the second processing chip, this task can be avoided being assigned to other processors or components, thus saving system resources and power consumption. By performing frame header identification on the second processing chip, the maintenance and update of the system can be made more convenient. Since the frame header identification function is integrated with other processing functions on the same chip, the maintenance and update of the system can be more centralized and integrated, reducing complexity and cost.

[0010] In an alternative embodiment, the first processing chip is further configured to send the first interface image and the fusion data to the second processing chip, including: the first processing chip is further configured to send the first interface image and the fusion data to the second processing chip through a preset serial communication interface.

[0011] For the image fusion system provided by the embodiments of the present invention, the preset serial communication interface is a high-speed serial communication interface capable of transmitting data at a very high rate. By using the preset serial communication interface, the first processing chip can quickly and stably transmit data to the second processing chip, ensuring the efficiency and real-time performance of data transmission. The preset serial communication interface supports high-bandwidth data transmission and can meet the requirements of large-scale data processing. By using the preset serial communication interface, the first processing chip can effectively transmit a large amount of first interface images and fusion data to the second processing chip, realizing efficient data processing and analysis. The preset serial communication interface has the characteristic of low latency and can reduce the transmission latency during data transmission, thereby improving the response speed and performance of the system.

[0012] In an alternative embodiment, the second processing chip is further configured to, when it recognizes the fusion data, overlay the fusion data on the real-time screen to generate a second target screen; wherein, the second target screen is the screen corresponding to the fusion of the second interface copy and the playback screen.

[0013] For the image fusion system provided by the embodiments of the present invention, the second target screen generated by fusing the second interface copy and the playback screen can save bandwidth and system resources to a certain extent while ensuring the integrity and consistency of information.

[0014] In an alternative embodiment, the second processing chip is further configured to overlay the fusion data on the real-time screen, including: the second processing chip is further configured to overlay the pixel data corresponding to the real-time screen with the fusion data and replace the pixel data corresponding to the real-time screen with zero.

[0015] For the image fusion system provided by the embodiments of the present invention, by replacing the pixel data with zero, the influence of the real-time screen on the fusion data can be effectively eliminated, enabling the fusion data to be displayed more clearly on the screen. Replacing the pixel data corresponding to the real-time screen with zero can reduce confusion and interference, making the fusion data more prominent and clear. By eliminating the influence of the real-time screen, the interference of the real-time screen on the fusion data can be effectively reduced, making the display of the fusion data on the screen more clear and accurate.

[0016] Second aspect, the present invention provides an image fusion method, which is applied to the image fusion system in the above first aspect, and includes: a first processing chip acquires a preset interface image and a playback screen to be played, and the preset interface image has a transparent effect; a second processing chip acquires a real-time image collected by an endoscope; the first processing chip copies the preset interface image to obtain two identical interface image copies; wherein, the two identical interface image copies include a first interface image and a second interface image, and the first interface image and the second interface image have a transparent effect; the first processing chip fuses the second interface image with the playback screen, and the fused data is determined as the fusion data; the first processing chip sends the first interface image and the fusion data to the second processing chip; when the second processing chip recognizes the first interface image, it fuses the first interface image with the real-time image to generate a first target image.

[0017] Third aspect, the present invention provides a computer device, including: a memory and a processor, which are communicatively connected to each other, and the memory stores computer instructions, and the processor executes the computer instructions to execute the image fusion method in the above second aspect.

[0018] Fourth aspect, the present invention provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions are used to cause a computer to execute the image fusion method in the above second aspect.

[0019] Fifth aspect, the present invention provides a computer program product, including computer instructions, and the computer instructions are used to cause a computer to execute the image fusion method in the above second aspect. Description of the Drawings

[0020] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required to be used in the description of the specific embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0021] Figure 1 is a schematic diagram of an image fusion system according to an embodiment of the present invention;

[0022] Figure 2 is a schematic flowchart of an image fusion method according to an embodiment of the present invention;

[0023] Figure 3 is a schematic diagram of image hierarchical fusion according to an embodiment of the present invention;

[0024] Figure 4It is a schematic diagram of the hardware structure of the computer device according to an embodiment of the present invention. Detailed implementation manners

[0025] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0026] Image fusion technology is one of the important technologies in the fields of computer vision and image processing. Its main objective is to combine multiple images from different sources or different parts of an image into an output image to extract more or better information, improve image quality, or enhance the performance of specific applications.

[0027] In the field of Field-Programmable Gate Array (FPGA), the development of image fusion application software has provided users with more convenient and efficient image processing solutions. However, there are indeed some challenges and limitations, especially in dealing with transparency information and multi-level image fusion. When a user inputs an image with transparency information into an image fusion application software for processing, the software may lose the transparency information during the processing, which may be due to imperfect software design or limitations in algorithm implementation. At the same time, during multi-level image fusion, each level of fusion usually takes the output of the previous level as the input. However, if the image output by the first-level fusion has already lost the transparency information, then subsequent levels of fusion will be performed without transparency information, which may result in the final output image lacking transparency information or the transparency information not being correctly transmitted.

[0028] In view of this, the technical solution of the present invention selects to transmit the first interface image carrying transparency or the fusion data after fusing the second interface image and the playback screen, and adds a frame header so that the second processing chip can identify which type of data is transmitted in the current frame, thereby fusing with real-time data, so that the first target screen after the image fusion operation can retain the transparency of the preset interface and will not lose the transparency characteristics due to fusion. At the same time, it is avoided that the transparency information is lost after the first-level fusion, so that subsequent levels of fusion will be performed without transparency information.

[0029] In this embodiment, an image fusion system is provided, as Figure 1 shown. The image fusion system includes: a first processing chip 1 and a second processing chip 2.

[0030] The first processing chip 1 is used to obtain a preset interface image and a playback screen to be played, and the preset interface image has a transparent effect.

[0031] The first processing chip 1 is a chip for processing image or video signals, used to process and operate image or video data from different sources, and can be, for example, an FPGA.

[0032] The preset interface image is a pre-designed interface element with a transparency effect, used to display menus and operation functions. Specifically, the preset interface image can be an interface designed with the Qt framework, which may include various controls, buttons, text boxes, etc., for user interaction with the system. For example, the interface elements of the menu or operation function can be set to be semi-transparent to highlight the background or other interface content while maintaining the visibility and operability of the functions.

[0033] The playback screen to be played is the video content to be displayed or transmitted. Specifically, it can be video data from sources such as video files or network streaming media. Before playback, it needs to be processed and decoded, and then presented to the user for viewing through a display device.

[0034] The first processing chip 1 is also used to copy the preset interface image to obtain two identical copies of the interface image. Among them, the two identical copies of the interface image include the first interface image and the second interface image, and the first interface image and the second interface image have a transparent effect.

[0035] The first processing chip 1 is used to copy the preset interface image to generate two copies that are exactly the same as the preset interface image, namely the first interface image and the second interface image. The content and layout of the first interface image and the second interface image are exactly the same as those of the preset interface image. Therefore, since the preset interface image has a transparent effect, the first interface image and the second interface image have the same transparent effect.

[0036] The first processing chip 1 is also used to fuse the second interface image with the playback screen, and the fused data is determined as the fused data.

[0037] The first processing chip 1 also has the function of fusing the second interface image with the playback screen, and determines the fused data as the fused data. Specifically, the first processing chip 1 can superimpose the second interface image on the playback screen, which can be achieved by applying an appropriate superimposition algorithm to each pixel of the second interface image, such as additive mixing, multiplicative mixing, etc.

[0038] The first processing chip 1 is also used to send the first interface image and the fused data to the second processing chip 2.

[0039] The first processing chip 1 has the function of sending the first interface image and the fusion data to the second processing chip 2. Specifically, the first processing chip 1 can send the first interface image and the fusion data to the second processing chip 2 through a preset serial communication interface. For example, the Aurora interface.

[0040] The Aurora interface is a high-speed serial interface standard that provides high-bandwidth and low-latency data transmission. Specifically, the first processing chip 1 uses the Aurora interface to send the first interface image and the fusion data to the second processing chip 2. The Aurora interface provides a high-speed serial data transmission channel, which can meet the requirements of high bandwidth and low latency, ensuring that data can be transmitted to the target processor quickly and reliably. During the data transmission process, the first processing chip 1 packs the first interface image and the fusion data into data packets that conform to the Aurora interface standard and sends them to the second processing chip 2 through the Aurora interface. After receiving the data, the second processing chip 2 can perform further processing or execute other tasks to complete the entire image processing process.

[0041] In the image fusion system provided by the embodiment of the present invention, the preset serial communication interface is a high-speed serial communication interface that can transmit data at a very high rate. By using the preset serial communication interface, the first processing chip can quickly and stably transmit data to the second processing chip, ensuring the efficiency and real-time nature of data transmission. The preset serial communication interface supports high-bandwidth data transmission and can meet the needs of large-scale data processing. By using the preset serial communication interface, the first processing chip can effectively transmit a large amount of the first interface images and the fusion data to the second processing chip, realizing efficient data processing and analysis. The preset serial communication interface has the characteristic of low latency and can reduce the transmission delay during the data transmission process, thereby improving the response speed and performance of the system.

[0042] The first processing chip 1 is also used to add a first frame header to the first interface image and a second frame header to the fusion data to identify the first interface image and the fusion data.

[0043] The first frame header is an identifier or metadata for the first interface image, usually containing some basic information about the data, such as resolution, frame rate, encoding format, etc. Adding the first frame header can help identify and parse the first interface image, ensuring that the receiving party can correctly process and display this data. The second frame header is an identifier or metadata for the fused data, usually containing some information about the fused data, such as fusion algorithm, fusion parameters, etc. Adding the second frame header can help identify and parse the fused data, ensuring that the receiving party can correctly process and apply the fusion effect. Specifically, when processing the first interface image and the fused data, the first processing chip 1 adds the corresponding frame header information at the beginning of each frame of data. Therefore, when the second processing chip 2 receives the data, it can identify and distinguish the first interface image and the fused data according to the frame header and perform corresponding processing.

[0044] In the image fusion system provided by the embodiments of the present invention, by adding frame headers, the first interface image and the fused data can be identified, enabling the system to accurately identify and distinguish these two types of data. Therefore, during the data transmission and processing, corresponding processing and operations can be performed on different types of data, improving the efficiency and accuracy of the system. Adding frame headers can help the system correctly identify and parse the data, ensuring that the data will not be lost or in error during the transmission and processing.

[0045] The second processing chip 2 is used to obtain the real-time image captured by the endoscope.

[0046] The second processing chip 2 is a processor chip for processing image or video data, with specific image processing functions and algorithms, capable of processing, analyzing, or transmitting the input image or video data. For example, it can be an FPGA.

[0047] An endoscope is a medical device used to observe the internal organs or tissues of the human body during a medical examination. It usually consists of a flexible tubular structure and a camera. The camera can capture the real-time image of the organs or tissues and display or record it through a connected device. The real-time image is the real-time image or video image captured by the endoscope camera, showing the real-time state of the organs or tissues being examined.

[0048] The second processing chip 2 has the function of receiving, processing, and displaying the real-time image from the endoscope camera, communicating with the endoscope device through a specific interface or protocol to obtain the image data captured by the camera.

[0049] The second processing chip 2 is also used to receive the first interface image and the fused data and perform identification.

[0050] The second processing chip 2 has a specific recognition function. After receiving the first interface image and the fusion data sent by the first processing chip 1, it can analyze and recognize the received first interface image and fusion data. Specifically, the second processing chip 2 is also used to recognize the first frame header corresponding to the first interface image and the second frame header corresponding to the fusion data. The second processing chip 2 can recognize the first frame header and the second frame header. By recognizing the frame headers, the second processing chip 2 can determine the type, format, and other necessary information of the received data, so as to perform subsequent data processing and operations.

[0051] In the image fusion system provided by the embodiments of the present invention, by recognizing the frame headers corresponding to the first interface image and the fusion data, the system can accurately determine what type of data is received and can accordingly process the data. This helps to ensure that the data is correctly used for the intended purpose, thereby improving the reliability and stability of the system. By performing frame header recognition on the second processing chip, this task can be avoided being assigned to other processors or components, thus saving system resources and power consumption. By performing frame header recognition on the second processing chip, the maintenance and update of the system can be made more convenient. Since the frame header recognition function is integrated with other processing functions on the same chip, the maintenance and update of the system can be more centralized and integrated, reducing complexity and cost.

[0052] When the second processing chip 2 also recognizes that it is the first interface image, it is further used to fuse the first interface image with the real-time picture to generate a first target picture.

[0053] The first target picture is the picture after the first interface image and the real-time picture are fused. Specifically, the second processing chip 2 will identify whether the received data is the first interface image according to its internal logic or algorithm. For example, the second processing chip 2 determines whether the received data conforms to the characteristics of the first interface image by steps such as parsing the frame header, detecting specific data formats or metadata. Once the second processing chip 2 confirms that the received data is the first interface image, the second processing chip 2 will perform a fusion operation, that is, superimpose the first interface image with a transparent effect on the real-time picture. Through the fusion operation, the second processing chip 2 fuses the real-time picture with the first interface image to generate a new picture, that is, the first target picture.

[0054] When the second processing chip 2 recognizes that it is the fusion data, it is further used to overlay the fusion data on the real-time picture to generate a second target picture. Wherein, the second target picture is the picture corresponding to the fusion of the second interface copy and the playing picture.

[0055] After receiving the data, the second processing chip 2 will determine whether the received data is fused data through internal logic or algorithms, which may include steps such as parsing the data frame header, detecting the data format or metadata. Once the second processing chip 2 confirms that the received data is fused data, the second processing chip 2 will perform an operation of overlaying the fused data onto the live video. By overlaying the fused data onto the live video, the second processing chip 2 will generate a second target video. Specifically, the second processing chip 2 will overlay the pixel data corresponding to the live video with the fused data and replace the pixel data corresponding to the live video with zero. The second processing chip 2 will overlay the pixel data corresponding to the live video with the fused data, that is, add, combine or mix the pixel data of the two to produce a new video effect. Among them, the overlay method can be determined according to specific requirements and application scenarios, and may include adjusting parameters such as overlay weights and blending modes. The second processing chip 2 will replace the pixel data corresponding to the live video with zero, that is, the pixel data in the live video will be cleared or set to black to leave space for subsequent operations and processing. The purpose of doing this may be to avoid interference or influence of the pixel data of the live video on the result after overlay, and at the same time ensure that the effect of the fused data can be presented completely.

[0056] The image fusion system provided by the embodiment of the present invention can save bandwidth and system resources to a certain extent by generating a second target video through fusing the second interface copy with the playback video, while ensuring the integrity and consistency of information. By replacing the pixel data with zero, the influence of the live video on the fused data can be effectively eliminated, so that the fused data can be displayed more clearly on the video. Replacing the pixel data corresponding to the live video with zero can reduce confusion and interference, making the fused data more prominent and clear. By eliminating the influence of the live video, the interference of the live video on the fused data can be effectively reduced, making the display of the fused data on the video clearer and more accurate.

[0057] According to an embodiment of the present invention, an embodiment of an image fusion method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0058] In this embodiment, an image fusion method is provided, which can be used in a computer device. Figure 2 is a flowchart of the image fusion method according to an embodiment of the present invention, as Figure 2 shown, the process includes the following steps:

[0059] Step S101, the first processing chip obtains a preset interface image and a playback screen to be played. The preset interface image has a transparent effect; the second processing chip obtains a real-time image captured by the endoscope.

[0060] The first processing chip is responsible for obtaining the preset interface image and the playback screen to be played. The preset interface image is a pre-defined screen that may contain user interface elements, images, or text, etc., and has a transparent effect, which means that some parts of it can be transparent to allow the subsequent content to be displayed. The playback screen to be played is content such as a video, image, or animation that is about to be displayed or played.

[0061] The second processing chip is responsible for obtaining the real-time image captured by the endoscope. Endoscopes are usually used in the medical field to observe the internal conditions of the human body, and the images captured by the endoscope are videos or images that display the internal conditions of the human body in real time.

[0062] Step S102, the first processing chip copies the preset interface image to obtain two identical copies of the interface image; among them, the two identical copies of the interface image include a first interface image and a second interface image, and the first interface image and the second interface image have a transparent effect.

[0063] The first processing chip copies the preset interface image to obtain two identical copies of the interface image. Specifically, the original preset interface image is copied into two copies, forming two completely identical screen copies, namely the first interface image and the second interface image. Since the content and layout of the first interface image and the second interface image are exactly the same as those of the preset interface image, the first interface image and the second interface image have the same transparent effect as the preset interface image.

[0064] Step S103, the first processing chip fuses the second interface image with the playback screen, and the data after fusion is determined as the fusion data.

[0065] Specifically, the content in the second interface image will be superimposed on the playback screen to form a new screen, which may contain elements, images, or text, etc. from the playback screen and the interface data. After the fusion is completed, the generated new screen is determined as the fusion data. Among them, the fusion data does not have a transparent effect because the purpose of the fusion is to synthesize the second interface image and the playback screen into a whole, rather than allowing the second interface image to still maintain partial transparency after synthesis. The second interface image will be displayed on the playback screen with a certain transparency, which is not the desired effect.

[0066] Step S104, the first processing chip sends the first interface image and the fusion data to the second processing chip.

[0067] The first processing chip sends the first interface image and the fusion data to the second processing chip. Specifically, this can be achieved through a data transmission interface or a bus, such as interfaces like HDMI, DisplayPort, or Aurora. Through these interfaces, the data can be transmitted to the location where the second processing chip is located for subsequent processing and display.

[0068] Step S105: The second processing chip identifies the first interface image and the fusion data. When it identifies the first interface image, it fuses the first interface image with the live video to generate a first target video.

[0069] The second processing chip receives the first interface image and the fusion data from the first processing chip and identifies the received data. Specifically, the second processing chip can distinguish which of the two types of data is the first interface image and which is the fusion data through the data identifier or a specific data format.

[0070] For example, in response to a user operation, a video recording operation of the live video is performed. During recording, the copied first interface image is directly used as the output, so the original transparency of the preset interface image is retained, and a frame header is added for the second processing chip to identify whether the current transmitted frame is the first interface image with transparency or the fused data after fusion without transparency. When the second processing chip identifies that the current frame is the first interface image with transparency, it retains the transparency and fuses it with the live video for output display. At this time, what is displayed is the video after the live video and the interface are fused.

[0071] In an alternative embodiment, the above image fusion method further includes: when the second processing chip identifies the data as the fusion data, it overlays and covers the fusion data on the live video to generate a second target video; where the second target video is the corresponding video after the second interface copy and the playback video are fused.

[0072] The second processing chip identifies whether the received data is the fusion data. When the second processing chip identifies that the received data is the fusion data, it performs an overlay process on these data and the live video. Specifically, the pixel data corresponding to the live video can be overlaid with the fusion data, and the pixel data corresponding to the live video is replaced with zero to avoid interference or influence of the pixel data of the live video on the overlaid result and ensure that the effect of the fusion data can be fully presented.

[0073] For example, in response to a user operation, a video playback operation of a to-be-played screen is performed. The first processing chip outputs the video after fusing the selected playback screen and the preset interface image, and the first interface image with transparency is bypassed. When the second processing chip recognizes that the current frame is fused data without a transparency effect, it sets the transparency to full coverage, that is, clears the pixel data in the real-time screen, and the real-time screen is completely covered. Therefore, only the screen corresponding to the fusion of the second interface copy and the playback screen is displayed.

[0074] Specifically, as Figure 3 shown, the first processing chip copies the preset interface image to generate a first interface image A and a second interface image B. The second interface image B is fused with the playback screen (pre-stage fusion), and then the first interface image and the fused data are sent to the second processing chip. The selector in the second processing chip recognizes the frame header. When it recognizes that it is the first interface image A, it fuses the first interface image A with the real-time screen (post-stage fusion) to generate a first target screen.

[0075] In the image fusion method provided by the embodiment of the present invention, the operation of fusing the second interface image with the playback screen does not affect the transparency effect of the first interface image corresponding to the preset interface image, so that when the first interface image is fused with the real-time screen, the underlying real-time screen can be displayed and the transparency information will not be lost due to fusion. At the same time, the collaborative work between the first processing chip and the second processing chip enables the system to complete complex image processing tasks. The first processing chip is responsible for fusing the second interface image with the playback screen and sending the result to the second processing chip, while the second processing chip is responsible for fusing the first interface image with the real-time screen. This division of labor and cooperation can improve the efficiency and performance of the system.

[0076] The embodiment of the present invention also provides a computer device having the above-mentioned first processing chip 1 and second processing chip 2.

[0077] Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of a computer device provided by an optional embodiment of the present invention. As Figure 4As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Each component communicates and connects with each other using different buses, and can be installed on a common motherboard or in other ways as needed. The processor can process instructions executed within the computer device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some alternative embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (such as an array of servers, a set of blade servers, or a multi-processor system). Figure 4 Taking one processor 10 as an example in

[0078] The processor 10 can be a central processing unit, a network processor, or a combination thereof. Among them, the processor 10 can further include a hardware chip. The above hardware chip can be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The above programmable logic device can be a complex programmable logic device, a field programmable gate array, a generic array logic, or any combination thereof.

[0079] Among them, the memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiments.

[0080] The memory 20 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the computer device, etc. In addition, the memory 20 can include high-speed random access memory, and can also include non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 can optionally include a memory remotely set relative to the processor 10, and these remote memories can be connected to the computer device through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0081] The memory 20 can include volatile memory, such as random access memory; the memory can also include non-volatile memory, such as flash memory, a hard disk, or a solid-state drive; the memory 20 can also include a combination of the above types of memory.

[0082] The computer device further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30, and the output device 40 may be connected by a bus or other means. Figure 4 Taking connection by bus as an example.

[0083] The input device 30 can receive input digital or character information and generate key signal inputs related to the user settings and function controls of the computer device, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED), and a haptic feedback device (e.g., a vibration motor), etc. The above display device includes, but is not limited to, a liquid crystal display, a light emitting diode, a display, and a plasma display. In some alternative embodiments, the display device may be a touch screen.

[0084] Embodiments of the present invention also provide a computer-readable storage medium. The method according to the embodiments of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented as computer code that is originally stored in a remote storage medium or a non-transitory machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiments is implemented.

[0085] A part of the present invention can be applied as a computer program product, such as computer program instructions. When executed by a computer, through the operation of the computer, the methods and / or technical solutions according to the present invention can be invoked or provided. Those skilled in the art should be able to understand that the forms of existence of computer program instructions in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible by the computer.

[0086] Although embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations fall within the scope defined by the appended claims.

Claims

1. An image fusion system, characterized in that: The system includes a first processing chip and a second processing chip; The first processing chip is used to obtain a preset interface image and a playback screen to be played, wherein the preset interface image has a transparent effect; the first processing chip is also used to copy the preset interface image to obtain two identical interface image copies; wherein the two identical interface image copies include a first interface image and a second interface image, wherein the first interface image and the second interface image have a transparent effect; the first processing chip is also used to merge the second interface image with the playback screen, and the merged data is determined as merged data; the first processing chip is also used to send the first interface image and the merged data to the second processing chip; The second processing chip is used to obtain real-time images collected by the endoscope; the second processing chip is also used to receive the first interface image and the fusion data, and identify them. When the first interface image is identified, the first interface image is fused with the real-time image to generate a first target image.

2. The image fusion system according to claim 1, characterized in that: The first processing chip is further used to add a first frame header to the first interface image and a second frame header to the fused data, so as to identify the first interface image and the fused data.

3. The image fusion system according to claim 2, characterized in that: The second processing chip is also used to identify the first interface image and the fusion data, including: The second processing chip is further used to identify the first frame header corresponding to the first interface image and the second frame header corresponding to the fusion data.

4. The image fusion system according to claim 1, characterized in that: The first processing chip is also used to send the first interface image and the fusion data to the second processing chip, including: The first processing chip is also used to send the first interface image and the fusion data to the second processing chip through a preset serial communication interface.

5. The image fusion system according to claim 1, characterized in that: The second processing chip is also used to overlay the fused data onto the real-time screen to generate a second target screen when the fused data is identified; wherein the second target screen is the corresponding screen after the second interface copy is fused with the playback screen.

6. The image fusion system according to claim 5, characterized in that: The second processing chip is also used to overlay the fusion data onto the real-time picture, including: The second processing chip is further used to superimpose the pixel data corresponding to the real-time image with the fusion data, and replace the pixel data corresponding to the real-time image with zero.

7. An image fusion method, characterized in that: The image fusion system as claimed in claim 1 comprises: The first processing chip acquires a preset interface image and a playback screen to be played, wherein the preset interface image has a transparent effect; the second processing chip acquires a real-time screen collected by the endoscope; The first processing chip copies the preset interface image to obtain two identical interface image copies; wherein the two identical interface image copies include a first interface image and a second interface image, and the first interface image and the second interface image have a transparent effect; The first processing chip fuses the second interface image with the playback screen, and the fused data is determined as fused data; The first processing chip sends the first interface image and the fusion data to the second processing chip; The second processing chip identifies the first interface image and the fusion data, and when identifying the first interface image, fuses the first interface image with the real-time picture to generate a first target picture.

8. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the image fusion method according to claim 7 by executing the computer instructions.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the image fusion method according to claim 7.

10. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions are used to enable a computer to execute the image fusion method according to claim 7.

Images