Multi-image fusion system and method

Abstract

A multi-image fusion system and method is provided. The multi-image fusion system includes an image capturing device and an image processor. The image capturing device captures a target captured image of a target body. The image processor copies the target captured image to generate a copied target image. The image processor sets the copied target image and the target captured image respectively as an original target image and an initial target image. The image processor divides the initial target image into a plurality of monochromatic target images of a plurality of color lights. The image processor fuses one or some of the plurality of monochromatic target images with the original target image to output a designated color light fused image.

Description

[Technical Field]

[0001] This invention relates to images, and in particular to a multi-image fusion system and method. [Previous Technology]

[0002] A multi-image fusion system requires multiple image capturing devices. The multiple lenses of the multiple image capturing devices capture multiple images of the same target object under different colored light illumination. Then, the multiple images are fused into a clear image, such as a single image that can clearly show the deep blood vessels on a part of the human body.

[0003] Because multiple lenses capture multiple images from different directions and angles, the content of the captured images will have offset errors. Therefore, in post-production, it is necessary to perform complex image recognition and fusion techniques to identify and analyze the content of multiple images, align similar content in the multiple images as much as possible, and then fuse the multiple images into a single image. However, due to the differences between the content of the multiple images captured by the multiple lenses, the fused single image will still not be perfect. [Summary of the Invention]

[0004] To address the shortcomings of existing technologies, the present invention provides a multi-image fusion system, comprising an image capturing device and an image processor. The image capturing device is configured to capture a target image of a target object. The image processor is connected to the image capturing device. The image processor is configured to copy the target image to generate a copied target image. The image processor is configured to use one of the target image and the copied target image as an original target image, and the other as an initial target image. The image processor is configured to divide the initial target image into multiple monochromatic light target images of different colors. The image processor is configured to select one or more of the multiple monochromatic light target images. The image processor is configured to fuse the selected one or more monochromatic light target images with the original target image to output a specified color fusion image.

[0005] To address the shortcomings of existing technologies, the present invention provides a multi-image fusion method, comprising the following steps: capturing a target image of a target body using an image capturing device; copying the target image to generate a copied target image; using an image processor to take one of the target image and the copied target image as an original target image and the other as an initial target image; dividing the initial target image into multiple monochromatic light target images of different colors using the image processor; selecting one or more of the monochromatic light target images from the multiple monochromatic light target images using the image processor; and fusing the selected one or more monochromatic light target images with the original target image using the image processor to output a specified color fusion image.

[0006] As described above, the present invention provides a multi-image fusion system and method. The multi-image fusion system and method of the present invention takes a single image of a target object as a target capture image, copies this target capture image, saves one of the target capture image and the copied image, and divides the other into multiple monochromatic target images of different colors. One of the multiple monochromatic target images is selected and fused with the original target image to form a specified color fusion image, allowing people to more clearly see the structure and outline of the target object (e.g., but not limited to, the distribution of deep blood vessels in the human body) on the specified color fusion image.

[0007] Compared to traditional image fusion systems where multiple images are captured by multiple lenses of multiple image capturing devices, the multi-image fusion system of the present invention only needs to use a single image capturing device (i.e., only a single lens) to capture a single target image, which is more cost-effective. Furthermore, since the target image and the monochromatic light target image segmented from the target image are captured by the same image capturing device (the same lens), the multiple image contents can be perfectly aligned with each other when they are superimposed and fused, so as to obtain a single specified color light fusion image with a better fusion effect.

[0008] To further understand the features and technical content of the present invention, please refer to the following detailed description and drawings of the present invention. However, the drawings provided are for reference and illustration only and are not intended to limit the present invention.

Implementation Method

[0009] The following describes the implementation of the present invention through specific embodiments. Those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various details in this specification can also be modified and changed based on different viewpoints and applications without departing from the concept of the present invention. In addition, the accompanying drawings of the present invention are only simple illustrations and are not depictions based on actual dimensions, as stated in advance. The following embodiments will further describe the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the scope of protection of the present invention. In addition, the term "or" used herein should be interpreted as potentially including any or more combinations of the associated listed items, depending on the actual situation.

[0010] Please refer to Figures 1 and 2, wherein Figure 1 is a block diagram of the multi-image fusion system of the first embodiment of the present invention, and Figure 2 is a flowchart of the steps of the multi-image fusion method of the first embodiment of the present invention.

[0011] The multi-image fusion system of the present invention includes an image capturing device 100 and an image processor 200 as shown in FIG1. ​​The image processor 200 is connected to the image capturing device 100. The multi-image fusion method of the present invention includes steps S101 to S108 as shown in FIG2, which are executed by the multi-image fusion system of the present invention.

[0012] The image capturing device 100 captures a target image IMG of a target body (as shown in step S101 of Figure 2), wherein the target body OB includes a living body (e.g., a human or animal), an object or a combination thereof.

[0013] First, the image processor 200 copies a target captured image IMG captured by the image capturing device 100 to generate a copied target image that is identical to the target captured image IMG (as shown in step S102 of Figure 2).

[0014] In order to perform different processing programs on different images, the image processor 200 can use one of a target captured image IMG and a copied target image as an original target image IMO (as shown in step S103 of Figure 2), and use the other as an initial target image IML (as shown in step S104 of Figure 2).

[0015] Next, the image processor 200 identifies an original color light of an initial target image IML, analyzes multiple monochromatic lights that are mixed to form this original color light, and divides the initial target image IML into multiple monochromatic light target images of different colors / hues (as shown in step S105 of Figure 2), such as, but not limited to, the first color light target image IMD1, the second color light target image IMD2, and the third color light target image IMD3 shown in Figure 1. In practice, the number of multiple monochromatic light target images into which the image processor 200 divides the initial target image IML may depend on other practical application requirements such as making the target OB more clearly presented.

[0016] The first color light target image IMD1 is the same as an image captured by the image capturing device 100 when only the first color light illuminates the target body OB. The second color light target image IMD2 is the same as an image captured by the image capturing device 100 when only the second color light illuminates the target body OB. The third color light target image IMD3 is the same as an image captured by the image capturing device 100 when only the third color light illuminates the target body OB. The first color light, the second color light, and the third color light are different colors of light. The initial target image IML is an image captured when the target body OB is illuminated by an original color light composed of the first color light, the second color light, and the third color light.

[0017] Next, the image processor 200 selects one or more of the segmented monochromatic light target images (as shown in step S106 of FIG2). For example, as shown in FIG1, in the first embodiment, the image processor 200 selects only the second color light target image IMD2 from the first color light target image IMD1, the second color light target image IMD2, and the third color light target image IMD3.

[0018] Finally, the image processor 200 fuses the selected one or more monochromatic light target images IMD1~IMD3 (for example, the second color light target image IMD2 shown in Figure 1) with an original target image IMO (as shown in step S107 of Figure 2) to output a single specified color light fused image IMF with a specified color light (as shown in step S108 of Figure 2).

[0019] It should be understood that since a copied target image is the same as an original target image IMO, in step S104 of Figure 2, whether a target capture image IMG or a copied target image is selected for subsequent segmentation, the same specified color fusion image IMF will be generated.

[0020] It is worth noting that the second color light target image IMD2 and the original target image IMO are both captured by a single lens of the image capturing device 100 in the same direction, angle and position. Therefore, when they are superimposed and fused, multiple identical image contents (such as multiple structural features inside the human body) can be directly aligned completely to obtain a specified color light fused image IMF with good fusion effect.

[0021] Please refer to Figure 3, which is a schematic diagram of the multi-image fusion system of the second embodiment of the present invention.

[0022] In the second embodiment, for example, as shown in FIG1, the image capturing device 100 captures an image of a body part inside the human body (as the target body OB) as a target capturing image IMG.

[0023] As shown in Figure 1, the image processor 200 copies a target captured image IMG received from the image capturing device 100 to generate a copied target image, which serves as an original target image IMO. As shown in Figure 3, the original target image IMO is exactly the same as the target captured image IMG.

[0024] As shown in FIG1, the image processor 200 uses a target captured image IMG captured by the image capturing device 100 as an initial target image IML. The initial target image IML is divided into a first color light target image IMD1, a second color light target image IMD2 and a third color light target image IMD3 in FIG3, which are respectively a red light target image, a green light target image and a blue light target image.

[0025] The red light target image is the same as an image captured by the image capturing device 100 when only red light illuminates the target body OB. The green light image is the same as an image captured by the image capturing device 100 when only green light illuminates the target body OB. The blue light target image is the same as an image captured by the image capturing device 100 when only blue light illuminates the target body OB.

[0026] The target captured image IMG is an image captured by the image capturing device 100 when white light, which is a mixture of red light, green light and blue light, is irradiated onto a body part inside the human body (as the target body OB).

[0027] The image processor 200 selects, for example but not limited to, the red light first color target image IMD1, the green light second color target image IMD2 and the blue light third color target image IMD3, and merges them with an original target image IMO to output a specified color fusion image IMF.

[0028] As shown in Figure 3, compared with the target captured image IMG, the fused image IMF of the specified color light can be seen more clearly by the human eye (such as, but not limited to, the blood vessels on the tongue inside the mouth).

[0029] Please refer to Figures 4 and 5, wherein Figure 4 is a schematic diagram of the multi-image fusion system of the third embodiment of the present invention, and Figure 5 is a flowchart of the steps of the multi-image fusion method of the third embodiment of the present invention.

[0030] As shown in FIG4, the multi-image fusion system of the present invention includes an image capturing device 100 and an image processor 200. The image processor 200 is connected to the image capturing device 100.

[0031] For example, as shown in FIG4, the image capturing device 100 is, for example, an endoscope, which includes an illumination device 102 and a single-lens camera 101.

[0032] In addition to steps S101 to S108 as described above in FIG2, the multi-image fusion method of the present invention may also include steps S201 to S203 as shown in FIG5, which are executed by the multi-image fusion system of the present invention as shown in FIG4, or in practice by the multi-image fusion system of the present invention as shown in FIG1.

[0033] Before fusing the original target image and the selected monochromatic target image into a specified color fused image IMF (i.e., after performing steps S101 to S106 and before step S107), the image processor 200 may first adjust one or more image feature parameters of an original target image IMO (as shown in step S201 of Figure 5) to generate an original modulated target image IMO2.

[0034] Alternatively, before fusing the original target image and the selected monochromatic light target image into a specified color fusion image IMF (i.e., after performing steps S101 to S106 and before step S107), the image processor 200 may first adjust the brightness contrast or other one or more image feature parameters of the selected one or more monochromatic light target images (as shown in step S202 of Figure 5) to generate one or more monochromatic light modulated target images, for example, adjusting the brightness contrast or other one or more image feature parameters of the second color light target image IMD2 to form the second color light target image IMD22.

[0035] For example, the image processor 200 adjusts the brightness contrast of an original target image IMO and the brightness contrast of a selected monochromatic light target image (e.g., a second color light target image IMD2) so that when the image is fused into a specified color light fused image IMF and output to a display device 300 for display (as shown in step S203 of FIG5), the internal structural features of the human body are presented more clearly.

[0036] If necessary, the image processor 200 can also output the second color light target image IMD2 and an original target image IMO to the display device 300 for display, as shown in FIG5. In practice, the image processor 200 can also output the second color light target image IMD22 and the original modulated target image IMO2 to the display device 300 for display.

[0037] In summary, the present invention provides a multi-image fusion system and method. The multi-image fusion system and method of the present invention takes a single image of a target object as a target capture image, copies this target capture image, saves one of the target capture image and the copied image, and divides the other into multiple monochromatic target images of different colors. One of the multiple monochromatic target images is selected and fused with the original target image to form a specified color fusion image, allowing people to more clearly see the structure and outline of the target object (e.g., but not limited to, the distribution of deep blood vessels in the human body) on the specified color fusion image.

[0038] Compared with traditional image fusion systems, which use multiple lenses of multiple image capturing devices to capture multiple images respectively, the multi-image fusion system of the present invention only needs to use a single image capturing device (i.e., only a single lens) to capture a single target image, which is more cost-effective. Since the target image and the monochromatic light target image segmented from the target image are captured by the same image capturing device (the same lens), the multiple image contents can be completely aligned with each other when they are superimposed and fused to obtain a single specified color light fusion image with a better fusion effect.

[0039] The content disclosed above is only a preferred and feasible embodiment of the present invention, and is not intended to limit the scope of the patent application of the present invention. Therefore, all equivalent technical changes made using the contents of the present invention specification and drawings are included in the scope of the patent application of the present invention. [Simplified Explanation of the Diagram]

[0040] Figure 1 is a block diagram of the multi-image fusion system of the first embodiment of the present invention.

[0041] Figure 2 is a flowchart of the steps of the multi-image fusion method of the first embodiment of the present invention.

[0042] Figure 3 is a schematic diagram of the multi-image fusion system of the second embodiment of the present invention.

[0043] Figure 4 is a schematic diagram of the multi-image fusion system of the third embodiment of the present invention.

[0044] Figure 5 is a flowchart of the steps of the multi-image fusion method according to the third embodiment of the present invention.

Claims

1. A multi-image fusion system, comprising: an image capturing device configured to capture a target image of a target body; and an image processor connected to the image capturing device, configured to: copy the target image to generate a copied target image; use one of the target image and the copied target image as an original target image, and the other as an initial target image; divide the initial target image into a plurality of monochromatic light target images of different colors; select one or a subset of the plurality of monochromatic light target images; and fuse the selected one or more monochromatic light target images with the original target image to output a specified color fusion image.

2. The multi-image fusion system as claimed in claim 1, wherein the plurality of monochromatic light target images include a red light target image, a green light target image and a blue light target image.

3. The multi-image fusion system as claimed in claim 1, wherein the image processor is configured to adjust one or more image feature parameters of the selected monochromatic light target images before fusing the selected one or more of the monochromatic light target images with the original target image.

4. The multi-image fusion system as claimed in claim 1, wherein the image processor is configured to adjust one or more image feature parameters of the original target image before fusing the selected one or more monochromatic light target images with the original target image.

5. A multi-image fusion method, comprising the following steps: capturing a target image of a target object using an image capturing device; copying the target image using an image processor to generate a copied target image; using the image processor to take one of the target image and the copied target image as an original target image and the other as an initial target image; dividing the initial target image into multiple monochromatic light target images of different colors using the image processor; selecting one or more of the monochromatic light target images from the multiple monochromatic light target images using the image processor; and fusing the selected one or more monochromatic light target images with the original target image using the image processor to output a specified color fusion image.

6. The multi-image fusion method as described in claim 5 further includes the following steps: the image processor segments the target captured image into a red light target image, a green light target image, and a blue light target image, which are included in a plurality of the monochromatic light target images.

7. The multi-image fusion method as described in claim 5 further includes the following steps performed before fusing the selected one or more monochromatic light target images with the original target image: adjusting one or more image feature parameters of one or more of the monochromatic light target images by the image processor.

8. The multi-image fusion method as described in claim 5 further includes the following steps performed before fusing the selected one or more monochromatic light target images with the original target image: adjusting one or more image feature parameters of the original target image by the image processor.

Images