Image fusion method, device and equipment based on weaving principle and storage medium
By using an image fusion method based on the principle of fabric weaving, the source image is segmented into strip images of warp and weft lines and interwoven, which solves the problems of high computational complexity and poor adaptability in the existing technology, and realizes high-quality image fusion and flexible fusion strategies.
Patent Information
- Application Number
- CN202511480630.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-16
- Publication Date
- 2026-01-13
AI Technical Summary
Existing pixel-level image fusion methods suffer from high computational complexity, poor fusion results, high requirements for image alignment, and a single fusion strategy, resulting in poor adaptability in different application scenarios.
An image fusion method based on weaving principles is adopted to segment the source image into strip images of warp and weft threads. Then, the strips are interwoven according to a preset weaving structure, and the fused pixel values are calculated using methods such as weighted average, maximum value, minimum value, median value, or modulo operation, including plain weave, twill weave, satin weave, checkered weave, and jacquard weave.
It simplifies the calculation process, improves the quality of fused images, enhances adaptability to different scenarios, and reduces the requirements for image alignment accuracy.
Smart Images
Figure CN121329786A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of image processing technology, and in particular to an image fusion method, apparatus, device, and storage medium based on the principle of fabric weaving. Background Technology
[0002] Currently, image fusion technology is widely used in various fields, such as medical imaging, remote sensing image processing, and computer vision. Common image fusion methods include pixel-level fusion, feature-level fusion, and decision-level fusion. Taking pixel-level fusion as an example, it mainly processes multiple images using algorithms such as weighted averaging and Laplacian pyramids to generate a clearer and more complete image. These methods typically require image preprocessing, such as alignment and normalization, and perform pixel-level fusion calculations using complex algorithms.
[0003] Existing pixel-level fusion methods, such as Laplacian pyramid fusion, require multi-scale decomposition and reconstruction of the image, which is computationally complex and time-consuming, making it difficult to meet real-time requirements. When dealing with complex scenes, existing methods are prone to loss of detail or blurring in the fused image, especially at image edges and textured areas. Most image fusion methods require strict alignment of the input images; otherwise, ghosting or misalignment will occur in the fused image, and image alignment itself is a complex and error-prone step. Existing methods mostly employ fixed fusion strategies, failing to flexibly adjust the fusion method according to specific scenarios, resulting in poor adaptability to different applications.
[0004] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention
[0005] The main objective of this invention is to provide an image fusion method, apparatus, device, and storage medium based on the principle of fabric weaving, aiming to solve the technical problems of existing image fusion algorithms, such as high computational complexity, poor fusion effect, high requirements for image alignment, and single fusion strategy.
[0006] To achieve the above objectives, the present invention provides an image fusion method based on the principle of fabric weaving, the image fusion method based on the principle of fabric weaving includes the following steps: Obtain source images to be fused, wherein the source images to be fused include at least a first source image and a second source image; The first source image is segmented into a strip image with multiple meridians based on its width, and the second source image is segmented into a strip image with multiple parallels based on its length. The striped image with multiple warp threads and the striped image with multiple weft threads are interwoven according to a preset fabric weave structure to generate a fused image. The preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave.
[0007] In some embodiments, the first source image and the second source image both have a length and a width of L and W, respectively, and the first source image is divided into n parts based on its width. *W strip image, the second source image is segmented based on length indivual The *W bar-shaped image, the segmented sub-images are as follows: and i and j represent the sub-image numbers, respectively. ,in, , , ,in, , , j=1,2,...,m.
[0008] In some embodiments, during the weaving process of the plain weave, for pixels in overlapping areas, the fused pixel value of the overlapping area is calculated using at least one of the following methods: weighted average fusion, maximum value fusion, minimum value fusion, or median value fusion. The formula for the weighted average fusion is:
[0009] ; The formula for maximum value fusion is: ; The formula for minimum value fusion is: ; The formula for median fusion is: .
[0010] In some embodiments, during the weaving process, the twill weave is either warp-dominated or weft-dominated. Warp-dominated twill consists of several warp yarns continuously floating above the weft yarns before sinking; weft-dominated twill consists of several weft yarns continuously floating above the warp yarns before sinking. For pixels in overlapping areas, the merged pixel value is determined through modulo operation, wherein: For the warp-dominated diagonal pattern, the fusion pixel value is:
[0011] For a weft-dominated diagonal pattern, the merged pixel value is:
[0012] in, denoted by the slope of the twill.
[0013] In some embodiments, during the weaving process, the satin weave is either warp-dominated or weft-dominated. Warp-dominated satin involves warp threads floating above weft threads at multiple locations to form floating lengths, while weft-dominated satin involves weft threads floating above warp threads at multiple locations to form floating lengths. For pixels in overlapping areas, the merged pixel value is determined through modulo operations, wherein: For the warp-dominated diagonal pattern, the fusion pixel value is:
[0014] For a weft-dominated diagonal pattern, the merged pixel value is:
[0015] in, denoted by the slope of the twill.
[0016] In some embodiments, during the interlacing process of the grid organization, the warp and weft lines interlace alternately within each cell, and the formula for calculating the fused pixel value is: .
[0017] In some embodiments, during the interlacing process, the jacquard weave allows adjustment of the warp and weft interlacing patterns according to a binary function of a custom pattern, and the formula for calculating the fused pixel value is as follows: ; Where 1 represents the meridian value and 0 represents the parallel value.
[0018] Furthermore, to achieve the above objectives, the present invention also proposes an image fusion device based on the principle of fabric weaving, the image fusion device based on the principle of fabric weaving comprising: The acquisition module is used to acquire source images to be fused, wherein the source images to be fused include at least a first source image and a second source image; The segmentation module is used to segment the first source image into a strip image with multiple meridians based on its width, and to segment the second source image into a strip image with multiple parallels based on its length. The fusion module is used to interweave the strip image with multiple warp threads and the strip image with multiple weft threads according to a preset fabric weave structure to generate a fused image. The preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave.
[0019] Furthermore, to achieve the above objectives, the present invention also proposes an image fusion device based on the principle of fabric weaving. The image fusion device based on the principle of fabric weaving includes: a memory, a processor, and an image fusion program based on the principle of fabric weaving stored in the memory and executable on the processor. The image fusion program based on the principle of fabric weaving is configured to implement the steps of the image fusion method based on the principle of fabric weaving described above.
[0020] Furthermore, to achieve the above objectives, the present invention also proposes a storage medium storing an image fusion program based on the principle of fabric weaving, wherein when the image fusion program based on the principle of fabric weaving is executed by a processor, it implements the steps of the image fusion method based on the principle of fabric weaving as described above.
[0021] In this invention, source images to be fused are obtained; the first source image is segmented into strip images with multiple warp threads based on width, and the second source image is segmented into strip images with multiple weft threads based on length; the strip images with multiple warp threads and the strip images with multiple weft threads are interwoven according to a preset fabric weave structure to generate a fused image, wherein the preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave. This method, by introducing an image fusion method based on fabric weaving principles, simplifies the calculation process, improves the quality of the fused image, enhances adaptability to different scenes, and reduces the requirements for image alignment accuracy. Attached Figure Description
[0022] Figure 1 This is a flowchart illustrating the first embodiment of the image fusion method based on the weaving principle of the present invention; Figure 2 This is a schematic diagram of the first source image after segmentation in the image fusion method based on the weaving principle of the present invention; Figure 3 This is a schematic diagram of the second source image after segmentation in the image fusion method based on the weaving principle of the present invention; Figure 4 This is a schematic diagram of the warp-dominated twill weave in the image fusion method based on weaving principles of the present invention; Figure 5 This is a schematic diagram of the weft-dominated twill weave in the image fusion method based on weaving principles of the present invention; Figure 6 This is a schematic diagram of the warp-dominated satin weave in the image fusion method based on weaving principles of the present invention; Figure 7 This is a schematic diagram of the weft-dominated satin weave in the image fusion method based on weaving principles of the present invention; Figure 8 This is a schematic diagram of the grid structure in the image fusion method based on the weaving principle of the present invention; Figure 9 This is a schematic diagram of the jacquard structure in the image fusion method based on weaving principles of the present invention; Figure 10 This is a structural block diagram of the first embodiment of the image fusion device based on the weaving principle of the present invention.
[0023] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0024] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the invention.
[0025] This invention provides an image fusion method based on the principle of fabric weaving, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of an image fusion method based on the principle of fabric weaving according to the present invention.
[0026] In this embodiment, the image fusion method based on the weaving principle includes the following steps: Step S10: Obtain the source images to be fused.
[0027] In this embodiment, the executing entity is an image fusion device based on the principle of fabric weaving. This image fusion device based on the principle of fabric weaving has functions such as data processing, data communication, and program execution. The image fusion device based on the principle of fabric weaving can be a computer terminal device or other network device, or other devices with similar functions. This embodiment does not limit the scope of the application.
[0028] It should be noted that image fusion technology is currently widely used in various fields, such as medical imaging, remote sensing image processing, and computer vision. Common image fusion methods include pixel-level fusion, feature-level fusion, and decision-level fusion. Taking pixel-level fusion as an example, it mainly processes multiple images using algorithms such as weighted averaging and Laplacian pyramid fusion to generate a clearer and more complete image. These methods typically require image preprocessing, such as alignment and normalization, and perform pixel-level fusion calculations using complex algorithms. Existing pixel-level fusion methods, such as Laplacian pyramid fusion, require multi-scale decomposition and reconstruction of the image, which is computationally complex and time-consuming, making it difficult to meet real-time requirements. When dealing with complex scenes, existing methods are prone to loss of detail or blurring of the fused image, especially at image edges and textured areas. Most image fusion methods require strict alignment of the input images; otherwise, ghosting or misalignment will occur in the fused image, and image alignment itself is a complex and error-prone step. Most existing methods adopt fixed fusion strategies and cannot flexibly adjust the fusion method according to specific scenarios, resulting in poor adaptability in different applications.
[0029] To address the aforementioned technical problems, this embodiment acquires source images to be fused; the first source image is segmented into strip images with multiple warp threads based on width, and the second source image is segmented into strip images with multiple weft threads based on length; the strip images with multiple warp threads and the strip images with multiple weft threads are interwoven according to a preset fabric weave structure to generate a fused image, wherein the preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave. This method, by introducing an image fusion method based on fabric weaving principles, can simplify the calculation process, improve the quality of the fused image, enhance adaptability to different scenes, and reduce the requirements for image alignment accuracy. Specifically, it can be implemented as follows.
[0030] In this specific implementation, the source images to be fused need to be acquired first. Specifically, a camera can be used to continuously photograph the target product to acquire two images. The source images to be fused include at least a first source image and a second source image, each image having a length and width of [missing information]. and That is, the length and width of the first source image and the second source image are both L and W.
[0031] Step S20: Divide the first source image into a strip image with multiple meridians based on width, and divide the second source image into a strip image with multiple parallels based on length.
[0032] In this embodiment, the length and width of the first source image and the second source image are both L and W, respectively. The first source image is divided into n parts based on its width. *W strip image, the second source image is segmented based on length indivual The *W bar-shaped image, the segmented sub-images are as follows: and i and j represent the sub-image numbers, respectively. ,in, , , ,in, , j=1,2,...,m. The segmented image of the first source image can be referenced. Figure 2 As shown, the image segmented from the second source image can be referenced. Figure 3 As shown.
[0033] Step S30: Interweave the strip image with multiple warp threads and the strip image with multiple weft threads according to a preset fabric weave structure to generate a fused image.
[0034] It should be noted that the preset fabric weave structure in this embodiment includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave.
[0035] When adopting a plain weave structure, for pixels in overlapping areas, the fused pixel value of the overlapping area is calculated using at least one of the following methods: weighted average fusion, maximum value fusion, minimum value fusion, or median value fusion. The formula for the weighted average fusion is:
[0036] ; The formula for maximum value fusion is: ; The formula for minimum value fusion is: ; The formula for median fusion is: .
[0037] In one embodiment, when adopting a twill weave structure, either the warp-dominated twill or the weft-dominated twill is used. In a warp-dominated twill, several warp yarns continuously float above the weft yarns and then sink. In a weft-dominated twill, several weft yarns continuously float above the warp yarns and then sink. For pixels in overlapping areas, the merged pixel value is determined through modulo operations, wherein: For the warp-dominated diagonal pattern, the fusion pixel value is:
[0038] For a weft-dominated diagonal pattern, the merged pixel value is:
[0039] in, The slope of the twill pattern; the warp-dominant twill pattern can be referenced. Figure 4 As shown, the dominant twill pattern along the latitude can be referenced. Figure 5 As shown.
[0040] In one embodiment, when adopting a satin weave structure, the satin weave is either warp-dominated or weft-dominated. Warp-dominated satin weave involves warp threads floating above weft threads at multiple locations to form floating lengths, while weft-dominated satin weaves float above warp threads at multiple locations to form floating lengths. For pixels in overlapping areas, the merged pixel value is determined through modulo operations, wherein: For warp-dominated satin weave, the blending pixel value is:
[0041] For weft-dominated satin weave, the blending pixel value is:
[0042] in, This refers to the float length of the satin weave; the warp-dominated satin weave can be referenced. Figure 6 As shown, the weft-dominated satin weave can be referenced. Figure 7 As shown.
[0043] In one embodiment, when adopting a grid-like organizational structure, a schematic diagram of the grid organization can be referenced. Figure 8 As shown, meridians and parallels intertwine alternately within each cell, and the formula for calculating the merged pixel value is: .
[0044] In one embodiment, when adopting a jacquard weave structure, a schematic diagram of the jacquard weave structure can be referred to. Figure 9 As shown, the interlacing pattern of meridians and parallels can be adjusted according to a binary function of a custom pattern. The formula for calculating the merged pixel value is as follows: ; Where 1 represents the meridian value and 0 represents the parallel value.
[0045] In one embodiment, a composite texture combines two or more basic weave structures to create a more complex texture. For example, plain and twill weaves can be combined.
[0046] Arrangement method: Plain and twill weave combined: Plain weave is used in some areas and twill weave is used in other areas.
[0047] Suppose R(x,y) is a region partitioning function (1 represents a plain-patterned region, 0 represents a diagonal-patterned region), then:
[0048] It's important to note that "mod" is short for "modulo operation," which means finding the remainder after dividing two numbers. In image fusion formulas, "mod" is used to achieve periodic alternation. For example, in twill or plain weave patterns, the "mod" operation can help determine which weave pattern a given pixel position (x, y) should belong to.
[0049] In practice, the image fusion can be completed by obtaining the fusion pixel value through the above formula.
[0050] In this embodiment, source images to be fused are obtained; the first source image is segmented into strip images with multiple warp threads based on width, and the second source image is segmented into strip images with multiple weft threads based on length; the strip images with multiple warp threads and the strip images with multiple weft threads are interwoven according to a preset fabric weave structure to generate a fused image, wherein the preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave. This method, by introducing an image fusion method based on fabric weaving principles, can simplify the calculation process, improve the quality of the fused image, enhance adaptability to different scenes, and reduce the requirements for image alignment accuracy.
[0051] Furthermore, this embodiment of the invention also proposes a storage medium storing an image fusion program based on the principle of fabric weaving. When the image fusion program based on the principle of fabric weaving is executed by a processor, it implements the steps of the image fusion method based on the principle of fabric weaving described above.
[0052] Reference Figure 10 , Figure 10 This is a structural block diagram of the first embodiment of the image fusion device based on the weaving principle of the present invention.
[0053] like Figure 10 As shown, the image fusion device based on the weaving principle proposed in this embodiment of the invention includes: The acquisition module 10 is used to acquire the source images to be fused, wherein the source images to be fused include at least a first source image and a second source image; The segmentation module 20 is used to segment the first source image into a strip image with multiple meridians based on width, and to segment the second source image into a strip image with multiple parallels based on length; The fusion module 30 is used to interweave the strip image with multiple warp threads and the strip image with multiple weft threads according to a preset fabric weave structure to generate a fused image. The preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave.
[0054] In this embodiment, source images to be fused are obtained; the first source image is segmented into strip images with multiple warp threads based on width, and the second source image is segmented into strip images with multiple weft threads based on length; the strip images with multiple warp threads and the strip images with multiple weft threads are interwoven according to a preset fabric weave structure to generate a fused image, wherein the preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave. This method, by introducing an image fusion method based on fabric weaving principles, can simplify the calculation process, improve the quality of the fused image, enhance adaptability to different scenes, and reduce the requirements for image alignment accuracy.
[0055] In some embodiments, the first source image and the second source image both have a length and a width of L and W, respectively, and the first source image is divided into n parts based on its width. *W strip image, the second source image is segmented based on length indivual The *W bar-shaped image, the segmented sub-images are as follows: and i and j represent the sub-image numbers, respectively. ,in, , , ,in, , , j=1,2,...,m.
[0056] In some embodiments, during the weaving process of the plain weave, for pixels in overlapping areas, the fused pixel value of the overlapping area is calculated using at least one of the following methods: weighted average fusion, maximum value fusion, minimum value fusion, or median value fusion. The formula for the weighted average fusion is:
[0057] ; The formula for maximum value fusion is: ; The formula for minimum value fusion is: ; The formula for median fusion is: .
[0058] In some embodiments, during the weaving process, the twill weave is either warp-dominated or weft-dominated. Warp-dominated twill consists of several warp yarns continuously floating above the weft yarns before sinking; weft-dominated twill consists of several weft yarns continuously floating above the warp yarns before sinking. For pixels in overlapping areas, the merged pixel value is determined through modulo operation, wherein: For the warp-dominated diagonal pattern, the fusion pixel value is:
[0059] For a weft-dominated diagonal pattern, the merged pixel value is:
[0060] in, denoted by the slope of the twill.
[0061] In some embodiments, during the weaving process, the satin weave is either warp-dominated or weft-dominated. Warp-dominated satin involves warp threads floating above weft threads at multiple locations to form floating lengths, while weft-dominated satin involves weft threads floating above warp threads at multiple locations to form floating lengths. For pixels in overlapping areas, the merged pixel value is determined through modulo operations, wherein: For warp-dominated satin weave, the blending pixel value is:
[0062] For weft-dominated satin weave, the blending pixel value is:
[0063] in, This refers to the float length of the satin weave.
[0064] In some embodiments, during the interlacing process of the grid organization, the warp and weft lines interlace alternately within each cell, and the formula for calculating the fused pixel value is: .
[0065] In some embodiments, during the interlacing process, the jacquard weave allows adjustment of the warp and weft interlacing patterns according to a binary function of a custom pattern, and the formula for calculating the fused pixel value is as follows: ; Where 1 represents the meridian value and 0 represents the parallel value.
[0066] This application embodiment also provides an image device based on the principle of fabric weaving, including a processor, a communication interface, a memory, and a communication bus. The processor, communication interface, and memory communicate with each other through the communication bus. The memory is used to store an image fusion program based on the principle of fabric weaving. When the processor executes the program stored in the memory, it implements the above-mentioned image fusion method based on the principle of fabric weaving.
[0067] The communication bus mentioned in the aforementioned image device based on the weaving principle can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc.
[0068] The communication interface is used for communication between the aforementioned image device based on the weaving principle and other devices.
[0069] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.
[0070] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0071] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)).
[0072] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0073] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0074] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
[0075] It should be understood that the above are merely illustrative examples and do not constitute any limitation on the technical solutions of the present invention. In specific applications, those skilled in the art can make settings as needed, and the present invention does not impose any restrictions on this.
[0076] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of this invention. In practical applications, those skilled in the art can select some or all of the workflow to achieve the purpose of this embodiment according to actual needs, and no restrictions are imposed here.
[0077] In addition, for technical details not described in detail in this embodiment, please refer to the image fusion method based on the weaving principle provided in any embodiment of the present invention, which will not be repeated here.
[0078] Furthermore, it should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.
[0079] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0080] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as read-only memory (ROM) / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.
[0081] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.
[0082] It is understood that the system provided in the embodiments of the present invention corresponds to the method provided in the embodiments of the present invention, and the explanation, examples and beneficial effects of the relevant content can be referred to the corresponding parts of the above methods.
Claims
1. An image fusion method based on the principle of fabric weaving, characterized in that, The image fusion method based on the principle of fabric weaving includes: Obtain source images to be fused, wherein the source images to be fused include at least a first source image and a second source image; The first source image is segmented into a strip image with multiple meridians based on its width, and the second source image is segmented into a strip image with multiple parallels based on its length. The striped image with multiple warp threads and the striped image with multiple weft threads are interwoven according to a preset fabric weave structure to generate a fused image. The preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave.
2. The image fusion method based on the weaving principle as described in claim 1, characterized in that, The first source image and the second source image both have a length and width of L and W, respectively. The first source image is divided into n parts based on its width. *W strip image, the second source image is segmented based on length indivual The *W bar-shaped image, the segmented sub-images are as follows: and i and j represent the sub-image numbers, respectively. ,in, , , ,in, , , j=1,2,...,m.
3. The image fusion method based on the weaving principle as described in claim 2, characterized in that, During the weaving process, for pixels in overlapping areas, the fused pixel value of the overlapping area is calculated using at least one of the following methods: weighted average fusion, maximum value fusion, minimum value fusion, or median value fusion. The formula for the weighted average fusion is: ； The formula for maximum value fusion is: ； The formula for minimum value fusion is: ； The formula for median fusion is: 。 4. The image fusion method based on the weaving principle as described in claim 2, characterized in that, During the weaving process, the twill weave is either warp-dominated or weft-dominated. Warp-dominated twill consists of several warp yarns continuously floating above the weft yarns before sinking, while weft-dominated twill consists of several weft yarns continuously floating above the warp yarns before sinking. For pixels in overlapping areas, the merged pixel value is determined through modulo operations, where: For the warp-dominated diagonal pattern, the fusion pixel value is: For a weft-dominated diagonal pattern, the merged pixel value is: in, denoted by the slope of the twill.
5. The image fusion method based on the weaving principle as described in claim 2, characterized in that, During the weaving process, the satin weave is either warp-dominated or weft-dominated. Warp-dominated satin weave involves warp threads floating above weft threads at multiple positions, forming floating lengths. Weft-dominated satin weave involves weft threads floating above warp threads at multiple positions, forming floating lengths. For pixels in overlapping areas, the merged pixel value is determined through modulo operations, where: For warp-dominated satin weave, the blending pixel value is: For weft-dominated satin weave, the blending pixel value is: in, This refers to the float length of the satin weave.
6. The image fusion method based on the weaving principle as described in claim 2, characterized in that, During the interlacing process of the grid structure, the warp and weft lines alternately intertwine within each cell. The formula for calculating the merged pixel value is as follows: 。 7. The image fusion method based on the weaving principle as described in claim 2, characterized in that, During the interlacing process, the jacquard weave allows adjustment of the warp and weft interlacing methods according to a binary function of a custom pattern. The formula for calculating the fused pixel value is as follows: ； Where 1 represents the meridian value and 0 represents the parallel value.
8. An image fusion device based on the principle of fabric weaving, characterized in that, The image fusion device based on the fabric weaving principle includes: The acquisition module is used to acquire source images to be fused, wherein the source images to be fused include at least a first source image and a second source image; The segmentation module is used to segment the first source image into a strip image with multiple meridians based on its width, and to segment the second source image into a strip image with multiple parallels based on its length. The fusion module is used to interweave the strip image with multiple warp threads and the image with multiple strip weft threads according to a preset fabric weave structure to generate a fused image. The preset fabric weave structure includes at least one of plain weave, twill weave, satin weave, checkered weave, jacquard weave, or composite weave.
9. An image fusion device based on the principle of fabric weaving, characterized in that, The image fusion device based on the fabric principle includes: a memory, a processor, and an image fusion program based on the fabric principle stored in the memory and executable on the processor, wherein the image fusion program based on the fabric principle is configured to implement the steps of the image fusion method based on the fabric principle as described in any one of claims 1 to 7.
10. A storage medium, characterized in that, The storage medium stores an image fusion program based on the principle of fabric weaving, which, when executed by a processor, implements the steps of the image fusion method based on the principle of fabric weaving as described in any one of claims 1 to 7.