Image fusion method and device

By obtaining the configuration information and position distribution of layer blocks, combined with row or column reading method and display priority order, the image fusion efficiency is improved, the problem of low image fusion speed in the prior art is solved, and more efficient is achieved image processing and display.

CN112907496BActive Publication Date: 2024-11-12CANAAN BRIGHT SIGHT CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110209219.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-24
Publication Date
2024-11-12
Estimated Expiration
2041-02-24

AI Technical Summary

Technical Problem

In the prior art, the image fusion process is long, resulting in low display efficiency. Especially in video or image processing, the sequential reading and fusing background images and multiple layer blocks lead to low fusion speed and low efficiency.

Method used

By obtaining the configuration information of multiple layer blocks to be fused, determining their position distribution in the target map, and obtaining the target image information and layer information according to the position distribution for fusing processing, using row or column reading method, combined with The overlapping areas are processed in order to improve image fusion efficiency.

Benefits of technology

The image fusion speed is effectively improved, image processing time is saved, display efficiency is improved, and the problem of low fusion speed in the prior art is solved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112907496B_ABST
    Figure CN112907496B_ABST
Patent Text Reader

Abstract

The present application discloses an image fusion method and device. The specific implementation scheme is as follows: the method includes: obtaining configuration information corresponding to multiple layer blocks to be fused, the configuration information including position information of the layer blocks in the target image; determining the position distribution of each layer block in the target image according to the configuration information; obtaining target image information corresponding to the target image, and obtaining layer information corresponding to each layer block according to the position distribution; fusing the target image information and the layer information corresponding to each layer block to obtain a fused image. The fusion speed is effectively improved, the image processing time is saved, and the display efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to the field of image fusion. Background Art

[0002] When an artificial intelligence system displays a video or image on a display screen, it is necessary to identify the target detected in the video or image, or to place other information related to the target based on the detected target. In order to achieve the above purpose, image fusion (alpha-blending) technology is usually used. Image fusion (alpha-blending) technology can fuse different images to be fused into different areas of the target image (such as the background image) in a semi-transparent or opaque manner, and then display the fused image. Each pixel of a color image is represented by three components R, G, and B. If each component is 8 bits, then a pixel is represented by 3*8=24 bits. When a pixel is represented by 32 bits, if R, G, and B are represented by 8 bits respectively, the remaining 8 bits are often called alpha channel bits. An alpha value is stored in each pixel to indicate the degree of transparency of the pixel. The value of alpha is generally 0 to 255. When alpha is 0, it means that the image is fully transparent. When alpha is 255, it means that the image is displaying the target image. When alpha is between 0 and 255, it means that the image is semi-transparent. When images are fused, the usual method is to mix the RGB values ​​of the source pixels with the RGB values ​​of the target pixels (such as the pixels of the background image) in proportion, and finally obtain a mixed RGB value. However, when the image fusion technology in the prior art is used, the processing time of the video or image is long, which leads to low display efficiency. Summary of the invention

[0003] The present application provides an image fusion method and device to solve the problems existing in the related art. The technical solution is as follows:

[0004] In a first aspect, an embodiment of the present application provides an image fusion method, comprising:

[0005] Obtain configuration information corresponding to multiple layer blocks to be fused, the configuration information including position information of the layer blocks in the target image;

[0006] Determine the position distribution of each layer block in the target map according to the configuration information;

[0007] Obtain the target image information corresponding to the target image, and obtain the layer information corresponding to each layer block according to the position distribution;

[0008] The target image information and the layer information corresponding to each layer block are fused to obtain a fused image.

[0009] In one implementation, the configuration information further includes a display priority order of each layer block, and the method further includes:

[0010] Determine the overlapping area between each layer block according to the position distribution;

[0011] For multiple layer blocks containing overlapping areas, the layer information of each layer block is obtained in order from low to high according to the display priority order.

[0012] In one implementation, obtaining target image information corresponding to the target image, and obtaining layer information corresponding to each layer block according to position distribution, includes:

[0013] Read the target image information of the current row or column in the target image by reading in rows or columns;

[0014] When there are layer blocks distributed in the current row or column, the arrangement order of each layer block is determined according to the position distribution;

[0015] Get the layer information of the current row according to the sorting order.

[0016] In one implementation, the location information includes an identification box corresponding to the layer block, and the starting coordinates, ending coordinates, and storage address of the identification box in the target image. The layer information of the current row is obtained according to the arrangement order, including:

[0017] When the read position falls within the range of the start coordinate and the end coordinate, a read request is generated;

[0018] According to the read request and storage address, read the layer information of the current row or column from the memory in the order of arrangement, or

[0019] Generate the layer information of the current row or column in the identification box corresponding to the layer block.

[0020] In one embodiment, it further includes:

[0021] Distributing target image information to a first storage module;

[0022] A bilinear interpolation operation is performed on the layer information corresponding to each layer block, and the layer information obtained after the operation is distributed to the second storage module.

[0023] In one implementation, distributing the layer information obtained after the operation to the second storage module includes:

[0024] For multiple layer blocks including overlapping areas, the layer information corresponding to the layer block with the highest priority is distributed to the second storage module.

[0025] In a second aspect, an embodiment of the present application provides an image fusion device, including:

[0026] A configuration information acquisition module is used to acquire configuration information corresponding to multiple layer blocks to be fused, and the configuration information includes position information of the layer blocks in the target image;

[0027] A layer block distribution determination module is used to determine the position distribution of each layer block in the target map according to the configuration information;

[0028] The layer information acquisition module is used to obtain the target image information corresponding to the target image, and obtain the layer information corresponding to each layer block according to the position distribution;

[0029] The image fusion module is used to fuse the target image information with the layer information corresponding to each layer block to obtain a fused image.

[0030] In one embodiment, the configuration information also includes the display priority order of each layer block, and also includes:

[0031] An overlapping area determination module is used to determine the overlapping area between each layer block according to the position distribution;

[0032] For multiple layer blocks containing overlapping areas, the layer information of each layer block is obtained in order from low to high according to the display priority order.

[0033] In one implementation, the layer information acquisition module includes:

[0034] A target image information reading submodule, used for reading the target image information of the current row or column in the target image by row or column;

[0035] The arrangement order determination submodule is used to determine the arrangement order of each layer block according to the position distribution when there are layer blocks distributed in the current row or column;

[0036] The layer information reading submodule is used to read the layer information of the current row or column according to the arrangement order.

[0037] In one embodiment, the location information includes an identification box corresponding to the layer block, and the starting coordinates, ending coordinates and storage address of the identification box in the target image. The layer information reading submodule includes:

[0038] A read request generating unit, configured to generate a read request when the read position falls within the range of the start coordinate and the end coordinate;

[0039] The layer information reading unit is used to read the layer information of the current row or column from the memory in the arrangement order according to the read request and the storage address;

[0040] The layer information generating unit is used to generate the layer information of the current row or column in the identification frame corresponding to the layer block.

[0041] In one embodiment, it further includes:

[0042] A target image information distribution module, used for distributing the target image information to the first storage module;

[0043] The layer information distribution module is used to perform bilinear interpolation operation on the layer information corresponding to each layer block, and distribute the layer information obtained after the operation to the second storage module.

[0044] In one implementation, the layer information distribution module includes:

[0045] The highest priority information distribution submodule is used to distribute the layer information corresponding to the highest priority layer block to the second storage module for multiple layer blocks containing overlapping areas.

[0046] In a third aspect, an electronic device is provided, including:

[0047] at least one processor; and a memory communicatively coupled to the at least one processor;

[0048] The memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor so that the at least one processor can execute any of the above methods.

[0049] In a fourth aspect, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to execute any of the above methods.

[0050] One embodiment of the above application has the following advantages or beneficial effects: the image fusion method provided by the embodiment can read the image information of the target image and also read the layer information of multiple layer blocks according to the position distribution of each layer block in the target image, and fuse the read image information of the target image and the layer information of multiple layer blocks to obtain a fused image, and then display the fused image. The target image and multiple layer blocks are read according to the reading method provided by the embodiment, and then the read target image and multiple layer blocks are fused, which solves the technical problems of low fusion speed and low efficiency caused by sequentially reading and fusing the background image and multiple layer blocks in the prior art, effectively improves the fusion speed, saves image processing time, and improves display efficiency.

[0051] Other effects of the above optional manner will be described below in conjunction with specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present application.

[0053] Figure 1 is a schematic diagram of an image fusion method according to an embodiment of the present application;

[0054] Figure 2 is a structural diagram of an image display device according to an embodiment of the present application;

[0055] Figure 3 is a schematic diagram of an image fusion method according to another embodiment of the present application;

[0056] Figure 4 is a structural diagram of an image information acquisition module according to an embodiment of the present application;

[0057] Figure 5 is a schematic diagram of a process of reading target image information and layer information of a layer block according to an embodiment of the present application;

[0058] Figure 6 is a schematic diagram of a display priority order of multiple layer blocks including overlapping areas according to an embodiment of the present application;

[0059] Figure 7 A scene graph in which layer block m and layer block n of a current row do not overlap according to an embodiment of the present application;

[0060] Figure 8 A scene graph for reading the overlapped layer block m and layer block n of the current row according to an embodiment of the present application;

[0061] Fig. 9 is a schematic diagram of an image fusion device according to an embodiment of the present application;

[0062] Fig.10 is a schematic diagram of an image fusion device according to another embodiment of the present application;

[0063] Fig.11 It is a block diagram of an electronic device used to implement an image fusion method in an embodiment of the present application. DETAILED DESCRIPTION

[0064] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0065] In the existing image fusion technology, the background image and multiple layer blocks are read and fused in sequence. Specifically, the background image and the first layer block are read and fused, and the image after the first fusion is used as the background image. The second layer block is read again, and the image after the first fusion is fused with the second layer block, and so on, until the fusion of the last layer block is completed, and then the final fused image is displayed, resulting in a long image fusion time and low display efficiency. In order to solve the above technical problems, this embodiment provides as follows Figure 1 An image fusion method shown includes the following steps:

[0066] Step S110: obtaining configuration information corresponding to the multiple layer blocks to be fused, the configuration information including position information of the layer blocks in the target image;

[0067] Step S120: determining the position distribution of each layer block in the target image according to the configuration information;

[0068] Step S130: obtaining target image information corresponding to the target image, and obtaining layer information corresponding to each layer block according to position distribution;

[0069] Step S140: Fusing the target image information with the layer information corresponding to each layer block to obtain a fused image.

[0070] In one example, an image display device is provided, which fuses multiple layer blocks (blocks) to be input and a target image, and generates an interface control logic for displaying the fused image. For example, 32 rectangular small images (layer blocks) configured by the software can be enlarged and pasted to different areas of the background video image (target image) in a semi-transparent or opaque manner, and all small images are independent of each other, wherein the target image can be a background image. The layer block can be a rectangular area, and the rectangular area can be used with a rectangular border. The total area of ​​the rectangular frame can be less than the sum of the areas of more than 4 original images. Each layer block can support integer magnification within 8 times. The image display device can support a maximum of 32 layer blocks for fusion, and the priority between the layer blocks can be configured; the transparency of the layer blocks can be configured; the identification box for identifying the content in the layer block can be a rectangular box, and the starting position, width and height of the rectangular box can be configured. It is necessary to configure the register and the starting address of each frame image, support MIPI (Mobile Industry Processor Interface), DPI (Display Pixel Interface, RGB interface) output, and support SiI9022 video parallel port output.

[0071] MIPI-DPI

[0072]

[0073] SiI9022 video parallel port

[0074]

[0075] Register Description

[0076] Register Name Bit width address describe blend_en 1 block_start_x_i 11 block_start_y_i 11 block_src_width_i 11 block_src_height_i 11 block_des_width_i 11 block_des_height_i 11 block_alph_i 8 block_addr_i 32 block_stride_i 32 block_mode_i 1 0: image 1: layer (block) block_box_r_i 8 block_box_g_i 8 block_box_b_i 8 block_ratio_i 3 image_base_addr 32 image_stride 32 image_weight 11 image_height 11

[0077] The hardware block diagram of the image display device is as follows Figure 2 As shown, the configuration information acquisition module (Block info) in the image display device acquires the configuration information of multiple layer blocks (rectangular frames) through the APB (Advanced Peripheral Bus) peripheral bus. The configuration information includes: the position information of the layer blocks in the target image. For example, the size of the rectangular frame corresponding to each layer block, the initial position, the end position and the storage address of the rectangular frame in the target image. The configuration information acquisition module (Blockinfo) acquires the configuration information from the memory and sends it to the image information acquisition module (Fetch) and the control module (ctrl). The image information acquisition module is used to determine the position distribution of each layer block in the target image according to the configuration information, acquire the image information corresponding to the target image, and acquire the layer information corresponding to each layer block according to the position distribution. The acquired image information of the target image is sent to the first buffer module (src_buf) for storage through the data distribution module (data_distribute), and the acquired image information of multiple layer blocks is sent to the second buffer module (block_buf) for storage. The control module (ctrl) is used to scan the image information of the target image and the layer information of multiple layer blocks from the starting position in the display order from left to right and from top to bottom. The image fusion module (blending alu) uses the fusion algorithm to fuse the image information of the scanned target image and the layer information of multiple layer blocks to obtain a fused image. The fused image is sent to the display buffer module (display_buf), and the timing control module (dsi_packer) displays the fused image through the protocol and interface.

[0078] In the present embodiment, while reading the image information of the target image, it is also possible to read the layer information of multiple layer blocks according to the position distribution of each layer block in the target image, and the read image information of the target image and the layer information of the multiple layer blocks are fused to obtain a fused image, and then the fused image is displayed, which effectively improves the fusion speed, saves image processing time, and improves display efficiency.

[0079] In one embodiment, if Figure 3As shown, the configuration information also includes the display priority order of each layer block, and also includes:

[0080] Step S150: determining the overlapping area between each layer block according to the position distribution;

[0081] Step S160: for multiple layer blocks including overlapping areas, the layer information of each layer block is obtained in order from low to high according to the display priority order.

[0082] In one example, when reading layer blocks, the order and overlap of multiple layer blocks need to be considered. For example, the position distribution relationship between layer block i (block_i) and layer block j (block_j) is determined based on the configuration information, and the arrangement order of block_i and block_j and the overlap area between block_i and block_j can be determined based on the position distribution relationship. If block_i and block_j need to be obtained in a row, and there is an overlap area between block_i and block_j, the layer information of these two layer blocks is obtained according to the arrangement order and display priority order of block_i and block_j.

[0083] In order to simplify the complexity of control, the layer information of the layer block with the lowest priority is read first, and then the layer information of the layer block with the second lowest priority is read. The layer information read later directly overwrites the layer information read earlier, until the layer information of the layer block with the highest priority is read. The control is greatly simplified, which is convenient for controlling the image in the memory and displaying it on the screen.

[0084] In one embodiment, step S130 includes:

[0085] Step S131: reading target image information of the current row or column in the target image by row or column reading;

[0086] Step S132: when there are layer blocks distributed in the current row or column, determine the arrangement order of each layer block according to the position distribution;

[0087] Step S133: Obtain the layer information of the current row or column according to the arrangement order.

[0088] In one example, Figure 4As shown, the image information acquisition module includes: a judgment submodule (block_judge), a coordinate management submodule (coor_manager), an address management submodule (addr_manager), a request management submodule (req_manager), and a layer block arbitration submodule (arb). Coordinate management submodule: maintains the coordinate calculation of the background image (target image), including the horizontal and vertical coordinates of the background image, and is also used to maintain the coordinate calculation of the layer block relative to the background image. Judgment submodule: Each layer block has its own independent judgment submodule. The judgment submodule determines whether to request the layer information of the layer block from the memory based on the vertical coordinate information of the background image, and calculates the row of layer information of the requested layer block. Address management submodule: calculates the storage address information in the memory based on the coordinate information of the image. Request management submodule: responsible for generating memory access requests for the background image and memory access requests for different layer blocks. Layer block arbitration submodule: when there are multiple memory access requests for a layer block, the corresponding layer block is selected for memory access based on the position distribution relationship between the layer blocks.

[0089] Usually, the target image information and layer information are obtained by reading by row. Of course, it can also be read by column. Before reading, the judgment submodule (block_judge) needs to determine whether there is a layer block distributed in the current row. If there is no layer block distributed in the current row, according to the requirements of the image fusion algorithm, a row of target image information (for example, background image data) can be read from left to right. If there is a layer block distributed in the current row, in addition to reading the target image information of the current row, it is also necessary to read the layer information of multiple layer blocks distributed in the current row. The reading process is as follows Figure 5 shown.

[0090] In the layer block arbitration sub-module (arb): If there are layer blocks distributed in the current row, determine the arrangement order of each layer block according to the position distribution. Of course, it is also necessary to judge the overlapping situation that will pass through multiple layer blocks in the current row, and determine the display priority order of multiple layer blocks containing overlapping areas. Then, read the current row of layer blocks according to the arrangement order and the display priority order. As shown in Figure 6, for example, if the starting coordinate of block_i in the current row is less than the starting coordinate of block_j in the current row (start_i < start_j), then the layer information of block_i in the current row can be obtained first, written into the second storage module, and then the layer information of block_j in the current row can be obtained and written into the second storage module. For the layer block row, after reading a row of layer information, the read layer information can be stored, which can ensure the minimum amount of stored data. If there is an overlapping area between block_i and block_j, and the display priority of block_i is higher than that of block_j, then first read the layer information of block_j in the current row, and then read the layer information of block_i in the current row. In the overlapping area, the layer information of block_i covers the layer information of block_j.

[0091] In one implementation, the position information includes the recognition frame corresponding to the layer block, as well as the starting coordinate, ending coordinate, and storage address of the recognition frame in the target image. Step S133 includes:

[0092] Generate a read request when the read position falls within the range of the starting coordinate and the ending coordinate;

[0093] According to the read request and the storage address, obtain the layer information of the current row or column from the memory in the arrangement order, or

[0094] Generate the layer information of the current row or column in the recognition frame corresponding to the layer block.

[0095] In one example, in the request management module (req_manager): During the process of reading the current row, as Figure 6 shown, if the read y coordinate falls within the range of the starting coordinate and the ending coordinate of the layer block, generate a read request. In the coordinate management sub-module (coor_manager): During the process of reading the current row from left to right, send the storage address and the read request corresponding to the pixel points of the background image to the memory, and read the background image information at this address from the memory. Ordinate management: If there are no layer blocks in the current row that can be fused, then for the y coordinate of the background image, only need to add 1 to the y coordinate at the end of each row read, and read the background image of the next row. Abscissa coordinate management: As Figure 7As shown, in the current row, the length of the current row of the background image is 1919, which is stored in the first cache module. During the reading process, it is necessary to pass through layer block m (block_m) and layer block n (block_n). When layer block m (block_m) and layer block n (block_n) do not overlap, the coordinates jump directly from 0 to the starting coordinate _m to read the layer information, and the reading ends at the ending coordinate _m. Then, it jumps directly to the starting coordinate _n of the next layer block n, starts to read the layer information, and ends at the ending coordinate _n. Figure 8 As shown, when layer block m (block_m) and layer block n (block_n) overlap, read to the overlap to determine the priority of layer block m and layer block n. If the priority of layer block m is greater than that of layer block n, first read the layer information of layer block n with lower priority at the overlap, and then read the layer information of layer block m with higher priority at the overlap. If the priority of layer block m is less than that of layer block n, first read the layer information of layer block m with lower priority at the overlap, and then read the layer information of layer block n with higher priority at the overlap.

[0096] In one embodiment, it further includes:

[0097] Distributing target image information to a first storage module;

[0098] A bilinear interpolation operation is performed on the layer information corresponding to each layer block, and the layer information obtained after the operation is distributed to the second storage module.

[0099] In one example, considering the real-time performance and design complexity of the image display device, the size of the acquired layer block is scaled, and bilinear interpolation is usually used to scale the image. Since the interpolation point only depends on the surrounding four pixels, the interpolation operation only depends on two lines of image data at most.

[0100] In one embodiment, step S180 includes:

[0101] For multiple layer blocks including overlapping areas, the layer information corresponding to the layer block with the highest priority is distributed to the second storage module.

[0102] In one example, each layer block will use different spaces in the cache. When layer blocks overlap, the layer information of the layer block with higher priority is retained, and the historical layer information of the overlapping layer blocks is not saved. This is to avoid opening a cache for each layer block, which would cause the cache space to be too large. Only the layer information of the layer block that needs to be merged currently needs to be stored, and the storage space is relatively small.

[0103] In another specific embodiment, Fig. 9As shown, an image fusion device is provided, comprising:

[0104] The configuration information acquisition module 110 is used to acquire configuration information corresponding to the multiple layer blocks to be fused, and the configuration information includes position information of the layer blocks in the target image;

[0105] The layer block distribution determination module 120 is used to determine the position distribution of each layer block in the target image according to the configuration information;

[0106] The layer information acquisition module 130 is used to acquire the target image information corresponding to the target image, and acquire the layer information corresponding to each layer block according to the position distribution;

[0107] The image fusion module 140 is used to fuse the target image information with the layer information corresponding to each layer block to obtain a fused image.

[0108] In one embodiment, Fig.10 As shown, the configuration information also includes the display priority order of each layer block, and also includes:

[0109] An overlapping area determination module 150 is used to determine the overlapping area between each layer block according to the position distribution;

[0110] The priority information acquisition module 160 is used to acquire the layer information of each layer block in order from low to high according to the display priority sequence for multiple layer blocks including overlapping areas.

[0111] In one implementation, the layer information acquisition module 130 includes:

[0112] A target image information reading submodule, used for reading the target image information of the current row or column in the target image by row or column;

[0113] The arrangement order determination submodule is used to determine the arrangement order of each layer block according to the position distribution when there are layer blocks distributed in the current row or column;

[0114] The layer information reading submodule is used to read the layer information of the current row or column according to the arrangement order.

[0115] In one embodiment, the location information includes an identification box corresponding to the layer block, and the starting coordinates, ending coordinates and storage address of the identification box in the target image. The layer information reading submodule includes:

[0116] A read request generating unit, configured to generate a read request when the read position falls within the range of the start coordinate and the end coordinate;

[0117] The layer information reading unit is used to read the layer information of the current row or column from the memory in the arrangement order according to the read request and the storage address;

[0118] The layer information generating unit is used to generate the layer information of the current row or column in the identification frame corresponding to the layer block.

[0119] In one embodiment, it further includes:

[0120] A target image information distribution module, used for distributing the target image information to the first storage module;

[0121] The layer information distribution module is used to perform bilinear interpolation operation on the layer information corresponding to each layer block, and distribute the layer information obtained after the operation to the second storage module.

[0122] In one implementation, the layer information distribution module includes:

[0123] The highest priority information distribution submodule is used to distribute the layer information corresponding to the highest priority layer block to the second storage module for multiple layer blocks containing overlapping areas.

[0124] The functions of each module in each device in the embodiment of the present application can be found in the corresponding description in the above method, and will not be repeated here.

[0125] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0126] like Fig.11 , is a block diagram of an electronic device according to an image fusion method according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0127] like Fig.11As shown, the electronic device includes: one or more processors 1101, memory 1102, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are interconnected using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of a graphical user interface (GUI) on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig.11 A processor 1101 is taken as an example.

[0128] The memory 1102 is a non-transient computer-readable storage medium provided in the present application. The memory stores instructions executable by at least one processor to enable at least one processor to perform an image fusion method provided in the present application. The non-transient computer-readable storage medium of the present application stores computer instructions, which are used to enable a computer to perform an image fusion method provided in the present application.

[0129] The memory 1102, as a non-transient computer-readable storage medium, can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to an image fusion method in an embodiment of the present application. The processor 1101 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 1102, that is, implements an image fusion method in the above method embodiment.

[0130] The memory 1102 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created by the use of an electronic device according to an image fusion method, etc. In addition, the memory 1102 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 1102 may optionally include a memory remotely arranged relative to the processor 1101, and these remote memories may be connected to the above-mentioned electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0131] The electronic device may further include: an input device 1103 and an output device 1104. The processor 1101, the memory 1102, the input device 1103 and the output device 1104 may be connected via a bus or other means. Fig.11 The example of connecting through bus is taken in the following.

[0132] The input device 1103 can receive input digital or character information, and generate key signal input related to the user settings and function control of the above electronic device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator rod, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 1104 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.

[0133] Various implementations of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, application specific integrated circuits (ASICs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0134] These computer programs (also referred to as programs, software, software applications, or codes) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and / or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0135] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0136] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

[0137] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

[0138] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution disclosed in this application can be achieved, and this document does not limit this.

[0139] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. An image fusion method, characterized in that: include: Acquire configuration information corresponding to the multiple layer blocks to be fused, wherein the configuration information includes position information of the layer blocks in the target image, and the position information includes an identification box corresponding to the layer block, and a starting coordinate, an ending coordinate, and a storage address of the identification box in the target image; Determine the position distribution of each layer block in the target map according to the configuration information; Read the target image information of the current row or column in the target image by reading in rows or columns; In the case where the layer blocks are distributed in the current row or column, determining the arrangement order of each of the layer blocks according to the position distribution; When the reading position falls within the range of the starting coordinates and the ending coordinates, generating a read request; Reading the layer information of the current row or column from the memory in the arrangement order according to the read request and the storage address; The target image information and the layer information corresponding to each layer block are fused to obtain a fused image.

2. The method according to claim 1, characterized in that The configuration information also includes a display priority order of each layer block, and the method further includes: Determine the overlapping area between each of the layer blocks according to the position distribution; For a plurality of layer blocks including the overlapping area, the layer information of each layer block is acquired in order from low to high according to the display priority sequence.

3. The method according to claim 1, characterized in that Also includes: Distributing the target image information to a first storage module; A bilinear interpolation operation is performed on the layer information corresponding to each of the layer blocks, and the layer information obtained after the operation is distributed to the second storage module.

4. The method according to claim 3, characterized in that The step of distributing the layer information obtained after the operation to the second storage module includes: For multiple layer blocks including overlapping areas, the layer information corresponding to the layer block with the highest priority is distributed to the second storage module.

5. An image fusion device, characterized in that: include: A configuration information acquisition module is used to acquire configuration information corresponding to multiple layer blocks to be fused, wherein the configuration information includes position information of the layer blocks in the target image, and the position information includes an identification box corresponding to the layer block, and the starting coordinates, ending coordinates and storage address of the identification box in the target image; A layer block distribution determination module, used to determine the position distribution of each layer block in the target map according to the configuration information; The layer information acquisition module is used to: read the target image information of the current row or column in the target image by row or column; when the layer blocks are distributed in the current row or column, determine the arrangement order of each layer block according to the position distribution; When the read position falls within the range of the start coordinate and the end coordinate, a read request is generated; and according to the read request and the storage address, the layer information of the current row or column is read from the memory in the arrangement order; The image fusion module is used to fuse the target image information with the layer information corresponding to each layer block to obtain a fused image.

6. The device according to claim 5, characterized in that The configuration information also includes the display priority order of each layer block, and also includes: An overlapping area determination module, used for determining the overlapping area between each layer block according to the position distribution; For a plurality of layer blocks including the overlapping area, the layer information of each layer block is acquired in order from low to high according to the display priority sequence.

7. The device according to claim 5, characterized in that Also includes: A target image information distribution module, used for distributing the target image information to the first storage module; The layer information distribution module is used to perform bilinear interpolation operation on the layer information corresponding to each layer block, and distribute the layer information obtained after the operation to the second storage module.

8. The device according to claim 7, characterized in that The layer information distribution module includes: The highest priority information distribution submodule is used to distribute the layer information corresponding to the highest priority layer block to the second storage module for multiple layer blocks containing overlapping areas.

9. An electronic device, characterized in that: include: at least one processor; and a memory communicatively coupled to the at least one processor; The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1 to 4.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 4.