A multi-image non-overlapping display method and device

Abstract

The application discloses a multi-image non-overlapping display method and device, and relates to the field of image processing. After a plurality of images which need to be displayed on a preset picture are acquired, the images are arranged on the preset picture, and then the images are mapped to a preset two-dimensional coordinate system corresponding to the preset picture. Whether the images overlap with any other image is determined according to the positional relationship between the end point coordinates of the diagonal line of each image and the end point coordinates of the same diagonal line of all other images. If there is no image overlapping with any other image, all the images do not overlap with each other. If it is determined that the images overlap with each other, the images are outputted for display on the picture when the images do not overlap with each other. Whether the plurality of images overlap with each other can be determined simply and accurately by comparing the relationship between the end points of the diagonal lines of two images, so that the images of each image source can be normally displayed on the picture.

Description

Technical Field

[0001] This invention relates to the field of image processing, and in particular to a method and apparatus for displaying multiple images without overlap. Background Technology

[0002] For images or videos, multiple image sources may exist on a single screen. For example, multiple image or video windows can be opened simultaneously on a computer; these windows are called image sources, and the computer screen is the screen itself. Since the screen displays images by scanning each pixel line by line, if a pixel on the screen is covered by multiple image sources, the correct color cannot be displayed on that pixel. Therefore, it is necessary to arrange the images from each image source on the screen in a non-overlapping manner. After the processor arranges the images, existing technologies typically use the following two methods to determine whether images on the screen overlap:

[0003] 1. Determine if any vertex of an image is inside any other image. If all vertices of an image are not inside any other image, then the image does not overlap with any other image. However, this method does not take into account the different sizes of different images. If the long side of image A is shorter than the long side of image B, but the wide side of image A is longer than the wide side of image B, then image A may pass through image B and overlap with it, thus failing to completely avoid image overlap.

[0004] 2. Determine if any side of an image intersects with any side of any other image. If none of the edges of an image intersect with any side of any other image, then the image does not overlap with any other image. However, this method also does not take into account the different sizes of different images, and there may be a situation where image A is completely inside image B, so it cannot completely avoid the phenomenon of image overlap. Summary of the Invention

[0005] The purpose of this invention is to provide a method and apparatus for displaying multiple images without overlap, which can easily and accurately determine whether there is overlap between multiple images.

[0006] To address the aforementioned technical problems, this invention provides a method for non-overlapping display of multiple images, comprising:

[0007] Retrieve multiple images that need to be displayed on a preset screen;

[0008] After arranging the multiple images on the preset screen, all the multiple images are mapped to a preset two-dimensional coordinate system corresponding to the preset screen, where the vertical axis of the preset two-dimensional coordinate system is the y-axis and the horizontal axis is the x-axis.

[0009] For any one of the images, it is determined whether the image overlaps with any other image based on the positional relationship between the endpoint coordinates of the diagonal of the image and the endpoint coordinates of the same diagonal of all other images;

[0010] If no image overlaps with any other image, then it is determined that none of the multiple images overlap, and the multiple images are output to the preset screen for display.

[0011] Otherwise, it is determined that the images overlap with each other.

[0012] Preferably, determining whether an image overlaps with any other image based on the positional relationship between the endpoint coordinates of the diagonal of the image and the endpoint coordinates of the same diagonal of all other images includes:

[0013] S21: Sort the images according to a first preset order;

[0014] S22: Use the first image as the current image;

[0015] S23: Determine whether either the x-axis coordinate or the y-axis coordinate of the endpoint of the current image furthest from the origin of the preset two-dimensional coordinate system is less than the corresponding coordinate of the endpoint of all other images furthest from the origin of the preset two-dimensional coordinate system.

[0016] or,

[0017] Determine whether either the x-axis coordinate or the y-axis coordinate of the endpoint of the current image closest to the origin of the preset two-dimensional coordinate system is greater than the coordinate of the endpoint of all other images furthest from the origin of the preset two-dimensional coordinate system; if either determination is yes, proceed to S24; otherwise, proceed to the step of determining that there is an overlap between the images.

[0018] S24: Determine whether the current image is the second to last image. If yes, proceed to the step of determining that none of the multiple images overlap. If no, proceed to S25.

[0019] S25: Take the next image after the current image as the new current image, and take all images after the new current image as the new all other images, and return to S23.

[0020] Preferably, before mapping all the multiple images onto the preset two-dimensional coordinate system corresponding to the preset screen, the method further includes:

[0021] S31: Map all the multiple images onto a preset one-dimensional coordinate system corresponding to the preset screen to obtain line segments of the multiple images on the preset one-dimensional coordinate system;

[0022] S32: Sort the line segments according to the second preset order;

[0023] S33: Take the line segment described in the second clause as the current line segment;

[0024] S34: Determine whether the coordinates of the endpoint of the current line segment that is far from the origin of the preset one-dimensional coordinate system are less than the coordinates of the endpoints of all other line segments that are close to the origin of the preset one-dimensional coordinate system.

[0025] or,

[0026] Determine whether the coordinates of the endpoint of the current line segment that is closer to the origin of the preset one-dimensional coordinate system are greater than the coordinates of the endpoints of all other line segments that are farther from the origin of the preset one-dimensional coordinate system; if any of them are determined to be yes, proceed to S35; otherwise, proceed to the step of mapping all the multiple images onto the preset two-dimensional coordinate system corresponding to the preset screen.

[0027] S35: Determine whether the current line segment is the second to last line segment. If yes, proceed to the step of determining that the multiple images do not overlap with each other; otherwise, proceed to S36.

[0028] S36: Take the next line segment of the current line segment as the new current line segment, and take all the line segments after the new current line segment as the new all other line segments, and return to S34.

[0029] Preferably, the step of mapping all the multiple images onto a preset two-dimensional coordinate system corresponding to the preset screen includes:

[0030] The image corresponding to the current line segment and all images corresponding to the line segments after the current image are mapped onto the preset two-dimensional coordinate system.

[0031] Preferably, the direction of the preset two-dimensional coordinate system is consistent with the line-by-line scanning direction of the preset image.

[0032] Preferably, before outputting the plurality of images to the preset screen for display, the method further includes:

[0033] For any of the images, obtain all image frames output by the image source containing the image within a preset time period;

[0034] The plurality of images and all their corresponding image frames are mapped onto a preset three-dimensional coordinate system corresponding to the preset two-dimensional coordinate system to obtain rectangles of the plurality of images on the preset three-dimensional coordinate system. The vertical axis of the preset three-dimensional coordinate system is the y-axis, the horizontal axis is the x-axis, and the vertical axis is the time axis. The vertical and horizontal coordinates of all the image frames corresponding to the image are the same as those of the image, and the vertical coordinates correspond to the time obtained by each image frame.

[0035] When a new image is detected being inserted into the preset screen, the insertion time of the new image is determined;

[0036] The new image is mapped onto the preset three-dimensional coordinate system according to the insertion time point;

[0037] Determine whether the new image overlaps with any of the rectangles in the preset three-dimensional coordinate system;

[0038] If they overlap, it is determined that the images overlap with each other;

[0039] If they do not overlap, proceed to the step of outputting the multiple images to the preset screen for display.

[0040] Preferably, determining whether the new image overlaps with any of the rectangles in the preset three-dimensional coordinate system includes:

[0041] Determine whether the coordinates of the endpoint of the new image furthest from the origin of the preset 3D coordinate system are less than the coordinates of the endpoints of all rectangles closest to the origin of the preset 3D coordinate system.

[0042] or,

[0043] Determine whether the coordinates of the endpoint of the new image closest to the origin of the preset three-dimensional coordinate system are greater than the coordinates of the endpoints of all rectangles furthest from the origin of the preset three-dimensional coordinate system;

[0044] If any judgment is true, then it is determined that they do not overlap;

[0045] Otherwise, it is determined to be an overlap.

[0046] Preferably, after determining that the images overlap, the method further includes:

[0047] The steps are to rearrange the multiple images on the preset screen and return to the step of mapping all the multiple images onto the preset two-dimensional coordinate system corresponding to the preset screen.

[0048] Preferably, rearranging the plurality of images on the preset screen includes:

[0049] Among the multiple images, obtain the positions of all the images that are determined to be non-overlapping on the preset screen;

[0050] The preset screen is used as the new preset screen after removing all the screens that occupy the positions.

[0051] All the images identified as overlapping are rearranged on the new preset screen.

[0052] This application also provides a non-overlapping display device for multiple images, comprising:

[0053] Memory, used to store computer programs;

[0054] A controller is used to implement the steps of the non-overlapping display method for multiple images as described above when executing the computer program.

[0055] This application provides a method and apparatus for non-overlapping display of multiple images, relating to the field of image processing. After acquiring multiple images to be displayed on a preset screen, these images are arranged on the preset screen, and then mapped onto a preset two-dimensional coordinate system corresponding to the preset screen. The positional relationship between the endpoint coordinates of the diagonal of each image and the endpoint coordinates of the same diagonal of all other images is used to determine whether an image overlaps with any other image. If no image overlaps with any other image, then all images are considered non-overlapping; otherwise, images are considered to overlap. When images do not overlap, they are output for display on the screen. By comparing the relationship between the endpoints of the diagonals of two images, it is possible to easily and accurately determine whether multiple images overlap, ensuring that each image source can be displayed correctly on the screen. Attached Figure Description

[0056] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the prior art and embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0057] Figure 1 A flowchart illustrating a method for non-overlapping display of multiple images provided in this application;

[0058] Figure 2 This is a schematic diagram of an image that overlaps across the entire image.

[0059] Figure 3 This is a schematic diagram of an image containing overlap.

[0060] Figure 4A schematic diagram illustrating multiple non-overlapping images provided in this application;

[0061] Figure 5 This is a schematic diagram of the structure of a non-overlapping display device for multiple images provided in this application. Detailed Implementation

[0062] The core of this invention is to provide a method and apparatus for displaying multiple images without overlap, which can easily and accurately determine whether there is overlap between multiple images.

[0063] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0064] With the development of image and video technology, the required specifications and scenarios are becoming increasingly complex, especially when multiple image sources appear in a single frame. This situation requires the processor to simultaneously observe and verify all image sources. Since current image display technology uses progressive scan, its principle is to scan each pixel on the screen in a certain order, such as from top to bottom and from left to right. Based on the image source information at that pixel, the processor determines the corresponding color. When a pixel on the screen overlaps with other images, because two different image source information exist simultaneously at that pixel, the processor cannot control that pixel based on the image source information. This usually results in the pixel displaying an abnormal color, affecting the user's viewing experience. Therefore, it is necessary to constrain these images and ensure their integrity, that is, to ensure that each image source does not overlap with the others on the screen.

[0065] In existing technologies, image constraints are mainly implemented in two ways: one is point-based constraint, which determines whether the four vertices / endpoints of one image are inside another image, comparing each endpoint of each image with any other image; the other is edge-based constraint, which determines whether the four edges of one image intersect with any edge of another image, comparing each edge of each image with every edge of any other image. Based on this, assuming that each image has a completely identical shape, point-based constraints are feasible. However, when the image shapes are inconsistent—for example, one image has a long side and a short side while another image has a short side and a long side—point-based constraints can lead to errors where the two images intersect. Please refer to [reference needed]. Figure 2 , Figure 2This is a schematic diagram of overlapping images. Two images overlap to form a cross shape. Although none of the four vertices of the two images are inside the opposite image, they are actually overlapping. Similarly, if each image is exactly the same size, edge constraints are feasible. However, when the image sizes are different, such as when one image is a scaled-down version of another, edge constraints can result in one image being completely contained within the other. Please refer to [reference needed]. Figure 3 , Figure 3 This is a schematic diagram of an image containing overlap. Understandably, neither of these two existing techniques can guarantee that each image source will not overlap when used alone. When these two existing techniques are used simultaneously, the processor load will be significantly increased and efficiency will be reduced because both methods need to compare every edge or endpoint of the image.

[0066] To solve the above technical problems, please refer to Figure 1 , Figure 1 A flowchart of a method for non-overlapping display of multiple images provided in this application includes:

[0067] S1: Obtain multiple images that need to be displayed on the preset screen;

[0068] S2: After arranging multiple images on a preset screen, map all images onto a preset two-dimensional coordinate system corresponding to the preset screen. The vertical axis of the preset two-dimensional coordinate system is the y-axis, and the horizontal axis is the x-axis.

[0069] S3: For any image, determine whether the image overlaps with any other image based on the positional relationship between the coordinates of the endpoints of the image's diagonal and the coordinates of the endpoints of the same diagonal of all other images;

[0070] S4: If no image overlaps with any other image, then determine that the multiple images do not overlap with each other, and output the multiple images to the preset screen for display;

[0071] S5: Otherwise, determine that there is an overlap between the images.

[0072] A pre-defined two-dimensional coordinate system is established based on the screen size. This system can be based on two perpendicular edges of the screen as coordinate axes, with the intersection of these edges serving as the origin. After obtaining images from multiple image sources, these images are selected for display on the screen. The processor randomly arranges these images, and then determines whether any images overlap using a diagonal comparison. Specifically, the positive direction of a coordinate axis can be used to sort the images. For example, on the x-axis, the leftmost image is the first image. A specific endpoint of the first image is designated as the first endpoint, such as the top-left or bottom-right endpoint. Then, endpoints in the opposite direction of other images are determined for comparison. For instance, if the first endpoint is the bottom-right endpoint, the other endpoint on the same diagonal of another image is its top-left endpoint. The overlap of an image is determined by comparing its position with the opposite endpoints of other images. If the first endpoint is closer to the opposite direction than the opposite endpoints of other images, then that image is necessarily closer to the opposite direction than all other images and does not overlap with any other images. For example, in a pre-defined two-dimensional coordinate system, the x-axis runs from left to right and the y-axis runs from bottom to top. If the bottom right corner of an image is further to the left or top than the top left corner of all other images, it can be understood that the left or top corner of that image must also be further to the left or top than the other images. Therefore, it can be determined that this image does not overlap with any other image. Based on this, by sequentially determining the position of the diagonal endpoint of each image and the other endpoint of the same diagonal of other images, it is possible to easily and accurately determine whether there is any overlap between images in the screen. When it is determined that all images do not overlap with other images, these images can be output and displayed on the screen, ensuring that the images from each image source can be displayed correctly on the screen.

[0073] For example, please refer to Figure 4 , Figure 4 This is a schematic diagram of multiple non-overlapping images provided in this application. There are three images in the picture. When determining whether image 3 overlaps with image 1 and image 2, since the upper left endpoint of image 3 is further down than the lower right endpoint of image 1, and the upper left endpoint of image 3 is further to the right than the lower right endpoint of image 2, it can be determined that image 3 does not overlap with images 1 and 2.

[0074] In summary, after acquiring multiple images to be displayed on a preset screen, these images are arranged on the preset screen and then mapped onto a preset two-dimensional coordinate system corresponding to the preset screen. The positional relationship between the endpoint coordinates of the diagonal of each image and the endpoint coordinates of the same diagonal of all other images is used to determine whether an image overlaps with any other image. If no image overlaps with any other image, it is determined that all images do not overlap; otherwise, it is determined that images overlap. When images do not overlap, they are output for display on the screen. By comparing the relationship between the endpoints of the diagonal of two images, it is possible to easily and accurately determine whether there is overlap between multiple images, ensuring that the images from each image source can be displayed correctly on the screen.

[0075] Based on the above embodiments:

[0076] As a preferred embodiment, determining whether an image overlaps with any other image based on the positional relationship between the endpoint coordinates of the diagonal of one image and the endpoint coordinates of the same diagonal of all other images includes:

[0077] S21: Sort the images according to the first preset order;

[0078] S22: Set the first image as the current image;

[0079] S23: Determine whether either the x-axis coordinate or the y-axis coordinate of the endpoint of the current image that is furthest from the origin of the preset two-dimensional coordinate system is less than the corresponding coordinate of the endpoint of all other images that is furthest from the origin of the preset two-dimensional coordinate system.

[0080] or,

[0081] Determine whether either the x-axis coordinate or the y-axis coordinate of the endpoint of the current image closest to the origin of the preset two-dimensional coordinate system is greater than the coordinate of the endpoint of all other images furthest from the origin of the preset two-dimensional coordinate system; if either determination is yes, proceed to S24; otherwise, proceed to the step of determining that there is an overlap between images.

[0082] S24: Determine whether the current image is the second to last image. If yes, proceed to the step of determining that multiple images do not overlap. If no, proceed to S25.

[0083] S25: Take the next image after the current image as the new current image, and take all images after the new current image as the new all other images, and return to S23.

[0084] To simplify the determination of image overlap, this application maps the images to a two-dimensional coordinate system and then uses the position of coordinate points for judgment. If an endpoint of an image is closer to the opposite direction of all other images (e.g., the top-left corner of an image is further to the right or lower than the bottom-right corner of other images, or the bottom-right corner is further to the left or higher than the top-left corner of other images), then that image does not overlap with any other image. This method is used to sequentially judge each image. Furthermore, these images are sorted in a certain order, typically using the positive direction of a coordinate axis as the order. The image closest to or furthest from the origin of that axis is taken as the first image, and then the first image is used as the current image for judgment. After determining that the current image does not overlap, subsequent images will not be judged based on that image. That is, after judging the first image, the second image will only be compared with the third through the last image, the third image will only be compared with the fourth through the last image, and so on. By evaluating each image sequentially in this way, at least two images remain. Once the penultimate image has been evaluated, since only one image remains, there is no issue of image overlap, so the evaluation can terminate after that. If image overlap is detected, after proceeding to the step of confirming image overlap, the images can be rearranged for further evaluation. Based on this, it is possible to easily determine whether images overlap.

[0085] As a preferred embodiment, before mapping all the plurality of images onto the preset two-dimensional coordinate system corresponding to the preset screen, the method further includes:

[0086] S31: Map multiple images onto a preset one-dimensional coordinate system corresponding to a preset screen to obtain line segments of multiple images on the preset one-dimensional coordinate system.

[0087] S32: Sort the line segments according to the second preset order;

[0088] S33: Set the second line segment as the current line segment;

[0089] S34: Determine whether the coordinates of the endpoint of the current line segment that is far from the origin of the preset one-dimensional coordinate system are less than the coordinates of the endpoints of all other line segments that are close to the origin of the preset one-dimensional coordinate system.

[0090] or,

[0091] Determine whether the coordinates of the endpoint of the current line segment that is close to the origin of the preset one-dimensional coordinate system are greater than the coordinates of the endpoints of all other line segments that are far from the origin of the preset one-dimensional coordinate system; if any determination is yes, proceed to S35; otherwise, proceed to the step of mapping multiple images to the preset two-dimensional coordinate system corresponding to the preset screen.

[0092] S35: Determine whether the current line segment is the second to last line segment. If yes, proceed to the step of ensuring that all multiple images do not overlap. If no, proceed to S36.

[0093] S36: Take the next line segment of the current line segment as the new current line segment, and take all line segments after the new current line segment as the new all other line segments, then return to S34.

[0094] To more easily determine whether images overlap, this application first uses a simple one-dimensional angle for judgment. Specifically, the preset one-dimensional coordinate system can be a certain edge of the image as the coordinate axis, and a certain endpoint of this edge as the origin of the coordinate system. First, all images are mapped to the preset one-dimensional coordinate system to obtain the line segment of each image on the preset one-dimensional coordinate system. Taking the preset one-dimensional coordinate system as equal to the long side of the preset image as an example, the line segment of each image mapped to the preset one-dimensional coordinate system is equal to the long side of that image. When determining whether line segments overlap in a pre-defined one-dimensional coordinate system, since there is no second dimension, if an image does not overlap with any other image in one dimension, it means that no other image exists within the coordinate range of the vertical and horizontal axes of the two-dimensional coordinate system. Therefore, it can be determined without doubt that the image does not overlap with any other image. However, if an image overlaps with another image in one dimension, this may indicate an overlap in the two-dimensional coordinate system, or it may indicate the existence of multiple non-overlapping images on the same vertical or horizontal axis. For example, when two images are placed side-by-side at the same height, although they do not overlap in a two-dimensional angle, because their vertical axes are the same, they will be considered to overlap in a one-dimensional angle when the pre-defined one-dimensional coordinate system uses the vertical axis. Therefore, when an overlap is found in a one-dimensional angle, it cannot be directly determined that images overlap; instead, the two-dimensional angle must be checked again.

[0095] To easily determine whether line segments overlap, we can determine the coordinates of the two endpoints of each line segment in a predefined one-dimensional coordinate system. Then, we evaluate each line segment one by one according to a certain direction. If one endpoint of a line segment is more inclined towards that direction than the other endpoint of any other line segment, then this line segment does not overlap with any other line segment. For example, assuming the evaluation direction is from left to right, if the right endpoint of a line segment is more to the left than the left endpoints of all other line segments, or the left endpoint is more to the right than the right endpoints of all other line segments, then this line segment does not overlap with any other line segment. We evaluate each line segment sequentially in this way. Once the first line segment has been evaluated, it will not participate in subsequent evaluations. The second line segment will be evaluated against the third, and so on, up to the last line segment. The third line segment will only be compared with the fourth, and so on. In summary, this method provides a simple way to determine whether line segments overlap.

[0096] As a preferred embodiment, the step of mapping all the plurality of images onto a preset two-dimensional coordinate system corresponding to the preset screen includes:

[0097] Map the image corresponding to the current line segment and the images corresponding to all line segments after the current image onto the preset two-dimensional coordinate system.

[0098] To reduce computational load, in this application, since images that are determined not to overlap in the preset one-dimensional coordinate system will necessarily not overlap in the preset two-dimensional coordinate system, it would increase computational load and reduce efficiency if these images that are necessarily not to overlap were judged again in two dimensions. Therefore, only images that overlap in the preset one-dimensional coordinate system are judged in the subsequent two-dimensional dimensions to reduce computational load and improve efficiency.

[0099] In a preferred embodiment, the orientation of the preset two-dimensional coordinate system is consistent with the line-by-line scanning direction of the preset image.

[0100] To improve applicability, this application considers that progressive scan technology scans each pixel on the screen in a certain order, such as from top to bottom and from left to right. To synchronize with the scanning order of the pixels, the directions of both the preset two-dimensional coordinate system and the preset one-dimensional coordinate system can be set to be the same as the scanning direction of the progressive scan technology. This is advantageous because when progressive scan is from top to bottom and from left to right, the positive x-axis of the preset two-dimensional coordinate system is from left to right, the y-axis is from top to bottom, and the direction of the preset one-dimensional coordinate system is either from top to bottom or from left to right. Based on this, applicability can be improved.

[0101] As a preferred embodiment, before outputting the plurality of images to the preset screen for display, the method further includes:

[0102] For any given image, obtain all image frames output by the image source containing the image within a preset time period;

[0103] Multiple images and all their corresponding image frames are mapped onto a preset three-dimensional coordinate system corresponding to a preset two-dimensional coordinate system, resulting in rectangles of multiple images on the preset three-dimensional coordinate system. The vertical axis of the preset three-dimensional coordinate system is the y-axis, the horizontal axis is the x-axis, and the vertical axis is the time axis. The vertical and horizontal coordinates of all image frames corresponding to the image are the same as those of the image, and the vertical coordinates correspond to the time obtained by each image frame.

[0104] When a new image is detected being inserted into a preset frame, the insertion time of the new image is determined;

[0105] Map the new image to a preset three-dimensional coordinate system based on the insertion time point;

[0106] Determine whether the new image overlaps with any rectangle in the preset three-dimensional coordinate system;

[0107] If they overlap, it is determined that there is an overlap between the images;

[0108] If they do not overlap, proceed to the step of outputting multiple images to a preset screen for display.

[0109] Considering that image sources in practical applications are usually video sources, and users may add new images or watermarks to the screen at random times, it is necessary to determine in real time whether image overlap exists. Specifically, after confirming that each image on the screen does not overlap with the others, the image source continuously outputs image frames and displays them in their designated positions on the screen. Essentially, the x and y axes of the images output by the image source are fixed in a preset two-dimensional coordinate system. Images output at different times are added to the corresponding time coordinates in a preset three-dimensional coordinate system, forming a rectangle. As time progresses, the z-axis of the rectangle increases. If a user inserts a new image at a certain point in time, it can first determine whether each rectangle contains an image at that time. Then, in the preset three-dimensional coordinate system, the x and y coordinates of the four endpoints of the new image are compared with the x and y coordinates of the rectangles containing images at that time to determine whether an image is present.

[0110] As a preferred embodiment, determining whether the new image overlaps with any rectangle in a preset three-dimensional coordinate system includes:

[0111] Determine whether the coordinates of the endpoint furthest from the origin of the preset 3D coordinate system in the new image are less than the coordinates of the endpoints closest to the origin of the preset 3D coordinate system for all rectangles.

[0112] or,

[0113] Determine whether the coordinates of the endpoint of the new image closest to the origin of the preset 3D coordinate system are greater than the coordinates of the endpoints of all rectangles furthest from the origin of the preset 3D coordinate system;

[0114] If any judgment is true, then it is determined that they do not overlap;

[0115] Otherwise, it is judged as overlapping.

[0116] Considering that in practical applications, newly added images are usually at the beginning or end of the frame (e.g., in video, the intro or outro), a simple method to determine if a new image overlaps can be used. This method relies on two-dimensional judgment: if the farthest endpoint of the new image in a preset three-dimensional coordinate system is closer to the opposite endpoints of all rectangles (e.g., the top-left corner of the new image is further to the right, lower, or rear than the bottom-right corners of the rectangles, or the bottom-right corner is further to the left, higher, or forward than the top-left corners of the rectangles), then the new image will not overlap with any rectangle. This method also applies to comparing the rectangle formed by the new image with other rectangles. Based on this, it's easy to determine if a new image overlaps.

[0117] As a preferred embodiment, after determining that images overlap, the method further includes:

[0118] The steps involve rearranging multiple images on a preset screen and then mapping all the images onto a preset two-dimensional coordinate system corresponding to the preset screen.

[0119] To facilitate user operation and task automation, this application automatically shuffles the images upon detecting image overlap in the current image arrangement, randomly rearranging them on a preset screen. The process then restarts, re-evaluating for overlap. If overlap persists, the shuffling and random rearranging continue until no overlap is detected. Furthermore, if image overlap remains after multiple repetitions, the arrangement can be stopped, and a prompt can be issued to alert staff.

[0120] As a preferred embodiment, rearranging multiple images on a preset screen includes:

[0121] In multiple images, obtain the positions of all non-overlapping images on a preset screen;

[0122] Use the preset screen as the new preset screen, excluding all screens that occupy space.

[0123] Rearrange all the images identified as overlapping on a new preset screen.

[0124] To improve efficiency, this application addresses the need to rearrange images on the screen when overlapping is detected. Considering that rearranging all images would include those already determined not to overlap, potentially causing overlap after rearrangement, multiple rearrangements might be required to achieve a non-overlapping state, this application first locates the positions and areas of previously determined non-overlapping images on the screen. These positions are considered non-arrangeable locations on a preset screen, meaning subsequent images can only be arranged on the remaining portion of the preset screen after removing these non-arrangeable locations. During actual rearrangement, previously non-overlapping images retain their positions on the preset screen, while only overlapping images are rearranged. Furthermore, the rearranged area is limited to the area on the preset screen excluding non-arrangeable locations, thus preventing overlapping of previously determined non-overlapping images. Based on this, by excluding occupied positions and only rearranging images that are determined to overlap, the arrangement efficiency can be improved.

[0125] Please refer to Figure 5 , Figure 5 A schematic diagram of a non-overlapping display device for multiple images provided in this application includes:

[0126] Memory 21 is used to store computer programs;

[0127] The controller 22 is used to implement the steps of the non-overlapping display method of multiple images as described above when executing a computer program.

[0128] For a detailed description of the non-overlapping display device for multiple images provided in this application, please refer to the embodiments of the non-overlapping display method for multiple images described above; further details will not be repeated here.

[0129] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0130] It should also be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0131] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for non-overlapping display of multiple images, characterized by, include: Retrieve multiple images that need to be displayed on a preset screen; After arranging the multiple images on the preset screen, all the multiple images are mapped to a preset two-dimensional coordinate system corresponding to the preset screen, where the vertical axis of the preset two-dimensional coordinate system is the y-axis and the horizontal axis is the x-axis. For any one of the images, it is determined whether the image overlaps with any other image based on the positional relationship between the endpoint coordinates of the diagonal of the image and the endpoint coordinates of the same diagonal of all other images; If no image overlaps with any other image, then it is determined that none of the multiple images overlap, and the multiple images are output to the preset screen for display. Otherwise, it is determined that the images overlap with each other; Determining whether an image overlaps with any other image based on the positional relationship between the endpoint coordinates of the diagonal of the image and the endpoint coordinates of the same diagonal of all other images includes: S21: Sort the images according to a first preset order; S22: Use the first image as the current image; S23: Determine whether either the x-axis coordinate or the y-axis coordinate of the endpoint of the current image furthest from the origin of the preset two-dimensional coordinate system is less than the corresponding coordinate of the endpoint of all other images furthest from the origin of the preset two-dimensional coordinate system. or, Determine whether either the x-axis coordinate or the y-axis coordinate of the endpoint of the current image closest to the origin of the preset two-dimensional coordinate system is greater than the coordinate of the endpoint of all other images furthest from the origin of the preset two-dimensional coordinate system; if either determination is yes, proceed to S24; otherwise, proceed to the step of determining that there is an overlap between the images. S24: Determine whether the current image is the second to last image. If yes, proceed to the step of determining that none of the multiple images overlap. If no, proceed to S25. S25: Take the next image after the current image as the new current image, and take all images after the new current image as the new all other images, and return to S23.

2. The method for non-overlapping display of multiple images as described in claim 1, characterized in that, Before mapping all the multiple images onto the preset two-dimensional coordinate system corresponding to the preset screen, the process further includes: S31: Map all the multiple images onto a preset one-dimensional coordinate system corresponding to the preset screen to obtain line segments of the multiple images on the preset one-dimensional coordinate system; S32: Sort the line segments according to the second preset order; S33: Take the line segment described in the second clause as the current line segment; S34: Determine whether the coordinates of the endpoint of the current line segment that is far from the origin of the preset one-dimensional coordinate system are less than the coordinates of the endpoints of all other line segments that are close to the origin of the preset one-dimensional coordinate system. or, Determine whether the coordinates of the endpoint of the current line segment that is closer to the origin of the preset one-dimensional coordinate system are greater than the coordinates of the endpoints of all other line segments that are farther from the origin of the preset one-dimensional coordinate system; if any of them are determined to be yes, proceed to S35; otherwise, proceed to the step of mapping all the multiple images onto the preset two-dimensional coordinate system corresponding to the preset screen. S35: Determine whether the current line segment is the second to last line segment. If yes, proceed to the step of determining that the multiple images do not overlap with each other; otherwise, proceed to S36. S36: Take the next line segment of the current line segment as the new current line segment, and take all the line segments after the new current line segment as the new all other line segments, and return to S34.

3. The method for non-overlapping display of multiple images as described in claim 2, characterized in that, The step of mapping all the multiple images onto a preset two-dimensional coordinate system corresponding to the preset screen includes: The image corresponding to the current line segment and the images corresponding to all line segments after the current line segment are mapped onto the preset two-dimensional coordinate system.

4. The method for non-overlapping display of multiple images as described in claim 1, characterized in that, The orientation of the preset two-dimensional coordinate system is consistent with the line-by-line scanning direction of the preset image.

5. The method for non-overlapping display of multiple images as claimed in claim 1, characterized in that, Before outputting the plurality of images to the preset screen for display, the method further includes: For any of the images, obtain all image frames output by the image source containing the image within a preset time period; The plurality of images and all their corresponding image frames are mapped onto a preset three-dimensional coordinate system corresponding to the preset two-dimensional coordinate system to obtain rectangles of the plurality of images on the preset three-dimensional coordinate system. The vertical axis of the preset three-dimensional coordinate system is the y-axis, the horizontal axis is the x-axis, and the vertical axis is the time axis. The vertical and horizontal coordinates of all the image frames corresponding to the image are the same as those of the image, and the vertical coordinates correspond to the time obtained by each image frame. When a new image is detected being inserted into the preset screen, the insertion time of the new image is determined; The new image is mapped onto the preset three-dimensional coordinate system according to the insertion time point; Determine whether the new image overlaps with any of the rectangles in the preset three-dimensional coordinate system; If they overlap, it is determined that the images overlap with each other; If they do not overlap, proceed to the step of outputting the multiple images to the preset screen for display.

6. The method for non-overlapping display of multiple images as described in claim 5, characterized in that, Determining whether the new image overlaps with any of the rectangles in the preset three-dimensional coordinate system includes: Determine whether the coordinates of the endpoint of the new image furthest from the origin of the preset 3D coordinate system are less than the coordinates of the endpoints of all rectangles closest to the origin of the preset 3D coordinate system. or, Determine whether the coordinates of the endpoint of the new image closest to the origin of the preset three-dimensional coordinate system are greater than the coordinates of the endpoints of all rectangles furthest from the origin of the preset three-dimensional coordinate system; If any judgment is true, then it is determined that they do not overlap; Otherwise, it is judged as overlapping.

7. The method for non-overlapping display of multiple images as described in any one of claims 1 to 6, characterized in that, After determining that the images overlap, the process further includes: The steps are to rearrange the multiple images on the preset screen and return to the step of mapping all the multiple images onto the preset two-dimensional coordinate system corresponding to the preset screen.

8. The method for non-overlapping display of multiple images as described in claim 7, characterized in that, Rearranging the multiple images on the preset screen includes: Among the multiple images, obtain the positions of all the images that are determined to be non-overlapping on the preset screen; The preset screen is used as the new preset screen after removing all the screens that occupy the positions. All the images identified as overlapping are rearranged on the new preset screen.

9. A non-overlapping display device for multiple images, characterized in that, include: Memory, used to store computer programs; A controller for implementing the steps of the non-overlapping display method for multiple images as described in any one of claims 1 to 8 when executing the computer program.

Images