A distributed splicing display method, device and system
By determining the mode and adjusting the display area and frequency in the distributed splicing display system, the difficulty of setting the screen is solved, and the unified display effect is achieved in the mode, eliminating the overlap and color unevenness of the display area.
Patent Information
- Application Number
- CN202411200922.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-08-29
AI Technical Summary
The distributed splicing display system has difficulty setting the screen in the screen in different modes, especially in independent mode and linkage mode. It is necessary to solve the problem of display area position, display frequency and color adjustment to eliminate overlap and inhomogeneity.
By controlling the image acquisition screen of the image acquisition device, determine that the current mode is an independent mode or a linkage mode, adjust the display area position and display frequency according to the number of pictures or the position of the equipment, and adjust the color during the adaptive splicing process to form a unified picture.
It realizes effective settings for the screen in different modes, eliminates overlap and uneven color in the display area, unify the display frequency, and improves the display effect.
Smart Images

Figure CN118689584B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image display technology, and in particular to a distributed splicing display method, device and system. Background Art
[0002] The distributed splicing display system consists of a control device and distributed image acquisition devices. Each image acquisition device is fixedly installed to collect images or videos within the movable field of view and transmit them back to the control device. The control device is equipped with a centralized display screen, which is divided into several display areas. Each display area corresponds to an image acquisition device to achieve centralized display and management.
[0003] The images in each display area of the screen can be controlled and displayed independently, making it easy to operate each individual image, such as zooming in, positioning, etc.
[0004] At present, due to the existence of multiple display areas, the overall screen image can be displayed in each display area independently without interfering with each other, or the images of multiple display areas can be spliced into one image through an image splicing algorithm. Therefore, it is necessary to solve the problem of how to set the images on the screen in different modes in a distributed splicing display system. Summary of the invention
[0005] Based on this, it is necessary to provide a distributed splicing display method, device and system to address the above problems.
[0006] The embodiment of the present invention is implemented as follows: a distributed splicing display method, the distributed splicing display method comprising:
[0007] Control the image acquisition device to acquire images;
[0008] Determine whether the current mode is independent or linkage;
[0009] If the current mode is independent, the position of the display area corresponding to each screen is determined according to the number of screens;
[0010] According to the pixel change of each picture, the display frequency of the display area corresponding to each picture is adjusted respectively;
[0011] If the current mode is linkage mode, the position of the display area corresponding to each picture is determined according to the distribution position of the image acquisition device;
[0012] Adaptively splice all the images so that all the images form one image;
[0013] In the process of adaptive stitching, the color of each display area is adjusted according to the pixels of the characteristic objects in each picture;
[0014] The display frequency of all display areas is uniformly set according to the pixel changes of each picture;
[0015] Among them, there are several image acquisition devices and several acquired pictures.
[0016] In one embodiment, the present invention provides a distributed splicing display device, the distributed splicing display device comprising:
[0017] An image acquisition module is used to control the image acquisition device to acquire images;
[0018] A mode selection module is used to determine whether the current mode is independent mode or linkage mode;
[0019] A first area determination module, used for determining the position of the display area corresponding to each picture according to the number of pictures if the current mode is independent;
[0020] A first frequency adjustment module, used to adjust the display frequency of the display area corresponding to each picture according to the pixel change of each picture;
[0021] A second area determination module is used to determine the position of the display area corresponding to each picture according to the distribution position of the image acquisition device if the current mode is linkage mode;
[0022] A picture splicing module is used to adaptively splice all pictures so that all pictures form one picture;
[0023] A color adjustment module, used to adjust the color of each display area according to the pixels of the characteristic objects in each picture during the adaptive stitching process;
[0024] The second frequency adjustment module is used to uniformly set the display frequency of all display areas according to the pixel change of each picture;
[0025] Among them, there are several image acquisition devices and several acquired pictures.
[0026] In one of the embodiments, the present invention provides a distributed splicing display system, the distributed splicing display system comprising a plurality of image acquisition devices, a display device and a control device;
[0027] Each of the image acquisition devices is connected to the display device and the control device, and is used to acquire images;
[0028] The display device is connected to the control device and is used to display the collected images;
[0029] The control device is used to execute the steps of the above-mentioned distributed splicing display method.
[0030] A distributed splicing display method provided by an embodiment of the present invention controls an image acquisition device to acquire pictures; determines whether the current mode is an independent mode or a linkage mode; if the current mode is an independent mode, determines the position of a display area corresponding to each picture according to the number of pictures; adjusts the display frequency of the display area corresponding to each picture according to the pixel change of each picture; if the current mode is a linkage mode, determines the position of the display area corresponding to each picture according to the distribution position of the image acquisition device; adaptively splices all pictures so that all pictures form one picture; in the process of adaptive splicing, adjusts the color of each display area according to the pixels of a feature object in each picture; and uniformly sets the display frequency of all display areas according to the pixel change of each picture; wherein, there are a plurality of image acquisition devices and a plurality of acquired pictures. In this way, when the independent mode is determined, the position of the display area corresponding to each picture is set, and the display frequency of each display area is adjusted; when the linkage mode is determined, the position of the display area corresponding to each picture is set, all pictures are adaptively spliced to eliminate the overlap of some pictures, the color of each display area is adjusted to eliminate color unevenness, and the display frequency of all display areas is uniformly set to eliminate the situation of different display frequencies. This solves the problem of setting the pictures on the screen in different modes of the distributed splicing display system. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 is a flow chart of a distributed splicing display method in one embodiment;
[0032] Figure 2 A logic diagram of a distributed splicing display method in one embodiment;
[0033] Figure 3 is a structural block diagram of a distributed splicing display device in one embodiment;
[0034] Figure 4 is a structural block diagram of a distributed splicing display system in one embodiment;
[0035] Figure 5 This is a rendering of the effect of a distributed splicing display system on a control device;
[0036] Figure 6 FIG. 4 is a block diagram of the internal structure of a control device in one embodiment. DETAILED DESCRIPTION
[0037] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0038] It is understood that the terms "first", "second", etc. used in the present invention may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script without departing from the scope of the present invention.
[0039] like Figure 1 , Figure 2 As shown, in one embodiment, a distributed splicing display method is proposed, which may specifically include the following steps:
[0040] S101, controlling the image acquisition device to acquire images;
[0041] S102, determining whether the current mode is independent mode or linkage mode;
[0042] S103, if the current mode is independent, determine the position of the display area corresponding to each picture according to the number of pictures;
[0043] S104, adjusting the display frequency of the display area corresponding to each picture according to the pixel change of each picture;
[0044] S105, if the current mode is linkage mode, determining the position of the display area corresponding to each picture according to the distribution position of the image acquisition device;
[0045] S106, adaptively splicing all the pictures so that all the pictures form one picture;
[0046] S107, in the process of adaptive stitching, adjusting the color of each display area according to the pixels of the characteristic object in each picture;
[0047] S108, uniformly setting the display frequencies of all display areas according to the pixel changes of each picture;
[0048] Among them, there are several image acquisition devices and several acquired pictures.
[0049] In this embodiment, the image acquisition device may be a device with a camera function such as a surveillance camera. The image acquisition device is fixed when it is working, and the shooting angle of the image acquisition device will not be changed unless it is manually set.
[0050] In this embodiment, each image acquisition device acquires one picture.
[0051] In this embodiment, the independent mode means that the display of each screen does not interfere with each other, and can have different magnifications and frequencies. The linkage mode means that all screens need to be spliced into one screen through an image splicing algorithm, and generally the magnification and frequency of the screens are the same.
[0052] In this embodiment, under normal circumstances, the number of image acquisition devices is consistent with the number of display areas of the screen. For example, if the screen has a display area of 4*4, the number of image acquisition devices is 16. However, if the image acquisition device is damaged, resulting in a reduction in the displayed image, the area of the display area is adjusted to minimize the blank area of the screen.
[0053] In this embodiment, the independent mode allows the display frequency of the display area corresponding to each picture to be different. Generally speaking, the more the content of the picture changes, the faster the display frequency should be, otherwise ghosting, freezing and other phenomena will occur.
[0054] In this embodiment, the pixel change condition includes whether the pixel has changed and the number of changed pixels.
[0055] In this embodiment, the distribution position of the image acquisition device is determined by the actual position of the image acquisition device. The image acquisition device can be numbered to determine the distribution position. For example, if the shooting direction of the image acquisition device is the line of sight of the human eye, the image acquisition device located in the upper left corner is numbered as image acquisition device No. 1, and the numbers are numbered from small to large from left to right and from top to bottom.
[0056] In this embodiment, the type of feature object is not limited, and it can be any physical image with obvious outlines such as buildings and signboards, or it can be a feature point, such as a corner point or an edge.
[0057] In this embodiment, if the linkage mode is determined, since the images in different display areas are captured by different image acquisition devices, there may be a large difference in the color or display frequency of the two images. It is necessary to set the color and display frequency of each display area the same to make the difference between all images as small as possible.
[0058] A distributed splicing display method provided by an embodiment of the present invention controls an image acquisition device to acquire pictures; determines whether the current mode is an independent mode or a linkage mode; if the current mode is an independent mode, determines the position of a display area corresponding to each picture according to the number of pictures; adjusts the display frequency of the display area corresponding to each picture according to the pixel change of each picture; if the current mode is a linkage mode, determines the position of the display area corresponding to each picture according to the distribution position of the image acquisition device; adaptively splices all pictures so that all pictures form one picture; in the process of adaptive splicing, adjusts the color of each display area according to the pixels of a feature object in each picture; and uniformly sets the display frequency of all display areas according to the pixel change of each picture; wherein, there are a plurality of image acquisition devices and a plurality of acquired pictures. In this way, when the independent mode is determined, the position of the display area corresponding to each picture is set, and the display frequency of each display area is adjusted; when the linkage mode is determined, the position of the display area corresponding to each picture is set, all pictures are adaptively spliced to eliminate the overlap of some pictures, the color of each display area is adjusted to eliminate color unevenness, and the display frequency of all display areas is uniformly set to eliminate the situation of different display frequencies. This solves the problem of setting the pictures on the screen in different modes of the distributed splicing display system.
[0059] In one embodiment, determining whether the current mode is independent mode or linkage mode includes:
[0060] Get the user's settings;
[0061] Determine whether the user's settings are empty. If not, determine whether to use independent mode or linkage mode according to the user's settings;
[0062] If the user's setting is empty, set the screen association value i;
[0063] For each two adjacent pictures, determine whether there is the same feature object in the content of the two adjacent pictures. If yes, add 1 to i;
[0064] judge Is it greater than a preset ratio? If so, it is determined to be a linkage mode; if not, it is determined to be an independent mode;
[0065] Wherein, i is counted from 0, and N is the number of picture groups consisting of two adjacent pictures.
[0066] In this embodiment, the user's setting has the highest priority.
[0067] In this embodiment, if the user's setting is empty, it means that the user has not made any setting. At this time, it can be determined whether to determine the linkage mode based on the relevance of the content of the screen, that is, the feature object.
[0068] In this embodiment, every two adjacent pictures may be two pictures adjacent to each other in the left and right, or two pictures adjacent to each other in the top and bottom, or two pictures adjacent to each other in the corners.
[0069] In this embodiment, the preset ratio may be set to 50%.
[0070] In one embodiment, determining the position of the display area corresponding to each picture according to the number of pictures includes:
[0071] Determine whether n is 1, 2 or a composite number. If so, divide the screen equally into n rectangular areas according to n.
[0072] If n is not 1, 2 or a composite number, determine the composite number a that is greater than n and has the smallest difference with n. Divide the screen equally according to a to obtain several rectangular areas. Select a row of rectangular areas on the screen and determine the number m of rectangular areas in the row. Re-divide the m rectangular areas of the row to get A rectangular area;
[0073] Match each rectangular area with each picture one by one to obtain the position of the display area corresponding to each picture;
[0074] Wherein, n is the number of pictures.
[0075] In this embodiment, the division of the display area of the screen is generally related to the number of image acquisition devices. For example, if there are 8 image acquisition devices, there will be 8 display areas and 8 pictures. However, if one image acquisition device fails, there will be only 7 pictures left. At this time, the display area needs to be adjusted to 7 to make full use of the screen space and reduce the blank space on the screen.
[0076] In this embodiment, due to viewing habits, the length of the screen is generally greater than the width, so when dividing the rectangular area, the solution of columns being greater than rows is preferred. For example, the screen is divided into 8 rectangular areas, which can be 2 rows and 4 columns or 4 rows and 2 columns. The solution of 2 rows and 4 columns is generally adopted. The solution of 1 row and 8 columns or 8 columns and 1 row is not considered because the viewing quality of the pictures using these two solutions is poor. Similarly, for all n, the solution of 1 row and n columns or n columns and 1 row is generally not considered.
[0077] In this embodiment, for example, if n is 7, then the composite number a that is greater than n and has the smallest difference with n is determined to be 8, and the screen is divided equally into 8 rectangular areas. A 2-row 4-column scheme is adopted. If any row of rectangular areas on the screen is the last row of rectangular areas, the number m of the rectangular areas in the last row of the screen is determined to be 4, and the 4 rectangular areas in the last row are redivided equally to obtain 3 rectangular areas, thereby forming 4 identical rectangular areas in the upper row and 3 identical rectangular areas in the lower row, for a total of 7 rectangular areas.
[0078] In this embodiment, each rectangular area is a display area. Since it is an independent mode, it is only necessary to ensure that each rectangular area, that is, each display area, corresponds to one screen. Each rectangular area can be matched with each screen one by one according to the distribution position of the image acquisition device and the arrangement order of the rectangular areas, or it can be matched freely one by one.
[0079] In this embodiment, the arrangement order of the rectangular areas is to number the rectangular areas from left to right and then from top to bottom, and then number the display areas starting from 1. The first display area corresponds to image acquisition device No. 1, the second display area corresponds to image acquisition device No. 2, and so on. Simply put, the shooting direction of the image acquisition device is consistent with the line of sight of the human eye. The image acquisition device located in the upper left corner corresponds to the display area in the upper left corner of the screen, and the same applies to the remaining image acquisition devices. The distribution position setting of the image acquisition device is a fixed setting. For example, there are 8 image acquisition devices arranged in 2 rows and 4 columns, and the distance between adjacent image acquisition devices on the left and right or up and down is consistent.
[0080] In one embodiment, adjusting the display frequency of the display area corresponding to each picture according to the pixel change of each picture includes:
[0081] For each picture, determine the image of the current frame of the picture;
[0082] Get the image of the preset number of frames before the current frame;
[0083] Compare the pixels of the current frame image with the images of a preset number of frames before the current frame to obtain several image change rates;
[0084] Determine whether the obtained image change rates are all greater than a preset value, and if not, do not change the display frequency of the display area corresponding to the picture;
[0085] If the obtained image change rates are all greater than the preset value, then the average value x of the image change rates of the picture is calculated, and the value is obtained by Get the preset frequency of the picture;
[0086] Determine the display frequency of the picture according to the preset frequency of the picture and the frequency comparison table;
[0087] Determine the greatest common multiple of the display frequencies of all the pictures, and set the greatest common multiple as the display frequency of the screen;
[0088] For each picture, frame processing is performed on the picture according to the ratio of the greatest common multiple and the display frequency of the picture, thereby adjusting the display frequency of the display area corresponding to the picture;
[0089] Among them, k 1 is the minimum display frequency, k 2 is the maximum display frequency.
[0090] In this embodiment, the image change rate indicates the change of pixels in the picture. The more pixels in the picture change, the greater the image change rate.
[0091] In this embodiment, the preset number of frames may be 5-10 frames. If only the image of one frame before the current frame is taken for pixel comparison, there is a certain degree of randomness.
[0092] In this embodiment, pixel comparison is performed on the current frame image with images of a preset number of frames before the current frame, which means that pixel comparison is performed on the current frame image with an image of one frame before the current frame, and then pixel comparison is performed on the current frame image with an image of two frames before the current frame, and this process is repeated until the number of compared frames reaches the preset number of frames.
[0093] In this embodiment, pixel comparison is the comparison of the grayscale values of the same pixel in different frames. If the grayscale value does not change, the picture corresponding to the pixel does not change; if the grayscale value changes, the picture corresponding to the pixel changes. Therefore, the image change rate can be obtained by the ratio of the number of pixels whose grayscale values change to the total number of pixels in the picture. The total number of pixels in the picture here refers to a single picture, not the entire screen. A single picture is related to the corresponding display area.
[0094] In this embodiment, the preset value may be set to 10%. Only when the obtained image change rates are all greater than the preset value, the display frequency of the display area corresponding to the picture needs to be changed.
[0095] In this embodiment, the frequency of the picture is a software setting, and the display area belongs to the screen. The display frequency of the display area is a hardware setting. The two need to be adapted so that the frequency of the picture and the display frequency of the display area are consistent.
[0096] In this embodiment, generally speaking, the display frequency of the screen is between 60 Hz and 240 Hz. 1 Can be 60hz, k 2It can be 240hz.
[0097] In this embodiment, since the display frequency of the screen is generally a conventional setting, namely 60 Hz, 75 Hz, and 120 Hz, if the calculated pre-adjusted frequency is not these conventional settings, such as 119 Hz, then it will be troublesome to set it. Therefore, in order to reduce the difficulty of setting, the frequency of 1-60 Hz is compared with 60 Hz, the frequency of 60-75 Hz is compared with 75 Hz, and so on, to establish a frequency comparison table.
[0098] In this embodiment, a screen can only have one display video, but for the display area, the picture corresponding to the display area can be extracted or inserted to reduce or increase the display frequency of the display area. For example, the display frequency of the first picture is 60hz, and the display frequency of the second picture is 120hz, then the greatest common multiple is 120hz. For the first picture, the ratio is 2 times. The display frequency of the screen at this time is 120hz, that is, 120 frames of images are displayed in 1s, and the display frequency of the first picture is 60hz, that is, 60 frames of pictures are displayed in 1s. Therefore, the frame number processing is performed on the picture to adjust the display frequency of the display area corresponding to the picture, that is, only one frame of the image is displayed in every two frames in the display area where the first picture is located, or one frame is displayed every other frame. This is a frame extraction processing method. The display frequency of the display area corresponding to the picture is adjusted in this way.
[0099] In one embodiment, determining the position of the display area corresponding to each picture according to the distribution position of the image acquisition device includes:
[0100] Determine whether n is 1, 2 or a composite number. If so, divide the screen equally into n rectangular areas according to n.
[0101] If n is not 1 or 2 or a composite number, determine a composite number b that is greater than n and has the smallest difference with n, divide the screen equally into several rectangular areas according to b, and adjust the relative positions of the rectangular areas according to the relative positions of n and the image acquisition device corresponding to the screen;
[0102] According to the distribution position of the image acquisition device and the arrangement order of the rectangular areas, each rectangular area is matched with each picture one by one, so as to obtain the position of the display area corresponding to each picture;
[0103] Wherein, n is the number of pictures.
[0104] In this embodiment, for example, if n is 3, then the composite number a that is greater than n and has the smallest difference with n is determined to be 4, and the screen is divided equally into 4 rectangular areas, using a 2-row 2-column solution. The relative positions of the rectangular areas are adjusted according to the relative positions of n and the image acquisition devices corresponding to the screen, and only 3 rectangular areas are needed at this time. The relative positions of the image acquisition devices refer to the relative positions of the two image acquisition devices on the plane. For example, if image acquisition device No. 1 is to the left of image acquisition device No. 2 and at the upper left corner of image acquisition device No. 3, then the first rectangular area is to the left of the second rectangular area and at the upper left corner of the third rectangular area.
[0105] In this embodiment, each rectangular area is a display area. Since the linkage mode is selected, the smoothness of the overall image needs to be ensured, so the relative position of the rectangular area needs to be adjusted according to the relative position of the image acquisition device corresponding to the screen. For example, if there are three image acquisition devices and three screens, and the image acquisition devices are at the three vertices of a triangle, then the midpoints of the three rectangular areas should also be the three vertices of the triangle so that the three rectangular areas are distributed in a triangle.
[0106] In this embodiment, if the image acquisition device is damaged, adjusting the relative position of the rectangular area according to the relative position of the image acquisition device corresponding to the picture essentially means leaving the display area corresponding to the damaged image acquisition device blank.
[0107] In this embodiment, the arrangement order of the rectangular areas is to number the rectangular areas from left to right and then from top to bottom starting from 1. Since each rectangular area is a display area, the first display area, that is, the first rectangular area, corresponds to the first image acquisition device, the second display area corresponds to the second image acquisition device, and so on.
[0108] In one embodiment, the step of adaptively splicing all the pictures so that all the pictures form one picture includes:
[0109] S601, select the first picture, recorded as picture A;
[0110] S602, determining a picture B adjacent to the picture A;
[0111] S603, identifying the same feature objects in the pictures A and B, recording them as the same feature objects, and determining the geometric change relationship of the picture B with respect to the picture A based on the same feature objects;
[0112] S604, adjusting picture B according to the geometric change relationship to achieve image registration between picture B and picture A;
[0113] S605, determining the perpendicular line of the same feature object as the splicing line;
[0114] S606, stitching the picture A and the picture B into one picture from the stitching line by using an image stitching algorithm, and recording the picture as a new picture A;
[0115] S607, repeat S602-S606 until there is only one picture A on the screen.
[0116] In this embodiment, the first picture is the picture in the first display area. There are multiple pictures adjacent to picture A, so the selection of picture B adjacent to picture A can be based on the standard of first from left to right and then from top to bottom.
[0117] In this embodiment, the geometric change relationship includes rotation, scaling, translation, perspective transformation, affine transformation, projection transformation, three-dimensional space transformation, non-rigid transformation, etc. Calculating the geometric change relationship of picture B with respect to picture A is equal to calculating how many degrees picture B is rotated, how many times it is scaled, how much distance it is translated, etc. with respect to picture A, and the reference object is the same feature object in picture A and picture B, that is, the geometric change relationship of the same feature object of picture B with respect to the same feature object of picture A.
[0118] In this embodiment, there may be multiple identical feature objects in screen A and screen B. The multiple identical feature objects can be regarded as a whole to determine the geometric change relationship of screen B to screen A, or the identical feature object close to the center of screen A can be used to determine the geometric change relationship of screen B to screen A.
[0119] In this embodiment, if multiple identical feature objects are regarded as a whole, the splicing line is the perpendicular line of the whole. A minimum rectangle including the whole can be established, and then the perpendicular line of the minimum rectangle is determined as the perpendicular line of the whole. Similarly, for an identical feature object, a minimum rectangle including the identical feature object can be determined, and the perpendicular line of the minimum rectangle is determined as the perpendicular line of the identical feature object.
[0120] In this embodiment, there are multiple image stitching algorithms, such as multi-band blending, Poisson blending, etc.
[0121] In one embodiment, during the adaptive stitching process, adjusting the color of each display area according to the pixels of the feature object in each picture includes:
[0122] After the process of adjusting the picture B according to the geometric change relationship, the values of the three components of all pixels of the pictures A and B on the HSV color model are determined;
[0123] For picture A, determine the pixel area C corresponding to the same feature object in picture A;
[0124] For picture B, determine the pixel area D corresponding to the same feature object in picture B;
[0125] According to the same feature object, pixels in the pixel area C and the pixel area D are matched one to one to obtain a plurality of pixel groups;
[0126] For each pixel group, Get the adjustment value h of the first component of the two pixels in the pixel group j ,Depend on Get the adjustment value s of the second component of the two pixels in the pixel group j ,Depend on Get the adjustment value v of the two pixels in the pixel group on the third component j ;
[0127] Depend on Get the mean value E of the adjustment values of all pixel groups on the first component;
[0128] Depend on Get the mean F of the adjustment values of all pixel groups on the second component;
[0129] Depend on Obtain the mean G of the adjustment values of all pixel groups on the third component;
[0130] For each pixel in the picture A, subtract E from the first component of the pixel in the HSV color model to obtain a new first component, subtract F from the second component of the pixel in the HSV color model to obtain a new second component, and subtract G from the third component of the pixel in the HSV color model to obtain a new third component;
[0131] For each pixel in picture B, add E to the first component of the pixel in the HSV color model to obtain a new first component, add F to the second component of the pixel in the HSV color model to obtain a new second component, and add G to the third component of the pixel in the HSV color model to obtain a new third component;
[0132] Where j is the serial number of the pixel group, M is the number of pixel groups, and H 1 is the value of the first component of the pixel in the pixel group belonging to the pixel area C, S 1 is the value of the second component of the pixel in the pixel group belonging to the pixel area C, V 1 is the value of the third component of the pixel belonging to the pixel area C in the pixel group, H 2 is the value of the first component of the pixel in the pixel group belonging to the pixel area D, S 2is the value of the first component of the pixel in the pixel group belonging to the pixel area D, V 2 is the value of the first component of the pixels in the pixel group belonging to the pixel area D.
[0133] In this embodiment, the color adjustment may occur after the process of adjusting the picture B according to the geometric change relationship and before the pictures A and B are spliced together.
[0134] In this embodiment, HSV (Hue, Saturation, Value) is a color space created based on the intuitive characteristics of color, also known as the Hexcone Model. The HSV color system is an intuitive color model, and the three components of the HSV color model are hue (H), saturation (S), and brightness (V).
[0135] In this embodiment, all adjustment values may be positive or negative, and the obtained E, F, and G may also be positive or negative.
[0136] In one embodiment, the display frequencies of all display areas are uniformly set according to the pixel changes of each picture, including:
[0137] For each picture, determine the image of the current frame of the picture;
[0138] Get the image of the preset number of frames before the current frame;
[0139] Compare the pixels of the current frame image with the images of a preset number of frames before the current frame to obtain several image change rates;
[0140] Calculate the average value x of the change rates of several images of the picture;
[0141] Depend on Get the preset frequency of the picture;
[0142] Determine the average value of all pre-adjusted frequencies and record it as the adjustment frequency;
[0143] Determine the display frequency of the screen according to the adjustment frequency and the frequency comparison table;
[0144] Process the frame number of each picture according to the display frequency of the screen so as to uniformly adjust the display frequency of all display areas;
[0145] Among them, k 1 is the minimum display frequency, k 2 is the maximum display frequency.
[0146] In this embodiment, different from the independent mode, the display frequencies of all display areas in the linkage mode need to be consistent.
[0147] In this embodiment, generally speaking, the display frequency of the screen is between 60 Hz and 240 Hz. 1 Can be 60hz, k 2 It can be 240hz.
[0148] In this embodiment, since the display frequency of the screen is generally a conventional setting, namely 60 Hz, 75 Hz, and 120 Hz, if the calculated pre-adjusted frequency is not these conventional settings, such as 119 Hz, then it will be troublesome to set it. Therefore, in order to reduce the difficulty of setting, the frequency of 1-60 Hz is compared with 60 Hz, the frequency of 60-75 Hz is compared with 75 Hz, and so on, to establish a frequency comparison table.
[0149] In this embodiment, the frame number processing is performed on each picture according to the display frequency of the screen so as to uniformly adjust the display frequency of all display areas, which means that the frequency of each picture may be different, and each picture needs to be processed by frame extraction or frame insertion according to the display frequency. For example, if the frequency of the first picture is 60 Hz, the second picture is 240 Hz, and the display frequency of the screen is 120 Hz, then the first picture is processed by frame insertion so that the frequency of the first picture becomes 120 Hz, and the second picture is processed by frame extraction so that the frequency of the second picture becomes 120 Hz.
[0150] like Figure 3 As shown, in one embodiment, a distributed splicing display device is provided, which may specifically include:
[0151] An image acquisition module is used to control the image acquisition device to acquire images;
[0152] A mode selection module is used to determine whether the current mode is independent mode or linkage mode;
[0153] A first area determination module, used for determining the position of the display area corresponding to each picture according to the number of pictures if the current mode is independent;
[0154] A first frequency adjustment module, used to adjust the display frequency of the display area corresponding to each picture according to the pixel change of each picture;
[0155] A second area determination module is used to determine the position of the display area corresponding to each picture according to the distribution position of the image acquisition device if the current mode is linkage mode;
[0156] A picture splicing module is used to adaptively splice all pictures so that all pictures form one picture;
[0157] A color adjustment module, used to adjust the color of each display area according to the pixels of the characteristic objects in each picture during the adaptive stitching process;
[0158] The second frequency adjustment module is used to uniformly set the display frequency of all display areas according to the pixel change of each picture;
[0159] Among them, there are several image acquisition devices and several acquired pictures.
[0160] In this embodiment, each module of the distributed splicing display device is a modularization of the method part of the present invention. For the specific explanation of each module, please refer to the corresponding content of the method part of the present invention, and the embodiment of the present invention will not be repeated here.
[0161] like Figure 4 As shown, in one embodiment, a distributed splicing display system is provided, and the distributed splicing display system includes a plurality of image acquisition devices, a display device and a control device;
[0162] Each of the image acquisition devices is connected to the display device and the control device, and is used to acquire images;
[0163] The display device is connected to the control device and is used to display the collected images;
[0164] The control device is used to execute the steps of the above-mentioned distributed splicing display method.
[0165] In this embodiment, the image acquisition device transmits the acquired images to the control device, and the control device transmits the processed images to the display device for display.
[0166] In this embodiment, a distributed splicing display system on the control device is shown in FIG. Figure 5 shown.
[0167] A distributed splicing display system provided by an embodiment of the present invention controls an image acquisition device to acquire pictures; determines whether the current mode is an independent mode or a linkage mode; if the current mode is an independent mode, determines the position of a display area corresponding to each picture according to the number of pictures; adjusts the display frequency of the display area corresponding to each picture according to the pixel change of each picture; if the current mode is a linkage mode, determines the position of the display area corresponding to each picture according to the distribution position of the image acquisition device; adaptively splices all pictures so that all pictures form one picture; in the process of adaptive splicing, adjusts the color of each display area according to the pixels of a feature object in each picture; and uniformly sets the display frequency of all display areas according to the pixel change of each picture; wherein, there are a plurality of image acquisition devices and a plurality of acquired pictures. In this way, when the independent mode is determined, the position of the display area corresponding to each picture is set, and the display frequency of each display area is adjusted; when the linkage mode is determined, the position of the display area corresponding to each picture is set, all pictures are adaptively spliced to eliminate the overlap of some pictures, the color of each display area is adjusted to eliminate color unevenness, and the display frequency of all display areas is uniformly set to eliminate the situation of different display frequencies. This solves the problem of setting the pictures on the screen in different modes of the distributed splicing display system.
[0168] Figure 6 FIG. 2 shows an internal structure diagram of a control device in an embodiment. Figure 6 As shown, the control device includes a processor, a memory, a network interface, an input device and a display screen connected through a system bus. Among them, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the control device stores an operating system and may also store a computer program. When the computer program is executed by the processor, the processor can implement a distributed splicing display method provided by an embodiment of the present invention. The internal memory may also store a computer program. When the computer program is executed by the processor, the processor can execute a distributed splicing display method provided by an embodiment of the present invention. The display screen of the control device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the control device may be a touch layer covered on the display screen, or a button, trackball or touchpad provided on the housing of the control device, or an external keyboard, touchpad or mouse, etc.
[0169] Those skilled in the art will understand that Figure 6The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present invention, and does not constitute a limitation on the control device to which the scheme of the present invention is applied. The specific control device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0170] In one embodiment, a distributed splicing display device provided by an embodiment of the present invention can be implemented in the form of a computer program. The computer program can be used in Figure 6 The memory of the control device can store various program modules constituting the distributed splicing display device, for example, Figure 3 The computer program composed of the image acquisition module, mode selection module, first region determination module, first frequency adjustment module, second region determination module, picture splicing module, color adjustment module and second frequency adjustment module shown in the figure enables the processor to execute the steps of a distributed splicing display method of each embodiment of the present invention described in this specification.
[0171] For example, Figure 6 The control device shown can be Figure 3 The image acquisition module in the distributed splicing display device shown executes step S101; the control device may execute step S102 through the mode selection module; the control device may execute step S103 through the first area determination module; the control device may execute step S104 through the first frequency adjustment module; the control device may execute step S105 through the second area determination module; the control device may execute step S106 through the picture splicing module; the control device may execute step S107 through the color adjustment module; the control device may execute step S108 through the second frequency adjustment module.
[0172] In one embodiment, a control device is provided, the control device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:
[0173] S101, controlling the image acquisition device to acquire images;
[0174] S102, determining whether the current mode is independent mode or linkage mode;
[0175] S103, if the current mode is independent, determine the position of the display area corresponding to each picture according to the number of pictures;
[0176] S104, adjusting the display frequency of the display area corresponding to each picture according to the pixel change of each picture;
[0177] S105, if the current mode is linkage mode, determining the position of the display area corresponding to each picture according to the distribution position of the image acquisition device;
[0178] S106, adaptively splicing all the pictures so that all the pictures form one picture;
[0179] S107, in the process of adaptive stitching, adjusting the color of each display area according to the pixels of the characteristic object in each picture;
[0180] S108, uniformly setting the display frequencies of all display areas according to the pixel changes of each picture;
[0181] Among them, there are several image acquisition devices and several acquired pictures.
[0182] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor performs the following steps:
[0183] S101, controlling the image acquisition device to acquire images;
[0184] S102, determining whether the current mode is independent mode or linkage mode;
[0185] S103, if the current mode is independent, determine the position of the display area corresponding to each picture according to the number of pictures;
[0186] S104, adjusting the display frequency of the display area corresponding to each picture according to the pixel change of each picture;
[0187] S105, if the current mode is linkage mode, determining the position of the display area corresponding to each picture according to the distribution position of the image acquisition device;
[0188] S106, adaptively splicing all the pictures so that all the pictures form one picture;
[0189] S107, in the process of adaptive stitching, adjusting the color of each display area according to the pixels of the characteristic object in each picture;
[0190] S108, uniformly setting the display frequencies of all display areas according to the pixel changes of each picture;
[0191] Among them, there are several image acquisition devices and several acquired pictures.
[0192] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.
[0193] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0194] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0195] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention.
Claims
1. A distributed splicing display method, characterized in that: The distributed splicing display method comprises: Control the image acquisition device to acquire images; Determine whether the current mode is independent or linkage; If the current mode is independent, the position of the display area corresponding to each screen is determined according to the number of screens; According to the pixel change of each picture, the display frequency of the display area corresponding to each picture is adjusted respectively; If the current mode is linkage mode, the position of the display area corresponding to each picture is determined according to the distribution position of the image acquisition device; Adaptively splice all the images so that all the images form one image; In the process of adaptive stitching, the color of each display area is adjusted according to the pixels of the characteristic objects in each picture; The display frequency of all display areas is uniformly set according to the pixel changes of each picture; Among them, there are several image acquisition devices and several acquired pictures.
2. The distributed splicing display method according to claim 1, characterized in that: The determining whether the current mode is the independent mode or the linkage mode includes: Get the user's settings; Determine whether the user's settings are empty. If not, determine whether to use independent mode or linkage mode according to the user's settings; If the user's setting is empty, set the screen association value i; For each two adjacent pictures, determine whether there is the same feature object in the content of the two adjacent pictures. If yes, add 1 to i; judge Is it greater than a preset ratio? If so, it is determined to be a linkage mode; if not, it is determined to be an independent mode; Wherein, i is counted from 0, and N is the number of picture groups consisting of two adjacent pictures.
3. The distributed splicing display method according to claim 1, characterized in that: The step of determining the position of the display area corresponding to each picture according to the number of pictures comprises: Determine whether n is 1, 2 or a composite number. If so, divide the screen equally into n rectangular areas according to n. If n is not 1, 2 or a composite number, determine the composite number a that is greater than n and has the smallest difference with n. Divide the screen equally according to a to obtain several rectangular areas. Select a row of rectangular areas on the screen and determine the number m of rectangular areas in the row. Re-divide the m rectangular areas of the row to get A rectangular area; Match each rectangular area with each picture one by one to obtain the position of the display area corresponding to each picture; Wherein, n is the number of pictures.
4. The distributed splicing display method according to claim 1, characterized in that: The step of adjusting the display frequency of the display area corresponding to each picture according to the pixel change of each picture includes: For each picture, determine the image of the current frame of the picture; Get the image of the preset number of frames before the current frame; Compare the pixels of the current frame image with the images of a preset number of frames before the current frame to obtain several image change rates; Determine whether the obtained image change rates are all greater than a preset value, and if not, do not change the display frequency of the display area corresponding to the picture; If the obtained image change rates are all greater than the preset value, then the average value x of the image change rates of the picture is calculated, and the value is obtained by Get the preset frequency of the picture; Determine the display frequency of the picture according to the preset frequency of the picture and the frequency comparison table; Determine the greatest common multiple of the display frequencies of all the pictures, and set the greatest common multiple as the display frequency of the screen; For each picture, frame processing is performed on the picture according to the ratio of the greatest common multiple and the display frequency of the picture, thereby adjusting the display frequency of the display area corresponding to the picture; Among them, k1 is the minimum display frequency and k2 is the maximum display frequency.
5. The distributed splicing display method according to claim 1, characterized in that: The step of determining the position of the display area corresponding to each picture according to the distribution position of the image acquisition device comprises: Determine whether n is 1, 2 or a composite number. If so, divide the screen equally into n rectangular areas according to n. If n is not 1 or 2 or a composite number, determine a composite number b that is greater than n and has the smallest difference with n, divide the screen equally into several rectangular areas according to b, and adjust the relative positions of the rectangular areas according to the relative positions of n and the image acquisition device corresponding to the screen; According to the distribution position of the image acquisition device and the arrangement order of the rectangular areas, each rectangular area is matched with each picture one by one to obtain the position of the display area corresponding to each picture; Wherein, n is the number of pictures.
6. The distributed splicing display method according to claim 1, characterized in that: The step of adaptively splicing all the images so that all the images form one image includes: S601, select the first picture, recorded as picture A; S602, determining a picture B adjacent to the picture A; S603, identifying the same feature objects in the pictures A and B, recording them as the same feature objects, and determining the geometric change relationship of the picture B with respect to the picture A based on the same feature objects; S604, adjusting picture B according to the geometric change relationship to achieve image registration between picture B and picture A; S605, determining the perpendicular line of the same feature object as the splicing line; S606, stitching the picture A and the picture B into one picture from the stitching line by using an image stitching algorithm, and recording the picture as a new picture A; S607, repeat S602-S606 until there is only one picture A on the screen.
7. The distributed splicing display method according to claim 6, characterized in that: In the process of adaptive stitching, the color of each display area is adjusted according to the pixels of the characteristic objects in each picture, including: After the process of adjusting the picture B according to the geometric change relationship, the values of the three components of all pixels of the pictures A and B on the HSV color model are determined; For picture A, determine the pixel area C corresponding to the same feature object in picture A; For picture B, determine the pixel area D corresponding to the same feature object in picture B; According to the same feature object, pixels in the pixel area C and the pixel area D are matched one to one to obtain a plurality of pixel groups; For each pixel group, Get the adjustment value h of the first component of the two pixels in the pixel group j ,Depend on Get the adjustment value s of the second component of the two pixels in the pixel group j ,Depend on Get the adjustment value v of the two pixels in the pixel group on the third component j ; Depend on Get the mean value E of the adjustment values of all pixel groups on the first component; Depend on Get the mean F of the adjustment values of all pixel groups on the second component; Depend on Obtain the mean G of the adjustment values of all pixel groups on the third component; For each pixel in the picture A, subtract E from the first component of the pixel in the HSV color model to obtain a new first component, subtract F from the second component of the pixel in the HSV color model to obtain a new second component, and subtract G from the third component of the pixel in the HSV color model to obtain a new third component; For each pixel in picture B, add E to the first component of the pixel in the HSV color model to obtain a new first component, add F to the second component of the pixel in the HSV color model to obtain a new second component, and add G to the third component of the pixel in the HSV color model to obtain a new third component; Among them, j is the serial number of the pixel group, M is the number of pixel groups, H1 is the value of the first component of the pixels in the pixel group belonging to the pixel area C, S1 is the value of the second component of the pixels in the pixel group belonging to the pixel area C, V1 is the value of the third component of the pixels in the pixel group belonging to the pixel area C, H2 is the value of the first component of the pixels in the pixel group belonging to the pixel area D, S2 is the value of the first component of the pixels in the pixel group belonging to the pixel area D, and V2 is the value of the first component of the pixels in the pixel group belonging to the pixel area D.
8. The distributed splicing display method according to claim 1, characterized in that: The step of uniformly setting the display frequencies of all display areas according to the pixel changes of each picture includes: For each picture, determine the image of the current frame of the picture; Get the image of the preset number of frames before the current frame; Compare the pixels of the current frame image with the images of a preset number of frames before the current frame to obtain several image change rates; Calculate the average value x of the change rates of several images of the picture; Depend on Get the preset frequency of the picture; Determine the average value of all pre-adjusted frequencies and record it as the adjustment frequency; Determine the display frequency of the screen according to the adjustment frequency and the frequency comparison table; Process the frame number of each picture according to the display frequency of the screen so as to uniformly adjust the display frequency of all display areas; Among them, k1 is the minimum display frequency and k2 is the maximum display frequency.
9. A distributed splicing display device, characterized in that: The distributed splicing display device comprises: An image acquisition module is used to control the image acquisition device to acquire images; A mode selection module is used to determine whether the current mode is independent mode or linkage mode; A first area determination module, used for determining the position of the display area corresponding to each picture according to the number of pictures if the current mode is independent; A first frequency adjustment module, used to adjust the display frequency of the display area corresponding to each picture according to the pixel change of each picture; A second area determination module is used to determine the position of the display area corresponding to each picture according to the distribution position of the image acquisition device if the current mode is linkage mode; A picture splicing module is used to adaptively splice all pictures so that all pictures form one picture; A color adjustment module, used to adjust the color of each display area according to the pixels of the characteristic objects in each picture during the adaptive stitching process; The second frequency adjustment module is used to uniformly set the display frequency of all display areas according to the pixel change of each picture; Among them, there are several image acquisition devices and several acquired pictures.
10. A distributed splicing display system, characterized in that: The distributed splicing display system includes several image acquisition devices, display devices and control devices; Each of the image acquisition devices is connected to the display device and the control device, and is used to acquire images; The display device is connected to the control device and is used to display the collected images; The control device is used to execute the steps of the distributed splicing display method described in any one of claims 1 to 8.
Citation Information
Patent Citations
Screen control method, control terminal, screen and computer readable storage medium
CN114035759A
Positioning method and device of image acquisition equipment, storage medium and electronic equipment
CN114758120A
Image display system and image display method
US20210241717A1
