System and method for realizing distributed seat free layout

Abstract

The invention belongs to the technical field of seat management, particularly relates to a distributed seat free layout implementation system and method, and aims to solve the problems that a pre-designed layout is not high in flexibility, the user interaction experience is not high, and pictures in the layout are tiled, cannot be displayed in an overlapped manner and are not layered. The method comprises the following steps: each signal source is coded into network streaming media through a corresponding coding node and is sent to a seat node through a network, a restored signal source is output, a UI module selects the network streaming media to be displayed through a displayed UI interface, free layout is carried out in a canvas area, layout list information is sent to a video output module, and the video output module outputs the layout list information. And according to the layout list information, synthesizing the restored signal source into an image, and outputting the image to the display for display. According to the method, flexible and free layout can be realized, the user interaction experience is improved, a plurality of video windows can be arranged for overlapping display, Z-sequence pictures can be adjusted and overlapped, and the layering sense is realized.

Description

Technical Field

[0001] The invention belongs to the technical field of seat management, and in particular relates to a system and method for realizing free layout of distributed seats. Background Art

[0002] In distributed video surveillance, video conferencing, distance education and other multi-channel video application software, various video layout methods are often seen. The video layout method presents a checkerboard cutting mode. By defining the number of columns and rows of the checkerboard (such as xDiv and yDiv), it is determined how many basic units the panel is cut into. These layouts are usually preset layouts such as single screen, 4 screens, 9 screens, 16 screens, 1 large and 5 small, etc. During use, just click the layout to apply.

[0003] The preset layout has the following defects in actual use: 1. The pre-designed (chessboard cutting) layout is not very flexible. Usually, only single-screen, 4-screen, 9-screen layouts are available, which cannot meet the user's customized needs; 2. The user interaction experience is not good. It is impossible to draw the screen window, drag and drop to adjust the window size, position and Z order; 3. The screen is in a tiled layout, the screen cannot be displayed in an overlapping manner, and the screen has no sense of hierarchy. Summary of the invention

[0004] In order to solve the above problems in the prior art, namely, the pre-designed layout has low flexibility, the user interaction experience is low, and the layout screen is flat, cannot be superimposed and has no sense of hierarchy, the first aspect of the present invention proposes a distributed seat free layout implementation system, the system includes: a signal source, an encoding node, a network, a seat node, and a display; the seat node includes a decoding module, a UI module, and a video output module; Each signal source is encoded into a network streaming media by a corresponding encoding node and sent to the seat node through the network; The UI module receives a stream selection instruction input by a user through a displayed UI interface, selects a network streaming media to be displayed, and freely lays out the pre-displayed windows of the selected network streaming media in a canvas area on the UI interface, and sends the layout list information to the video output module; The decoding module decodes the selected network streaming media and outputs a restored signal source; The video output module synthesizes an image according to the layout list information and the restored signal source, and outputs the image to the display for display, and the process is as follows: The video output module receives the layout list information; the layout list is a list of all video window information freely laid out on the UI interface; the video window information includes X coordinate, Y coordinate, width, height, transparency, and Z order; Determine the video window display position according to the X coordinate, Y coordinate, width, and height in the layout list information, and calculate the overlap area O and non-overlap area between the video windows; For each pixel in the overlapped area O, the fused pixel value is calculated according to the transparency and Z order of the multiple video windows at the pixel position; For the non-overlapping area, directly drawing the pixel value of the corresponding video window according to the layout list information; The images of the multiple video windows after pixel value processing and the restored signal source are combined to form a composite image, which is displayed on the display.

[0005] In some preferred embodiments, the fused pixel value is: ; In the formula, Alpha_i is the picture transparency of the i-th video window; R_i, G_i, B_i are the RGB pixel values ​​of the picture of the i-th video window respectively; O_R_(i-1), O_G_(i-1), O_B_(i-1) are the RGB pixel values ​​of the picture of the i-1-th video window after superposition; O_Alpha_(i-1) represents the transparency value of the picture of the i-1-th video window after superposition; O_R_i, O_G_i, O_B_i represent the RGB pixel values ​​of the picture of the i-th video window after superposition.

[0006] In some preferred implementations, the video window draws the screen in Z order during free layout, and also includes frame extraction and frame insertion processing during the screen drawing; Obtaining a frame number in an output resolution of the display as a first frame number; According to the layout list information, the frame number of input frames of each screen drawn by the video window corresponding to the selected network streaming media is obtained as the second frame number; If the first frame number is lower than the second frame number, a frame extraction process is performed on the corresponding picture, wherein the frame extraction process is as follows: a timer is triggered to obtain an input frame once at a countdown time interval of the first frame number, the obtained input frame is placed into a timer to-be-obtained frame area in a manner of being covered by a countdown time interval of the second frame, and any unobtained input frame received at a non-triggering time of the timer is discarded; If the first frame number is higher than the second frame number, performing frame insertion processing on the corresponding picture; The interpolation processing is as follows: putting the output frame of the corresponding picture into the memory as a memory frame; triggering the timer to obtain a memory frame once every countdown time of the first frame number, if the memory frame is not updated, displaying the previous frame, otherwise, displaying the updated memory frame.

[0007] The second invention of the present invention provides a method for implementing the distributed seat free layout, comprising the following steps: When a mouse press event is detected, the coordinates of the mouse in the canvas area are obtained as original coordinates; Determine whether the original coordinates are located in each video window. If not, generate a dynamic rectangular frame by combining the coordinates after the mouse is moved and the original coordinates; based on the dynamic rectangular frame, draw the A color frame, the B color frame and the screen of the video window at the same time. If yes, change the Z order of the clicked video window to the front and display the screen of the video window; the A color frame and the B color frame are both dynamic rectangular frames whose colors are set according to the resolution of the dynamic rectangular frame; When the dynamic rectangular frame is a B color frame and a mouse release event is detected, the picture drawing of the current video window is completed; After drawing is completed, close the color display of the A color box and the B color box, and obtain the validity of the current video window; if the current video window is a valid window, display the picture of the video window, and save the window information to the layout list as the layout list information; if the current video window is not a valid window, end directly.

[0008] In some preferred implementations, the color of the dynamic rectangular frame is set according to the resolution of the dynamic rectangular frame, and the method is: Detecting the resolution of the dynamic rectangular frame and comparing the resolution with a preset threshold M, if the resolution is less than the threshold M, setting the color of the dynamic rectangular frame to color A; If it is greater than or equal to M, the color of the dynamic rectangular frame is set to color B.

[0009] In some preferred embodiments, when there are multiple video windows, the multiple video windows include multiple overlapping video windows and multiple non-overlapping video windows; The Z order of the multiple superimposed video windows can be adjusted by a mouse click event on the video window.

[0010] In some preferred implementations, re-layout may be performed after free layout, and the re-layout includes: Adjusting the size of the window after free layout, including reconfiguring the width and height in the video window information saved in the UI interface; Or, on the video window saved in the UI interface, the width and height of the video window are changed based on mouse events; the mouse events include click events, press events, and move events; In some preferred embodiments, the rearrangement further comprises: Adjust the free layout window position, including reconfiguring the X and Y coordinates in the saved video window information in the UI interface; Or, on a video window saved in the UI interface, the position of the video window is changed based on mouse events; the mouse events include click events, move events, and mouse release events.

[0011] Beneficial effects of the present invention: 1. On the preset canvas of distributed seats, you can flexibly and freely layout the windows. You can use the mouse to freely layout the windows, drag the window position, and adjust the window size, which increases the operability and practicality of the user interaction process and bids farewell to the monotony of the traditional chessboard-type layout; 2. In the free layout preset canvas, multiple video windows can be laid out, and the screens are drawn in Z order according to the layout list information. When drawing the screen, frame extraction and frame insertion processing are also included. The input frames of each screen drawn by the video window are consistent with the number of frames in the output resolution of the display. They can be superimposed and displayed with a sense of hierarchy. When multiple windows are superimposed, the superimposed Z order of the free layout windows can be freely adjusted; 3. The free layout window can provide color prompts when it exceeds the output resolution limit. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings: Figure 1 It is a structural block diagram of a distributed seat free layout implementation system of the present invention; Figure 2 It is a free layout step diagram of a method for implementing free layout of distributed seats of the present invention; Figure 3 It is a Z-sequence adjustment step diagram of a method for implementing a distributed seat free layout of the present invention; Figure 4 It is a mouse pressing event diagram of a method for implementing a distributed seat free layout of the present invention; Figure 5 It is a mouse movement event diagram of a method for implementing a distributed seat free layout of the present invention; Figure 6 It is a mouse release event diagram of a method for implementing a distributed seat free layout of the present invention; Figure 7It is a diagram of steps for adjusting the size of a free layout window after free layout of a distributed seat free layout implementation method of the present invention; Figure 8 It is a step diagram of adjusting the position of the free layout window after free layout of a distributed seat free layout implementation method of the present invention; Fig. 9 It is a schematic diagram of a UI module saving an output layout list to a video output module in a method for implementing a distributed seat free layout of the present invention. DETAILED DESCRIPTION

[0013] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0014] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0015] In order to more clearly illustrate a method for implementing a distributed seat free layout of the present invention, the following is combined with Figures 1 to 9 Each step in the embodiment of the present invention is described in detail.

[0016] A distributed seat free layout implementation system of the first embodiment of the present invention, see Figure 1 The system includes a signal source, an encoding node, a network, an agent node, and a display. The agent node includes a decoding module, a UI module, and a video output module; Each signal source is encoded into a network streaming media by a corresponding encoding node and sent to the seat node through the network; The UI module receives a stream selection instruction input by a user through a displayed UI interface, selects a network streaming media to be displayed, and freely lays out the pre-displayed windows of the selected network streaming media in a canvas area on the UI interface, and sends the layout list information to the video output module; The decoding module decodes the selected network streaming media and outputs a restored signal source; The video output module synthesizes an image according to the layout list information and the restored signal source, and outputs the image to the display for display; In this embodiment, the encoding node is a device that encodes the video signal input by the common video interface HDMI and DVI into a network streaming media signal; Seat node: a device that selects multiple network streaming media through the UI interface, decodes them into images and outputs them to the back-end display; The video output module synthesizes an image according to the layout list information and the restored signal source, and outputs the image to the display for display, and the process is as follows: The video output module receives the layout list information; the layout list is a list of all video window information freely laid out on the UI interface; the video window information includes X coordinate, Y coordinate, width, height, transparency, and Z order; This embodiment takes the case where three video windows A, B, and C are superimposed and displayed in a free layout as an example, and determines the display position of the video window according to the X coordinate, Y coordinate, width, and height in the layout list information, and calculates the overlap area O and non-overlap area between the video windows; For each pixel in the overlapped area O, the fused pixel value is calculated according to the transparency and Z order of the multiple video windows at the pixel position, and the pixel value of the corresponding video window is drawn according to the fused pixel value. In this embodiment, the transparency of the image A, image B and image C corresponding to the three video windows A, B and C are Alpha_A, Alpha_B and Alpha_C respectively (the value range is 0 to 1, 1 means completely opaque, and 0 means completely transparent). The fused pixel value is: ; Wherein, Alpha_i is the transparency of the i-th video window; R_i, G_i, B_i are the RGB pixel values ​​of the i-th video window; O_R_(i-1), O_G_(i-1), O_B_(i-1) are the RGB pixel values ​​of the i-th video window after superposition; O_Alpha_(i-1) represents the transparency value of the i-th video window after superposition, and is calculated according to the Z sequence by descending the picture (i represents the picture sequence number of the video window, starting from 1 to 3, corresponding to the descending order of images C, B, and A); O_R_i, O_G_i, O_B_i represent the RGB pixel values ​​of the i-th video window after superposition; For the non-overlapping area, directly drawing the pixel value of the corresponding video window according to the layout list information; Combining the images of the plurality of video windows after pixel value processing and the restored signal source to synthesize an image, and displaying the image on the display; In free layout, the video window draws the screen in Z order, and also includes frame extraction and frame insertion processing; Obtaining a frame number in an output resolution of the display as a first frame number; According to the layout list information, the frame number of input frames of each screen drawn by the video window corresponding to the selected network streaming media is obtained as the second frame number; If the first frame number is lower than the second frame number, a frame extraction process is performed on the corresponding picture, wherein the frame extraction process is as follows: a timer is triggered to obtain an input frame once at a countdown time interval of the first frame number, the obtained input frame is placed into a timer to-be-obtained frame area in a manner of being covered by a countdown time interval of the second frame, and any unobtained input frame received at a non-triggering time of the timer is discarded; If the first frame number is higher than the second frame number, performing frame insertion processing on the corresponding picture; The interpolation process is as follows: putting the output frame of the corresponding picture into the memory as a memory frame; triggering the timer to obtain the memory frame once every countdown time of the first frame number, and if the memory frame is not updated, displaying the previous frame, otherwise, displaying the updated memory frame; The following is a detailed explanation with examples: When the output resolution of the back-end display is 1920*1080-60 frames, and the picture input of window A in the free layout is 25 frames (less than 60 frames), it is necessary to insert frames of the picture of window A to make up 25 frames to 60 frames; when the output of the back-end display is 30 frames and the picture input of window A is 60 frames, it is necessary to extract frames of picture A to extract 60 frames into 30 frames to ensure that the picture frame rate of all window inputs is consistent with the output frame rate; Internally, the output frames of window A are placed in the memory to be submitted. When window A inputs 25 frames and outputs 60 frames, the timer is started to obtain the memory frame every 1s / 60 = 16666us. Only when the memory updates the picture will the output be updated synchronously, otherwise the previous frame will be played repeatedly. When window A inputs 60 frames and outputs 30 frames, the timer obtains the input frame in 1s / 30 = 33333us, and the input frame that is not obtained is discarded, thereby realizing dynamic frame extraction and insertion operations.

[0017] It should be noted that the above embodiment provides a distributed seat free layout implementation system, which is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the modules or steps in the embodiments of the present invention can be decomposed or combined. For example, the modules in the above embodiments can be combined into one module, or further divided into multiple sub-modules to complete all or part of the functions described above. The names of the modules and steps involved in the embodiments of the present invention are only for distinguishing the modules or steps, and are not regarded as improper limitations of the present invention.

[0018] A method for implementing a distributed seat free layout according to the second embodiment of the present invention is shown in Figure 4-Figure 6 , including the following steps: When a mouse press event is detected, the coordinates of the mouse in the canvas area are obtained as original coordinates; Determine whether the original coordinates are located within each video window. If not, generate a dynamic rectangular frame by combining the coordinates after the mouse is moved and the original coordinates; based on the dynamic rectangular frame, draw the A color frame, the B color frame and the screen of the video window at the same time. The A color frame and the B color frame are both dynamic rectangular frames whose colors are set according to the resolution of the dynamic rectangular frame. In the process of drawing the video window, the coordinate displacement relative to the original coordinates and the rectangular frame color are displayed in real time when the mouse moves. The rectangular frame color is used to limit the display window resolution to exceed M. During the movement, the switching of color A and color B is involved; when the dynamic rectangular frame is the B color frame and a mouse release event is detected, the screen drawing of the current video window is completed, free layout is realized, and a highlighted white rectangular frame will be displayed. At this time, the rectangular information will be displayed inside the rectangular frame, including X coordinate, Y coordinate, width, height, and transparency information; Specifically, the resolution of the dynamic rectangular frame is detected and compared with a preset threshold value M. If the resolution is less than M, the color of the dynamic rectangular frame is set to color A; if the resolution is greater than or equal to M, the color of the dynamic rectangular frame is set to color B. The steps of the video window free layout operation are as follows: Figure 2 As shown, in the UI interface, a mouse click event is made on the free layout button, and the UI interface generates a canvas area; based on the mouse press event, the original coordinates are obtained; based on the original coordinates and the mouse move event, a dynamic rectangular frame appears, and the video window is freely drawn; based on the mouse release event, the dynamic rectangular frame is a B color frame, and the free drawing of the video window is completed; If so, the Z order of the clicked video window is changed to the front, and the screen of the video window is displayed. Specifically, when there are multiple video windows, the multiple video windows include multiple overlapping video windows and multiple non-overlapping video windows; the multiple overlapping video windows can adjust the Z order of each video window by clicking the mouse on the video window. The operation steps are as follows: Figure 3 As shown in the figure, when there are multiple video windows in the free layout canvas area; when multiple windows are superimposed, for example, screens B and C are superimposed on screen A; after the mouse clicks screen A, the Z order of screen A becomes the highest, and screen A is located above screens B and C; After the drawing is completed, the color display of the A color box and the B color box is closed to obtain the validity of the current video window; if the current video window is a valid window, the picture of the video window is displayed, and the window information is saved to the layout list as the layout list information. The specific steps are as follows: Fig. 9As shown in the figure: after drawing multiple windows in the preset canvas; click the Save Layout button and enter the new layout name X; that is, the newly added X layout is displayed on the layout switching page; after clicking the X layout, it is output to the video output module, and the video output module outputs the free layout scheme to the back-end display; then select the video source for a single picture, decode and output to obtain the final video effect; if the current video window is not a valid window, it ends directly; After the free layout, you can re-layout and adjust the free layout window size. Figure 7 , including reconfiguring the width and height in the video window information saved in the UI interface; Or, on the video window saved in the UI interface, the width and height of the video window are changed based on mouse events; the mouse events include click events, press events, and move events; In this embodiment, the width and height are reconfigured in the video window information saved in the UI interface; specifically: when there are multiple video windows in the free layout preset canvas; after clicking on window A, the rectangular frame of window A changes from transparent to highlighted white; at this time, the rectangular frame will display the rectangular information, including X coordinate, Y coordinate, width, and height information; after clicking on the X coordinate and Y coordinate of the starting position, re-enter the value; after clicking Enter, the size of window A is set successfully; wherein, the value adjustment supports input from the physical keyboard and the right-click soft keyboard of the mouse. During the adjustment process, the size of window A cannot exceed the canvas. After inputting a value exceeding the canvas, the input value automatically becomes the maximum value, and the window is pressed to the edge of the canvas; In this embodiment, on the video window saved in the UI interface, the width and height of the video window are changed based on the mouse event; specifically, after clicking on the A window, the rectangular frame of the A window changes from transparent to highlighted white; drag the highlighted white border to adjust the size of the window; After the free layout, you can re-layout and adjust the free layout window position. Figure 8 , including reconfiguring the X and Y coordinates in the video window information saved in the UI interface; Or, on a video window saved on a UI interface, changing the position of the video window based on a mouse event; the mouse event includes a click event, a move event, and a mouse release event; In this embodiment, the X coordinate and Y coordinate are reconfigured in the video window information saved in the UI interface. Specifically, when there are multiple video windows in the free layout preset canvas, after clicking on the A window, the A window rectangular frame changes from transparent to highlighted white. At this time, the rectangular frame displays the rectangular information, including the X coordinate, Y coordinate, width, and height information. After clicking on the X coordinate and Y coordinate of the starting position, re-enter the value. After clicking Enter, the position of the A window is successfully set. Among them, the value adjustment supports the input of the physical keyboard and the right-click soft keyboard of the mouse. During the adjustment process, the size of the A window cannot exceed the canvas. After the value exceeding the canvas is entered, the input value automatically becomes the maximum value, and the window is pressed to the edge of the canvas. In this embodiment, on the video window saved in the UI interface, the position of the video window is changed based on the mouse event; specifically, the mouse clicks on window A and the mouse is moved without releasing it; the window moves with the mouse, and during the movement, the display screen of window A cannot exceed the canvas size; after the mouse is released, window A will stay at the position where the mouse was released.

[0019] Although the various steps in the above embodiment are described in the above-mentioned order, those skilled in the art can understand that in order to achieve the effect of this embodiment, different steps do not have to be executed in such an order. They can be executed simultaneously (in parallel) or in a reverse order. These simple changes are within the scope of protection of the present invention.

[0020] The terms "first", "second", etc. are used to distinguish similar objects rather than to describe or indicate a particular order or sequence.

[0021] The term "comprise" or any other similar term is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus / device that includes a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus / device.

[0022] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A distributed seat free layout implementation system, characterized in that: The system includes: a signal source, a coding node, a network, a seat node, and a display; the seat node includes a decoding module, a UI module, and a video output module; Each signal source is encoded into a network streaming media by a corresponding encoding node and sent to the seat node through the network; The UI module receives a stream selection instruction input by a user through a displayed UI interface, selects a network streaming media to be displayed, and freely lays out the pre-displayed windows of the selected network streaming media in a canvas area on the UI interface, and sends the layout list information to the video output module; The decoding module decodes the selected network streaming media and outputs a restored signal source; The video output module synthesizes an image according to the layout list information and the restored signal source, and outputs the image to the display for display, and the process is as follows: The video output module receives the layout list information; the layout list is a list of all video window information freely laid out on the UI interface; the video window information includes X coordinate, Y coordinate, width, height, transparency, and Z order; Determine the video window display position according to the X coordinate, Y coordinate, width, and height in the layout list information, and calculate the overlap area O and non-overlap area between the video windows; For each pixel in the overlapped area O, the fused pixel value is calculated according to the transparency and Z order of the multiple video windows at the pixel position; For the non-overlapping area, directly drawing the pixel value of the corresponding video window according to the layout list information; The images of the multiple video windows after pixel value processing and the restored signal source are combined to form a composite image, which is displayed on the display.

2. A distributed seat free layout implementation system according to claim 1, characterized in that: The fused pixel value is: ； In the formula, Alpha_i is the picture transparency of the i-th video window; R_i, G_i, B_i are the RGB pixel values ​​of the picture of the i-th video window respectively; O_R_(i-1), O_G_(i-1), O_B_(i-1) are the RGB pixel values ​​of the picture of the i-1-th video window after superposition; O_Alpha_(i-1) represents the transparency value of the picture of the i-1-th video window after superposition; O_R_i, O_G_i, O_B_i represent the RGB pixel values ​​of the picture of the i-th video window after superposition.

3. A distributed seat free layout implementation system according to claim 1, characterized in that: In free layout, the video window draws the screen in Z order, and also includes frame extraction and frame insertion processing; Obtaining a frame number in an output resolution of the display as a first frame number; According to the layout list information, the frame number of input frames of each screen drawn by the video window corresponding to the selected network streaming media is obtained as the second frame number; If the first frame number is lower than the second frame number, a frame extraction process is performed on the corresponding picture, wherein the frame extraction process is as follows: a timer is triggered to obtain an input frame once at a countdown time interval of the first frame number, the obtained input frame is placed into a timer to-be-obtained frame area in a manner of being covered by a countdown time interval of the second frame, and any unobtained input frame received at a non-triggering time of the timer is discarded; If the first frame number is higher than the second frame number, performing frame insertion processing on the corresponding picture; The interpolation processing is as follows: putting the output frame of the corresponding picture into the memory as a memory frame; triggering the timer to obtain a memory frame once every countdown time of the first frame number, if the memory frame is not updated, displaying the previous frame, otherwise, displaying the updated memory frame.

4. A method for implementing distributed seat free layout, based on a distributed seat free layout implementation system according to any one of claims 1 to 3, characterized in that: The following steps are involved: When a mouse press event is detected, the coordinates of the mouse in the canvas area are obtained as original coordinates; Determine whether the original coordinates are located in each video window. If not, generate a dynamic rectangular frame by combining the coordinates after the mouse is moved and the original coordinates; based on the dynamic rectangular frame, draw the A color frame, the B color frame and the screen of the video window at the same time. If yes, change the Z order of the clicked video window to the front and display the screen of the video window; the A color frame and the B color frame are both dynamic rectangular frames whose colors are set according to the resolution of the dynamic rectangular frame; When the dynamic rectangular frame is a B color frame and a mouse release event is detected, the picture drawing of the current video window is completed; After drawing is completed, close the color display of the A color box and the B color box, and obtain the validity of the current video window; if the current video window is a valid window, display the picture of the video window, and save the window information to the layout list as the layout list information; if the current video window is not a valid window, end directly.

5. A method for implementing distributed seat free layout according to claim 4, characterized in that: The color of the dynamic rectangular frame is set according to the resolution of the dynamic rectangular frame, and the method is as follows: Detecting the resolution of the dynamic rectangular frame, and comparing the resolution with a preset threshold M, if the resolution is less than the threshold M, setting the color of the dynamic rectangular frame to color A; If it is greater than or equal to M, the color of the dynamic rectangular frame is set to color B.

6. A method for implementing distributed seat free layout according to claim 4, characterized in that: When there are multiple video windows, the multiple video windows include multiple overlapping video windows and multiple non-overlapping video windows; The Z order of the multiple superimposed video windows can be adjusted by a mouse click event on the video window.

7. A method for implementing distributed seat free layout according to claim 4, characterized in that: After free layout, re-layout can be performed, and the re-layout includes: Adjusting the size of the window after free layout, including reconfiguring the width and height in the video window information saved in the UI interface; Or on the video window saved in the UI interface, the width and height of the video window are changed based on mouse events; the mouse events include click events, press events, and move events.

8. The method for implementing distributed seat free layout according to claim 4, characterized in that: The re-arrangement also includes: Adjust the free layout window position, including reconfiguring the X and Y coordinates in the saved video window information in the UI interface; Or, on a video window saved in the UI interface, the position of the video window is changed based on mouse events; the mouse events include click events, move events, and mouse release events.

Images