A multi-screen device, a control method and a storage medium

Abstract

The application discloses a kind of multi-screen device, control method and storage medium, comprising the following steps: obtaining video source to be played, respectively configuring a player for each video source;The corresponding video source is parsed by each player, to obtain the parsed data corresponding to the video source;According to the display requirement, more than two display windows are provided in the multi-screen, and video source is configured for each display window;According to the video source of each display window, the corresponding parsed data is selected, and the parsed data is rendered and displayed in the corresponding display window.The application can make the parsing and rendering of video source in multi-screen more flexible, thereby reducing the requirements of software and hardware of multi-screen player, improving the efficiency of multi-screen video playback management.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a multi-screen device, a control method and a storage medium. BACKGROUND

[0002] In the prior art, a large-size multi-screen is usually used to display a larger video or display multiple video contents.

[0003] In the configuration method of the multi-screen player, a player is configured for each playing window, which is used to parse the video data corresponding to the playing window and render the parsed data. When the display scene of the player changes or the video data switches, the video data of the player needs to be re-parsed and rendered. Therefore, the software and hardware requirements of the multi-screen player are very high, and the multi-screen video data playing control efficiency is greatly affected. SUMMARY

[0004] In view of the above problems, the present application provides a multi-screen control method to solve the technical problems of high software and hardware requirements of the multi-screen player and low control efficiency in the multi-screen playing.

[0005] To achieve the above purpose, the inventors provide a multi-screen display control method, the multi-screen is formed by splicing a plurality of physical display screens, and the method comprises the following steps:

[0006] Obtaining a video source to be played, and configuring a player for each video source;

[0007] Parsing the corresponding video source by each player to obtain parsed data corresponding to the video source;

[0008] According to the display requirements, the multi-screen is provided with two or more display windows, and each display window is configured with a video source, wherein one physical display screen corresponds to one display window, or two or more physical display screens are combined to correspond to one or two or more display windows; different display windows can be configured with the same or different video sources;

[0009] According to the video source selection of each display window, the parsed data is rendered and displayed in the corresponding display window.

[0010] Further, the player parses the corresponding video source, and the parsed data is rendered and displayed in the corresponding display window, which are executed independently.

[0011] Furthermore, the step of selecting the corresponding parsed data based on the video source of each display window and rendering and displaying the parsed data in the corresponding display window includes the following steps:

[0012] Configure at least one virtual display for each of the physical display screens occupied by the display window;

[0013] The portions displayed on each physical display screen in the parsed data corresponding to the display window are rendered onto the corresponding virtual display screen.

[0014] The rendered images of each virtual display screen are displayed on the corresponding physical display screen.

[0015] Furthermore, when different display areas of the same physical display screen are occupied by two or more display windows respectively; a virtual display screen is configured for each of the different display areas; and the portions displayed in the parsed data for different display areas are rendered to the corresponding display areas through the corresponding virtual display screens.

[0016] Furthermore, the method also includes the step of:

[0017] When it is necessary to change the scene interface of the display window, the display content corresponding to the display window is rendered according to the current scene interface of the display window to obtain the original rendered image;

[0018] Furthermore, the display content corresponding to the display window is rendered according to the changed new scene interface to obtain a new rendered image;

[0019] The original rendered image in the display window is replaced with the new rendered image.

[0020] Furthermore, the method also includes the step of:

[0021] When it is necessary to switch the video source displayed in the display window, the parsed data corresponding to the new video source after the switch is rendered, and the current image of the display window is replaced with the rendered image.

[0022] Furthermore, the method also includes the step of:

[0023] When the number of video sources connected to the multi-screen device increases, a corresponding number of players are added to the multi-screen device to parse the newly added video sources.

[0024] Furthermore, the method also includes the step of:

[0025] A preset control system is used to uniformly control all the aforementioned players.

[0026] To address the aforementioned technical problems, this application also provides another technical solution:

[0027] A multi-screen device, formed by splicing together multiple physical displays, includes:

[0028] Multiple players, each of which is used to parse one video source to obtain corresponding parsed data;

[0029] One or more display windows are used to display the video source, wherein one physical display screen corresponds to one display window, or two or more physical display screens are combined to correspond to one or more display windows; different display windows can be configured with the same or different video sources;

[0030] The rendering module is used to select the corresponding parsed data according to the video source displayed in each of the display windows, and render and display the parsed data in the corresponding display window.

[0031] To address the aforementioned technical problems, this application also provides another technical solution:

[0032] A computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the multi-screen display control method as described in any of the above technical solutions.

[0033] Unlike existing technologies, the multi-screen display control method described above separates the parsing and rendering of video sources across multiple screens into two independent steps. It determines the number of players needed to parse the video sources based on the number of video sources, and selects corresponding parsing data for rendering based on each playback window. By eliminating the need to set the number of players based on the number of playback windows, and by removing the synchronous execution of video source parsing and rendering, the number of players can be reduced, and the parsing and rendering of video sources becomes more flexible. This reduces the hardware and software requirements of the multi-screen player and improves the efficiency of multi-screen video playback management.

[0034] The above description of the invention is merely an overview of the technical solution of this application. In order to enable those skilled in the art to better understand the technical solution of this application and to implement it based on the description and drawings, and to make the above-mentioned objectives and other objectives, features and advantages of this application easier to understand, the following description is provided in conjunction with the specific embodiments and drawings of this application. Attached Figure Description

[0035] The accompanying drawings are only used to illustrate the principles, implementation methods, applications, features, and effects of specific embodiments of the present invention and other related contents, and should not be considered as limitations on this application.

[0036] In the accompanying drawings of the instruction manual:

[0037] Figure 1 A flowchart illustrating the multi-screen display control method described in a specific implementation;

[0038] Figure 2 This is a schematic diagram of the structure of the multi-screen unit as described in the specific implementation method;

[0039] Figure 3a A flowchart illustrating the parsing and rendering of data as described in the specific implementation method;

[0040] Figure 3b This is a schematic diagram showing the distribution of each display window in a display scene in a specific implementation method;

[0041] Figure 4 A flowchart illustrating the scene interface of the display window as described in the specific implementation method;

[0042] Figure 5 This is a schematic diagram of the multi-screen device described in a specific embodiment;

[0043] Figure 6 A schematic diagram of the computer-readable storage medium described in a specific embodiment;

[0044] The reference numerals used in the above figures are explained as follows:

[0045] 100. Multi-screen display; 101. Display screen; 500. Multi-screen device; 600. Computer-readable storage medium; 31. First display window; 32. Second display window; 33. Third display window; Detailed Implementation

[0046] To illustrate the possible application scenarios, technical principles, implementable specific solutions, and achievable objectives and effects of this application in detail, the following description, in conjunction with the listed specific embodiments and accompanying drawings, provides a detailed explanation. The embodiments described herein are merely illustrative of the technical solutions of this application and are therefore intended to limit the scope of protection of this application.

[0047] In this document, the term "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The term "embodiment" appearing in various places throughout the specification does not necessarily refer to the same embodiment, nor does it specifically limit its independence or connection with other embodiments. In principle, in this application, as long as there are no technical contradictions or conflicts, the technical features mentioned in each embodiment can be combined in any way to form corresponding implementable technical solutions.

[0048] Unless otherwise defined, the technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the use of related terms herein is merely for the purpose of describing particular embodiments and is not intended to limit this application.

[0049] In the description of this application, the term "and / or" is used to describe the logical relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A exists, B exists, and A and B exist simultaneously. Additionally, the character " / " in this document generally indicates that the preceding and following objects have an "or" logical relationship.

[0050] In this application, terms such as “first” and “second” are used only to distinguish one entity or operation from another, and do not necessarily require or imply any actual quantity, hierarchy or order relationship between these entities or operations.

[0051] Without further limitations, the use of terms such as “comprising,” “including,” “having,” or other similar open-ended expressions in this application is intended to cover non-exclusive inclusion, which does not exclude the presence of additional elements in a process, method, or product that includes the stated elements, such that a process, method, or product that includes a list of elements may include not only those defined elements but also other elements not expressly listed, or elements inherent to such a process, method, or product.

[0052] Similar to the understanding in the Examination Guidelines, in this application, expressions such as "greater than," "less than," and "exceeding" are understood to exclude the stated number; expressions such as "above," "below," and "within" are understood to include the stated number. Furthermore, in the description of the embodiments in this application, "multiple" means two or more (including two), and similar expressions related to "multiple" are also understood in this way, such as "multiple groups" and "multiple times," unless otherwise explicitly specified.

[0053] In the description of the embodiments of this application, the space-related expressions used, such as "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "vertical," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential," indicate the orientation or positional relationship based on the orientation or positional relationship shown in the specific embodiments or drawings. They are only for the purpose of describing the specific embodiments of this application or for the reader's understanding, and do not indicate or imply that the device or component referred to must have a specific position, a specific orientation, or be constructed or operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.

[0054] Unless otherwise expressly specified or limited, the terms "installation," "connection," "linking," "fixing," and "setting," as used in the description of the embodiments of this application, should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral setting; it can be a mechanical connection, an electrical connection, or a communication connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be the internal connection of two components or the interaction between two components. For those skilled in the art to which this application pertains, the specific meaning of the above terms in the embodiments of this application can be understood according to the specific circumstances.

[0055] Please see Figure 1 and Figure 2 This embodiment provides a multi-screen display control method, wherein the multi-screen 100 is formed by splicing together multiple physical display screens 101, and the method includes the following steps:

[0056] S101. Obtain the video source to be played, and configure a player for each video source;

[0057] S102. The corresponding video source is parsed by each of the aforementioned players to obtain parsed data corresponding to the video source;

[0058] S103. According to the display requirements, the multi-screen setup has two or more display windows and a video source is configured for each display window. One physical display screen corresponds to one display window, or two or more physical display screens combined together correspond to one or more display windows. Different display windows can be configured with the same or different video sources.

[0059] S104. Select the corresponding parsed data according to the video source of each display window, and render and display the parsed data in the corresponding display window.

[0060] like Figure 2 As shown, the multi-screen 100 is formed by splicing together multiple physical displays 101. The physical displays 101 can be LCD displays, OLED displays, Micro LED displays, etc. Multiple physical displays 101 can be spliced ​​in a row-column matrix, with the borders of adjacent physical displays 101 pressed together, and then fixed in place by mounting brackets. The row-column matrix includes one row with multiple columns, one column with multiple rows, and multiple rows with multiple columns. The data transmission lines of each physical display 101 are connected to the controller of the multi-screen 100, and the controller outputs image data to each physical display 101 for display. To facilitate splicing, each physical display 101 can be a display of the same model or the same size and resolution.

[0061] In step S101, the video source can be a locally stored video source, a video source stored in the cloud or broadcast live on the network, or real-time video data generated by a video shooting device such as a camera. The video source can be in formats such as MP4, AVI, WMV, RMVB, FLV, etc. In step S102, the player is used to parse the video source to obtain video data (unrendered video data). Parsing includes decrypting the video source protocol, decapsulating, and decoding; the parsed data is the decoded video data.

[0062] In step S103, the display window is the video playback window. According to the playback requirements, multiple display windows can be set on the multi-screen, and each display window can be the same or different in size or shape.

[0063] In step S104, the rendering can be performed by using 3D production software such as Maya, 3ds Max, and Blender to process the parsed data through steps such as texturing, binding, animation, and lighting, and then pasting it onto the display window to obtain the final display effect. The display window can ultimately display dynamic video data or static images such as pictures.

[0064] In this embodiment, the parsing of the corresponding video source by the player and the rendering and display of the parsed data in the corresponding display window are performed independently. The video source parsing is performed by the player, while the rendering of the parsed data can be performed using 3D modeling software such as Maya, 3ds Max, and Blender. Furthermore, the player and the 3D modeling software do not necessarily have a one-to-one correspondence, and the player is only responsible for video source parsing and does not participate in the rendering step; similarly, the 3D modeling software is only responsible for rendering and does not participate in the parsing step. For example, if a multi-screen setup has two video sources connected to it, and currently has three display windows, with two windows displaying the same video source, then the multi-screen setup only needs to set up two players to parse the two video sources respectively. Then, the three display windows each select the corresponding parsed data and render the parsed data according to the display scene of the display window, thereby displaying the corresponding video image on each display window. In this embodiment, separating video source parsing and rendering into two independent steps makes multi-screen video playback control more flexible and convenient, while also reducing the requirements for the multi-screen controller's hardware and software.

[0065] In step S104, when rendering and displaying the parsed data in the corresponding display window, a corresponding virtual display screen can be set for each display window. The rendered video image is first sent to the virtual display screen, and then the virtual display screen is pasted onto the display window. The virtual display screen refers to a space in memory or video memory used to temporarily store the rendered video data. Its data reception principle is the same as that of a physical display screen, except that the received video data is not displayed on the physical screen.

[0066] In the above embodiments, when a display window occupies two or more physical displays, the player parses the video source and, based on the number of physical displays involved in the display window and the content displayed on each physical display, segments the video image (i.e., the image corresponding to the video source). Each involved physical display displays a portion of the video image, and the physical displays combine to display the video image. Furthermore, in the above embodiments, the player and display window are uniformly controlled by the backend through the controller. Multi-screen setups can use some or all of the physical displays as needed; for example, five physical displays might be used in a real-world scenario.

[0067] In one usage scenario, the multi-screen setup is a music video (MV) scenario. Four physical displays are combined to form one display window for showing one MV video. A fifth physical display serves as a second display window. The first and second display windows are independent and do not overlap. The second display window is used to display the MV video. In this case, only one player needs to be set up to parse the video source. The five physical displays are each connected to this player, and the parsed data is rendered onto the first and second display windows respectively.

[0068] In another use case, the multi-screen setup is for playing video footage. Four physical displays are used to show video clips, and a fifth physical display is used to show music videos. In this case, only two players need to be configured for control: one player connected to the video clip resources, and the other player connected to the music video resources.

[0069] In the above embodiments, the display windows on the multi-screen can have various different layouts. For example, the display windows in the multi-screen can be set independently, that is, the display windows are spaced apart and do not overlap or cross each other.

[0070] like Figure 3a As shown, rendering and displaying the parsed data in the corresponding display window includes the following steps:

[0071] S301. Configure at least one virtual display screen for each physical display screen occupied by the display window;

[0072] S302. Render the portions displayed on each physical display screen in the parsed data corresponding to the display window to the corresponding virtual display screen;

[0073] S303. Display the rendered images of each virtual display screen on the corresponding physical display screen.

[0074] In some embodiments, some display windows in a multi-screen setup can overlap or nest with each other, thereby creating a richer and more flexible layout. For example, two display windows can be distributed in a "picture-in-picture" manner, where a smaller display window is completely embedded within a larger display window, and the two display windows display different images, thus creating a picture-in-picture display effect. When two or more display windows partially or completely overlap (i.e., nest) in a picture-in-picture layout, and different display areas of the same physical display screen are occupied by two or more display windows; a virtual display screen is configured for each of the different display areas; and the portions displayed in the parsed data for different display areas are rendered to the corresponding virtual display screens for the respective display areas.

[0075] For example, such as Figure 3b As shown, in a display scenario, four physical displays in a multi-screen setup form a first display window 31, used to display video footage. A second display window 32 uses a separate physical display, the fifth physical display, used to display music videos (MVs). The fifth physical display is located outside the first display window 31 (i.e., outside the four physical displays that make up the first display window 31). A third display window 33, a picture-in-picture window, is also positioned in the middle of the four physical displays forming the first display window 31. This third display window 33 is also used to display MVs, thus creating a picture-in-picture MV display in the center of the four physical displays. In this display scenario, the four physical displays of the first display window 31 need to be configured with four virtual displays to display video footage. Furthermore, these four physical displays also need to be configured with four additional virtual displays to display the MVs in the picture-in-picture windows. Therefore, in these four physical displays, every two virtual displays connect to one physical display, which displays the footage while simultaneously displaying the picture-in-picture in the center of the screen. Additionally, the fifth physical display screen is used to display the music video, so a virtual display screen also needs to be set up for the fifth physical display screen. Therefore, in this embodiment, the multi-screen setup only requires two players. One player is connected to the video material playback address for parsing the video material, and the other player is connected to the music video resource for parsing the music video. With just two players, three display windows can be used to play the video source.

[0076] like Figure 4As shown, in another embodiment, the above-described multi-screen display control method further includes the step of:

[0077] S401. When it is necessary to change the scene interface of the display window, render the display content corresponding to the display window according to the current scene interface of the display window to obtain the original rendered image.

[0078] S402, and render the display content corresponding to the display window according to the changed new scene interface to obtain a new rendered image;

[0079] S403. Replace the original rendered image in the display window with the new rendered image.

[0080] In step S401, the scene interface of the display window includes the number, size, shape, and distribution of display windows on the multi-screen display. When the scene interface of the display windows on the multi-screen display changes, the style of the video image played within the display window is also adjusted accordingly. In this embodiment, when the scene interface of the display window changes, it is only necessary to re-render the parsed data of the video source according to the new scene interface during rendering, without re-parsing the video source. Therefore, the amount of data processing is reduced, and the efficiency and smoothness of the scene interface switching of the display window are improved.

[0081] In some embodiments, the multi-screen display control method described above further includes the step of:

[0082] When it is necessary to switch the video source displayed in the display window, the parsed data corresponding to the new video source after the switch is rendered, and the current image of the display window is replaced with the rendered image.

[0083] For example, a multi-screen setup includes a camera display window for showing live video captured by the camera; an MV window for playing music videos; and a media window for playing video footage. In this setup, the multi-screen system has three players, one for parsing camera video data, the other for music videos, and the third for playing video footage. When the MV window needs to display video footage, and the media window needs to display MVs (i.e., when the content displayed in the MV and media windows is swapped), the video sources connected to the three players do not need to be adjusted. Rendering can be performed simply by switching the parsed data corresponding to the MV and media windows in the background.

[0084] In some embodiments, the multi-screen display control method described above further includes the step of:

[0085] When the number of video sources connected to the multi-screen device increases, a corresponding number of players are added to the multi-screen device to parse the newly added video sources.

[0086] likeFigure 5 As shown, in one embodiment, a multi-screen device 500 is provided, which is formed by splicing together multiple physical displays. The multi-screen device 500 includes:

[0087] Multiple players, each of which is used to parse one video source to obtain corresponding parsed data;

[0088] One or more display windows are used to display the video source, wherein one physical display screen corresponds to one display window, or two or more physical display screens are combined to correspond to one or more display windows; different display windows can be configured with the same or different video sources;

[0089] The rendering module is used to select the corresponding parsed data according to the video source displayed in each of the display windows, and render and display the parsed data in the corresponding display window.

[0090] The parsing of the corresponding video source by the player and the rendering and display of the parsed data in the corresponding display window are performed independently of each other.

[0091] In this embodiment, the multi-screen device 500 divides the parsing and rendering of video sources from multiple screens into two independent steps. It determines the number of players needed to parse the video sources based on the number of video sources, and selects corresponding parsing data for rendering based on each playback window. By eliminating the need to set the number of players based on the number of playback windows, and by removing the synchronous execution of video source parsing and rendering, the number of players can be reduced, and the parsing and rendering of video sources can be made more flexible. This reduces the hardware and software requirements of the multi-screen player and improves the efficiency of multi-screen video playback management.

[0092] like Figure 6 As shown, in another embodiment, a computer-readable storage medium 600 is provided. The computer-readable storage medium 600 stores a computer program that, when executed by a processor, implements the multi-screen display control method as described in any of the above embodiments.

[0093] Finally, it should be noted that although the above embodiments have been described in the text and drawings of this application, this should not limit the scope of patent protection of this application. Any technical solutions that are based on the essential concept of this application and utilize the content described in the text and drawings of this application, resulting in equivalent structural or procedural substitutions or modifications, as well as the direct or indirect application of the technical solutions of the above embodiments to other related technical fields, are all included within the scope of patent protection of this application.

Claims

1. A method for controlling a multi-screen display, wherein the multi-screen is formed by splicing together multiple physical displays, characterized in that, The method includes the following steps: Obtain the video sources to be played, and configure a player for each video source; Each of the aforementioned players parses the corresponding video source to obtain parsed data corresponding to the video source; According to the display requirements, the multi-screen setup has two or more display windows and a video source configured for each display window. One physical display screen corresponds to one display window, or two or more physical display screens can be combined to correspond to one or more display windows. Different display windows can be configured with the same or different video sources. Select the corresponding parsed data according to the video source of each display window, and render and display the parsed data in the corresponding display window; The step of selecting the corresponding parsed data based on the video source of each display window and rendering and displaying the parsed data in the corresponding display window includes the following steps: Configure at least one virtual display for each of the physical display screens occupied by the display window; The portions displayed on each physical display screen in the parsed data corresponding to the display window are rendered onto the corresponding virtual display screen. The rendered images of each virtual display screen are displayed on the corresponding physical display screen.

2. The multi-screen display control method according to claim 1, characterized in that, The parsing of the corresponding video source by the player and the rendering and display of the parsed data in the corresponding display window are performed independently of each other.

3. The multi-screen display control method according to claim 1, characterized in that, When different display areas of the same physical display screen are occupied by two or more display windows respectively; configure a virtual display screen for each of the different display areas; and render the portions of the parsed data displayed in the different display areas to the corresponding display areas through the corresponding virtual display screens respectively.

4. The multi-screen display control method according to claim 1, characterized in that, The method further includes the following steps: When it is necessary to change the scene interface of the display window, the display content corresponding to the display window is rendered according to the current scene interface of the display window to obtain the original rendered image; Furthermore, the display content corresponding to the display window is rendered according to the changed new scene interface to obtain a new rendered image; The original rendered image in the display window is replaced with the new rendered image.

5. The multi-screen display control method according to claim 1, characterized in that, The method further includes the following steps: When it is necessary to switch the video source displayed in the display window, the parsed data corresponding to the new video source after the switch is rendered, and the current image of the display window is replaced with the rendered image.

6. The multi-screen display control method according to claim 1, characterized in that, The method further includes the following steps: When the number of video sources connected to the multi-screen device increases, a corresponding number of players are added to the multi-screen device to parse the newly added video sources.

7. The multi-screen display control method according to claim 1, characterized in that, The method further includes the following steps: A preset control system is used to uniformly control all the aforementioned players.

8. A multi-screen device, formed by splicing together multiple physical displays, characterized in that, The multi-screen device includes: Multiple players, each of which is used to parse one video source to obtain corresponding parsed data; One or more display windows are used to display the video source, wherein one physical display screen corresponds to one display window, or two or more physical display screens are combined to correspond to one or more display windows; different display windows can be configured with the same or different video sources; The rendering module is used to select the corresponding parsed data according to the video source displayed in each of the display windows, and render and display the parsed data in the corresponding display window, including the following steps: Configure at least one virtual display for each of the physical display screens occupied by the display window; The portions displayed on each physical display screen in the parsed data corresponding to the display window are rendered onto the corresponding virtual display screen. The rendered images of each virtual display screen are displayed on the corresponding physical display screen.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the multi-screen display control method as described in any one of claims 1 to 7.

Images