A television wall window control method and device, electronic equipment and storage medium

Abstract

The application discloses a television wall window control method and device, electronic equipment and a storage medium. The method is applied to a decoding device, and comprises the following steps: when a first SDK interface configured in the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, a target television wall window is determined according to the window layout adjustment instruction, and an operation matched with the window layout adjustment instruction is performed on the target television wall window; a target decoding channel corresponding to the target television wall window is determined; and a decoding video stream provided to the target television wall window based on the target decoding channel is controlled according to the window layout adjustment instruction, so as to adjust the television wall window layout in the television wall region. According to the scheme, the local operation of the target television wall window is performed, and the decoding video stream provided to the television wall window by the decoding channel is controlled based on the association relationship between the decoding channel and the television wall window, so that the adjustment of the television wall window layout on the spliced large screen is realized.

Description

Technical Field

[0001] This invention relates to the field of video surveillance technology, and in particular to a method, device, electronic device, and storage medium for controlling video wall windows. Background Technology

[0002] Currently, the national standard protocol is widely used in video surveillance and large-screen display systems, primarily to achieve interconnectivity between different devices. However, the national standard protocol has certain limitations in practical applications, especially in multi-channel decoding and large-screen display. According to the national standard protocol, one national standard channel corresponds to one video wall window, and the bitstream of each national standard channel can only be output on one physical output port. This results in the video wall window on the large screen being limited to a fixed layout and lacking flexibility after the decoding device connects to the national standard server based on the national standard protocol. Summary of the Invention

[0003] This invention provides a method, device, electronic device, and storage medium for controlling video wall windows, in order to solve the technical problem that decoding devices cannot arbitrarily adjust the layout of video wall windows.

[0004] According to one aspect of the present invention, a video wall window control method is provided, applied to a decoding device, the method comprising:

[0005] When the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by the client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and the target video wall window is subjected to an operation that matches the window layout adjustment instruction.

[0006] Determine the target decoding channel corresponding to the target video wall window;

[0007] The window layout adjustment instruction controls the decoded video stream provided to the target video wall window based on the target decoding channel, so as to adjust the layout of the video wall window in the video wall area.

[0008] According to another aspect of the present invention, a video wall window control device is provided, applied to a decoding device, the device comprising:

[0009] The target video wall window determination module is used to determine the target video wall window according to the window layout adjustment instruction when the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by the client or a third-party SDK platform, and to perform an operation on the target video wall window that matches the window layout adjustment instruction.

[0010] The target decoding channel determination module is used to determine the target decoding channel corresponding to the target video wall window;

[0011] The window layout adjustment module is used to control the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction, so as to adjust the layout of the video wall window in the video wall area.

[0012] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0013] At least one processor; and

[0014] A memory communicatively connected to the at least one processor; wherein,

[0015] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the video wall window control method according to any embodiment of the present invention.

[0016] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the video wall window control method according to any embodiment of the present invention.

[0017] The video wall window control scheme of this invention, when the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, determines the target video wall window according to the window layout adjustment instruction and performs an operation on the target video wall window that matches the window layout adjustment instruction; determines the target decoding channel corresponding to the target video wall window; and controls the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction, so as to adjust the layout of the video wall window in the video wall area. Through the technical solution provided by this invention, the technical problem that the decoding device cannot arbitrarily adjust the layout of the video wall window is solved. The decoding device controls the decoded video stream provided to the video wall window by the decoding channel based on the association between the decoding channel and the video wall window through local operation of the target video wall window, thereby realizing the adjustment of the layout of the video wall window on the spliced ​​large screen.

[0018] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 A flowchart of a video wall window control method provided in an embodiment of the present invention;

[0021] Figure 2 A flowchart of a video wall window control method provided in an embodiment of the present invention;

[0022] Figure 3 This invention provides a signaling diagram between a decoding device, a national standard server, and a client or third-party SDK platform.

[0023] Figure 4 This is a schematic diagram of the structure of a video wall window control device provided in an embodiment of the present invention;

[0024] Figure 5 This is a schematic diagram of the structure of an electronic device that implements the video wall window control method of this invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] Figure 1This is a flowchart illustrating a video wall window control method according to an embodiment of the present invention. This embodiment is applicable to situations involving the control of a video wall window. The method can be executed by a video wall window control device, which can be implemented in hardware and / or software and can be configured in a decoding device. Figure 1 As shown, the method includes:

[0028] S110. When the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by the client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and the target video wall window is subjected to an operation that matches the window layout adjustment instruction.

[0029] In this embodiment of the invention, the decoding device is configured with a first SDK interface, which is used to obtain information about the video wall window. The first SDK interface of the decoding device is called through a client or a third-party SDK platform to obtain the current video wall window layout from the decoding device and display the current video wall window layout on the client or third-party SDK platform. When a user wants to adjust the current video wall window layout, the user triggers a window layout adjustment operation on the client or third-party SDK platform. When the client or third-party SDK platform detects the user-triggered window layout adjustment operation, it generates a window layout adjustment command and sends the command to the decoding device through the first SDK interface. When the decoding device receives the window layout adjustment command from the client or third-party SDK platform through the first SDK interface, it determines the target video wall window according to the command and performs an operation on the target video wall window that matches the command. The window layout adjustment command may include a window deletion command, a window creation command, a window position adjustment command, and a window shape and size adjustment command. It should be noted that this embodiment of the invention does not limit the type of window layout adjustment command. For example, if the window layout adjustment command is a window deletion command, then the target TV wall window to be deleted is determined from the TV wall area according to the window deletion command, and the target TV wall window is deleted from the TV wall area. As another example, if the window layout adjustment command is a window shape and size adjustment command, then the target TV wall window to be adjusted is determined from the TV wall area according to the window shape and size adjustment command, and the shape and size of the target TV wall window in the TV wall area are adjusted according to the window shape and size adjustment command.

[0030] S120. Determine the target decoding channel corresponding to the target video wall window.

[0031] For example, if the window layout adjustment command is any command other than the window creation command, then the pre-stored correspondence between video wall windows and decoding channels can be obtained, and the target decoding channel corresponding to the target video wall window can be determined based on the correspondence. As another example, if the window layout adjustment command is a window creation command, then an unused decoding channel can be searched in the pre-stored decoding channel database, and the target decoding channel corresponding to the target video wall window can be selected randomly or according to a preset rule from the currently unused decoding channels.

[0032] S130. Control the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction, so as to adjust the layout of the video wall window in the video wall area.

[0033] In this embodiment of the invention, a one-to-one correspondence is established between the decoding channel and the video wall window, thereby providing the decoded video stream generated by the decoding channel for the corresponding monitoring video stream to the corresponding video wall window for playback. Therefore, the decoded video stream provided to the target video wall window based on the target decoding channel is controlled according to the window layout adjustment instruction to adjust the layout of the video wall window in the video wall area. For example, if the window layout adjustment instruction is a window deletion instruction, then providing the decoded video stream generated based on the target decoding channel to the target video wall window is interrupted or prohibited, thereby deleting the target video wall window in the video wall area. As another example, if the window layout adjustment instruction is a shape and size adjustment instruction, then the decoded video stream generated based on the target decoding channel is provided to the target video wall window after shape and size adjustment, thereby completing the adjustment of the shape and size of the target video wall window in the splicing screen, and ensuring that the decoded video stream is played in the target video wall window in the splicing screen after shape and size adjustment.

[0034] The video wall window control method of this invention, when the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, determines the target video wall window according to the window layout adjustment instruction, and performs an operation on the target video wall window that matches the window layout adjustment instruction; determines the target decoding channel corresponding to the target video wall window; and controls the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction, so as to adjust the layout of the video wall window in the video wall area. Through the technical solution provided by this invention, the technical problem that the decoding device cannot arbitrarily adjust the layout of the video wall window is solved. The decoding device controls the decoded video stream provided to the video wall window by the decoding channel based on the association between the decoding channel and the video wall window through local operation of the target video wall window, thereby realizing the adjustment of the layout of the video wall window on the spliced ​​large screen.

[0035] Figure 2 A flowchart of a video wall window control method provided in an embodiment of the present invention is shown below. Figure 2 As shown, the method includes:

[0036] S210. When the first SDK interface configured on the decoding device receives a window opening command sent by the client or a third-party SDK platform, the target TV wall window is drawn in the TV wall area according to the window position information contained in the window opening command.

[0037] In this embodiment of the invention, a window opening command sent by a client or a third-party SDK platform is received through a first SDK interface. The window opening command can be a window opening message. The window opening command is parsed to determine the window position information contained in the window opening command. For example, the window position information can be window coordinate information. The position of the newly created TV wall window in the TV wall area is determined based on the window position information. Then, the target TV wall window is drawn in the TV wall area based on the position of the newly created TV wall window in the TV wall area.

[0038] S220. Determine the target decoding channel corresponding to the target TV wall window from the list of decoding channels that are enabled and not bound to the TV wall window.

[0039] In this embodiment of the invention, before displaying the decoded video stream on the wall, the decoding device can determine the number of supported decoding channels and the sequence number and encoding of each decoding channel. The sequence number and encoding of the decoding channel can be understood as the identification information of the decoding channel. Since the decoding device interacts with the national standard server through the national standard protocol, the decoding channel can also be called a national standard channel. The decoding device automatically creates a full VO window video wall based on the number of decoding channels, meaning the number of video wall windows is the same as the number of decoding channels, ensuring a one-to-one correspondence between video wall windows and decoding channels. The video wall window corresponding to each decoding channel is encoded based on preset window encoding rules to generate a window encoding. For example, the corresponding window encoding can be generated based on the decoding channel encoding, or the sequence number of the decoding channel can be used as the window encoding of the video wall window. Before displaying the decoded video stream on the wall, the decoding device defaults to an inactive state for each video wall window. When displaying the decoded video stream, the device can determine the active decoding channels based on the decoding channel activation command input by the user on the web interface of the decoding device. In this embodiment of the invention, a decoding channel database can be constructed based on the decoding channel number, decoding channel encoding, window encoding of the corresponding video wall window, and the enabling status of the video wall window. After the decoding device registers with the national standard server, it reports the decoding channel database to the national standard platform via the national standard protocol, ensuring that the national standard server obtains the channel information and configures network services according to the channel information. For example, the user can choose to enable the first three decoding channels. Table 1, for instance, shows the decoding channel database table after enabling the first three decoding channels.

[0040] Table 1. Decoding channel database table after enabling the first 3 decoding channels.

[0041]

[0042] The national standard server analyzes the decoding channel database, configures the relationship between the decoding channels and the monitoring video streams based on the enabled decoding channels, and notifies the decoding devices of the correspondence between each enabled decoding channel and the monitoring video stream in the form of messages. This enables the decoding channels in the decoding devices to perform decoding operations on the corresponding monitoring video streams. Optionally, the national standard server can also create a video wall display interface based on the decoding channel database, allowing users to adjust the layout of the video wall window in the video wall display interface on the national standard server.

[0043] For example, the decoder channel database is searched for a list of decoder channels that are enabled but not bound to a video wall window. The target decoder channel corresponding to the target video wall window is then randomly or according to a preset strategy selected from this list. Table 2 shows the decoder channel database table after deleting window codes 3 and 4 from Table 1, turning off decoder channel 3, and turning on decoder channel 4.

[0044] Table 2 Decoding Channel Database Table

[0045]

[0046]

[0047] As shown in Table 2, if the window code corresponding to the decoding channel code is empty, it can be determined that the decoding channel corresponding to that decoding channel code is a decoding channel not bound to a video wall window. 1 indicates that the video wall window is in an open state, and 0 indicates that the video wall window is not in an open state. Therefore, according to Table 1, the decoding channels that are in an enabled state and not bound to a video wall window include decoding channel 4 and decoding channel 6. For example, the decoding channel with the smallest decoding channel number can be used as the target decoding channel corresponding to the target video wall window. Therefore, decoding channel 4 in Table 2 can be used as the target decoding channel corresponding to the target video wall window. To establish the binding relationship between the target decoding channel and the target video wall window, a window code corresponding to the target video wall window can be generated and added to Table 2 to update the decoding channel database. In this embodiment, the sequence number (4) of the target decoding channel can be directly used as the window code of the corresponding target video wall window, or the window code of the target video wall window can be generated according to the decoding channel code (34020000001335770004) of the target decoding channel. The generation rule of the window code of the target video wall window is not limited in this embodiment. For example, Table 3 is the decoded channel database table updated after the windowing operation:

[0048] Table 3. Decoding channel database table updated after the windowing operation.

[0049]

[0050]

[0051] S230. Determine the target decoding channel code corresponding to the target decoding channel, and generate the target window code corresponding to the target video wall window based on the decoding channel code.

[0052] For example, the target decoding channel code corresponding to the target decoding channel is determined according to the decoding channel database, and the target decoding channel code is encoded according to a preset encoding strategy to generate the target window code of the target video wall window corresponding to the target decoding channel.

[0053] S240. Based on the target decoding channel, the corresponding monitoring video stream is decoded to generate a decoded video stream, and the decoded video stream is provided to the target video wall window for playback, so as to adjust the layout of the video wall window in the video wall area.

[0054] In this embodiment of the invention, the decoding device can obtain the monitoring video stream corresponding to the target decoding channel based on the correspondence between the decoding channel and the monitoring video stream issued by the national standard server. Optionally, the national standard server can also issue the method or channel for obtaining the monitoring video stream corresponding to each decoding channel to the decoding device. The decoding device obtains the monitoring video stream corresponding to the target decoding channel based on the method or channel for obtaining the monitoring video stream corresponding to the target decoding channel. The corresponding monitoring video stream is decoded through the target decoding channel, and the decoded monitoring video stream is used as the decoded video stream. The decoding device provides the decoded video stream generated by decoding through the target decoding channel to the target video wall window for playback. For example, the decoding device can transmit the decoded video stream to the display device through the decoded video stream output port corresponding to the target video wall window. The display device may include a large video wall screen to play the decoded video stream generated by decoding through the target decoding channel within the target video wall window on the display device, thereby realizing the creation of a new video wall window on the large video wall screen and completing the adjustment of the video wall window layout on the large video wall screen.

[0055] S250. The window change information is reported to the national standard server through the national standard protocol, so that the national standard server updates the TV wall window layout in the window display interface based on the window change information; wherein, the window change information includes the target decoding channel encoding, the target window encoding and the window position information.

[0056] For example, the decoding device uses the target decoding channel encoding, the target window encoding, and the window position information corresponding to the target video wall window as window change information, and reports the window change information to the national standard server via the national standard protocol. The national standard server can update the video wall window layout in the window display interface according to the window change information.

[0057] In some embodiments, when the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, a target video wall window is determined according to the window layout adjustment instruction, and an operation matching the window layout adjustment instruction is performed on the target video wall window, including: when the first SDK interface configured on the decoding device receives a window closing instruction sent by a client or a third-party SDK platform, a target video wall window to be closed is determined from the video wall area according to the window closing instruction, and the target video wall window is deleted from the video wall area; the target decoding channel corresponding to the target video wall window is determined, including: determining the target decoding channel corresponding to the target video wall window based on a pre-stored correspondence between video wall windows and decoding channels; the decoded video stream provided to the target video wall window based on the target decoding channel is controlled according to the window layout adjustment instruction, including: interrupting the operation of providing the decoded video stream generated by decoding the corresponding monitoring video stream based on the target decoding channel to the target video wall window.

[0058] For example, when the decoding device receives a window-closing command from a client or third-party SDK platform through the first SDK interface, it parses the command, determines the window identification information contained within it, identifies the target TV wall window to be closed based on the window identification information, and deletes the target TV wall window from the TV wall area. It then obtains the pre-stored correspondence between TV wall windows and decoding channels, and searches for the target decoding channel corresponding to the target TV wall window based on this correspondence. The decoding device interrupts the operation of providing the decoded video stream generated by the target decoding channel to the target TV wall window. For example, the decoding device prevents the decoded video stream output port corresponding to the target TV wall window from transmitting the decoded video stream to the display device, where the display device may include a large video wall screen. This prevents the target TV wall window on the display device from continuing to play the decoded video stream and deletes the target TV wall window from the display device, thereby deleting the target TV wall window on the large video wall screen and completing the adjustment of the TV wall window layout on the large video wall screen.

[0059] Optionally, after interrupting the operation of providing the decoded video stream generated by decoding the corresponding monitoring video stream based on the target decoding channel to the target video wall window, the method further includes: unbinding the target decoding channel code corresponding to the target decoding channel in the decoding channel database from the window code corresponding to the target video wall window. For example, the window code corresponding to the target decoding channel code in the decoding channel database can be deleted. For example, if the target decoding channel can be determined to be the decoding channel with serial number 2 in Table 1 according to the window closing instruction, then the window code 2 corresponding to the decoding channel code (34020000001335770002) in Table 2 is deleted. Table 4 is the updated decoding channel database table after the window closing operation.

[0060] Table 4. Decoding channel database table updated after window closing operation.

[0061]

[0062] In some embodiments, when the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and the target video wall window is subjected to an operation matching the window layout adjustment instruction. This includes: when the first SDK interface configured on the decoding device receives a window position adjustment instruction sent by a client or a third-party SDK platform, the target video wall window to be adjusted is determined from the video wall area according to the window position adjustment instruction, and the position of the target video wall window in the video wall area is adjusted according to the new window position information contained in the window position adjustment instruction; the target decoding channel corresponding to the target video wall window is determined, including: determining the target decoding channel corresponding to the target video wall window based on a pre-stored correspondence between video wall windows and decoding channels; and the decoded video stream provided to the target video wall window based on the target decoding channel is controlled according to the window layout adjustment instruction, including: decoding the corresponding monitoring video stream based on the target decoding channel to generate a decoded video stream, and providing the decoded video stream to the target video wall window after the position is adjusted for playback.

[0063] For example, when the decoding device receives a window position adjustment instruction from a client or third-party SDK platform through the first SDK interface, it parses the instruction to determine the window identifier information and the new window position information contained within it. Based on the window identifier information, it identifies the target TV wall window to be adjusted within the TV wall area and adjusts its position within the area based on the new window position information. It retrieves a pre-stored correspondence between TV wall windows and decoding channels and searches for the target decoding channel corresponding to the target TV wall window. The decoding device then provides the decoded video stream generated by the target decoding channel to the adjusted target TV wall window for playback. For example, the decoding device can further transmit the decoded video stream to a display device through the output port corresponding to the target TV wall window. The display device may include a large video wall display (e.g., a splicing screen), to play the decoded video stream generated by the target decoding channel within the adjusted target TV wall window on the display device. This achieves the adjustment of the target TV wall window's position on the splicing screen, completing the adjustment of the TV wall window layout on the splicing screen. Since only the position of the target video wall window is adjusted, but the correspondence between the target video wall window and the target decoding channel remains unchanged, that is, the binding relationship or correspondence between the target decoding channel code corresponding to the target decoding channel in the decoding channel database and the window code of the target video wall window remains unchanged, the decoding channel database is not updated after the window position adjustment operation.

[0064] In some embodiments, after determining the target decoding channel corresponding to the target video wall window, the method further includes: reporting window change information to a national standard server via a national standard protocol, so that the national standard server updates the video wall window layout in the window display interface based on the window change information; wherein, the window change information includes the target decoding channel code corresponding to the target decoding channel, the target window code corresponding to the target video wall window, and the window position information contained in the window layout adjustment instruction. For example, when performing window opening, window closing, and window position adjustment operations on the video wall area, after determining the target decoding channel corresponding to the target video wall window, the target decoding channel code corresponding to the target decoding channel, the target window code corresponding to the target video wall window, and the window position information contained in the window layout adjustment instruction are used as window change information, and the window change information is reported to the national standard server via a national standard protocol. The national standard server can update the video wall window layout in the window display interface according to the window change information.

[0065] In some embodiments, the method further includes: when the second SDK interface configured on the decoding device receives a local live video feed instruction sent by a client or a third-party SDK platform, determining a target local input channel according to the local live video feed instruction; determining a local video wall window corresponding to the target local input channel; and providing the local video stream transmitted through the target local input channel to the local video wall window for playback. Optionally, when the second SDK interface configured on the decoding device receives a local live video feed instruction sent by a client or a third-party SDK platform, determining the target local input channel according to the local live video feed instruction includes: when the second SDK interface configured on the decoding device receives a local live video feed instruction sent by a client or a third-party SDK platform, feeding back a list of local input channels to the client or third-party SDK platform through the second SDK interface; obtaining the target local input channel fed back by the client or third-party SDK platform through the second SDK interface; wherein the target local input channel is the local input channel selected by the user from the list of local input channels on the client or third-party SDK platform. The advantage of this configuration is that it allows the decoding device to simultaneously perform the function of playing local video streams on a video wall.

[0066] In this embodiment of the invention, the decoding device is configured with a second SDK interface, which is used to obtain local input channel information. The second SDK interface of the decoding device is invoked by a client or a third-party SDK platform to obtain a list of local input channels from the decoding device. For example, when the client or third-party SDK platform sends a local live video display command to the second SDK interface of the decoding device, the second SDK interface of the decoding device sends the local input channel list back to the client or third-party SDK platform. When the client or third-party SDK platform detects a user's selection of a local input channel in the local input channel list, it determines the target local input channel selected by the user and sends the target local input channel to the second SDK interface of the decoding device. The decoding device receives the target local input channel from the client or third-party SDK platform through the second SDK interface. Based on a pre-stored correspondence between local input channels and video wall windows, it determines the local video wall window corresponding to the target local input channel and provides the local video stream transmitted through the target local input channel to the local video wall window for playback.

[0067] Figure 3 This invention provides a signaling diagram between a decoding device, a national standard server, and a client or third-party SDK platform, as illustrated in an embodiment of the invention. The description of the above embodiments can be used to... Figure 3To understand, it will not be discussed further here. Figure 3 To elaborate further.

[0068] Figure 4 This is a schematic diagram of a video wall window control device provided in an embodiment of the present invention. The device is applied to a decoding device, such as... Figure 4 As shown, the device includes:

[0069] The target video wall window determination module 410 is used to determine the target video wall window according to the window layout adjustment instruction when the first SDK interface configured on the decoding device receives the window layout adjustment instruction sent by the client or a third-party SDK platform, and to perform an operation on the target video wall window that matches the window layout adjustment instruction.

[0070] The target decoding channel determination module 420 is used to determine the target decoding channel corresponding to the target video wall window;

[0071] The window layout adjustment module 430 is used to control the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction, so as to adjust the layout of the video wall window in the video wall area.

[0072] Optionally, the target video wall window determination module is used for:

[0073] When the first SDK interface configured on the decoding device receives a window opening command sent by the client or a third-party SDK platform, the target TV wall window is drawn in the TV wall area according to the window position information contained in the window opening command.

[0074] The target decoding channel determination module is used for:

[0075] The target decoding channel corresponding to the target TV wall window is determined from the list of decoding channels that are enabled and not bound to a TV wall window;

[0076] Determine the target decoding channel encoding corresponding to the target decoding channel, and generate the target window encoding corresponding to the target video wall window based on the decoding channel encoding;

[0077] The window layout adjustment module is used for:

[0078] The corresponding monitoring video stream is decoded based on the target decoding channel to generate a decoded video stream, and then provided to the target video wall window for playback.

[0079] Optionally, the target video wall window determination module is used for:

[0080] When the first SDK interface configured on the decoding device receives a window closing command sent by the client or a third-party SDK platform, the target TV wall window to be closed is determined from the TV wall area according to the window closing command, and the target TV wall window is deleted from the TV wall area.

[0081] The target decoding channel determination module is used for:

[0082] The target decoding channel corresponding to the target TV wall window is determined based on the pre-stored correspondence between TV wall windows and decoding channels;

[0083] The window layout adjustment module is used for:

[0084] The interruption will provide the decoded video stream generated by decoding the corresponding monitoring video stream based on the target decoding channel to the target video wall window.

[0085] Optionally, the target video wall window determination module is used for:

[0086] When the first SDK interface configured on the decoding device receives a window position adjustment instruction sent by the client or a third-party SDK platform, the target TV wall window to be adjusted is determined from the TV wall area according to the window position adjustment instruction, and the position of the target TV wall window in the TV wall area is adjusted according to the new window position information contained in the window position adjustment instruction.

[0087] The target decoding channel determination module is used for:

[0088] The target decoding channel corresponding to the target TV wall window is determined based on the pre-stored correspondence between TV wall windows and decoding channels;

[0089] The window layout adjustment module is used for:

[0090] Based on the target decoding channel, the corresponding monitoring video stream is decoded to generate a decoded video stream, which is then provided to the adjusted target video wall window for playback.

[0091] Optional, also includes:

[0092] The window change information reporting module is used to report window change information to the national standard server via the national standard protocol after determining the target decoding channel corresponding to the target video wall window, so that the national standard server updates the video wall window layout in the window display interface based on the window change information; wherein, the window change information includes the target decoding channel code corresponding to the target decoding channel, the target window code corresponding to the target video wall window, and the window position information contained in the window layout adjustment instruction.

[0093] Optional, also includes:

[0094] The target local input channel determination module is used to determine the target local input channel according to the local live video display instruction when the second SDK interface configured on the decoding device receives a local live video display instruction sent by a client or a third-party SDK platform.

[0095] The local video wall window determination module is used to determine the local video wall window corresponding to the target local input channel;

[0096] The local video stream playback module is used to provide the local video stream transmitted through the target local input channel to the local video wall window for playback.

[0097] Optionally, the target local input channel determination module is used for:

[0098] When the second SDK interface configured on the decoding device receives a local live video display command sent by the client or a third-party SDK platform, the local input channel list is fed back to the client or the third-party SDK platform through the second SDK interface;

[0099] Obtain the target local input channel fed back by the client or third-party SDK platform through the second SDK interface; wherein, the target local input channel is the local input channel selected by the user from the list of local input channels in the client or third-party SDK platform.

[0100] The video wall window control device provided in this embodiment of the invention can execute the video wall window control method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method.

[0101] Figure 5 A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0102] like Figure 5As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0103] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0104] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the video wall window control method.

[0105] In some embodiments, the video wall window control method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the video wall window control method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the video wall window control method by any other suitable means (e.g., by means of firmware).

[0106] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0107] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0108] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0109] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0110] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0111] A computing system may include a client or third-party SDK platform and a server. The client or third-party SDK platform and server are generally geographically separated and typically interact via a communication network. The client or third-party SDK platform and server relationship is established by computer programs running on the respective computers and having a client or third-party SDK platform-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0112] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0113] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for controlling a video wall window, characterized in that, Applied to a decoding device, the method includes: When the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by the client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and the target video wall window is subjected to an operation that matches the window layout adjustment instruction. Determine the target decoding channel corresponding to the target video wall window; The window layout adjustment instruction controls the decoded video stream provided to the target video wall window based on the target decoding channel, so as to adjust the layout of the video wall window in the video wall area.

2. The method according to claim 1, characterized in that, When the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and an operation matching the window layout adjustment instruction is performed on the target video wall window, including: When the first SDK interface configured on the decoding device receives a window opening command sent by the client or a third-party SDK platform, the target TV wall window is drawn in the TV wall area according to the window position information contained in the window opening command. Determining the target decoding channel corresponding to the target video wall window includes: The target decoding channel corresponding to the target TV wall window is determined from the list of decoding channels that are enabled and not bound to a TV wall window; Determine the target decoding channel encoding corresponding to the target decoding channel, and generate the target window encoding corresponding to the target video wall window based on the decoding channel encoding; Controlling the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction includes: Based on the target decoding channel, the corresponding monitoring video stream is decoded to generate a decoded video stream, which is then provided to the target video wall window for playback.

3. The method according to claim 1, characterized in that, When the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and an operation matching the window layout adjustment instruction is performed on the target video wall window, including: When the first SDK interface configured on the decoding device receives a window closing command sent by the client or a third-party SDK platform, the target TV wall window to be closed is determined from the TV wall area according to the window closing command, and the target TV wall window is deleted from the TV wall area. Determining the target decoding channel corresponding to the target video wall window includes: The target decoding channel corresponding to the target TV wall window is determined based on the pre-stored correspondence between TV wall windows and decoding channels; Controlling the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction includes: The interruption will provide the decoded video stream generated by decoding the corresponding monitoring video stream based on the target decoding channel to the target video wall window.

4. The method according to claim 1, characterized in that, When the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by a client or a third-party SDK platform, the target video wall window is determined according to the window layout adjustment instruction, and an operation matching the window layout adjustment instruction is performed on the target video wall window, including: When the first SDK interface configured on the decoding device receives a window position adjustment instruction sent by the client or a third-party SDK platform, the target TV wall window to be adjusted is determined from the TV wall area according to the window position adjustment instruction, and the position of the target TV wall window in the TV wall area is adjusted according to the new window position information contained in the window position adjustment instruction. Determining the target decoding channel corresponding to the target video wall window includes: The target decoding channel corresponding to the target TV wall window is determined based on the pre-stored correspondence between TV wall windows and decoding channels; Controlling the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction includes: Based on the target decoding channel, the corresponding monitoring video stream is decoded to generate a decoded video stream, which is then provided to the adjusted target video wall window for playback.

5. The method according to claim 1, characterized in that, After determining the target decoding channel corresponding to the target video wall window, the process further includes: The window change information is reported to the national standard server via the national standard protocol, so that the national standard server updates the TV wall window layout in the window display interface based on the window change information; wherein, the window change information includes the target decoding channel code corresponding to the target decoding channel, the target window code corresponding to the target TV wall window, and the window position information contained in the window layout adjustment instruction.

6. The method according to claim 1, characterized in that, Also includes: When the second SDK interface configured on the decoding device receives a local live video display instruction sent by the client or a third-party SDK platform, the target local input channel is determined according to the local live video display instruction; Determine the local video wall window corresponding to the target local input channel; The local video stream transmitted through the target local input channel is provided to the local video wall window for playback.

7. The method according to claim 6, characterized in that, When the second SDK interface configured on the decoding device receives a local live video display instruction sent by a client or a third-party SDK platform, the target local input channel is determined according to the local live video display instruction, including: When the second SDK interface configured on the decoding device receives a local live video display command sent by the client or a third-party SDK platform, the local input channel list is fed back to the client or the third-party SDK platform through the second SDK interface; Obtain the target local input channel fed back by the client or third-party SDK platform through the second SDK interface; wherein, the target local input channel is the local input channel selected by the user from the list of local input channels in the client or third-party SDK platform.

8. A video wall window control device, characterized in that, Applied to a decoding device, the device includes: The target video wall window determination module is used to determine the target video wall window according to the window layout adjustment instruction when the first SDK interface configured on the decoding device receives a window layout adjustment instruction sent by the client or a third-party SDK platform, and to perform an operation on the target video wall window that matches the window layout adjustment instruction. The target decoding channel determination module is used to determine the target decoding channel corresponding to the target video wall window; The window layout adjustment module is used to control the decoded video stream provided to the target video wall window based on the target decoding channel according to the window layout adjustment instruction, so as to adjust the layout of the video wall window in the video wall area.

9. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the video wall window control method according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the video wall window control method according to any one of claims 1-7.

Images