Method and device for controlling decoding output display of display wall by terminal software

Abstract

The invention relates to a control method and device for terminal software to decode, output and display a display wall. The method comprises the steps of obtaining display wall data sent by a decoder and displaying the display wall data in a display wall control interface of a terminal; under the condition that the screen triggering event is detected, position adjustment or size adjustment is conducted on a target display wall screen in the display wall control interface; determining a target screen parameter of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen and the interface size of the display wall; the target screen parameter is sent to a target decoder corresponding to the target display wall screen, so that the target decoder determines a target resource corresponding to the target display wall screen and adjusts the position or size of the target resource in the display wall according to the target screen parameter, and the display wall screen, the image resource and the decoder have a corresponding relation. The flexibility of resource display in the display wall can be improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent terminal technology, and in particular to a method and device for controlling terminal software to decode and output display of a display wall. Background Art

[0002] Display wall decoding output means that the terminal software controls the decoder through the server to output the resources displayed on the terminal software on the display wall. The display wall can have multiple screen areas, each of which plays different resources. After the user logs in to the terminal, he drags the resources in the resource tree to the display wall, and each resource is decoded and output to each screen area of ​​the display wall in the order of the screen. Figure 1 This is a schematic diagram of the display interface for decoding on the wall. It can be seen that the layout information of the display wall is 4-split screen display, and the decoding status information is outputting 10404 image resources on the first screen.

[0003] The current terminal software decoding and wall display function only supports displaying image resources according to the specified layout of the display wall, and the flexibility of resource display is poor. Summary of the invention

[0004] The present application provides a method and device for controlling terminal software to decode and output display of a display wall, so as to solve the problem of poor flexibility of resource display.

[0005] In a first aspect, the present application provides a method for controlling terminal software to decode and output a display wall, the method comprising:

[0006] Acquire display wall data sent by the decoder and display the display wall data in a display wall control interface of the terminal, wherein the display wall data includes screen layout information in the display wall and different image resources in each screen;

[0007] When a screen triggering event is detected, adjusting the position or size of the target display wall screen in the display wall control interface;

[0008] Determining target screen parameters of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall;

[0009] The target screen parameters are sent to a target decoder corresponding to the target display wall screen, so that the target decoder determines the target resource corresponding to the target display wall screen, and adjusts the position or size of the target resource in the display wall according to the target screen parameters, wherein there is a corresponding relationship between the display wall screen, the image resource and the decoder.

[0010] Optionally, before detecting a screen triggering event, the method further includes:

[0011] According to the resource selection instruction, the set resources in the resource library are placed on the set display wall screen of the display wall control interface;

[0012] Determining the initial screen parameters of the setting display wall screen;

[0013] Converting the initial screen parameters into screen parameters of a corresponding screen in the display wall;

[0014] The setting resource is decoded and output to the display wall according to the converted screen parameters through the setting decoder corresponding to the setting display wall screen.

[0015] Optionally, decoding the setting resource according to the converted screen parameters and outputting it to the display wall through a setting decoder corresponding to the setting display wall screen comprises:

[0016] Determining the set decoder information and the set resource information corresponding to the set display wall screen according to the preset corresponding relationship;

[0017] Constructing decoding wall information according to the set decoder information, the set resource information and the converted screen parameters, wherein the decoding wall information is used to notify the server to use a specified decoder to output corresponding resources to a corresponding position of the display wall;

[0018] The decoded wall display information is sent to a server, so that the server forwards the setting resource information and the converted screen parameters to the setting decoder. The setting decoder sends the setting resources to the display wall according to the setting resource information and displays the setting resources according to the converted screen parameters.

[0019] Optionally, sending the target screen parameter to a target decoder corresponding to the target display wall screen includes:

[0020] Constructing a decoding movement request according to the target screen parameter and the decoding wall information corresponding to the target display wall resource, wherein the decoding movement request is used to adjust the position or size of the target resource in the display wall;

[0021] The decoding movement request is sent to the server, so that the server sends the target screen parameters to the target decoder according to the decoded wall information corresponding to the target display wall resource, and the target decoder adjusts the position or size of the target resource in the display wall according to the target screen parameters.

[0022] Optionally, after sending the decoded wall display information or the decoded mobile request to the server, the method further includes:

[0023] Obtaining a decoding status notification fed back by the server, wherein the decoding status notification is obtained by the server from the decoder, and the decoding status notification is used to indicate a decoding success or a decoding failure;

[0024] The current decoding status in the display wall control interface is updated according to the decoding status notification.

[0025] Optionally, determining a target screen parameter of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall includes:

[0026] Determining a margin ratio of the target display wall screen in the display wall control interface according to the size of the display wall control interface and the adjusted target display wall screen;

[0027] The screen size and screen position of the target display wall screen in the display wall are determined according to the interface size of the display wall and the margin ratio of the target display wall screen.

[0028] Optionally, after sending the target screen parameters to a target decoder corresponding to the target display wall screen, the method further includes:

[0029] If the position and size of the target display wall screen after adjustment are not changed from those before adjustment, the screen triggering event continues to be monitored.

[0030] In a second aspect, the present application provides a device for controlling terminal software to decode and output a display wall, the device comprising:

[0031] An acquisition module, used for acquiring display wall data sent by the decoder and displaying the display wall data in a display wall control interface of the terminal, wherein the display wall data includes screen layout information in the display wall and different image resources in each screen;

[0032] An adjustment module, configured to adjust the position or size of a target display wall screen in the display wall control interface when a screen triggering event is detected;

[0033] A determination module, configured to determine a target screen parameter of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall;

[0034] A sending module is used to send the target screen parameters to a target decoder corresponding to the target display wall screen, so that the target decoder determines the target resource corresponding to the target display wall screen and adjusts the position or size of the target resource in the display wall according to the target screen parameters, wherein there is a corresponding relationship between the display wall screen, the image resource and the decoder.

[0035] In a third aspect, the present application provides an electronic device comprising: at least one communication interface; at least one bus connected to the at least one communication interface; at least one processor connected to the at least one bus; and at least one memory connected to the at least one bus.

[0036] In a fourth aspect, the present application further provides a computer storage medium storing computer executable instructions, wherein the computer executable instructions are used to execute the method for controlling the decoding output and display of a display wall by the terminal software described in any one of the above items of the present application.

[0037] The above technical solution provided by the embodiment of the present application has the following advantages compared with the prior art: the display wall control interface of the terminal can synchronously display the content of the display wall, and the user adjusts the position or size of the target display wall screen in the display wall control interface, thereby converting the position or size of the adjusted screen in the display wall, that is, the target screen parameter. The terminal sends the target screen parameter to the display wall through the target decoder, so that the target resources corresponding to the target display wall screen can also be displayed in the display wall according to the target screen parameter, ensuring that the adjustment operation in the display wall control interface can be synchronized to the display wall. The present application enables the user to adjust the resource layout in the display wall at any time according to actual conditions, adapt to different changes in demand, and improve the flexibility of resource display. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0040] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0041] Figure 1 A schematic diagram of a display interface for decoding on a wall provided by the prior art;

[0042] Figure 2 A schematic diagram of a control system for decoding and outputting a display wall by the terminal software provided in an embodiment of the present application;

[0043] Figure 3 A flow chart of a method for controlling a terminal software to decode and output a display wall provided in an embodiment of the present application;

[0044] Figure 4 A schematic diagram of a display wall control interface provided in an embodiment of the present application;

[0045] Figure 5 A schematic diagram of the interface after adjusting the screen provided in an embodiment of the present application;

[0046] Figure 6 A schematic diagram of a control flow of dragging resources onto a wall provided in an embodiment of the present application;

[0047] Figure 7 A schematic diagram of a control flow of resource movement or scaling provided in an embodiment of the present application;

[0048] Figure 8 A schematic diagram of a control device for decoding and outputting display on a display wall by a terminal software provided in an embodiment of the present application;

[0049] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0051] The disclosure below provides many different embodiments or examples to realize the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0052] In order to solve the problem mentioned in the background technology, according to one aspect of an embodiment of the present application, an embodiment of controlling the decoding output display of a display wall by terminal software is provided.

[0053] Optionally, in the embodiment of the present application, the control method of the terminal software for display wall decoding output display can be applied to the following Figure 2 In the hardware environment composed of terminal 201 and server 203 shown in FIG. Figure 2 As shown, the server 203 is connected to the terminal 201 via a network. The user adjusts the position or size of a display wall screen in the display wall control interface of the terminal. The server synchronously adjusts the position or size of the resources in the corresponding screen in the display wall according to the user's adjustment operation, so as to realize user-defined adjustment of the resources output by the display wall decoding. The database 205 can be set on the server or independently of the server to provide data storage services for the server 203. The above-mentioned network includes but is not limited to: wide area network, metropolitan area network or local area network, and the terminal 201 includes but is not limited to PC, mobile phone, tablet computer, etc.

[0054] In the following, in combination with a specific implementation method, a method for controlling a display wall decoding output display by a terminal software provided in an embodiment of the present application is described in detail, taking application in a terminal as an example. Figure 3 As shown, the specific steps are as follows:

[0055] Step 301: Obtain display wall data sent by the decoder and display the display wall data in the display wall control interface of the terminal, wherein the display wall data includes screen layout information in the display wall and different image resources in each screen;

[0056] Step 302: When a screen triggering event is detected, the position or size of the target display wall screen is adjusted in the display wall control interface;

[0057] Step 303: determining target screen parameters of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall;

[0058] Step 304: Send the target screen parameters to the target decoder corresponding to the target display wall screen, so that the target decoder determines the target resource corresponding to the target display wall screen, and adjusts the position or size of the target resource in the display wall according to the target screen parameters, wherein there is a corresponding relationship between the display wall screen, the image resource and the decoder.

[0059] This application can be applied to multiple fields by displaying and adjusting scenes of different resource images through a display wall, such as security monitoring such as transportation and fire protection, multi-screen remote conferencing, industrial production monitoring, etc. Users can use terminal devices to drag, zoom, and perform other operations on the content displayed on the display wall to improve the flexibility of resource display.

[0060] In the embodiment of the present application, after the terminal enters the display wall control interface, the terminal obtains the screen layout information and decoding status information of the display wall from the decoder, and then displays the obtained information on the display wall control interface of the terminal. Among them, the screen layout information is the split-screen display of multiple screens in the display wall, and the decoding status information includes the sequence number of each screen, the resource information of the resource being played on the screen, and the resource decoding status (for example, being decoded and displayed on the wall or decoded and played).

[0061] The display wall control interface is a virtual display space that simulates the structure of the display wall and allows users to preview and adjust the position and size of the selected screen on this interface.

[0062] Figure 4 This is a schematic diagram of the display wall control interface. It can be seen that the left side of the interface is multiple resources in the resource tree, and the right side of the interface is multiple independent screens. Each screen can display different image resources (such as static pictures, video streams, real-time monitoring screens, etc.), and these screens can be flexibly configured and adjusted as needed. One of the screens shows "Decoding on the wall 10404", indicating that 10404 image resources are output on this screen.

[0063] The user can drag resources from the resource tree on the left side of the interface to any screen on the right side of the interface, or set the display wall control interface to have only multiple independent screens. After the user performs a preset operation on the screen (such as single-click or double-click), jump to the resource tree and then place the selected resources on the screen.

[0064] When the terminal detects a screen trigger event, the terminal device will respond to the user's interaction with the target display wall screen and adjust the position or size of the target display wall screen in the display wall control interface. Figure 5 The following is a schematic diagram of the interface after the screen is adjusted. The screen trigger events here include but are not limited to touch or mouse operations such as dragging the screen and zooming the screen. The terminal device is not only used to display the real-time preview of the display wall, but also acts as a control center, allowing users to directly manage all display resources on the display wall through the terminal interface.

[0065] After the user adjusts the position or size of the target display wall screen in the display wall control interface, the terminal needs to further determine whether the adjusted target display wall screen has any changes in position and size compared with the target display wall screen before adjustment. If there is no change, the terminal considers that the adjustment is invalid. This may be because the user only clicked the screen but did not actually move or scale it, or the result of the adjustment happens to be the same as the original state. In this case, the terminal will continue to monitor the screen trigger event and wait for the next operation. If there is a change, then continue to execute the subsequent steps.

[0066] Since the interface sizes of the display wall control interface and the display wall are different, after the position or resources of the target display wall screen are adjusted, the screen parameters of the target display wall screen in the display wall control interface need to be converted into target screen parameters of the target display wall screen in the display wall, wherein the target screen parameters include the position and size of the target display wall screen in the display wall. More specifically, the target screen parameters can be expressed by the margin ratio of the target display wall screen in the display wall.

[0067] The target display wall screen is used to display the target resources. As the position or size of the target display wall screen in the display wall control interface is adjusted, the target resources in the display wall must also be adjusted accordingly, so as to ensure that the display wall control interface can display the content in the display wall accordingly.

[0068] Among them, there is a corresponding relationship between the display wall screen, image resources and decoder, so the target display wall screen corresponds to the target resources and the target decoder, the terminal sends the target screen parameters of the target display wall screen to the target decoder, and the target decoder outputs the target screen parameters as parameters of the target resources to the display wall, so that the display wall displays the target resources according to the target screen parameters, so that the size and position of the target resource in the display wall are consistent with the size and position of the target display wall screen in the display wall control interface.

[0069] In the present application, the display wall control interface of the terminal can synchronously display the content of the display wall. The user adjusts the position or size of the target display wall screen in the display wall control interface, thereby converting the position or size of the adjusted screen in the display wall, that is, the target screen parameters. The terminal sends the target screen parameters to the display wall through the target decoder, so that the target resources corresponding to the target display wall screen can also be displayed in the display wall according to the target screen parameters, ensuring that the adjustment operations in the display wall control interface can be synchronized to the display wall. The present application enables users to adjust the resource layout in the display wall at any time according to actual conditions, adapt to different changes in needs, and improve the flexibility of resource display.

[0070] As an optional implementation manner, before detecting the screen triggering event, the method further includes the following steps:

[0071] Step S11: according to the resource selection instruction, placing the set resources in the resource library to the set display wall screen of the display wall control interface;

[0072] Step S12: Determine and set the initial screen parameters of the display wall screen;

[0073] Step S13: converting the initial screen parameters into screen parameters of the corresponding screen in the display wall;

[0074] Step S14: By setting a setting decoder corresponding to the display wall screen, the setting resource is decoded and output to the display wall according to the converted screen parameters.

[0075] Before the screen trigger event is detected, that is, before the user performs specific adjustment operations, the terminal has completed a series of preparations in advance to ensure that the subsequent screen position or size adjustment can proceed smoothly. These preparations include: when the terminal synchronously controls the display wall, the terminal will select specific setting resources from the resource library according to the user's resource selection instructions (such as click, drag, etc.), and place them on the setting display wall screen of the display wall control interface. The setting resources here can be various types of multimedia content such as video streams, picture files, real-time monitoring images, etc.

[0076] The terminal automatically identifies the set display wall screen where the set resource is located in the display wall control interface, and calculates the initial screen parameters of the set display wall screen, including but not limited to the width, height, position coordinates and other information of the screen. These parameters will be used for subsequent conversion calculations to ensure the correct display of resources on the display wall.

[0077] Since the display wall control interface and the actual display wall may have different sizes, it is necessary to convert the initial screen parameters of the display wall screen to the screen parameters that adapt to the display wall. This conversion process involves mathematical operations such as scaling and coordinate mapping to ensure that the adjustments in the display wall control interface can be accurately reproduced on the actual display wall. In this way, users can get a consistent operating experience even if the terminal device and the display wall have different physical sizes.

[0078] The terminal sends the converted screen parameters to the set decoder corresponding to the set display wall screen, and the set decoder decodes the set resources according to the converted screen parameters and outputs them to the display wall. The operation step of sending the screen parameters to the decoder can be completed by the terminal or the server. If the terminal implements this step, then if the terminal directly establishes a connection with the decoder (for example, through a network interface) and supports the corresponding protocol, it can send the decoding wall information to the decoder. After receiving the video stream, the decoder decodes it and outputs the resources to a specific area on the display wall according to the screen parameters.

[0079] As the system expands, multiple terminals directly controlling different decoders at the same time may lead to resource conflicts and management confusion. Therefore, the server can be used as a central controller to uniformly manage and schedule all decoders and resources. The process of server management and scheduling decoders and resources is as follows:

[0080] Step S141: Determine the set decoder information and set resource information corresponding to the set display wall screen according to the preset corresponding relationship;

[0081] Step S142: constructing decoding wall information according to the set decoder information, the set resource information and the converted screen parameters, wherein the decoding wall information is used to notify the server to use the specified decoder to output the corresponding resource to the corresponding position of the display wall;

[0082] Step S143: Send the decoded wall information to the server, so that the server forwards the setting resource information and the converted screen parameters to the setting decoder, and the setting decoder sends the setting resources to the display wall according to the setting resource information and displays the setting resources according to the converted screen parameters.

[0083] There is a correspondence between display wall screens, image resources, and decoders, and this correspondence is stored in a configuration file or database. Display wall screens are usually screen numbers. Image resource information is an important part of building decoding wall information, which includes but is not limited to resource ID, resource type (such as video stream, picture file), encoding format (such as H.264, JPEG), frame rate and resolution, etc. This information is used to identify the resource and instruct the decoder how to process the resource. Decoder information usually includes the decoder's IP address, port number, supported encoding formats, etc. Each decoder has its own specific capabilities and limitations, so accurate decoder information is critical to ensure that resources can be decoded correctly.

[0084] The terminal reads the set decoder information and set resource information corresponding to the set display wall screen from the configuration file or database, and then integrates the set decoder information, set resource information and converted screen parameters into a complete decoding wall information. The decoding wall information not only includes the source and final display position of the set resource, but also clarifies how the resource should be decoded and displayed. For example, it may specify which decoder to use, at which screen position on the display wall, and at what size to display the resource.

[0085] The terminal sends the decoded wall information to the server through the network interface. This process is usually asynchronous, which means that there is no need to wait for an immediate response after sending the request, so as not to affect the user's continued operation. After receiving the decoded wall information, the server parses the converted screen parameters, setting resource information and the specific decoder to be used, and then forwards the setting resource information and the converted screen parameters to the specified setting decoder. The server acts as an intermediate coordinator, responsible for ensuring that the information is correctly transmitted to the correct decoder. After receiving the setting resource information and the converted screen parameters, the setting decoder starts the decoding process. After the decoding is completed, the setting decoder sends the setting resources to the display wall and displays the position and size of the setting resources strictly according to the converted screen parameters.

[0086] In a complex multi-screen display environment, the server is not directly responsible for the final output of resources. The server is mainly responsible for the management and distribution of resources. The actual resource generation and display are completed by each independent decoder. On the one hand, this approach allows the system to be more flexibly expanded and maintained, while also reducing the pressure on the server. On the other hand, since the decoders are close to the physical display device (i.e., the display wall), they can directly control the position and size of the resource output. This approach reduces signal transmission delay and makes it easier to achieve high-precision display control.

[0087] In this application, when the terminal initializes the control of the display wall, the user can select resources and perform preliminary layout settings, and the user can instantly see the effect of resource placement on the display wall control interface. In addition, by converting the interface parameters between the display wall control interface and the display wall, no matter how large the physical difference between the terminal device and the display wall is, it can ensure that the user's operation on the display wall control interface can be accurately reflected on the actual display wall, maintaining the consistency and reliability of the operation.

[0088] As an optional implementation, in step 304, sending the target screen parameter to the target decoder corresponding to the target display wall screen includes:

[0089] Step S21: constructing a decoding movement request according to the target screen parameters and the decoding wall information corresponding to the target display wall resource, wherein the decoding movement request is used to adjust the position or size of the target resource in the display wall;

[0090] Step S22: Send a decoding movement request to the server, so that the server sends the target screen parameters to the target decoder according to the decoding wall information corresponding to the target display wall resources, and the target decoder adjusts the position or size of the target resources in the display wall according to the target screen parameters.

[0091] After the user adjusts the position or size of the target display wall screen through the display wall control interface, the terminal extracts the new position and size information of the target display wall screen, namely the target screen parameters. These parameters are the final display effect of the target resource that the user wants to display on the display wall, including specific values ​​such as the width, height, and coordinates of the target display wall screen.

[0092] The decoding video wall information contains the relevant configurations of the target resource previously set, such as decoder ID, resource ID, and encoding format, etc. The terminal combines this information with the newly obtained target screen parameters to ensure that the decoding mobile request can accurately point to the resource that needs to be adjusted and its corresponding decoder.

[0093] The terminal integrates the above target screen parameters and decoding wall information to construct a complete decoding movement request. This request not only specifies the target resource to be adjusted, but also specifies the new position and size parameters, as well as the specific decoder responsible for performing the adjustment task. In addition, the decoding movement request may also include other auxiliary information, such as timestamps, priorities, etc., to optimize the processing order and improve the response speed.

[0094] The terminal sends the decoding movement request to the server through the network interface. After receiving the decoding movement request, the server parses the target resource, target screen parameters and responsible decoder that need to be adjusted. Then, the server sends the target screen parameters together with the necessary resource information to the corresponding target decoder. After receiving this information, the target decoder starts to perform specific adjustment tasks and adjusts the position or size of the target resource in the display wall according to the target screen parameters.

[0095] This application constructs a decoding movement request based on the target screen parameters and decoding wall information, and sends the request to the server to adjust the position or size of the target resource. In this way, users can adjust the layout of resources at any time according to actual conditions to meet the needs of different application scenarios. At the same time, the decoder can flexibly respond to various resource types and display requirements, which enhances the scope of application of the system.

[0096] As an optional implementation, after the decoding wall information is displayed or the decoding movement request is sent to the server, the method also includes: obtaining a decoding status notification fed back by the server, wherein the decoding status notification is obtained by the server from the decoder, and the decoding status notification is used to indicate a successful decoding or a failed decoding; and updating the current decoding status in the display wall control interface according to the decoding status notification.

[0097] After receiving the decoding wall information or decoding mobile request, the server will forward it to the corresponding decoder to perform the specific decoding task. Once the decoding task is completed, whether successful or not, the decoder will send a decoding status notification to the server. This notification contains detailed decoding result information, such as whether the decoding is successful, the reason for failure (if any), the new resource location and size, etc. After receiving this information, the server will organize it into a unified format of decoding status notification and return it to the terminal through the network interface.

[0098] After receiving the decoding status notification, the terminal first parses it to extract key information. For example, for a successful decoding notification, the terminal can know that the resources have been adjusted in place as expected; and for a failed decoding notification, the terminal can obtain a specific error code or message to help locate the problem.

[0099] According to the content of the decoding status notification, the terminal will update the current decoding status in the display wall control interface, which includes but is not limited to the resource layout of each screen on the display wall, the position and size of each resource, etc. If the decoding is successful, the new position or new size of the resource will be immediately reflected on the display wall control interface, for example, the following will be displayed on the corresponding screen: position is xx, size is xx; if the decoding fails, the display wall control may display an error prompt and provide options for retrying or other solutions.

[0100] In this application, a real-time feedback mechanism of the decoding status is used to enable users to know the decoding operation results in a timely manner, thereby improving the user experience.

[0101] As an optional implementation, in step 303, determining the target screen parameters of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall includes:

[0102] Step S31: determining a margin ratio of the target display wall screen in the display wall control interface according to the size of the display wall control interface and the adjusted target display wall screen;

[0103] Step S32: Determine the screen size and screen position of the target display wall screen in the display wall according to the interface size of the display wall and the margin ratio of the target display wall screen.

[0104] The terminal first reads the total width and height of the current display wall control interface, which is the virtual display space of the simulated display wall on the terminal interface. The user adjusts the target display wall screen on the display wall control interface (such as dragging or scaling), and the terminal will record the new position (i.e., the upper left corner coordinates) and new size (width and height) of the adjusted target display wall screen. The terminal calculates the margin ratio of the target display wall screen relative to the four sides of the display wall control interface, including: left margin ratio, top margin ratio, right margin ratio, and bottom margin ratio.

[0105] After calculating the margin ratio, the terminal reads the actual size of the display wall from the configuration file or database, including the total width and total height, and then applies the previously calculated margin ratio of the target display wall screen to the actual size of the display wall to calculate the exact position and size of the target display wall screen in the display wall. For example: actual left margin = total width of the display wall * left margin ratio. Through the above calculation, the terminal can determine the exact screen size (width and height) and screen position (upper left corner coordinates) of the target display wall screen in the display wall. These parameters will be used for subsequent decoding output control to ensure that the resources can be displayed correctly as the user intends.

[0106] Through strict mathematical calculations, this application ensures that the user's operations on the display wall control interface can be accurately reflected on the actual display wall, ensuring the consistency and accuracy of the layout. Even if the display wall and the terminal interface are of different sizes, the terminal can respond flexibly, allowing users to adjust the layout at any time according to actual conditions to meet the needs of different application scenarios.

[0107] This application provides a schematic diagram of the control process of dragging resources onto the wall, such as Figure 6 As shown, the following steps are included:

[0108] Step 1: Drag the set resources to the display wall control interface.

[0109] The terminal enters the display wall control interface and monitors whether the user drags the set resource from the resource tree to the display wall control interface through the mouse or other input devices.

[0110] Step 2: Determine and set the position and size of the display wall screen in the display wall control interface.

[0111] When the user drags the resource, the terminal will track the current position of the mouse in real time, and determine the set display wall screen that the set resource enters according to the movement of the mouse, and determine the position and size of the set display wall screen in the display wall control interface.

[0112] Step 3: Calculate and set the position and size of the display wall screen in the display wall.

[0113] The terminal converts the position and size of the display wall screen adjusted in the display wall control interface to the position and size of the actual display wall. This step involves the calculation of the margin ratio to ensure that the resources can be accurately mapped to the actual display wall.

[0114] Step 4: Construct and decode the wall information.

[0115] According to the converted position, size, decoder information and resource information of the set resource, the terminal constructs decoding video wall information, which includes resource ID, decoder ID, new position coordinates, size and other parameters, and possible other configuration information.

[0116] Step 5: Request decoding and upload to the video wall.

[0117] The terminal sends the constructed decoding video wall information to the server, requesting the server to perform the decoding video wall operation. After receiving the request, the server will process the request and perform the corresponding decoding task.

[0118] Step 6: The server decodes and uploads the video to the video wall.

[0119] The server decodes the resource based on the received decoding wall information and displays it on the actual display wall at the specified position and size. This process involves the decoder working together to ensure that the resource can be displayed correctly.

[0120] Step 7: Receive decoding status notification.

[0121] After the server completes the decoding and video wall operation, it will send a decoding status notification to the terminal. This notification contains information on whether the decoding is successful, as well as possible error codes or messages.

[0122] Step 8: Update the current decoding status in the display wall control interface.

[0123] After receiving the decoding status notification, the terminal parses the data. If the decoding is successful, the display wall control interface will show the new position and size of the resource; if the decoding fails, the display wall control interface may display an error prompt and provide options for retrying or other solutions.

[0124] This application provides a schematic diagram of a control flow of resource movement or scaling, such as Figure 7 As shown, the following steps are included:

[0125] Step 1: Monitor screen trigger events.

[0126] The user selects the target display wall screen to be moved or scaled on the display wall control interface of the terminal, and starts the dragging or scaling operation through a mouse or other input device.

[0127] Step 2: Record the adjusted position and size of the target display wall screen.

[0128] The terminal records in real time the new position and size of the target display wall screen during the user's dragging or zooming process. This information will be used for subsequent calculations and adjustments.

[0129] Step 3: The user finishes dragging or scaling the target display wall screen.

[0130] After the user completes the dragging or scaling operation, the terminal stops recording the new position and size information.

[0131] Step 4: Determine whether the position and size of the target display wall screen have changed.

[0132] The terminal compares the current recorded position and size with the previous state to determine whether there is an actual change. If there is no change, it continues to monitor the screen trigger event and waits for the next operation. If there is a change, it goes to step 5.

[0133] Step 5: Calculate the position and size of the target display wall screen.

[0134] Based on the new position and size information, the terminal performs necessary conversions to ensure that the information can be accurately mapped to the actual display wall.

[0135] Step 6: Construct the decoded movement information.

[0136] The terminal constructs a data packet of a decoding movement request based on the converted screen position and size information and the decoded wall information of the target display wall screen. These data packets contain key parameters such as the new position and new size of the screen.

[0137] Step 7: A screen move request occurs.

[0138] The constructed decoding and moving request is sent to the server, requesting the server to perform corresponding decoding and moving operations.

[0139] Step 8: The server decodes and outputs the size and location of the target resource.

[0140] After receiving the decoding movement request, the server processes the request and analyzes the target decoder for executing the operation. The target decoder decodes the screen according to the specified new position and size and displays it on the actual display wall.

[0141] Step 9: Get the decoded output notification.

[0142] After the target decoder completes the decoding and moving operations, it sends a decoding output notification to the terminal through the server, informing whether the screen movement is successful and possible error information.

[0143] Step 10: Parse the notification data and display it.

[0144] After receiving the decode output notification, the terminal parses the data. If the decoding is successful, the new position and size of the display wall control interface will be updated; if the decoding fails, the display wall control interface may display an error prompt and provide options for retrying or other solutions.

[0145] Based on the same technical concept, the present application provides a control device for terminal software to decode and output display of a display wall, such as Figure 8 As shown, the device comprises:

[0146] An acquisition module 801 is used to acquire display wall data sent by the decoder and display the display wall data in a display wall control interface of the terminal, wherein the display wall data includes screen layout information in the display wall and different image resources in each screen;

[0147] An adjustment module 802, configured to adjust the position or size of a target display wall screen in a display wall control interface when a screen triggering event is detected;

[0148] A determination module 803 is used to determine the target screen parameters of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen and the interface size of the display wall;

[0149] The sending module 804 is used to send the target screen parameters to the target decoder corresponding to the target display wall screen, so that the target decoder determines the target resource corresponding to the target display wall screen and adjusts the position or size of the target resource in the display wall according to the target screen parameters, wherein there is a corresponding relationship between the display wall screen, the image resource and the decoder.

[0150] Optionally, the device is also used for:

[0151] According to the resource selection instruction, the set resources in the resource library are placed on the set display wall screen of the display wall control interface;

[0152] Determine and set the initial screen parameters of the display wall screen;

[0153] Convert the initial screen parameters into the screen parameters of the corresponding screen in the display wall;

[0154] By setting the setting decoder corresponding to the display wall screen, the setting resource is decoded and output to the display wall according to the converted screen parameters.

[0155] Optionally, the device is also used for:

[0156] According to the preset corresponding relationship, determine the set decoder information and the set resource information corresponding to the set display wall screen;

[0157] Constructing decoding wall information according to the set decoder information, the set resource information and the converted screen parameters, wherein the decoding wall information is used to notify the server to use the specified decoder to output the corresponding resource to the corresponding position of the display wall;

[0158] The decoded wall information is sent to the server, so that the server forwards the setting resource information and the converted screen parameters to the setting decoder. The setting decoder sends the setting resources to the display wall according to the setting resource information and displays the setting resources according to the converted screen parameters.

[0159] Optionally, the sending module 804 is used to:

[0160] Constructing a decoding movement request according to the target screen parameters and the decoding wall information corresponding to the target display wall resource, wherein the decoding movement request is used to adjust the position or size of the target resource in the display wall;

[0161] Send a decoding movement request to the server, so that the server sends the target screen parameters to the target decoder according to the decoding wall information corresponding to the target display wall resource, and the target decoder adjusts the position or size of the target resource in the display wall according to the target screen parameters.

[0162] Optionally, the device is also used for:

[0163] Obtaining a decoding status notification fed back by the server, wherein the decoding status notification is obtained by the server from the decoder, and the decoding status notification is used to indicate decoding success or decoding failure;

[0164] Update the current decoding status in the display wall control interface according to the decoding status notification.

[0165] Optionally, the determination module 803 is used to:

[0166] Determine the margin ratio of the target display wall screen in the display wall control interface according to the size of the display wall control interface and the adjusted target display wall screen;

[0167] The screen size and screen position of the target display wall screen in the display wall are determined according to the interface size of the display wall and the margin ratio of the target display wall screen.

[0168] Optionally, the device is also used for:

[0169] If the position and size of the target display wall screen after adjustment are not changed from those before adjustment, the screen triggering event continues to be monitored.

[0170] like Fig. 9As shown, an embodiment of the present application provides an electronic device, including a processor 901, a communication interface 902, a memory 903 and a communication bus 904, wherein the processor 901, the communication interface 902, and the memory 903 communicate with each other through the communication bus 904.

[0171] The memory 903 is used to store computer programs.

[0172] In one embodiment of the present application, the processor 901 is used to implement the control method for the terminal software to decode and output the display wall provided by any one of the aforementioned method embodiments when executing the program stored in the memory 903.

[0173] The embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method for controlling the terminal software to decode and output the display wall provided in any of the aforementioned method embodiments are implemented.

[0174] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0175] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0176] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0177] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.

Claims

1. A method for controlling the decoding output and display of a display wall by terminal software, characterized in that: The method comprises: Acquire display wall data sent by the decoder and display the display wall data in a display wall control interface of the terminal, wherein the display wall data includes screen layout information in the display wall and different image resources in each screen; When a screen triggering event is detected, adjusting the position or size of the target display wall screen in the display wall control interface; Determining target screen parameters of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall; The target screen parameters are sent to a target decoder corresponding to the target display wall screen, so that the target decoder determines the target resource corresponding to the target display wall screen, and adjusts the position or size of the target resource in the display wall according to the target screen parameters, wherein there is a corresponding relationship between the display wall screen, the image resource and the decoder.

2. The method according to claim 1, characterized in that Before detecting the screen triggering event, the method further includes: According to the resource selection instruction, the set resources in the resource library are placed on the set display wall screen of the display wall control interface; Determining the initial screen parameters of the setting display wall screen; Converting the initial screen parameters into screen parameters of a corresponding screen in the display wall; The setting resource is decoded and output to the display wall according to the converted screen parameters through the setting decoder corresponding to the setting display wall screen.

3. The method according to claim 2, characterized in that The step of decoding the setting resource according to the converted screen parameters and outputting it to the display wall through the setting decoder corresponding to the setting display wall screen comprises: Determining the set decoder information and the set resource information corresponding to the set display wall screen according to the preset corresponding relationship; Constructing decoding wall information according to the set decoder information, the set resource information and the converted screen parameters, wherein the decoding wall information is used to notify the server to use a specified decoder to output corresponding resources to a corresponding position of the display wall; The decoded wall display information is sent to a server, so that the server forwards the setting resource information and the converted screen parameters to the setting decoder. The setting decoder sends the setting resources to the display wall according to the setting resource information and displays the setting resources according to the converted screen parameters.

4. The method according to claim 3, characterized in that Sending the target screen parameter to a target decoder corresponding to the target display wall screen includes: Constructing a decoding movement request according to the target screen parameter and the decoding wall information corresponding to the target display wall resource, wherein the decoding movement request is used to adjust the position or size of the target resource in the display wall; The decoding movement request is sent to the server, so that the server sends the target screen parameters to the target decoder according to the decoded wall information corresponding to the target display wall resource, and the target decoder adjusts the position or size of the target resource in the display wall according to the target screen parameters.

5. The method according to claim 3 or 4, characterized in that: After the decoding wall information or the decoding mobile request is sent to the server, the method further includes: Obtaining a decoding status notification fed back by the server, wherein the decoding status notification is obtained by the server from the decoder, and the decoding status notification is used to indicate a decoding success or a decoding failure; The current decoding status in the display wall control interface is updated according to the decoding status notification.

6. The method according to claim 2, characterized in that Determining target screen parameters of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall includes: Determining a margin ratio of the target display wall screen in the display wall control interface according to the size of the display wall control interface and the adjusted target display wall screen; The screen size and screen position of the target display wall screen in the display wall are determined according to the interface size of the display wall and the margin ratio of the target display wall screen.

7. The method according to claim 1, characterized in that After sending the target screen parameters to the target decoder corresponding to the target display wall screen, the method further includes: If the position and size of the target display wall screen after adjustment are not changed from those before adjustment, the screen triggering event continues to be monitored.

8. A control device for decoding and outputting display of a display wall by terminal software, characterized in that: The device comprises: An acquisition module, used for acquiring display wall data sent by the decoder and displaying the display wall data in a display wall control interface of the terminal, wherein the display wall data includes screen layout information in the display wall and different image resources in each screen; An adjustment module, configured to adjust the position or size of a target display wall screen in the display wall control interface when a screen triggering event is detected; A determination module, configured to determine a target screen parameter of the target display wall screen in the display wall according to the interface size of the display wall control interface, the adjusted target display wall screen, and the interface size of the display wall; A sending module is used to send the target screen parameters to a target decoder corresponding to the target display wall screen, so that the target decoder determines the target resource corresponding to the target display wall screen and adjusts the position or size of the target resource in the display wall according to the target screen parameters, wherein there is a corresponding relationship between the display wall screen, the image resource and the decoder.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing any of the methods described in claims 1-7 when executing a program stored in a memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images