Fine-grained graph packaging complex collaboration method and system based on UE5

Abstract

The invention provides a UE5-based fine-grained graph packaging complex collaboration method and system. The method comprises the following steps: connecting studio graph packaging control software to a UE5-based intermediate plug-in; using studio graphic package control software to obtain graphic package UMG parameters in the graphic package project exposed by the intermediate plug-in, and performing custom operation on the graphic package UMG parameters to render the graphic package according to a custom preset value; after the user-defined operation is completed, a control command is sent to control the graphic package to be rendered; starting to render the online package, and controlling the graphic package to be added and displayed on a certain layer of the output picture; the rendered online package is deleted, and the graphic package is deleted from a certain layer of the output picture and is not displayed; the exposed variables within the graphics package are updated and the performance function is executed. According to the method, a complex graphic packaging engine does not need to be directly operated any more, rendering of graphic packaging is controlled through one key in an automatic mode, and complex collaboration of multiple packages is achieved.

Description

Technical Field

[0001] The present invention relates to the field of graphics packaging technology, and in particular to a UE5-based fine-grained graphics packaging complex collaboration method and system. Background Art

[0002] The design background of the complex collaborative technology of fine-grained graphics packaging based on Unreal Engine 5 (UE5) stems from the demand for high-quality graphics processing and multi-person collaborative work in modern film and television production, graphics packaging, virtual reality and other fields. With the continuous improvement of the complexity of 3D graphics and the details of scenes, traditional rendering and graphics packaging methods face performance bottlenecks, and it is difficult to achieve efficient real-time rendering while ensuring image quality. At the same time, the scale of projects is getting larger and larger, and multi-person team collaboration is becoming more and more complex. Traditional development tools are insufficient in data synchronization, real-time editing and version control, and cannot meet the collaboration needs in complex scenarios. At the same time, in the broadcasting industry, the control method of graphics packaging often cannot be automated, which greatly increases the work intensity of the director and increases the broadcast error rate. Therefore, the complex collaborative technology of fine-grained graphics packaging based on UE5 came into being.

[0003] Although the fine-grained graphics packaging complex collaborative technology based on UE5 has many advantages in improving work efficiency and graphics rendering effects, it also has some potential defects and challenges. For example: (1) Compared with the traditional graphics packaging control method, the fine-grained graphics packaging complex collaborative technology is more powerful and more convenient to operate, but operators need to be specially trained before they can use it; (2) The operation of fine-grained graphics packaging complex collaborative technology is highly dependent on the stability of the network. If the network environment has high latency, the control of graphics packaging will be affected to a certain extent. Summary of the invention

[0004] In order to overcome the deficiencies of the prior art, the purpose of the present invention is to provide a complex collaboration method and system for fine-grained graphics packaging based on UE5, which can control the rendering of graphics packaging with one click in an automated manner to achieve complex collaboration of multiple packages.

[0005] To achieve the above object, the present invention provides the following solutions:

[0006] A fine-grained graphics packaging complex collaboration method based on UE5, including:

[0007] Connect the studio graphics packaging control software to the middleware plugin running on UE5 via TCP;

[0008] Using the studio graphics packaging control software to obtain the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in, and performing custom operations on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the custom preset values;

[0009] Send control commands after the custom operation is completed to control the graphics package for rendering;

[0010] Start rendering online packaging, control the graphics packaging to add a layer displayed on the output screen;

[0011] Delete the rendered online packaging, and delete the graphic packaging from a layer in the output screen so that it is not displayed;

[0012] Update the exposed variables in the graphics package and execute the function; the function is used to execute the function exposed by the graphics package.

[0013] Preferably, the graphics packaging UMG parameters in the graphics packaging project are exposed by the intermediate plug-in using the studio graphics packaging control software, including:

[0014] When making a graphics package in the UE5 editor, set the parameters to be exposed to an externally visible state, and bind the made graphics package to the blueprint in the intermediate plug-in;

[0015] When the UE5 project is started, scan all graphics packages bound to the blueprints in the intermediate plug-in and cache the bound graphics packages into the global object;

[0016] When the TCP module receives the query command, it takes out all the graphic packages from the global object cache, parses the graphic packages and all externally visible state parameters into a command in JSON format and returns it to the client.

[0017] Preferably, the global object is a container for storing the graphic package to be controlled by the client.

[0018] Preferably, the externally visible state is a state of whether the parameters in the graphic packaging blueprint can be used externally; the intermediate plug-in uses the externally visible state to distinguish whether the parameters need to be exposed.

[0019] Preferably, the control command is generated by the client according to a pre-defined protocol.

[0020] A fine-grained graphics packaging complex collaboration method based on UE5, including:

[0021] A connection unit for connecting the studio graphics packaging control software to the middleware plug-in running on UE5 via TCP;

[0022] A customization unit, used for obtaining the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in by using the studio graphics packaging control software, and performing a customization operation on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the customized preset values;

[0023] A rendering unit, used to send a control command after the custom operation is completed to control the graphics package to render;

[0024] The display unit is used to start rendering the online package and control the graphics package to add a layer displayed on the output screen;

[0025] The deletion unit is used to delete the rendered online packaging, and delete the graphic packaging from a certain layer of the output screen so that it is not displayed;

[0026] The function unit is used to update the variables exposed in the graphic package and execute the function function; the function function is used to execute the function exposed by the graphic package.

[0027] According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects:

[0028] The present invention provides a complex coordination method and system for fine-grained graphics packaging based on UE5, the method comprising: connecting the studio graphics packaging control software to an intermediate plug-in running on UE5 through TCP; using the studio graphics packaging control software to obtain the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in, and performing a custom operation on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the custom preset value; sending a control command after the custom operation is completed to control the graphics packaging to render; starting to render online packaging, controlling the graphics packaging to add a layer displayed on the output screen; deleting the rendered online packaging, deleting the graphics packaging from a layer of the output screen without displaying it; updating the exposed variables in the graphics packaging, and executing a function function; the function function is used to execute the function exposed by the graphics packaging. The present invention has good operational convenience, and the director staff no longer needs to directly operate the complex graphics packaging engine, and can use an automated method to control the rendering of the graphics packaging with one key, thereby realizing complex coordination of multiple packages. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0030] Figure 1A flow chart of a method provided by an embodiment of the present invention;

[0031] Figure 2 A schematic diagram of the system structure provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0033] The purpose of the present invention is to provide a complex coordination method and system for fine-grained graphics packaging based on UE5, which can control the rendering of graphics packaging with one click in an automated manner to achieve complex coordination of multiple packages.

[0034] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0035] Figure 1 A flow chart of a method provided by an embodiment of the present invention, such as Figure 1 As shown, the present invention provides a fine-grained graphics packaging complex collaboration method based on UE5, including:

[0036] Step 100: Connect the studio graphics packaging control software to the intermediate plug-in running on UE5 through TCP;

[0037] Step 200: using the studio graphics packaging control software to obtain the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in, and performing a custom operation on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the custom preset values;

[0038] Step 300: Send a control command after the custom operation is completed to control the graphics package to render;

[0039] Step 400: Start rendering the online package, and control the graphic package to add a layer displayed on the output screen;

[0040] Step 500: Delete the rendered online package, and delete the graphic package from a certain layer of the output screen so that it is not displayed;

[0041] Step 600: Update the exposed variables in the graphic package and execute the function; the function is used to execute the function exposed by the graphic package.

[0042] Specifically, in order to realize the application of UE5-based fine-grained graphic packaging complex collaborative technology in the studio, the communication and information transmission between the studio graphic packaging control software and UE5 are all through the network. This method is only realized through the self-developed plug-in (middle plug-in) running on UE5. The plug-in is the middleware between the studio graphic packaging control software and UE5, and all subsequent controls and operations need to be implemented through this software.

[0043] Optionally, the graphic packaging is a technology that dynamically superimposes visual elements such as graphics, animations, and subtitles onto video signals in real-time scenes such as live TV or virtual studios. It can instantly generate and present visual effects based on real-time data or preset rules without affecting live broadcasts.

[0044] Furthermore, UE5 (Unreal Engine 5) is an advanced real-time 3D engine designed for high-precision graphics applications such as film and television production, virtual reality (VR) and augmented reality (AR). It plays a key role in online packaging. Through its powerful real-time rendering capabilities and highly realistic graphics performance, it can dynamically generate and superimpose complex visual effects, animations and virtual scenes. UE5 can efficiently process online packaging in high resolution and complex environments, while supporting cross-platform and multi-user collaboration, making online packaging more flexible and visual effects more immersive. It is widely used in virtual studios, real-time live broadcasts and interactive content production.

[0045] Furthermore, the studio graphics packaging control software of this embodiment refers to a software that can connect to a self-developed plug-in running on UE5 through TCP, and send graphics packaging control commands to the plug-in.

[0046] Specifically, a method for implementing a fine-grained graphics packaging complex collaboration technology based on UE5 in this embodiment includes the following steps:

[0047] ① The studio graphic packaging control software is connected to the self-developed plug-in running on UE5 via TCP. Green represents a successful connection and red represents a failed connection. For example, in order for the graphic packaging control software to control the UE5 engine, a TCP connection must be established. The middleware can connect the two systems to achieve control.

[0048] ②After the connection is successful, the studio graphics packaging control software will obtain the graphics packaging UMG parameters in the graphics packaging project exposed by the self-developed plug-in. The exposed parameters of the graphics packaging can be customized to allow the graphics packaging to be rendered according to the customized preset values; for example, the exposed parameters specifically refer to some variables used to change all displayed text content of the graphics packaging, or trigger the behavior of the graphics packaging. The client changes the content or behavior of the graphics packaging by passing these parameters.

[0049] ③After the settings are completed, send the control command to control the graphics packaging rendering;

[0050] ④ Start rendering the online package (Take), control the graphics package to add a layer displayed on the output screen; demonstratively, this step of this embodiment and the following steps are to implement different forms of control commands for the graphics package, and different controls on the graphics package are achieved through these commands, so that the graphics package can make corresponding responses.

[0051] ⑤ Delete the rendered online packaging (TakeOut), and delete the graphic packaging from a certain layer in the output screen;

[0052] ⑥Update parameters (Update), update the variables in the graphic package. The variables can be exposed or not when designing the graphic package. This command can only modify the exposed variables;

[0053] ⑦Execute Function (Execute), this command can execute the Function exposed by the graphic package;

[0054] Furthermore, the graphics package (UMG) refers to Unreal Motion Graphics, which is a system in Unreal Engine for creating and managing user interfaces (UI) and interactive elements. It can be used as a graphics package for broadcasting and television. Function is a special structure used to encapsulate and reuse blueprint logic, similar to functions or methods in traditional programming languages. It allows a section of blueprint logic to be defined and then called multiple times where needed. Function (Execute) is a function function here, which defines the behavior of the graphics package when it is designed. Then, the function function is called during external control to trigger the behavior of the graphics package. Therefore, the function function is customized by the designer of the graphics package. There is no specific formula or algorithm code.

[0055] The specific algorithm for exposing UMG parameters in step ② is:

[0056] I. When making a graphics package in the UE5 editor, set the parameters that need to be exposed to an externally visible state, and bind the graphics package to the blueprint in the plug-in; demonstratively, the externally visible state refers to whether the parameters in the graphics package blueprint can be used externally, and the plug-in uses this state to distinguish whether the parameters need to be exposed.

[0057] II. When the UE5 project is started, scan all graphics packages bound to the plug-in blueprint and cache the bound graphics packages into the global object;

[0058] III. When the TCP module receives the query command, it takes out all the graphic packages from the global object cache, parses the graphic packages and all externally visible state parameters into JSON format commands and returns them to the client; exemplary, the global objects involved in steps II and III refer to the graphic package containers that need to be controlled by the client. The global objects are initialized when the project is started.

[0059] Specifically, during the operation of this embodiment, automated graphics packaging control software, middleware and UE5 engine are required. With this middleware, the director does not need to directly operate the complex graphics packaging engine, and can achieve control through a simple page of the graphics packaging control software.

[0060] Furthermore, this embodiment allows multiple people to collaboratively edit and delete in real time, so that multiple people can operate the same object or scene, modify parameters, control up and down, and other operations.

[0061] Corresponding to the above method, this embodiment further provides a fine-grained graphics packaging complex collaboration method based on UE5, including:

[0062] A connection unit for connecting the studio graphics packaging control software to the middleware plug-in running on UE5 via TCP;

[0063] A customization unit, used for obtaining the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in by using the studio graphics packaging control software, and performing a customization operation on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the customized preset values;

[0064] A rendering unit, used to send a control command after the custom operation is completed to control the graphics package to render;

[0065] The display unit is used to start rendering the online package and control the graphics package to add a layer displayed on the output screen;

[0066] The deletion unit is used to delete the rendered online packaging, and delete the graphic packaging from a certain layer of the output screen so that it is not displayed;

[0067] The function unit is used to update the variables exposed in the graphic package and execute the function function; the function function is used to execute the function exposed by the graphic package.

[0068] The beneficial effects of the present invention are as follows:

[0069] (1) The UE5-based fine-grained graphics packaging complex collaboration technology provided by the present invention has good operational convenience. The director no longer needs to directly operate the complex graphics packaging engine. He can use an automated method to control the rendering of the graphics packaging with one click to achieve complex collaboration of multiple packages.

[0070] (2) The UE5-based fine-grained graphics packaging complex collaborative technology provided by the present invention can support simultaneous operations on the same scene or object, and realize rapid changes in graphics packaging parameters.

[0071] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0072] The principles and implementation methods of the present invention are described in this article using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present invention. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A fine-grained graphics packaging complex collaboration method based on UE5, characterized in that: include: Connect the studio graphics packaging control software to the middleware plugin running on UE5 via TCP; Using the studio graphics packaging control software to obtain the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in, and performing custom operations on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the custom preset values; Send control commands after the custom operation is completed to control the graphics package for rendering; Start rendering online packaging, control the graphics packaging to add a layer displayed on the output screen; Delete the rendered online packaging, and delete the graphic packaging from a layer in the output screen so that it is not displayed; Update the exposed variables in the graphics package and execute the function; the function is used to execute the function exposed by the graphics package.

2. The UE5-based fine-grained graphics packaging complex collaboration method according to claim 1, characterized in that: The intermediate plug-in is used to obtain the graphics packaging UMG parameters in the graphics packaging project by using the studio graphics packaging control software, including: When making a graphics package in the UE5 editor, set the parameters to be exposed to an externally visible state, and bind the made graphics package to the blueprint in the intermediate plug-in; When the UE5 project is started, scan all graphics packages bound to the blueprints in the intermediate plug-in and cache the bound graphics packages into the global object; When the TCP module receives the query command, it takes out all the graphic packages from the global object cache, parses the graphic packages and all externally visible state parameters into a command in JSON format and returns it to the client.

3. The UE5-based fine-grained graphics packaging complex collaboration method according to claim 2, characterized in that: The global object is a container for storing graphic packages to be controlled by the client.

4. The UE5-based fine-grained graphics packaging complex collaboration method according to claim 2, characterized in that: The externally visible state is the state of whether the parameters in the graphic packaging blueprint can be used externally; the intermediate plug-in uses the externally visible state to distinguish whether the parameters need to be exposed.

5. The UE5-based fine-grained graphics packaging complex collaboration method according to claim 1, characterized in that: The control command is generated by the client according to a pre-defined protocol.

6. A fine-grained graphics packaging complex collaboration method based on UE5, characterized in that: include: A connection unit for connecting the studio graphics packaging control software to the middleware plug-in running on UE5 via TCP; A customization unit, used for obtaining the graphics packaging UMG parameters in the graphics packaging project exposed by the intermediate plug-in by using the studio graphics packaging control software, and performing a customization operation on the graphics packaging UMG parameters so that the graphics packaging is rendered according to the customized preset values; A rendering unit, used to send a control command after the custom operation is completed to control the graphics package to render; The display unit is used to start rendering the online package and control the graphics package to add a layer displayed on the output screen; The deletion unit is used to delete the rendered online packaging, and delete the graphic packaging from a certain layer of the output screen so that it is not displayed; The function unit is used to update the variables exposed in the graphic package and execute the function function; the function function is used to execute the function exposed by the graphic package.

Images