Modeling method and device based on display screen, computer equipment and storage medium
By dividing the display into rendering partitions and modeling based on the partition grid parameters, the problem of deviation between the display modeling results and the actual effect is solved, and the modeling efficiency and accuracy are improved.
Patent Information
- Application Number
- CN202510422793.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-03
- Publication Date
- 2025-07-11
AI Technical Summary
In the prior art, the display screen modeling results are prone to deviations from the actual display effect, resulting in low modeling processing efficiency and requiring repeated debugging.
By obtaining the physical parameters of the screen and partition configuration parameters of the display screen, the display screen is divided into multiple rendering partitions, the display unit and its index information of each rendering partition are determined, and the modeling is performed based on the partition grid parameters to obtain global modeling results.
Improves the processing efficiency of display modeling, reduces repeated debugging, and ensures accurate modeling of each rendering partition.
Smart Images

Figure CN120298592A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a display screen-based modeling method, apparatus, computer equipment, storage medium, and computer program product. Background Art
[0002] With the development of computer technology, dynamic background display screens constructed by high-density LED (Light Emitting Diode) module arrays have become the core technology carrier for realizing immersive scene synthesis. Such large-size display screens composed of splicing have been widely used in indoor and outdoor commercial displays, stage performances, public information displays, virtual shooting and other scenes. When modeling the display screen to adjust the display screen, the modeling results of the display screen are prone to deviations from the actual display effect, and repeated debugging is required, resulting in low efficiency in modeling processing for the display screen. Summary of the invention
[0003] Based on this, it is necessary to provide a display screen-based modeling method, apparatus, computer equipment, computer-readable storage medium and computer program product that can improve the modeling processing efficiency in response to the above technical problems.
[0004] In a first aspect, the present application provides a display-based modeling method. The method comprises:
[0005] Acquire screen physical parameters and partition configuration parameters of a display screen, where the display screen includes at least one display unit of a unit size;
[0006] Dividing the display screen into at least one rendering partition according to the partition configuration parameters;
[0007] Determine the display units and index information of the display units included in each rendering partition according to the partition configuration parameters, screen physical parameters and unit size;
[0008] Determine the partition grid parameters of each rendering partition based on the index information and unit size of the display units included in each rendering partition;
[0009] A partition modeling result is obtained according to the partition grid parameters of each rendering partition, and a global modeling result for the display screen is obtained based on the partition modeling result of each rendering partition.
[0010] In a second aspect, the present application also provides a modeling device based on a display screen. The device comprises:
[0011] A parameter acquisition module, used to acquire screen physical parameters and partition configuration parameters of a display screen, wherein the display screen includes at least one display unit of a unit size;
[0012] A partition division module, configured to divide a display screen into at least one rendering partition according to partition configuration parameters;
[0013] A partition information determination module, configured to determine, according to partition configuration parameters, screen physical parameters, and unit size, display units included in each rendering partition and index information of the display units;
[0014] A grid parameter determination module, configured to respectively determine partition grid parameters of each rendering partition based on index information and unit size of display units included in each rendering partition;
[0015] A modeling result obtaining module, configured to obtain a partition modeling result according to partition grid parameters of each rendering partition, and obtain a global modeling result for the display screen based on the partition modeling results of each rendering partition.
[0016] In some embodiments, the grid parameter determination module is further configured to, for each rendering partition, determine vertex position information of each vertex of a display unit based on first index information and unit size of display units included in the rendering partition targeted; respectively determine spatial mapping information of each vertex of the display unit; determine face index information of the display unit according to second index information of each vertex of the display unit; and obtain partition grid parameters of each rendering partition based on vertex position information, spatial mapping information, and face index information of display units included in each rendering partition.
[0017] In some embodiments, the grid parameter determination module is further configured to, when the display screen belongs to a flat screen type, determine first coordinate information of each vertex of a display unit according to column index information in first index information of display units included in the rendering partition targeted and width in unit size; determine second coordinate information of each vertex of the display unit according to row index information in first index information and height in unit size; and respectively obtain vertex position information of each vertex of the display unit based on the first coordinate information and the second coordinate information of each vertex of the display unit.
[0018] In some embodiments, the grid parameter determination module is further configured to determine first mapping coordinates of each vertex of a display unit in the rendering partition targeted according to column index information and partition column range of the rendering partition targeted; determine second mapping coordinates of each vertex of the display unit in the rendering partition targeted according to row index information and partition row range of the rendering partition targeted; and obtain spatial mapping information of each vertex of the display unit based on the first mapping coordinates and the second mapping coordinates of each vertex of the display unit.
[0019] In some embodiments, the grid parameter determination module is further configured to, when the display screen belongs to the arc screen type, determine the unit angle of the display unit according to the column index information in the first index information of the display units included in the rendering partition and the opening angle parameter in the screen physical parameters, where the opening angle parameter represents the radian range of the display screen; determine the first coordinate information of each vertex of the display unit according to the unit angle and the arc radius in the screen physical parameters; determine the second coordinate information of each vertex of the display unit according to the row index information in the first index information and the height in the unit size; determine the third coordinate information of each vertex of the display unit according to the unit angle and the arc radius; and respectively obtain the vertex position information of each vertex of the display unit based on the first coordinate information, the second coordinate information, and the third coordinate information of each vertex of the display unit.
[0020] In some embodiments, the grid parameter determination module is further configured to determine the first mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the first coordinate information of each vertex of the display unit, the first starting coordinate information of the targeted rendering partition, and the partition width of the targeted rendering partition; determine the second mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the second coordinate information of each vertex of the display unit, the second starting coordinate information of the targeted rendering partition, and the partition height of the targeted rendering partition; and obtain the spatial mapping information of each vertex of the display unit based on the first mapping coordinates and the second mapping coordinates of each vertex of the display unit.
[0021] In some embodiments, the grid parameter determination module is further configured to determine the second index information of each vertex of the display unit; and combine based on the second index information of each vertex of the display unit to obtain the face index information of the display unit.
[0022] In some embodiments, the partition information determination module is further configured to determine the partition range of each rendering partition according to the partition configuration parameters and the screen physical parameters; determine the display units included in each rendering partition according to the partition range of each rendering partition and the unit size; and determine the index information of the display units based on the display units included in each rendering partition.
[0023] In some embodiments, the modeling result obtaining module is further configured to determine the geometric body created for each rendering partition; obtain the mesh body of each rendering partition according to the geometric body of each rendering partition, the partition grid parameters, and the texture information; and combine the mesh bodies of each rendering partition to obtain the global modeling result for the display screen.
[0024] In some embodiments, the parameter acquisition module is further configured to, in response to a configuration trigger operation for the display screen, display a configuration interface for the display screen; and in response to a screen configuration operation triggered in the configuration interface, determine the screen physical parameters and partition configuration parameters configured for the display screen according to the screen configuration operation.
[0025] In some embodiments, it further includes a partition adjustment module, configured to display a partition schematic diagram for the rendering partition; in response to a partition adjustment operation triggered for the partition schematic diagram, update the partition schematic diagram according to the partition adjustment operation; update the partition configuration parameters according to the partition adjustment operation, and return to execute the step of dividing the display screen into at least one rendering partition according to the partition configuration parameters.
[0026] In some embodiments, the partition adjustment module is further configured to update the rendering partition according to the partition adjustment operation to obtain an updated rendering partition; determine the partition coordinates of the updated rendering partition, and update the partition schematic diagram according to the partition coordinates of the updated rendering partition.
[0027] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the steps of the above display screen-based modeling method are implemented.
[0028] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, and when the computer program is executed by a processor, the steps of the above display screen-based modeling method are implemented.
[0029] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the above display screen-based modeling method are implemented.
[0030] The above display screen-based modeling method, device, computer device, storage medium, and computer program product divide the display screen into at least one rendering partition according to the partition configuration parameters, determine the display units included in each rendering partition and the index information of the display units according to the partition configuration parameters, screen physical parameters, and unit size, determine the partition grid parameters of each rendering partition respectively based on the index information and unit size of the display units included in each rendering partition, obtain the partition modeling results according to the partition grid parameters of each rendering partition respectively, and obtain the global modeling result for the display screen based on the partition modeling results of each rendering partition respectively. In the modeling process of the display screen, based on the index information and unit size of the display units included in each rendering partition in the display screen, determine the partition grid parameters of each rendering partition respectively, obtain the partition modeling results for the rendering partition through the partition grid parameters, and obtain the global modeling result of the display screen according to the partition modeling results of each rendering partition respectively. It is possible to perform parametric modeling for each rendering partition using the partition grid parameters, ensure accurate modeling for each rendering partition in the display screen, reduce repeated debugging in the modeling process, and improve the modeling efficiency of the display screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0032] Figure 1 It is an application environment diagram of the display screen-based modeling method in an embodiment;
[0033] Figure 2 It is a flowchart of the display screen-based modeling method in an embodiment;
[0034] Figure 3 It is a schematic diagram of display units being spliced to form a display screen in an embodiment;
[0035] Figure 4 It is a schematic diagram of display units being spliced to form a display screen in another embodiment;
[0036] Figure 5 It is a schematic diagram of a display screen being divided into multiple rendering partitions in an embodiment;
[0037] Figure 6 It is a schematic diagram of a display screen being divided into multiple rendering partitions in another embodiment;
[0038] Figure 7Schematic diagram of index information of a display unit in an embodiment;
[0039] Figure 8 Flow schematic diagram of determining partition grid parameters in an embodiment;
[0040] Figure 9 Schematic diagram of determining vertex position information in an embodiment;
[0041] Figure 10 Schematic diagram of determining face index information in an embodiment;
[0042] Figure 11 Schematic diagram of the problem of seams in LED wall modeling;
[0043] Figure 12 Interface schematic diagram of the configuration interface of a display screen in an embodiment;
[0044] Figure 13 Schematic diagram of a 3D model of LED wall modeling in an embodiment;
[0045] Figure 14 Schematic diagram of the operation of splitting partitions in an embodiment;
[0046] Figure 15 Schematic diagram of the operation of splitting partitions in another embodiment;
[0047] Figure 16 Schematic diagram of the operation of merging partitions in an embodiment;
[0048] Figure 17 Schematic diagram of the result of partition merging in an embodiment;
[0049] Figure 18 Schematic diagram of input and output data during the modeling process in an embodiment;
[0050] Figure 19 Schematic diagram of an LED wall in an embodiment;
[0051] Figure 20 Schematic diagram of an LED wall divided into rendering partitions in an embodiment;
[0052] Figure 21 Schematic diagram of parameter calculation for LED modules in an embodiment;
[0053] Figure 22 Schematic diagram of determining UV coordinates in an embodiment;
[0054] Figure 23 Schematic diagram of dynamically adjusting rendering partitions in an embodiment;
[0055] Figure 24 Schematic diagram of a model file in an embodiment;
[0056] Figure 25 Schematic diagram of the global modeling result in an embodiment;
[0057] Figure 26 Block diagram of a modeling device based on a display screen in an embodiment;
[0058] Figure 27 Internal structure diagram of a computer device in an embodiment. Detailed implementation manners
[0059] In order to make the objectives, technical solutions, and advantages of the present application clearer and more understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0060] The display screen-based modeling method provided by the embodiments of the present application can be applied to an application environment as Figure 1 shown. Among them, the computer device 102 can be used to perform modeling processing on the display screen 104. The computer device 102 can communicate with the rendering server 106 through a network. The data storage system can store the data that the rendering server 106 needs to process. The data storage system can be set separately, integrated on the rendering server 106, placed in the cloud or on other devices.
[0061] The computer device 102 can obtain the screen physical parameters and partition configuration parameters of the display screen 104. The computer device 102 can divide the display screen 104 into at least one rendering partition according to the partition configuration parameters. For example, it can be divided into 3 rendering partitions. The computer device 102 can determine the display units included in each rendering partition and the index information of the display units according to the partition configuration parameters, the screen physical parameters, and the unit size. The computer device 102 can respectively determine the partition grid parameters of each rendering partition based on the index information and unit size of the display units included in each rendering partition. The computer device 102 can obtain the partition modeling results according to the partition grid parameters of each rendering partition, and obtain the global modeling result for the display screen 104 based on the partition modeling results of each rendering partition. The computer device 102 can send the global modeling result to the rendering server 106 for the rendering server 106 to perform rendering based on the global modeling result and return the rendering result to the computer device 102. The computer device 102 can include at least one of a terminal or a server. When the computer device 102 includes a display device, the computer device 102 can display the rendering result returned by the rendering server 106.
[0062] Among them, the computer device 102 may include a terminal or a server, or may be implemented based on a combination of a terminal and a server. The terminal may be, but is not limited to, various desktop computers, laptop computers, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things devices may be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. The portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. The server may be implemented by an independent server or a server cluster composed of multiple servers, and may also be a cloud server. The rendering server 106 may be implemented by an independent server or a server cluster composed of multiple servers, and may also be a cloud server.
[0063] In some exemplary embodiments, as Figure 2 shown, a display-based modeling method is provided. This method is executed by a computer device, and specifically may be executed alone by a computer device such as a terminal or a server, or may be jointly executed by a terminal and a server. In the embodiments of the present application, taking this method as an example of being applied to Figure 1 the computer device therein, the following steps 202 to 210 are included. Among them:
[0064] Step 202, obtain the screen physical parameters and partition configuration parameters of the display screen. The display screen includes at least one display unit of a unit size.
[0065] Among them, the display screen may be an object in the real world that needs to be modeled, such as an object that needs to be modeled in 3D (Three-Dimensional) or 2D (Two-Dimensional). The display screen may be a physical display screen that actually exists in the real world. The display screen may include at least one display unit, and the display unit may be a display module of a unit size. For example, the display unit may be an LED module. The height and width included in the unit size may be flexibly configured according to actual needs. In some embodiments, the display screen may include multiple display units, that is, the display screen may be obtained by splicing multiple display units. As Figure 3 shown, the display screen 1 may be obtained by splicing 4 display units A; as Figure 4 shown, the display screen 2 may be obtained by splicing 4 display units B. In some embodiments, the display screen may also include one display unit, that is, directly use one display unit as the display screen. The display unit may be of a unit size, and the unit size may be configured according to actual needs. As Figure 3 shown, the unit size of the display unit A may be (width w, height h). When the values of the width w and the height h are different, the display unit A is a rectangle; as Figure 4As shown, the unit size of the display unit B can be (width a, height a), that is, the display unit B can be a square with side length a. In some embodiments, the display unit can also include at least one of various shapes such as triangles, pentagons, hexagons, etc.
[0066] The screen physical parameters are the physical parameters of the entire display screen. For example, they can include at least one of various parameters such as the width, height, curvature, etc. of the display screen. For display screens of different screen types, the screen physical parameters can include different types of parameters. For example, for a flat screen type, the screen physical parameters of the display screen can include the width and height; for another example, for a curved screen type, the screen physical parameters of the display screen can include at least one of various parameters such as the height, radius of curvature, and opening angle parameter defining the overall curved range. The partition configuration parameters are used to divide the rendering partitions for the display screen. For example, the partition configuration parameters can include the number of rows and columns divided for the display screen. For example, the partition configuration parameters include 2 rows and 3 columns. As Figure 5 shown, the display screen can be divided into 2 rows and 3 columns according to the partition configuration parameters, resulting in 6 rendering partitions, including rendering partition 1, rendering partition 2, rendering partition 3, rendering partition 4, rendering partition 5, and rendering partition 6. Among them, the display screen includes 54 (6 rows × 9 columns) display units. Rendering partition 1 and rendering partition 4 each include 12 display units, rendering partition 2 and rendering partition 5 each include 9 display units, and rendering partition 3 and rendering partition 6 each include 6 display units. The partition configuration parameters can be determined by the user according to actual needs for dividing the display screen. Each of the divided rendering partitions can be independently rendered, so as to divide the overall rendering and modeling tasks of the display screen into multiple smaller-sized partitions for separate processing.
[0067] Optionally, the computer device may obtain the screen physical parameters of the display screen and the partition configuration parameters for the display screen. The screen physical parameters and the partition configuration parameters may be determined by the computer device based on the attribute information of the display screen. In some embodiments, the screen physical parameters and the partition configuration parameters may also be configured by the user for the display screen according to actual needs. For example, the computer device may be a terminal, and the user may configure the display screen through the terminal to obtain the screen physical parameters and the partition configuration parameters of the display screen. In some embodiments, the display screen may be of a flat screen type. The screen physical parameters of the display screen may include the height and width, and the partition configuration parameters may include the division parameters for the display screen, such as the number of rows and columns of the division. In some embodiments, the partition configuration parameters may also include other types of division parameters, such as the ranges of each rendering partition. For example, the partition configuration parameters may include the width [w1, w2, w3] of each column and the height [h1, h2, h3, h4, h5] of each row, so that the display screen can be divided into rendering partitions based on the ranges of each rendering partition. As Figure 6 shown, after the display screen 3 is divided according to the ranges of each rendering partition included in the partition configuration parameters, the display screen 3 can be divided into 5 rows and 3 columns. The height of each row is h1, h2, h3, h4, h5 respectively, and the width of each column is w1, w2, w3 respectively, so that flexible division of the display screen can be achieved, and the sizes of each rendering partition can be flexibly configured. For example, the width of the rendering partition S23 is w2 and the height is h3.
[0068] Step 204: Divide the display screen into at least one rendering partition according to the partition configuration parameters.
[0069] Among them, the rendering partition is a partition obtained by dividing the display screen from the perspective of rendering logic. Each rendering partition can be modeled and rendered separately. The display screen can be divided into at least one rendering partition, and each rendering partition may include at least one display unit. For example, for the display screen 1, it may include 1 display unit. After being divided according to the partition configuration parameters, 1 rendering partition can be obtained, and this rendering partition includes 1 display unit. Another example is for the display screen 2, which may include N (N is an integer greater than 1) display units. After being divided according to the partition configuration parameters, 1 rendering partition can be obtained, and this rendering partition includes N display units. In some embodiments, the display screen 3 may include N (N is an integer greater than 1) display units. After being divided according to the partition configuration parameters, M (M is an integer greater than 1) rendering partitions can be obtained. Each rendering partition may include at least one display unit. The total number of display units included in the M rendering partitions is N, that is, the N display units in the display screen are divided into M rendering partitions according to the partition configuration parameters.
[0070] Exemplarily, for a display screen, the computer device may perform partition division according to the partition configuration parameters to obtain at least one rendering partition, and each rendering partition may include at least one display unit. In some embodiments, the display screen may include an LED wall, which may be formed by splicing a large number of standard small screens. The standard small screen may be a display unit of a unit size, such as an LED module with a size of 0.5m (meter) × 0.5m. Each small screen may have a fixed physical size and resolution. At least one small screen may form a rendering partition. The partition is to solve the problem that a single graphics card cannot bear the rendering task of the entire LED wall, so as to disperse the rendering task for the entire LED wall by dividing it into rendering partitions. Each rendering partition may need to build an independent UV mapping (UV Mapping) space to ensure correct content mapping. UV mapping is the process of mapping the surface coordinates of a 3D model to a 2D texture space. Establishing an independent UV mapping space for each rendering partition can perform processing such as modeling and rendering independently for each rendering partition.
[0071] Step 206, determine the display units included in each rendering partition and the index information of the display units according to the partition configuration parameters, screen physical parameters, and unit size.
[0072] Among them, the index information is used to locate the display units in the display screen. The index information of the display units can be established based on all the display units included in the display screen, and the display unit pointed to can be determined from the display screen based on the index information. For example, the index information may include the row index information and column index information of the display unit, so as to characterize which row and which column the display unit is in the display screen. For example, if the index information of display unit 1 includes row index information i and column index information j, it can be determined that display unit 1 is the display unit in the i-th row and j-th column of all the display units of the display screen, so as to achieve accurate positioning of display unit 1.
[0073] Optionally, for each divided rendering partition, the computer device may respectively determine the display units included in each rendering partition and determine the index information of the display units included in each rendering partition based on the partition configuration parameters, screen physical parameters, and unit size. In some embodiments, the computer device may determine the partition range covered by each rendering partition in the display screen based on the partition configuration parameters and screen physical parameters, and respectively determine the display units included in each rendering partition according to the partition range and the unit size of each display unit, and determine the index information of the display units among all the display units of the display screen. Such as Figure 7As shown, the display screen may include a total of 54 display units arranged in 6 rows and 9 columns. Each display unit may be a square with a side length of h. The display screen is divided into 6 rendering partitions according to the partition configuration parameters. The computer device may determine the partition range of each rendering partition based on the partition configuration parameters and the screen physical parameters, and determine the display units included in each rendering partition based on the unit size h of the display unit. The computer device may determine the index information of each display unit included in each rendering partition. For example, for rendering partition 6, it includes 6 display units, namely A1, A2, A3, A4, A5, and A5. The index information of each display unit may be the 8th column of the 1st row (A1), the 9th column of the 1st row (A2), the 8th column of the 2nd row (A3), the 9th column of the 2nd row (A4), the 8th column of the 3rd row (A5), and the 9th column of the 3rd row (A6), respectively.
[0074] Step 208: Based on the index information and unit size of the display units included in each rendering partition, determine the partition grid parameters of each rendering partition respectively.
[0075] Among them, the partition grid parameters are the parameters corresponding to the mesh body (Mesh) modeled for the rendering partition. The mesh body may include the basic 3D model structure composed of vertices, edges, and faces. Based on the mesh body, 3D modeling can be performed for the rendering partition. The partition grid parameters may include at least one of various information such as the vertex position information, spatial mapping information, and vertex index information of each vertex of the display units included in the rendering partition. Among them, the vertex position information may include the vertex coordinates of the vertices in the display unit, the spatial mapping information may include the UV coordinates of the vertices of the display unit in the rendering partition to which it belongs, and the vertex index information may include the index information of the vertices of the display unit among the vertices of the display screen, such as the vertex number. Based on the partition grid parameters, the mesh body corresponding to the rendering partition can be constructed, and based on the mesh body, 3D modeling can be performed for the rendering partition to model each display unit corresponding to the rendering partition.
[0076] Optionally, for each display unit in each rendering partition, the computer device may determine the partition grid parameters of each rendering partition respectively in combination with the index information of the display unit and the unit size. In some embodiments, the computer device may obtain the vertex parameters of each display unit based on the index information and the unit size of each display unit in each rendering partition, and obtain the partition grid parameters of the rendering partition based on the respective vertex parameters of the display units belonging to the same rendering partition. For example, for the i-th rendering partition of the display screen, which includes M display units, the computer device may determine the vertex parameters of each display unit respectively based on the index information of each display unit in the M display units and the unit size of the display unit. If the display unit is a quadrilateral, each display unit may include 4 vertices. The computer device may determine the vertex parameters of each of the 4 vertices of each display unit, such as vertex position information, spatial mapping information, and vertex index information. The computer device may obtain the partition grid parameters of the i-th rendering partition based on the respective vertex parameters of the M display units. The computer device may traverse each rendering partition to obtain the partition grid parameters of each rendering partition respectively.
[0077] Step 210, obtain a partition modeling result according to the partition grid parameters of each rendering partition respectively, and obtain a global modeling result for the display screen based on the partition modeling results of each rendering partition respectively.
[0078] Among them, the partition modeling result is the modeling result obtained by modeling the rendering partition in the display screen. The partition modeling result may include the modeling model of the display units included in the rendering partition, such as the 3D model of the display units included in the rendering partition. The global modeling result is the modeling result obtained by modeling the entire display screen. The global modeling result may include the modeling models of all the display units in the display screen, such as the 3D models of all the display units in the display screen, that is, the global modeling result may include the 3D model of the entire display screen.
[0079] Exemplarily, the computer device may obtain the respective partition modeling results by modeling each rendering partition. For example, the computer device may perform modeling respectively based on the partition grid parameters of each rendering partition to obtain the respective partition modeling results of each rendering partition. The partition modeling result may include the modeling models of some display units in the display screen. The computer device may obtain the global modeling result of the display screen based on the respective partition modeling results of each rendering partition. For example, the computer device may combine the respective partition modeling results of each rendering partition to obtain the global modeling result of the display screen. The global modeling result may include the modeling model for the entire display screen, and the modeling model for the entire display screen may be obtained by combining the respective modeling models of all the display units in the display screen.
[0080] In the above display-based modeling method, the display screen is divided into at least one rendering partition according to the partition configuration parameters. According to the partition configuration parameters, the screen physical parameters, and the unit size, the display units included in each rendering partition and the index information of the display units are determined. Based on the index information and the unit size of the display units included in each rendering partition respectively, the partition grid parameters of each rendering partition are determined. The partition modeling results are obtained according to the partition grid parameters of each rendering partition respectively, and the global modeling result for the display screen is obtained based on the partition modeling results of each rendering partition respectively. In the modeling process of the display screen, based on the index information and the unit size of the display units included in each rendering partition of the display screen respectively, the partition grid parameters of each rendering partition are determined, and the partition modeling results are obtained for the rendering partitions through the partition grid parameters, and the global modeling result of the display screen is obtained according to the partition modeling results of each rendering partition respectively. Parametric modeling can be performed for each rendering partition by using the partition grid parameters, ensuring accurate modeling for each rendering partition in the display screen, reducing repeated debugging in the modeling process, and improving the modeling efficiency of the display screen.
[0081] In some exemplary embodiments, as Figure 8 shown, the process of determining the partition grid parameters, that is, based on the index information and the unit size of the display units included in each rendering partition respectively, the partition grid parameters of each rendering partition are determined, includes:
[0082] Step 802, for each rendering partition, based on the first index information and the unit size of the display units included in the rendering partition targeted, determine the vertex position information of each vertex of the display units.
[0083] Among them, the first index information is the index information of the display units included in the rendering partition targeted, such as it may include the row index information and the column index information of the display units included in the rendering partition targeted among all the display units in the display screen. A vertex is the connection point between the sides of a display unit, and the number of vertices corresponds to the shape of the display unit. For example, when the display unit is a triangle, each display unit may include 3 vertices; when the display unit is a quadrilateral, each display unit may include 4 vertices; when the display unit is a hexagon, each display unit may include 6 vertices. The vertex position information may include the coordinate information of the vertex in space, such as it may include the two-dimensional coordinate information of the vertex in a two-dimensional space, or it may include the three-dimensional coordinate information of the vertex in a three-dimensional space.
[0084] Exemplarily, for each rendering partition, the computer device may traverse the display units included in the rendering partition to determine the vertex position information of each vertex of each display unit. For example, the computer device may determine the first index information of each display unit among the display units on the display screen, and the first index information may include row index information and column index information. The computer device may determine the vertex position information of each vertex of each display unit based on the first index information and the unit size of the display unit.
[0085] As Figure 9 shown, in a rendering partition, there are 4 display units arranged in 2 rows and 2 columns. Among them, display unit 1 includes 4 vertices, namely vertex A, vertex B, vertex E, and vertex F. Display unit 2 includes vertices B, C, D, and E. If each display unit is a square with a side length of h, then for display unit 1, its first index information may include row index information of the first row and column index information of the first column. It can be determined that the vertex position information of the 4 vertices of display unit 1 is vertex A(0, 0), vertex B(h, 0), vertex E(h, h), and vertex F(0, h); for the 4 vertices of display unit 2, the vertex position information is vertex B(h, 0), vertex C(2h, 0), vertex D(2h, h), and vertex E(h, h). In some embodiments, the vertex position information may further include coordinate positions in a three-dimensional space. Then, the vertex position information of the 4 vertices of display unit 1 may include vertex A(0, 0, 0), vertex B(h, 0, 0), vertex E(h, h, 0), and vertex F(0, h, 0).
[0086] Step 804, respectively determine the spatial mapping information of each vertex of the display unit.
[0087] Among them, the spatial mapping information is the mapping information that maps the surface coordinates of the 3D model to the 2D texture space. For example, it may include UV mapping information in the UV space. The UV mapping information may include UV coordinates in the UV space. Through the spatial mapping information, the matching and correspondence between the 3D model description and the 2D texture information can be achieved.
[0088] Optionally, for each display unit in the targeted rendering partition, the computer device may separately determine the spatial mapping information of each vertex of the display unit. For example, the computer device may determine the spatial mapping information of each vertex based on the index information of the display unit. In some embodiments, for display screens of different screen types, the spatial mapping information of each vertex of the display unit may be determined in different ways. For example, for a flat screen, the spatial mapping information may include U coordinate = number of columns of the display unit / total number of columns, and V coordinate = number of rows of the display unit / total number of rows. In some embodiments, for display unit X, based on the index information of the display unit X, the spatial mapping information of the vertex at the upper right corner in the display unit X can be directly determined, and the computer device may further combine the unit size of the display unit X to separately calculate the spatial mapping information of the vertex at the lower left corner, the lower right corner, and the upper left corner in the display unit X, so as to obtain the spatial mapping information of each vertex in the display unit X.
[0089] Step 806: Determine the face index information of the display unit according to the second index information of each vertex of the display unit.
[0090] Among them, the second index information is the index information of the vertex of the display unit among all the vertices of the display screen, and all the vertices of the display screen may include each vertex included in the display units of all the rendering partitions. Through the second index information, the vertex of the display unit can be accurately located among all the vertices. The face index information is the index information of the display face formed by connecting the vertices of the display unit. For example, if the display unit is a quadrilateral, the display unit includes 4 vertices, and by selecting 3 vertices from the 4 vertices of the display unit, two triangles can be formed, and the face index information of the display unit can be obtained according to the index information of each triangle.
[0091] Exemplarily, the computer device may determine the second index information of each vertex of the display unit, and the second index information may be determined based on the vertices of the display unit relative to all the vertices of all the display units in the display screen. The computer device may obtain the face index information of the display unit based on the second index information of each vertex of the display unit. In some embodiments, the computer device may form different display faces by connecting the vertices based on the vertices of the display unit, and obtain the face index information of the display unit according to the index information of the vertices included in the display face. Figure 10As shown, for display unit 1 and display unit 2 in a certain rendering partition, display unit 1 includes vertex A, vertex B, vertex E, and vertex F, and display unit 2 includes vertex B, vertex C, vertex D, and vertex E; display unit 1 can form a display surface of two triangles by connecting 3 vertices, including triangle ABE and triangle EFA. Similarly, display unit 2 can form a display surface of two triangles by connecting 3 vertices, including triangle BCD and triangle DEB. For display unit 1, the computer device can obtain the face index information of display unit 1 based on the index information of triangle ABE and triangle EFA, such as it can include triangle 1 and triangle 2, or it can also include the vertex position information of each vertex of triangle ABE and triangle EFA respectively.
[0092] Step 808, based on the vertex position information, space mapping information, and face index information of the display units included in each rendering partition, obtain the partition grid parameters of each rendering partition.
[0093] Exemplarily, for the display units included in each rendering partition, the computer device can obtain the vertex position information, space mapping information, and vertex index information of the display units. The vertex position information of the display units can include the vertex position information of each vertex in the display unit, the space mapping information of the display units can include the space mapping information of each vertex in the display unit, and the face index information of the display units can include the index information of the display surfaces formed based on the vertices of the display units. The computer device can obtain the partition grid parameters of the rendering partition based on the vertex position information, space mapping information, and face index information of each display unit included in the rendering partition. After traversing each rendering partition, the computer device can obtain the partition grid parameters of each rendering partition in the display screen.
[0094] In this embodiment, for each rendering partition, the computer device obtains the partition grid parameters based on the vertex position information, space mapping information of each vertex of the included display units, and the face index information of the display units. Thus, the grid of the rendering partition can be characterized by parameters of multiple structures such as vertex position information, space mapping information, and face index information, which can ensure the reliability of the partition grid parameters, is beneficial to the accurate modeling of each rendering partition in the display screen, reduces the repeated debugging in the modeling process, and can improve the modeling processing efficiency of the display screen.
[0095] In some exemplary embodiments, based on the first index information of the display units included in the rendering partition and the unit size, determining the vertex position information of each vertex of the display units includes: when the display screen belongs to the flat screen type, determining the first coordinate information of each vertex of the display units according to the column index information in the first index information of the display units included in the rendering partition and the width in the unit size; determining the second coordinate information of each vertex of the display units according to the row index information in the first index information and the height in the unit size; and respectively obtaining the vertex position information of each vertex of the display units based on the first coordinate information and the second coordinate information of each vertex of the display units.
[0096] Among them, the flat screen type means that the display screen belongs to a straight screen, that is, no curvature is formed in the splicing combination of each display unit in the display screen. The first index information of the display unit may include column index information and row index information, and the display unit can be accurately located through the column index information and the row index information. The first coordinate information may be the coordinate information of the vertex in the horizontal axis direction in the space coordinate system; the second coordinate information may be the coordinate information of the vertex in the vertical axis direction in the space coordinate system. The horizontal axis direction may be the direction along the width of the display screen, and the vertical axis direction may be the direction along the height of the display screen.
[0097] Optionally, the computer device may determine the screen type of the display screen. When it is determined that the display screen belongs to the flat screen type, it indicates that the display surface of the display screen does not form an arc. Then, the computer device may obtain the first index information of the display units included in the rendering partition. The first index information may include column index information and row index information. The computer device may determine the first coordinate information of each vertex in the display unit based on the column index information and the width in the unit size. In some embodiments, when the display unit is a quadrilateral, the display unit may include 4 vertices, namely the lower left vertex, the lower right vertex, the upper right vertex, and the upper left vertex. The computer device may obtain the first coordinate information of the upper right vertex and the lower right vertex of the display unit based on the product of the column index information and the width in the unit size. The computer device may obtain the first coordinate information of the upper left vertex and the lower left vertex of the display unit based on the product of (column index information - 1) and the width in the unit size. The computer device may obtain the second coordinate information of each vertex in the display unit based on the row index information and the height in the unit size. For example, when the display unit is a quadrilateral, the display unit may include 4 vertices, namely the lower left vertex, the lower right vertex, the upper right vertex, and the upper left vertex. The computer device may obtain the second coordinate information of the upper right vertex and the upper left vertex respectively based on the product between the row index information and the height in the unit size, and obtain the second coordinate information of the lower left vertex and the lower right vertex respectively according to the product between (row index information - 1) and the height in the unit size. Each vertex of the display unit may include its own first coordinate information and second coordinate information. The computer device may obtain the vertex position information of each vertex in the display unit according to the first coordinate information and the second coordinate information of each vertex in the display unit. For example, the computer device may use that each vertex may include its own first coordinate information and second coordinate information as the vertex position information of each vertex respectively.
[0098] In some embodiments, the spatial coordinate system can also be a three-dimensional coordinate system. That is, in addition to the horizontal axis (X) and the vertical axis (Y), it can also include the Z axis in the front-back direction. Then the vertex position information of each vertex can include three-dimensional coordinates, such as (x1, y1, z1). For a display screen of the flat screen type, which has no curvature formed and no deviation in the front-back direction, it can be uniformly considered that the Z-axis coordinate is 0. That is, the vertex position information of each vertex can be (x, y, 0). In some embodiments, the display screen can be an LED wall of the flat screen type obtained by splicing LED modules. That is, the LED modules are used as display units. For the LED modules in the rendering partition, the computer device can determine that the origin is at the lower left corner. For each LED module in each rendering partition, according to its row (i) and column (j) positions, the following can be calculated: x coordinate = number of columns * unit screen width, y coordinate = number of rows * unit screen height, and z coordinate = 0, so as to obtain the vertex position information (x, y, z) of the vertex.
[0099] In this embodiment, for a display screen of the flat screen type, the computer device determines the respective first coordinate information of each vertex according to the column index information of the display unit and the width in the unit size, determines the respective second coordinate information of each vertex according to the row index information of the display unit and the height in the unit size, and obtains the respective vertex position information of each vertex based on the respective first coordinate information and second coordinate information of each vertex. Thus, the respective vertex position information of each vertex of the display unit can be determined by using the row and column index information of the display unit and the size of the display unit, ensuring the accuracy of the vertex position information.
[0100] In some exemplary embodiments, determining the respective spatial mapping information of each vertex of the display unit includes: determining the respective first mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the column index information and the partition column range of the targeted rendering partition; determining the respective second mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the row index information and the partition row range of the targeted rendering partition; and obtaining the respective spatial mapping information of each vertex of the display unit based on the respective first mapping coordinates and second mapping coordinates of each vertex of the display unit.
[0101] Among them, the partition column range can represent the width range of the rendering partition, such as including the total number of columns of the rendering partition; the partition row range can represent the height range of the rendering partition, such as including the total number of rows of the rendering partition. The spatial mapping information can include spatial mapping coordinates, such as UV coordinates. The first mapping coordinate can be the U coordinate in the UV coordinates, and the second mapping coordinate can be the V coordinate in the UV coordinates.
[0102] Exemplarily, the computer device can determine the partition range for the rendering partition, such as determining the partition column range and the partition row range of the rendering partition. The computer device can determine the first mapping coordinates of each vertex of the display unit in the targeted rendering partition based on the partition column range and the column index information. For example, the partition column range can include the total number of columns of the targeted rendering partition, the column index information can include the number of columns to which the display unit belongs, the display unit can be a quadrilateral, and the computer device can calculate the first mapping coordinates of the upper right vertex and the lower right vertex of the display unit respectively based on the number of columns / the total number of columns. The computer device can calculate the first mapping coordinates of the upper left vertex and the lower left vertex of the display unit respectively based on (the number of columns - 1) / the total number of columns. The computer device can obtain the second mapping coordinates of each vertex of the display unit in the targeted rendering partition based on the partition row range and the row index information. For example, the partition row range can include the total number of rows of the targeted rendering partition, the row index information can include the number of rows to which the display unit belongs, the display unit can be a quadrilateral, and the computer device can calculate the second mapping coordinates of the upper left vertex and the upper right vertex of the display unit respectively based on the number of rows / the total number of rows. The computer device can calculate the second mapping coordinates of the lower left vertex and the lower right vertex of the display unit respectively based on (the number of rows - 1) / the total number of rows. The computer device can obtain the spatial mapping information of each vertex based on the first mapping coordinates and the second mapping coordinates of each vertex, such as the spatial mapping information can include the spatial mapping coordinates of (u, v).
[0103] In this embodiment, for a display screen of the flat screen type, the computer device determines the first mapping coordinates of each vertex according to the column index information of the display unit and the partition column range of the targeted rendering partition, determines the second mapping coordinates of each vertex according to the row index information of the display unit and the partition row range of the targeted rendering partition, and obtains the spatial mapping information of each vertex based on the first mapping coordinates and the second mapping coordinates of each vertex. Thus, the spatial mapping information of each vertex of the display unit can be determined by using the row and column index information of the display unit and the partition range of the targeted rendering partition, which can ensure the accuracy of the spatial mapping information.
[0104] In some exemplary embodiments, based on the first index information of the display units included in the rendering partition and the unit size, determining the vertex position information of each vertex of the display units includes: when the display screen belongs to the arc screen type, determining the unit angle of the display unit according to the column index information in the first index information of the display units included in the rendering partition and the opening angle parameter in the screen physical parameters, where the opening angle parameter represents the radian range of the display screen; determining the first coordinate information of each vertex of the display unit according to the unit angle and the arc radius in the screen physical parameters; determining the second coordinate information of each vertex of the display unit according to the row index information in the first index information and the height in the unit size; determining the third coordinate information of each vertex of the display unit according to the unit angle and the arc radius; and respectively obtaining the vertex position information of each vertex of the display unit based on the first coordinate information, the second coordinate information, and the third coordinate information of each vertex of the display unit.
[0105] Among them, the arc screen type means that the display screen belongs to an arc screen, that is, a certain radian is formed in the splicing combination of each display unit in the display screen. The first index information of the display unit may include column index information and row index information, and the display unit can be accurately positioned through the column index information and the row index information. The opening angle parameter is used to define the overall radian range of the display screen, and the arc radius is the radius corresponding to the arc formed by the display screen. The radian of the entire display screen is determined by the opening angle parameter. By evenly distributing this opening angle parameter to each display unit in the horizontal direction, the unit angle of each display unit can be obtained, and the vertex position information of the vertices in the display unit can be determined based on the unit angle. The first coordinate information may be the coordinate information of the vertex in the horizontal axis direction in the space coordinate system; the second coordinate information may be the coordinate information of the vertex in the vertical axis direction in this space coordinate system; the third coordinate information may be the coordinate information of the vertex in the front-back direction in this space coordinate system; the horizontal axis direction may be the direction along the width of the display screen, and the vertical axis direction may be the direction along the height of the display screen.
[0106] Optionally, the computer device may determine the screen type of the display screen. When it is determined that the display screen belongs to the arc screen type, it indicates that the display surface of the display screen forms an arc. Then the computer device may obtain the first index information of the display units included in the rendering partition. The first index information may include column index information and row index information. For a display screen of the arc screen type, the screen physical parameters may include an opening angle parameter and an arc radius. The computer device may determine the unit angle of the display unit based on the column index information and the opening angle parameter. The computer device may obtain the respective first coordinate information of each vertex of the display unit according to the unit angle and the arc radius. The computer device may obtain the respective second coordinate information of each vertex of the display unit according to the row index information and the height in the unit size. The computer device may obtain the respective third coordinate information of each vertex of the display unit according to the unit angle and the arc radius.
[0107] In some embodiments, for a display screen of the arc screen type, the origin of the spatial coordinate system may be set at the arc center. When the display screen is an LED wall formed by splicing LED modules, for each LED module in the rendering partition, calculate the angle of the current LED module according to its row (i) and column (j) positions. =(j / total number of columns) × opening angle, and further, the x coordinate can be calculated as = sin( ) × radius, the y coordinate = i × unit screen height, the z coordinate = -cos( ) × radius. Since the origin is at the arc center, the z coordinate is negative. Among them, the x coordinate may be the first coordinate information, the y coordinate may be the second coordinate information, and the z coordinate may be the third coordinate information. The computer device may obtain the respective vertex position information of each vertex based on the respective first coordinate information, second coordinate information, and third coordinate information of each vertex.
[0108] In this embodiment, for a display screen of the arc screen type, the computer device determines the unit angle of the display unit according to the column index information of the display unit and the opening angle parameter of the display screen, determines the respective first coordinate information of each vertex according to the unit angle of the display unit and the arc radius of the display screen, determines the respective second coordinate information of each vertex according to the row index information and the height in the unit size, determines the respective third coordinate information of each vertex according to the unit angle and the arc radius, and obtains the respective vertex position information of each vertex based on the respective first coordinate information, second coordinate information, and third coordinate information of each vertex. Thus, the respective vertex position information of each vertex of the display unit can be determined by using the row and column index information of the display unit, the size of the display unit, and the opening angle parameter and arc radius of the display screen, ensuring the accuracy of the vertex position information.
[0109] In some exemplary embodiments, determining the respective spatial mapping information of each vertex of the display unit respectively includes: determining the respective first mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the respective first coordinate information of each vertex of the display unit, the first starting coordinate information of the targeted rendering partition, and the partition width of the targeted rendering partition; determining the respective second mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the respective second coordinate information of each vertex of the display unit, the second starting coordinate information of the targeted rendering partition, and the partition height of the targeted rendering partition; and obtaining the respective spatial mapping information of each vertex of the display unit based on the respective first mapping coordinates and second mapping coordinates of each vertex of the display unit.
[0110] Wherein, the first starting coordinate information may include the starting coordinate of the targeted rendering partition on the horizontal axis (X-axis), and the second starting coordinate information may include the starting coordinate of the targeted rendering partition on the vertical axis (Y-axis). The partition width may characterize the width range of the targeted rendering partition, and the partition height may characterize the height range of the targeted rendering partition. The spatial mapping information may include spatial mapping coordinates, such as UV coordinates. The first mapping coordinate may be the U coordinate in the UV coordinates, and the second mapping coordinate may be the V coordinate in the UV coordinates.
[0111] Exemplarily, the computer device can determine the partition range of the rendering partition, such as determining the partition width and partition height of the rendering partition. The computer device can determine the first starting coordinate information of the rendering partition in the direction of the coordinate axis to which the first coordinate information belongs. For example, if the first coordinate information belongs to the horizontal axis in the spatial coordinate system, the first starting coordinate information can be the starting coordinate information of the rendering partition in the horizontal axis direction. The computer device can obtain the first mapping coordinates of each vertex of the display unit in the rendering partition to which it belongs based on the first coordinate information of each vertex of the display unit, the first starting coordinate information, and the partition width. For example, the computer device can calculate the first mapping coordinate U of vertex A based on (the first coordinate information - the first starting coordinate information) / the partition width. The computer device can determine the second starting coordinate information of the rendering partition in the direction of the coordinate axis to which the second coordinate information belongs. For example, if the second coordinate information belongs to the vertical axis in the spatial coordinate system, the second starting coordinate information can be the starting coordinate information of the rendering partition in the vertical axis direction. The computer device can obtain the second mapping coordinates of each vertex of the display unit in the rendering partition to which it belongs based on the second coordinate information of each vertex of the display unit, the second starting coordinate information, and the partition height. For example, the computer device can calculate the second mapping coordinate V of vertex A based on (the second coordinate information - the second starting coordinate information) / the partition height. The computer device can obtain the spatial mapping information of each vertex based on the first mapping coordinate and the second mapping coordinate of each vertex. For example, the spatial mapping information can include spatial mapping coordinates, and the spatial mapping coordinates can include (the first mapping coordinate, the second mapping coordinate).
[0112] In this embodiment, for a display screen of the arc screen type, the computer device obtains the first mapping coordinates of each vertex of the display unit in the rendering partition to which it belongs based on the first coordinate information of each vertex of the display unit, the first starting coordinate information of the rendering partition to which it belongs, and the partition width of the rendering partition to which it belongs, obtains the second mapping coordinates of each vertex of the display unit in the rendering partition to which it belongs based on the second coordinate information of each vertex of the display unit, the second starting coordinate information of the rendering partition to which it belongs, and the partition height of the rendering partition to which it belongs, and obtains the spatial mapping information of each vertex based on the first mapping coordinate and the second mapping coordinate of each vertex. Thus, by using the coordinate information of each vertex of the display unit, the starting coordinate information of the rendering partition to which it belongs, and the partition range, the spatial mapping information of each vertex of the display unit can be determined, ensuring the accuracy of the spatial mapping information.
[0113] In some exemplary embodiments, determining the face index information of a display unit according to the respective second index information of each vertex of the display unit includes: determining the respective second index information of each vertex of the display unit; and combining based on the respective second index information of each vertex of the display unit to obtain the face index information of the display unit.
[0114] Wherein, the second index information can be determined based on the vertices of the display unit relative to all the vertices of all the display units in the display screen. The computer device can obtain the face index information of the display unit based on the respective second index information of each vertex of the display unit. The face index information can include the index information of the display surface formed by the respective vertices of the display unit, such as the identification information of each vertex constituting the display surface.
[0115] Optionally, the computer device can determine the respective second index information of each vertex and combine based on the respective second index information of each vertex. For example, it can select the second index information of 3 vertices for combination to form a triangular display surface. The computer device can obtain the face index information of the display surface according to the second index information corresponding to the vertices of the formed display surface. For a display unit, at least one display surface can be constructed, and each display surface can have corresponding face index information. The computer device can obtain the face index information of the display unit based on the respective face index information of each display surface. In some embodiments, the display screen can be an LED wall formed by splicing multiple LED modules. The LED module can be a display unit in the shape of a square. Each LED module can construct two triangles. The first triangle can be obtained by combining the lower left vertex, the lower right vertex, and the upper right vertex of the display unit, and the second triangle can be obtained by combining the upper right vertex, the upper left vertex, and the lower left vertex of the display unit. The computer device can use the second index information of the vertices included in each triangle as the face index information of the display unit, or can also use the vertex position information of the vertices included in each triangle as the face index information of the display unit.
[0116] In this embodiment, the computer device combines based on the respective second index information of each vertex of the display unit to obtain the face index information of the display unit, so that a display surface can be constructed through the vertices of the display unit to perform modeling for the target, which is beneficial to realizing the accurate modeling of each rendering partition, reducing the repeated debugging in the modeling process, and improving the modeling processing efficiency of the display screen.
[0117] In some exemplary embodiments, based on the partition configuration parameters, the screen physical parameters, and the unit size, the display units included in each rendering partition and the index information of the display units are determined, including: determining the partition range of each rendering partition according to the partition configuration parameters and the screen physical parameters; determining the display units included in each rendering partition according to the partition range of each rendering partition and the unit size; and determining the index information of the display units based on the display units included in each rendering partition.
[0118] Among them, the partition range can represent the range covered by the rendering partition on the display screen, such as including the partition column range and the partition row range. Exemplarily, the computer device can analyze the display screen according to the partition configuration parameters and the screen physical parameters of the display screen to determine the partition range covered by each rendering partition on the display screen. For example, the partition configuration parameters include the number of rows and columns divided, and the computer device can determine the partition range of each rendering partition based on the number of rows and columns divided, as well as the height and width of the display screen. Each rendering partition includes at least one display unit, and the display unit is a small display screen of the unit size. The computer device can determine the display units included in each rendering partition based on the partition range of each rendering partition and the unit size respectively. The computer device can determine the index information of each display unit based on the display units included in each rendering partition. For example, the display units included in the rendering partition can be compared with the distribution positions of all the display units on the display screen to determine the index information of the display unit relative to all the display units on the display screen. For example, the index information of the display unit can include the row and column where the display unit is located.
[0119] In this embodiment, the computer device determines the partition range of each rendering partition based on the partition configuration parameters and the screen physical parameters, determines the display units included in the rendering partition based on the partition range and the unit size of the display unit, and then determines the index information of the display unit, so that the partition grid parameters of the rendering partition can be determined based on the index information of the display units included in the rendering partition and the unit size of the display unit, for parametric modeling of the display screen, which is beneficial to improving the modeling processing efficiency of the display screen.
[0120] In some exemplary embodiments, based on the partition grid parameters of each rendering partition, the partition modeling results are obtained, and based on the partition modeling results of each rendering partition, the global modeling result for the display screen is obtained, including: determining the geometric bodies created for each rendering partition respectively; obtaining the meshes of each rendering partition according to the geometric bodies, the partition grid parameters, and the texture information of each rendering partition; and combining the meshes of each rendering partition to obtain the global modeling result for the display screen.
[0121] After the display screen is divided into at least one rendering partition, each rendering partition can be separately modeled and rendered. That is, each rendering partition can separately model a corresponding mesh body (Mesh), and the mesh body can be constructed based on a geometry body (BufferGeometry) and texture information (Texture). The partition mesh parameters can be used as the attribute information of the geometry body, and based on the geometry body, the partition mesh parameters, and the texture information, a 3D model corresponding to the rendering partition can be modeled, that is, the rendering result corresponding to the rendering partition can be obtained.
[0122] Exemplarily, for each rendering partition, a corresponding geometry body can be created, and the geometry body is used to model the corresponding mesh body. The computer device can independently create a corresponding geometry body for each rendering partition, and based on the geometry body, the partition mesh parameters, and the texture information of the rendering partition, model the mesh body of the rendering partition. The mesh body of the rendering partition can be used as the modeling result for the rendering partition, and the mesh body can include a 3D model of the display unit modeled for the display unit included in the rendering partition. The computer device can combine the mesh bodies modeled for each rendering partition respectively, for example, can be combined according to the corresponding distribution positions of the rendering partitions, so as to obtain a global modeling result for the display screen, and the global modeling result can include a 3D model of the display screen modeled for the display screen. In some embodiments, for each rendering partition, the computer device can generate a corresponding modeling file according to the geometry body, the partition mesh parameters, and the texture information of the rendering partition, for example, can generate an Obj file, and the Obj file can define the mesh body corresponding to the rendering partition. The computer device can obtain a global modeling result for the display screen based on the modeling files corresponding to each rendering partition respectively. For example, the global modeling result can include an Obj modeling file for the display screen. The computer device can perform modeling and rendering processing based on the Obj modeling file, so as to visually display the modeling result for the display screen.
[0123] In this embodiment, the computer device obtains the mesh body of each rendering partition respectively according to the geometry body, the partition mesh parameters, and the texture information of each rendering partition, and combines the mesh bodies of each rendering partition respectively to obtain a global modeling result of the display screen. By dividing the display screen into at least one rendering partition and separately modeling them independently, it is possible to improve the modeling processing efficiency of the display screen while achieving accurate modeling.
[0124] In some exemplary embodiments, obtaining the screen physical parameters and partition configuration parameters of the display screen includes: in response to a configuration trigger operation for the display screen, displaying a configuration interface for the display screen; in response to a screen configuration operation triggered in the configuration interface, determining the screen physical parameters and partition configuration parameters configured for the display screen according to the screen configuration operation.
[0125] Among them, the screen physical parameters and partition configuration parameters of the display screen can be pre-configured by the user according to actual needs. The configuration trigger operation can be a trigger operation for the display screen process. Through the configuration trigger operation, the configuration interface can be activated to configure the display screen in the configuration interface.
[0126] Exemplarily, the user can interact with the display screen. For example, the user can click on the configuration entry for the display screen to generate a configuration trigger operation. The computer device can respond to this configuration trigger operation and display the configuration interface for the display screen. The configuration interface can include configuration items for the display screen, such as physical parameter configuration items and partition configuration items for the display screen. The user can configure the physical parameters of the display screen through the physical parameter configuration items and configure the rendering partition division of the display screen through the partition configuration items. The user can trigger a screen configuration operation in the configuration interface, and the computer device can respond to this screen configuration operation and obtain the configured screen physical parameters and partition configuration parameters of the display screen by the user according to the screen configuration operation.
[0127] In this embodiment, the computer device can respond to the user's screen configuration operation for the display screen, determine the configured screen physical parameters and partition configuration parameters for the display screen according to the screen configuration operation, and support the user to flexibly set the display screen to be modeled according to actual needs.
[0128] In some exemplary embodiments, the modeling method based on the display screen further includes: displaying a partition schematic diagram for the rendering partition; in response to a partition adjustment operation triggered for the partition schematic diagram, updating the partition schematic diagram according to the partition adjustment operation; updating the partition configuration parameters according to the partition adjustment operation, and returning to execute the step of dividing the display screen into at least one rendering partition according to the partition configuration parameters.
[0129] Among them, the partition schematic diagram is used to visually represent the rendering partitions in the display screen. The partition schematic diagram can include visual elements representing the rendering partitions, so that the visually divided rendering partitions in the display screen can be intuitively presented through the visual elements in the partition schematic diagram. The partition adjustment operation is used to adjust the rendering partitions in the display screen, such as including but not limited to various adjustment operations such as merging and splitting the rendering partitions.
[0130] Exemplarily, the computer device can display the partition schematic diagram of the rendering partition to visually display each rendered partition divided in the display screen through the partition schematic diagram. The user can trigger an interaction with respect to the partition schematic diagram, such as a partition adjustment operation triggered by the user with respect to the partition schematic diagram. Specifically, for example, the user can trigger partition adjustment operations such as merging and splitting with respect to the visual elements representing the rendering partitions in the partition schematic diagram. The computer device can respond to the partition adjustment operation, update the partition schematic diagram, and display the updated partition schematic diagram. The computer device can also update the partition configuration parameters according to the partition adjustment operation, and return to execute the step of dividing the display screen into at least one rendering partition according to the partition configuration parameters, so as to synchronously update the modeling of the display screen according to the updated partition configuration parameters.
[0131] In this embodiment, the computer device can display the partition schematic diagram of the rendering partition, support the user to trigger a partition adjustment operation with respect to the partition schematic diagram, synchronously update the partition schematic diagram and the modeling result of the display screen according to the partition adjustment operation, support the user to dynamically update the modeling of the display screen, and improve the modeling processing efficiency of the display screen.
[0132] In some exemplary embodiments, updating the partition schematic diagram according to the partition adjustment operation includes: updating the rendering partition according to the partition adjustment operation to obtain an updated rendering partition; determining the partition coordinates of the updated rendering partition, and updating the partition schematic diagram according to the partition coordinates of the updated rendering partition.
[0133] Among them, the partition coordinates are the coordinate position range of the updated rendering partition, which can be specifically implemented based on the partition data structure of the quadruple [x1, y1, x2, y2], that is, the updated rendering partition can be located based on the four vertices such as (x1, y1), (x1, y2), (x2, y2), and (x2, y1) constructed from the quadruple [x1, y1, x2, y2]. Optionally, the computer device can update the rendering partition according to the partition adjustment operation. For example, it can update the partition division method of the display screen. For example, it can perform update processing such as merging and splitting the rendering partition to obtain the updated rendering partition. The computer device can determine the partition coordinates of the updated rendering partition. For example, it can determine the partition coordinates of the updated rendering partition based on the partition data structure of the quadruple [x1, y1, x2, y2]. The computer device can update the partition schematic diagram according to the partition coordinates of the updated rendering partition. For example, it can update the visual elements representing the rendering partition in the partition schematic diagram, so as to realize the update of the partition schematic diagram, and make the partition division method of the display screen in the updated partition schematic diagram synchronized with the partition division method in the modeling result of the display screen. In some embodiments, the computer device can convert the partition coordinates of the updated rendering partition into 2D coordinates in the partition schematic diagram, and update the partition schematic diagram based on the converted 2D coordinates. For example, it can update the distribution position of the visual elements representing the rendering partition in the partition schematic diagram based on the converted 2D coordinates.
[0134] In this embodiment, the computer device can update the partition schematic diagram based on the partition coordinates of the updated rendering partition, which can ensure that the partition division method in the partition schematic diagram is synchronized with the partition division method in the modeling result of the display screen, and guarantee the reliability of the schematic content displayed in the partition schematic diagram.
[0135] This application also provides an application scenario that applies the above-mentioned modeling method based on the display screen. Specifically, the application of the modeling method based on the display screen in this application scenario is as follows:
[0136] In a shopping mall, a real display screen can be set up. The display screen is obtained by splicing multiple display units. When constructing a corresponding virtual scene for the shopping mall scenario, such as replicating the real shopping mall in the virtual scene of a game during game production, when modeling the shopping mall, it also involves modeling the real display screen in the shopping mall. For the modeling of the display screen, the computer device can obtain the corresponding partition configuration parameters and screen physical parameters. The computer device can divide the display screen into at least one rendering partition according to the partition configuration parameters, and determine the display units included in each rendering partition and the index information of the display units according to the partition configuration parameters, screen physical parameters, and unit size. The computer device can respectively determine the partition grid parameters of each rendering partition based on the index information and unit size of the display units included in each rendering partition, obtain the partition modeling results according to the partition grid parameters of each rendering partition, and obtain the global modeling result for the display screen based on the partition modeling results of each rendering partition. The global modeling result can include the 3D model corresponding to the display screen set in the shopping mall. By loading the global modeling result into the game file, the corresponding display screen 3D model can be rendered in the game virtual scene.
[0137] The present application also provides an application scenario that applies the above-mentioned modeling method based on the display screen. Specifically, the application of the modeling method based on the display screen in this application scenario is as follows:
[0138] This application scenario relates to LED virtual shooting technology, which creates a highly realistic virtual scene in a studio by combining high-brightness LED screens, a real-time rendering engine, and a camera following system. In LED virtual shooting technology, it is necessary to model the display screen in the real scene. The display screen can specifically include an LED wall formed by splicing several LED modules. In the process of modeling the display screen, professional 3D modeling skills are often required, resulting in high labor costs; and adjusting the UV mapping is time-consuming and error-prone, and it is impossible to quickly respond to on-site adjustment requirements. In addition, after the display screen is divided into multiple rendering partitions, the rendering partitions are fixed and cannot be modified or adjusted, lacking real-time preview ability, resulting in the inability to meet the requirements of complex scenarios.
[0139] There are accuracy problems in traditional modeling of LED walls, such as Figure 11As shown in the figure, inaccurate UV mapping results in obvious "seams" in the displayed content in different intervals, that is, there are obvious splicing gaps (such as the thick black line) between the rendering partitions of the display screen. After troubleshooting the seam problem, such as checking the LED screen control settings, checking the display settings of the display device, and checking the application window settings, it is found that the UV of the 3D model of the display screen is not full, that is, the UV mapping of the display screen is not aligned with the edge of the display screen. In the 3D engine, the mapping relationship between the surface of the 3D model and the texture pixels is determined through the UV mapping information. When the rendering application uses this UV mapping information to reverse map the virtual space to the LED screen, it is found that the UV mapping does not fill the 0-1 space, that is, there are gaps at the edges, resulting in the inward movement of the edge vertices and the absence of color at the edges. At this time, it is often necessary to manually adjust the UV mapping information. However, there is usually a blank space at the UV edge generated by the modeling software. When rendering, due to precision errors, the UV values of the edge vertices may exceed the 0-1 range. If the UV completely fills the space, these extra samplings will cause abnormal rendering. Moreover, the design goal of the UV editor of the modeling software is for traditional modeling requirements, lacking the integer alignment and batch scaling functions required for the LED scenario, resulting in the precise adjustment of UV points requiring manual operation, which is time-consuming and difficult to ensure accuracy. In addition, during on-site implementation, the screen re-partitioning operation performed to optimize performance will cause the UV to need to be re-adjusted, and the whole process is very time-consuming. In addition, it is time-consuming and error-prone for users to manually adjust the UV coordinates, and the UV unfolding accuracy of the curved LED wall is also relatively low.
[0140] Based on this, the modeling method based on the display screen provided by the present application, when applied to the LED virtual shooting technology, the display screen can be an LED wall, and the display unit can be an LED module that makes up the LED wall. Specifically, before virtual shooting, after building the LED wall, it is necessary to quickly complete the virtual screen modeling. As Figure 12 shown, as a user, the virtual production technician can perform partition configuration on the display screen. Specifically, the screen type (flat / curved) can be selected, the physical parameters (size / radian, etc.) and partition configuration parameters (number of rows and columns) can be input, and the unit size of each LED module can also be configured. After confirmation, a 3D model of the display screen can be automatically modeled. As Figure 13 shown, in some embodiments, it is a 3D model of the LED wall modeled in the virtual scene. The 3D model of the LED wall can be divided into 4 rendering partitions, and the number and distribution positions of the LED modules covered by each rendering partition are different. Further, the user can also perform real-time preview on the obtained 3D model and support fine-tuning. For example, the user can adjust the size of the rendering partition in the 3D model.
[0141] In some embodiments, dynamic adjustment is supported for users at the shooting site. For example, if the partition scheme needs to be adjusted temporarily due to shooting requirements, the user can select the target rendering partition in the 3D preview window, drag the boundary, or select merge / split. As Figure 14 shown, the user can trigger the operation of splitting the rendering partition 4. As Figure 15 shown, the rendering partition 1 includes 8 LED modules, the rendering partition 2 includes 8 LED modules, the rendering partition 3 includes 16 LED modules, and the rendering partition 4 includes 32 LED modules. After splitting the rendering partition, the number of LED modules included in the adjusted rendering partition will change accordingly. The computer device can automatically update the UV mapping information of each rendering partition in the LED wall. As Figure 16 shown, the user can also trigger the merging of the rendering partition 4 and the rendering partition 5; as Figure 17 shown, after merging the rendering partition 4 and the rendering partition 5, in the 3D model of the LED wall obtained by re-modeling, the number of rendering partitions changes from 6 to 5, and the original rendering partition 4 and rendering partition 5 are updated to the new rendering partition 4.
[0142] In LED virtual shooting technology, the LED wall is composed of a large number of standard small screens (usually LED modules of 0.5m×0.5m) spliced together. Each small screen has a fixed physical size and resolution. Multiple small screens form a rendering partition. Partitioning is to solve the problem that a single graphics card cannot handle the rendering task of the entire LED wall. Therefore, partitioning is required, and each rendering partition requires an independent UV space to ensure correct mapping of the content.
[0143] From the perspective of 3D modeling, the LED wall can be simplified into a planar system without thickness. Based on this, taking a small screen, that is, an LED module as an example, its core data structure can include a vertex array, a UV array, and an index array, where:
[0144] / / Vertex array: Define the spatial position
[0145] vertices=
[0146] 0.0,0.0,0.0 / / Lower left corner point (x, y, z)
[0147] 0.5,0.0,0.0 / / Lower right corner point
[0148] 0.5,0.5,0.0 / / Upper right corner point
[0149] 0.0,0.5,0.0 / / Upper left corner point
[0151] / / UV array: Define the texture coordinates
[0152] uvs =
[0153] 0.0, 0.0 / / Bottom - left UV
[0154] 1.0, 0.0 / / Bottom - right UV
[0155] 1.0, 1.0 / / Top - right UV
[0156] 0.0, 1.0 / / Top - left UV
[0158] / / Index array: Connect vertices to form faces
[0159] indices =
[0160] 0, 1, 2 / / The first triangle
[0161] 2, 3, 0 / / The second triangle
[0163] Based on this, a complete parametric modeling system can be constructed, including:
[0164] 1. Abstract core parameters, including:
[0165] a. Small - screen parameters
[0166] Physical size: The standard specification is 0.5m × 0.5m, which is the basic unit of modeling;
[0167] Dot pitch: Determines the actual resolution of each physical screen, such as 2.6mm / pixel; The dot pitch is the physical distance between LED pixels and determines the display precision. For example, if the dot pitch of a 0.5m * 0.5m small screen is 2.6mm, then its number of pixels is 0.5 * 1000 / 2.6 = 192;
[0168] b. LED - wall parameters
[0169] For a flat - faced screen, including:
[0170] Total physical size: Width and height (in meters);
[0171] For a curved screen, including:
[0172] Height (in meters);
[0173] Radius of curvature;
[0174] Opening angle: Defines the overall radian range;
[0175] c. Partition parameters
[0176] Partitioning method: Number of rows and columns;
[0177] 2. Mesh Generation Processing
[0178] a. Generate an independent geometry for each rendering partition according to the partitioning method, and calculate the LED modules it contains based on the range of the rendering partition;
[0179] b. Calculate the vertices of the LED modules within each rendering partition;
[0180] For a flat screen:
[0181] The origin is at the lower left corner; for each LED module within the rendering partition, calculate according to its row (i) and column (j) positions:
[0182] x coordinate = column number * unit screen width;
[0183] y coordinate = row number * unit screen height;
[0184] z coordinate = 0;
[0185] For a curved screen:
[0186] The origin is at the center of the arc; for each LED module within the partition, calculate according to its row (i) and column (j) positions:
[0187] Angle calculation:
[0188] The curvature of the entire LED wall is determined by the screen opening angle, and this opening angle is evenly distributed to each LED module in the horizontal direction;
[0189] Angle of the current LED module =(j / total number of columns) × opening angle;
[0190] Position calculation:
[0191] x coordinate = sin( ) × radius;
[0192] y coordinate = i × unit screen height;
[0193] z coordinate = cos( ) × radius (the origin is at the center of the arc, so the z coordinate is negative);
[0194] c. Calculate the uvs for each partition
[0195] For a flat screen:
[0196] u = column number / total number of columns;
[0197] v = row number / total number of rows;
[0198] For a curved screen:
[0199] u = (starting position x of x - coordinate partition) / total partition width;
[0200] v = (starting position y of y - coordinate partition) / total partition height;
[0201] d. Calculation of indices for each partition
[0202] Each LED module generates two triangles. The first triangle: bottom - left, bottom - right, top - right; The second triangle: top - right, top - left, bottom - left.
[0203] Specifically, as Figure 18 shown, users can input LED screen parameters, which can include various parameters such as flat screens, curved screens, and pixel pitches. After modeling by the modeling software, a 3D model corresponding to the LED screen is output. As Figure 19 shown, in the modeling process for the LED wall, the real physical structure parameters of the LED wall existing in the display scene can be 10 meters in width and 3.5 meters in height. As Figure 20 shown, for rendering partition division, when dividing by partition configuration parameters of 1 row and 4 columns, 4 rendering partitions can be obtained. The width of each rendering partition is 2.5 meters and the height is 3.5 meters. Each rendering partition includes 5×7 LED modules.
[0204] The computer device can obtain the respective vertices of each rendering partition according to the partition data of the LED wall. In each rendering partition (Block), for each LED module, a vertex grid can be generated according to the number of rows and columns (lineHeight / columnWidth). Further, for a flat screen, the vertex position information of each vertex can be calculated based on x = column index × unit screen height, y = row index × unit screen width, and z = 0. For a curved screen, the vertex position information of each vertex can be calculated based on x = sin(column index × screen angle) × radius, y = row index × unit screen width, and z = -cos(column index × screen angle) × radius. As Figure 21As shown, it is the calculation process for each LED module in each rendering partition. For each LED module in the LED wall, the vertex position information of each vertex can be calculated separately, and the face index information of the LED module can be determined. The face index information can include the serial numbers of the three vertices of the triangle. For example, the four vertices of a certain LED module are vertex A, vertex B, vertex C, and vertex D respectively. Among them, according to the formula x = sin(θ)×r, y = i×unitHeight, z = -cos(θ)×r, the vertex position information of vertex D can be calculated as (8.17, 3.50, -17.82), where θ is the unit angle of the LED module, r is the radius of the LED wall, i is the row index of the LED module, and unitHeight is the height of the LED module. Further, it can be determined that the face index information of the LED module includes the face index information [0,1,2] of the triangle formed by vertex A, vertex B, and vertex D, and the face index information [2,3,0] of the triangle formed by vertex D, vertex C, and vertex A.
[0205] To ensure the correct transition of content between rendering partitions, the UV coordinates within each rendering partition are calculated through normalization. Specifically, the UV coordinates can be calculated based on u = (current column - starting column) / total number of columns, v = 1 - (current row - starting row) / total number of rows. Among them, the v value of the UV coordinates is inverted to match the texture coordinate system. As Figure 22 shown, it is the calculation process for UV mapping in each rendering partition. Among them, for a certain vertex A in the rendering partition, its VU coordinates are (0.40, 0.57). The VU coordinates can be calculated based on u = (j - j') / width and v = 1 - (i - i') / height, where j is the current column where vertex A is located, j' is the starting column of the rendering partition to which it belongs, width is the total number of columns of the rendering partition to which it belongs; i is the current row where vertex A is located, i' is the starting row of the rendering partition to which it belongs, and height is the total number of rows of the rendering partition to which it belongs.
[0206] As Figure 23As shown, it is a process for dynamically updating rendering partitions. Specifically, for a rendering partition that triggers an update, the partition coordinates of the updated rendering partition can be determined. The partition coordinates can be a partition data structure based on the quadruple [x1, y1, x2, y2], which supports 2D visual editing of splitting / merging and can solve the problem of dynamic partition adjustment. Moreover, it also supports the regeneration of the mesh body Mesh after 3D reconstruction to solve the installation error of the physical LED screen. For the partition coordinates, they can be converted to the 2D coordinates of the interface to display the corresponding partition schematic diagram in the interface. The computer device can adjust the corresponding partition schematic diagram according to the converted 2D coordinates and generate the corresponding modeling result. For example, a global modeling result including 4 rendering partitions can be generated; another example is that after merging 4 rendering partitions, a global modeling result including 5 rendering partitions can be dynamically generated.
[0207] When generating the mesh body Mesh corresponding to the LED wall, the computer device can create a basic geometry BufferGeometry and set the geometry attributes, specifically including: setting the vertex positions, where every 3 values represent the x, y, and z coordinates of a vertex; setting the UV coordinates, where every 2 values represent the u and v coordinates of a vertex; setting the vertex indices, where every 3 values form a triangle; and calculating the normals. The computer device can create a material (texture information) using MeshPhongMaterial to support basic lighting and create the mesh body Mesh corresponding to the rendering partition by combining the geometry BufferGeometry and the texture information. In some embodiments, as Figure 24 shown, in the generated model file, various data of the mesh body Mesh corresponding to the rendering partition can be recorded. The model file can be an Obj file. For example, for the coordinates of the upper left LED module, it can include the vertex position information, UV coordinates of the vertex, and the face index information of the triangle. Based on the model file, graphical processing can be performed to construct the corresponding mesh body Mesh. As Figure 25 shown, it is for the rendering use of the generated Obj file, and specifically, the 3D model of the corresponding LED wall can be rendered in a virtual scene.
[0208] The modeling method based on the display screen provided by this application can achieve the adaptive partition processing of the LED virtual shooting screen based on parametric modeling. This method abstracts the LED wall into a standardized unit grid, uses a quadruple coordinate system to achieve precise positioning, supports dynamic partition adjustment and precise UV mapping. It innovatively introduces an adaptive space mapping technology to solve the "seam" problem in traditional LED wall modeling. This solution significantly improves the efficiency of building a virtual shooting scene, shortening the modeling time and adjustment time from the hour level to the minute level.
[0209] The modeling method based on a display screen provided by this application introduces a quadruple coordinate system to achieve precise spatial positioning, can automatically calculate UV mapping, ensure pixel-level alignment of partition boundaries, and designs a dedicated UV unfolding algorithm for curved screens, which can greatly improve the modeling efficiency. In terms of specific quantitative effects, the modeling time is shortened from the traditional 12 days to within 5 minutes, the partition adjustment response time is improved from the hour level to the millisecond level (average 16 ms), and the manual operation steps are reduced by 90%. The specific technical principles include parametric modeling replacing manual modeling, real-time preview eliminating repeated debugging, and automatic UV mapping replacing manual adjustment, etc. Moreover, the maintenance cost is greatly reduced. In terms of specific quantitative effects, the technical training time is reduced by 80%, the problem location time is shortened by 90%, and the labor cost is reduced. The specific technical principles include a visual operation interface, real-time monitoring and early warning, and automated operation and maintenance, etc. The modeling method based on a display screen provided by this application can lower the technical threshold of virtual shooting, improve the production efficiency and quality, promote the development of technical standardization, be applicable to various virtual production scenarios, support rapid scene setup and debugging, facilitate the accumulation and reuse of technical experience. In addition, compared with the traditional modeling process that requires repeated verification for modification and adjustment and requires professional 3D modeling skills, the modeling method based on a display screen provided by this application provides a real-time preview function to support instant verification, and the visual interface can lower the usage threshold.
[0210] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are shown in sequence according to the arrows, these steps do not necessarily have to be executed in the order indicated by the arrows. Unless there is a clear indication in this article, there is no strict order limit for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages do not necessarily have to be completed at the same moment, but can be executed at different moments. The execution order of these steps or stages does not necessarily have to be sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.
[0211] Based on the same inventive concept, the embodiments of this application also provide a modeling device based on a display screen for implementing the above-mentioned modeling method based on a display screen. The solution for solving problems provided by this device is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the modeling device based on a display screen provided below can refer to the limitations on the modeling method based on a display screen in the above text, and will not be elaborated here.
[0212] In an exemplary embodiment, as Figure 26As shown, a display-based modeling device 2600 is provided, including: a parameter acquisition module 2602, a partition division module 2604, a partition information determination module 2606, a grid parameter determination module 2608, and a modeling result acquisition module 2610, where:
[0213] The parameter acquisition module 2602 is configured to acquire the screen physical parameters and partition configuration parameters of the display screen, and the display screen includes at least one display unit of a unit size;
[0214] The partition division module 2604 is configured to divide the display screen into at least one rendering partition according to the partition configuration parameters;
[0215] The partition information determination module 2606 is configured to determine, according to the partition configuration parameters, the screen physical parameters, and the unit size, the display units included in each rendering partition and the index information of the display units;
[0216] The grid parameter determination module 2608 is configured to respectively determine the partition grid parameters of each rendering partition based on the index information of the display units included in each rendering partition and the unit size;
[0217] The modeling result acquisition module 2610 is configured to obtain the partition modeling results according to the partition grid parameters of each rendering partition, and obtain the global modeling result for the display screen based on the partition modeling results of each rendering partition.
[0218] In some embodiments, the grid parameter determination module 2608 is further configured to, for each rendering partition, based on the first index information of the display units included in the rendering partition targeted and the unit size, determine the vertex position information of each vertex of the display unit; respectively determine the space mapping information of each vertex of the display unit; determine the face index information of the display unit according to the second index information of each vertex of the display unit; and obtain the partition grid parameters of each rendering partition based on the vertex position information, the space mapping information, and the face index information of the display units included in each rendering partition.
[0219] In some embodiments, the grid parameter determination module 2608 is further configured to, when the display screen belongs to the flat screen type, determine the first coordinate information of each vertex of the display unit according to the column index information in the first index information of the display units included in the rendering partition targeted and the width in the unit size; determine the second coordinate information of each vertex of the display unit according to the row index information in the first index information and the height in the unit size; and respectively obtain the vertex position information of each vertex of the display unit based on the first coordinate information and the second coordinate information of each vertex of the display unit.
[0220] In some embodiments, the grid parameter determination module 2608 is further configured to determine the first mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the column index information and the partition column range of the targeted rendering partition; determine the second mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the row index information and the partition row range of the targeted rendering partition; and obtain the spatial mapping information of each vertex of the display unit based on the first mapping coordinates and the second mapping coordinates of each vertex of the display unit.
[0221] In some embodiments, when the display screen is of an arc screen type, the grid parameter determination module 2608 is further configured to determine the unit angle of the display unit according to the column index information in the first index information of the display units included in the targeted rendering partition and the opening angle parameter in the screen physical parameters, where the opening angle parameter represents the radian range of the display screen; determine the first coordinate information of each vertex of the display unit according to the unit angle and the arc radius in the screen physical parameters; determine the second coordinate information of each vertex of the display unit according to the row index information in the first index information and the height in the unit size; determine the third coordinate information of each vertex of the display unit according to the unit angle and the arc radius; and obtain the vertex position information of each vertex of the display unit respectively based on the first coordinate information, the second coordinate information, and the third coordinate information of each vertex of the display unit.
[0222] In some embodiments, the grid parameter determination module 2608 is further configured to determine the first mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the first coordinate information of each vertex of the display unit, the first starting coordinate information of the targeted rendering partition, and the partition width of the targeted rendering partition; determine the second mapping coordinates of each vertex of the display unit in the targeted rendering partition according to the second coordinate information of each vertex of the display unit, the second starting coordinate information of the targeted rendering partition, and the partition height of the targeted rendering partition; and obtain the spatial mapping information of each vertex of the display unit based on the first mapping coordinates and the second mapping coordinates of each vertex of the display unit.
[0223] In some embodiments, the grid parameter determination module 2608 is further configured to determine the second index information of each vertex of the display unit; and obtain the face index information of the display unit based on the combination of the second index information of each vertex of the display unit.
[0224] In some embodiments, the partition information determination module 2606 is further configured to determine the partition range of each rendering partition according to the partition configuration parameters and the screen physical parameters; determine the display units included in each rendering partition according to the partition range of each rendering partition and the unit size; and determine the index information of the display units based on the display units included in each rendering partition.
[0225] In some embodiments, the modeling result obtaining module 2610 is further configured to determine the geometric bodies created for each rendering partition respectively; obtain the meshes of each rendering partition according to the geometric bodies of each rendering partition respectively, the partition mesh parameters, and the texture information; and combine the meshes of each rendering partition respectively to obtain the global modeling result for the display screen.
[0226] In some embodiments, the parameter acquisition module 2602 is further configured to, in response to a configuration trigger operation for the display screen, display a configuration interface for the display screen; and in response to a screen configuration operation triggered in the configuration interface, determine the screen physical parameters and the partition configuration parameters configured for the display screen according to the screen configuration operation.
[0227] In some embodiments, it further includes a partition adjustment module, which is configured to display a partition schematic diagram for the rendering partition; in response to a partition adjustment operation triggered for the partition schematic diagram, update the partition schematic diagram according to the partition adjustment operation; update the partition configuration parameters according to the partition adjustment operation, and return to execute the step of dividing the display screen into at least one rendering partition according to the partition configuration parameters.
[0228] In some embodiments, the partition adjustment module is further configured to update the rendering partition according to the partition adjustment operation to obtain an updated rendering partition; determine the partition coordinates of the updated rendering partition, and update the partition schematic diagram according to the partition coordinates of the updated rendering partition.
[0229] Each module in the above display screen-based modeling device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor in the computer device in hardware form or be independent of it, or can be stored in the memory in the computer device in software form, so that the processor can call and execute the operations corresponding to the above respective modules.
[0230] In an exemplary embodiment, a computer device is provided. The computer device can be a server or a terminal, and its internal structural diagram can be as Figure 27As shown in the figure. The computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O), and a communication interface. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database of the computer device is used to store various data such as screen physical parameters, partition configuration parameters, unit size, index information, partition grid parameters, partition modeling results, or global modeling results. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements a modeling method based on a display screen.
[0231] Those skilled in the art can understand that Figure 27 the structure shown in the figure is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.
[0232] In one embodiment, a computer device is further provided, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, the steps in the above method embodiments are implemented.
[0233] In one embodiment, a computer-readable storage medium is provided, storing a computer program. When the computer program is executed by the processor, the steps in the above method embodiments are implemented.
[0234] In one embodiment, a computer program product is provided, including a computer program. When the computer program is executed by the processor, the steps in the above method embodiments are implemented.
[0235] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.
[0236] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processors, graphics processors, digital signal processors, programmable logic devices, etc., without limitation.
[0237] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.
[0238] The above-described embodiments merely represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.
Claims
1. A display-based modeling method, characterized in that, The method includes: Obtaining the screen physical parameters and partition configuration parameters of the display screen, where the display screen includes at least one display unit of a unit size; Dividing the display screen into at least one rendering partition according to the partition configuration parameters; Determining, according to the partition configuration parameters, the screen physical parameters, and the unit size, the display units included in each rendering partition and the index information of the display units; Based on the index information of the display units included in each rendering partition and the unit size, respectively determining the partition grid parameters of each rendering partition; Obtaining a partition modeling result according to the partition grid parameters of each rendering partition, and obtaining a global modeling result for the display screen based on the partition modeling results of each rendering partition.
2. The method according to claim 1, characterized in that The step of respectively determining the partition grid parameters of each rendering partition based on the index information of the display units included in each rendering partition and the unit size includes: For each rendering partition, based on the first index information of the display units included in the rendering partition to be targeted and the unit size, determining the vertex position information of each vertex of the display unit; Respectively determining the spatial mapping information of each vertex of the display unit; According to the second index information of each vertex of the display unit, determining the face index information of the display unit; Based on the vertex position information, spatial mapping information, and face index information of the display units included in each rendering partition, obtaining the partition grid parameters of each rendering partition.
3. The method according to claim 2, wherein The step of determining the vertex position information of each vertex of the display unit based on the first index information of the display units included in the rendering partition to be targeted and the unit size includes: In the case where the display screen belongs to the flat screen type, according to the column index information in the first index information of the display units included in the rendering partition to be targeted and the width in the unit size, determining the first coordinate information of each vertex of the display unit; According to the row index information in the first index information and the height in the unit size, determining the second coordinate information of each vertex of the display unit; Based on the first coordinate information and the second coordinate information of each vertex of the display unit, respectively obtaining the vertex position information of each vertex of the display unit.
4. The method according to claim 3, characterized in that The step of respectively determining the spatial mapping information of each vertex of the display unit includes: According to the column index information and the partition column range of the rendering partition to be targeted, determining the first mapping coordinates of each vertex of the display unit in the rendering partition to be targeted; According to the row index information and the partition row range of the rendering partition to be targeted, determining the second mapping coordinates of each vertex of the display unit in the rendering partition to be targeted; Based on the first mapping coordinates and the second mapping coordinates of each vertex of the display unit, obtaining the spatial mapping information of each vertex of the display unit.
5. The method according to claim 2, characterized in that, Determining the vertex position information of each vertex of the display unit based on the first index information of the display units included in the rendering partition to be targeted and the unit size includes: When the display screen belongs to the arc screen type, determining the unit angle of the display unit according to the column index information in the first index information of the display units included in the rendering partition to be targeted and the opening angle parameter in the screen physical parameters, where the opening angle parameter characterizes the radian range of the display screen; Determining the first coordinate information of each vertex of the display unit according to the unit angle and the arc radius in the screen physical parameters; Determining the second coordinate information of each vertex of the display unit according to the row index information in the first index information and the height in the unit size; Determining the third coordinate information of each vertex of the display unit according to the unit angle and the arc radius; Based on the first coordinate information, second coordinate information, and third coordinate information of each vertex of the display unit, respectively obtaining the vertex position information of each vertex of the display unit.
6. The method according to claim 5, wherein Respectively determining the spatial mapping information of each vertex of the display unit includes: Determining the first mapping coordinates of each vertex of the display unit in the rendering partition to be targeted according to the first coordinate information of each vertex of the display unit, the first starting coordinate information of the rendering partition to be targeted, and the partition width of the rendering partition to be targeted; Determining the second mapping coordinates of each vertex of the display unit in the rendering partition to be targeted according to the second coordinate information of each vertex of the display unit, the second starting coordinate information of the rendering partition to be targeted, and the partition height of the rendering partition to be targeted; Based on the first mapping coordinates and second mapping coordinates of each vertex of the display unit, obtaining the spatial mapping information of each vertex of the display unit.
7. The method according to claim 2, characterized in that, Determining the face index information of the display unit according to the second index information of each vertex of the display unit includes: Determining the second index information of each vertex of the display unit; Based on the combination of the second index information of each vertex of the display unit, obtaining the face index information of the display unit.
8. The method according to claim 1, wherein Determining the display units included in each rendering partition and the index information of the display units according to the partition configuration parameters, the screen physical parameters, and the unit size includes: Determining the partition range of each rendering partition according to the partition configuration parameters and the screen physical parameters; Determining the display units included in each rendering partition according to the partition range of each rendering partition and the unit size; Based on the display units included in each rendering partition, determining the index information of the display units.
9. The method according to claim 1, characterized in that Obtaining the partition modeling result according to the partition grid parameters of each rendering partition and obtaining the global modeling result for the display screen based on the partition modeling result of each rendering partition includes: Determining the geometric body created for each rendering partition respectively; Based on the geometry, partition grid parameters, and texture information of each of the rendering partitions, a mesh body for each of the rendering partitions is obtained. The mesh bodies of each of the rendering partitions are combined to obtain a global modeling result for the display screen.
10. The method according to claim 1, wherein The obtaining of the screen physical parameters and partition configuration parameters of the display screen includes: In response to a configuration trigger operation for the display screen, a configuration interface for the display screen is displayed. In response to a screen configuration operation triggered in the configuration interface, the screen physical parameters and partition configuration parameters configured for the display screen are determined according to the screen configuration operation.
11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: Displaying a partition schematic diagram for the rendering partition. In response to a partition adjustment operation triggered for the partition schematic diagram, the partition schematic diagram is updated according to the partition adjustment operation. The partition configuration parameters are updated according to the partition adjustment operation, and the step of dividing the display screen into at least one rendering partition according to the partition configuration parameters is returned for execution.
12. The method according to claim 11, wherein The updating of the partition schematic diagram according to the partition adjustment operation includes: The rendering partition is updated according to the partition adjustment operation to obtain an updated rendering partition. The partition coordinates of the updated rendering partition are determined, and the partition schematic diagram is updated according to the partition coordinates of the updated rendering partition.
13. A modeling device based on a display screen, characterized in that, The apparatus includes: A parameter acquisition module for acquiring the screen physical parameters and partition configuration parameters of a display screen, where the display screen includes at least one display unit of a unit size. A partition division module for dividing the display screen into at least one rendering partition according to the partition configuration parameters. A partition information determination module for determining, according to the partition configuration parameters, the screen physical parameters, and the unit size, the display units included in each of the rendering partitions and the index information of the display units. A grid parameter determination module for respectively determining the partition grid parameters of each of the rendering partitions based on the index information of the display units included in each of the rendering partitions and the unit size. A modeling result acquisition module for obtaining a partition modeling result according to the partition grid parameters of each of the rendering partitions, and obtaining a global modeling result for the display screen based on the partition modeling results of each of the rendering partitions.
14. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, the steps of the method according to any one of claims 1 to 12 are implemented.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 12 are implemented.
16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 12 are implemented.