2.5 D model multi-screen display editing method and system

Abstract

The invention discloses a 2.5 D model multi-screen display editing method and system, and belongs to the field of computer image processing. The method mainly comprises the steps of environment preparation, starting of related plug-ins, connection establishment, model generation and display, model parameter adjustment and synchronous updating. After the 2.5 D model is generated and loaded to the large screen for display, a user can directly perform real-time operation and modification on the model in a large screen environment, such as height, position, angle, deformation strength and the like, without exiting a current operation mode, returning to editing software to modify or replace the model and then restarting a display process.

Description

Technical Field

[0001] The present invention relates to the field of computer image processing, and in particular to a 2.5D model multi-screen display editing method and system. Background Art

[0002] In the field of extended reality (XR) technology, the application of 2.5D models is rapidly emerging and has become the focus of academic and industrial attention. As a bridge connecting the real and virtual worlds, XR technology integrates elements of augmented reality (AR), virtual reality (VR) and mixed reality (MR) to create a multi-dimensional interactive space for users.

[0003] Under current technical conditions, 2.5D models face some challenges in large-screen display:

[0004] In terms of real-time performance, once the model is loaded onto the large screen, any changes require restarting the rendering process, affecting the smoothness of the user experience.

[0005] In terms of flexibility and operational complexity, after the 2.5D model is completed and displayed on the large screen, the user cannot directly operate or modify the model in real time in the large-screen environment, such as adjusting the model's height, position, angle, deformation intensity, etc.; and the user must exit the current operating mode and return to the editing software to make necessary modifications or replace the model, and the display process needs to be started again, which makes the operation complicated and cumbersome. Summary of the invention

[0006] The purpose of the present invention is to overcome one or more deficiencies of the prior art. After the 2.5D model is generated and loaded onto a large screen for display, the user can directly perform real-time operations and modifications on the model in the large screen environment, such as height, position, angle, deformation intensity, etc., thereby providing a 2.5D model multi-screen display editing method and system.

[0007] The objective of the present invention is achieved through the following technical solutions:

[0008] A 2.5D model multi-screen display editing method, the method steps comprising:

[0009] S1.Environmental preparation:

[0010] Install the nDisplay plug-in, multiplayer collaboration plug-in, and image generation 2.5D model plug-in on the operation end; install the nDisplay plug-in and multiplayer collaboration plug-in on the display screen server; the 2.5D model plug-in is a 2.5D model conversion function that comes with the AI ​​Studio software.

[0011] S2. Enable plugins: Enable nDisplay plugin and multiplayer collaboration plugin on the display screen server to support multi-screen display and collaborative operation; enable nDisplay plugin, multiplayer collaboration plugin and image generation 2.5D model plugin on the operation end to connect to the display screen server and generate 2.5D models;

[0012] S3. Establishing a connection: The operation terminal is connected to the display screen server, and is used for the operation terminal and the display screen server to communicate with each other;

[0013] S4. Generate and display the model: Use the image generation 2.5D model plug-in on the operation end to generate a 2.5D model from the image; the operation end bakes the 2.5D dynamic model to generate a 2.5D static model and sends it to the display screen server; the display screen receives the static model and displays it on the display screen;

[0014] S5. Adjust model parameters: adjust the model parameters on the operation side, the operation side synchronously updates the static model, and sends the updated model to the display screen server;

[0015] S6. Synchronous update: The display screen server receives the updated static model sent by the operation terminal; the display screen terminal synchronously updates the model.

[0016] Furthermore, in step S5, the model parameters are adjusted at the operating end, and the adjusted parameters include: model replacement, model height, model position, angle and deformation strength.

[0017] A 2.5D model multi-screen display and editing system is provided, which includes an operation terminal, a display screen server and a display screen, and is used for generating, displaying and editing 2.5D models on multiple screens.

[0018] The beneficial effects of the present invention are:

[0019] (1) After the 2.5D model is generated and loaded onto the large screen for display, the user can directly operate and modify the model in real time on the large screen, such as height, position, angle, deformation intensity, etc.;

[0020] (2) There is no need to exit the current operating mode, return to the editing software to make modifications or replace the model, and then start the display process again. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A flowchart of the steps of a 2.5D model multi-screen display editing method;

[0022] Figure 2 It is a structural diagram of a 2.5D model multi-screen display editing system;

[0023] Figure 3 is the original picture;

[0024] Figure 4 2.5D model image generated for the original image;

[0025] Figure 5 This is the operation interface diagram;

[0026] Figure 6 It is the operation process diagram;

[0027] Figure 7 This is the interface diagram for real-time modification of data for 2.5D models. DETAILED DESCRIPTION

[0028] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0029] See also Figure 1 , provides a 2.5D model multi-screen display editing method, the steps comprising:

[0030] S1.Environmental preparation:

[0031] Install nDisplay plug-in, multiplayer collaboration plug-in and image generation 2.5D model plug-in on the operation end; install nDisplay plug-in and multiplayer collaboration plug-in on the display screen server;

[0032] Among them, nDisplay is a multi-screen visualization solution; the multi-player collaboration plug-in is a function that comes with UE;

[0033] S2. Enable plugins: Enable nDisplay plugin and multiplayer collaboration plugin on the display screen server to support multi-screen display and collaborative operation; enable nDisplay plugin, multiplayer collaboration plugin and image generation 2.5D model plugin on the operation end to connect to the display screen server and generate 2.5D models;

[0034] S3. Establishing a connection: The operation terminal is connected to the display screen server, and is used for the operation terminal and the display screen server to communicate with each other;

[0035] S4. Generate and display the model: Use the image generation 2.5D model plug-in on the operation end to generate a 2.5D model from the image; the operation end bakes the 2.5D dynamic model to generate a 2.5D static model and sends it to the display screen server; the display screen receives the static model and displays it on the display screen;

[0036] S5. Adjust model parameters: adjust the model parameters on the operation side, the operation side synchronously updates the static model, and sends the updated model to the display screen server;

[0037] S6. Synchronous update: The display screen server receives the updated static model sent by the operation end; the display screen end synchronously updates the model to ensure that the model on the display screen is consistent with the operation end.

[0038] See also Figure 2 The embodiment provides a 2.5D model multi-screen display and editing system, which includes an operation terminal, a display screen server and a display screen.

[0039] The operation end includes: image generation 2.5D model plug-in, nDisplay plug-in and multiplayer collaboration plug-in;

[0040] Among them, the image generation 2.5D model plug-in is used for 2.5D model generation; the nDisplay plug-in is used for multi-screen display; and the multi-person collaboration plug-in is used to connect to the display screen server.

[0041] The following is an example of the process and results of generating a 2.5D model from an original image for multi-screen display editing:

[0042] The test video processor used is Nova M40Pro, the LED display screen is Xiuhu P1.68, the cabinet is arranged in 6 columns and 5 rows, the screen refresh rate is 3840Hz, the display screen is connected to the display splicer through a network cable, the shooting camera is Sony's FS7, the shutter is set to 120 / 1 second, the recording format is set to 120 frames per second, the control host is HPZ4, the network switch is Huawei S5735S, and the control host is equipped with a video capture card BMD4K12G. Connect the operation terminal to the display screen server to ensure that the two can communicate with each other.

[0043] See also Figure 3 , input the original image into the operation terminal, install the nDisplay plug-in, multiplayer collaboration plug-in and image generation 2.5D model plug-in on the operation terminal; install the nDisplay plug-in and multiplayer collaboration plug-in on the display screen server;

[0044] Among them, nDisplay is a multi-screen visualization solution; the multi-player collaboration plug-in is a function that comes with UE;

[0045] Enable plug-ins: Enable nDisplay plug-in and multiplayer collaboration plug-in on the display screen server to support multi-screen display and collaborative operation; enable nDisplay plug-in, multiplayer collaboration plug-in and image generation 2.5D model plug-in on the operation end to connect to the display screen server and generate 2.5D models;

[0046] Establish connection: the operation terminal is connected to the display screen server, which is used for the operation terminal and the display screen server to communicate with each other;

[0047] See also Figure 4 ,Adjust model parameters: adjust model parameters on the operation side, the operation side synchronously updates the static model, and sends the updated model to the display screen server;

[0048] See also Figure 5 , Generate and display models: Use the image generation 2.5D model plug-in on the operation end to generate a 2.5D model from an image; the operation end bakes the 2.5D dynamic model to generate a 2.5D static model and sends it to the display screen server; the display screen receives the static model and displays it on the display screen;

[0049] See also Figure 6 After the static model has been displayed on the display screen, the model can be modified on the operation side, such as filling in a layer of a person image, which can then be updated synchronously on the display screen.

[0050] Synchronous update: The display screen server receives the updated static model sent by the operator; the display screen synchronously updates the model to ensure that the model on the display screen is consistent with the operator.

[0051] See also Figure 7 Compared with the traditional technology, after the 2.5D model in this embodiment is generated and loaded onto the large screen for display, the operating end, i.e. the user, can directly perform real-time operations and modifications on the model in the large screen environment, such as height, position, angle, deformation intensity, etc.; without having to exit the current operating mode, return to the editing software to make modifications or replace the model, and then start the display process again.

[0052] The above is only a preferred embodiment of the present invention. It should be understood that the present invention is not limited to the form disclosed herein, and should not be regarded as excluding other embodiments, but can be used in various other combinations, modifications and environments, and can be modified within the scope of the concept described herein through the above teachings or the technology or knowledge of the relevant field. The changes and modifications made by those skilled in the art shall not deviate from the spirit and scope of the present invention, and shall be within the scope of protection of the claims attached to the present invention.

Claims

1. A 2.5D model multi-screen display editing method, characterized in that: The method steps include: S1.Environmental preparation: Install nDisplay plug-in, multiplayer collaboration plug-in and image generation 2.5D model plug-in on the operation end; install nDisplay plug-in and multiplayer collaboration plug-in on the display screen server; S2. Enable plugins: Enable nDisplay plugin and multiplayer collaboration plugin on the display screen server to support multi-screen display and collaborative operation; enable nDisplay plugin, multiplayer collaboration plugin and image generation 2.5D model plugin on the operation end to connect to the display screen server and generate 2.5D models; S3. Establishing a connection: The operation terminal is connected to the display screen server, and is used for the operation terminal and the display screen server to communicate with each other; S4. Generate and display the model: Use the image generation 2.5D model plug-in on the operation end to generate a 2.5D model from the image; the operation end bakes the 2.5D dynamic model to generate a 2.5D static model and sends it to the display screen server; the display screen receives the static model and displays it on the display screen; S5. Adjust model parameters: adjust the model parameters on the operation side, the operation side synchronously updates the static model, and sends the updated model to the display screen server; S6. Synchronous update: The display screen server receives the updated static model sent by the operation terminal; the display screen terminal synchronously updates the model.

2. A 2.5D model multi-screen display editing method according to claim 1, characterized in that: In the step S5, the model parameters are adjusted at the operating end, and the adjusted parameters include: model replacement, model height, model position, angle and deformation strength.

3. A 2.5D model multi-screen display editing system, characterized in that: Used to execute a 2.5D model multi-screen display and editing method as described in claims 1 to 2, the system is used to generate, display and edit 2.5D models on multiple screens.

Images