Shadow configuration method, apparatus and device in virtual manufacturing, and storage medium

Abstract

The invention discloses a studio configuration method and device in virtual manufacturing, equipment and a storage medium, and relates to the technical field of computers and the Internet. The method comprises the steps that a configuration guide interface provided by a first application program is displayed, the first application program is used for configuring and managing a virtual studio project, and a plurality of configuration steps arranged in sequence are displayed in the configuration guide interface; in the configuration guide interface, displaying configuration guide information corresponding to the current configuration step and configuration information input by a user based on the configuration guide information; the configuration guide information is used for guiding a user to input configuration information related to the current configuration step; and after the plurality of configuration steps are completed, in response to an operation for the configuration completion control, generating first configuration data. The configuration guide interface displays the plurality of configuration steps arranged in sequence and the configuration guide information corresponding to each configuration step, so that the user can be effectively guided to complete the input operation of the configuration information, and the learning cost is low.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer and Internet technology, and in particular to a studio configuration method, device, equipment and storage medium in virtual production. Background Art

[0002] Unreal Engine is an open source 3D (Three-Dimensional) game engine for creating visually stunning interactive 3D applications, including video games, simulators, virtual reality, and augmented reality applications.

[0003] In the process of virtual production based on LED (Light Emitting Diode), most workers in the traditional film and television industry have no experience in using Unreal Engine. In order to put a picture data on the screen into a state that can be used for LED virtual production, a lot of Unreal Engine configuration work is required. It usually takes a long time for users to learn this set of processes, and in actual work, the screen process is cumbersome. Summary of the invention

[0004] The embodiment of the present application provides a studio configuration method, device, equipment and storage medium in virtual production. The technical solution provided by the embodiment of the present application is as follows.

[0005] According to one aspect of an embodiment of the present application, a method for configuring a studio in a virtual production is provided, the method comprising:

[0006] Displaying a configuration guide interface provided by a first application, wherein the first application is an application for configuring and managing a virtual production studio project, and the configuration guide interface displays a plurality of configuration steps arranged in sequence;

[0007] In the configuration guidance interface, the configuration guidance information corresponding to the current configuration step and the configuration information input by the user based on the configuration guidance information are displayed; wherein the configuration guidance information is used to guide the user to input the configuration information related to the current configuration step;

[0008] After the plurality of configuration steps are completed, in response to an operation on a configuration completion control, first configuration data is generated, the first configuration data including configuration information related to each of the plurality of configuration steps.

[0009] According to one aspect of an embodiment of the present application, a studio configuration device in virtual production is provided, the device comprising:

[0010] A first display module is used to display a configuration guide interface provided by a first application, wherein the first application is an application for configuring and managing a virtual production studio project, and the configuration guide interface displays a plurality of configuration steps arranged in sequence;

[0011] A second display module is used to display, in the configuration guidance interface, configuration guidance information corresponding to the current configuration step and configuration information input by the user based on the configuration guidance information; wherein the configuration guidance information is used to guide the user to input configuration information related to the current configuration step;

[0012] A generating module is used to generate first configuration data in response to an operation on a configuration completion control after the plurality of configuration steps are completed, wherein the first configuration data includes configuration information related to each of the plurality of configuration steps.

[0013] According to one aspect of an embodiment of the present application, a terminal device is provided, the terminal device comprising a processor and a memory, the memory storing a computer program, and the processor being used to execute the computer program to implement the studio configuration method in the above-mentioned virtual production.

[0014] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the studio configuration method in the above-mentioned virtual production.

[0015] According to one aspect of an embodiment of the present application, a computer program product is provided. The computer program product includes a computer program. The computer program is loaded and executed by a processor to implement the studio configuration method in the virtual production.

[0016] The technical solution provided in the embodiments of the present application can bring the following beneficial effects:

[0017] The first application provides the user with a configuration guide interface to guide the user to complete multiple configuration steps in order to complete the studio configuration. The configuration guide interface displays multiple configuration steps arranged in order, and the configuration guide information corresponding to each configuration step, which can effectively guide the user to complete the input operation of the configuration information, and the learning cost is low. The user does not need to be trained on the use of the first application, saving the user time. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a schematic diagram of an implementation environment of a solution provided by an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of a studio environment provided by an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of a studio environment provided by another embodiment of the present application;

[0021] Figure 4 is a flow chart of a studio configuration method in virtual production provided by an embodiment of the present application;

[0022] Figure 5 It is a schematic diagram of configuration steps provided by an embodiment of the present application;

[0023] Figure 6 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0024] Figure 7 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0025] Figure 8 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0026] Fig. 9 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0027] Fig.10 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0028] Fig.11 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0029] Fig.12 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0030] Fig.13 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0031] Fig.14 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0032] Fig.15 is a schematic diagram of configuration steps provided by another embodiment of the present application;

[0033] Fig.16 It is a schematic diagram of version control provided by an embodiment of the present application;

[0034] Fig.17 is a schematic diagram of batch processing provided by an embodiment of the present application;

[0035] Fig.18 is a block diagram of a studio configuration device in virtual production provided by an embodiment of the present application;

[0036] Fig.19 This is a structural block diagram of a terminal device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0037] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0038] Before introducing the technical solution of the present application, some basic concepts involved in the present application are first introduced and explained.

[0039] 1. Unreal Engine: Unreal Engine is an open source 3D game engine for creating visually stunning interactive 3D applications, including video games, simulators, virtual reality, and augmented reality applications. It provides a node-based visual blueprint system that enables developers to quickly create complex interactive elements without writing code. Unreal Engine also includes an advanced physics engine, artificial intelligence, rendering engine, and network code, making it one of the preferred engines for creating high-quality interactive 3D applications.

[0040] 2. Screen-on-screen process: Virtual production uses Unreal Engine and its screen-on-screen plug-in Ndisplay (NDisplayLauncher, N display launcher) as the screen-on-screen tool. By using its rendering control tool (control software Switchboard) as the control terminal, it controls multiple rendering machines to render the same picture for a large screen at the same time. The rendering machine transmits the rendered picture to the LED screen controller through the display cable, and uses the synchronization interface to ensure that the pictures rendered by each rendering device (i.e., rendering machine) are consistent in time, and then outputs the signal to the LED screen through the display control device. This complete process, that is, outputting the picture in the engine to the LED in real time, we call this process "screen-on-screen".

[0041] 3.LED virtual production: refers to the use of high-display performance, small-dot-pitch LED display screens as background walls, through a real-time rendering engine, using a multi-screen synchronous real-time rendering method, and using the camera's internal and external parameter synchronization system to render high-quality three-dimensional scenes onto the LED background wall. It also uses the real-time rendering engine to adjust and synchronize on-site lighting, scene mechanical devices and other shooting equipment, and is shot directly by the camera to synthesize real actor performances, prop displays and LED background walls in real time, thereby achieving a new type of film production method of "what you see is what you get".

[0042] 4. Assets: In game production, "assets" refers to the various elements used to create games. This is usually a general term, including images, sound effects, models, animations, and codes. Assets are crucial to game development because they are the basic building blocks of all visible and audible items in the game. Developers can obtain assets from a variety of sources, including creating, purchasing, renting, or obtaining from shared libraries. Assets need to be combined according to the needs of the game to create the final game. Asset management in game production is usually an important workflow, and continuous iteration and updating are required throughout the game production process to continuously optimize the gaming experience. In actual usage scenarios, assets usually exist in the form of file packages, which are transferred between departments through version control tools.

[0043] 5. Version control tools and Perforce: Perforce is an application for software development and version control that allows teams to securely collaborate and share source code, documents, and other assets throughout the development process. The core component of Perforce is Perforce Helix Core (also known as Perforce P4), which is a powerful version control system (VCS) that can manage large code bases and binary assets. Perforce is widely used in industries such as game development and enterprise software development.

[0044] Please refer to Figure 1 , which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The solution implementation environment can be implemented as a system architecture of a first application, and the first application can provide a studio configuration function for a user. The solution implementation environment may include: a terminal device 100 and a server 200.

[0045] The terminal device 100 may be an electronic device such as a PC (Personal Computer), a tablet computer, a mobile phone, a wearable device, a vehicle terminal, a VR (Virtual Reality) device, an AR (Augmented Reality) device, an MR (Mixed Reality) device, etc. A client that runs a first application may be installed in the terminal device 100, and the first application may provide a studio configuration function for the user. Exemplarily, the first application is an application for configuring and managing a virtually produced studio project, and the first application may display a configuration guide interface to guide the user to complete a plurality of configuration steps in sequence, and after the plurality of configuration steps are completed, generate first configuration data, and the first configuration data includes configuration information related to each of the plurality of configuration steps. In addition, the present application does not limit the form of the first application, including but not limited to App (Application), applets, etc. installed in the terminal device 100, and may also be in the form of a web page.

[0046] The server 200 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The server 200 may be a background server of the first application program, and is used to provide background services for the client of the first application program.

[0047] The terminal device 100 and the server 200 may communicate via a network, such as a wired or wireless network.

[0048] Please refer to Figure 2 , which shows a schematic diagram of a studio environment provided by an embodiment of the present application. In the embodiment of the present application, the studio environment will be taken as an example to exemplify the studio configuration method in virtual production. The studio environment may include: a motion capture device 310, a camera 320, a lighting device 330, a rendering machine 340, a screen controller 350, a console device 360, a switch 370 and a local machine room 380. The camera is uniformly controlled by a UMC (Universal Motor Controller).

[0049] In some embodiments, the motion capture device 310 is used to collect the position and lens data of the camera. In the embodiment of the present application, the motion capture device is also called a camera auxiliary device.

[0050] In some embodiments, the camera 320 is used to perform a shooting task. Figure 3As shown, the screen 390 displays the image rendered by the rendering machine 340, the actor 400 performs in front of the screen 390, and the camera 320 shoots the actor 400 and the screen 390 to obtain a shot video. The content of the shot video is composed of the image displayed on the screen 390 and the performance of the actor 400. Of course, corresponding props can also be placed in the studio environment according to the actual needs of video shooting, and this application does not limit this.

[0051] In some embodiments, the lighting device 330 is used to provide lighting for a studio environment.

[0052] In some embodiments, the rendering engine 340 is used to render and generate the picture to be displayed on the display screen based on the picture data. In some embodiments, the picture data is produced by an Unreal Engine.

[0053] In some embodiments, the screen controller 350 processes the image rendered by the rendering engine and controls the display to display the image. In the embodiment of the present application, the screen controller can also be called a display screen processor.

[0054] In some embodiments, the console device 360 ​​is used to control various lighting devices included in the studio environment. In some embodiments, the console device 360 ​​can also be used to control other devices included in the studio environment, such as audio equipment, etc., which is not limited in this application.

[0055] In some embodiments, the switch 370 is used to establish a data channel between the local computer room 380 and other devices in the studio environment. In other words, data exchange is implemented between the local computer room 380 and other devices in the studio environment based on the switch.

[0056] In some embodiments, the local computer room 380 may be any computer device with data processing capability included in a studio environment.

[0057] In some embodiments, the motion capture device 310, the camera 320, the lighting device 330, the rendering machine 340, the screen controller 350, the console device 360, the switch 370 and the local computer room 380 constitute a local area network, which only includes the devices included in the studio environment.

[0058] In some embodiments, there is a communication connection between the local computer room 380 and the server 200.

[0059] In some embodiments, the user completes the configuration of the studio project on the terminal device 100, obtains the first configuration data, and operates each device in the studio environment based on the first configuration data. The terminal device 100 sends a control instruction to the server 200 based on the user's operation, and the server 200 forwards the above control instruction to the local computer room 380 to achieve control of each device in the studio environment, thereby executing the above studio project.

[0060] In some embodiments, relative to various devices included in the studio environment, the server 200 is located outside the local area network, and therefore may also be referred to as an external server.

[0061] In the related art, to complete the configuration of a studio project based on the Unreal Engine, the user needs to configure each device included in the studio environment separately to complete the configuration of the studio project, and then present the pictures produced based on the Unreal Engine on the display screen to advance the progress of the studio project. The user may not be required to operate on the corresponding device, but the user may also need to remotely control the corresponding device through other devices to achieve control of the device. This process is not only cumbersome, but also requires the user to manually fill in the configuration information of each device.

[0062] However, the above method is cumbersome to operate. For users who are new to Unreal Engine, it takes a long time to learn the above process, which has a high learning cost. In addition, in actual work, due to the cumbersome operation process, some human errors may occur, which are usually difficult to detect and will seriously delay the progress of work.

[0063] The embodiment of the present application provides a studio configuration method in virtual production. The user can complete the configuration of the studio project based on the configuration guidance interface provided by the first application, generate the first configuration data, and execute the studio project based on the first configuration data. In the configuration guidance interface of the first application, the user does not need to manually fill in the configuration information of each device, which can effectively avoid the occurrence of human error operations. Moreover, the configuration guidance interface displays multiple configuration steps arranged in order, and the configuration guidance information corresponding to each configuration step, which can effectively guide the user to complete the input operation of the configuration information, and the learning cost is low.

[0064] Please refer to Figure 4 , which shows a flow chart of a studio configuration method in virtual production provided by an embodiment of the present application. The method is executed by a terminal device. The method may include at least one of the following steps 410 to 430.

[0065] Step 410, displaying a configuration guide interface provided by a first application, where the first application is an application for configuring and managing a virtual production studio project, and the configuration guide interface displays a plurality of configuration steps arranged in sequence.

[0066] In some embodiments, the configuration guide interface is used to guide the user to configure the studio project.

[0067] In some embodiments, multiple sequentially arranged configuration steps are displayed in the form of sub-interfaces. For example, the sub-interface of the first configuration step is displayed first, and after the user completes the first configuration step, the sub-interface of the second configuration step is displayed, and so on, until multiple configuration steps are completed.

[0068] In some embodiments, the sub-interface of the configuration step can be a partial interface of the configuration guide interface, or the entire interface of the configuration guide interface, or a floating window displayed on the configuration guide interface. This application does not limit this.

[0069] In some embodiments, multiple sequentially arranged configuration steps are displayed on the configuration guide interface. Exemplarily, multiple configuration steps are displayed on the configuration guide interface in order from top to bottom, and the user can change the content displayed on the configuration guide interface by sliding the interface.

[0070] In some embodiments, a plurality of sequentially arranged configuration steps can be displayed or hidden based on a control on the configuration guide interface.

[0071] Take the configuration steps 1 to 4 displayed in sequence on the configuration guide interface as an example:

[0072] In one example, if the control corresponding to configuration step 1 is in the first state, the specific content of configuration step 1 is displayed; if the control corresponding to configuration step 1 is in the second state, the content of configuration step 1 is hidden. The first state is different from the second state. This application does not limit the specific first state and second state, and can be set based on the actual form of the control. For example, if the control corresponding to configuration step 1 is a right triangle-shaped control, the first state is that the right angle of the triangle points downward, and the second state is that the right angle of the triangle points to the right.

[0073] In another example, in response to a first operation on a control corresponding to configuration step 2, the specific content of displaying configuration step 2 is changed to hiding the specific content of displaying configuration step 2; in response to a second operation on a control corresponding to configuration step 2, the specific content of hiding displaying configuration step 2 is changed to displaying the specific content of configuration step 2. The first operation and the second operation may be the same or different, and this application does not limit this.

[0074] It should be noted that the operation mentioned in the embodiments of the present application may be any one of click, double-click, slide, drag, long press, etc., or other operations, or a combination of any two or more operations, and the present application does not limit this.

[0075] In some embodiments, the order between the multiple configuration steps may be fixed, or may be set based on actual needs of the studio project.

[0076] Exemplarily, the order between the multiple configuration steps is fixed, and the order may be set by the developer of the first application, for example, based on the common features of various studio projects.

[0077] Exemplarily, the order of the multiple configuration steps is set based on the actual needs of the studio project, so before performing studio configuration, the user can customize the order of the multiple configuration steps. For example, the first application can provide N configuration steps, where N is a positive integer, and the user can select the required multiple configuration steps in order from the N configuration steps.

[0078] Step 420, in the configuration guidance interface, display the configuration guidance information corresponding to the current configuration step and the configuration information input by the user based on the configuration guidance information; wherein the configuration guidance information is used to guide the user to input the configuration information related to the current configuration step.

[0079] In some embodiments, the configuration guidance information may include the name of the configuration information that the user needs to input, the acquisition path of the configuration information that the user needs to input, the format requirements of the configuration information that the user needs to input, examples of the configuration information that the user needs to input, etc., which is not limited in this application.

[0080] In some embodiments, the configuration guidance information may also include a functional description of each control displayed in the configuration guidance interface.

[0081] In some embodiments, the configuration guidance information may include basic guidance information displayed in the configuration guidance interface, and detailed guidance information that is hidden from display.

[0082] In some embodiments, the basic guidance information can help the user roughly understand the functions of each control in the configuration guidance interface; the detailed guidance information includes the detailed functions of each control in the configuration guidance interface, configuration information input requirements, etc. If the user cannot understand the operations to be completed in the current configuration guidance interface based on the basic guidance information, the user can choose to read the detailed guidance information.

[0083] In some embodiments, in response to a third operation on the configuration guide interface, detailed guide information is displayed. For example, in response to a long press operation on the configuration guide interface, detailed guide information is displayed.

[0084] In some embodiments, in response to a fourth operation on any control in the configuration guidance interface, detailed guidance information corresponding to the control is displayed.

[0085] Displaying configuration guidance information in the configuration guidance interface can effectively help users understand the configuration information that needs to be input in the configuration guidance interface, assist users in completing the configuration of the studio project, and reduce the learning cost required to use the first application. Users do not need to be trained in advance on the use of the first application, saving time for personnel training.

[0086] Step 430: After the multiple configuration steps are completed, in response to the operation on the configuration completion control, generate first configuration data, the first configuration data including configuration information related to each of the multiple configuration steps.

[0087] In some embodiments, in response to an operation on a configuration completion control, first configuration data is generated and stored.

[0088] In some embodiments, the first configuration data may be stored in a terminal device or in a server, which is not limited in this application.

[0089] In some embodiments, the first configuration data may be stored in the form of a configuration file.

[0090] In some embodiments, the first application may record changes to the first configuration data and store the corresponding changes. For example, the first application stores the first configuration data in Studio Project 1-Configuration File 1, and if the first configuration data is modified, the modified first configuration data is stored in Studio Project 1-Configuration File 2.

[0091] In some embodiments, the first application may manage various versions of configuration data generated in a studio project, and may also manage configuration data included in multiple studio projects. Exemplarily, if the configuration data is stored in the form of a configuration file, the first application may manage the configuration data based on the naming method of the configuration file. For example, different studio projects have different names, and configuration files corresponding to different versions of configuration data of the same studio project have different names. Exemplarily, the first application may manage the configuration data based on the storage path of the configuration data. For example, different studio projects have different storage paths. Exemplarily, the first application may manage the configuration data based on the storage path and naming method of the configuration file. For example, different studio projects have different storage paths, and configuration files corresponding to different versions of configuration data of the same studio project have different names.

[0092] The technical solution provided by the embodiment of the present application provides a configuration guidance interface for the user through the first application, guiding the user to complete multiple configuration steps in order to complete the studio configuration. The configuration guidance interface displays multiple configuration steps arranged in order, and the configuration guidance information corresponding to each configuration step, which can effectively guide the user to complete the input operation of the configuration information, and the learning cost is low. There is no need for the user to be trained on the use of the first application, saving the user time.

[0093] This application provides exemplary descriptions of the multiple configuration steps arranged in sequence mentioned in the above embodiments.

[0094] In some embodiments, the plurality of configuration steps include:

[0095] Configuration name, used to configure the name of the studio project and the source of the configuration information;

[0096] Add a display screen model, which is used to describe the characteristics of the display screen;

[0097] Added an operating machine, which is used to execute studio projects;

[0098] Add a rendering machine, which is used to render and generate the images that need to be displayed on the display screen based on the image data;

[0099] Add a display screen processor, which is used to process the images rendered by the rendering machine;

[0100] Data association, used to associate the various devices included in the studio project;

[0101] Add camera auxiliary equipment, which is used to collect camera position and lens data;

[0102] Add a camera, which is used to shoot the images displayed on the display.

[0103] Next, we will Figures 5 to 15 Take the example to illustrate the above configuration steps.

[0104] Step 1: Configure the name. Figure 5 As shown, the configuration name is used to configure the name of the studio project and the source of the configuration information. For example, control 510 is used to configure the name of the studio project, and control 520 is used to select the source of the configuration information.

[0105] In some embodiments, the configuration information can be obtained based on the configuration file that has been configured, such as the configuration information included in the reused historical configuration file. For example, if the user selects the data source as the historical project 521 in the control 520, then the storage path of the historical configuration file included in the historical project to be reused is selected in the control 530, and the configuration data included in the historical configuration file can be reused in the current studio project, that is, the configuration information in the selected historical configuration file will be displayed in the subsequent configuration steps.

[0106] In some embodiments, the user can modify the configuration information stored in the historical configuration file to generate the first configuration data, which can effectively shorten the time required for the user to configure the studio.

[0107] In some embodiments, the configuration information may be added by the user. For example, if the user selects the data source as manual addition 522 in the control 520, then in the subsequent configuration steps, each configuration information needs to be manually added by the user. This ensures that the first configuration data obtained is more in line with the needs of the user.

[0108] Step 2, add a display screen model. In some embodiments, the display screen model is used to describe the characteristics of the display screen. In some embodiments, the display screen refers to a real device in a studio environment, and the device is called a display screen. The display screen model uses the same characteristics as the display screen to standardize the size, resolution and other information of the image rendered by the rendering machine, so that the image rendered by the rendering machine can achieve better results when displayed on the display screen.

[0109] For example, Figure 6As shown, the configuration information that needs to be input in this step may include at least one of the following: control 610 is used to configure the name of the LED model, control 620 is used to configure the storage path of the configuration file corresponding to the LED model, and control 630 is used to input the relevant configuration of the LED model, such as the aspect ratio of the LED model. In addition, the configuration guide interface can also display the configuration specifications of the LED model, as shown in the LED model specification instructions 640: each LED module has a four-sided surface, each fbx represents a part processed by an LED processor, the LED model scale size is consistent with the actual display screen, and the LED model coordinate origin and the ground plane height are unified at one point.

[0110] Step 3, add an operating machine. For example, Figure 7 As shown, the operating machine is used to execute studio projects.

[0111] In some embodiments, the first application can automatically identify the studio environment and obtain device information in the studio environment. The user can then select from the device information obtained by the first application to determine the equipment required for the current studio project. The user does not need to manually add the device information corresponding to each device to avoid misoperation.

[0112] In some embodiments, the studio environment is automatically identified to obtain device information in the studio environment; based on the device information in the studio environment, corresponding device information is displayed in multiple configuration steps respectively; for any one of the multiple configuration steps, in response to an operation on the device information corresponding to the configuration step, the device information corresponding to the configuration step is added to the studio project.

[0113] For example, Figure 7 As shown, the first application displays the device information of the operator automatically identified in the configuration guide interface corresponding to step 3, and the control 710 can display the device information of one or more operators automatically identified by the first application. If the automatic identification fails to identify the operator, it may not be displayed in the control 710. The user can select an operator to be set as the current studio project from the operators displayed in the control 710, or manually add an operator. Exemplarily, the operator of the current studio project can be displayed in the control 720, and the user can set the operator in the control 710 as the operator of the current studio project according to the control 730, and can remove the operator of the current studio project according to the control 740.

[0114] Step 4: Add a rendering machine. The rendering machine is used to render and generate the screen to be displayed based on the screen data.

[0115] In some embodiments, the rendering machine obtains the picture data information required for rendering from the Unreal Engine, and obtains the picture data from the server storing the picture data according to the picture data information, and then renders the picture data to obtain the corresponding picture. In some embodiments, the server storing the picture data and the external server in the above embodiment can be the same server or a different server, and this application does not limit this. For example, the server storing the picture data can be the background server of the Unreal Engine.

[0116] In some embodiments, the device information of the rendering machine in the studio environment can also be automatically identified by the first application. Figure 8 As shown, the first application displays the device information of the automatically identified rendering machine in the configuration guide interface corresponding to step 4, and the device information of one or more rendering machines automatically identified by the first application can be displayed in control 810. If the automatic identification fails to identify the rendering machine, it may not be displayed in control 810. The user can select a rendering machine to be set as the current studio project from the rendering machines displayed in control 810, or manually add a rendering machine. Exemplarily, the rendering machine of the current studio project can be displayed in control 820, and the user can use control 830 to set the rendering machine in control 810 as the rendering machine of the current studio project, and can use control 840 to remove the rendering machine of the current studio project.

[0117] Step 5, add a display screen processor. The display screen processor is used to process the image rendered by the rendering machine. In some embodiments, the main function of the display screen processor is to divide a complete image signal into N blocks and distribute them to N video display units (such as rear projection units), so as to form an ultra-large screen dynamic image display screen with multiple ordinary video units.

[0118] In some embodiments, the rendering machine renders the picture data, and after obtaining the corresponding picture, the display screen processor processes it to obtain the processed picture, and then the display screen processor sends the processed picture to the display screen, and the display screen displays the processed picture.

[0119] In some embodiments, the device information of the display screen processor in the studio environment can also be automatically identified by the first application. Fig. 9As shown, the first application displays the device information of the display screen processor automatically identified in the configuration guide interface corresponding to step 4, and the device information of one or more display screen processors automatically identified by the first application can be displayed in control 910. If the automatic identification fails to identify the display screen processor, it may not be displayed in control 910. The user can select a display screen processor set as the current studio project from the display screen processors displayed in control 910, or manually add a display screen processor. For example, the display screen processor of the current studio project can be displayed in control 920, and the user can use control 930 to implement the operation of setting the display screen processor in control 910 as the display screen processor of the current studio project, and can use control 940 to implement the operation of removing the display screen processor of the current studio project.

[0120] Step 6, data association, is used to associate various devices included in the studio project.

[0121] For example, Figures 10 to 13 As shown, the association between the display screen processor and the display screen, and the association between the rendering machine and the display screen processor are taken as examples to illustrate the data association.

[0122] For example, Fig.11 As shown, in response to the operation of associating the display screen processor with the display screen 1110, the display screen processor 1111 that can be associated and the display screen 1112 that can be associated are displayed, as shown in FIG. Fig.12 As shown, in response to the association operation for displaying the associable display screen processor 1111 and the associable display screen 1112, the association group 1 is displayed, and the association group 1 includes the associable display screen processor 1111 and the associable display screen 1112. Fig.13 As shown, in the association between the rendering machine and the display screen processor, an association group 2 can be displayed, and the association group 2 includes an associable display screen processor and an associable rendering machine.

[0123] Step 7, add the camera auxiliary device. The camera auxiliary device is used to collect the position and lens data of the camera.

[0124] The present application does not limit the type of camera auxiliary equipment. For example, RedSpy can be used. By installing a RedSpy camera to a recording camera and photographing reflective marking stickers attached to an area, the camera position information and lens data can be collected in real time with high precision, and the collected data can be output to a rendering machine in real time.

[0125] For example, Fig.14 As shown, the configuration information that needs to be input in step 7 may include a configuration name 1410 and device information 1420 of the camera auxiliary device.

[0126] Step 8: Add a camera. The camera is used to shoot the images displayed on the display.

[0127] For example, Fig.15 As shown, the configuration information that needs to be input in step 8 may include a configuration name 1510 and camera device information 1520 .

[0128] In some embodiments, the camera is used to Figure 3 In the environment shown, the images displayed on the display screen and the actors performing are filmed to obtain a filmed video.

[0129] The above embodiment provides multiple configuration steps and schematic diagrams of the configuration guide interface corresponding to each configuration step. It should be noted that the above content is only an exemplary description of multiple configuration steps. The order of each configuration step, the type of configuration information required to be input for each configuration step, and the multiple configuration steps required to be executed can all be set according to the actual needs of the studio configuration, and this application does not limit this. For example, if camera auxiliary equipment is not required in the current studio environment, step 7 does not need to be executed. For another example, if a switch needs to be added in the current studio environment, the step of "adding a switch" needs to be added in the steps.

[0130] In the above embodiment, it is mentioned that the first application can automatically identify each device in the studio environment and obtain the device information of each device. In this regard, the present application also provides an exemplary embodiment.

[0131] In some embodiments, the method may include at least one of the following steps 1 to 3.

[0132] Step 1: automatically identify the studio environment and obtain device information in the studio environment.

[0133] In some embodiments, Figure 2 As shown, since each device in the studio environment is in the same local area network, each device in the local area network can communicate with the local computer room through a switch, so the local computer room can obtain device information of each device.

[0134] In some embodiments, some devices support API (Application Programming Interface) ports, and the local computer room can communicate with the device based on the API port. For example, the local computer room sends a request message to the device, and the request message is used to request the device to provide the device information of the device. After receiving the request message, the device sends the device information of the device to the local computer room.

[0135] In some embodiments, some devices do not support API ports. In this regard, an embodiment of the present application provides a monitoring program, a client of the monitoring program is installed in the device, the monitoring program can provide a monitoring port, and communicate with the local computer room through the monitoring port. For example, the device sends a first message to the local computer room through the monitoring port, the first message is used to establish a communication connection with the local computer room, and after receiving the first message, the local computer room sends an instruction message to the device, instructing the device to send the device information of the device to the local computer room, and after receiving the instruction message, the device sends the device information of the device to the local computer room.

[0136] In some embodiments, the local computer room can also communicate with various devices in the studio environment based on other ports to obtain device information of each device, which is not limited in this application. For example, the local computer room can obtain device information of the device through a broadcast port.

[0137] In some embodiments, after obtaining the device information of each device in the studio environment, the local computer room sends the device information of each device to the server, and the server provides it to the terminal device of the client installed with the first application.

[0138] Step 2: Based on the device information in the studio environment, corresponding device information is displayed in multiple configuration steps respectively.

[0139] For example, Figure 7 As shown, the control 710 only displays the device information of the operating machine, but does not display the device information of the rendering machine.

[0140] Step 3: For any one of the multiple configuration steps, in response to an operation on the device information corresponding to the configuration step, add the device information corresponding to the configuration step to the studio project.

[0141] by Figure 7 Taking the steps of adding an operating machine as an example, if the first operating machine displayed in the control 710 is in a selected state, in response to the operation on the control 730, the first operating machine is determined as the operating machine of the current studio project and the operating machine is displayed in the control 720.

[0142] Due to the complex and changeable live shooting environment, some equipment in the studio environment may have errors after a period of time, such as running stuck, disk full load, etc. These errors are usually difficult to find, so they will affect the pursuit of stable shooting process. In this regard, a method is provided in the embodiment of the present application.

[0143] In some embodiments, based on a similar method of automatic identification of each device in a studio environment, the status of each device can be monitored, and autonomous monitoring of each device can be achieved, making it easier to discover errors that occur in each device.

[0144] Exemplarily, for a device that supports an API port, the state of the device can be obtained through the API port. For a device that does not support an API port, the state of the device can be obtained through a monitoring port provided by a monitoring program installed in the device.

[0145] In some embodiments, the status of the device may include at least one of the following: device operating status, such as whether the device is stuck; device disk status, such as the proportion of data stored in the device disk; device operating pressure, such as the amount of data that the device needs to process, and the number of processes that the device needs to process simultaneously.

[0146] In some embodiments, the monitoring program may automatically modify the status configurations that can be modified in the device, and may also send a prompt message to the user for the status configurations that cannot be modified.

[0147] In some embodiments, for any device included in the studio environment, the status of the device is monitored; if the device is in an abnormal state, the status configuration of the device is automatically modified, and the device running based on the modified status configuration is in a normal state.

[0148] In some embodiments, if the device is in an abnormal state, the state configuration of the device is automatically modified and a first prompt message is displayed, the first prompt message is used to indicate that the device is abnormal and has been automatically repaired. In some embodiments, the first prompt message can be used to indicate at least one of the following: the reason why the device is abnormal, the modification method used, the state configuration before the modification, and the state configuration after the modification.

[0149] In some embodiments, if the device is in an abnormal state, a prompt message is displayed, and the prompt message is used to indicate that the device is abnormal. In some embodiments, the prompt message is used to indicate that the device is abnormal and cannot be automatically repaired. In some embodiments, the prompt message can be used to indicate at least one of the following: the reason why the device is abnormal, the current state configuration, the recommended modification method, and the reason why it cannot be automatically repaired.

[0150] In some embodiments, the monitoring program may pre-set the state to be monitored, the threshold for abnormality of the state, and the processing method after the abnormality occurs, and monitor the device according to the above thresholds, and perform corresponding processing after the abnormality occurs.

[0151] Exemplarily, the monitoring program pre-sets the amount of data stored on the disk of the monitored device, and when the amount of data stored on the disk is greater than 75%, the device is determined to be in an abnormal state, and is set to send a prompt message to the user when an abnormal state occurs, prompting the user that the amount of data stored on the disk of the device is too high.

[0152] Exemplarily, the monitoring program pre-device needs to monitor whether the device is stuck, if stuck, it is considered to be in an abnormal state, and the device can be automatically restarted. Then after the monitoring program determines that the device is stuck, the device can be automatically restarted.

[0153] In some embodiments, since the studio configuration may be modified multiple times in a studio project, multiple versions of configuration data will be generated. Therefore, an embodiment of the present application provides a project management method that can manage the multiple versions of configuration data generated in the studio project and the status configurations corresponding to each device, so as to facilitate subsequent reuse of the configuration data.

[0154] In some embodiments, for any device included in the studio environment, the state configuration of the device is recorded in a historical state configuration set. If the state configuration is changed, the changed state configuration is also recorded in the historical state configuration set. The historical state configuration set includes the state configurations of various versions generated in the studio project. Different studio projects have different historical state configuration sets.

[0155] In some embodiments, for any device included in the studio environment, the state configuration of the device is recorded in a historical state configuration set, which is used to record the state configurations applied by the device; if the state configuration of the device is modified, the modified state configuration is recorded in the historical state configuration set; in response to an operation on a first state configuration in the historical state configuration set, the first state configuration is determined as the state configuration of the device.

[0156] In some embodiments, the above method for managing state configuration and configuration data can be implemented based on version management tools, which can automate project management and make it simpler. By storing the configuration data and configuration status of historical configurations, historical configurations can be reused in new studio projects without the need for users to reconfigure, and studio configuration can be completed quickly.

[0157] In some embodiments, the first application program may also automatically detect the first configuration data before being displayed on the screen. For example, the first application program may detect whether the first configuration data contains an erroneous configuration based on a preset question.

[0158] In some embodiments, in addition to automatically detecting the first configuration data, the first application may also automatically adjust the configuration of the assets used in the studio project.

[0159] In some embodiments, in response to an application operation on the first configuration data, the asset configuration is automatically adjusted, and the adjusted asset configuration is suitable for a studio environment, and the assets include picture data required to be rendered by a rendering machine.

[0160] In some embodiments, the asset configuration may not be suitable for the current studio environment and needs to be adjusted to achieve better results in the current studio environment. For example, if the monitor size that the asset is adapted to is different from the monitor size in the current studio environment, the image displayed on the monitor after being displayed may be incorrect. In this case, the first application can automatically adjust it.

[0161] In some embodiments, the operation of automatically adjusting the asset configuration is completed by a plug-in installed in the first application, and the plug-in can be used to modify the asset configuration. For example, the asset is produced by a third application used to produce the asset. Relative to the third application, the asset belongs to the project created by the third application. If you want to modify the asset, you need to modify it in the third application, or modify the data of the project file of the third application. The above plug-in can complete the function of modifying the data of the project file of the third application, so the first application can use the above plug-in to complete the automatic adjustment of the asset configuration.

[0162] In some embodiments, the first application also provides a tool port for other tools, and the user can open the corresponding tool through the tool port to use the tool to assist in completing the configuration of the studio.

[0163] In some embodiments, at least one tool port provided by the first application is displayed, each tool port corresponds to a tool, and the tool is used to assist in completing the studio configuration; in response to an operation on any one of the at least one tool port, a user interface corresponding to the tool port is displayed.

[0164] The present application does not limit the specific tool port provided by the first application. For example, the tool port provided by the first application can be used to assist in completing the studio configuration for green screen shooting.

[0165] In some embodiments, the user can add a tool port of a commonly used tool in the first application based on his or her own habits to quickly start the commonly used tool.

[0166] In some embodiments, for a client that has not downloaded the first application, the first application may also store a configuration file in the first format, and the configuration file in the first format may be applicable to a second application, and the second application has the same function as the first application.

[0167] In some embodiments, in response to a storage operation for the first configuration data, the first configuration data is stored in a configuration file in a first format, the configuration file in the first format is applicable to a second application, and the second application has the same function as the first application.

[0168] In some embodiments, the second application may refer to an application used in related technologies, or may be other applications having the same functions as the first application.

[0169] In some embodiments, the studio project includes a screen loading process and a shooting process. During the shooting process, it may be necessary to modify the image displayed on the display screen or modify the studio environment. The embodiment of the present application also supports real-time modification of configuration data.

[0170] In some embodiments, in response to an application operation on the first configuration data, a screen-on-screen process is completed based on a device in a studio environment, and the screen-on-screen process refers to a process of displaying a picture on a display screen; in response to a modification operation on the first configuration data, the configuration information included in the first configuration data is modified.

[0171] In some embodiments, in response to a modification operation on the first configuration data, configuration information included in the first configuration data is modified; in response to an application operation on the modified first configuration data, the screen display process is re-performed based on the device in the studio environment.

[0172] In some embodiments, the modification operation on the first configuration data may include adding, deleting, replacing, etc., equipment in the studio environment.

[0173] In some embodiments, in response to a modification operation on the picture data, modified picture data is obtained; in response to an application operation on the modified picture data, a rendering machine is controlled to perform a rendering operation based on the modified picture data to obtain a modified picture; and a display screen is controlled to display the modified picture.

[0174] In some embodiments, the modification operation on the picture data may include modifying the brightness, resolution, position of objects in the picture, etc. in the picture data.

[0175] Since the studio environment includes multiple types of devices, each type of device may also include multiple devices, and the model of each device may be different. Different content or different formats of control information need to be sent to devices of different models so that each device can operate based on the control information to complete the screen display process.

[0176] In some embodiments, in response to an application operation on the first configuration data, control information is sent to devices in the studio environment, different devices correspond to different control information, and the devices in the studio environment are used to operate based on the control information corresponding to the devices to complete the screen display process.

[0177] In some embodiments, the terminal device determines the control information corresponding to each device in the studio environment based on the first configuration data, and sends the control information to the server, communicates with the server and the local computer room, and sends the control information corresponding to each device to the corresponding device.

[0178] For example, Fig.16 As shown, the data receiving layer of the terminal device receives the user's operation, and obtains the required data in the studio configuration and project configuration according to the instructions corresponding to the operation. The data analysis layer determines the control information corresponding to each device (control devices A~C and rendering devices 1~3) based on the required data and the device that needs to receive the control information; based on the required data and the data that needs to be operated, the data information corresponding to each device (control devices A~C and rendering devices 1~3) is determined. The control information corresponding to each device is used to control the operation of the device, and the data information corresponding to each device is used to provide data resources for the operation of the device. For example, the data information corresponding to the rendering machine is the picture data that needs to be rendered, and the control information corresponding to the rendering machine is the information that controls the rendering machine to start rendering.

[0179] In some embodiments, since a studio project may generate many assets, if you want to download these assets, you need to operate on each device in the studio environment separately to obtain the complete assets. Correspondingly, if you want to upload assets, you also need to upload the assets separately on each device, which is cumbersome. In this regard, an embodiment of the present application provides a solution. A batch processing control is provided in the first application, which can realize batch downloading or uploading of assets.

[0180] In some embodiments, a batch download control and a batch upload control are provided in the first application. Fig.17 As shown, the batch download control 1710 is used to batch download all assets of the studio project, and the batch upload control 1720 is used to batch upload assets.

[0181] In some embodiments, batch downloading refers to batch downloading assets in the studio project to the terminal device of the client with the first application installed, and batch uploading refers to batch uploading assets stored in the terminal device of the client with the first application installed to various devices in the studio environment.

[0182] In some embodiments, various configuration files and assets in the studio project are managed and stored by the version management device. Batch downloading refers to batch downloading of the assets of the studio project by the version management device, and batch uploading refers to batch uploading of assets stored in the terminal device of the client with the first application installed to the version management device, which are classified and stored by the version management device.

[0183] In summary, the embodiment of the present application provides a rapid engineering project configuration and management tool (first application) for the virtual production process of the Unreal Engine to improve the efficiency of the production process and facilitate asset management. It can provide an efficient, stable, easy-to-use tool that can run independently of the Unreal Engine, and guide on-site staff to quickly configure the studio configuration in virtual production, greatly improving work efficiency; at the same time, it has certain scalability and customization capabilities, and can use this tool as an entry to start other tools, and can generate configuration files customized according to the studio environment, which greatly facilitates on-site production; in addition, this tool supports the detection of environmental status, and in the face of problems in complex shooting environments, it can promptly warn operators and avoid unnecessary troubles on site. This tool also has certain project management capabilities, and can cooperate with version control tools to perform version management and facilitate the restoration of project status.

[0184] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0185] Please refer to Fig.18 , which shows a block diagram of a studio configuration device in virtual production provided by an embodiment of the present application. The device has the function of implementing the studio configuration method in virtual production, and the function can be implemented by hardware or by hardware executing corresponding software. The device can be the terminal device described above, or it can be set in the terminal device. Fig.18 As shown, the device 1800 may include: a first display module 1810 , a second display module 1820 and a generating module 1830 .

[0186] The first display module 1810 is used to display a configuration guide interface provided by a first application, where the first application is an application for configuring and managing a virtual production studio project, and the configuration guide interface displays a plurality of configuration steps arranged in sequence.

[0187] The second display module 1820 is used to display the configuration guidance information corresponding to the current configuration step and the configuration information input by the user based on the configuration guidance information in the configuration guidance interface; wherein the configuration guidance information is used to guide the user to input configuration information related to the current configuration step.

[0188] The generating module 1830 is used to generate first configuration data in response to an operation on a configuration completion control after the multiple configuration steps are completed, wherein the first configuration data includes configuration information related to each of the multiple configuration steps.

[0189] In some embodiments, the plurality of configuration steps include:

[0190] Configuration name, used to configure the name of the studio project and the source of the configuration information;

[0191] Add a display screen model, where the display screen model is used to describe the characteristics of the display screen;

[0192] Adding an operating machine, wherein the operating machine is used to execute the studio project;

[0193] Add a rendering machine, the rendering machine is used to render and generate the picture to be displayed on the display screen based on the picture data;

[0194] Add a display screen processor, the display screen processor is used to process the picture rendered by the rendering machine;

[0195] Data association, used to associate various devices included in the studio project;

[0196] Adding a camera auxiliary device, the camera auxiliary device is used to collect the position and lens data of the camera;

[0197] A camera is added, and the camera is used to shoot the images displayed on the display screen.

[0198] In some embodiments, the device 1800 further includes an automatic identification module (not shown).

[0199] The automatic identification module is used to automatically identify the studio environment and obtain the device information in the studio environment; based on the device information in the studio environment, display the corresponding device information in the multiple configuration steps respectively; for any one of the multiple configuration steps, in response to the operation on the device information corresponding to the configuration step, add the device information corresponding to the configuration step to the studio project.

[0200] In some embodiments, the automatic identification module is also used to monitor the status of any device included in the studio environment; if the device is in an abnormal state, automatically modify the status configuration of the device, and the device running based on the modified status configuration is in a normal state; or, if the device is in an abnormal state, display a prompt message, and the prompt message is used to indicate that the device is abnormal.

[0201] In some embodiments, the device 1800 further includes a state configuration module (not shown).

[0202] The state configuration module is used to record the state configuration of any device included in the studio environment in a historical state configuration set, where the historical state configuration set is used to record the state configurations applied to the device; if the state configuration of the device is modified, the modified state configuration is recorded in the historical state configuration set; and in response to an operation on a first state configuration in the historical state configuration set, the first state configuration is determined as the state configuration of the device.

[0203] In some embodiments, the device 1800 further includes a third display module (not shown).

[0204] The third display module is used to display at least one tool port provided by the first application, each tool port corresponds to a tool, and the tool is used to assist in completing the studio configuration; in response to an operation on any one of the at least one tool port, a user interface corresponding to the tool port is displayed.

[0205] In some embodiments, the device 1800 further includes a storage module (not shown).

[0206] The storage module is used to store the first configuration data in a configuration file in a first format in response to a storage operation on the first configuration data, where the configuration file in the first format is applicable to a second application, and the second application has the same function as the first application.

[0207] In some embodiments, the device 1800 further includes an upper screen module (not shown).

[0208] The on-screen module is used to respond to an application operation on the first configuration data, complete a on-screen process based on the equipment in the studio environment, and the on-screen process refers to the process of displaying a picture on a display screen; respond to a modification operation on the first configuration data, and modify the configuration information included in the first configuration data.

[0209] In some embodiments, the screen-on-screen module is used to send control information to the devices in the studio environment in response to an application operation on the first configuration data, and different devices correspond to different control information. The devices in the studio environment are used to operate based on the control information corresponding to the devices to complete the screen-on-screen process.

[0210] In some embodiments, the device 1800 further includes an automatic adjustment module (not shown).

[0211] The automatic adjustment module is used to automatically adjust the asset configuration in response to the application operation on the first configuration data, and the adjusted asset configuration is suitable for the studio environment. The assets include the picture data required to be rendered by the rendering machine.

[0212] The technical solution provided by the embodiment of the present application provides a configuration guidance interface for the user through the first application, guiding the user to complete multiple configuration steps in order to complete the studio configuration. The configuration guidance interface displays multiple configuration steps arranged in order, and the configuration guidance information corresponding to each configuration step, which can effectively guide the user to complete the input operation of the configuration information, and the learning cost is low. There is no need for the user to be trained on the use of the first application, saving the user time.

[0213] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0214] Please refer to Fig.19 , which shows a block diagram of a terminal device 1900 provided in one embodiment of the present application. The terminal device 1900 may be any electronic device with data calculation, processing and storage functions. The terminal device 1900 may be used to implement the studio configuration method in the virtual production provided in the above embodiment.

[0215] Typically, the terminal device 1900 includes: a processor 1901 and a memory 1902 .

[0216] Processor 1901 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. Processor 1901 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1901 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, processor 1901 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, processor 1901 may also include an AI processor for processing computing operations related to machine learning.

[0217] The memory 1902 may include one or more computer-readable storage media, which may be non-transitory. The memory 1902 may also include a high-speed random access memory and a non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1902 is used to store a computer program, which is configured to be executed by one or more processors to implement the studio configuration method in the virtual production described above.

[0218] Those skilled in the art will understand that Fig.19 The structure shown in the figure does not constitute a limitation on the terminal device 1900, and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0219] In an exemplary embodiment, a computer-readable storage medium is also provided, in which a computer program is stored, and when the computer program is executed by a processor of a terminal device, the studio configuration method in the virtual production is implemented. Optionally, the computer-readable storage medium may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0220] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a terminal device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the terminal device executes the studio configuration method in the virtual production.

[0221] It should be noted that before collecting the user's relevant data and during the process of collecting the user's relevant data, this application can display a prompt interface, pop-up window or output voice prompt information. The prompt interface, pop-up window or voice prompt information is used to prompt the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining the user's relevant data after obtaining the user's confirmation operation on the prompt interface or pop-up window. Otherwise (that is, when the user's confirmation operation on the prompt interface or pop-up window is not obtained), the relevant steps of obtaining the user's relevant data are terminated, that is, the user's relevant data is not obtained. In other words, all user data collected by this application (including the device information of each device in the studio environment) are processed strictly in accordance with the requirements of relevant national laws and regulations. The informed consent or separate consent of the subject of personal information is obtained only with the user's consent and authorization. The subsequent data use and processing behavior is carried out within the scope of authorization of laws and regulations and the subject of personal information, and the collection, use and processing of relevant user data must comply with the relevant laws, regulations and standards of relevant countries and regions.

[0222] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0223] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A studio configuration method in virtual production, characterized in that: The method comprises: Displaying a configuration guide interface provided by a first application, wherein the first application is an application for configuring and managing a virtual production studio project, and the configuration guide interface displays a plurality of configuration steps arranged in sequence; In the configuration guidance interface, the configuration guidance information corresponding to the current configuration step and the configuration information input by the user based on the configuration guidance information are displayed; wherein the configuration guidance information is used to guide the user to input the configuration information related to the current configuration step; After the plurality of configuration steps are completed, in response to an operation on a configuration completion control, first configuration data is generated, the first configuration data including configuration information related to each of the plurality of configuration steps.

2. The method according to claim 1, characterized in that The multiple configuration steps include: Configuration name, used to configure the name of the studio project and the source of the configuration information; Add a display screen model, where the display screen model is used to describe the characteristics of the display screen; Adding an operating machine, wherein the operating machine is used to execute the studio project; Add a rendering machine, the rendering machine is used to render and generate the picture to be displayed on the display screen based on the picture data; Add a display screen processor, the display screen processor is used to process the picture rendered by the rendering machine; Data association, used to associate various devices included in the studio project; Adding a camera auxiliary device, the camera auxiliary device is used to collect the position and lens data of the camera; A camera is added, and the camera is used to shoot the images displayed on the display screen.

3. The method according to claim 1, characterized in that The method further comprises: Automatically identify the studio environment and obtain device information in the studio environment; Based on the device information in the studio environment, displaying corresponding device information in the multiple configuration steps respectively; For any one of the multiple configuration steps, in response to an operation on the device information corresponding to the configuration step, the device information corresponding to the configuration step is added to the studio project.

4. The method according to claim 3, characterized in that The method further comprises: For any device included in the studio environment, monitoring the status of the device; If the device is in an abnormal state, automatically modify the state configuration of the device, so that the device running based on the modified state configuration is in a normal state; or, If the device is in an abnormal state, a prompt message is displayed, and the prompt message is used to prompt that the device is abnormal.

5. The method according to claim 4, characterized in that The method further comprises: For any device included in the studio environment, recording the state configuration of the device in a historical state configuration set, where the historical state configuration set is used to record the state configuration applied by the device; If the state configuration of the device is modified, the modified state configuration is recorded in the historical state configuration set; In response to an operation on a first state configuration in the historical state configuration set, the first state configuration is determined as the state configuration of the device.

6. The method according to claim 1, characterized in that The method further comprises: Displaying at least one tool port provided by the first application, each tool port corresponding to a tool, the tool being used to assist in completing the studio configuration; In response to an operation on any one of the at least one tool port, a user interface corresponding to the tool port is displayed.

7. The method according to claim 1, characterized in that The method further comprises: In response to a storage operation for the first configuration data, the first configuration data is stored in a configuration file in a first format, the configuration file in the first format is applicable to a second application, and the second application has the same function as the first application.

8. The method according to claim 1, characterized in that The method further comprises: In response to the application operation for the first configuration data, completing a screen display process based on the device in the studio environment, wherein the screen display process refers to a process of displaying a picture on a display screen; In response to a modification operation on the first configuration data, configuration information included in the first configuration data is modified.

9. The method according to claim 8, characterized in that The step of completing the screen display process based on the device in the studio environment in response to the application operation for the first configuration data includes: In response to an application operation for the first configuration data, control information is sent to the devices in the studio environment, different devices correspond to different control information, and the devices in the studio environment are used to operate based on the control information corresponding to the devices to complete the screen display process.

10. A studio configuration device in virtual production, characterized in that: The device comprises: A first display module is used to display a configuration guide interface provided by a first application, wherein the first application is an application for configuring and managing a virtual production studio project, and the configuration guide interface displays a plurality of configuration steps arranged in sequence; A second display module is used to display, in the configuration guidance interface, configuration guidance information corresponding to the current configuration step and configuration information input by the user based on the configuration guidance information; wherein the configuration guidance information is used to guide the user to input configuration information related to the current configuration step; A generating module is used to generate first configuration data in response to an operation on a configuration completion control after the plurality of configuration steps are completed, wherein the first configuration data includes configuration information related to each of the plurality of configuration steps.

11. A terminal device, characterized in that: The terminal device comprises a processor and a memory, wherein a computer program is stored in the memory, and the processor is configured to execute the computer program to implement the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the method according to any one of claims 1 to 9.

13. A computer program product, characterized in that The computer program product comprises a computer program, which is loaded and executed by a processor to implement the method according to any one of claims 1 to 9.

Images