Interaction method and device in virtual scene, equipment and storage medium

Abstract

The embodiment of the invention provides an interaction method and device in a virtual scene, equipment and a computer readable storage medium. The method comprises the steps that the electronic equipment presents an interactive interface of a virtual scene; receiving a generation request via the interactive interface, the generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; and creating a first virtual object corresponding to the target virtual resource in the virtual scene in response to the fact that the target virtual resource is generated based on the generation request. In this way, a user can complete the creation of a complex virtual object through simple parameter setting by means of a machine learning model.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly to interactive methods, devices, apparatuses, and computer-readable storage media in a virtual scene. Background Art

[0002] With the rapid development of computer technology, more and more applications and platforms are currently designed to provide various services to users. In some applications, users can create various virtual objects in virtual space, including but not limited to houses, fountains, lighthouses, etc. However, in some traditional interactive solutions, users need to use the materials provided by the platform to complete the creation of virtual objects. The material-based creation process has certain requirements for operating skills, and the operation is relatively complicated, which makes most users unable to complete the creation of complex virtual objects. Even if some users can complete the creation of complex objects, it takes users a long time. In view of this, it is urgent to provide a quick and efficient virtual object creation method so that users can quickly complete the creation of virtual objects. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for interaction in a virtual scene is provided. The method comprises: presenting an interaction interface of the virtual scene; receiving a generation request via the interaction interface, the generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; and in response to a target virtual resource being generated based on the generation request, creating a first virtual object corresponding to the target virtual resource in the virtual scene.

[0004] In a second aspect of the present disclosure, an interactive device for a virtual scene is provided. The device includes: a virtual scene presentation module configured to present an interactive interface of the virtual scene; a generation request receiving module configured to receive a generation request via the interactive interface, the generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; and a virtual object generation module configured to create a first virtual object corresponding to the target virtual resource in the virtual scene in response to the target virtual resource being generated based on the generation request.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1A A schematic diagram showing an example environment in which embodiments according to the present disclosure may be implemented;

[0010] Figure 1B shows a spatial distribution / segmentation block diagram according to some embodiments of the present disclosure;

[0011] Figure 1C A three-dimensional anchor point system according to some embodiments of the present disclosure is shown;

[0012] Figures 2 to 10 shows an example interface according to some embodiments of the present disclosure;

[0013] Fig.11 A flowchart showing an example interaction process in a virtual scene according to some embodiments of the present disclosure;

[0014] Fig.12 A flowchart showing an example interaction process in a virtual scene according to some embodiments of the present disclosure;

[0015] Fig.13 A schematic structural block diagram showing an example interactive device used in a virtual scene according to some embodiments of the present disclosure; and

[0016] Fig.14 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0020] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0021] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects are subject to the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user knows and confirms. Accordingly, when implementing each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0022] The schemes in this specification and the embodiments, if involving the processing of personal information, will be processed on the premise of having a legal basis (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and will only be processed within the scope of regulations or agreements. The user's refusal to process personal information other than the necessary information required for basic functions will not affect the user's use of basic functions. As an optional but non-restrictive implementation method, in response to receiving the user's active request, a method of sending a prompt message to the user may be, for example, a pop-up window, in which the prompt message may be presented in text. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device. It is understandable that the above notification and the process of obtaining user authorization are only illustrative and do not constitute a limitation on the implementation method of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation method of the present disclosure.

[0023] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multi-layer processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0024] A "neural network" is a machine learning network based on deep learning. A neural network is capable of processing inputs and providing corresponding outputs, and typically includes an input layer and an output layer and one or more hidden layers between the input layer and the output layer. Neural networks used in deep learning applications typically include many hidden layers, thereby increasing the depth of the network. The layers of a neural network are connected in sequence so that the output of the previous layer is provided as input to the next layer, where the input layer receives the input of the neural network and the output of the output layer serves as the final output of the neural network. Each layer of a neural network includes one or more nodes (also called processing nodes or neurons), each of which processes input from the previous layer.

[0025] Generally, machine learning can be roughly divided into three stages, namely the training stage, the testing stage, and the application stage (also called the inference stage). In the training stage, a given model can be trained using a large amount of training data, and the parameter values ​​are continuously updated iteratively until the model can obtain consistent inferences that meet the expected goals from the training data. Through training, the model can be considered to be able to learn the association between input and output (also called input-to-output mapping) from the training data. The parameter values ​​of the trained model are determined. In the testing stage, the test input is applied to the trained model to test whether the model can provide the correct output, thereby determining the performance of the model. The testing stage can sometimes be integrated into the training stage. In the application or inference stage, the trained model can be used to process the actual model input based on the parameter values ​​obtained through training to determine the corresponding model output.

[0026] As mentioned above, with the rapid development of computer technology, more and more applications and platforms are currently designed to provide various services to users. In some applications, users can create various virtual objects in virtual space, including but not limited to houses, fountains, lighthouses, etc. However, in some traditional interactive solutions, users need to use the materials provided by the platform to complete the creation of virtual objects. The material-based creation process has certain requirements for operating skills, and the operation is relatively complicated, which makes most users unable to complete the creation of complex virtual objects. Even if some users can complete the creation of complex objects, it takes users a long time. In view of this, it is urgent to provide a quick and efficient virtual object creation method so that users can quickly complete the creation of virtual objects.

[0027] The embodiment of the present disclosure proposes an interactive scheme in a virtual scene. The scheme includes: an electronic device presenting an interactive interface of a virtual scene; receiving a generation request via the interactive interface, the generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; and in response to a target virtual resource being generated based on the generation request, creating a first virtual object corresponding to the target virtual resource in the virtual scene. In this way, users can use machine learning models to complete the creation of complex virtual objects through simple parameter settings.

[0028] In some embodiments of the present disclosure, for ease of understanding, some embodiments of the present disclosure are described using buildings as examples of virtual objects. However, it should be understood that the embodiments of the present disclosure are not limited to the creation of buildings. In fact, the embodiments of the present disclosure can be applied to scenes of any virtual objects. In other words, the embodiments of the present disclosure are not limited in terms of the specific types of virtual objects.

[0029] In the context of the present disclosure, virtual resources refer to operational resources that can be created, modified, saved and / or reused in a virtual space. Virtual objects are objects that are created in a virtual space. In some implementations, a user can create a virtual resource, for example, a user creates a building and saves it in a collection of virtual resources. In some implementations, a user can place the created virtual resources in a virtual space. In this case, the created virtual resources also constitute virtual objects in the virtual space. It can be seen that in the context of the present disclosure, the two can be converted into each other. In this case, unless explicitly indicated, the terms "virtual resources" and "virtual objects" can be used interchangeably.

[0030] Various example implementations of the solution are described in detail below in conjunction with the accompanying drawings. Example Environment

[0031] Figure 1A 1 shows a schematic diagram of an example environment 100A in which embodiments of the present disclosure can be implemented. Figure 1A As shown, the example environment 100A may include an electronic device 110. In the example environment 100A, an application 115 is installed in the electronic device 110. A user 140 may interact with the application 115 via the electronic device 110 and / or an attached device of the electronic device 110.

[0032] Application 115 can provide the user 140 with an integration of multiple applications or components. These applications can be used as application modules in application 115. In some embodiments, application 115 can be downloaded and installed as an application on electronic device 110. In some embodiments, application 115 can also be accessed in other ways, such as through a web page.

[0033] Application 115 may be any appropriate type of application capable of providing media content, examples of which may include but are not limited to: social applications, audio / video applications, media item playback applications, broadcast applications, etc. The embodiments of the present disclosure are not limited in this respect.

[0034] exist Figure 1A In the environment 100A, if the application 115 is active, the electronic device 110 can present an interactive page through the application 115. The interactive page can be any appropriate type of page, which can support the user 140 to input any appropriate type of data and present media items of any media item type to the user 140. The interactive interface can include various interfaces that the application 115 can provide, such as a parameter setting interface, a loading interface, a special effect display interface, and the like.

[0035] In some embodiments, the electronic device 110 can communicate with the server 130 to provide services for the application 115. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio receiver, an e-book device, a game device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0036] The server 130 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 115 that supports virtual scenes in the electronic device 110.

[0037] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired manner or a wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0038] A machine learning model 120 is deployed in the environment 100A. The machine learning model 120 can be deployed on an appropriate electronic device. As an example, the machine learning model 120 can also be deployed on other electronic devices different from the server 130. The server 130 can, for example, call the machine learning model 120 to perform the corresponding task by way of a service call. In another example, the machine learning model 120 can also be deployed locally on the server 130.

[0039] As will be described in detail below, the electronic device 110 can use the machine learning model 120 to complete the creation of the virtual object. As an example, the electronic device 110 can call the machine learning model 120 through the server 130. As another example, the electronic device 110 can also directly call the machine learning model 120. In short, the present disclosure is not limited in terms of the deployment location and calling method of the machine learning model 120.

[0040] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0041] In some embodiments, the application 115 may provide a virtual space to the user 140, and the virtual space may include various virtual objects. According to some embodiments of the present disclosure, the virtual objects in the virtual space may be composed of voxel data. It should be understood that in the traditional three-dimensional construction scheme, at least it is not possible to support partial updates and / or secondary editing of the created virtual objects, and operations of supplementing the created virtual objects. This is because, in the traditional three-dimensional construction scheme, each virtual object is an indivisible whole, resulting in that the components of the virtual object cannot be processed separately. The application scenario of the present disclosure is a voxel-based scenario. In this particular scenario, each virtual object and each part of the virtual object can be expressed and operated by voxel data. In this case, each virtual object and each part of the virtual object can be operated independently. In this case, compared with the traditional scheme, the various embodiments of the present disclosure can achieve refined processing of virtual objects. More importantly, after the creation of the virtual object is completed, the virtual object can be secondary edited (changing the part of the virtual object and / or supplementing the virtual object).

[0042] In some embodiments, a virtual object creation process based on voxel operations can be supported. In operation, the electronic device 110 receives a request to create a virtual object in a virtual scene. In response to the request to create a virtual object, the electronic device 110 can divide the target space in the virtual scene into multiple subspaces based on the spatial distribution / segmentation information corresponding to the virtual object. Next, the electronic device 110 can fill a group of subspaces in the multiple subspaces with corresponding voxel data based on the voxel configuration information corresponding to the multiple subspaces to create a virtual object in the virtual scene. In this way, for a voxel-based virtual space scene, the virtual object creation process can be abstracted as a voxel data operation on the space. The space can thus be iteratively divided so that every detail of the virtual object can be well processed, thereby improving the creation refinement of the virtual object.

[0043] In some embodiments, the electronic device 110 obtains an asset file corresponding to the virtual object, also referred to as a brush file or simply a brush, and determines spatial segmentation information and voxel configuration information based on the asset file. Asset files are sometimes also referred to as brush files or brushes. In order to support the creation of asset files, according to some embodiments of the present disclosure, a data structure for voxels and / or multiple voxel operations for voxel scenes are introduced. Next, a brief description of the data structure and / or voxel operations of the present disclosure is first given.

[0044] In some embodiments, both basic data structures and voxel data structures are supported. Examples of basic data structures include: Boolean type (abbreviated as bo01) / integer type (abbreviated as int), floating point type (float), floating point vector type (abbreviated as vector3f), integer vector type (abbreviated as vector3i), string type (abbreviated as string) and array type (abbreviated as array). Through the above conventional data structures, basic data expression requirements can be achieved.

[0045] In some embodiments, the voxel data structure includes a first data structure (abbreviated as Volume) that describes whether there is a voxel block in each grid of an area or space. Additionally, in some embodiments, the first data structure can be composed of the following basic data structures: an integer vector type vector3i describing a starting point, an integer vector type vector3i describing an area size, and / or a Boolean type bool indicating whether there is a voxel block.

[0046] Alternatively or additionally, in some embodiments, the voxel data structure includes a second data structure (abbreviated as Voxel) that describes the type of voxels in each grid in an area or space. Additionally, in some embodiments, the second data structure may be composed of the following basic data structures: an integer vector type vector3i that describes the starting point, an integer vector type vector3i that describes the size of the area, and / or an enumeration type blockid that indicates the type of voxel. Alternatively or additionally, in some embodiments, the voxel data structure includes a third data structure (abbreviated as bounds) that describes the boundary of an area or space. Additionally, in some embodiments, the third data structure may be composed of a basic data structure of vector type. Alternatively or additionally, in some embodiments, the voxel data structure includes the type of voxel blocks of enumeration type (abbreviated as BlockType). By introducing the above-mentioned voxel data structure, the voxel data can be better expressed. In addition, since the above-mentioned voxel data is composed of a basic data structure, better system compatibility is achieved.

[0047] According to some example embodiments of the present disclosure, within a given input space, space segmentation may be recursively performed to divide the given space into a plurality of subspaces, and different voxel operations may be applied to the subspaces respectively.

[0048] See also Figure 1B , which shows a spatial distribution / segmentation block diagram 100B according to some embodiments of the present disclosure. In the embodiment, the spatial distribution / segmentation function can determine the size, quantity and position of the space. In some embodiments, the spatial distribution / segmentation function can use a third data structure (bounds) as an output, and its output can be one or more third data structures (bounds) corresponding to one or more subspaces. In some embodiments, the spatial distribution / segmentation function can determine the number and position of the segmented subspaces. In some embodiments, the segmented space can be: one-dimensional space, two-dimensional space or three-dimensional space. In some embodiments, voxel data can be distributed in the segmented space based on a variety of distribution types, including but not limited to random distribution, noise-based distribution, geometric shape distribution, wave function collapse distribution, Lindenmayer system distribution, Hit Surface Sampler and other distributions.

[0049] In some embodiments, by setting the anchor point and alignment properties, an adaptive segmentation function can be implemented. Figure 1C , which shows a three-dimensional anchor system 100C according to some embodiments of the present disclosure. In operation, since the anchor position is predefined, the relative relationship of the elements in the space will not change regardless of any changes in the space (e.g., size change, rotation, etc.). For example, when drawing a wall including a door, the door can be predetermined to be located at the bottom center of the wall, with a height of half the height of the wall and a width of one quarter of the width of the wall. In this case, regardless of how the size of the generated wall changes, a door and a wall with a predetermined relative relationship can be generated.

[0050] After the space is divided, voxel operations can be applied to the divided space. In some embodiments, the voxel operation includes at least one of the following: a voxel filling operation for filling voxel data (i.e., an operation of filling a certain voxel block into a certain space), a voxel erasing operation for erasing voxel data (i.e., an operation of erasing all voxel blocks in the entire space), a voxel rotation operation for rotating voxel data (i.e., an operation of rotating all voxel blocks in a space), a voxel operation including a voxel merging operation for merging voxel data in multiple spaces (i.e., an operation of merging voxel blocks in two spaces), or an asset application operation for applying another asset file corresponding to an additional virtual object to a specified space (i.e., an operation of drawing a space as an input space of another brush to support multi-layer nested operations).

[0051] Based on the above-mentioned voxel data structure, spatial distribution / segmentation algorithm, and voxel operation, an application developer or application developer can edit or create an asset file (i.e., a brush file). Next, the asset file creation process according to some embodiments of the present disclosure will be described in detail. In some embodiments, an asset editing interface may be provided to a user (e.g., an application developer or application developer). The user creates a node graph in the asset editing interface, wherein the node graph includes a plurality of connected processing nodes, and the node connection graph indicates the process of creating a virtual object. The electronic device 110 may create an asset file corresponding to the virtual object based on the node graph.

[0052] In some embodiments, the plurality of processing nodes include a voxel operation node, and the voxel operation node is configured to apply a corresponding voxel operation to the specified space. In some embodiments, the voxel operation includes at least one of the following: a voxel filling operation for filling voxel data; a voxel erasing operation for erasing voxel data; an asset applying operation for applying another asset file corresponding to the additional virtual object to the specified space; a voxel merging operation for merging voxel data in multiple spaces; and a voxel rotating operation for rotating voxel data.

[0053] In other words, the voxel-based operations and distribution / segmentation functions discussed in the present disclosure can be encapsulated as processing nodes. Application developers or application developers can define the input and output of processing nodes and interconnect multiple processing nodes to install the creation logic of virtual objects, thereby completing the creation of asset files.

[0054] In some embodiments, application developers or application developers can arrange and call spatial distribution / segmentation nodes and voxel operation nodes in the editor in various forms such as dragging and dropping. Furthermore, application developers or application developers can connect these nodes with lines to achieve data transfer between input and output functions. In other words, application developers or application developers can create asset files based on voxel-based operation technologies supported by the platform. In response to the virtual object creation instruction of user 140, electronic device 110 can call the corresponding asset file to complete the creation of the virtual object.

[0055] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings. Example Interaction

[0056] Figures 2 to 10 1 shows example interfaces 200 to 1000 according to some embodiments of the present disclosure. Example interfaces 200 to 1000 may be provided by the electronic device 110 shown in FIG. 1 , for example. It should be understood that Figure 2 The interactive interfaces shown in 7 are merely examples, and various designs may exist in practice. For example, the various graphical elements and / or controls in the interactive interface may have different arrangements and different visual representations, one or more of the elements and / or controls may be omitted or replaced, and one or more other elements and / or controls may also exist. In addition, any appropriate content may be included in the user interface. The scope of the present disclosure is not limited in this respect.

[0057] Further, user 140 can switch and jump the interactive interface by activating the control / entry in each interactive interface or performing a predetermined operation in the interactive interface. It should be understood that the logic of switching and jumping the interactive interface can be set arbitrarily. For example, in an example embodiment, user 140 jumps from the first interactive interface to the second interactive interface by activating a control. In other embodiments, user 140 can jump from the first interactive interface to the third interactive interface by activating another control. The present disclosure is not limited in this respect. It should also be understood that although multiple interactive interfaces are described in a specific embodiment, any interactive interface described in the present disclosure can be independently implemented as a separate embodiment.

[0058] In operation, the user 140 may start the application 115 and enter the virtual resource creation mode through corresponding operation controls. Figure 2An example interface 200 for creating a virtual object is shown. In the example interface 200, the user can control the placement of the operation block 208. By placing multiple operation blocks reasonably, various virtual objects can be created. Further, the example interface 200 may include operation controls such as setting controls, navigation controls, and undo controls 204 to assist the user 140 in completing various operations. For example, after the user 140 places the operation block 208 at a specified position, the undo control 204 can be used to undo the most recent placement operation.

[0059] The above virtual resource creation process is relatively flexible, but requires high operating skills from the user. Therefore, when creating relatively complex virtual resources, it takes the user a long time.

[0060] In some embodiments, the example interface 200 includes a virtual resource collection 206 control. By triggering the virtual resource collection 206 control, the user 140 can view the created historical virtual resources and / or the virtual resources pre-configured in the application 115. The user 140 can place the virtual resources in the virtual resource collection in the example interface 200 by clicking / dragging, etc., to create a virtual object or implement secondary editing of the created virtual resources. The above-mentioned method for creating virtual objects is relatively simple, but it needs to rely on the existing virtual resources in the application 115, and cannot meet the user's need to freely create virtual resources.

[0061] According to some embodiments of the present disclosure, the support application 115 utilizes a machine learning model to assist the user 140 in completing the creation of a virtual object. In operation, the electronic device 110 first presents an interactive interface of a virtual scene. Next, the electronic device 110 receives a generation request via the interactive interface, and the generation request indicates at least one generation parameter for generating a virtual resource associated with the virtual scene. Finally, in response to the target virtual resource being generated based on the generation request, the electronic device 110 creates a first virtual object corresponding to the target virtual resource in the virtual scene. In this way, the user can complete the creation of a complex virtual object by simply setting parameters. See Figure 2 An example interface 200 is shown to describe an example operation. The example interface 200 includes an auto-generate control 202. The user 140 can activate the auto-generate control 202 to trigger the automatic creation of a virtual object.

[0062] Next, we will combine Figures 3A to 3C The example interfaces 300A to 300C shown are used to describe the process of how to generate a request for generating a virtual resource according to various embodiments of the present disclosure.

[0063] According to some example embodiments of the present disclosure, the user 140 can complete the parameter setting of the virtual resource through the generation panel. Specifically. The electronic device 110 can present the generation panel in the interactive interface, wherein the generation panel includes multiple configuration controls for configuring different types of generation parameters. The user 140 can receive a generation request via multiple configuration controls in the generation panel. As an example operation, when the user 140 activates the automatic generation control 202 in the interface 200, the interactive interface can switch to the example interface 300A. In the example interface 300A, a generation panel 301 is presented. Through the generation panel 301, the user 140 can set the various parameters of the virtual resource to be created to obtain the desired creation effect. In this way, the user 140 can clearly and flexibly configure the various parameters of the virtual resource to be created, so that the created virtual resource is more in line with the user's expectations.

[0064] In some embodiments, the virtual resource may include a virtual building resource in a virtual scene. In this case, at least one generation parameter of the virtual resource may indicate at least one of the following: the type of the virtual building resource, the style of the virtual building resource, the size of the virtual building resource, the material of the virtual building resource, the structure of the virtual building resource, and the function of the virtual building resource. Additionally, in some embodiments, the electronic device 110 may obtain a first parameter via a first configuration control in a plurality of configuration controls, wherein the first parameter indicates the number of floors of the virtual building resource to be generated. Further, the electronic device 110 may obtain a second parameter via a second configuration control in a plurality of configuration controls, wherein the second parameter indicates the function of at least one floor in the virtual building resource to be generated. Alternatively or additionally, in some embodiments, the generation request also indicates whether to generate an internal component of the virtual building resource. The above parameters clearly define the creation parameters of the specific virtual resource of the building, and simply and concisely summarize the characteristics of the building, so that the generation process of the virtual resource of the building is more standardized. It should be understood that when the virtual object to be created is other objects, other setting parameters of other virtual resources to be created may be presented, and the present disclosure is not limited in this respect.

[0065] exist Figure 3AIn the example embodiment of , the virtual object to be created is a virtual building. In the example interface 300A, the user 140 can set the type and / or style of the virtual building. In some embodiments, the type and / or style of the virtual building may be associated. For example, the first type of the virtual building corresponds to the first group of candidate styles, and the second type of the virtual building corresponds to the second group of candidate styles. In this case, as the user 140 selects different building types, the candidate building styles may change accordingly. In one example, the candidate styles corresponding to the villa type may be: modern, European, and Japanese, while the candidate styles corresponding to the office building may be industrial, modern, and traditional. Depending on whether the type selected by the user 140 is a villa or an office building, the electronic device 110 presents different candidate styles. In this way, the type and style of the virtual building can be better matched, and the various attributes of the virtual resources created thereby can be more coordinated and consistent.

[0066] Alternatively or additionally, in the example interface 300A, the user 140 can set the size of the virtual building. Alternatively or additionally, in the example interface 300A, the user 140 can set the environment of the virtual building. Examples of the environment include, but are not limited to, a beach, a green lawn, a mountain forest, etc. In some embodiments, the electronic device 110 also supports generating an environment or determining the size of the virtual building in a random manner.

[0067] Alternatively or additionally, in the example interface 300A, the user 140 can set the color tone of the virtual building. In some embodiments, the user 140 can select the color tone of the virtual building. The electronic device 110 can use a machine learning model to determine the color of the virtual building according to the main color tone selected by the user 140 and the existing color scheme.

[0068] According to various embodiments of the present disclosure, more parameters about virtual resources can be configured. When all setting parameters cannot be displayed due to the size of the generation panel, the user 140 can set other parameters of the virtual resource through a drop-down menu, an expansion control, etc.

[0069] exist Figure 3B More example parameters are presented in the example interface 300B. In the example interface 300B, the user 140 can set the material of the virtual building. Examples of materials include, but are not limited to, wood, stone, and glass. The electronic device 110 can use the machine learning model to select the selected material as the main material of the virtual resource to be created.

[0070] In the example interface 300B, the user 140 can set the structure and function of the virtual building. Figure 3BAs shown, the user 140 can set the number of floors and floor functions of the virtual resources to be created. In some embodiments, the user 140 can choose to generate the number of floors in a random manner. Alternatively, in some embodiments, the user 140 can set the number of floors. Further, the user 140 can set the floor functions in a random or specified manner.

[0071] In one example, when the number of floors and the floor functions are both set to be randomly generated, the electronic device 110 may not present the structural details of the virtual building, such as Figure 3B In another example, when both the number of floors and the floor functions are customized, the electronic device 110 supports the user 140 to set the floor function for each corresponding floor. Figure 3C As shown, the electronic device 110 displays the floor setting control 351 and displays all the optional room function options of each floor in a tiled manner. In another example, when the number of floors is set to randomly generated and the floor function is set to customized, the electronic device 110 displays all candidate room function options in a tiled manner. In another example, when the number of floors is set to a specified number of floors and the floor function is set to randomly generated, the electronic device 110 may not present the structural details of the virtual building.

[0072] In some embodiments, when the number of floors and / or floor functions are set to customized and the user 140 does not select the corresponding parameters, the electronic device 110 can use a machine learning model to determine the parameters corresponding to the number of floors and / or floor functions based on other set parameters of the virtual resources to be created.

[0073] As discussed above, the generation request also indicates whether to generate the interior components of the virtual building resource. In the example interface 300B, the user 140 can set whether to generate interior walls and furniture for the virtual building. In operation, if the user 140 determines to generate interior walls without generating furniture, the electronic device 110 can generate only interior walls using the machine learning model. In another embodiment, if the user 140 determines to generate only furniture, the electronic device 110 can generate interior walls and generate furniture by default using the machine learning model. By presetting the generation rules, it can be ensured that the generation logic of the virtual building is consistent with the generation logic in the real world.

[0074] By presenting candidate parameters to assist the user 140 in completing parameter settings for virtual resources, the user 140 can be quickly helped to complete parameter settings, and the interaction method is more concise.

[0075] Alternatively or additionally, in some embodiments, it is also supported to express the generation request based on natural language. In some embodiments, the generation request is generated based on a user instruction based on natural language input by a user, wherein the user instruction indicates at least one generation parameter of the virtual resource. In some embodiments, the user instruction based on natural language can be a prompt word of a machine learning model.

[0076] Describe the virtual resources to be generated by using prompt words. Figure 3B As shown, the generation panel 301 also includes a prompt word input control 322. The user 140 describes the virtual resource to be generated in the prompt word input control 322 in a natural language. In some embodiments, prompt information can be presented in the prompt word input control 322. For example, the prompt information can include but is not limited to example prompt words or other auxiliary information to help the user 140 better input more accurate prompt words. In some embodiments, in response to the user activating the prompt word input control 322, the presentation of the prompt information is canceled. In some embodiments, the user 140 can input a part of the prompt word, and the electronic device 110 can automatically complete the prompt word in response to the request of the user 140. By introducing the prompt word, the generation process of the virtual resource can be made more flexible.

[0077] It should be understood that although Figures 3A to 3C The request to create a virtual object is described with a building as a virtual object, but the virtual object of the present disclosure may include any virtual object in a virtual environment. In addition, although the interface elements related to parameter configuration and prompt word input are presented in the same generation panel, in other embodiments, the interface elements related to parameter configuration and prompt words may be arranged in other ways, for example, setting a separate control price to support the input of prompt words. In other words, the present disclosure is not intended to improve the specific layout of the interface. Therefore, in the case of implementing the corresponding functions of the present disclosure, any changes in the interface layout are within the scope of protection of the present disclosure.

[0078] Alternatively or additionally, in some embodiments, the electronic device 110 may present prompt information via the interactive interface, the prompt information indicating at least one generation parameter of the virtual resource. In response to confirmation of the prompt information, the electronic device 110 may generate the generation request based on the prompt information. In this case, the application 115 may guide the user 140 to trigger the creation of a virtual object according to a predetermined strategy. Additionally, in some embodiments, the prompt information may be generated based on at least one of the following: historical virtual object creation information of the user 140, role information of the user 140 (e.g., age, gender and occupation of the virtual role), current virtual space environment, etc. As an example embodiment, if the current virtual space is a seaside, and the occupation of the virtual role corresponding to the user 140 is a barista, a prompt information may be presented in the interactive interface, for example, "Start creating a Japanese seaside coffee house." In response to the user 140 confirming the prompt information, the creation of the virtual resource may be triggered.

[0079] In short, the generation request can be initiated by the user 140, or it can be initiated by the application 115 and then confirmed by the user 140. In addition, the generation request can be configured based on a menu, or it can be expressed in the form of natural language. In other words, the various embodiments of the present disclosure can obtain the generation request in various flexible ways.

[0080] In operation, the electronic device 110 may determine the floor area according to the default building size when presenting the generation panel 301. After the user 140 sets the virtual building size through the generation panel 301, the electronic device 110 may adjust the determined floor area accordingly. In some embodiments, the floor area may be presented in the interactive interface in the form of a wireframe.

[0081] In some embodiments, the size and environment of the virtual building can jointly affect the fit of the virtual resources with the ground when they are placed. For example, when the environment of the virtual building is a beach, the terrain will be relatively flat, which will not have a significant impact on the placement of the virtual resources. However, when the environment of the virtual building is a mountain forest, the terrain difference is large. In this case, the lowest vertical height value among the corners of the virtual resource can be selected to determine the placement of the virtual resource.

[0082] In some embodiments, the user 140 can view the size of the virtual building and the setting effect of the environment, such as Figure 4AInterface 400A shown. In operation, the electronic device 110 dynamically presents the dimension wireframe and the set environment in interface 400A. Further, the electronic device 110 can present the size of the virtual building and the setting effect of the environment in a front view by default. The user 140 can switch the viewing angle through the controls or other input devices in the interface, such as by moving, rotating, etc. As an example operation, the user 140 can switch the viewing angle by rotating controls 401 and / or 402, and the interactive interface can be switched from the example interface 400A to the example interface 400B.

[0083] In some embodiments, the user 140 may determine to activate the confirmation control 403 in the example interface 400A to save the current region settings. In some embodiments, if the user 140 is not satisfied with the selected region, the user 140 may return to the generation panel to reset other parameters.

[0084] In some embodiments, the electronic device 110 may present a virtual character corresponding to the user 140 in the interactive interface. In the example interface 400A, a virtual character 401 corresponding to the user 140 is presented. In some embodiments, the distance between the virtual character 401 and the dimension wireframe of the virtual resource to be created may be a default value or may be configured by the user 140. In this way, the user 140 may have an immersive experience.

[0085] In some embodiments, the target virtual resource is also generated based on the placement scenario associated with the virtual resource to be generated. As an example, when the virtual resource is placed in an urban virtual space, the generated virtual resource will have a more modern feature. When the virtual resource is placed in a rural virtual space, the generated virtual resource will have a more pastoral feature. In this way, the generated virtual resource can be better integrated with the environment in which it is placed.

[0086] In some embodiments, the electronic device 110 supports generating multiple virtual resources in parallel. Specifically, the electronic device 110 can present a generation list in the interactive interface, wherein the generation list includes a group of content items corresponding to a group of historical generation requests and the content items indicate the completion status of the corresponding historical generation requests. In operation, the user 140 can sequentially activate the automatic generation control multiple times to trigger the generation of multiple virtual resources. Figure 5Example interface 500 shown. Example interface 500 includes a generation list, including content items 510, 520 and 530. Further, content items 510, 520 and 530 include progress rings to indicate the completion status of the corresponding historical generation request. In some embodiments, when a virtual resource is generated, the corresponding content item in the generation list can be superimposed to present an animated prompt. In some embodiments, the animated prompt can continue to be displayed until the user 140 has completed the processing.

[0087] In some embodiments, the electronic device 110 presents at least one element for characterizing the generation state of the first virtual object in the first placement area. In this case, in some embodiments, in response to receiving a selection of a target content item in the set of content items, the electronic device 110 may present a second placement area corresponding to a target generation request or present a second virtual object created based on the target generation request, wherein the target generation request corresponds to the target content item.

[0088] In some embodiments, when the user 140 clicks on a content item in the generated list, the interactive interface jumps to the front of the target building, and the default display perspective is a state of facing the building. Further, when the area behind is the periphery of the scene, the virtual character corresponding to the user 140 is displaced forward and downward on the basis of the relative position, and enters the edge position inside the current building generation to ensure that the character does not move out of the scene. In the example interface 500, when the user 140 selects a content item 510, it can be switched to the virtual scene of the target generation request corresponding to the content item 510, and the scene can display the interface in which the corresponding virtual resource has been created. When the user 140 selects a content item 520, it can be switched to the virtual scene of the target generation request corresponding to the content item 520, and the scene can display the scene in which the corresponding virtual resource is being created.

[0089] In some embodiments, if the current virtual resource is being created, the electronic device 110 prohibits the user 140 from editing the virtual resource again. Alternatively or additionally, in some embodiments, if the current virtual resource is being created, the electronic device 110 prohibits the user 140 from revoking the currently created virtual resource. In this case, the revocation operation is implemented on the previous virtual resource. For example, the user 140 completes the mode to the first virtual resource, and subsequently triggers the generation of the second virtual resource. In the generation process of the second virtual resource, the electronic device 110 receives the user's revocation operation, and the second virtual resource continues to be generated, and the first virtual resource is cancelled and placed. In this way, it is ensured that the current virtual resource process can be continuously executed.

[0090] In some embodiments, the number of multiple virtual resources generated in parallel has a maximum value. When the maximum value is exceeded, the system prompts that the generation of new virtual resources cannot be triggered. Referring to the example interface 500, in response to the number of virtual resources generated in parallel having reached the maximum value, when the user 140 triggers the automatic generation control again, the electronic device 110 presents a prompt message 540-the generation list is full, please give priority to the generation result. In some embodiments, after the user 140 has processed the generation result (as discussed later, save, delete, re-delete, etc.), the content item corresponding to the virtual resource completed by the operation is deleted from the generation list. At this point, the user 140 can trigger the creation of a new virtual resource. In this way, the user can meet the needs of creating multiple virtual resources at the same time, and ensure that the system does not occupy too many system resources at the same time.

[0091] Next, we will combine Fig. 6A and 6B The example interfaces 600A and 600B shown describe in detail the processing when the virtual resource creation fails. In some embodiments, when the first generation fails, the machine learning model can automatically attempt to regenerate. In other words, the regeneration process is imperceptible to the user. In this case, the corresponding content item in the generation list can present a status of being generated and / or a progress ring indicating that it is being generated. In some embodiments, when the number of times the machine learning model attempts to regenerate reaches a predetermined number of times, the machine learning model determines that the virtual resource generation has failed.

[0092] In some embodiments, when the virtual resource generation fails, the interactive interface may present a failure prompt message. Fig. 6A In the example of 600A, the failure prompt information may be any one of 610-1, 610-2 and 610-3. Additionally, the example interface 600A also presents a delete control 620. The user 140 may delete the creation task through the delete control 620. In this case, the content item corresponding to the virtual resource will be deleted from the generated list.

[0093] Alternatively, the example interface 600A also presents an edit control 630, sometimes also referred to as a regeneration control or a modification control. In some embodiments, the electronic device 110 receives an edit request for the generated target virtual resource via an interactive interface, and presents a second virtual resource generated based on the edit request in the interactive interface. Additionally, if the target virtual resource is a virtual building resource, and the edit request may indicate an adjustment to a portion of the floors in the virtual building resource. In other words, in the example interface 600A, via the corresponding edit control, the user 140 can trigger the regeneration of the entire virtual resource, or can trigger the regeneration of a portion of the virtual resource (e.g., a specified floor).

[0094] Next, we will combine Figures 7A to 7E The example interfaces 700A and 700E shown describe in detail the process when the virtual resource is successfully created. In some embodiments, when the virtual resource is successfully generated, the interactive interface may present a success prompt message. Fig. 7A In the example, the success prompt information may be 710 and / or 710.

[0095] In some embodiments, the user 140 can further process the successfully generated virtual resources. For example, when the user 140 activates the success prompt message in the example interface 700A, the interactive interface can switch to the example interface 700B. In the example interface 700B, the user 140 can view the created virtual resources and process the created virtual resources through the operation controls.

[0096] In one example, the example interface 700B is presented with a delete control 711. The user 140 can delete the currently created virtual resource through the delete control 711. In this case, the content item corresponding to the virtual resource is deleted from the generated list. As an example operation, when the user activates the delete control 711, the interactive interface switches to the example interface 700E.

[0097] In another example, the example interface 700B also presents an edit control 712, sometimes also referred to as a regeneration control or a modification control. In some embodiments, the electronic device 110 receives an edit request for the generated target virtual resource via the interactive interface, and presents a second virtual resource generated based on the edit request in the interactive interface. Additionally, if the target virtual resource is a virtual building resource, and the edit request may indicate an adjustment to a portion of the floors in the virtual building resource. In other words, in the example interface 700A, via the corresponding edit control, the user 140 can trigger the regeneration of the entire virtual resource, or can trigger the regeneration of a portion of the virtual resource (e.g., a specified floor). As an example operation, when the user activates the edit control 712, the interactive interface switches to the example interface 700D.

[0098] In some embodiments, application 115 supports secondary editing of created virtual resources, for example, updating created virtual resources (or part of virtual resources), supplementing part of virtual resources, and the like. In order to better illustrate the real reference of secondary editing in the present disclosure, a building with a two-story structure is used as an example scenario for explanation. In one example, the secondary editing operation can be to regenerate a building with a two-story structure. In another embodiment, the secondary editing operation can be to regenerate the first / second floor of the building. In another embodiment, the secondary editing operation can be to add wall decoration to the building with a two-story structure. It can be seen that in the present disclosure, a secondary editing operation can refer to any operation that results in the generation of new virtual resources / elements in a virtual space.

[0099] It should be understood that in traditional solutions, at least partial updates of virtual resources and operations to supplement created virtual resources cannot be supported. This is because, in traditional three-dimensional creation solutions, each virtual resource is an indivisible whole, resulting in the inability to process the components of the virtual resources separately. Unlike traditional three-dimensional creation solutions, the application scenario of the present disclosure is a voxel-based scenario. In this particular scenario, each virtual resource and each part of the virtual resource can be expressed and operated through voxel data. In this case, each virtual resource and each part of the virtual resource can be operated independently. Therefore, the embodiments of the present disclosure can support secondary editing of created virtual resources.

[0100] In another example, user 140 can save the currently created virtual resource by activating save control 713. In some embodiments, when user 140 activates save control 713, a blueprint of the current virtual resource can be drawn. As an example operation, when the user activates save control 713, the interactive interface switches to example interface 700C.

[0101] In some embodiments, the electronic device 110 can add the target virtual resource to the virtual resource collection associated with the virtual scene to support the creation of additional virtual objects in the virtual scene based on the target virtual resource. In some embodiments, the saved virtual resources will be presented in the shortcut bar and / or the virtual resource collection. As an example operation, when the user 140 activates the save control 731 in the example interface 700C, the interactive interface is displayed as shown in the example interface 800. In the example interface 800, the blueprint 820 of the currently created virtual resource is presented in the shortcut bar. Alternatively or additionally, the currently created virtual resource is saved to the virtual resource collection. Additionally, along with the save operation, the blueprint of the virtual resource moves to the virtual resource collection control 810 in a floating-in animation. Additionally, the virtual resource collection control 810 displays an update mark, for example, NEW.

[0102] According to some embodiments of the present disclosure, the created virtual resources can be placed in a virtual scene to create a target object in the virtual scene. In operation, the electronic device 110 can determine a first placement area in the virtual scene. Next, in response to the completion of the generation of the target virtual resource, the electronic device 110 can create the first virtual object corresponding to the target virtual resource in the first placement area of ​​the virtual scene. Next, the placement process of the virtual resources is described in detail in conjunction with the example interfaces 900A to 900C.

[0103] In operation, see Fig. 9A In the example interface 900A shown, the electronic device 110 presents a placement area 910. The placement area 910 may be generated based on the input of the user 140 or based on the set parameters of the virtual object. Fig. 9B In the example interface 900B shown, the electronic device 110 presents a placement bounding box 920. Similar to the placement area, the size of the placement bounding box 920 can also be generated based on the input of the user 140 or based on the setting parameters of the virtual object. By presenting the placement area and the placement bounding box, the user 140 can have a more intuitive feeling of the placement space of the virtual object.

[0104] In some embodiments, if other virtual resources have been placed in the placement area / placement space, the previously placed virtual resources are removed in response to the placement of the current virtual resource. In example interface 900B, virtual resource 930 has been placed in the placement area / placement bounding box, in which case virtual resource 930 will be removed. See example interface 900C, in which virtual resource 930 has been removed in response to the placement of the current virtual resource 950.

[0105] In some embodiments, a placement operation can be undone. Fig. 9B and 9C In the example of , in response to user 140 canceling the placement operation in 900C, the interactive interface can switch to 900B.

[0106] As discussed above, created virtual resources can be added to a virtual resource collection for maintenance. Fig.10 The example interface 1000 shown. In the example interface 1000, the virtual resources created by the user 140 can be presented. Further, the user 140 can manage and maintain the names, categories, etc. of the created virtual resources. Further, in some embodiments, the created virtual resources can be placed in the virtual scene by operations such as dragging and / or selecting. In this way, the reuse of virtual resources can be achieved.

[0107] Just to better understand the above example interaction process, we will combine Fig.11 To further describe the example interaction process of the present disclosure. Fig.11 A flowchart 1100 is shown of an example interaction process in a virtual scene according to some embodiments of the present disclosure.

[0108] In operation, user 140 can enter the virtual resource creation page. For example, in box 1101, the user starts application 115, and electronic device 110 enters the initial page of application 115. Considering that application 115 can have multiple functions, user 115 can click "My Game" tab in box 1102, and click "Create New Game" in box 1103. Further, user 140 can select a template in box 1104 and switch to building mode in box 1105. In this way, user 140 can enter building placement mode in box 1107, for example, example interface 200 shown in 2. It should be understood that the display process of triggering example interface 200 is exemplary. In other embodiments, example interface 200 can be triggered by other operation paths, including but not limited to directly displaying example interface 200 by opening application 115.

[0109] In some examples, in box 1112, user 140 can click on the automatic generation control (see example interface 200). In box 1113, user 140 can select the corresponding label, that is, set the parameters of the virtual resource (see example interfaces 300A to 300C). In box 1114, user 140 can select the area, and in box 1105, click to confirm to start generating. As an example operation, user 140 can set the virtual resource size and environment through example interface 300A, and preview and confirm in example interfaces 400A and 400B. In box 1115, user 140 can click to confirm the generation of triggering virtual resources. In some embodiments, in the generation process of virtual resources, secondary editing of user 140 is not supported, but viewing results can be supported. As an example, electronic device 110 can display generation progress, generation results, generation process, etc.

[0110] In box 1116, in response to the generation being completed, the user 140 can view the generation result. In some embodiments, in response to the viewing operation, the virtual character corresponding to the user 140 can be presented in front of the corresponding target building. Further, the interactive interface can automatically pop up a prompt message whether to save / delete / edit the currently generated building. As an example operation, when the user 140 clicks on the success prompt message 710 in the example interface 700A, the interactive interface switches to the example 700B. If the user does not process the generation result of the virtual resource, then in box 1117, the electronic device 110 continues to display the generation result prompt message.

[0111] In block 1118, if the user 140 determines to clear the generated content, the electronic device 110 deletes the generated virtual resource. As an example operation, if the user 140 clicks the delete control 711 in the example interface 700B, the interactive interface switches to the example interface 700E.

[0112] In box 1119, if the user 140 determines to regenerate, the electronic device 110 automatically opens the generation interface and uses the previous selection of this building. As an example operation, if the user 140 clicks the edit control 712 in the example interface 700B, the interactive interface switches to the example interface 700D.

[0113] If the user 140 determines to save the currently created virtual resource, the user may save the blueprint name of the virtual resource in block 1120. The electronic device 110 may add the virtual resource to the virtual resource collection, and the generation is complete.

[0114] In some embodiments, if multiple identical buildings need to be created, the user 140 can return to box 1108, for example, to select to edit the created virtual resource, or jump to box 1112 and click the automatic generation control. If the user does not need to generate other virtual resources, the user can directly continue the game at box 1111.

[0115] Alternatively, at block 1106, user 140 may view the architectural resource backpack template tab and, at 1108, open the virtual resource collection (see example interface 1000). User 140 may select the corresponding virtual resource at block 1109 and place the virtual resource in the virtual environment at block 1110.

[0116] Through the above-mentioned example interactions disclosed in the present invention, the electronic device 110 can assist the user in completing the creation of complex virtual resources with the help of a machine learning model, thereby simplifying the virtual resource creation process and optimizing the generation effect of virtual resources. Example Process

[0117] Fig.12 FIG. 1 is a flow chart showing an example interaction process 1200 in a virtual scene according to some embodiments of the present disclosure. The process 1200 may be implemented at the electronic device 110. Figure 1A To describe process 1200.

[0118] In box 1210, the electronic device 110 presents an interactive interface of a virtual scene.

[0119] In block 1220 , the electronic device 110 receives a generation request via an interactive interface, where the generation request indicates at least one generation parameter for generating a virtual resource associated with a virtual scene.

[0120] In block 1230 , in response to the target virtual resource being generated based on the generation request, the electronic device 110 creates a first virtual object corresponding to the target virtual resource in the virtual scene.

[0121] In some embodiments, the electronic device 110 receives an edit request for the generated target virtual resource via an interactive interface; and presents a second virtual resource generated based on the edit request in the interactive interface.

[0122] In some embodiments, the target virtual resource is a virtual building resource, and the edit request indicates an adjustment to a portion of a floor in the virtual building resource.

[0123] In some embodiments, in response to the target virtual resource being generated based on a generation request, creating a first virtual object corresponding to the target virtual resource in the virtual scene includes: determining a first placement area in the virtual scene; and in response to the target virtual resource being generated, creating a first virtual object corresponding to the target virtual resource in the first placement area of ​​the virtual scene.

[0124] In some embodiments, the electronic device 110 presents at least one element representing a generation state of the first virtual object in the first placement area.

[0125] In some embodiments, the electronic device 110 presents a generation list in an interactive interface, the generation list including a group of content items corresponding to a group of historical generation requests, the content items indicating the completion status of the corresponding historical generation requests; and in response to receiving a selection of a target content item from a group of content items, presenting a second placement area corresponding to the target generation request or presenting a second virtual object created based on the target generation request, the target generation request corresponding to the target content item.

[0126] In some embodiments, creating a first virtual object corresponding to a target virtual resource in a virtual scene includes: dividing the target space in the virtual scene into multiple subspaces based on spatial distribution / segmentation information corresponding to the first virtual object; and filling a group of subspaces in the multiple subspaces with corresponding voxel data based on voxel configuration information corresponding to the multiple subspaces to create the first virtual object in the virtual scene.

[0127] In some embodiments, the electronic device 110 obtains an asset file corresponding to the first virtual object; and determines the space segmentation information and the voxel configuration information based on the asset file.

[0128] In some embodiments, the asset file is created based on the following process: in an asset editing interface, creating a node graph, the node graph including a plurality of connected processing nodes, the node connection graph indicating a process of creating a first virtual object; and based on the node graph, creating an asset file corresponding to the first virtual object.

[0129] In some embodiments, the generation request is generated based on a natural language-based user instruction input by a user, the user instruction indicating at least one generation parameter of the virtual resource.

[0130] In some embodiments, receiving the generation request via the interactive interface includes: presenting prompt information via the interactive interface, the prompt information indicating at least one generation parameter of the virtual resource; and generating the generation request based on the prompt information in response to confirming the prompt information.

[0131] In some embodiments, receiving a generation request via an interactive interface includes: presenting a generation panel in the interactive interface, the generation panel including a plurality of configuration controls for configuring different types of generation parameters; and receiving the generation request via the plurality of configuration controls.

[0132] In some embodiments, the virtual resources include virtual building resources in a virtual scene, and at least one generation parameter indicates at least one of the following: the type of the virtual building resource; the style of the virtual building resource; the size of the virtual building resource; the material of the virtual building resource; the tone of the virtual building resource; the environment of the virtual building resource; the structure of the virtual building resource; or the function of the virtual building resource.

[0133] In some embodiments, receiving a generation request via multiple configuration controls includes: obtaining a first parameter via a first configuration control among the multiple configuration controls, the first parameter indicating the number of floors of the virtual building resource to be generated; and / or obtaining a second parameter via a second configuration control among the multiple configuration controls, the second parameter indicating the function of at least one floor of the virtual building resource to be generated.

[0134] In some embodiments, the generation request also indicates whether to generate internal components of the virtual building resource.

[0135] In some embodiments, the target virtual resource is also generated based on a placement scenario associated with the virtual resource to be generated.

[0136] In some embodiments, the electronic device 110 adds the target virtual resource to a collection of virtual resources associated with the virtual scene to support creation of an additional virtual object in the virtual scene based on the target virtual resource. Example devices and equipment

[0137] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Fig.13A schematic structural block diagram of an example apparatus 1300 used in a virtual scene according to some embodiments of the present disclosure is shown. The apparatus 1300 may be implemented as or included in the electronic device 110. Each module / component in the apparatus 1300 may be implemented by hardware, software, firmware, or any combination thereof.

[0138] like Fig.13 As shown, the device 1300 includes a virtual scene presentation module 1310, configured to present an interactive interface of a virtual scene; a generation request receiving module 1320, configured to receive a generation request via the interactive interface, the generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; and a virtual object generation module 1330, configured to create a first virtual object corresponding to the target virtual resource in the virtual scene in response to the target virtual resource being generated based on the generation request.

[0139] In some embodiments, the apparatus 1300 further includes an editing module configured to receive an editing request for the generated target virtual resource via an interactive interface; and present the second virtual resource generated based on the editing request in the interactive interface.

[0140] In some embodiments, the target virtual resource is a virtual building resource, and the edit request indicates an adjustment to a portion of a floor in the virtual building resource.

[0141] In some embodiments, the virtual object generation module 1330 is further configured to: determine a first placement area in the virtual scene; and in response to completion of the target virtual resource generation, create a first virtual object corresponding to the target virtual resource in the first placement area of ​​the virtual scene.

[0142] In some embodiments, the device 1300 further includes a generation status presentation module configured to present at least one element representing a generation status of the first virtual object in the first placement area.

[0143] In some embodiments, the device 1300 also includes a generation list presentation module, which is configured to: present a generation list in an interactive interface, the generation list including a group of content items corresponding to a group of historical generation requests, the content items indicating the completion status of the corresponding historical generation requests; and in response to receiving a selection of a target content item from a group of content items, present a second placement area corresponding to the target generation request or present a second virtual object created based on the target generation request, the target generation request corresponding to the target content item.

[0144] In some embodiments, the virtual object generation module 1330 is also configured to: divide the target space in the virtual scene into multiple subspaces based on spatial distribution / segmentation information corresponding to the first virtual object; and fill a group of subspaces in the multiple subspaces with corresponding voxel data based on voxel configuration information corresponding to the multiple subspaces to create a first virtual object in the virtual scene.

[0145] In some embodiments, the device 1300 also includes an asset file acquisition module configured to: acquire an asset file corresponding to the first virtual object; and an information generation module configured to determine spatial segmentation information and voxel configuration information based on the asset file.

[0146] In some embodiments, the asset file is created based on the following process: in an asset editing interface, creating a node graph, the node graph including a plurality of connected processing nodes, the node connection graph indicating a process of creating a first virtual object; and based on the node graph, creating an asset file corresponding to the first virtual object.

[0147] In some embodiments, the generation request is generated based on a natural language-based user instruction input by a user, the user instruction indicating at least one generation parameter of the virtual resource.

[0148] In some embodiments, the generation request receiving module 1320 is further configured to: present prompt information via an interactive interface, the prompt information indicating at least one generation parameter of the virtual resource; and generate the generation request based on the prompt information in response to confirmation of the prompt information.

[0149] In some embodiments, the generation request receiving module 1320 is further configured to: present a generation panel in the interactive interface, the generation panel including a plurality of configuration controls for configuring different types of generation parameters; and receive a generation request via the plurality of configuration controls.

[0150] In some embodiments, the virtual resources include virtual building resources in a virtual scene, and at least one generation parameter indicates at least one of the following: the type of the virtual building resource; the style of the virtual building resource; the size of the virtual building resource; the material of the virtual building resource; the tone of the virtual building resource; the environment of the virtual building resource; the structure of the virtual building resource; or the function of the virtual building resource.

[0151] In some embodiments, the generation request receiving module 1320 is further configured to: obtain a first parameter via a first configuration control among multiple configuration controls, the first parameter indicating the number of floors of the virtual building resource to be generated; and / or obtain a second parameter via a second configuration control among multiple configuration controls, the second parameter indicating the function of at least one floor of the virtual building resource to be generated.

[0152] In some embodiments, the generation request also indicates whether to generate internal components of the virtual building resource.

[0153] In some embodiments, the target virtual resource is also generated based on a placement scenario associated with the virtual resource to be generated.

[0154] In some embodiments, the apparatus 1300 further includes a virtual resource maintenance module configured to: cause the terminal device 110 to add the target virtual resource to a virtual resource set associated with the virtual scene to support creation of an additional virtual object in the virtual scene based on the target virtual resource.

[0155] like Fig.14 As shown, the electronic device 1400 is in the form of a general electronic device. The components of the electronic device 1400 may include, but are not limited to, one or more processors or processing units 1410, a memory 1420, a storage device 1430, one or more communication units 1440, one or more input devices 14140, and one or more output devices 1460. The processing unit 1410 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 1420. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 1400.

[0156] The electronic device 1400 typically includes a plurality of computer storage media. Such media may be any accessible media accessible to the electronic device 1400, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1420 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1430 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 1400.

[0157] The electronic device 1400 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.14As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1420 may include a computer program product 1425 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0158] The communication unit 1440 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 1400 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 1400 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0159] Input device 14140 may be one or more input devices, such as a mouse, keyboard, tracking ball, etc. Output device 1460 may be one or more output devices, such as a display, a speaker, a printer, etc. Electronic device 1400 may also communicate with one or more external devices (not shown) through communication unit 1440 as needed, such as storage devices, display devices, etc., communicate with one or more devices that enable a user to interact with electronic device 1400, or communicate with any device that enables electronic device 1400 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0160] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0161] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0162] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0163] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0164] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0165] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. An interactive method in a virtual scene, comprising: An interactive interface that presents a virtual scene; receiving, via the interactive interface, a generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; as well as In response to the target virtual resource being generated based on the generation request, a first virtual object corresponding to the target virtual resource is created in the virtual scene.

2. The method according to claim 1, further comprising: Receiving, via the interactive interface, an editing request for the generated target virtual resource; as well as A second virtual resource generated based on the editing request is presented in the interactive interface. 3 . The method according to claim 2 , wherein the target virtual resource is a virtual building resource, and the edit request indicates adjustment of a portion of floors in the virtual building resource.

4. The method according to claim 1, wherein in response to a target virtual resource being generated based on the generation request, creating a first virtual object corresponding to the target virtual resource in the virtual scene comprises: Determining a first placement area in the virtual scene; as well as In response to the target virtual resource being generated, the first virtual object corresponding to the target virtual resource is created in the first placement area of ​​the virtual scene.

5. The method according to claim 4, further comprising: At least one element representing a generation state of the first virtual object is presented in the first placement area.

6. The method according to claim 1, further comprising: Presenting a generation list in the interactive interface, the generation list including a set of content items corresponding to a set of historical generation requests, the content items indicating a completion status of the corresponding historical generation requests; as well as In response to receiving a selection of a target content item from the group of content items, presenting a second placement area corresponding to a target generation request or presenting a second virtual object created based on the target generation request, the target generation request corresponding to the target content item.

7. The method according to claim 1, wherein creating the first virtual object corresponding to the target virtual resource in the virtual scene comprises: Dividing a target space in the virtual scene into a plurality of subspaces based on spatial distribution / segmentation information corresponding to the first virtual object; as well as Based on the voxel configuration information corresponding to the multiple subspaces, a group of subspaces among the multiple subspaces is filled with corresponding voxel data to create the first virtual object in the virtual scene.

8. The method according to claim 7, further comprising: Acquire an asset file corresponding to the first virtual object; as well as Based on the asset file, the spatial segmentation information and the voxel configuration information are determined.

9. The method of claim 8, wherein the asset file is created based on the following process: In an asset editing interface, creating a node graph, the node graph comprising a plurality of connected processing nodes, the node connection graph indicating a process of creating the first virtual object; and Based on the node graph, the asset file corresponding to the first virtual object is created.

10. The method according to claim 1, wherein the generation request is generated based on a natural language-based user instruction input by a user, the user instruction indicating at least one generation parameter of the virtual resource.

11. The method of claim 10, wherein receiving a generation request via the interactive interface comprises: Presenting prompt information via the interactive interface, the prompt information indicating at least one generation parameter of the virtual resource; as well as In response to confirmation of the prompt information, the generation request is generated based on the prompt information.

12. The method of claim 1, wherein receiving a generation request via the interactive interface comprises: Presenting a generation panel in the interactive interface, the generation panel including a plurality of configuration controls for configuring different types of generation parameters; as well as The generate request is received via the plurality of configuration controls.

13. The method according to claim 12, wherein the virtual resource comprises a virtual building resource in the virtual scene, and the at least one generation parameter indicates at least one of the following: Types of virtual building resources; The style of the virtual architectural resources; the dimensions of the virtual building resources; Materials of virtual building resources; the hue of virtual architectural resources; Environment of virtual building resources; the structure of a virtual building resource; or Functionality of virtual building resources.

14. The method of claim 13, wherein receiving, via the plurality of configuration controls, the generation request comprises: Obtaining a first parameter via a first configuration control among the plurality of configuration controls, wherein the first parameter indicates the number of floors of the virtual building resource to be generated; and / or A second parameter is obtained via a second configuration control among the plurality of configuration controls, where the second parameter indicates a function of at least one floor in the virtual building resource to be generated.

15. The method according to claim 13, wherein the generation request further indicates whether to generate internal components of the virtual building resource.

16. The method according to claim 1, wherein the target virtual resource is further generated based on a placement scenario associated with the virtual resource to be generated.

17. The method according to claim 1, further comprising: The target virtual resource is added to a virtual resource collection associated with the virtual scene to support creation of an additional virtual object in the virtual scene based on the target virtual resource.

18. An interactive device in a virtual scene, comprising: A virtual scene presentation module, configured to present an interactive interface of a virtual scene; A generation request receiving module, configured to receive a generation request via the interactive interface, the generation request indicating at least one generation parameter for generating a virtual resource associated with the virtual scene; as well as The virtual object generation module is configured to create a first virtual object corresponding to the target virtual resource in the virtual scene in response to the target virtual resource being generated based on the generation request.

19. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processing unit.

20. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 17.

Images