Interaction method and device in virtual scene, equipment and storage medium

Abstract

The embodiment of the invention provides an interaction method and device in a virtual scene, equipment and a computer readable storage medium. The method comprises the steps that the electronic equipment receives a request for creating a virtual object in a virtual scene; dividing a target space in the virtual scene into a plurality of subspaces based on the spatial distribution / segmentation information corresponding to the virtual object; and based on the voxel configuration information corresponding to the plurality of subspaces, filling a group of subspaces in the plurality of subspaces with corresponding voxel data so as to create a virtual object in the virtual scene. In this manner, the virtual object may be created in a more refined manner.

Description

Technical Field

[0001] The exemplary embodiments of the present disclosure generally relate to the computer field, and more particularly to an interaction method, apparatus, device, and computer-readable storage medium in a virtual scene. Background Art

[0002] With the rapid development of computer technology, more and more applications and platforms are currently designed to provide various services to users, for example, providing virtual space. The virtual space provided by the application can include various virtual objects, including but not limited to hills, grasslands, forests, etc. In traditional solutions, although the above virtual objects can also be generated, traditional solutions often do not pay attention to the details of virtual objects, resulting in obvious defects in the generated virtual objects, thereby affecting the visual presentation effect of the application. In view of this, it is urgent to provide a fast and efficient virtual object creation method so that virtual objects in the virtual space can be created in a refined manner. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for interaction in a virtual scene is provided. The method comprises: receiving a request for creating a virtual object in the virtual scene; dividing a target space in the virtual scene into a plurality of subspaces based on spatial distribution / segmentation information corresponding to the virtual object; and filling a group of subspaces in the plurality of subspaces with corresponding voxel data based on voxel configuration information corresponding to the plurality of subspaces, so as to create the virtual object in the virtual scene.

[0004] In a second aspect of the present disclosure, an interactive device in a virtual scene is provided. The device includes: a request receiving module configured to receive a request for creating a virtual object in the virtual scene; a segmentation module configured to divide a target space in the virtual scene into a plurality of subspaces based on spatial distribution / segmentation information corresponding to the virtual object; and a filling module configured to fill a group of subspaces in the plurality of subspaces with corresponding voxel data based on voxel configuration information corresponding to the plurality of subspaces, so as to create the virtual object in the virtual scene.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments according to the present disclosure may be implemented;

[0010] Figure 2 shows an example interface according to some embodiments of the present disclosure;

[0011] Figures 3A to 3C An example interface according to some embodiments of the present disclosure is shown.

[0012] Figure 4A shows a spatial distribution / segmentation block diagram according to some embodiments of the present disclosure;

[0013] Figure 4B A three-dimensional anchor point system according to some embodiments of the present disclosure is shown;

[0014] Figure 5 A flowchart showing an example interaction process in a virtual scene according to some embodiments of the present disclosure;

[0015] Figure 6 A schematic structural block diagram showing an example interactive device used in a virtual scene according to some embodiments of the present disclosure; and

[0016] Figure 7 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0020] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0021] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects are subject to the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user knows and confirms. Accordingly, when implementing each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0022] The schemes in this specification and the embodiments, if involving the processing of personal information, will be processed on the premise of having a legal basis (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and will only be processed within the scope of regulations or agreements. The user's refusal to process personal information other than the necessary information required for basic functions will not affect the user's use of basic functions. As an optional but non-restrictive implementation method, in response to receiving the user's active request, a method of sending a prompt message to the user may be, for example, a pop-up window, in which the prompt message may be presented in text. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device. It is understandable that the above notification and the process of obtaining user authorization are only illustrative and do not constitute a limitation on the implementation method of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation method of the present disclosure.

[0023] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multi-layer processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0024] As mentioned above, with the rapid development of computer technology, more and more applications and platforms are currently designed to provide users with various services, such as providing virtual space. The virtual space provided by the application may include multiple virtual objects, including but not limited to hills, grasslands, forests, etc. In the creation of virtual objects, users can use algorithms and programs to automatically generate virtual objects in the virtual space, for example, to generate hills, grasslands, and forests according to predetermined rules.

[0025] However, traditional virtual object generation schemes often do not pay attention to the details of virtual objects, resulting in obvious defects in the generated virtual objects, thus affecting the visual presentation of the application. Especially for voxel-based scenes, traditional schemes are not suitable for voxel-based virtual spaces. In view of this, it is urgent to provide a fast and efficient virtual object creation method so that virtual objects in virtual spaces can be created more finely in voxel-based scenes.

[0026] The embodiment of the present disclosure proposes an interaction scheme in a virtual scene. The scheme includes: receiving a request to create a virtual object in a virtual scene; and dividing a target space in the virtual scene into multiple subspaces based on spatial distribution / segmentation information corresponding to the virtual object; and filling corresponding voxel data in a group of subspaces in the multiple subspaces based on voxel configuration information corresponding to the multiple subspaces to create a virtual object in the virtual scene. In this way, virtual objects can be created in a more refined manner.

[0027] In some embodiments of the present disclosure, for ease of understanding, some embodiments of the present disclosure are described using buildings as examples of virtual objects. However, it should be understood that the embodiments of the present disclosure are not limited to the creation of buildings. In fact, the embodiments of the present disclosure can be applied to the creation scenario of any virtual object. In other words, the embodiments of the present disclosure are not limited in terms of the specific types of virtual objects.

[0028] It should be understood that the various embodiments discussed in the present disclosure may be applicable to modes based on user-generated-content (UGC) mode, professional-generated content (PGC) mode and / or professional user-generated content (PUGC) mode. In other words, the present disclosure is not limited in terms of content generation mode.

[0029] It should be understood that the various embodiments discussed in the present disclosure may be applicable to one-dimensional space, two-dimensional space, and three-dimensional space. In view of this, the term space used in the present disclosure may sometimes be replaced by region or line segment.

[0030] Various example implementations of the solution are described in detail below in conjunction with the accompanying drawings.

[0031] Example Environment

[0032] Figure 1 1 is a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1 As shown, the example environment 100 may include an electronic device 110. In the example environment 100, an application 115 is installed in the electronic device 110. A user 140 may interact with the application 115 via the electronic device 110 and / or an attached device of the electronic device 110.

[0033] Application 115 can provide the user 140 with an integration of multiple applications or components. These applications can be used as application modules in application 115. In some embodiments, application 115 can be downloaded and installed as an application on electronic device 110. In some embodiments, application 115 can also be accessed in other ways, such as through a web page.

[0034] Application 115 may be any appropriate type of application capable of providing media content, examples of which may include but are not limited to: social applications, audio / video applications, media item playback applications, broadcast applications, etc. The embodiments of the present disclosure are not limited in this respect.

[0035] exist Figure 1 In the environment 100 of FIG. 1 , if the application 115 is active, the electronic device 110 can present an interactive page through the application 115. The interactive page can be a page of any appropriate type, which can support the user 140 to input any appropriate type of data and present media items of any media item type to the user 140. The interactive interface can include various interfaces that can be provided by the application 115, such as a parameter setting interface, a loading interface, a special effect display interface, and the like.

[0036] In some embodiments, the electronic device 110 can communicate with the server 130 to provide services for the application 115. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio receiver, an e-book device, a game device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0037] The server 130 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 115 that supports virtual scenes in the electronic device 110.

[0038] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired manner or a wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0039] A machine learning model 120 is deployed in the environment 100. The machine learning model 120 can be deployed on an appropriate electronic device. As an example, the machine learning model 120 can also be deployed on other electronic devices different from the server 130, and the server 130 can, for example, call the machine learning model 120 to perform the corresponding task by way of a service call. In another example, the machine learning model 120 can also be deployed locally on the server 130, for example.

[0040] As will be described in detail below, the electronic device 110 can use the machine learning model 120 to complete the creation of the virtual object. As an example, the electronic device 110 can call the machine learning model 120 through the server 130. As another example, the electronic device 110 can also directly call the machine learning model 120. In short, the present disclosure is not limited in terms of the deployment location and calling method of the machine learning model 120.

[0041] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0042] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0043] Example Interaction

[0044] Figures 2 to 3C200 to 300C according to some embodiments of the present disclosure. The example interfaces 200 to 300C may be, for example, Figure 1 The electronic device 110 shown is provided. It should be understood that Figures 2 to 3C The interactive interface shown is only an example, and various designs may exist in practice. For example, the various graphical elements and / or controls in the interactive interface may have different arrangements and different visual representations, one or more of the elements and / or controls may be omitted or replaced, and one or more other elements and / or controls may also exist. In addition, any appropriate content may be included in the user interface. The scope of the present disclosure is not limited in this respect.

[0045] In operation, the electronic device 110 receives a request to create a virtual object in a virtual scene. In response to the request to create a virtual object, the electronic device 110 can divide the target space in the virtual scene into multiple subspaces based on the spatial distribution / segmentation information corresponding to the virtual object. Next, the electronic device 110 can fill a group of subspaces in the multiple subspaces with corresponding voxel data based on the voxel configuration information corresponding to the multiple subspaces to create a virtual object in the virtual scene. In this way, for a voxel-based virtual space scene, the process of creating a virtual object can be abstracted as a voxel data operation on the space. The space can thus be divided iteratively so that every detail of the virtual object can be well processed, thereby improving the creation precision of the virtual object.

[0046] See also Figure 2 An example interface 200 for creating a virtual object is shown. In the example interface 200, the user can control the placement of the operation block 208. By properly placing multiple operation blocks, various virtual objects can be created. According to some embodiments of the present disclosure, the support application 115 uses a machine learning model to assist the user 140 in completing the creation of virtual objects. In operation, the electronic device 110 first presents an interactive interface of a virtual scene. Next, the electronic device 110 receives a request to create a virtual object via the interactive interface, and the request indicates the generation of at least one generation parameter associated with the virtual object. In this way, the user can complete the creation of complex virtual objects through simple parameter settings. See Figure 2 An example interface 200 is shown to describe an example operation. The example interface 200 includes an auto-generate control 202. The user 140 can activate the auto-generate control 202 to trigger the automatic creation of a virtual object.

[0047] Next, we will combine Figures 3A to 3C The example interfaces 300A to 300C shown are used to describe the process of how to generate a request to create a virtual object according to various embodiments of the present disclosure.

[0048] According to some example embodiments of the present disclosure, the user 140 can complete the parameter setting of the virtual object through the generation panel. Specifically. The electronic device 110 can present the generation panel in the interactive interface, wherein the generation panel includes a plurality of configuration controls for configuring different types of generation parameters. The user 140 can receive a creation request via the plurality of configuration controls in the generation panel. As an example operation, when the user 140 activates the automatic generation control 202 in the interface 200, the interactive interface can switch to the example interface 300A. In the example interface 300A, a generation panel 301 is presented. Through the generation panel 301, the user 140 can set the various parameters of the virtual object to be created to obtain the desired creation effect. In this way, the user 140 can clearly and flexibly configure the various parameters of the virtual object to be created, so that the created virtual object is more in line with the user's expectations.

[0049] In some embodiments, the virtual object may include a virtual building object in a virtual scene. In this case, at least one generation parameter of the virtual object may indicate at least one of the following: the type of the virtual building object, the style of the virtual building object, the size of the virtual building object, the material of the virtual building object, the structure of the virtual building object, and the function of the virtual building object. Additionally, in some embodiments, the electronic device 110 may obtain a first parameter via a first configuration control in a plurality of configuration controls, wherein the first parameter indicates the number of floors of the virtual building object to be generated. Further, the electronic device 110 may obtain a second parameter via a second configuration control in a plurality of configuration controls, wherein the second parameter indicates the function of at least one floor in the virtual building object to be generated. Alternatively or additionally, in some embodiments, the generation request also indicates whether to generate the internal components of the virtual building object. The above parameters clearly define the creation parameters of the specific virtual object of the building, and simply and concisely summarize the characteristics of the building, so that the generation process of the virtual object of the building is more standardized. It should be understood that when the virtual object to be created is other objects, other setting parameters of other virtual objects to be created may be presented, and the present disclosure is not limited in this respect.

[0050] exist Figure 3AIn the example embodiment of , the virtual object to be created is a virtual building. In the example interface 300A, the user 140 can set the type and / or style of the virtual building. In some embodiments, the type and / or style of the virtual building may be associated. For example, the first type of the virtual building corresponds to the first group of candidate styles, and the second type of the virtual building corresponds to the second group of candidate styles. In this case, as the user 140 selects different building types, the candidate building styles may change accordingly. In one example, the candidate styles corresponding to the villa type may be: modern, European, and Japanese, while the candidate styles corresponding to the office building may be industrial, modern, and traditional. Depending on whether the type selected by the user 140 is a villa or an office building, the electronic device 110 presents different candidate styles. In this way, the type and style of the virtual building can be better matched, and the various attributes of the virtual object created thereby can be more coordinated and consistent.

[0051] Alternatively or additionally, in the example interface 300A, the user 140 can set the size of the virtual building. Alternatively or additionally, in the example interface 300A, the user 140 can set the environment of the virtual building. Examples of the environment include, but are not limited to, a beach, a green lawn, a mountain forest, etc. In some embodiments, the electronic device 110 also supports generating an environment or determining the size of the virtual building in a random manner.

[0052] Alternatively or additionally, in the example interface 300A, the user 140 can set the color tone of the virtual building. In some embodiments, the user 140 can select the color tone of the virtual building. The electronic device 110 can use a machine learning model to determine the color of the virtual building according to the main color tone selected by the user 140 and the existing color scheme.

[0053] According to various embodiments of the present disclosure, more parameters about the virtual object can be configured. When all setting parameters cannot be displayed due to the size of the generation panel, the user 140 can set other parameters of the virtual object through a drop-down menu, an expansion control, etc.

[0054] exist Figure 3B More example parameters are presented in the example interface 300B. In the example interface 300B, the user 140 can set the material of the virtual building. Examples of materials include, but are not limited to, wood, stone, and glass. The electronic device 110 can use the machine learning model to use the selected material as the main material of the virtual object to be created.

[0055] In the example interface 300B, the user 140 can set the structure and function of the virtual building. Figure 3BAs shown, the user 140 can set the number of floors and floor functions of the virtual object to be created. In some embodiments, the user 140 can choose to generate the number of floors in a random manner. Alternatively, in some embodiments, the user 140 can set the number of floors. Further, the user 140 can set the floor functions in a random or specified manner.

[0056] In one example, when the number of floors and the floor functions are both set to be randomly generated, the electronic device 110 may not present the structural details of the virtual building, such as Figure 3B In another example, when both the number of floors and the floor functions are customized, the electronic device 110 supports the user 140 to set the floor function for each corresponding floor. Figure 3C As shown, the electronic device 110 displays the floor setting control 351 and displays all the optional room function options of each floor in a tiled manner. In another example, when the number of floors is set to randomly generated and the floor function is set to customized, the electronic device 110 displays all candidate room function options in a tiled manner. In another example, when the number of floors is set to a specified number of floors and the floor function is set to randomly generated, the electronic device 110 may not present the structural details of the virtual building.

[0057] In some embodiments, when the number of floors and / or floor functions are set to customized and the user 140 does not select the corresponding parameters, the electronic device 110 can use a machine learning model to determine the parameters corresponding to the number of floors and / or floor functions based on other set parameters of the virtual object to be created.

[0058] As discussed above, the generation request also indicates whether to generate the interior components of the virtual building object. In the example interface 300B, the user 140 can set whether to generate interior walls and furniture for the virtual building. In operation, if the user 140 determines to generate interior walls without generating furniture, the electronic device 110 can generate only interior walls using the machine learning model. In another embodiment, if the user 140 determines to generate only furniture, the electronic device 110 can generate interior walls and generate furniture by default using the machine learning model. By presetting the generation rules, it can be ensured that the generation logic of the virtual building is consistent with the generation logic in the real world.

[0059] By presenting candidate parameters to assist the user 140 in completing the parameter setting for the virtual object, the user 140 can be quickly helped to complete the parameter setting, and the interaction method is more concise.

[0060] Alternatively or additionally, in some embodiments, the user 140 is also supported to describe the virtual object to be generated by means of prompt words. Figure 3BAs shown, the generation panel 301 also includes a prompt word input control 322. The user 140 describes the virtual object to be generated in a natural language in the prompt word input control 322. In some embodiments, prompt information can be presented in the prompt word input control 322. For example, the prompt information can include but is not limited to example prompt words or other auxiliary information to help the user 140 better input more accurate prompt words. In some embodiments, in response to the user activating the prompt word input control 322, the presentation of the prompt information is canceled. In some embodiments, the user 140 can input a part of the prompt word, and the electronic device 110 can automatically complete the prompt word in response to the request of the user 140. By introducing the prompt word, the generation process of the virtual object can be made more flexible.

[0061] It should be understood that although Figures 3A to 3C The request to create a virtual object is described with a building as a virtual object, but the virtual object of the present disclosure may include any virtual object in a virtual environment. In addition, although the interface elements related to parameter configuration and prompt word input are presented in the same generation panel, in other embodiments, the interface elements related to parameter configuration and prompt words may be arranged in other ways. In other words, the present disclosure is intended to improve how to create virtual objects, rather than to improve the specific layout of the interface. Therefore, in the case of implementing the corresponding functions of the present disclosure, any changes in the interface layout are within the scope of protection of the present disclosure.

[0062] It should be understood that the request to create a virtual object in the context of the present disclosure may refer to any of the following operations: generating a virtual object (or a part of a virtual object), updating a virtual object (or a part of a virtual object), supplementing a part of a virtual object, and the like. In order to better illustrate the actual reference of the request to create a virtual object in the present disclosure, a building with a two-story structure is used as an example scenario for explanation. In one example, the request to create a virtual object may be to generate a building with a two-story structure. In another embodiment, the request to create a virtual object may be to regenerate a building with a two-story structure. In yet another embodiment, the request to create a virtual object may be to regenerate the first / second floor of the building. In yet another embodiment, the request to create a virtual object may be to add wall decoration to the building with a two-story structure. It can be seen that in the present disclosure, the request to create a virtual object may refer to any operation that results in the generation of a new virtual object / element in a virtual space.

[0063] It should be understood that in the traditional solution, at least the partial update of virtual objects and the operation of supplementing the created virtual objects cannot be supported. This is because, in the traditional solution, each virtual object is an indivisible whole, which makes it impossible to process the components of the virtual object separately. The application scenario of the present disclosure is a voxel-based scenario. In this specific scenario, each virtual object and each part of the virtual object can be expressed and operated by voxel data. In this case, each virtual object and each part of the virtual object can be operated independently. In this case, compared with the traditional solution, the various embodiments of the present disclosure can achieve refined processing of virtual objects.

[0064] In some embodiments, in order to achieve the creation of virtual objects, the space / region can be recursively segmented in a given input space / region, thereby dividing the given space into multiple subspaces, and applying different voxel operations to the subspaces, respectively, thereby achieving the creation of refined virtual objects.

[0065] In some embodiments, the target space is determined based on a placement location of the virtual object in the virtual scene and a request to create the virtual object.

[0066] In some embodiments, the electronic device 110 obtains an asset file corresponding to the virtual object, also referred to as a brush file or simply a brush, and determines spatial segmentation information and voxel configuration information based on the asset file. Asset files are sometimes also referred to as brush files or brushes. In order to support the creation of asset files, according to some embodiments of the present disclosure, a data structure for voxels and / or multiple voxel operations for voxel scenes are introduced. Next, a brief description of the data structure and / or voxel operations of the present disclosure is first given.

[0067] In some embodiments, both basic data structures and voxel data structures are supported. Examples of basic data structures include: Boolean type (abbreviated as bool) / integer type (abbreviated as int), floating point type (float), floating point vector type (abbreviated as vector3f), integer vector type (abbreviated as vector3i), string type (abbreviated as string) and array type (abbreviated as array). Through the above conventional data structures, basic data expression requirements can be achieved.

[0068] In some embodiments, the voxel data structure includes a first data structure (abbreviated as Volume) that describes whether there is a voxel block in each grid of an area or space. Additionally, in some embodiments, the first data structure can be composed of the following basic data structures: an integer vector type vector3i describing a starting point, an integer vector type vector3i describing an area size, and / or a Boolean type bool indicating whether there is a voxel block.

[0069] Alternatively or additionally, in some embodiments, the voxel data structure includes a second data structure (abbreviated as Voxel) that describes the type of voxels in each grid in an area or space. Additionally, in some embodiments, the second data structure may be composed of the following basic data structures: an integer vector type vector3i that describes the starting point, an integer vector type vector3i that describes the size of the area, and / or an enumeration type blockid that indicates the type of voxel. Alternatively or additionally, in some embodiments, the voxel data structure includes a third data structure (abbreviated as bounds) that describes the boundary of an area or space. Additionally, in some embodiments, the third data structure may be composed of a basic data structure of vector type. Alternatively or additionally, in some embodiments, the voxel data structure includes the type of voxel blocks of enumeration type (abbreviated as BlockType). By introducing the above-mentioned voxel data structure, the voxel data can be better expressed. In addition, since the above-mentioned voxel data is composed of a basic data structure, better system compatibility is achieved.

[0070] According to some example embodiments of the present disclosure, within a given input space, space segmentation may be recursively performed to divide the given space into a plurality of subspaces, and different voxel operations may be applied to the subspaces respectively.

[0071] See also Figure 4A , which shows a spatial distribution / segmentation block diagram 400A according to some embodiments of the present disclosure. In an embodiment, the spatial distribution / segmentation function can determine the size, quantity and position of the space. In some embodiments, the spatial distribution / segmentation function can output a third data structure (bounds), and its output can be one or more third data structures (bounds) corresponding to one or more subspaces. In some embodiments, the spatial distribution / segmentation function can determine the number and position of the segmented subspaces. In some embodiments, the segmented space can be: one-dimensional space, two-dimensional space or three-dimensional space. In some embodiments, voxel data can be distributed in the segmented space based on a variety of distribution types, including but not limited to random distribution, noise-based distribution, geometric shape distribution, wave function collapse distribution, Lindenmayer system distribution, Hit Surface Sampler and other distributions.

[0072] In some embodiments, by setting the anchor point and alignment properties, an adaptive segmentation function can be implemented. Figure 4B, which shows a three-dimensional anchor point system 400B according to some embodiments of the present disclosure. In operation, since the anchor point position is predefined, the relative relationship of the elements in the space will not change regardless of any changes in the space (e.g., size change, rotation, etc.). For example, when drawing a wall including a door, the door can be predetermined to be located at the bottom center of the wall, with a height of half the height of the wall and a width of one quarter of the width of the wall. In this case, regardless of how the size of the generated wall changes, a door and a wall with a predetermined relative relationship can be generated.

[0073] After the space is divided, voxel operations can be applied to the divided space. In some embodiments, the voxel operation includes at least one of the following: a voxel filling operation for filling voxel data (i.e., an operation of filling a certain voxel block into a certain space), a voxel erasing operation for erasing voxel data (i.e., an operation of erasing all voxel blocks in the entire space), a voxel rotation operation for rotating voxel data (i.e., an operation of rotating all voxel blocks in a space), a voxel operation including a voxel merging operation for merging voxel data in multiple spaces (i.e., an operation of merging voxel blocks in two spaces), or an asset application operation for applying another asset file corresponding to an additional virtual object to a specified space (i.e., an operation of drawing a space as an input space of another brush to support multi-layer nested operations).

[0074] Based on the above-mentioned voxel data structure, spatial distribution / segmentation algorithm, and voxel operation, an application developer or application developer can edit or create an asset file (i.e., a brush file). Next, the asset file creation process according to some embodiments of the present disclosure will be described in detail. In some embodiments, an asset editing interface may be provided to a user (e.g., an application developer or application developer). The user creates a node graph in the asset editing interface, wherein the node graph includes a plurality of connected processing nodes, and the node connection graph indicates the process of creating a virtual object. The electronic device 110 may create an asset file corresponding to the virtual object based on the node graph.

[0075] In some embodiments, the plurality of processing nodes include a voxel operation node, and the voxel operation node is configured to apply a corresponding voxel operation to the specified space. In some embodiments, the voxel operation includes at least one of the following: a voxel filling operation for filling voxel data; a voxel erasing operation for erasing voxel data; an asset applying operation for applying another asset file corresponding to the additional virtual object to the specified space; a voxel merging operation for merging voxel data in multiple spaces; and a voxel rotating operation for rotating voxel data.

[0076] In other words, the voxel-based operations and distribution / segmentation functions discussed in the present disclosure can be encapsulated as processing nodes. Application developers or application developers can define the input and output of processing nodes and interconnect multiple processing nodes to install the creation logic of virtual objects, thereby completing the creation of asset files.

[0077] In some embodiments, application developers or application developers can arrange and call spatial distribution / segmentation nodes and voxel operation nodes in the editor in various forms such as dragging and dropping. Furthermore, application developers or application developers can connect these nodes with lines to achieve data transfer between input and output functions. In other words, application developers or application developers can create asset files based on voxel-based operation technologies supported by the platform. In response to the virtual object creation instruction of user 140, electronic device 110 can call the corresponding asset file to complete the creation of the virtual object.

[0078] In some embodiments, the plurality of processing nodes include a spatial processing node, and the spatial processing node is configured to output at least one subspace in a specified space. In some embodiments, at least one subspace is determined based on a specified spatial distribution pattern. In some embodiments, the distribution pattern includes, but is not limited to, a one-dimensional pattern, a two-dimensional pattern, and a three-dimensional pattern. In other embodiments, the distribution pattern includes, but is not limited to, random distribution, noise-based distribution, geometric shape distribution, wave function collapse distribution, Lindenmayer system distribution, Hit Surface Sampler distribution, etc.

[0079] In this way, application developers or application developers can quickly create asset files, and these asset files can assist users in quickly completing the creation of virtual objects.

[0080] In some embodiments, the user 140 can also edit the created virtual object again. Specifically, in some embodiments, the electronic device 110 receives an edit request for the created virtual resource via an interactive interface, and presents a second virtual resource generated based on the edit request in the interactive interface. Additionally, in some embodiments, the edit request includes at least one of the following: updating a portion of the virtual object; or adding a new portion to the virtual object. In other words, the user 140 can use the virtual object creation scheme discussed in this article to implement secondary editing of the created virtual object. Since the secondary creation process is similar to the virtual object creation process discussed above, for the purpose of brevity, the secondary editing process will not be repeated. In this way, the creation method discussed in the present disclosure can be applied to the entire life cycle of a virtual object.

[0081] Example Process

[0082] Figure 5 FIG. 5 is a flow chart showing an example interaction process 500 in a virtual scene according to some embodiments of the present disclosure. The process 500 may be implemented at the electronic device 110. Figure 1 The process 500 is described below.

[0083] In block 510 , the electronic device 110 receives a request to create a virtual object in a virtual scene.

[0084] In block 520 , the electronic device 110 divides the target space in the virtual scene into a plurality of subspaces based on the spatial distribution / segmentation information corresponding to the virtual object.

[0085] In block 530 , the electronic device fills corresponding voxel data in a group of subspaces among the plurality of subspaces based on the voxel configuration information corresponding to the plurality of subspaces, so as to create a virtual object in the virtual scene.

[0086] In some embodiments, the electronic device 110 may obtain an asset file corresponding to the virtual object; and determine the spatial segmentation information and the voxel configuration information based on the asset file.

[0087] In some embodiments, the asset file is created based on the following process: in an asset editing interface, creating a node graph, the node graph including a plurality of connected processing nodes, the node connection graph indicating a process of creating a virtual object; and creating an asset file corresponding to the virtual object based on the node graph.

[0088] In some embodiments, the plurality of processing nodes include a spatial processing node configured to output at least one subspace within a designated space.

[0089] In some embodiments, at least one subspace is determined based on a specified spatial distribution pattern.

[0090] In some embodiments, the plurality of processing nodes includes a voxel operation node configured to apply a corresponding voxel operation to a specified space.

[0091] In some embodiments, the voxel operation includes at least one of the following: a voxel filling operation for filling voxel data; a voxel erasing operation for erasing voxel data; an asset applying operation for applying another asset file corresponding to an additional virtual object to a specified space; a voxel merging operation for merging voxel data within multiple spaces; and a voxel rotation operation for rotating voxel data.

[0092] In some embodiments, the target space is determined based on a placement location of the virtual object in the virtual scene and a request to create the virtual object.

[0093] In some embodiments, the electronic device 110 may receive an edit request for the created virtual resource via an interactive interface; and present a second virtual resource generated based on the edit request in the interactive interface.

[0094] In some embodiments, the edit request includes at least one of: updating a portion of the virtual object; or adding a new portion to the virtual object.

[0095] Example Devices and Equipment

[0096] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 6 A schematic structural block diagram of an example apparatus 600 used in a virtual scene according to some embodiments of the present disclosure is shown. The apparatus 600 may be implemented as or included in the electronic device 110. Each module / component in the apparatus 600 may be implemented by hardware, software, firmware, or any combination thereof.

[0097] like Figure 6 As shown, the device 600 includes a request receiving module 610, which is configured to receive a request for creating a virtual object in a virtual scene; and a segmentation module 620, which is configured to divide the target space in the virtual scene into multiple subspaces based on spatial distribution / segmentation information corresponding to the virtual object; and a filling module 630, which is configured to fill a group of subspaces in the multiple subspaces with corresponding voxel data based on voxel configuration information corresponding to the multiple subspaces to create a virtual object in the virtual scene.

[0098] In some embodiments, the device 600 further includes an asset file acquisition module configured to acquire an asset file corresponding to the virtual object; and an information determination module configured to determine the spatial segmentation information and the voxel configuration information based on the asset file.

[0099] In some embodiments, the asset file is created based on the following process: in an asset editing interface, creating a node graph, the node graph including a plurality of connected processing nodes, the node connection graph indicating a process of creating a virtual object; and creating an asset file corresponding to the virtual object based on the node graph.

[0100] In some embodiments, the plurality of processing nodes include a spatial processing node configured to output at least one subspace within a designated space.

[0101] In some embodiments, at least one subspace is determined based on a specified spatial distribution pattern.

[0102] In some embodiments, the plurality of processing nodes includes a voxel operation node configured to apply a corresponding voxel operation to a specified space.

[0103] In some embodiments, the voxel operation includes at least one of the following: a voxel filling operation for filling voxel data; a voxel erasing operation for erasing voxel data; an asset applying operation for applying another asset file corresponding to an additional virtual object to a specified space; a voxel merging operation for merging voxel data within multiple spaces; and a voxel rotation operation for rotating voxel data.

[0104] In some embodiments, the target space is determined based on a placement location of the virtual object in the virtual scene and a request to create the virtual object.

[0105] In some embodiments, the device 600 also includes an editing request receiving module, configured to receive an editing request for the created virtual resource via an interactive interface; and a second virtual resource generating module, configured to present a second virtual resource generated based on the editing request in the interactive interface.

[0106] In some embodiments, the edit request includes at least one of: updating a portion of the virtual object; or adding a new portion to the virtual object.

[0107] like Figure 7 As shown, the electronic device 700 is in the form of a general electronic device. The components of the electronic device 700 may include, but are not limited to, one or more processors or processing units 710, a memory 720, a storage device 730, one or more communication units 740, one or more input devices 770, and one or more output devices 760. The processing unit 710 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 720. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 700.

[0108] The electronic device 700 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 720 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 730 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 700.

[0109] The electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 7 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 720 may include a computer program product 725 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0110] The communication unit 740 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 700 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 700 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0111] The input device 770 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 760 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 700 may also communicate with one or more external devices (not shown) through the communication unit 740 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 700, or communicate with any device that allows the electronic device 700 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0112] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0113] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0114] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0115] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0116] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0117] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. An interactive method in a virtual scene, comprising: receiving a request to create a virtual object in a virtual scene; as well as Dividing a target space in the virtual scene into a plurality of subspaces based on spatial distribution / segmentation information corresponding to the virtual object; as well as Based on the voxel configuration information corresponding to the multiple subspaces, a group of subspaces among the multiple subspaces is filled with corresponding voxel data to create the virtual object in the virtual scene.

2. The method according to claim 1, further comprising: Obtaining an asset file corresponding to the virtual object; as well as Based on the asset file, the spatial segmentation information and the voxel configuration information are determined.

3. The method of claim 2, wherein the asset file is created based on the following process: In an asset editing interface, creating a node graph, the node graph comprising a plurality of connected processing nodes, the node connection graph indicating a process of creating the virtual object; and Based on the node graph, the asset file corresponding to the virtual object is created. 4 . The method of claim 3 , wherein the plurality of processing nodes comprises a spatial processing node configured to output at least one subspace in a designated space. The method according to claim 4 , wherein the at least one subspace is determined based on a specified spatial distribution pattern. 6 . The method of claim 3 , wherein the plurality of processing nodes include voxel operation nodes configured to apply corresponding voxel operations to a specified space.

7. The method of claim 6, wherein the voxel operation comprises at least one of: Voxel filling operation, used to fill voxel data; A voxel erase operation, used to erase voxel data; An asset application operation for applying another asset file corresponding to the additional virtual object to the specified space; Voxel merging operation, used to merge voxel data in multiple spaces; Voxel rotation operation, used to rotate voxel data. 8 . The method of claim 1 , wherein the target space is determined based on a placement position of the virtual object in the virtual scene and the request to create the virtual object.

9. The method according to claim 1, further comprising: Receiving, via the interactive interface, an editing request for the created virtual resource; as well as A second virtual resource generated based on the editing request is presented in the interactive interface.

10. The method of claim 9, wherein the edit request comprises at least one of the following: updating a portion of the virtual object; or Adding new parts to the virtual object.

11. An interactive device in a virtual scene, comprising: A request receiving module, configured to receive a request to create a virtual object in a virtual scene; as well as a segmentation module configured to divide the target space in the virtual scene into a plurality of subspaces based on the spatial distribution / segmentation information corresponding to the virtual object; as well as The filling module is configured to fill corresponding voxel data in a group of subspaces among the multiple subspaces based on voxel configuration information corresponding to the multiple subspaces, so as to create the virtual object in the virtual scene.

12. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform a method according to one of claims 1 to 10.

13. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 10.

Images