Method for operating component, electronic device, storage medium and program product

By providing the function of users to draw patterns and generate three-dimensional models in the metaverse space, the problem of limited user interaction is solved and the fun and interactive nature of the metaverse space is improved.

CN116778114BActive Publication Date: 2025-02-11BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210225795.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-07
Publication Date
2025-02-11
Estimated Expiration
2042-03-07

Smart Images

  • Figure CN116778114B_ABST
    Figure CN116778114B_ABST
Patent Text Reader

Abstract

The method, electronic device, storage medium and program product for operating components provided by the present disclosure relate to the fields of artificial intelligence technology such as computer vision, image processing technology and augmented reality technology, including: in response to the drawing operation of the operable component in the three-dimensional virtual space, the drawn two-dimensional pattern is displayed in the operable component; in response to the model generation operation of the operable component, the two-dimensional pattern is processed to generate a three-dimensional model; and the three-dimensional model is displayed in the three-dimensional virtual space. In the scheme provided by the present disclosure, an operable component that can be applied in the virtual space is provided, and the user can draw a pattern in the operable component so that the system can generate a three-dimensional model corresponding to the pattern. This method allows the user to add a model in the virtual space through his own operation, thereby providing a richer interaction method between the user and the virtual space.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, in particular to the field of computer vision, image processing technology and augmented reality technology, and in particular to a method for operating a component, an electronic device, a storage medium and a program product. Background Art

[0002] At present, the Metaverse is a collection of virtual time and space, which is linked and created by scientific and technological means. It is a virtual world that maps and interacts with the real world and has a digital living space with a new social system. People can hold meetings, watch performances, socialize, play games, etc. in the Metaverse.

[0003] The content of the Metaverse is created using professional 3D modeling software. For example, the tables and cars in the Metaverse are all created in advance by developers using 3D modeling software. Users can use the existing content in the Metaverse.

[0004] However, in this way, users can only use the existing content in the metaverse space and cannot interact more richly with the content in the metaverse space, resulting in poor interest. Summary of the invention

[0005] The present disclosure provides a method for operating components, an electronic device, a storage medium, and a program product, which can provide richer solutions for interacting with the metaverse space, thereby increasing the fun.

[0006] According to a first aspect of the present disclosure, there is provided a method for operating a component, comprising:

[0007] In response to a drawing operation on an operable component in a three-dimensional virtual space, displaying a drawn two-dimensional pattern on the operable component;

[0008] In response to a model generation operation on the operable component, processing the two-dimensional pattern to generate a three-dimensional model;

[0009] The three-dimensional model is displayed in the three-dimensional virtual space.

[0010] According to a second aspect of the present disclosure, a method for operating a component is provided, comprising:

[0011] In response to a second control instruction for an operable component in the three-dimensional virtual space, controlling a preset surface of the operable component to be displayed in a mirror style;

[0012] Determining a mirror image corresponding to the three-dimensional virtual character according to a relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space;

[0013] A mirror image of the three-dimensional virtual character is displayed on the preset surface.

[0014] According to a third aspect of the present disclosure, there is provided a device for operating a component, comprising:

[0015] A drawing unit, for responding to a drawing operation on an operable component in a three-dimensional virtual space, and displaying a drawn two-dimensional pattern on the operable component;

[0016] A model generation unit, configured to process the two-dimensional pattern to generate a three-dimensional model in response to a model generation operation on the operable component;

[0017] A model display unit is used to display the three-dimensional model in the three-dimensional virtual space.

[0018] According to a fourth aspect of the present disclosure, there is provided a device for operating a component, comprising:

[0019] A second control unit, configured to respond to a second control instruction for an operable component in the three-dimensional virtual space, and control a preset surface of the operable component to be displayed in a mirror style;

[0020] The mirror unit is used to determine the mirror image corresponding to the three-dimensional virtual character according to the relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space, and display the mirror image of the three-dimensional virtual character on the preset surface.

[0021] According to a fifth aspect of the present disclosure, there is provided an electronic device, including:

[0022] at least one processor; and

[0023] a memory communicatively connected to the at least one processor; wherein,

[0024] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to the first aspect or the second aspect.

[0025] According to a sixth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method as described in the first aspect or the second aspect.

[0026] According to the seventh aspect of the present disclosure, a computer program product is provided, comprising: a computer program, wherein the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the electronic device performs the method as described in the first aspect or the second aspect.

[0027] The method, electronic device, storage medium and program product for operating components provided by the present disclosure include: in response to a drawing operation on an operable component in a three-dimensional virtual space, displaying a drawn two-dimensional pattern on the operable component; in response to a model generation operation on the operable component, processing the two-dimensional pattern to generate a three-dimensional model; and displaying the three-dimensional model in a three-dimensional virtual space. In the scheme provided by the present disclosure, an operable component that can be applied in a virtual space is provided, and a user can draw a pattern in the operable component so that the system can generate a three-dimensional model corresponding to the pattern. This method allows the user to add a model in the virtual space through his own operation, thereby providing a richer interaction method between the user and the virtual space.

[0028] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0030] Figure 1 A flowchart of a method for operating a component according to a first exemplary embodiment of the present disclosure is shown;

[0031] Figure 2 A schematic diagram of a virtual space shown as an exemplary embodiment of the present disclosure;

[0032] Figure 3 A schematic flow chart of a method for operating a component according to a second exemplary embodiment of the present disclosure;

[0033] Figure 4 A schematic flow chart of a method for operating a component according to a third exemplary embodiment of the present disclosure;

[0034] Figure 5 A schematic diagram of operational components showing an exemplary embodiment of the present disclosure;

[0035] Figure 6 A schematic flow chart of a method for operating a component according to a fourth exemplary embodiment of the present disclosure;

[0036] Figure 7 A schematic structural diagram of a device for operating a component according to a first exemplary embodiment of the present disclosure;

[0037] Figure 8 A schematic structural diagram of a device for operating a component according to a second exemplary embodiment of the present disclosure;

[0038] Fig. 9 This is a schematic structural diagram of a device for operating a component according to a third exemplary embodiment of the present disclosure;

[0039] Fig.10 A schematic structural diagram of a device for operating a component according to a fourth exemplary embodiment of the present disclosure;

[0040] Fig.11 The block diagram is a block diagram of an electronic device for implementing the method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0041] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0042] Virtual spaces can be created through technological means, such as the Metaverse. In the Metaverse, three-dimensional virtual characters can be created to represent users, and these three-dimensional virtual characters can move around in the Metaverse. Researchers can set up many virtual objects in the Metaverse, and the three-dimensional virtual characters can use these objects under the control of the user. For example, there can be tables, chairs, and cars, and the three-dimensional virtual characters can sit on the chairs and drive virtual cars.

[0043] However, these three-dimensional virtual characters can only use these virtual objects and cannot interact more richly with the metaverse, resulting in less fun for users to interact with the metaverse.

[0044] In order to solve the above technical problems, the present disclosure provides an operable component that can be applied to a three-dimensional virtual space. The operable component can be used as a drawing board, where users can draw patterns, and the system of the metaverse can convert the two-dimensional pattern into a three-dimensional model, so that users can participate in the creation process of the metaverse and add virtual objects in the three-dimensional virtual space. The operable component can also be used as a mirror to reflect the image of a three-dimensional virtual character. The user can also operate the operable component to personalize the two-dimensional virtual image in the mirror to increase the fun.

[0045] Figure 1 The present invention is a flowchart of a method for operating a component according to a first exemplary embodiment of the present invention.

[0046] like Figure 1 As shown, the method for operating a component provided by the present disclosure includes:

[0047] Step 101 , in response to a drawing operation on an operable component in a three-dimensional virtual space, a drawn two-dimensional pattern is displayed on the operable component.

[0048] The components provided in the present disclosure are operable components that can be set in a metaverse or other virtual space. The methods provided in the present disclosure can be executed by a system in a metaverse or virtual space, and the system can be installed in a computer.

[0049] In an optional implementation, the operable components may be packaged as an SDK package (Software Development Kit), and researchers who develop the virtual space may use the SDK package to add the operable components to the virtual space.

[0050] For example, the operable component may be set on a roadside in a virtual space, and the R&D personnel may add the operable component according to the location of the roadside.

[0051] Specifically, after the operable component is added to the virtual space, the operable component can be displayed when the user operates the user terminal to display the virtual space. The user can also operate the three-dimensional virtual character to use the operable component.

[0052] In the disclosed embodiment, the operable component can be used as a drawing board, and the user can operate the three-dimensional virtual character to draw a two-dimensional pattern on the operable component. In an optional implementation scheme, the operable component can also be used as a mirror, and the user can operate the three-dimensional virtual character to stand in front of the mirror, so that the operable component displays a mirror image of the three-dimensional virtual character.

[0053] The operable components displayed in the three-dimensional virtual space include at least one plane or curved surface, and the three-dimensional virtual character can stand in front of the plane or curved surface to perform drawing operations on the plane or curved surface in the operable components.

[0054] In an optional implementation, the operable component may be in the form of a flat plate having an operable plane or an operable curved surface.

[0055] In an optional implementation, the operable component may include multiple planes or curved surfaces, or may include both planes and curved surfaces. When a user operates any of the planes or curved surfaces, the operated plane or curved surface may be locked. After the plane or curved surface is locked, other users cannot operate the plane or curved surface. This method can prevent other users from operating the plane or curved surface, resulting in the destruction of the content previously drawn by the user.

[0056] Specifically, the operable component may have an operable keyboard, for example, a keyboard may be provided next to the operable component, and the user may operate the keyboard to start the drawing board function of the operable component. If the operable component includes multiple planes or curved surfaces, each surface may have an operable keyboard.

[0057] Furthermore, after starting the drawing board function of the operable component, the user can control the three-dimensional virtual character to perform drawing operations on the operable component, and the system of the virtual space can display the drawn two-dimensional pattern based on the drawing operation of the three-dimensional virtual character. For example, the movement trajectory of the hand or the brush held by the three-dimensional virtual character can be obtained, and then the drawn two-dimensional pattern can be generated according to the movement trajectory and displayed on the operable component. Specifically, it is displayed on the plane or curved surface used as the drawing board in the operable component.

[0058] Step 102, in response to a model generation operation on an operable component, the two-dimensional pattern is processed to generate a three-dimensional model.

[0059] In actual application, after the user operates the three-dimensional virtual character to draw a two-dimensional pattern, he can also operate the operable components to enable the metaverse system to generate a three-dimensional model based on the two-dimensional pattern drawn by the user.

[0060] Among them, buttons for operating operable components can be set. For example, a "Done" button can be displayed on the plane or curved surface of the operable component. The user can control the three-dimensional virtual character to click the done button, thereby enabling the system to convert the two-dimensional pattern on the plane or curved surface into a three-dimensional model.

[0061] Specifically, the technical capabilities of the corresponding three-dimensional model can be determined based on the content of the two-dimensional image. Generating a three-dimensional virtual image based on a single image (PTA, Photo To Avatar) is generally divided into two types: reconstruction type and classification type. The reconstruction type relies on 3DMM or deep neural network to perceive the information in a single image and reconstruct the pattern, and construct a virtual image based on the reconstructed pattern; the classification type directly perceives the type of each part of the pattern in a single image, selects the corresponding type from the existing type library and pieces it together into a virtual image. A virtual image generated by PTA often corresponds to a set of parameters, which are used for the bid virtual image.

[0062] Step 103: display the generated three-dimensional model in the three-dimensional virtual space.

[0063] Furthermore, after the three-dimensional model is generated, the three-dimensional model can be displayed in the three-dimensional virtual space, so that the user can add the model in the virtual space through his own operation, which can provide a richer interaction method between the user and the virtual space.

[0064] In actual application, the user can also control the 3D virtual character to operate the generated 3D model. For example, the user can control the 3D virtual character to touch the 3D model, or grab the 3D model to make it move with the 3D virtual character.

[0065] The three-dimensional model can also be fixed at any location as an ornament, such as being tied to the back of a virtual car.

[0066] In an optional implementation, the generated 3D model can be used as a pet of the 3D virtual character and move with the 3D virtual character. For example, the movement trajectory of the 3D virtual character can be obtained, and the 3D model generated by the 3D virtual character can be controlled to move according to the movement trajectory.

[0067] Figure 2 The figure is a schematic diagram of a virtual space according to an exemplary embodiment of the present disclosure.

[0068] like Figure 2 As shown, an operable component 21 is provided in the virtual space, in which the user can operate and draw a pattern 22. The system can convert the two-dimensional pattern 22 into a three-dimensional model 23, and the three-dimensional model 23 can also move.

[0069] The method for operating a component provided by the present disclosure includes: responding to a drawing operation on an operable component in a three-dimensional virtual space, displaying a drawn two-dimensional pattern on the operable component; responding to a model generation operation on the operable component, processing the two-dimensional pattern to generate a three-dimensional model; and displaying the three-dimensional model in the three-dimensional virtual space. In the scheme provided by the present disclosure, an operable component that can be applied in a virtual space is provided, and a user can draw a pattern in the operable component so that the system can generate a three-dimensional model corresponding to the pattern. This method allows the user to add a model in the virtual space through his own operation, thereby providing a richer interaction method between the user and the virtual space.

[0070] Figure 3 The present invention is a flowchart of a method for operating a component according to a second exemplary embodiment of the present invention.

[0071] like Figure 3 As shown, the method for operating a component provided by the present disclosure includes:

[0072] Step 301, in response to a preset instruction of a three-dimensional virtual character in a three-dimensional virtual space, a control keyboard for controlling operable components is displayed.

[0073] Among them, in the method provided by the present disclosure, the operable component can be displayed in a drawing board style or in a mirror style. When displayed in the drawing board style, the user can control the three-dimensional virtual character to draw a pattern in the operable component, and when displayed in the mirror style, the operable component can display a mirror image of the three-dimensional virtual character.

[0074] In this implementation, the operable component has a control keyboard. When the operable component is not operated, the control keyboard may not be displayed in the three-dimensional virtual space. The user can control the three-dimensional virtual character to walk near the operable component and control the three-dimensional virtual character to perform a preset action, thereby triggering the system to display the control keyboard of the operable component in the three-dimensional virtual space.

[0075] For example, when the three-dimensional virtual character raises his right hand, the system displays the control keyboard of the operable component in the three-dimensional virtual space; for another example, when the three-dimensional virtual character sits on a chair next to the operable component, the system displays the control keyboard of the operable component in the three-dimensional virtual space.

[0076] Specifically, the control keyboard can be displayed next to the operable component, or connected to the operable component, so that the three-dimensional virtual character can operate it. The control keyboard can be touch-sensitive or key-sensitive, and the present disclosure does not limit it.

[0077] Step 302, in response to a first operation of the three-dimensional virtual character on the control keyboard, a first control instruction is generated, and a preset surface of the operable component is controlled to be displayed in a drawing board style.

[0078] Furthermore, by operating the control keyboard, the function of the operable component can be selected, such as using it as a drawing board or as a mirror.

[0079] In actual application, when the user controls the three-dimensional virtual character to perform a first operation on the control keyboard, the system can generate a first control instruction for controlling the operable component in the three-dimensional virtual space.

[0080] For example, the control keyboard includes a first key with "drawing board" written on it and a second key with "mirror" written on it. If the three-dimensional virtual character touches the first key with "drawing board" written on it, the system can generate a first control instruction for controlling the operable component, and if the three-dimensional virtual character touches the second key with "mirror" written on it, the system can generate a second control instruction for controlling the operable component.

[0081] In this implementation, when the operable component is not operated, its control keyboard is not displayed, thereby making the visual effect in the three-dimensional virtual space better, and when the operable component can provide multiple functions, different functions of the operable component can be selected by operating the control keyboard.

[0082] Specifically, when the user performs a first operation on the operable component to send a first control instruction to the operable component, the preset surface on the operable component is displayed in a drawing board style. In this application scenario, the operated preset surface in the operable component is used as a drawing board.

[0083] Furthermore, the preset surface can be a plane or a curved surface.

[0084] Step 303, in response to the drawing operation on the preset surface of the drawing board style, the drawn two-dimensional pattern is displayed on the preset surface of the drawing board style.

[0085] Furthermore, after the preset surface of the operable component is displayed in a drawing board style, the user can control the three-dimensional virtual character to perform drawing operations on the preset surface.

[0086] As an optional implementation, a virtual brush may be set in the drawing board component, and the user may control the three-dimensional virtual character to pick up the brush and draw on the preset surface of the drawing board component.

[0087] In another optional implementation, the user may control the three-dimensional virtual character to draw on a preset surface of the operable component using fingers.

[0088] The user can also control the three-dimensional virtual character to select the color used for drawing. For example, a color palette can be displayed in the preset surface of the operable component, and the color used for drawing can be selected in the color palette.

[0089] Specifically, a two-dimensional pattern can be generated according to the trajectory generated by the drawing operation, and the pattern can be displayed in a preset surface of the drawing board style. For example, if the finger of the three-dimensional virtual character moves upward, a line is displayed in the preset surface according to the trajectory of the finger movement.

[0090] In this implementation, a solution for users to draw two-dimensional patterns in a three-dimensional virtual space can be provided, so that the system can convert the drawn two-dimensional patterns into three-dimensional models, thereby making the solution more interesting.

[0091] Step 304, in response to the model generation operation on the operable component, obtain a preset skeleton model.

[0092] Furthermore, after drawing the two-dimensional pattern, the user can also operate the three-dimensional virtual character to operate the operable component, so that the system generates a three-dimensional model corresponding to the two-dimensional pattern. A completion button can be set on the preset surface of the operable component, and the button can be clicked to trigger the system to generate a three-dimensional model corresponding to the two-dimensional pattern.

[0093] In actual application, after the operable components are operated to generate a model, the system can obtain a preset skeleton model.

[0094] In an optional implementation, the system may obtain a plurality of preset skeleton models, and the user may control the three-dimensional virtual character to select a skeleton model for generating a three-dimensional model.

[0095] In response to the model generation operation of the operable component, a plurality of default skeleton models can be displayed in the three-dimensional virtual space. The displayed default skeleton models can be in three-dimensional style or two-dimensional style.

[0096] Specifically, the user can control the three-dimensional virtual character to operate the default skeleton model, thereby selecting a preset skeleton model for generating a three-dimensional model.

[0097] For example, a movement operation can be performed on any of the default skeleton models, and the operated default skeleton model is the preset skeleton model. The preset skeleton model can be moved to the location of the two-dimensional pattern so that the preset skeleton model overlaps with the two-dimensional pattern.

[0098] In this way, a preset skeleton model for generating a three-dimensional model can be obtained based on the user's operation, thereby generating a three-dimensional model that meets the user's needs, allowing the user to participate in the creation process of the virtual image in the virtual space.

[0099] In another optional implementation, the system may also obtain a corresponding preset bone model according to the shape or type of the two-dimensional pattern.

[0100] Step 305: convert the two-dimensional pattern into a three-dimensional model, and determine the skin binding relationship between the preset skeleton model and the three-dimensional model.

[0101] The system can convert a two-dimensional pattern into a three-dimensional model, and specifically can generate the three-dimensional model based on a solution of the prior art.

[0102] The system can also determine the skin binding relationship between the preset skeletal model and the three-dimensional model. The preset skeletal model has a corresponding animation. By determining the skin binding relationship between the preset skeletal model and the three-dimensional model, the animation can be used to drive the preset skeletal model to perform actions corresponding to the animation, thereby driving the three-dimensional model to perform corresponding actions.

[0103] For example, the animation corresponding to the preset skeleton model is the tail of the skeleton swinging. When the tail of the skeleton swings, the position bound to the tail of the skeleton will also swing. In this way, the three-dimensional model can be made to move.

[0104] In the solution provided by the present disclosure, through the interaction between the user and the three-dimensional virtual space, not only can a three-dimensional model be added to the three-dimensional virtual space, but the three-dimensional model can also be made to move, thereby increasing the fun.

[0105] If the three-dimensional virtual character drags the preset skeleton model to the location of the two-dimensional pattern, the system can determine the skin binding relationship between the three-dimensional model and the skeleton based on the relative position between the three-dimensional model and the preset skeleton model.

[0106] The position of the three-dimensional model is consistent with the position of the two-dimensional pattern.

[0107] For example, based on the relative position between the three-dimensional model and the preset skeleton model, the adjusted boundary of the three-dimensional model can be aligned with the boundary of the preset skeleton model, and then the nodes in the preset skeleton model can be mapped to the three-dimensional model, thereby binding the corresponding relationship between the preset skeleton model and the three-dimensional model.

[0108] Specifically, when converting a two-dimensional pattern into a three-dimensional model, the boundaries of the simply connected regions of the two-dimensional pattern can be clipped, and then each connected region can be triangulated and texture mapped. Thereafter, based on the results of the triangulation and texture mapping, the two-dimensional pattern can be meshed into three-dimensional form to generate a three-dimensional model.

[0109] Furthermore, if a gridding process is performed when the three-dimensional model is generated, the adjusted boundary of the three-dimensional model can be aligned with the boundary of the preset skeleton model by means of grid alignment.

[0110] By binding the three-dimensional model with the preset skeleton model in this way, the three-dimensional model can move according to the posture of each node in the preset skeleton model, making it more interesting.

[0111] Step 306: display the three-dimensional model in the three-dimensional virtual space.

[0112] Step 306 and Figure 1 The process is similar to step 103 in the above process and will not be described in detail.

[0113] Step 307, using the animation data of the preset skeleton model, driving the three-dimensional model to perform actions corresponding to the animation data.

[0114] In actual application, the preset skeleton model has animation data, so the animation data of the preset skeleton model can also be used to drive the three-dimensional model to perform actions corresponding to the animation data. For example, in the animation data of the preset skeleton model, the skeleton head can swing left and right, and the three-dimensional model part bound to the head can also perform the swinging action left and right.

[0115] In this way, the 3D model can make movements according to the animation data of the preset skeleton model, making it more interesting.

[0116] In an optional embodiment of the present disclosure, the operable component may also have a mirror function. The user may control the three-dimensional virtual character to perform a second operation on the operable component, so that the system may generate a second control instruction, and when the system receives the second control instruction, it may be displayed in a mirror style.

[0117] The system can convert the three-dimensional virtual character into two-dimensional one, obtain the mirror image of the three-dimensional virtual character, and display the mirror image of the three-dimensional virtual character in a preset surface.

[0118] Specifically, in order to make the mirror image displayed in the operable component achieve the effect of looking in a real mirror, the mirror image corresponding to the three-dimensional virtual character can be determined according to the relative position of the three-dimensional virtual character and the preset surface in the three-dimensional virtual space. For example, a two-dimensional mirror image can be generated according to the distance between each part of the three-dimensional virtual character and the preset surface, so that the distance between each part of the mirror image and the mirror surface is the same as the distance between each part of the three-dimensional virtual character and the preset surface.

[0119] Figure 4 The present invention is a flowchart of a method for operating a component according to a third exemplary embodiment of the present invention.

[0120] like Figure 4 As shown, the method for operating a component provided by the present disclosure includes:

[0121] Step 401: In response to a second control instruction for an operable component in a three-dimensional virtual space, a preset surface of the operable component is controlled to be displayed in a mirror style.

[0122] The components provided in the present disclosure are operable components that can be set in a metaverse or other virtual space. The methods provided in the present disclosure can be executed by a system in a metaverse or virtual space, and the system can be installed in a computer.

[0123] In an optional implementation, the operable components may be packaged as an SDK package (Software Development Kit), and researchers who develop the virtual space may use the SDK package to add the operable components to the virtual space.

[0124] For example, the operable component may be set on a roadside in a virtual space, and the R&D personnel may add the operable component according to the location of the roadside.

[0125] Specifically, after the operable component is added to the virtual space, the operable component can be displayed when the user operates the user terminal to display the virtual space. The user can also operate the three-dimensional virtual character to use the operable component.

[0126] In the disclosed embodiment, the operable component can also be used as a mirror, and the user can manipulate the three-dimensional virtual character to stand in front of the mirror, so that the operable component displays the mirror image of the three-dimensional virtual character. In an optional implementation, the operable component can be used as a drawing board, and the user can manipulate the three-dimensional virtual character to draw a two-dimensional pattern on the operable component.

[0127] The operable components displayed in the three-dimensional virtual space include at least one plane or curved surface, and the three-dimensional virtual character can stand in front of the plane or curved surface to perform drawing operations on the plane or curved surface in the operable components.

[0128] In an optional implementation, the operable component may include multiple planes or curved surfaces. When a user operates any of the planes or curved surfaces, the operated plane or curved surface can be locked. After the plane or curved surface is locked, other users cannot operate the plane or curved surface. This method can prevent multiple users from operating the same plane or curved surface at the same time.

[0129] Specifically, the operable component may have an operable keyboard, for example, a keyboard may be provided next to the operable component, and the user may operate the keyboard to start the drawing board function of the operable component. If the operable component includes multiple planes or curved surfaces, each plane or curved surface may have an operable keyboard.

[0130] In an optional implementation, the operable component may be in the form of a flat plate having an operable flat surface or curved surface.

[0131] Furthermore, after activating the mirror function of the operable component, the user can control the three-dimensional virtual character to perform various actions in front of the mirror, and the operable component can display the mirror image of the three-dimensional virtual character.

[0132] Step 402: determining a mirror image corresponding to the three-dimensional virtual character according to the relative position of the three-dimensional virtual character and the preset surface in the three-dimensional virtual space.

[0133] In actual application, the operable component can convert the three-dimensional virtual character into a two-dimensional mirror image according to the relative position of the three-dimensional virtual character and the preset surface.

[0134] Among them, the 3D model can be rendered into a cartoon 2D style rendering image through textures and rendering shaders. In one way, all the light and dark transitions and model details in 2D rendering can be expressed only by adjusting the textures; the other is to use the 2D rendering shader and adjust the model texture with the shader to obtain a better 2D rendering result.

[0135] Specifically, in order to make the mirror function of the operable component more realistic, the solution provided by the present disclosure can determine the mirror image corresponding to the three-dimensional virtual character based on the relative position of the three-dimensional virtual character and the preset surface.

[0136] Furthermore, the relative position includes distance and angle.

[0137] Step 403: display a mirror image of the three-dimensional virtual character on a preset surface.

[0138] In actual application, a certain mirror image can also be displayed on the preset surface of the operable component, thereby achieving the effect of a three-dimensional virtual character looking in the mirror.

[0139] If the three-dimensional virtual character changes its posture, the operable component can re-determine the mirror image according to the current posture of the three-dimensional virtual character and its relative position to the preset surface, and then display the mirror image on the preset surface.

[0140] Figure 5 A schematic diagram of operational components showing an exemplary embodiment of the present disclosure.

[0141] like Figure 5 As shown, the three-dimensional virtual character 51 stands in front of the operable component 52. If the operable component 52 turns on the mirror function, a mirror image as shown in 53 can be displayed.

[0142] The method for operating a component provided by the present disclosure includes: responding to a second control instruction of an operable component in a three-dimensional virtual space, controlling a preset surface of the operable component to be displayed in a mirror style; determining a mirror image corresponding to the three-dimensional virtual character according to the relative position of the three-dimensional virtual character and the preset surface in the three-dimensional virtual space; and displaying the mirror image of the three-dimensional virtual character on the preset surface. In the method provided by the present disclosure, the mirror function of the operable component can be activated by the user's operation on the operable component, so that the mirror image of the three-dimensional virtual character is displayed. This solution can provide a new type of interaction solution between the user and the virtual space, thereby improving the fun.

[0143] Figure 6 The present invention is a flowchart of a method for operating a component according to a fourth exemplary embodiment of the present invention.

[0144] like Figure 6As shown, the method for operating a component provided by the present disclosure includes:

[0145] Step 601, in response to a preset instruction of a three-dimensional virtual character in a three-dimensional virtual space, a control keyboard for controlling operable components is displayed.

[0146] Among them, in the method provided by the present disclosure, the operable component can be displayed in a mirror style or in a drawing board style. When displayed in a mirror style, the operable component can display a mirror image of a three-dimensional virtual character, and when displayed in a drawing board style, the user can control the three-dimensional virtual character to draw a pattern in the operable component.

[0147] In this implementation, the operable component has a control keyboard. When the operable component is not operated, the control keyboard may not be displayed in the three-dimensional virtual space. The user can control the three-dimensional virtual character to walk near the operable component and control the three-dimensional virtual character to perform a preset action, thereby triggering the system to display the control keyboard of the operable component in the three-dimensional virtual space.

[0148] For example, when the three-dimensional virtual character raises his right hand, the system displays the control keyboard of the operable component in the three-dimensional virtual space; for another example, when the three-dimensional virtual character sits on a chair next to the operable component, the system displays the control keyboard of the operable component in the three-dimensional virtual space.

[0149] Specifically, the control keyboard can be displayed next to the operable component, or connected to the operable component, so that the three-dimensional virtual character can operate it. The control keyboard can be touch-sensitive or key-sensitive, and the present disclosure does not limit it.

[0150] Step 602, in response to the second operation of the three-dimensional virtual character on the control keyboard, generate a second control instruction, and control the preset surface of the operable component to be displayed in a mirror style according to the second control instruction.

[0151] Furthermore, by operating the control keyboard, the function of the operable component can be selected, such as using it as a mirror or as a drawing board.

[0152] In actual application, when the user controls the three-dimensional virtual character to perform the second operation on the control keyboard, the system can generate a second control instruction for controlling the operable component in the three-dimensional virtual space.

[0153] For example, the control keyboard includes a first key with "drawing board" and a second key with "mirror". If the three-dimensional virtual character touches the first key with "drawing board", the system can generate a first control instruction for controlling the operable component, and if the three-dimensional virtual character touches the second key with "mirror", the system can obtain a second control instruction for controlling the operable component.

[0154] Specifically, when the user operates the operable component and sends the second control instruction to it, the preset surface on the operable component is displayed in a mirror style. In this application scenario, the operated preset surface in the operable component is used as a mirror.

[0155] Step 603: In response to the second operation of the three-dimensional virtual character on the control keyboard, a key for controlling the mirror image is displayed in the control keyboard.

[0156] Furthermore, in the method provided by the present invention, multiple operations can be performed on the mirror image displayed on the preset surface. In order to reduce the number of operations performed by the user, in the solution provided by the present invention, when the user performs a second operation on the control keyboard, keys for controlling the mirror image can also be displayed on the control keyboard.

[0157] In actual application, a plurality of buttons for controlling the mirror image may be displayed in the control keyboard, and each button corresponds to a different control method of the mirror image, such as changing the style or changing the clothes.

[0158] There is no restriction on the execution order of step 602 and step 603.

[0159] Step 604: Determine a mirror image corresponding to the three-dimensional virtual character according to the relative position of the three-dimensional virtual character and the preset surface in the three-dimensional virtual space.

[0160] Step 605: Display the mirror image of the three-dimensional virtual character on the preset surface.

[0161] Steps 604-605 and Figure 5 The corresponding contents shown are similar and will not be repeated here.

[0162] Step 606, in response to the operation of the key in the control keyboard, the mirror image in the operable component is processed.

[0163] Among them, after the mirror image of the three-dimensional virtual image is displayed on the preset surface of the operable component, the user can also control the three-dimensional virtual image to operate the keys in the control keyboard, so that the component processes the mirror image according to the processing method corresponding to the key.

[0164] The solution provided by the present disclosure can provide multiple ways of processing mirror images to enhance the interaction between users and virtual space and increase the fun.

[0165] Specifically, the buttons include a first button for adjusting the appearance style. If the user controls the three-dimensional virtual image to operate the first button, the system can adjust the appearance style of the mirror image displayed on the preset surface.

[0166] Furthermore, after the first button is operated, a plurality of appearance styles may be displayed in the operable component, and the user may select any one of the styles, and the system may adjust the mirror image displayed in the preset surface to the selected appearance style.

[0167] In actual application, multiple appearance styles can be pre-set. Each time the first button is operated in sequence, the foreign trade style of the mirror image can be updated once. The preset appearance styles can be used to update the foreign trade style of the mirror image one by one.

[0168] Among them, the buttons displayed in the control keyboard can also include a second button for recording video. The user can control the three-dimensional virtual image to operate the second button, so that the system plays the preset audio and stores the mirror image displayed in the preset surface.

[0169] In an optional real-time mode, after the second button is operated, a music list can also be displayed in the operable component, and the user can control the three-dimensional virtual image to select any music from it, and the system can play the audio of the selected music.

[0170] Specifically, the user can control the three-dimensional virtual image to perform actions in front of the mirror, and the system can store the mirror image of the three-dimensional virtual image in the preset surface, thereby realizing the recording of the picture.

[0171] Furthermore, when recording a video, if the user operates the three-dimensional virtual image to operate the second button in the control keyboard again, the recording can be stopped and a video file including audio and multiple frames of mirror images can be generated.

[0172] In actual application, the stored file includes the mirror image of multiple consecutive frames of the three-dimensional virtual image and the played audio. When the file is played, the stored audio and the recorded mirror image can be played simultaneously.

[0173] Among them, the buttons in the control keyboard also include a third button for changing the clothes in the mirror image. The user can control the three-dimensional virtual image to operate the third button. The system obtains the character clothing from the clothing library and displays the mirror image of the three-dimensional virtual character wearing the character clothing in the operable component.

[0174] Specifically, the obtained character clothing may be used to replace the clothing in the mirror image by rendering.

[0175] Furthermore, after the user controls the three-dimensional virtual image to operate the third button, the system can also display multiple sets of character costumes in the operable component, and can select any set of character costumes from them, and use the selected character costume to replace the clothes in the mirror image.

[0176] In actual application, multiple sets of character costumes can be displayed in the operable component;

[0177] When the user selects a displayed character costume, the system may respond to a selection instruction for the character costume to determine a target character costume;

[0178] A mirror image of a three-dimensional virtual character wearing the target character's clothing is displayed in the operable component.

[0179] In an optional implementation of the present disclosure, the operable component may also have a drawing board function.

[0180] The system may respond to a first control instruction to an operable component in the three-dimensional virtual space and control a preset surface of the operable component to be displayed in a drawing board style;

[0181] Determining a mirror image corresponding to the three-dimensional virtual character according to a relative position of the three-dimensional virtual character and the preset surface in the three-dimensional virtual space;

[0182] In response to a drawing operation on the operable component, a drawn two-dimensional pattern is displayed on the operable component;

[0183] In response to a model generation operation on the operable component, the two-dimensional pattern is processed to generate a three-dimensional model.

[0184] The implementation scheme of using the operable component as a canvas, Figure 1-Figure 3 The embodiments described in any one of the items are similar and will not be described in detail.

[0185] Figure 7 It is a schematic structural diagram of an apparatus for operating a component according to the first exemplary embodiment of the present disclosure.

[0186] The device 700 for operating a component provided by the present disclosure includes:

[0187] A drawing unit 710, for responding to a drawing operation on an operable component in a three-dimensional virtual space, and displaying a drawn two-dimensional pattern on the operable component;

[0188] A model generation unit 720, configured to process the two-dimensional pattern to generate a three-dimensional model in response to a model generation operation on the operable component;

[0189] The model display unit 730 is used to display the three-dimensional model in the three-dimensional virtual space.

[0190] In the device for operating components provided by the present disclosure, an operable component that can be used in a virtual space is provided, and a user can draw a pattern in the operable component so that the system can generate a three-dimensional model corresponding to the pattern. This method allows the user to add models in the virtual space through his own operations, thereby providing a richer interaction method between the user and the virtual space.

[0191] Figure 8 It is a schematic structural diagram of an apparatus for operating a component according to a second exemplary embodiment of the present disclosure.

[0192] In the device 800 for operating a component provided by the present disclosure, the drawing unit 810 and Figure 7 Similar to the drawing unit 710 shown in FIG. Figure 7 Similar to the model generation unit 720 shown in FIG. Figure 7 The model shown shows that unit 730 is similar.

[0193] The device provided by the present disclosure further includes a first control unit 840, which is used for, before the drawing unit 810 responds to a drawing operation on an operable component in the three-dimensional virtual space:

[0194] In response to a first control instruction for the operable component in the three-dimensional virtual space, controlling a preset surface of the operable component to be displayed in a drawing board style;

[0195] The drawing unit 810 is specifically used for:

[0196] In response to a drawing operation on the preset surface of the drawing board style, a drawn two-dimensional pattern is displayed on the preset surface of the drawing board style.

[0197] The device further includes a keyboard display unit 850, which is used for, before the first control unit 840 responds to the first control instruction of the operable component in the three-dimensional virtual space and controls the preset surface of the operable component to be displayed in a drawing board style:

[0198] In response to a preset instruction of the three-dimensional virtual character in the three-dimensional virtual space, displaying a control keyboard for controlling the operable component;

[0199] The first control unit 840 is specifically used for:

[0200] In response to the first operation of the three-dimensional virtual character on the control keyboard, the first control instruction is generated, and the preset surface of the operable component is controlled to be displayed in a drawing board style according to the first control instruction.

[0201] Wherein, the model generation unit 820 includes:

[0202] An acquisition module 821, configured to acquire a preset skeleton model in response to a model generation operation on the operable component;

[0203] The binding module 822 is used to convert the two-dimensional pattern into a three-dimensional model and determine the skin binding relationship between the preset skeleton model and the three-dimensional model.

[0204] The acquisition module 821 is specifically used for:

[0205] In response to a model generation operation on the operable component, displaying a plurality of default skeleton models in the three-dimensional virtual space;

[0206] In response to a movement operation of the three-dimensional virtual character on any one of the default skeleton models, the operated skeleton model is moved to the position where the two-dimensional pattern is located, wherein the operated skeleton model is the preset skeleton model.

[0207] The binding module 822 is specifically used for:

[0208] A skin binding relationship between the three-dimensional model and the preset skeleton model is determined according to a relative position between the three-dimensional model and the preset skeleton model.

[0209] Wherein, the preset skeleton model has animation data;

[0210] The device further comprises a driving unit 860, which is used to:

[0211] The animation data of the preset skeleton model is used to drive the three-dimensional model to perform actions corresponding to the animation data.

[0212] The device also includes:

[0213] A second control unit 870 is used to control a preset surface of the operable component to be displayed as a mirror in response to a second control instruction to the operable component in the three-dimensional virtual space;

[0214] The mirror unit 880 is used to determine the mirror image corresponding to the three-dimensional virtual character according to the relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space, and display the mirror image of the three-dimensional virtual character on the preset surface.

[0215] Fig. 9 It is a schematic structural diagram of an apparatus for operating a component according to a third exemplary embodiment of the present disclosure.

[0216] like Fig. 9 As shown, the device 900 for operating a component provided by the present disclosure includes:

[0217] The second control unit 910 is used to respond to a second control instruction to the operable component in the three-dimensional virtual space, and control the preset surface of the operable component to be displayed in a mirror style;

[0218] The mirror unit 920 is used to determine the mirror image corresponding to the three-dimensional virtual character according to the relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space, and display the mirror image of the three-dimensional virtual character on the preset surface.

[0219] Fig.10 It is a schematic structural diagram of an apparatus for operating a component according to a fourth exemplary embodiment of the present disclosure.

[0220] Fig.10 The second control unit 1010 in Fig. 9 Similar to the second control unit 910 shown, the mirror unit 1020 is Fig. 9 Similar to the 920 shown.

[0221] The device further includes a keyboard display unit 1030, which is used before the second control unit 1010 responds to a second control instruction for an operable component in the three-dimensional virtual space and controls the preset surface of the operable component to be displayed in a mirror style:

[0222] In response to a preset instruction of the three-dimensional virtual character in the three-dimensional virtual space, displaying a control keyboard for controlling the operable component;

[0223] The second control unit 1010 is specifically used for:

[0224] In response to the second operation of the three-dimensional virtual character on the control keyboard, the second control instruction is generated, and the preset surface of the operable component is controlled to be displayed in a mirror style according to the second control instruction.

[0225] Optionally, the keyboard display unit 1030 is further used for:

[0226] In response to a second operation of the three-dimensional virtual character on the control keyboard, displaying a key for controlling the mirror image in the control keyboard;

[0227] The device further comprises a processing unit 1040 for processing the mirror image in the operable component in response to an operation on the key in the control keyboard.

[0228] The button includes a first button for adjusting the appearance style, and the processing unit 1040 includes a first processing module 1041 for:

[0229] In response to an operation on the first key in the control keyboard, an appearance style of the mirror image displayed on the preset surface is adjusted.

[0230] The button includes a second button for recording a video, and the processing unit 1040 includes a second processing module 1042 for:

[0231] In response to an operation on the second key in the control keyboard, playing a preset audio, and storing the mirror image displayed on the preset surface;

[0232] When recording a video, in response to an operation on the second key in the control keyboard, a video file including the audio and a plurality of frames of the mirror image is generated.

[0233] The buttons include a third button for changing the clothing in the mirror image, and the processing unit 1040 includes a third processing module 1043 for:

[0234] In response to the user operating the third button in the control keyboard, acquiring a character costume from a costume library;

[0235] A mirror image of a three-dimensional virtual character wearing the character costume is displayed in the operable component.

[0236] The third processing module 1043 is specifically used for:

[0237] Displaying a plurality of sets of the character costumes in the operable components;

[0238] In response to a selection instruction for selecting among the character costumes, determining a target character costume;

[0239] A mirror image of a three-dimensional virtual character wearing the target character's clothing is displayed in the operable component.

[0240] The device further comprises:

[0241] A first control unit 1050 is used to respond to a first control instruction to the operable component in the three-dimensional virtual space, and control a preset surface of the operable component to be displayed in a drawing board style;

[0242] A drawing unit 1060, configured to respond to a drawing operation on the operable component and display a drawn two-dimensional pattern on the operable component;

[0243] The model generating unit 1070 is used to process the two-dimensional pattern to generate a three-dimensional model in response to the model generating operation on the operable component.

[0244] The present disclosure provides a method for operating a component, an electronic device, a storage medium, and a program product, which are applied to the field of artificial intelligence technology, especially to the field of computer vision, image processing technology, and augmented reality technology, and can provide richer solutions for interacting with the metaverse space, thereby increasing interest.

[0245] It should be noted that the mirror image in this embodiment is not an image of a specific user and cannot reflect the personal information of a specific user.

[0246] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0247] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0248] According to an embodiment of the present disclosure, the present disclosure also provides a computer program product, which includes: a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the solution provided by any of the above embodiments.

[0249] Fig.11 A schematic block diagram of an example electronic device 1100 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0250] like Fig.11 As shown, the device 1100 includes a computing unit 1101, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1102 or a computer program loaded from a storage unit 1108 into a random access memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the device 1100 can also be stored. The computing unit 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0251] A number of components in the device 1100 are connected to the I / O interface 1105, including: an input unit 1106, such as a keyboard, a mouse, etc.; an output unit 1107, such as various types of displays, speakers, etc.; a storage unit 1108, such as a disk, an optical disk, etc.; and a communication unit 1109, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1109 allows the device 1100 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0252] The computing unit 1101 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1101 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1101 performs the various methods and processes described above, such as methods for operating components. For example, in some embodiments, the method for operating a component may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1108. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1100 via the ROM 1102 and / or the communication unit 1109. When the computer program is loaded into the RAM 1103 and executed by the computing unit 1101, one or more steps of the method for operating a component described above may be performed. Alternatively, in other embodiments, the computing unit 1101 may be configured to execute the method of operating the component in any other appropriate manner (eg, by means of firmware).

[0253] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0254] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0255] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0256] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0257] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0258] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0259] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0260] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for operating a component, comprising: In response to a preset instruction of a three-dimensional virtual character in the three-dimensional virtual space, displaying a control keyboard for controlling operable components in the three-dimensional virtual space; In response to a first operation of the three-dimensional virtual character on the control keyboard, a first control instruction is generated, and according to the first control instruction, a preset surface of the operable component is controlled to be displayed in a drawing board style; In response to a drawing operation on the preset surface of the drawing board style, displaying a drawn two-dimensional pattern on the preset surface of the drawing board style; In response to the model generation operation on the operable component, a preset skeleton model is acquired, wherein the preset skeleton model has animation data; Converting the two-dimensional pattern into a three-dimensional model, and determining a skin binding relationship between the preset skeleton model and the three-dimensional model; Displaying the three-dimensional model in the three-dimensional virtual space; The animation data of the preset skeleton model is used to drive the three-dimensional model to perform actions corresponding to the animation data.

2. The method according to claim 1, wherein: The step of obtaining a preset skeleton model in response to the model generation operation on the operable component includes: In response to a model generation operation on the operable component, displaying a plurality of default skeleton models in the three-dimensional virtual space; In response to a movement operation of the three-dimensional virtual character on any one of the default skeleton models, the operated skeleton model is moved to the position where the two-dimensional pattern is located, wherein the operated skeleton model is the preset skeleton model.

3. The method according to claim 2, wherein: The determining of the skin binding relationship between the preset skeleton model and the three-dimensional model includes: A skin binding relationship between the three-dimensional model and the preset skeleton model is determined according to a relative position between the three-dimensional model and the preset skeleton model.

4. The method according to any one of claims 1 to 3, further comprising: In response to a second control instruction for the operable component in the three-dimensional virtual space, controlling a preset surface of the operable component to be displayed in a mirror style; Determining a mirror image corresponding to the three-dimensional virtual character according to a relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space; A mirror image of the three-dimensional virtual character is displayed on the preset surface.

5. A method for operating a component, comprising: In response to a preset instruction of a three-dimensional virtual character in the three-dimensional virtual space, displaying a control keyboard for controlling operable components in the three-dimensional virtual space; In response to a second operation of the three-dimensional virtual character on the control keyboard, a second control instruction is generated, and according to the second control instruction, a preset surface of the operable component is controlled to be displayed in a mirror style; Determining a mirror image corresponding to the three-dimensional virtual character according to a relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space; Displaying a mirror image of the three-dimensional virtual character in the preset surface; The method further comprises: in response to a second operation of the three-dimensional virtual character on the control keyboard, displaying a key for controlling the mirror image in the control keyboard; In response to an operation on the key in the control keyboard, processing the mirror image in the operable component; The button includes a second button for recording a video, and the response is used to operate the button in the control keyboard to process the mirror image in the operable component, including: In response to the operation of the second key in the control keyboard, a music list is displayed in the operable component; in response to the selection operation of the three-dimensional virtual character in the music list, a preset audio is played, and the mirror image displayed in the preset surface is stored; When recording a video, in response to an operation on the second key in the control keyboard, a video file including the audio and a plurality of frames of the mirror image is generated.

6. The method according to claim 5, wherein: The key includes a first key for adjusting the appearance style, and the response is used to operate the key in the control keyboard to process the mirror image in the operable component, including: In response to an operation on the first key in the control keyboard, an appearance style of the mirror image displayed on the preset surface is adjusted.

7. The method according to claim 5, wherein: The key includes a third key for changing the clothing in the mirror image, and the response is used to operate the key in the control keyboard to process the mirror image in the operable component, including: In response to the user operating the third button in the control keyboard, acquiring a character costume from a costume library; A mirror image of a three-dimensional virtual character wearing the character costume is displayed in the operable component.

8. The method according to claim 7, wherein: The step of obtaining the character costume from the costume library includes: Displaying a plurality of sets of the character costumes in the operable components; In response to a selection instruction for selecting among the character costumes, determining a target character costume; The step of displaying a mirror image of a three-dimensional virtual character wearing the character costume in the operable component comprises: A mirror image of a three-dimensional virtual character wearing the target character's clothing is displayed in the operable component.

9. The method according to any one of claims 5 to 8, further comprising: In response to a first control instruction for the operable component in the three-dimensional virtual space, controlling a preset surface of the operable component to be displayed in a drawing board style; In response to a drawing operation on the operable component, displaying a drawn two-dimensional pattern on the operable component; In response to a model generation operation on the operable component, the two-dimensional pattern is processed to generate a three-dimensional model.

10. A device for operating a component, comprising: A keyboard display unit, for responding to preset instructions of a three-dimensional virtual character in the three-dimensional virtual space, and displaying a control keyboard for controlling operable components in the three-dimensional virtual space; A first control unit, configured to generate a first control instruction in response to a first operation of the three-dimensional virtual character on the control keyboard, and control the preset surface of the operable component to be displayed in a drawing board style according to the first control instruction; A drawing unit, configured to respond to a drawing operation on the preset surface of the drawing board style and display a drawn two-dimensional pattern on the preset surface of the drawing board style; A model generation unit, configured to process the two-dimensional pattern to generate a three-dimensional model in response to a model generation operation on the operable component; A model display unit, used for displaying the three-dimensional model in the three-dimensional virtual space; Wherein, the model generation unit includes: An acquisition module, used for acquiring a preset skeleton model in response to a model generation operation on the operable component; A binding module, used for converting the two-dimensional pattern into a three-dimensional model, and determining a skin binding relationship between the preset skeleton model and the three-dimensional model; Wherein, the preset skeleton model has animation data; The device also includes a drive unit for: The animation data of the preset skeleton model is used to drive the three-dimensional model to perform actions corresponding to the animation data.

11. The device according to claim 10, wherein: The acquisition module is specifically used for: In response to a model generation operation on the operable component, displaying a plurality of default skeleton models in the three-dimensional virtual space; In response to a movement operation of the three-dimensional virtual character on any one of the default skeleton models, the operated skeleton model is moved to the position where the two-dimensional pattern is located, wherein the operated skeleton model is the preset skeleton model.

12. The device according to claim 10, wherein: The binding module is specifically used for: A skin binding relationship between the three-dimensional model and the preset skeleton model is determined according to a relative position between the three-dimensional model and the preset skeleton model.

13. The device according to any one of claims 10 to 12, further comprising: A second control unit, configured to respond to a second control instruction to the operable component in the three-dimensional virtual space, and control a preset surface of the operable component to be displayed in a mirror style; The mirror unit is used to determine the mirror image corresponding to the three-dimensional virtual character according to the relative position between the three-dimensional virtual character and the preset surface in the three-dimensional virtual space, and display the mirror image of the three-dimensional virtual character on the preset surface.

14. A device for operating a component, comprising: A keyboard display unit, for responding to preset instructions of a three-dimensional virtual character in the three-dimensional virtual space, and displaying a control keyboard for controlling operable components in the three-dimensional virtual space; A second control unit, configured to generate a second control instruction in response to a second operation of the three-dimensional virtual character on the control keyboard, and control the preset surface of the operable component to be displayed in a mirror style according to the second control instruction; A mirror unit, configured to determine a mirror image corresponding to the three-dimensional virtual character according to a relative position between the three-dimensional virtual character in the three-dimensional virtual space and the preset surface, and to display the mirror image of the three-dimensional virtual character on the preset surface; The keyboard display unit is also used for: In response to a second operation of the three-dimensional virtual character on the control keyboard, displaying a key for controlling the mirror image in the control keyboard; The device further comprises a processing unit for processing the mirror image in the operable component in response to an operation on the key in the control keyboard; The button includes a second button for recording a video, and the processing unit includes a second processing module for: In response to the operation of the second key in the control keyboard, a music list is displayed in the operable component; in response to the selection operation of the three-dimensional virtual character in the music list, a preset audio is played, and the mirror image displayed in the preset surface is stored; When recording a video, in response to an operation on the second key in the control keyboard, a video file including the audio and a plurality of frames of the mirror image is generated.

15. The device according to claim 14, wherein: The button includes a first button for adjusting the appearance style, and the processing unit includes a first processing module for: In response to an operation on the first key in the control keyboard, an appearance style of the mirror image displayed on the preset surface is adjusted.

16. The device according to any one of claims 14, wherein: The buttons include a third button for changing the clothing in the mirror image, and the processing unit includes a third processing module for: In response to the user operating the third button in the control keyboard, acquiring a character costume from a costume library; A mirror image of a three-dimensional virtual character wearing the character costume is displayed in the operable component.

17. The device according to claim 16, wherein: The third processing module is specifically used for: Displaying a plurality of sets of the character costumes in the operable components; In response to a selection instruction for selecting among the character costumes, determining a target character costume; A mirror image of a three-dimensional virtual character wearing the target character's clothing is displayed in the operable component.

18. The device according to any one of claims 14 to 17, further comprising: A first control unit, configured to respond to a first control instruction for the operable component in the three-dimensional virtual space, and control a preset surface of the operable component to be displayed in a drawing board style; A drawing unit, configured to respond to a drawing operation on the operable component and display a drawn two-dimensional pattern on the operable component; The model generating unit is used for processing the two-dimensional pattern to generate a three-dimensional model in response to the model generating operation on the operable component.

19. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

20. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-9.

21. A computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Two-dimensional image to three-dimensional scene realization method based on AR

    CN106373187A

  • Game data processing method, game data processing device and terminal equipment

    CN110639204A

  • Virtual content display method and device, terminal equipment and storage medium

    CN111563966A