Virtual object processing method, device, storage medium and computer device

By obtaining the matching points set between the virtual body and clothing, and using point cloud registration and deep learning technology for adaptation, the body shape mismatch problem during virtual body clothing adaptation is solved, achieving high-precision virtual clothing self-adaptation and cost reduction.

CN113963139BActive Publication Date: 2025-05-30ALIBABA DAMO (HANGZHOU) TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111166602.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-30
Publication Date
2025-05-30
Estimated Expiration
2041-09-30

AI Technical Summary

Technical Problem

The prior art is difficult to adapt clothing automatically according to the body shape of the virtual body accurately and automatically, resulting in the problem of clothing being unfit or being too large or too small.

Method used

By obtaining the matching point set between the virtual body and the apparel, using point cloud registration and deep learning technology, the matching point set of virtual apparel is determined, and the apparel is deformed based on these point sets to adapt to the body shapes of different virtual bodies.

Benefits of technology

It realizes high-precision virtual clothing self-adaptation, solves the problem of body shape mismatch during clothing adaptation, and reduces the cost of clothing design and customization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113963139B_ABST
    Figure CN113963139B_ABST
Patent Text Reader

Abstract

The present invention discloses a method, apparatus, storage medium and computer device for processing virtual objects. Among them, the method includes: obtaining a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body; determining a set of matching points between the first virtual body and the first virtual clothing; obtaining a second virtual body of a second virtual object; and determining a second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points. The present invention solves the technical problem in the related art that it is difficult to accurately and automatically adapt clothing according to the body type of the virtual body when performing clothing adaptation on the virtual body.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computers, and in particular, to a method, device, storage medium, and computer device for processing virtual objects. Background Art

[0002] Currently, virtual avatars are relatively popular. Virtual avatars are involved in various scenarios, such as video software, social software, variety shows with virtual characters, and so on. Virtual avatars also include various development directions, such as cartoon-style, real-person style, and so on. In subsequent development, personal low-cost and diverse virtual images will be more popular. In addition, with the launch of the UE5 engine, the prospect of high-precision virtual images will be broader, such as virtual images of high-precision human bodies. Taking virtual characters as an example, currently, the cost of making a set of clothes for a virtual character is about three thousand yuan. And clothing change is one of the important requirements for virtual characters. Among them, the body shapes of virtual characters are different, and the topologies of each piece of clothing are different. Therefore, it is a quite challenging task to adapt different clothes to different virtual characters.

[0003] In response to the above problems, no effective solution has been proposed yet. Summary of the Invention

[0004] Embodiments of the present invention provide a method, device, storage medium, and computer device for processing virtual objects, so as to at least solve the technical problem that it is difficult to accurately and automatically adapt to the body shape of a virtual body when performing clothing adaptation on the virtual body in related technologies.

[0005] According to one aspect of the embodiments of the present invention, there is provided a method for processing virtual objects, including: obtaining a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body; determining a set of matching points between the first virtual body and the first virtual clothing; obtaining a second virtual body of a second virtual object; and determining a second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0006] Optionally, the determining the set of matching points between the first virtual body and the first virtual clothing includes: for any point to be matched on the first virtual clothing, determining a set of points corresponding to the point to be matched; and determining a point on the first virtual body that matches the point to be matched on the first virtual clothing from the set of points.

[0007] Optionally, determining a point set corresponding to any point to be matched on the first virtual clothing includes: converting a grid divided based on the first virtual clothing into a first point cloud, and converting a grid divided based on the first virtual body into a second point cloud; determining, by means of point cloud registration, a point set corresponding to the grid of any point to be matched on the first virtual clothing.

[0008] Optionally, determining a point set corresponding to any point to be matched on the first virtual clothing includes: for any point to be matched on the first virtual clothing, determining a first distance from the point to be matched to the first virtual body, and determining, based on the first distance, a point set corresponding to the point to be matched in the first virtual body; determining a point on the first virtual body that matches the point to be matched on the first virtual clothing from the point set includes: determining a second distance from a point in the point set to the first virtual clothing; determining, based on the first distance and the second distance, a point on the first virtual body that matches the point to be matched on the first virtual clothing, where, after obtaining a matching point on the first virtual body for any point to be matched on the first virtual clothing, a matching point set between the first virtual body and the first virtual clothing is obtained.

[0009] Optionally, after determining a second virtual clothing adapted to the second virtual body according to the second virtual body and the matching point set, it further includes: displaying the second virtual clothing on a display interface; receiving an editing operation on the second virtual clothing to obtain an edited second virtual clothing; displaying the edited second virtual clothing on the display interface.

[0010] Optionally, displaying the edited second virtual clothing on the display interface includes: when there are multiple edited second virtual clothes, displaying the multiple edited second virtual clothes; or, displaying the first virtual body, the first virtual clothing, the second virtual body, and the edited second virtual body simultaneously.

[0011] Optionally, determining a second virtual clothing adapted to the second virtual body according to the second virtual body and the matching point set includes: obtaining distances between corresponding matching points in the matching point set; determining a spatial point corresponding to a point to be determined on the second virtual body according to the point to be determined on the second virtual body and the distances between corresponding matching points for the point to be determined; determining a second virtual clothing adapted to the second virtual body based on the spatial point corresponding to the point to be determined.

[0012] Optionally, determining a second virtual clothing item adapted to the second virtual body based on the spatial point corresponding to the point to be determined includes: for other points on the second virtual body except the point to be determined, determining the spatial points corresponding to the other points; and determining a second virtual clothing item adapted to the second virtual body based on the spatial point corresponding to the point to be determined and the spatial points corresponding to the other points.

[0013] Optionally, determining a second virtual clothing item adapted to the second virtual body according to the second virtual body and the set of matching points includes: determining a first grid position of the first virtual body in a predetermined grid and a second grid position of the second virtual body in the predetermined grid; obtaining the difference between the first grid position and the second grid position; and performing a deformation process on the first virtual clothing item according to the set of matching points and the difference to obtain a second virtual clothing item adapted to the second virtual body.

[0014] According to another aspect of the embodiments of the present invention, a method for processing virtual objects is provided, including: displaying, on an interaction interface, a first virtual body of a first virtual object and a first virtual clothing item adapted to the first virtual body; displaying, on the interaction interface, a second virtual body of a second virtual object; receiving an adaptation instruction; and in response to the adaptation instruction, displaying, on the interaction interface, a second virtual clothing item adapted to the second virtual body, where the second virtual clothing item is determined based on the second virtual body and a set of matching points, and the set of matching points is a set of matching points between the first virtual body and the first virtual clothing item.

[0015] According to another aspect of the embodiments of the present invention, a method for processing virtual objects is provided, including: displaying, on a live broadcast page, a first virtual body of a first virtual object and a first virtual clothing item adapted to the first virtual body; displaying, on the live broadcast page, second virtual bodies of a plurality of second virtual objects uploaded by a viewer account; receiving a selection operation of selecting a target second virtual body from the second virtual bodies of the plurality of second virtual objects; and in response to the selection operation, displaying, on the live broadcast page, a second virtual clothing item adapted to the target second virtual body, where the second virtual clothing item is determined based on the target second virtual body and a set of matching points, and the set of matching points is a set of matching points between the first virtual body and the first virtual clothing item.

[0016] According to another aspect of the embodiments of the present invention, there is provided a virtual object processing device, including: a first acquisition module, configured to acquire a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body; a first determination module, configured to determine a set of matching points between the first virtual body and the first virtual clothing; a second acquisition module, configured to acquire a second virtual body of a second virtual object; a second determination module, configured to determine a second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0017] According to another aspect of the embodiments of the present invention, there is provided a virtual object processing device, including: a first display module, configured to display a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on an interaction interface; a second display module, configured to display a second virtual body of a second virtual object on the interaction interface; a first reception module, configured to receive an adaptation instruction; a third display module, configured to, in response to the adaptation instruction, display a second virtual clothing adapted to the second virtual body on the interaction interface, where the second virtual clothing is determined according to the second virtual body and a set of matching points, and the set of matching points is a set of matching points between the first virtual body and the first virtual clothing.

[0018] According to another aspect of the embodiments of the present invention, there is provided a virtual object processing device, including: a fourth display module, configured to display a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on a live broadcast page; a fifth display module, configured to display second virtual bodies of a plurality of second virtual objects uploaded by a viewer account on the live broadcast page; a second reception module, configured to receive a selection operation of selecting a target second virtual body from the second virtual bodies of the plurality of second virtual objects; a sixth display module, configured to, in response to the selection operation, display a second virtual clothing adapted to the target second virtual body on the live broadcast page, where the second virtual clothing is determined according to the target second virtual body and a set of matching points, and the set of matching points is a set of matching points between the first virtual body and the first virtual clothing.

[0019] According to another aspect of the embodiments of the present invention, there is provided a storage medium, where the storage medium includes a stored program, and when the program runs, it controls a device where the storage medium is located to execute any one of the virtual object processing methods.

[0020] According to another aspect of the embodiments of the present invention, a computer device is provided, including: a memory and a processor, the memory stores a computer program; the processor is configured to execute the computer program stored in the memory, and when the computer program runs, the processor is caused to execute any one of the virtual object processing methods.

[0021] In the embodiments of the present invention, the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body are obtained, a set of matching points between the first virtual body and the first virtual clothing is determined, and according to the second virtual body and the set of matching points, the second virtual clothing adapted to the second virtual body is determined. Since the second virtual clothing is determined according to the second virtual body and the set of matching points, high-precision virtual clothing self-adaptation can be achieved, and the technical problem that it is difficult to accurately and automatically adapt to the body type of the virtual body when performing clothing adaptation on the virtual body in the related art is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings described herein are used to provide a further understanding of the present invention, and constitute a part of this application. The illustrative embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation to the present invention. In the drawings:

[0023] Figure 1 A hardware structure block diagram of a computer terminal for implementing the virtual object processing method is shown;

[0024] Figure 2 is a flowchart of the first virtual object processing method according to Embodiment 1 of the present invention;

[0025] Figure 3 is a flowchart of the second virtual object processing method according to Embodiment 1 of the present invention;

[0026] Figure 4 is a flowchart of the third virtual object processing method according to Embodiment 1 of the present invention;

[0027] Figure 5 is a schematic diagram of the virtual object processing method provided according to an alternative embodiment of the present invention;

[0028] Figure 6 is a schematic diagram of the point cloud registration method provided according to an alternative embodiment of the present invention;

[0029] Figure 7 is a structural block diagram of the first virtual object processing device according to Embodiment 2 of the present invention;

[0030] Figure 8 is a structural block diagram of the second virtual object processing device according to Embodiment 3 of the present invention;

[0031] Figure 9 It is a structural block diagram of the virtual object processing device three provided in Embodiment 4 of the present invention;

[0032] Figure 10 It is a device block diagram of a terminal according to an embodiment of the present invention. Detailed implementation manners

[0033] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0034] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order different from those illustrated or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0035] Embodiment 1

[0036] According to an embodiment of the present invention, an embodiment of a virtual object processing method is further provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.

[0037] The method embodiment provided in the first embodiment of the present application can be executed on a mobile terminal, a computer terminal or a similar computing device. Figure 1 It shows a hardware structure block diagram of a computer terminal (or mobile device) for implementing the virtual object processing method. As Figure 1As shown, the computer terminal 10 (or mobile device) may include one or more processors 102 (illustrated as 102a, 102b, ……, 102n in the figure) (the processor may include, but is not limited to, processing devices such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission module 106 for communication functions. In addition, it may further include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply, and / or a camera. Those of ordinary skill in the art can understand that Figure 1 the structure shown is only schematic and does not limit the structure of the above-mentioned electronic device. For example, the computer terminal 10 may further include more or fewer components than Figure 1 shown in, or have a different configuration from Figure 1 that shown.

[0038] It should be noted that the above one or more processors 102 and / or other data processing circuits are generally referred to as "data processing circuits" in this article. The data processing circuit may be embodied in software, hardware, firmware, or any combination thereof, in whole or in part. In addition, the data processing circuit may be a single independent processing module, or be incorporated in whole or in part into any one of the other elements in the computer terminal 10 (or mobile device). As involved in the embodiments of the present application, the data processing circuit is a kind of processor control (such as the selection of a variable resistor terminal path connected to an interface).

[0039] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the virtual object processing method in the embodiments of the present invention. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, implements the virtual object processing method of the above application program. The memory 104 may include a high-speed random access memory, and may further include a non-volatile memory, such as one or more magnetic storage devices, a flash memory, or other non-volatile solid-state memories. In some instances, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories may be connected to the computer terminal 10 through a network. Examples of the above network include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0040] The transmission device 106 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by the communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0041] The display can be, for example, a touch-screen liquid crystal display (LCD), which enables the user to interact with the user interface of the computer terminal 10 (or mobile device).

[0042] Under the above operating environment, the present application provides a virtual object processing method as Figure 2 shown. Figure 2 is a flowchart of the virtual object processing method 1 according to Embodiment 1 of the present invention. As Figure 2 shown, the method includes the following steps:

[0043] Step S202, obtaining the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body;

[0044] Step S204, determining a set of matching points between the first virtual body and the first virtual clothing;

[0045] Step S206, obtaining the second virtual body of the second virtual object;

[0046] Step S208, determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0047] Through the above steps, the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body are obtained, a set of matching points between the first virtual body and the first virtual clothing is determined, and the second virtual clothing adapted to the second virtual body is determined according to the second virtual body and the set of matching points. Since the second virtual clothing is determined according to the second virtual body and the set of matching points, high-precision virtual clothing self-adaptation can be achieved, and the technical problem that it is difficult to accurately automatically adapt to the body shape of the virtual body when adapting clothing to the virtual body in the related art is solved.

[0048] As an alternative embodiment, obtain the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body. Herein, the virtual object can include various types. For example, it can be a person, an animal, a plant, or any created virtual object, which is not limited herein. The scope of the virtual object is very large. For example, among people, it includes anthropomorphic characters, cartoon characters, etc. Settings and operations can be performed on various different types of virtual objects. The virtual clothing is the clothing that can be worn by the virtual body of the virtual object. For example, it can be the clothes that can be worn on the body, the utensils that can be held in the hand, the accessories that can be worn on the head, etc., which is not limited herein. By matching the virtual clothing to the virtual body of the virtual object, diversified design of the virtual object can be achieved, the visual experience can be improved, and the virtual object can be made more three-dimensional. By obtaining the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body, the virtual clothing can be adapted to the virtual body of the virtual object. The virtual body of the virtual object can change differently according to the different virtual objects. When the virtual object is an anthropomorphic character, the anthropomorphic character can have different characteristics such as height, weight, and build. Moreover, for a specific anthropomorphic character, the physical appearance and body shape should also be different at different stages. Therefore, obtaining the virtual clothing according to the virtual body of the virtual object can make the virtual clothing fit the virtual body of the current virtual object.

[0049] As an alternative embodiment, determine the set of matching points between the first virtual body and the first virtual clothing. Herein, both the first virtual body and the first virtual clothing include multiple points. By determining the set of matching points between the first virtual body and the first virtual clothing, that is, determining the set of points where the first virtual body and the first virtual clothing can match, subsequent adaptation of the virtual body and the virtual clothing can be completed by adjusting the points in the set of matching points.

[0050] As an alternative embodiment, there are various ways to determine the set of matching points between the first virtual body and the first virtual clothing. For example, the following steps can be taken: for any point to be matched on the first virtual clothing, determine the set of corresponding points; determine the points on the first virtual body that match the point to be matched on the first virtual clothing from the set of points. That is, according to the point to be matched on the first virtual clothing, obtain the set of corresponding points for each point to be matched. The set of points to be matched includes points that match the first virtual clothing and points that do not match the first virtual clothing. Determine the points on the first virtual body that match the point to be matched on the first virtual clothing and screen out the non-matching points for subsequent operations based on the matching points.

[0051] As an alternative embodiment, when determining a point set corresponding to an arbitrary point to be matched on the first virtual garment, the following method can be adopted: converting the grid divided based on the first virtual garment into a first point cloud, and converting the grid divided based on the first virtual body into a second point cloud; using the method of point cloud registration to determine the point set corresponding to the grid of any point to be matched on the first virtual garment. That is, converting the grids divided by the virtual garment and the virtual body into the form of point clouds, and using the method of point cloud registration to determine the point set of the points to be matched on the first virtual garment. By using the method of point cloud registration, the error can be controlled within a smaller range, ensuring that the obtained point set has a higher accuracy and can make the obtained point set within a suitable range.

[0052] As an alternative embodiment, when determining a point set corresponding to an arbitrary point to be matched on the first virtual garment, the following method can also be adopted: for any point to be matched on the first virtual garment, determining the first distance from the point to be matched to the first virtual body, and based on the first distance, determining the point set corresponding to the point to be matched in the first virtual body. When determining the point on the first virtual body that matches the point to be matched on the first virtual garment from the point set, the following method can be adopted: determining the second distance from the point in the point set to the first virtual garment, and based on the first distance and the second distance, determining the point on the first virtual body that matches the point to be matched on the first virtual garment. Among them, after obtaining the matching points of any point to be matched on the first virtual garment on the first virtual body, the matching point set between the first virtual body and the first virtual garment can be obtained, that is, the point set corresponding to the point to be matched includes multiple points in the first virtual body, and the multiple points in the first virtual body are the points within the range of the first distance from the points on the first virtual body and the first virtual garment. By determining the first distance from the point to be matched on the first virtual garment to the first virtual body and the second distance from the points in the point set of the first virtual body to the first virtual garment, and determining the matching points between the first virtual body and the first virtual garment through the mutual relationship between the two distances, and comprehensively determining the matching points according to the two distances, the matching between the first virtual body and the first virtual garment can be made more perfect, enabling the first virtual garment to fit the first virtual body better and creating a better visual effect.

[0053] As an alternative embodiment, in the process of determining the first distance from the point to be matched to the first virtual body, the following method can be adopted: determine the first body model corresponding to the first virtual body according to the body adaptation model, and determine the distance from the point to be matched to the first body model as the first distance. That is, the body model corresponding to the virtual body can be determined through the body adaptation model. Among them, the body model can be trained with a large number of sample data through a deep learning network. For example, the body model corresponding to the virtual body can be trained through a deep learning network based on DeepSDF (Learning continuous signed distance functions for shape representation). By determining the body model, not only can the generalization ability of the model to different data be enhanced, but also the speed can be improved when confirming the distance of the point to be matched. In addition, multiple points to be matched can be processed in parallel, and the first distance can be accurately confirmed. It should be noted that the body model can also be used in the subsequent steps of the operation to effectively avoid phenomena such as model penetration or improper matching when the virtual body is matched with the virtual clothing.

[0054] As an alternative embodiment, the point set corresponding to the point to be matched in the first virtual body can be determined in various ways. For example, the range including the point to be matched as the center and the first distance as the radius can be obtained; the points included in the range in the first virtual body are determined as the point set corresponding to the point to be matched in the first virtual body. That is, multiple points in the first virtual body are the points within the range of the first distance from the points on the first virtual clothing. This first distance range is the range within the sphere with the first distance as the radius. By setting the range with the point to be matched as the center and the first distance as the radius, it is ensured that the matching points are selected within a suitable range, avoiding the phenomenon that multiple points cannot be matched caused by too small a range, and problems such as increased computational complexity and reduced running speed and running jams caused by too large a range.

[0055] As an alternative embodiment, to determine the second distance from the points in the point set to the first virtual clothing, similarly, the following method can be adopted: Determine the first clothing model corresponding to the first virtual clothing according to the clothing adaptation model, and determine the distance from the points in the point set to the first clothing model as the second distance. That is, the clothing model corresponding to the virtual clothing can be determined through the clothing adaptation model. Among them, the clothing model can also be trained with a large number of sample data through a deep learning network. For example, the clothing model corresponding to the virtual clothing can be trained through a deep learning network based on DeepSDF (Learning continuous signed distance functions for shape representation). By determining the clothing model, not only can the generalization ability of the model for different data be enhanced, but also the speed can be improved when determining the distance from the points in the point set to the model. Moreover, the points in multiple sets can be processed in parallel, and the second distance can be accurately determined. It should be noted that the clothing model can also be applied in subsequent operations to effectively avoid phenomena such as model penetration or mismatch when the virtual body is adapted to the virtual clothing.

[0056] As an alternative embodiment, based on the first distance and the second distance, to determine the points on the first virtual body that match the points to be matched on the first virtual clothing, it may further include: Obtain the third distance from the points to be matched to the points in the point set, and confirm the points that are better matched through the third distance. Then, based on the first distance, the second distance, and the third distance, determine the points on the first virtual body that match the points to be matched on the first virtual clothing. When determining the points on the first virtual body that match the points to be matched on the first virtual clothing based on the first distance, the second distance, and the third distance, the distance to be compared can be determined based on the first distance and the second distance, and the points on the first virtual body that match the points to be matched on the first virtual clothing can be determined according to the distance to be compared and the third distance. That is, by comparing different distances, when the comparison result is within a reasonable range, the points to be matched on the first virtual body and the first virtual clothing are determined to be matching points. This enables the obtained matching points to be controlled within a more accurate range and enables the matching points to be obtained more accurately.

[0057] As an alternative embodiment, obtain the second virtual body of the second virtual object. By obtaining the second virtual body of the second virtual object, the virtual clothing can be worn on the virtual bodies of virtual objects with different body shapes and appearances, achieving the effect of adaptively wearing virtual clothing.

[0058] As an alternative embodiment, a second virtual clothing item that fits the second virtual body is determined based on the second virtual body and the set of matching points. That is, the obtained second virtual body is still applicable to the above-obtained set of matching points. That is, the spatial positions of the points on the virtual clothing item corresponding to the second virtual body can be obtained through the set of matching points, and then a second virtual clothing item that fits the second virtual body can be obtained.

[0059] As an alternative embodiment, when determining a second virtual clothing item that fits the second virtual body based on the second virtual body and the set of matching points, the distances between the corresponding matching points in the set of matching points can be obtained. Based on the point to be determined on the second virtual body and the distances between the corresponding matching points for the point to be determined, the spatial points corresponding to the point to be determined are determined. Based on the spatial points corresponding to the point to be determined, a second virtual clothing item that fits the second virtual body is determined. That is, the point to be determined on the second virtual body can be matched to the corresponding spatial points, and the points on the second virtual body can be matched to the correct spatial positions. Through the matching between points, a second virtual clothing item that fits the second virtual body is automatically determined. It should be noted that when determining a second virtual clothing item that fits the second virtual body based on the spatial points corresponding to the point to be determined, there may be other points in addition to the point to be determined. Therefore, for the other points on the second virtual body in addition to the point to be determined, the spatial points corresponding to the other points are determined. Among them, the As-Rigid-As-Possible (ARAP) method can be selected to determine the corresponding spatial points as much as possible. Based on the spatial points corresponding to the point to be determined and the spatial points corresponding to the other points, a second virtual clothing item that fits the second virtual body is determined. Specifically, a second virtual clothing item that fits the second virtual body can be obtained by determining the grid positions. For example, the first grid position of the first virtual body in a predetermined grid and the second grid position of the second virtual body in the predetermined grid are determined, the difference between the first grid position and the second grid position is obtained, and the first virtual clothing item is deformed based on the set of matching points and the difference to obtain a second virtual clothing item that fits the second virtual body. This can ensure that no points are missed, making the matching details between the second virtual body and the second virtual clothing item higher.

[0060] As an alternative embodiment, after determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points, the following steps may further be included: displaying the second virtual clothing on the display interface; receiving an editing operation on the second virtual clothing to obtain the edited second virtual clothing, and the second virtual clothing can be adjusted again, that is, the second virtual clothing can be displayed to the user, and the user can edit the virtual clothing, such as modifying the color, accessories, clothing style, size, etc. For example, when the second virtual clothing is a skirt, pleat textures can be added to the skirt, or a dynamic effect of fluttering in the wind can be added to the skirt, etc. Then, the edited second virtual clothing is displayed on the display interface, so that the second virtual clothing can not only be suitable for the second virtual body, but also can add or adjust clothing details, etc. Through the editing operation on the second virtual clothing, the second virtual clothing has editability and makes the transformation of the clothing more flexible.

[0061] As an alternative embodiment, displaying the edited second virtual clothing on the display interface may include the following steps: in the case where the edited second virtual clothing includes multiple pieces, displaying the multiple edited second virtual clothing can visually show the appearance of the second virtual clothing worn by the second virtual body after adjustment. By simultaneously displaying multiple candidate second virtual clothing, users can freely choose which virtual clothing to use; or, displaying the first virtual body and the first virtual clothing, the second virtual body, and the edited second virtual body simultaneously can compare and show the appearance of different virtual bodies wearing the same type of virtual clothing, and can more intuitively show the different feelings of the same style of clothing worn on different virtual bodies, which is more visually impactful. It should be noted that during the process of displaying the second virtual clothing, the user can view the second virtual clothing in all directions, that is, view the second virtual clothing through operations such as rotation, dragging, zooming in, and zooming out.

[0062] Figure 3 is the flowchart of the second method for processing virtual objects according to Embodiment 1 of the present invention, as Figure 3 shown, the method includes the following steps:

[0063] Step S302, displaying the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body on the interaction interface;

[0064] Step S304, displaying the second virtual body of the second virtual object on the interaction interface;

[0065] Step S306, receiving an adaptation instruction;

[0066] Step S308: In response to the adaptation instruction, display a second virtual clothing item that is adapted to the second virtual body on the interaction interface, where the second virtual clothing item is determined based on the second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing item.

[0067] Through the above steps, the first virtual body of the first virtual object and the first virtual clothing item adapted to the first virtual body are displayed on the interaction interface, and the second virtual body of the second virtual object is also displayed. By receiving and responding to the adaptation instruction, a second virtual clothing item adapted to the second virtual body can be displayed on the interaction interface. Since the second virtual clothing item is determined based on the second virtual body and the set of matching points, high-precision self-adaptation of virtual clothing can be achieved, thus solving the technical problem in the related art that it is difficult to accurately and automatically adapt to the body shape of the virtual body when performing clothing adaptation on the virtual body.

[0068] Figure 4 It is a flowchart of the method for processing virtual objects according to Embodiment 1 of the present invention. As Figure 4 shown, the method includes the following steps:

[0069] Step S402: Display the first virtual body of the first virtual object and the first virtual clothing item adapted to the first virtual body on the live broadcast page;

[0070] Step S404: Display the second virtual bodies of multiple second virtual objects uploaded by the viewer account on the live broadcast page;

[0071] Step S406: Receive a selection operation to select a target second virtual body from the second virtual bodies of multiple second virtual objects;

[0072] Step S408: In response to the selection operation, display a second virtual clothing item adapted to the target second virtual body on the live broadcast page, where the second virtual clothing item is determined based on the target second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing item.

[0073] Through the above steps, the first virtual body of the first virtual object and the first virtual clothing item adapted to the first virtual body are displayed on the live broadcast interface, and the second virtual bodies of the second virtual objects uploaded by the viewer account are also displayed. By receiving and responding to the selection operation, a second virtual clothing item adapted to the second virtual body can be displayed on the live broadcast interface. Since the second virtual clothing item is determined based on the second virtual body and the set of matching points, high-precision self-adaptation of virtual clothing can be achieved, thus solving the technical problem in the related art that it is difficult to accurately and automatically adapt to the body shape of the virtual body when performing clothing adaptation on the virtual body.

[0074] It should be noted that this alternative embodiment can be used in a live broadcast scenario to better display the effect of trying on clothes for the audience. For example, in an e-commerce live broadcast, when the host shows a coat, the coat can be made into a virtual garment, that is, a virtual coat. Furthermore, an anthropomorphic virtual body can be used to display the virtual coat. Among them, the anthropomorphic virtual body can simulate people of different body types such as tall, short, fat, and thin seen in real life, and can display a better effect of trying on clothes for the audience.

[0075] Based on the above embodiments and alternative embodiments, an alternative implementation manner is provided, which is specifically described below.

[0076] In related technologies, virtual avatars have been widely used. Taking virtual characters as an example, when making the clothing materials of the characters, the following problems are faced in the process of making the materials: 1) For clothing materials such as clothes and wearable devices, the design process is relatively long. It requires a series of operations including original painting production, production by ISV (Independent Software Vendors), acceptance process, and finally testing. Moreover, when making, the clothing model will be matched with a specified body model. The same set of clothes can only be made for a certain body type. That is, after the body type changes, when docking with virtual people of different body types, problems such as the clothes not fitting properly, being too large, or passing through the model may occur, and the clothes cannot be adapted; 2) The cost of making a set of clothing models by ISV is about 3,000 yuan, which is relatively high. Therefore, it requires a relatively high cost to customize clothes for different body types respectively.

[0077] As can be seen from the above example, after making virtual people of different body types, there are relatively large problems in how to adapt the specified style of clothes to different body types, especially when it comes to a relatively large amount of clothing materials. For example, when making and developing functions such as a clothing accessory mall later, there are relatively large challenges in how to adapt the same style of clothes to different body types.

[0078] Based on this, the alternative implementation manner of the present invention provides a virtual object processing method, specifically providing a clothing adaptation and migration scheme based on deep learning. Taking a virtual person wearing clothes as an example, only by inputting a set of well-matched clothing model and body model, and then inputting the body model with a changed body type, a clothing model adapted to this body type can be obtained. Figure 5 It is a schematic diagram of the virtual object processing method provided by the alternative implementation manner of the present invention. As Figure 5 shown, the alternative implementation manner of the present invention will be described in detail below.

[0079] S1, Prepare an initial clothing model Dc and an initial human body model Db, as Figure 5As shown in the initial ISV making the body + clothes, the model clothSDF (cloth signed distance functions) adapted to the clothes and the model bodySDF (body signed distance functions) adapted to the body are obtained through training;

[0080] It should be noted that during the training process, a deep learning network based on DeepSDF: Learning continuous signed distance functions for shape representation can be used.

[0081] S2, Denote the points on the clothes as Vc, calculate the distance from Vc to the body model Db, and obtain the distance dis_Vc_Db;

[0082] It should be noted that during the process of calculating the distance, it can be calculated through the bodySDF model adapted to the body.

[0083] S3, Draw a sphere with Vc as the center and the length of dis_Vc_Db as the radius;

[0084] Among them, the set of points included in the body model Db in the sphere is denoted as Sbody, and the included points are denoted as Vd, that is, for any point Vd, the points in the body inside the sphere are included in Sbody;

[0085] It should also be noted that the above steps can be accelerated by using the octree method and multi-point parallel operations can be implemented.

[0086] S4, Calculate in the clothSDF model, calculate the distance from Vd to the clothes model Dc, and obtain the distance dis_Vd_Dc;

[0087] S5, Select the above point set. During the process of selecting the point set, the point cloud registration method can be adopted. Figure 6 It is a schematic diagram of the point cloud registration method provided according to an optional embodiment of the present invention, as Figure 6 shown, Source corresponds to the human body; target corresponds to the clothing; the registration is performed by converting the clothes body mesh grid into a point cloud, through the formula: Then select the set of matching points according to the set conditions. For example, the condition can be set that if C_dis < 0.9 * dis_vc_vd or C_dis > 1.1 * dis_vc_vd, the pairing is rejected, and the range of the matched point set is denoted as Smatch.

[0088] S6, After the body shape is deformed, as Figure 5As shown by the target body (e.g., a taller body) in Figure 5 When making the original material clothes in Figure 5 there is an obvious phenomenon of clothing penetration. To solve the above problems, in an alternative embodiment of the present invention, a body model Dbd is obtained. Since Db and Dbd share the same set of topologies, that is, the Smatch point set still applies, the c_dis of the corresponding teams can be maintained through point set pairing, and the corresponding spatial positions of the control points on the clothes can be calculated, that is, the

[0089] target body shown in

[0090] can be obtained and the optimized clothing position can be seen.

[0091] (1) Parallel acceleration can be achieved during the process of confirming points, shortening the optimization time, and enabling automated calculation to reduce costs;

[0092] (2) During the process of confirming the point set, through the matching optimization method, a matching point set with distance matching is obtained, and the incorrect matches are eliminated. In the post-processing part, the clothing adaptation problem is solved through optimization means;

[0093] (3) The clothes can be adapted to different body types through program calculation, reducing the workload during modeling. And for different topological bodies in the future, transitions can be made through model construction to handle different body topology problems;

[0094] (4) Based on the deep learning method, by combining 3D data with deep learning, the algorithm is provided with broader generalization ability and robustness.

[0095] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0096] Through the description of the above embodiments, those skilled in the art can clearly understand that the virtual object processing method according to the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases, the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of the present invention.

[0097] Embodiment 2

[0098] According to an embodiment of the present invention, there is also provided an apparatus 1 for implementing the above virtual object processing method. Figure 7 It is a structural block diagram of the virtual object processing apparatus 1 provided in Embodiment 2 of the present invention. As Figure 7 shown, the apparatus includes: a first acquisition module 702, a first determination module 704, a second acquisition module 706, and a second determination module 708. The apparatus will be described below.

[0099] The first acquisition module 702 is configured to acquire the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body; the first determination module 704 is connected to the above-mentioned first acquisition module 702 and is configured to determine a set of matching points between the first virtual body and the first virtual clothing; the second acquisition module 706 is connected to the above-mentioned first determination module 704 and is configured to acquire the second virtual body of the second virtual object; the second determination module 708 is connected to the above-mentioned second acquisition module 706 and is configured to determine the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0100] It should be noted here that the above-mentioned first acquisition module 702, first determination module 704, second acquisition module 706, and second determination module 708 correspond to steps S202 to S208 in Embodiment 1. The examples and application scenarios implemented by the two modules and the corresponding steps are the same, but are not limited to the content disclosed in the above-mentioned Embodiment 1. It should be noted that the above modules, as part of the apparatus, can run in the computer terminal 10 provided in Embodiment 1.

[0101] Embodiment 3

[0102] According to an embodiment of the present invention, there is also provided an apparatus 2 for implementing the above virtual object processing method. Figure 8 It is a structural block diagram of the virtual object processing apparatus 2 provided in Embodiment 3 of the present invention. As Figure 8As shown, the device includes: a first display module 802, a second display module 804, a first receiving module 806, and a third display module 808. The device will be described below.

[0103] The first display module 802 is configured to display, on an interaction interface, a first virtual body of a first virtual object and first virtual clothing adapted to the first virtual body; the second display module 804 is connected to the first display module 802 and is configured to display, on the interaction interface, a second virtual body of a second virtual object; the first receiving module 806 is connected to the second display module 804 and is configured to receive an adaptation instruction; the third display module 808 is connected to the first receiving module 806 and is configured to, in response to the adaptation instruction, display, on the interaction interface, second virtual clothing adapted to the second virtual body, where the second virtual clothing is determined based on the second virtual body and a set of matching points, and the set of matching points is a set of matching points between the first virtual body and the first virtual clothing.

[0104] It should be noted here that the first display module 802, the second display module 804, the first receiving module 806, and the third display module 808 correspond to steps S302 to S308 in Embodiment 1. The examples and application scenarios implemented by the multiple modules and the corresponding steps are the same, but are not limited to the content disclosed in Embodiment 1 above. It should be noted that the above modules, as part of the device, can run in the computer terminal 10 provided in Embodiment 1.

[0105] Embodiment 4

[0106] According to an embodiment of the present invention, there is also provided a device three for implementing the above virtual object processing method. Figure 9 is a structural block diagram of a virtual object processing device three provided according to Embodiment 4 of the present invention, as Figure 9 shown, the device includes: a fourth display module 902, a fifth display module 904, a second receiving module 906, and a sixth display module 908. The device will be described below.

[0107] The fourth display module 902 is configured to display the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body on the live page; the fifth display module 904 is connected to the fourth display module 902 and is configured to display the second virtual bodies of multiple second virtual objects uploaded by the viewer account on the live page; the second receiving module 906 is connected to the fifth display module 904 and is configured to receive a selection operation of selecting a target second virtual body from the second virtual bodies of the multiple second virtual objects; the sixth display module 908 is connected to the second receiving module 906 and is configured to, in response to the selection operation, display the second virtual clothing adapted to the target second virtual body on the live page, where the second virtual clothing is determined based on the target second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing.

[0108] It should be noted here that the above-mentioned fourth display module 902, fifth display module 904, second receiving module 906, and sixth display module 908 correspond to steps S402 to S408 in Embodiment 1. The examples and application scenarios implemented by the multiple modules and the corresponding steps are the same, but are not limited to the content disclosed in Embodiment 1 above. It should be noted that the above modules, as part of the device, can run in the computer terminal 10 provided in Embodiment 1.

[0109] Embodiment 5

[0110] An embodiment of the present invention can provide a computer terminal, and the computer terminal can be any computer terminal device in a computer terminal group. Optionally, in this embodiment, the above computer terminal can also be replaced with a terminal device such as a mobile terminal.

[0111] Optionally, in this embodiment, the above computer terminal can be located in at least one of multiple network devices in a computer network.

[0112] In this embodiment, the above computer terminal can execute the program code of the following steps in the virtual object processing method of the application program: obtaining the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body; determining the set of matching points between the first virtual body and the first virtual clothing; obtaining the second virtual body of the second virtual object; and determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0113] Among them, the memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the virtual object processing detection method and device in the embodiments of the present invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, implements the above-mentioned virtual object processing method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some instances, the memory may further include a memory remotely disposed relative to the processor, and these remote memories may be connected to the terminal A through a network. Examples of the above network include but are not limited to the Internet, enterprise intranets, local area networks, mobile communication networks, and combinations thereof.

[0114] The processor can call the information and application programs stored in the memory through the transmission device to execute the following steps: obtaining the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body; determining a set of matching points between the first virtual body and the first virtual clothing; obtaining the second virtual body of the second virtual object; and determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0115] Optionally, the above processor may further execute the program code of the following steps: determining a set of matching points between the first virtual body and the first virtual clothing, including: for any point to be matched on the first virtual clothing, determining a set of corresponding points; and determining the points on the first virtual body that match the point to be matched on the first virtual clothing from the set of points.

[0116] Optionally, the above processor may further execute the program code of the following steps: for any point to be matched on the first virtual clothing, determining a set of corresponding points, including: converting the grid divided based on the first virtual clothing into a first point cloud, and converting the grid divided based on the first virtual body into a second point cloud; and determining the set of points corresponding to the grid of any point to be matched on the first virtual clothing by using a point cloud registration method.

[0117] Optionally, the above-mentioned processor may also execute the program code of the following steps: for any point to be matched on the first virtual clothing, determining the point set corresponding to the point to be matched includes: for any point to be matched on the first virtual clothing, determining the first distance from the point to be matched to the first virtual body, and based on the first distance, determining the point set corresponding to the point to be matched in the first virtual body; determining the point on the first virtual body that matches the point to be matched on the first virtual clothing from the point set includes: determining the second distance from the points in the point set to the first virtual clothing; based on the first distance and the second distance, determining the point on the first virtual body that matches the point to be matched on the first virtual clothing, wherein, after obtaining the matching points of any point to be matched on the first virtual clothing on the first virtual body, obtaining the matching point set between the first virtual body and the first virtual clothing.

[0118] Optionally, the above-mentioned processor may also execute the program code of the following steps: after determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the matching point set, it further includes: displaying the second virtual clothing on the display interface; receiving an editing operation on the second virtual clothing to obtain the edited second virtual clothing; displaying the edited second virtual clothing on the display interface.

[0119] Optionally, the above-mentioned processor may also execute the program code of the following steps: displaying the edited second virtual clothing on the display interface includes: in the case where the edited second virtual clothing includes multiple pieces, displaying the multiple edited second virtual clothing; or, displaying the first virtual body and the first virtual clothing, the second virtual body, and the edited second virtual body simultaneously.

[0120] Optionally, the above-mentioned processor may also execute the program code of the following steps: determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the matching point set includes: obtaining the distances between the corresponding matching points in the matching point set; according to the point to be determined on the second virtual body and the distances between the corresponding matching points for the point to be determined, determining the spatial points corresponding to the point to be determined; based on the spatial points corresponding to the point to be determined, determining the second virtual clothing adapted to the second virtual body.

[0121] Optionally, the above-mentioned processor may also execute the program code of the following steps: determining the second virtual clothing adapted to the second virtual body based on the spatial points corresponding to the point to be determined includes: for other points on the second virtual body except the point to be determined, determining the spatial points corresponding to the other points; based on the spatial points corresponding to the point to be determined and the spatial points corresponding to the other points, determining the second virtual clothing adapted to the second virtual body.

[0122] Optionally, the above-mentioned processor may also execute the program code of the following steps: determining a second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points, including: determining a first grid position of the first virtual body in a predetermined grid and a second grid position of the second virtual body in the predetermined grid; obtaining the difference between the first grid position and the second grid position; deforming the first virtual clothing according to the set of matching points and the difference to obtain a second virtual clothing adapted to the second virtual body.

[0123] The processor may call the information and application programs stored in the memory through a transmission device to execute the following steps: a virtual object processing method, including: displaying a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on an interaction interface; displaying a second virtual body of a second virtual object on the interaction interface; receiving an adaptation instruction; and in response to the adaptation instruction, displaying a second virtual clothing adapted to the second virtual body on the interaction interface, where the second virtual clothing is determined according to the second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing.

[0124] The processor may call the information and application programs stored in the memory through a transmission device to execute the following steps: displaying a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on a live broadcast page; displaying second virtual bodies of a plurality of second virtual objects uploaded by a viewer account on the live broadcast page; receiving a selection operation of selecting a target second virtual body from the second virtual bodies of the plurality of second virtual objects; and in response to the selection operation, displaying a second virtual clothing adapted to the target second virtual body on the live broadcast page, where the second virtual clothing is determined according to the target second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing.

[0125] Those of ordinary skill in the art can understand that the structure shown in the figure is only schematic, and the computer terminal may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, and terminal devices such as Mobile Internet Devices (MID), PAD, etc. Figure 10 It does not limit the structure of the above-mentioned electronic device. For example, the computer terminal 10 may also include more or fewer components (such as a network interface, a display device, etc.) than those shown Figure 10 in the figure, or have a different configuration from that shown Figure 10 in the figure.

[0126] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the relevant hardware of the terminal device through a program, and this program can be stored in a computer-readable storage medium. The storage medium can include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disk, etc.

[0127] Embodiment 6

[0128] An embodiment of the present invention also provides a storage medium. Optionally, in this embodiment, the above storage medium can be used to store the program code executed by the virtual object processing method provided in the first embodiment above.

[0129] Optionally, in this embodiment, the above storage medium can be located in any one of the computer terminals in the computer terminal group in the computer network, or in any one of the mobile terminals in the mobile terminal group.

[0130] Optionally, in this embodiment, the storage medium is set to store program code for performing the following steps: obtaining the first virtual body of the first virtual object and the first virtual clothing adapted to the first virtual body; determining a set of matching points between the first virtual body and the first virtual clothing; obtaining the second virtual body of the second virtual object; and determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points.

[0131] Optionally, in this embodiment, the storage medium is set to store program code for performing the following steps: determining a set of matching points between the first virtual body and the first virtual clothing, including: for any point to be matched on the first virtual clothing, determining a set of corresponding points; and determining the points on the first virtual body that match the point to be matched on the first virtual clothing from the set of points.

[0132] Optionally, in this embodiment, the storage medium is set to store program code for performing the following steps: for any point to be matched on the first virtual clothing, determining a set of corresponding points, including: converting the grid divided based on the first virtual clothing into a first point cloud, and converting the grid divided based on the first virtual body into a second point cloud; and determining the set of points corresponding to the grid of any point to be matched on the first virtual clothing by using the method of point cloud registration.

[0133] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: for any point to be matched on the first virtual clothing, determining the point set corresponding to the point to be matched includes: for any point to be matched on the first virtual clothing, determining the first distance from the point to be matched to the first virtual body, and based on the first distance, determining the point set corresponding to the point to be matched in the first virtual body; determining the point on the first virtual body that matches the point to be matched on the first virtual clothing from the point set includes: determining the second distance from the points in the point set to the first virtual clothing; based on the first distance and the second distance, determining the point on the first virtual body that matches the point to be matched on the first virtual clothing, wherein, after obtaining the matching points of any point to be matched on the first virtual clothing on the first virtual body, obtaining the matching point set between the first virtual body and the first virtual clothing.

[0134] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: after determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the matching point set, further including: displaying the second virtual clothing on the display interface; receiving an editing operation on the second virtual clothing to obtain the edited second virtual clothing; displaying the edited second virtual clothing on the display interface.

[0135] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: displaying the edited second virtual clothing on the display interface includes: in the case where the edited second virtual clothing includes multiple pieces, displaying the multiple edited second virtual clothing; or, displaying the first virtual body and the first virtual clothing, and the second virtual body, and the edited second virtual body simultaneously.

[0136] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the matching point set includes: obtaining the distances between the corresponding matching points in the matching point set; according to the point to be determined on the second virtual body and the distances between the corresponding matching points for the point to be determined, determining the spatial point corresponding to the point to be determined; based on the spatial point corresponding to the point to be determined, determining the second virtual clothing adapted to the second virtual body.

[0137] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining the second virtual clothing adapted to the second virtual body based on the spatial point corresponding to the point to be determined includes: for other points on the second virtual body except the point to be determined, determining the spatial points corresponding to the other points; based on the spatial point corresponding to the point to be determined and the spatial points corresponding to the other points, determining the second virtual clothing adapted to the second virtual body.

[0138] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: determining a second virtual clothing item adapted to the second virtual body according to the second virtual body and the set of matching points, including: determining a first grid position of the first virtual body in a predetermined grid and a second grid position of the second virtual body in the predetermined grid; obtaining the difference between the first grid position and the second grid position; and deforming the first virtual clothing item according to the set of matching points and the difference to obtain a second virtual clothing item adapted to the second virtual body.

[0139] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: a virtual object processing method, including: displaying, on an interaction interface, a first virtual body of a first virtual object and a first virtual clothing item adapted to the first virtual body; displaying, on the interaction interface, a second virtual body of a second virtual object; receiving an adaptation instruction; and in response to the adaptation instruction, displaying, on the interaction interface, a second virtual clothing item adapted to the second virtual body, where the second virtual clothing item is determined according to the second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing item.

[0140] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: displaying, on a live broadcast page, a first virtual body of a first virtual object and a first virtual clothing item adapted to the first virtual body; displaying, on the live broadcast page, second virtual bodies of multiple second virtual objects uploaded by viewer accounts; receiving a selection operation of selecting a target second virtual body from the second virtual bodies of the multiple second virtual objects; and in response to the selection operation, displaying, on the live broadcast page, a second virtual clothing item adapted to the target second virtual body, where the second virtual clothing item is determined according to the target second virtual body and the set of matching points, and the set of matching points is the set of matching points between the first virtual body and the first virtual clothing item.

[0141] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0142] In the above embodiments of the present invention, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0143] In several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only illustrative. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the couplings or direct couplings or communication connections shown or discussed with each other can be through some interfaces. The indirect couplings or communication connections of units or modules can be in electrical or other forms.

[0144] The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0145] In addition, in each embodiment of the present invention, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0146] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present invention. The foregoing storage medium includes: various media such as USB flash drives, read-only memories (ROMs), random access memories (RAMs), mobile hard disks, magnetic disks, or optical discs that can store program codes.

[0147] The above is only the preferred embodiment of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present invention.

Claims

1. A method for processing virtual objects, characterized in that, comprising: obtaining a first virtual body of a first virtual object and first virtual clothing adapted to the first virtual body; determining a set of matching points between the first virtual body and the first virtual clothing, wherein the set of matching points is determined based on a first distance and a second distance, where the first distance is the distance from any point to be matched on the first virtual clothing to the first virtual body, and the second distance is the distance from the corresponding point in the first virtual body to the first virtual clothing; obtaining a second virtual body of a second virtual object; determining second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points, wherein the second virtual clothing is determined based on the spatial points corresponding to the points to be determined on the second virtual body, and the spatial points corresponding to the points to be determined are determined according to the distances between the corresponding matching points of the points to be determined.

2. The method according to claim 1, characterized in that, the determining the set of matching points between the first virtual body and the first virtual clothing includes: for any point to be matched on the first virtual clothing, determining a set of corresponding points; determining, from the set of points, the points on the first virtual body that match the point to be matched on the first virtual clothing.

3. The method according to claim 2, characterized in that, the for any point to be matched on the first virtual clothing, determining a set of corresponding points includes: converting the grid divided based on the first virtual clothing into a first point cloud, and converting the grid divided based on the first virtual body into a second point cloud; using a point cloud registration method to determine the set of points corresponding to the grid of any point to be matched on the first virtual clothing.

4. The method according to claim 2, characterized in that, the for any point to be matched on the first virtual clothing, determining a set of corresponding points includes: for any point to be matched on the first virtual clothing, determining the first distance from the point to be matched to the first virtual body, and based on the first distance, determining the set of corresponding points in the first virtual body; the determining, from the set of points, the points on the first virtual body that match the point to be matched on the first virtual clothing includes: determining the second distance from the points in the set of points to the first virtual clothing; based on the first distance and the second distance, determining the points on the first virtual body that match the point to be matched on the first virtual clothing, wherein after obtaining the matching points of any point to be matched on the first virtual clothing on the first virtual body, the set of matching points between the first virtual body and the first virtual clothing is obtained.

5. The method according to claim 1, characterized in that, after determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points, further comprising: displaying the second virtual clothing on a display interface; Receive an editing operation on the second virtual clothing to obtain the edited second virtual clothing; Display the edited second virtual clothing on the display interface.

6. The method according to claim 5, wherein, the displaying the edited second virtual clothing on the display interface includes: when there are multiple edited second virtual clothings, display the multiple edited second virtual clothings; or, simultaneously display the first virtual body, the first virtual clothing, the second virtual body, and the edited second virtual body.

7. The method according to claim 1, wherein, the determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points further includes: obtain the distances between the corresponding matching points in the set of matching points.

8. The method according to claim 7, wherein, the determining the second virtual clothing adapted to the second virtual body based on the spatial points corresponding to the points to be determined includes: for other points on the second virtual body except the points to be determined, determine the spatial points corresponding to the other points; determine the second virtual clothing adapted to the second virtual body based on the spatial points corresponding to the points to be determined and the spatial points corresponding to the other points.

9. The method according to any one of claims 1 to 8, wherein, the determining the second virtual clothing adapted to the second virtual body according to the second virtual body and the set of matching points includes: determine the first grid position of the first virtual body in a predetermined grid and the second grid position of the second virtual body in the predetermined grid; obtain the difference between the first grid position and the second grid position; perform a deformation process on the first virtual clothing according to the set of matching points and the difference to obtain the second virtual clothing adapted to the second virtual body.

10. A virtual object processing method, wherein, includes: display a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on an interaction interface; display a second virtual body of a second virtual object on the interaction interface; receive an adaptation instruction; in response to the adaptation instruction, display a second virtual clothing adapted to the second virtual body on the interaction interface, wherein the second virtual clothing is determined according to the second virtual body and a set of matching points, the second virtual clothing is determined based on the spatial points corresponding to the points to be determined on the second virtual body, the spatial points corresponding to the points to be determined are determined according to the distances between the corresponding matching points of the points to be determined, the set of matching points is the set of matching points between the first virtual body and the first virtual clothing, and the set of matching points is determined according to a first distance and a second distance, the first distance is the distance from any point to be matched on the first virtual clothing to the first virtual body, and the second distance is the distance from the point corresponding to the point to be matched in the first virtual body to the first virtual clothing.

11. A virtual object processing method, Characterized in that, Comprising: Displaying a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on a live page; Displaying second virtual bodies of a plurality of second virtual objects uploaded by a viewer account on the live page; Receiving a selection operation of selecting a target second virtual body from the second virtual bodies of the plurality of second virtual objects; In response to the selection operation, displaying second virtual clothing adapted to the target second virtual body on the live page, wherein the second virtual clothing is determined according to the target second virtual body and a set of matching points, the second virtual clothing is determined according to spatial points corresponding to points to be determined on the second virtual body, the spatial points corresponding to the points to be determined are determined according to the distances between corresponding matching points of the points to be determined, the set of matching points is a set of matching points between the first virtual body and the first virtual clothing, and the set of matching points is determined according to a first distance and a second distance, the first distance is the distance from any point to be matched on the first virtual clothing to the first virtual body, and the second distance is the distance from the point corresponding to the point to be matched in the first virtual body to the first virtual clothing.

12. A virtual object processing device, Characterized in that, Comprising: A first acquisition module for acquiring a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body; A first determination module for determining a set of matching points between the first virtual body and the first virtual clothing, wherein the set of matching points is determined according to a first distance and a second distance, the first distance is the distance from any point to be matched on the first virtual clothing to the first virtual body, and the second distance is the distance from the point corresponding to the point to be matched in the first virtual body to the first virtual clothing; A second acquisition module for acquiring a second virtual body of a second virtual object; A second determination module for determining, according to the second virtual body and the set of matching points, second virtual clothing adapted to the second virtual body, wherein the second virtual clothing is determined according to spatial points corresponding to points to be determined on the second virtual body, and the spatial points corresponding to the points to be determined are determined according to the distances between corresponding matching points of the points to be determined.

13. A virtual object processing device, Characterized in that, Comprising: A first display module for displaying a first virtual body of a first virtual object and a first virtual clothing adapted to the first virtual body on an interaction interface; A second display module for displaying a second virtual body of a second virtual object on the interaction interface; A first receiving module for receiving an adaptation instruction; A third display module, configured to respond to the adaptation instruction and display, on the interaction interface, a second virtual clothing item adapted to the second virtual body, where the second virtual clothing item is determined based on the second virtual body and a set of matching points, the second virtual clothing item is determined based on spatial points corresponding to points to be determined on the second virtual body, and the spatial points corresponding to the points to be determined are determined according to the distances between the corresponding matching points of the points to be determined, where the set of matching points is the set of matching points between the first virtual body and the first virtual clothing item, and the set of matching points is determined based on a first distance and a second distance, the first distance being the distance from any point to be matched on the first virtual clothing item to the first virtual body, and the second distance being the distance from the point corresponding to the point to be matched in the first virtual body to the first virtual clothing item.

14. A virtual object processing device characterized in that it includes: A fourth display module, configured to display, on a live broadcast page, a first virtual body of a first virtual object and a first virtual clothing item adapted to the first virtual body; A fifth display module, configured to display, on the live broadcast page, second virtual bodies of a plurality of second virtual objects uploaded by a viewer account; A second receiving module, configured to receive a selection operation of selecting a target second virtual body from the second virtual bodies of the plurality of second virtual objects; A sixth display module, configured to respond to the selection operation and display, on the live broadcast page, a second virtual clothing item adapted to the target second virtual body, where the second virtual clothing item is determined based on the target second virtual body and a set of matching points, the second virtual clothing item is determined based on spatial points corresponding to points to be determined on the second virtual body, and the spatial points corresponding to the points to be determined are determined according to the distances between the corresponding matching points of the points to be determined, the set of matching points being the set of matching points between the first virtual body and the first virtual clothing item, and the set of matching points being determined based on a first distance and a second distance, the first distance being the distance from any point to be matched on the first virtual clothing item to the first virtual body, and the second distance being the distance from the point corresponding to the point to be matched in the first virtual body to the first virtual clothing item.

15. A storage medium characterized in that the storage medium includes a stored program, where, when the program runs, it controls the device where the storage medium is located to execute the virtual object processing method according to any one of claims 1 to 11.

16. A computer device characterized in that it includes: a memory and a processor the memory stores a computer program; the processor is configured to execute the computer program stored in the memory, and when the computer program runs, it causes the processor to execute the virtual object processing method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Clothing manufacturing method and device, storage medium and electronic device

    CN109741138A

  • Method and program for providing virtual fitting service

    KR1020170068741A