Metacosm user selective matching fashion exhibition virtual system and method thereof

By generating virtual models with user characteristics in the virtual reality fashion show, the problem of insufficient authenticity and learnability of fashion display in virtual reality is solved, and a more realistic and interactive fashion display experience is achieved.

CN118941705APending Publication Date: 2024-11-12SQ TECH (SHANGHAI) CORP +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410866860.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-28
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing technology cannot truly reflect the user's situation after wearing clothes in virtual reality fashion shows, and lacks interactivity and learningability, making it difficult for users to choose their favorite models as the learning object of Meizi Meiyi.

Method used

By prompting the user to select body modeling data, fashion modeling data and obtaining the user's face image in the server-side device, performing 3D modeling to generate virtual models with user characteristics, and embed corresponding walking posture features, so that the virtual models can be used in Move in the 3D virtual fashion display space according to these features.

Benefits of technology

It improves the authenticity and learnability of fashion displays, allowing users to learn beautiful postures and beauty through the walking posture of virtual models, and improve their own demeanor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941705A_ABST
    Figure CN118941705A_ABST
Patent Text Reader

Abstract

The invention discloses a meta universe user selective matching fashion exhibition virtual system and a method thereof, and the method comprises the steps: prompting a user to select stature modeling data and fashion modeling data through a server device, obtaining a user face image as face modeling data, and executing 3D modeling according to the data to generate a virtual model with user features; and the walking posture characteristics corresponding to the stature modeling data are embedded as the teaching basis of the posture and posture beautifying instrument. And then, when the server device drives the display to display the 3D virtual fashion display space and the virtual model therein, the virtual model correspondingly moves according to the embedded walking posture characteristics to serve as a walking demonstration, so that the technical effect of improving the authenticity and learnability of fashion display is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a fashion show virtual system and method thereof, in particular to a metaverse user selective matching fashion show virtual system and method thereof. Background Art

[0002] In recent years, with the vigorous development of the Metaverse, various Metaverse applications have sprung up. The concept of the Metaverse has not only attracted a large number of technology companies to invest and develop, but also aroused widespread attention and interest from the public. However, how to improve the usability of the Metaverse has always been a problem that all manufacturers are eager to solve. This involves not only technical challenges, but also how to meet the growing needs and expectations of users.

[0003] Generally speaking, the metaverse can be realized based on technologies such as virtual reality, augmented reality, and mixed reality to provide diverse application scenarios such as display, games, advertising, and social interaction. Taking the application scenario of display as an example, virtual reality can be used to hold a fashion show, allowing participants to watch various clothes and accessories in an immersive way. This immersive experience can not only get rid of the limitations of space and allow audiences around the world to participate, but also greatly enhance the influence and participation of the event. However, although virtual reality technology can provide an immersive experience, it often cannot truly reflect the situation of participants wearing clothes. This means that the effect of the model wearing clothes on the catwalk seen by the audience in virtual reality may be very different from when they actually wear the same clothes. Secondly, the existing technical means make it difficult for participants to arbitrarily choose their favorite models to walk the catwalk as the learning object of beauty and etiquette, which makes the fashion show lack interactivity and learnability.

[0004] In summary, it can be seen that the existing technology has long had the problem of insufficient authenticity and learnability of fashion display, so it is necessary to propose improved technical means to solve this problem. Summary of the invention

[0005] The present invention discloses a metaverse user selective matching fashion show virtual system and method.

[0006] First, the present invention discloses a virtual system for selectively matching fashion shows for Metaverse users, which includes: a display, a database host, and a server-side device. The display is used to display a 3D virtual fashion display space and display virtual models in the 3D virtual fashion display space; the database host is used to store fashion modeling data, user feature data, and model feature data, each of which includes external features and walking posture features. Next, in the server-side device, which is connected to the display and the database host, the server-side device includes: a non-temporary computer-readable storage medium and a hardware processor. Among them, the non-temporary computer-readable storage medium is used to store multiple computer-readable instructions; and the hardware processor is electrically connected to the non-temporary computer-readable storage medium to execute the multiple computer-readable instructions, so that the hardware processor is configured to: prompt the user to select one of the user feature data and the model feature data as body modeling data, select one of the fashion modeling data, and obtain the user's facial image as facial modeling data; perform 3D modeling to generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated facial modeling data, wherein the virtual model is embedded with walking posture features corresponding to the body modeling data; and drive the display in the displayed 3D virtual fashion display space to make the virtual model move accordingly according to the embedded walking posture features.

[0007] In addition, the present invention also discloses a virtual method for selectively matching fashion shows for users of the metaverse, the steps of which include: connecting a display and a server-side device to each other, and connecting the server-side device to a database host, wherein the database host stores fashion modeling data, user feature data and model feature data, and each user feature data and model feature data includes external features and walking posture features; the server-side device prompts the user to select one of the user feature data and the model feature data as body modeling data, select one of the fashion modeling data, and obtain the user's facial image as facial modeling data; the server-side device performs 3D modeling to jointly generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated facial modeling data, wherein the virtual model is embedded with walking posture features corresponding to the body modeling data; and the server-side device drives the display to display a 3D virtual fashion display space, and displays the virtual model in the 3D virtual fashion display space, and causes the virtual model to move accordingly according to the embedded walking posture features.

[0008] The system and method disclosed in the present invention are as described above. The difference from the prior art is that the present invention prompts the user to select body modeling data, fashion modeling data and obtains the user's facial image as facial modeling data through the server-side device, and then performs 3D modeling based on these data to generate a virtual model with user characteristics, and embeds the walking posture characteristics corresponding to the body modeling data as the teaching basis of beauty posture and beauty. Then, when the server-side device drives the display to display the 3D virtual fashion display space and the virtual model therein, the virtual model is simultaneously moved accordingly according to the embedded walking posture characteristics as a walking demonstration.

[0009] Through the above-mentioned technical means, the present invention can achieve the technical effect of improving the authenticity and learnability of fashion display. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A system block diagram of the fashion show virtual system for selective matching of metaverse users of the present invention.

[0011] Figure 2 A flow chart of the method for selectively matching fashion show virtual methods for metaverse users of the present invention.

[0012] Figure 3 FIG. 4 is a system block diagram of a fashion virtual platform according to the present invention.

[0013] Figure 4A and Figure 4B A schematic diagram of generating a virtual model by applying the present invention.

[0014] Description of reference numerals:

[0015] 110: Display

[0016] 120: Database host

[0017] 130: Server device

[0018] 131: Non-transitory computer-readable storage medium

[0019] 132: Hardware Processor

[0020] 310: Display

[0021] 320: Fashion Database

[0022] 330: Fashion virtual platform

[0023] 331: Avatar embedding module

[0024] 332: Model Imaging Module

[0025] 333: Resource acquisition module

[0026] 334: Integration Module

[0027] 400: Select block

[0028] 401: User feature data

[0029] 402: Model feature data

[0030] 403a~403n: Fashion modeling data

[0031] 404: Face acquisition block

[0032] 405: Determine the generated component

[0033] 410: Display

[0034] 411: Controller

[0035] 420: 3D virtual fashion display space

[0036] 421: Avatar

[0037] 422: Runway

[0038] Step 210: Connect the display and the server device to each other, and connect the server device to a database host, wherein the database host stores at least one fashion modeling data, at least one user feature data and at least one model feature data, each of which includes external features and walking posture features.

[0039] Step 220: The server device prompts the user to select one of the user feature data and the model feature data as body modeling data, select one of the fashion modeling data, and obtain the user's facial image as facial modeling data.

[0040] Step 230: The server-side device performs 3D modeling to generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated face modeling data, wherein the virtual model is embedded with the walking posture feature corresponding to the body modeling data.

[0041] Step 240: The server device drives the display to display the 3D virtual fashion display space, and displays the virtual model in the 3D virtual fashion display space, and enables the virtual model to move accordingly according to the embedded walking posture feature. DETAILED DESCRIPTION

[0042] The following will describe the implementation methods of the present invention in detail with reference to the accompanying drawings and embodiments, so that the implementation process of how the present invention applies technical means to solve technical problems and achieve technical effects can be fully understood and implemented accordingly.

[0043] First, please refer to Figure 1 , Figure 1 The system block diagram of the virtual fashion show system for selective matching of Metaverse users of the present invention includes: a display 110, a database host 120 and a server-side device 130. The display 110 is used to display a 3D virtual fashion display space and to display virtual models in the 3D virtual fashion display space. In addition, in actual implementation, the display 110 can be implemented using a head-mounted display (HMD), a naked-eye 3D display or the like. The present invention does not limit the type of the display 110. Any display device that can present 3D does not deviate from the application scope of the present invention.

[0044] The database host 120 is used to store fashion modeling data, user feature data and model feature data, each of which includes external features and walking posture features. In actual implementation, the database host 120 can be a computer host running a non-relational database (NoSQL), a relational database (Relational Database) or other types of databases. In fact, the database host 120 can also be integrated with the server device 130, for example, directly running a database storing fashion modeling data, user feature data and model feature data on the server device 130.

[0045] In the server-side device 130, which is connected to the display 110 and the database host 120, the server-side device 130 includes: a non-transitory computer-readable storage medium 131 and a hardware processor 132. Among them, the non-transitory computer-readable storage medium 131 is used to store a plurality of computer-readable instructions. In actual implementation, the non-transitory computer-readable storage medium 131 may include a hard disk, an optical disk, a flash memory or the like. In addition, the computer-readable instructions are executed by the server-side device 130, and the computer-readable instructions may be assembly language instructions, instruction set architecture instructions, machine instructions, machine-related instructions, microinstructions, firmware instructions, or source code or object code (Object Code) written in any combination of one or more programming languages, and the programming languages ​​include object-oriented programming languages, such as: Common Lisp, Python, C++, Objective-C, Smalltalk, Delphi, Java, Swift, C#, Perl, Ruby and PHP, etc., and conventional procedural programming languages, such as: C language or similar programming languages.

[0046] The hardware processor 132 is electrically connected to the non-temporary computer-readable storage medium 131 to execute the computer-readable instructions, so that the hardware processor 132 is configured to: prompt the user to select one of the user feature data and the model feature data as the body modeling data, select one of the fashion modeling data, and obtain the user's facial image as the facial modeling data; perform 3D modeling to generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated facial modeling data, wherein the virtual model is embedded with the walking posture characteristics corresponding to the body modeling data; and drive the display to make the virtual model move accordingly according to the embedded walking posture characteristics in the displayed 3D virtual fashion display space. In actual implementation, the server-side device 130 can be connected to multiple sensors, the sensors are used to sense height, weight, measurements, body shape and skin color to generate the external features, and the walking posture characteristics are generated by the sensors using motion capture technology. In addition, the server-side device 130 allows receiving 2D fashion data, and the hardware processor 132 performs at least one of digital image processing, computer-aided design and machine learning to convert the 2D fashion data into corresponding fashion modeling data. In addition, the server-side device 130 can also execute a crawler program, which automatically obtains at least one of fashion images and videos with copyright information from the network, and filters out the part of the copyright information that records the permission for commercial use as 2D fashion data. Furthermore, the server-side device 130 can also be connected to a controller to control the movement of the virtual model and display the virtual model from different perspectives. The tracker includes a head tracker, a handheld controller and a hand tracker.

[0047] It should be particularly noted that in actual implementation, the present invention may be partially or completely implemented based on hardware. For example, one or more components in the system may be implemented by hardware processors such as integrated circuit chips, system on chip (SoC), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), etc. The non-transitory computer-readable storage medium described in the present invention carries computer-readable instructions (or computer program instructions) for enabling the hardware processor to implement various aspects of the present invention. The non-transitory computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. The non-transitory computer-readable storage medium may be, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: a hard disk, a random access memory, a read-only memory, a flash memory, an optical disk, a floppy disk, and any suitable combination thereof. The non-transitory computer-readable storage medium used herein is not to be interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., an optical signal through a fiber optic cable), or an electrical signal transmitted through a wire. In addition, the computer-readable instructions described herein can be downloaded from the non-transitory computer-readable storage medium to each computing / processing device, or downloaded to an external computer device or external storage device through a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, hubs, and / or gateways. The network card or network interface in each computing / processing device receives the computer-readable instructions from the network and forwards the computer-readable instructions for storage in the non-transitory computer-readable storage medium in each computing / processing device.

[0048] See also Figure 2 , Figure 2The method flow chart of the virtual method for selectively matching fashion show for metaverse users of the present invention comprises the following steps: connecting the display 110 and the server-side device 130 to each other, and connecting the server-side device 130 to the database host 120, wherein the database host 120 stores fashion modeling data, user feature data and model feature data, each of which includes external features and walking posture features (step 210); the server-side device 130 prompts the user to select one of the user feature data and the model feature data as the body modeling data, and any one of the fashion modeling data as the body modeling data; Select one, and obtain the user's facial image as facial modeling data (step 220); the server-side device 130 performs 3D modeling to generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated facial modeling data, wherein the virtual model is embedded with the walking posture characteristics corresponding to the body modeling data (step 230); and the server-side device 130 drives the display to display the 3D virtual fashion display space, and displays the virtual model in the 3D virtual fashion display space, and makes the virtual model move accordingly according to the embedded walking posture characteristics (step 240). Through the above steps, the server-side device 130 can prompt the user to select the body modeling data, the fashion modeling data, and obtain the user's facial image as the facial modeling data, and then perform 3D modeling according to these data to generate a virtual model with user characteristics, and embed the walking posture characteristics corresponding to the body modeling data as the teaching basis of beauty and beauty. Then, when the server-side device 130 drives the display 110 to display the 3D virtual fashion display space and the virtual model therein, the virtual model is simultaneously moved accordingly according to the embedded walking posture characteristics as a walking demonstration.

[0049] The following match Figures 3 to 4B The following description is given by way of example: Figure 3 Indicated, Figure 3 Schematic diagram of the system block of the fashion virtual platform of the present invention. Figure 1The illustrated server device 130 can run a fashion virtual platform 330, which can include: an avatar embedding module 331, a model imaging module 332, a resource acquisition module 333 and an integration module 334. Among them, the avatar embedding module 331 obtains the user avatar that can be embedded in the virtual avatar through a camera device; the model imaging module 332 generates a virtual avatar of the model / individual; the resource acquisition module 333 obtains the selected fashion data from the fashion database 320 through the network; the integration module 334 embeds the obtained user avatar into the generated virtual avatar, and generates the clothing of the virtual avatar according to the obtained fashion data so as to be displayed in all directions (e.g., different viewing angles can be switched) through the display 310. In other words, the computer-readable instructions can be classified according to functions to form the programs of the above-mentioned different functional modules, and the hardware processor 132 of the server device 130 executes the programs of these functional modules, so that the server device 130 generates a virtual avatar (i.e., a virtual model) with personal characteristics, for example, the appearance of the virtual model is the same or similar to that of the user. The virtual model itself is embedded with walking posture characteristics. When the display 310 displays the virtual model in the 3D virtual fashion display space, the virtual model will move according to the walking posture characteristics to serve as a walking demonstration teaching of beauty and etiquette.

[0050] like Figure 4A and Figure 4B Indicated, Figure 4A and Figure 4B A schematic diagram of generating a virtual model by applying the present invention. Figure 4A , the server-side device 130 may generate a selection block 400 to prompt the user to select one of the user feature data 401 and the model feature data 402 as body modeling data. For example, if you want to use your own body, select your own user feature data; if you want to use a designated model for display, select the designated model feature data. Then, the user may select one of the fashion modeling data (403a-403n) to select the clothing that he likes and wants to display. Next, the user may click on the face acquisition block 404 to acquire the user's facial image, for example: upload a photo file to the server-side device 130, or directly capture the user's face through a camera component and transmit it to the server-side device 130 for use as facial modeling data.

[0051] After the user clicks to confirm the generation component 405, the server-side device 130 can perform 3D modeling to generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated face modeling data. In particular, in the process of generating the virtual model, the walking posture features corresponding to the body modeling data will be embedded into the virtual model, so that the virtual model can move according to the embedded walking posture features. Figure 4BAs shown, the server-side device 130 drives the display 410 to display the 3D virtual fashion display space 420, and displays the aforementioned generated virtual model 421 in the 3D virtual fashion display space 420, for example, making the virtual model 421 move accordingly on the catwalk 422 according to the embedded walking posture characteristics. In actual implementation, assuming that the user feature data is generated by sensing the user's external features such as height, weight, measurements, body shape and skin color through multiple sensors connected to the server-side device 130, and the walking posture characteristics are generated by capturing the user's walking posture through the sensors using motion capture technology, then the virtual model 421 will have the same height, weight, measurements, body shape and skin color as the user, and the walking posture of the virtual model 421 will also be similar to that of the user, so the user can directly examine whether the wearing and matching of clothing is suitable for the real self from the virtual model 421 and its walking posture. On the other hand, assuming that it suits him / herself and the user wants to further improve his / her posture, the user can reselect the favorite model in the selection block 400, and then load the corresponding model feature data to generate a virtual model with the same walking posture as the specified model and the same or similar appearance as the user, and through an immersive experience, observe the walking posture of the virtual model from different angles and imitate it through the operation of the controller 411, so as to achieve the purpose of learning beautiful posture and improving one's own posture.

[0052] In summary, it can be seen that the difference between the present invention and the prior art is that the server-side device prompts the user to select body modeling data, fashion modeling data, and obtains the user's facial image as facial modeling data, and then performs 3D modeling based on these data to generate a virtual model with user characteristics, and embeds the walking posture characteristics corresponding to the body modeling data as the teaching basis of beauty and beauty. Then, when the server-side device drives the display to display the 3D virtual fashion display space and the virtual model therein, the virtual model is simultaneously moved accordingly according to the embedded walking posture characteristics as a walking demonstration. This technical means can solve the problems existing in the prior art, and then achieve the technical effect of improving the authenticity and learnability of fashion display.

[0053] Although the present invention is disclosed as above with the aforementioned embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of patent protection of the present invention shall be subject to the scope defined by the claims attached to this specification.

Claims

1. A virtual fashion show system for selective matching of Metaverse users, the system comprising: A display for displaying a 3D virtual fashion display space and displaying a virtual model in the 3D virtual fashion display space; A database host, used to store at least one fashion modeling data, at least one user characteristic data and at least one model characteristic data, each of which includes external characteristics and walking posture characteristics; as well as A server-side device is used to connect the display and the database host, and the server-side device includes: a non-transitory computer-readable storage medium storing a plurality of computer-readable instructions; and A hardware processor is electrically connected to the non-transitory computer-readable storage medium and is used to execute the plurality of computer-readable instructions, so that the hardware processor is configured to: Prompting the user to select one of the user feature data and the model feature data as body modeling data, to select one of the fashion modeling data, and to obtain a facial image of the user as facial modeling data; Performing 3D modeling to generate the virtual model based on the body modeling data, the selected fashion modeling data, and the generated face modeling data, wherein the virtual model is embedded with the walking posture feature corresponding to the body modeling data; as well as The display is driven to make the virtual model move accordingly according to the embedded walking posture feature in the displayed 3D virtual fashion display space.

2. The metaverse user selective matching fashion show virtual system as described in claim 1, wherein the server-side device is connected to multiple sensors, and the sensors are used to sense height, weight, measurements, body shape and skin color to generate the external features, and to generate the walking posture features through motion capture technology through the sensors.

3. The metaverse user selective matching fashion show virtual system as described in claim 1, wherein the server-side device allows receiving at least one 2D fashion data, and the hardware processor performs at least one of digital image processing, computer-aided design and machine learning to convert the 2D fashion data into the corresponding fashion modeling data.

4. The metaverse user selective matching fashion show virtual system as described in claim 3, wherein the server-side device executes a crawler program, which automatically obtains at least one of the fashion images and videos with copyright information from the network, and filters out the part of the copyright information that records permission for commercial use as the 2D fashion data.

5. The metaverse user selective matching fashion show virtual system as described in claim 1, wherein the server-side device is connected to a controller for controlling the movement of the virtual model and displaying the virtual model from different perspectives, and the controller includes a head tracker, a handheld controller and a hand tracker.

6. A virtual method for selectively matching metaverse users with fashion shows, comprising the following steps: Connecting the display to the server device, and connecting the server device to a database host, wherein the database host stores at least one fashion modeling data, at least one user feature data, and at least one model feature data, each of which includes an external feature and a walking posture feature; The server-side device prompts the user to select one of the user feature data and the model feature data as body modeling data, select one of the fashion modeling data, and obtains the user's facial image as facial modeling data; The server-side device performs 3D modeling to generate a virtual model based on the body modeling data, the selected fashion modeling data, and the generated face modeling data, wherein the virtual model is embedded with the walking posture feature corresponding to the body modeling data; and The server-side device drives the display to display the 3D virtual fashion display space, displays the virtual model in the 3D virtual fashion display space, and enables the virtual model to move accordingly according to the embedded walking posture feature.

7. A virtual fashion show method for selectively matching metaverse users as described in claim 6, wherein the server-side device is connected to a plurality of sensors, the sensors are used to sense height, weight, measurements, body shape and skin color to generate the external features, and the walking posture features are generated by the sensors using motion capture technology.

8. A virtual method for selectively matching fashion shows among Metaverse users as described in claim 6, wherein the server-side device allows receiving at least one 2D fashion data and performing at least one of digital image processing, computer-aided design and machine learning to convert the 2D fashion data into corresponding fashion modeling data.

9. The metaverse user selective matching fashion show virtual method as described in claim 8, wherein the server-side device executes a crawler program, which automatically obtains at least one of the fashion images and videos with copyright information from the network, and filters out the part of the copyright information that records permission for commercial use as the 2D fashion data.

10. The metaverse user selective matching fashion show virtual method as described in claim 6, wherein the server-side device is connected to a controller for controlling the movement of the virtual model and displaying the virtual model from different perspectives, and the controller includes a head tracker, a handheld controller and a hand tracker.