A screen-castable intelligent mirror based on radar three-dimensional modeling and an e-commerce virtual fitting and data synchronization system

Abstract

The application discloses a screen-castable intelligent mirror based on radar three-dimensional modeling and an e-commerce virtual fitting and data synchronization system, and belongs to the technical field of smart home, non-contact sensing and e-commerce. The system takes radar non-contact body measurement and three-dimensional modeling as the core, realizes whole body three-dimensional data acquisition and model reconstruction of a human body through a radar module, and realizes face recognition, face state monitoring and body health record through a camera. The three-dimensional body modeling is realized independently by the radar. The intelligent mirror body adopts a semi-transparent mirror touch display structure, and has mirror reflection, high-definition display and touch operation functions. The system supports wireless screen projection and reverse touch control, and can complete commodity browsing, virtual fitting and order operation on the mirror. The system also realizes user identity recognition, face and body state monitoring, historical data comparison and change tracking, and supports data synchronization of human model data, fitting record and e-commerce server. The application integrates radar body modeling, mirror touch, virtual fitting, health monitoring and data synchronization, has clear function division, high privacy security, is convenient to use, has simple structure and controllable cost, and is suitable for home and commercial scenes.

Description

Technical Field

[0001] This invention relates to smart home, non-contact 3D measurement, identity recognition, status monitoring, wireless projection, touch control, e-commerce virtual try-on and data synchronization technology, and particularly to a smart mirror with projection capability based on radar 3D modeling and an e-commerce virtual try-on and data synchronization system. Background Technology

[0002] Existing virtual fitting devices mostly rely on optical image acquisition, posing a risk of privacy leaks, and cannot penetrate clothing to obtain real body shape data, making it difficult to achieve accurate virtual fitting results. Traditional smart mirrors only have basic mirror reflection and simple display functions, lacking contactless 3D body modeling capabilities, failing to meet users' core need for accurate fitting. Furthermore, existing devices fail to integrate on-mirror touch operation, wireless projection, e-commerce interaction, and facial and body health monitoring, resulting in fragmented functions and a poor user experience. In addition, the local and cloud synchronization mechanisms for human 3D model data, virtual fitting records, and user health status data are incomplete, hindering consistent data management across multiple terminals and scenarios. Currently, the market lacks a complete smart mirror system that integrates radar-based non-contact 3D modeling and e-commerce virtual fitting, along with data synchronization, health monitoring, wireless projection, and reverse touch control. Summary of the Invention

[0003] 1. Technical problems to be solved:

[0004] To address the shortcomings of existing technologies, this invention aims to provide a smart mirror with projection capabilities based on radar 3D modeling, along with an e-commerce virtual try-on and data synchronization system. This solves the privacy risks and inaccurate body measurement issues caused by existing virtual try-on devices relying on optical data acquisition. It also addresses the technical deficiencies of traditional smart mirrors, such as lack of 3D modeling capabilities and fragmented functions. Furthermore, it resolves the problems of imperfect data synchronization mechanisms, high hardware costs, and difficulties in mass production associated with related devices. This invention achieves accurate body modeling through clothing using non-contact radar technology. It employs a separate design for radar modeling and camera recognition modules, mitigating privacy risks from the outset. It integrates wireless projection, reverse touch control, virtual try-on, health monitoring, and data synchronization into a unified system, creating a closed-loop process from body measurement to e-commerce ordering. Simultaneously, it utilizes a lightweight hardware design, delegating complex calculations to an external smart terminal, reducing hardware costs and adapting to various home and commercial scenarios. This effectively addresses the shortcomings of existing integrated smart mirror systems on the market.

[0005] 2. Technical Solution:

[0006] To solve the above-mentioned technical problems, the present invention adopts the following technical solution: a smart mirror with projection capability based on radar 3D modeling and an e-commerce virtual try-on and data synchronization system, including a smart mirror body, a semi-transparent mirror touch display module, a radar 3D body measurement module, a camera module, a wireless projection and reverse touch module, an identity recognition and status monitoring module, a data synchronization module, and a main control module. The main control module is the core control center of the system. All functional modules work together to realize the integrated functions of non-contact body measurement, virtual try-on, mirror operation, status monitoring, and data synchronization.

[0007] The main control module is a low-power embedded control unit that does not perform complex calculations. It is only responsible for connecting, driving, and transmitting basic instructions to various hardware modules, completing data transfer between modules, device start / stop management, and simple logic control. It is adapted to the lightweight hardware design of the system and effectively reduces hardware costs.

[0008] The radar 3D body shape measurement module adopts non-contact radar sensing technology, with low operating power and electromagnetic radiation levels lower than those of everyday consumer electronic devices such as Wi-Fi and mobile phones, making it safe and harmless to the human body. It can penetrate clothing to obtain the 3D contour information of the entire human body without contact, independently complete the measurement of the dimensions of multiple parts of the human body and the reconstruction of 3D digital models, and does not rely on cameras for body shape modeling, providing accurate basic data of human body shape for virtual try-on.

[0009] The camera module is dedicated to face recognition, facial feature acquisition, facial state analysis, and body health recording. It does not participate in 3D body modeling and works independently from the radar 3D body measurement module. This ensures the realization of identity recognition and state monitoring functions while avoiding the privacy leakage risks associated with optical image acquisition.

[0010] The semi-transparent mirror touch display module combines mirror reflection, high-definition display output, and capacitive touch functions. While displaying the operation interface and virtual try-on effect, it maintains the mirror reflection function, so that the human body image and the displayed content are presented synchronously. Users can directly complete various touch operations on the mirror surface.

[0011] The wireless projection and reverse touch control module supports a universal wireless projection protocol, enabling stable wireless connection with external smart terminals and one-click projection of the screen. It can also synchronously map the touch operation of the mirror to the external terminal for control, allowing users to complete the entire e-commerce process, such as browsing products, triggering virtual try-on, and submitting orders, on the mirror.

[0012] The identity recognition and status monitoring module automatically identifies the user's identity through the camera, retrieves the user's historical body shape, clothing fitting, facial and body posture data, realizes the comparison and analysis of the current facial, body posture and skin condition with historical data, completes the tracking of body posture changes and health data recording, and forms a long-term user status monitoring system.

[0013] The data synchronization module enables automatic synchronization of human 3D model data, virtual try-on records, and user facial and body posture data between local devices, the cloud, and e-commerce servers. This ensures data consistency across multiple terminals and scenarios, facilitating cross-device viewing and use. The system's core functions are radar 3D body modeling and e-commerce virtual try-on. Modules work collaboratively to achieve a fully integrated process, from non-contact body measurement and 3D model reconstruction to virtual try-on on a mirror, e-commerce ordering, identity recognition, status monitoring, and data synchronization. Furthermore, a lightweight hardware architecture significantly reduces hardware costs and structural complexity.

[0014] 3. Beneficial effects

[0015] Compared with the prior art, the beneficial effects of the present invention are as follows: (1) This invention uses radar 3D modeling technology to achieve non-contact human body shape measurement through clothing. It does not require optical image acquisition, avoids the risk of body privacy leakage from the hardware source, and radar measurement can obtain real human body shape data. The modeling accuracy is significantly higher than that of traditional optical acquisition and 3D scanning methods. It solves the technical problems of high privacy risk and inaccurate body shape measurement of existing virtual fitting devices, and has outstanding advantages in body privacy and data security.

[0016] (2) The present invention adopts a separate design of radar three-dimensional body shape measurement module and camera module. The radar module is dedicated to body shape modeling, and the camera module is dedicated to face recognition and status monitoring. The two work independently and do not interfere with each other, which not only improves the accuracy of body shape modeling and the effectiveness of identity recognition, but also avoids functional interference and privacy risks caused by the multi-functionality of a single module. The division of functions is clear and the security of identity privacy is high.

[0017] (3) The present invention adopts a lightweight hardware design. The main control module is a low-power embedded control unit, which only undertakes basic module connection and instruction transmission functions. Complex data processing, interface rendering, e-commerce interaction and other operations are completed by external smart terminals. There is no need to install a high-performance processor and independent operating system, which greatly reduces hardware cost and structural complexity, facilitates mass production and market popularization, and solves the problem of high hardware cost of existing smart devices.

[0018] (4) This invention integrates radar non-contact body measurement, 3D modeling, semi-transparent mirror touch display, wireless projection and reverse touch, e-commerce virtual try-on, identity recognition, facial and body status monitoring, and local and cloud data synchronization in a highly integrated manner. It realizes a complete technical closed loop from human body modeling to virtual try-on, e-commerce ordering, and then to status monitoring and data synchronization. It solves the defects of existing equipment in terms of scattered functions and poor user experience. The user process is smooth and the functions are complete, providing users with a one-stop user experience.

[0019] (5) The main body of the smart mirror of the present invention supports multiple installation and placement methods, and can be adapted to family daily dressing and body health monitoring scenarios, as well as commercial virtual fitting and merchandise sales scenarios such as clothing stores and shopping malls. It takes into account both personal use and commercial operation, and is highly practical.

[0020] (6) The radar three-dimensional body shape measurement module used in this invention has low operating power and electromagnetic radiation level lower than that of everyday electronic devices such as mobile phones and wireless routers. It is highly safe to use and can reduce users' concerns about radiation from close-range electronic devices.

[0021] (7) The present invention sets up an independent data synchronization module to realize the automatic synchronization of human body three-dimensional model, fitting records, user status data in local, cloud and e-commerce server, ensure data consistency of multiple terminals and multiple scenarios, solve the technical problem of imperfect data synchronization mechanism of existing related devices, facilitate users to retrieve and use their own data across devices and scenarios, and improve the flexibility and ease of use of the system.

[0022] Low-cost implementation This system can be implemented using a lightweight hardware structure: the main body of the smart mirror only includes a semi-transparent touch display panel, a radar 3D body measurement module, a camera module, and a simplified main control unit, requiring no independent operating system or... With a dedicated internet access module, all data processing, interface rendering, e-commerce interaction, and complex calculations can be completed by external smart terminals (mobile phones, tablets, etc.), significantly reducing hardware requirements while achieving all core functions. The low cost and structural complexity facilitate mass production and market penetration. Attached Figure Description

[0023] Figure 1 This is a block diagram of the overall structure of the present invention.

[0024] Explanation of the labels in the diagram: 10. Main Control Module 20 Semi-transparent mirror touch display modules 30 Radar 3D Shape Measurement Module 40 camera modules 50 Wireless projection and reverse touch module 60. Identity Recognition and Status Monitoring Module 70 Data Synchronization Module Detailed Implementation

[0025] Example 1 (For everyday household use) 1. The system is powered on and started. The main control module completes the initialization self-test of each hardware module, and the semi-transparent mirror touch display module enters the working state.

[0026] 2. The camera module performs facial recognition, and the identity recognition module automatically retrieves the user's historical data and displays the comparison results between the current facial and body posture and the historical records.

[0027] 3. The user stands in the designated position in front of the mirror, and the radar 3D body shape measurement module automatically completes the multi-directional acquisition of the human body's three-dimensional data through clothing. The radar point cloud data processing algorithm completes the data optimization and 3D model reconstruction to generate an accurate and personalized human body 3D digital model.

[0028] 4. Users can wirelessly project their mobile phone screen onto the mirror and use touch controls on the mirror to browse clothing products on an e-commerce platform.

[0029] 5. The system binds the virtual clothing model to the 3D human body model, and displays the human image and virtual clothing on a mirror surface to complete the virtual try-on.

[0030] 6. The data synchronization module automatically synchronizes the human body 3D model, fitting records, and related user data.

[0031] 7. Users can submit orders by using the mirrored touch screen.

[0032] Example 2 (For commercial store experience) 1. When a customer enters a commercial space and approaches the smart mirror, the main control module wakes up all the hardware modules of the system, completing the automatic system wake-up.

[0033] 2. The camera module performs temporary identification of customers and creates a temporary experience profile for them.

[0034] 3. The customer stands in the designated position in front of the mirror. The radar 3D body shape measurement module quickly completes multi-angle acquisition of the full-body 3D body shape. Through radar point cloud data processing algorithms, data optimization and 3D model reconstruction are completed immediately. Generate a suitable 3D digital model of the human body.

[0035] 4. The store has pre-projected the product display terminal onto the smart mirror. Store staff or customers can directly select in-store or online clothing products through the mirror's touch operation, and the system automatically loads the corresponding 3D model of the clothing.

[0036] 5. The semi-transparent mirror touch display module displays the superimposed virtual clothing effect of the customer's image in real time.

[0037] 6. Customers can switch clothing styles, sizes, and colors via the mirror touch screen and view different matching effects.

[0038] 7. After trying on the clothes, customers can view detailed product information, place an order, or add the item to their favorites via the mirror touchscreen. The data synchronization module saves the fitting record and body data for future customer trials. Consumption.

Claims

1. A smart mirror with projection capability based on radar 3D modeling and an e-commerce virtual try-on and data synchronization system, characterized in that, include: The smart mirror body, semi-transparent mirror touch display module, radar 3D body shape measurement module, camera module, wireless projection and reverse touch module, identity recognition and status monitoring module, data synchronization module, and main control module; The radar 3D body shape measurement module is used to obtain the 3D contour information of the whole human body in a non-contact manner that can penetrate clothing, and generate a 3D digital model of the human body. The camera module is used for face recognition, facial feature acquisition, facial state analysis, and body health recording. The semi-transparent mirror touch display module combines mirror reflection, display output, and capacitive touch functions, and is used to display human body image, virtual try-on effect, and operation interface; The wireless screen projection and reverse touch module is used to establish a wireless connection with an external smart terminal to realize screen projection and map the mirror touch operation to the external terminal control. The identity recognition and status monitoring module is used for user identity recognition, facial status analysis, body posture change comparison and historical record tracking; The data synchronization module is used to synchronize data between the human body 3D model, fitting records, user status data and the e-commerce server. The main control module is the core control center of the system, responsible for the connection, driving and basic instruction transmission of each hardware module; This system uses radar 3D body modeling and e-commerce virtual try-on as its core functions, realizing the integration of non-contact body measurement, virtual try-on, mirror operation, status monitoring and data synchronization.

2. The system according to claim 1, characterized in that, The radar 3D body shape measurement module does not rely on a camera for body shape modeling and can independently complete the measurement of the dimensions of multiple parts of the human body and the reconstruction of a 3D digital model.

3. The system according to claim 1, characterized in that, During virtual try-on, the semi-transparent mirror touch display module overlays and displays the real human body image with the virtual clothing generated based on the three-dimensional digital model in real time, and displays them in the same proportion.

4. The system according to claim 1, characterized in that, The wireless projection and reverse touch module supports the wireless projection protocol, enabling one-click projection from external smart terminals and synchronously mapping mirror touch operations to external terminals to complete product browsing, virtual try-on, and order submission.

5. The system according to claim 1, characterized in that, The identity recognition and status monitoring module can automatically identify the user's identity through the camera, retrieve historical data, and perform comparative analysis of the current facial, body posture, and skin condition with historical data.

6. The system according to claim 1, characterized in that, The semi-transparent mirror touch display module maintains its mirror reflection function while displaying the interface, so that the human body image and the displayed content are presented simultaneously.

7. The system according to claim 1, characterized in that, The data synchronization module supports automatic synchronization of human 3D model data, fitting records, and user status data between local and cloud environments.

8. The system according to claim 1, characterized in that, The smart mirror supports multiple installation and placement methods, making it suitable for both home and commercial use.

Images