AI_SkinBody_Vending_Patent_Spec

Abstract

The present invention relates to a device for providing customized skin and health products that integrates AI skin analysis, BIA body composition analysis, and vending functions. The device includes a face alignment bay, a shooting unit, a condensation suppression unit, a body composition measurement unit, a control unit, a product storage and dispensing unit, and a payment unit. The control unit analyzes the skin condition using a facial image and analyzes body composition using BIA measurements based on a two-hand contact method, then integrates these results to calculate a health and skin index. Additionally, based on the analysis results, it recommends and automatically dispenses cosmetics, nutrition bars, vitamins, or functional products. The present invention enables stable measurement even in high-temperature and high-humidity environments and can be utilized in gyms, saunas, hotels, airports, medical tourism, and K-beauty service sectors through multilingual avatar consultation.

Description

Technology Field

[0001] The present invention relates to body composition analysis using artificial intelligence (AI), computer vision, and bioimpedance analysis (BIA), alignment bays, vending systems, multilingual avatar consultation, cloud integration, automatic sales of K-beauty cosmetics, automatic sales of nutrition bars and supplements, condensation suppression technology in high-temperature and high-humidity environments, and technology for application in high-temperature and high-humidity industrial environments such as gyms, saunas, locker rooms, airports, and hotels. More specifically, the invention relates to AI skin analysis based on facial imaging, body composition analysis based on two-hand insertion and contact, an AI prescription and recommendation engine integrating the results of the two analyses, a vending device that automatically dispenses customized products (cosmetics, nutrition bars, vitamins, etc.) to the user based on the results, a multilingual metahuman avatar consultation function, an alignment bay and condensation suppression device for eliminating interference from water vapor, moisture, and fine particles, a narrow-space type imaging unit for privacy protection, and a convergence platform applicable across all industries in hospital, gym, spa, and hotel environments. Background Technology

[0002] Existing AI skin diagnosis solutions based on cosmetic stores or mobile apps suffer from problems such as significantly varying accuracy depending on lighting and angles, and low reproducibility during repeated measurements due to the lack of an alignment device to maintain a consistent position of the user's face. Additionally, in high-temperature and high-humidity environments such as gyms, saunas, locker rooms, and spas, lens condensation and camera performance degradation occur frequently, leading to reduced accuracy in skin analysis. Furthermore, in diverse climatic environments like Korea and Vietnam, differences in illumination and humidity cause an increase in error rates even with the same equipment.

[0003] Meanwhile, body composition devices used in fitness centers and hospitals are not only large and expensive to install, but they are also generally not integrated with face-based skin analysis systems. Consequently, there are virtually no solutions available that provide customized health and beauty prescriptions by comprehensively analyzing skin and body composition conditions. Furthermore, there is a lack of vending machine structures that seamlessly connect users to the purchase of nutritional supplements, bars, and protein products based on body composition results and lifestyle information.

[0004] In existing systems, the separation of skin analysis results and the product purchasing process leads to high customer churn, and the lack of multilingual consultation capabilities makes it difficult to provide sufficient explanations to foreign users. While privacy protection is critical in actual store and locker room operations, there is also an issue where solutions based on photographing users' bare faces lack structural considerations regarding this.

[0005] Therefore, a new system is required that integrates skin analysis and body composition analysis to operate stably even in high-temperature and high-humidity environments, and can implement multilingual avatar consultation and vending machine functions in a single device. The problem to be solved

[0006] [Purpose of the Invention]

[0007] The main objectives of the present invention are as follows.

[0008] First, it maximizes the accuracy and reproducibility of AI skin analysis by ensuring the fixed posture, distance, and angle of the face through alignment bays.

[0009] Second, by introducing a condensation suppression and thermal circulation structure, the camera lens and internal sensor are designed to operate stably even in high-temperature and high-humidity environments such as saunas, locker rooms, and after exercise.

[0010] Third, it provides a comprehensive AI health and skin scoring model that integrates skin and body composition results by simultaneously performing AI facial analysis and BIA body composition analysis on a single device.

[0011] Fourth, based on the results of the above integrated analysis, a system is implemented to automatically sell cosmetics, nutrition bars, vitamins, functional beverages, etc., according to the user's condition.

[0012] Fifth, by having multilingual metahuman avatars provide real-time shooting guides, result explanations, and product information, it offers the same level of consultation experience to customers using various languages, such as Korean, English, Vietnamese, and Chinese.

[0013] Sixth, the goal is to design a platform usable in various locations such as hospitals, dermatology clinics, gyms, hotels, golf courses, and airports, thereby establishing a convergence service ecosystem encompassing medical, beauty, and tourism.

[0014] Seventh, it integrates personal information protection, filming security, and financial payments (POS, QR, NFC, etc.), and provides a foundation that can be expanded into VR / metaverse, medical tourism, and international marriage counseling booths in the future. means of solving the problem

[0015] [Overview of the Invention]

[0016] The AI-based skin and body composition integrated analysis and cosmetic and nutrition bar vending machine according to the present invention includes the following hardware and software components.

[0017] 1. Hardware Configuration

[0018] (1) Alignment Bay: Includes left and right side wall panels, a jaw fixing part, and an upper lighting panel to minimize errors in height, angle, and distance of the user's face.

[0019] (2) Condensation suppression device: Includes a heating film around the camera lens, an air exhaust fan, a water vapor blocking structure, and a humidity sensor to prevent condensation in high temperature and high humidity environments.

[0020] (3) High refresh rate camera and IR sensor: Includes an RGB camera and an infrared (IR) sensor for precise imaging of facial skin condition, and a depth sensor as needed.

[0021] (4) Two-hand insertable BIA body composition sensor module: Analyzes body composition by measuring electrical impedance through palm and finger contact electrodes.

[0022] (5) Environmental sensor: Measures temperature, humidity, illuminance, brightness, fine moisture, etc., and is used for correcting analysis values ​​and protecting the device.

[0023] (6) Voice recognition microphone and speaker: Handles multilingual voice guidance and user voice input.

[0024] (7) Large touch display: Displays analysis results, recommended products, avatar consultation screens, etc., and receives touch input.

[0025] (8) Product storage cartridge and automatic discharge module: Stores products such as cosmetics and nutrition bars, and automatically discharges selected products.

[0026] (9) Payment module: Supports various payment methods such as fingerprint, QR, NFC, and card, and can also recognize welfare cards or free cards.

[0027] (10) Privacy protection panel: Protects the user's privacy by restricting the shooting area to block the gaze of others.

[0028] 2. Software Configuration

[0029] (1) AI face analysis engine: A model that extracts skin characteristics such as pores, wrinkles, skin tone, moisture, dead skin cells, and erythema, and calculates an index.

[0030] (2) Body composition analysis algorithm: An algorithm that estimates body water, muscle mass, fat percentage, basal metabolic rate, stress index, etc. using BIA measurements.

[0031] (3) Skin and body composition integrated scoring model: An AI model that calculates a Health-Derma Score by integrating skin condition and body composition condition.

[0032] (4) Multilingual Avatar Consultation Engine: Provides guidance on shooting, explanation of results, product recommendations, and hospital guidance in multiple languages ​​through metahuman avatars.

[0033] (5) K-Beauty personalized recommendation algorithm: An algorithm that recommends cosmetics based on skin and body composition indicators and regional characteristics.

[0034] (6) Nutrition bar and vitamin recommendation algorithm: Recommends nutrition bars and protein bars based on body fat percentage, muscle mass, hydration status, stress level, etc.

[0035] (7) Reinforcement learning-based recommendation engine: A reinforcement learning module that improves recommendation quality by learning purchase history and repeated usage patterns.

[0036] (8) Cloud-based remote management server: performs device status monitoring, software updates, log collection, and statistical analysis.

[0037] (9) Payment and Shipment Control System: Controls the automatic shipment of goods based on payment approval and records transaction details. Effects of the invention

[0038] . Brief explanation of the drawing

[0039] Figure 1 is a drawing illustrating the overall structure of an alignment bay (including left and right fixed panels, top lighting, and bottom support bar). FIG. 2 is a diagram showing the configuration of a condensation suppression device, including (a) a heating film, (b) an air exhaust fan, and (c) a humidity sensor location. Figure 3 shows a layout diagram of a camera and IR sensor for capturing a user's face. Figure 4 is a drawing illustrating a two-hand insertable BIA body composition measuring unit (electrode and palm contact pad). Figure 5 shows the user interface (UI) and user experience (UX) flowchart of the entire device. Figure 6 is a block diagram showing the structure of an AI analysis server. Figure 7 is a block diagram of the cosmetic and nutrition bar recommendation system algorithm. Figure 8 shows the vending machine cartridge structure and motor discharge flow diagram. Figure 9 is a diagram illustrating the logic of a multilingual avatar consultation engine. FIG. 10 is a cross-sectional view showing a moisture-resistant structure in a high-temperature and high-humidity environment such as a gym or sauna. Specific details for implementing the invention

[0040] Examples

[0041] The invention will be explained in more detail below through embodiments. The following embodiments are merely examples to aid in understanding the invention and do not limit the technical scope of the invention.

[0042] Example 1: Improvement of face imaging precision using an alignment bay

[0043] The alignment bay is designed to ensure that the user's face is always captured from the same distance, angle, and height. The left and right side wall panels secure the user's head position from both sides, and the inner surface is treated with a matte coating to minimize optical reflection. The bottom chin support bar is positioned at a height where the user can lightly rest their chin, ensuring the shooting position is fixed without the need for strong force. The top integrated lighting panel maintains a color temperature in the 5500–6500K range, and the light output is automatically adjusted by an ambient light sensor. When the user positions their face inside the alignment bay, the camera generates a 3D Face Mesh to evaluate alignment accuracy, and if it falls below the standard, it indicates the direction for fine-tuning via LED guide lines. Additionally, an image stabilization algorithm is applied to eliminate minute shake during the moment of capture.

[0044] Example 2: High temperature and high humidity performance of the condensation suppression device

[0045] The heating film is positioned within a 2–3 cm area around the camera lens to maintain a temperature in the 35–40°C range, thereby preventing moisture condensation on the lens surface. A triple-sealing structure is formed on the top and sides to block external water vapor from entering directly, and internal heat and moisture are forcibly expelled through air circulation ducts. A condensation detection sensor detects minute moisture concentrations, and if the threshold is exceeded, the AI ​​automatically adjusts the heating intensity and fan speed. This allows the device to operate normally even in environments with relative humidity exceeding 90%.

[0046] Example 3: AI-based face analysis function

[0047] When a user's face is captured, skin tone deviation, wrinkle depth and direction, pore size and density, keratin distribution, sebum volume estimation, moisture volume estimation, erythema, pigmentation, skin elasticity, and sagging indices are extracted. Additionally, estimated indices for basal metabolism and skin regeneration capacity can be calculated based on the facial image.

[0048] Example 4: Body Composition (BIA) Measurement Function

[0049] When the user inserts both hands into the lower insertion port, a low-voltage alternating current is injected through the palm contact electrodes and finger electrodes, and electrical impedance is measured. Through this, body water content (TBW), upper body core muscle mass, body fat percentage, estimation of basal metabolic rate, stress index based on electrodermal analysis (EDA), and estimated peripheral temperature and blood flow indices are calculated. As health indicators closely related to skin condition, these provide meaningful information during integrated analysis.

[0050] Example 5: Calculation of Integrated Skin and Body Composition AI Index

[0051] In this invention, skin and body composition data are integrated into a single AI model to calculate a Health-Derma Score. For example, if skin condition is good but the body fat percentage is 30% or higher, low water retention capacity is assessed as having a high risk of increased sensitivity in the future; if muscle mass is insufficient, the risk of skin tone deterioration due to reduced facial blood flow is reflected. Additionally, if dehydration and a deficiency in specific vitamins are estimated, a high recommendation index for nutrition bars or supplements is calculated.

[0052] Example 6: Multilingual Avatar Consultation Function

[0053] The present invention provides a metahuman-based multilingual avatar to enhance user trust. The avatar performs functions such as providing guidance on posture, facial expressions, and lighting before shooting, guiding stability during shooting, summarizing results after shooting, explaining recommended cosmetics and nutritional bars, and providing information on nearby hospitals, dermatology clinics, gyms, and hotels. Languages ​​such as Korean, English, Vietnamese, Thai, and Chinese are supported, and reinforcement learning can be applied to perform highly reliable communication by learning user purchasing patterns and response data.

[0054] Example 7: Cosmetics automatic vending function

[0055] The recommendation algorithm combines and recommends products such as Vitamin C ampoules when skin tone deteriorates, moisturizing creams when dead skin cells increase, oil-control serums when sebum and body fat increase, and hypoallergenic soothing lines when sensitivity increases. The control unit checks the inventory of the selected product and drives the motor of the corresponding cell to move the product to the dispensing port. During the dispensing process, a sensor detects whether the product has passed through; if the product fails to be dispensed, it records an error and guides the user to the retry or refund procedure.

[0056] Example 8: Nutrition Bar / Protein Bar Automatic Vending Function

[0057] The nutrition bar storage unit includes a temperature control function in the range of 18–25°C or 5–15°C to maintain the quality of products such as protein bars and collagen jellies. By comprehensively analyzing skin and health risks resulting from protein deficiency, vitamin B deficiency, excessive carbohydrate intake, and excessive fat intake, different recommended ratios for energy bars, protein bars, and vitamin bars can be set.

[0058] Example 9: Installation Case in a High Temperature and High Humidity Region

[0059] The device of the present invention can be installed in areas without specialized dermatology clinics, such as rural Vietnam, rural regions of Korea, and mountainous areas. In such cases, it can identify early signs of abnormalities, such as seborrheic dermatitis, psoriasis, or the risk of acne exacerbation, through basic skin condition checks and body composition analysis, and output a message recommending a visit to a nearby public health center or hospital if necessary. Such operation contributes to the improvement of public health and access to medical care.

[0060] Example 10: Linkage of Tourism, Medical Tourism, and International Marriage Services

[0061] The device can be integrated with medical tourism platforms (such as VR MEDI TOUR & HOME) via the cloud. Analysis results and purchase history are automatically transmitted to the company's AI account, enabling integrated customer management between Korea and Vietnam, and allowing health and skin condition information to be used as reference material at medical tourism or international marriage consultation booths.

[0062] [Variation Example]

[0063] The present invention may be implemented in various modifications, and the following modifications are examples for embodying the technical scope of the invention.

[0064] Variant Example 1: Multi-electrode expansion of body composition measurement method - Structure that improves BIA accuracy by adding 2 back-of-hand electrodes in addition to 4 palm electrodes.

[0065] Variation Example 2: Electric height adjustment of face alignment bay - The entire alignment bay is adjusted up and down by an electric column within the range of 110cm to 180cm.

[0066] Variant Example 3: Temperature and Humidity Automatic Synchronization Environment Correction AI - Automatically calculates skin measurement correction coefficients by sensing external temperature, humidity, and illuminance in real time.

[0067] Variation Example 4: 3D Face Mesh-based body shape and skeletal shape estimation - Additional body shape and posture AI indices calculated by analyzing face depth and curvature.

[0068] Variant Example 5: Infrared (IR)-based blood flow estimation function - Analyzes the cause of skin tone deterioration by measuring changes in micro-blood flow using IR patterns.

[0069] Variant Example 6: RGB+IR+Depth composite camera structure - Composite sensor configuration for measuring face depth and curvature with high precision.

[0070] Variant Example 7: Condensation removal type heating wire + Peltier hybrid structure - addition of a module capable of switching between cooling and heating.

[0071] Variant Example 8: Addition of cooling and heating function to the nutrition bar storage section - Refrigerated storage function suitable for protein bar and collagen products.

[0072] Variant Example 9: Real-time integration with mobile apps - Synchronizing analysis results with a smartphone app to link with shopping, health management, and hospital appointments.

[0073] Variant Example 10: AI-based early detection of skin diseases - Detects abnormal patterns such as seborrheic dermatitis, atopic dermatitis, psoriasis, and acne, and recommends visiting a medical institution.

[0074] Variant Example 11: Voice recognition-based non-face-to-face self-guidance - Allows for voice selection of menus for people with disabilities who have difficulty using their hands.

[0075] Variant Example 12: User Key Recognition Automatic Adjustment System - Automatically adjusts camera and alignment bay positions by recognizing height with a depth sensor.

[0076] Variant Example 13: ID-based age verification - Perform ID OCR-based age verification to protect minors.

[0077] Variant Example 14: Personalized nutrition bar recommendation based on health data - Differential application of recommendation algorithms based on protein intake, body fat percentage, and hydration status.

[0078] Variant Example 15: Region-specific cosmetics and nutrition bar recommendations - Utilizing a region-specific model that reflects temperature, humidity, and environmental factors.

[0079] Variant Example 16: Expansion of payment methods - Supports card, QR, NFC, and face-based payments.

[0080] Variant Example 17: Free provision card system for the socially vulnerable - Provides a free payment function using cards issued by local governments and welfare institutions.

[0081] Variant Example 18: VR MEDI TOUR & HOME cloud integration - Utilization of skin and body composition data for medical tourism, international marriage counseling, etc.

[0082] Variant Example 19: Large-scale rural / health center installation model - Supports battery and offline mode, enabling operation even in areas with poor infrastructure.

[0083] Variant Example 20: Golf Course / Sauna Specialized Version - Designed to enable accurate analysis and product sales even in high-temperature and high-humidity environments with sweat after exercise. Industrial applicability

[0084] The AI-based skin and body composition integrated analysis and cosmetic and nutrition bar vending device according to the present invention can be installed and utilized in various locations such as gyms, saunas, locker rooms, hotels, resorts, golf courses, spas, shopping malls, airports, train stations, hospitals, dermatology clinics, public health centers, and public institutions. In particular, in countries where the K-beauty industry and medical tourism industry are developed, new revenue models can be created through the recommendation and sale of customized cosmetic and nutrition bars based on skin and body composition conditions.

[0085] In addition, since the present invention can be operated stably in hot and humid regions such as Vietnam and in rural and mountainous areas lacking medical infrastructure, it can contribute to basic skin and health condition checks and the improvement of public health. When data is aggregated on a central server through cloud integration, various secondary uses are also possible, such as national health statistics, analysis of skin and nutritional status by region, and design of customized public campaigns.

[0086] Therefore, the present invention is applicable to a wide range of industry entities, including K-beauty companies, healthcare companies, medical institutions, medical tourism agencies, resort and hotel operators, local governments, and public health centers, and possesses high industrial applicability in domestic and international medical, beauty, wellness, and tourism markets.

Claims

Claim 1 An AI-based skin and body composition integrated analysis and cosmetic and nutrition bar vending device comprising an AI-based skin analysis module, a body composition analysis module, a face alignment bay, a shooting lighting unit, a condensation suppression unit for high temperature and high humidity environments, a cosmetic vending unit, a nutrition bar vending unit, and a control unit, wherein the control unit performs face shooting, skin feature extraction, body composition (BIA) analysis, calculation of an integrated skin and health score, product recommendation, and automatic dispensing control. Claim 2 The above-described face alignment bay is a device comprising a side wall panel, a jaw fixing part, and an upper lighting integrated panel to maintain the error in height, angle, and distance of the user's face within ±2mm. Claim 3 The above-mentioned imaging unit is a device including an RGB camera, an IR camera, and a depth sensor. Claim 4 The above condensation suppression unit is a device comprising a heating film and a Peltier cooling / heating module. Claim 5 The above control unit is a device including an AI model that calculates a Health-Derma Score by integrating skin analysis results and body composition analysis results. Claim 6 The above nutrition bar sales unit is a device that includes the function of storing various foods, such as protein bars and vitamin bars, by controlling the temperature within the range of 18 to 25°C or 5 to 15°C. Claim 7 The above-mentioned cosmetic sales unit is a device including a temperature and humidity monitoring sensor and a motor-driven discharge device. Claim 8 The above device includes a multilingual avatar consultation function and is a device that provides Korean, English, Vietnamese, Thai, Chinese, etc. Claim 9 The above body composition analysis module is a device comprising a 4-electrode or 8-electrode BIA electrode structure. Claim 10 The above control unit is a device including a reinforcement learning-based product recommendation algorithm.

Images