3D Nail Recognition Using Point Clouds for Precise Printing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing intelligent nail decorating machines face limitations in recognizing multiple nails simultaneously due to the need for pre-coating with nail gel, which affects decorating time and accuracy, and fail to account for nail deflection angles and tilt situations.
Innovation Solution
A method involving image acquisition, 3D point cloud calculation, and calibration to determine true coordinates and tilt angles of nails, using a recognition device and segmentation network to generate nail mask images, followed by conversion to a calibration coordinate system for precise nail positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If pre-coating with nail gel is used to enable nail recognition, then nail recognition becomes possible, but decorating time increases and recognition accuracy is restricted
Solution Approach 1:
The system performs preliminary actions by capturing images of the hand and nails before the actual decorating process begins. The recognition device acquires images and the processing system identifies nail positions, contours, and angles in advance, allowing the decorating machine to prepare printing patterns beforehand without requiring time-consuming pre-coating steps during the decorating process itself.
Solution Approach 2:
The patent replaces the mechanical pre-coating process with an optical recognition system. Instead of using nail gel with different colors to enable recognition, the system uses image capture devices and computer vision algorithms to automatically identify and locate nails, eliminating the need for physical pre-coating materials and reducing decorating time.
2Device complexity
If only single nail printing is performed, then printing process is simple, but deflection angle and tilt information is not recognized
Solution Approach 1:
The system transitions from two-dimensional image recognition to three-dimensional spatial understanding by calculating not only the position and contour of nails but also their deflection angles and tilt angles. The processing system determines spatial orientation parameters including left/right tilt angles and front/back tilt angles, adding dimensional information that enables accurate pattern alignment on nails with various orientations.
Solution Approach 2:
The printing system is designed with multi-functionality to handle both simple and complex nail scenarios. It can process single nails or multiple nails simultaneously, accommodate various nail angles and orientations, and adapt to different hand positions. The system universally applies the same recognition and calculation algorithms regardless of the specific configuration of nails being decorated.
Data Source
AI summary
A method and system for nail recognition and positioning are disclosed. The method includes: S1, acquiring, by a recognition device, first image information of an operating area through photographing, sending the first image information to a target-detecting network to generate corresponding second image information, and comparing to obtain nail mask images after performing segmentation; S2, obtaining true coordinates of a nail point cloud through calculation of an original 3D point cloud and the nail mask images; S3, converting the nail point cloud to a calibration coordinate system, which is determined by locating a printing device below the identification device; S4, traversing each nail to obtain angle information of the nails according to point cloud information of the nails; and S5, projecting point cloud coordinates of each nail to a two-dimensional plane, and obtaining a deflection angle of each nail.