Method and apparatus for providing lifting procedure information

Abstract

The present invention relates to a method for providing lifting procedure information and an apparatus for implementing the method, wherein the apparatus may comprise: an input unit configured to receive a facial image of a subject for a lifting procedure; an image analysis unit configured to extract, from the facial image, points located at a lateral canthus, a tragus, a corner of the mouth, and an alar base, and to extract a point located at an intersection of straight lines generated from the extracted points; a calculation unit configured to generate a new point by calculating distances between the extracted points; a data generation unit configured to derive an entry point, an exit point, and a procedure vector from the extracted points or the generated point; and an output unit configured to output the derived entry point, the exit point, and the procedure vector, thereby providing optimal lifting procedure information to a user according to a facial shape and structure of the subject for the lifting procedure.

Description

Method and device for providing lifting procedure information

[0001] The present invention relates to a method for providing lifting procedure information and an apparatus for implementing said method.

[0002] Facial lifting procedures are commonly performed to improve skin elasticity, reduce wrinkles, and restore a youthful and firm facial contour. Traditionally, these procedures relied primarily on manual techniques and the practitioner's experience, often resulting in inconsistent outcomes. While advancements in imaging technology and medical devices have improved the accuracy of these procedures, there are still limitations in planning for various facial structures in a standardized manner.

[0003] Existing facial lifting procedures often fail to adequately reflect individual anatomical differences. Many systems rely on subjective evaluations or static measurements, which do not account for facial geometry, skin elasticity, or changes in specific target areas. Furthermore, these methods have limitations in practicality as they do not provide dynamic visualization or real-time adjustment capabilities during the planning phase.

[0004] As the demand for cosmetic procedures increases, there is a growing need for customized solutions tailored to an individual's facial structure and treatment goals. A system capable of analyzing facial features, calculating optimal entry and exit points for lifting procedures, and generating customized treatment vectors can significantly improve the efficiency and consistency of lifting procedures.

[0005] Conventional technologies propose methods and systems for extracting feature points from face images and generating face recognition or feature vectors based thereon. Registered Patent No. 10-1998112 includes a technology that generates feature vectors of face images using algorithms such as LBP and SIFT and improves the accuracy of face recognition through PCA analysis. Meanwhile, Registered Patent No. 10-2137329 focuses on a method for extracting face feature vectors by utilizing a deep learning model to enable face image analysis that minimizes the influence of lighting and location. However, the aforementioned prior art technologies are primarily designed for face recognition and feature analysis and do not provide personalized treatment information based on comprehensive data including face proportions, physical distance and inclination of the procedure.

[0006] Therefore, in order to resolve the aforementioned problems, there is a growing need to develop a system capable of providing optimal lifting procedure information tailored to the unique facial structure of the subject.

[0007] The present invention aims to provide a method for providing lifting procedure information by extracting and generating key points from an image generated by photographing the face of a subject for a lifting procedure, and outputting entry points, exit points, and procedure vectors required of the practitioner during the lifting procedure.

[0008] In addition, the present invention aims to provide a device for providing lifting procedure information comprising an input unit, an image analysis unit, a calculation unit, a data generation unit, and an output unit.

[0009] However, the problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned problems will be clearly understood by those skilled in the art from the description below.

[0010] One aspect of the present invention is a method performed by a device, wherein

[0011] a) A step of obtaining an image generated by photographing the face of a subject for a lifting procedure;

[0012] b) a step of extracting a first point located at the lateral canthus, a second point located at the tragus, a third point located at the mouth corner, and a fourth point located at the alar base from the acquired face image, and extracting a first straight line connecting the first and second points, a second straight line tangent to the jaw line and having the same slope, and a fifth point located at the intersection point of the second straight line and the third straight line connecting the third and fourth points;

[0013] c) generating a sixth point located 0.8 cm to 1.2 cm in the direction of tragus on the second straight line from the fifth point extracted in step b), generating a seventh point located at half the distance between the third point and the fifth point on the third straight line, measuring the length of the first straight line and generating an eighth point at a point 4 cm from the second point on the first straight line if the length is less than 8.5 cm, and at a point 4.5 cm from the 22nd point on the first straight line if the length is 8.5 cm or more, and generating a ninth point and a tenth point at points 0.8 cm to 1.2 cm to the right and left, respectively, of the eighth point on the first straight line;

[0014] d) a step of creating a first entry point at a point 1.5 cm to 2.5 cm away from the ninth point on a straight line connecting the seventh point and the ninth point created in step c), creating a second entry point at a point 1.5 cm to 2.5 cm away from the eighth point on a straight line connecting the eighth point and the fifth point, creating a third entry point at a point 1.5 cm to 2.5 cm away from the tenth point on a straight line connecting the tenth point and the sixth point, creating the seventh point as a first exit point, the fifth point as a second exit point, and the sixth point as a third exit point, and creating a procedure vector that indicates the first entry point and the first exit point, the second entry point and the second exit point, and the third entry point and the third exit point, respectively, in a forward direction;

[0015] e) A method for providing lifting procedure information comprising the step of outputting the entry point, exit point, and procedure vector generated in step d) above.

[0016] According to one embodiment of the present invention, after step c), instead of steps d) to e), d) a first entry point created at a point 1.5 cm to 2.5 cm away from the ninth point on a straight line connecting the seventh point and the ninth point created in step c), a second entry point created at a point 1.5 cm to 2.5 cm away from the eighth point on a straight line connecting the eighth point and the fifth point, a third entry point created at a point 1.5 cm to 2.5 cm away from the tenth point on a straight line connecting the tenth point and the sixth point, and the seventh point created as a first exit point, the fifth point as a second exit point, and the sixth point as a third exit point;

[0017] e) a step of calculating an L1 value by measuring the distance between the first entry point and the seventh point generated in step d), calculating an L2 value by measuring the distance between the second entry point and the fifth point, and calculating an L3 value by measuring the distance between the third entry point and the sixth point;

[0018] f) a step of generating a fourth exit point at a point L1 away from the first entry point on a straight line connecting the first entry point and the seventh point in the above step e), generating a fifth exit point at a point L2 away from the first entry point on a straight line connecting the second entry point and the fifth point, generating a sixth exit point at a point L3 away from the third entry point and the sixth point on a straight line connecting the third entry point and the sixth point, and generating a procedure vector that indicates the first entry point and the first exit point, the first entry point and the fourth exit point, the second entry point and the second exit point, the second entry point and the fifth exit point, the third entry point and the third exit point, and the third entry point and the sixth exit point, respectively, in the forward direction;

[0019] g) Lifting procedure information can be provided by performing a step of outputting the entry point, exit point, and procedure vector generated in step f) above.

[0020] Another aspect of the present invention is a method performed by a device, wherein

[0021] a) A step of obtaining an image generated by photographing the face of a subject for a lifting procedure;

[0022] b) a step of extracting a first point located at the lateral canthus, a second point located at the tragus, a third point located at the mouth corner, and a fourth point located at the alar base from the acquired face image, and extracting a first straight line connecting the first and second points, a second straight line tangent to the jaw line and having the same slope, and a fifth point located at the intersection point of the second straight line and the third straight line connecting the third and fourth points;

[0023] c) generating a sixth point located at a point 0.3 cm to 0.7 cm in the direction of tragus on the second straight line from the fifth point extracted in step b), generating a seventh point located at 2 / 3 of the distance between the third point and the fifth point on the third straight line, measuring the length of the first straight line and generating an eighth point at a point 4 cm from the second point on the first straight line if the length is less than 8.5 cm, and at a point 4.5 cm from the 22nd point on the first straight line if the length is 8.5 cm or more, and generating a ninth point and a tenth point at a point 0.3 cm to 0.7 cm to the right and left, respectively, of the eighth point on the first straight line;

[0024] d) a step of creating a first entry point at a point 1.5 cm to 2.5 cm away from the ninth point on a straight line connecting the seventh point and the ninth point created in step c), creating a second entry point at a point 1.5 cm to 2.5 cm away from the tenth point on a straight line connecting the tenth point and the sixth point, creating the seventh point as a first exit point and the sixth point as a second exit point, and creating a procedure vector that indicates the first entry point and the first exit point, and the second entry point and the second exit point, respectively, in a forward direction;

[0025] e) A method for providing lifting procedure information comprising the step of outputting the entry point, exit point, and procedure vector generated in step d) above.

[0026] According to one embodiment of the present invention, after step c), instead of steps d) to e), d) a step of creating a first entry point at a distance of 1.5 cm to 2.5 cm from the ninth point on a straight line connecting the seventh point and the ninth point created in step c), and creating a second entry point at a distance of 1.5 cm to 2.5 cm from the tenth point on a straight line connecting the tenth point and the sixth point;

[0027] e) a step of calculating an L1 value by measuring the distance between the first entry point and the seventh point generated in step d), and calculating an L2 value by measuring the distance between the second entry point and the sixth point;

[0028] f) a step of creating a third exit point at a point L1 away from the first entry point on a straight line connecting the first entry point and the seventh point in the above step e), creating a fourth exit point at a point L2 away from the first entry point on a straight line connecting the second entry point and the sixth point, creating the seventh point as the first exit point and the sixth point as the second exit point, and creating a procedure vector that indicates the first entry point and the first exit point, the first entry point and the third exit point, the second entry point and the second exit point, and the second entry point and the fourth exit point, respectively, in the forward direction; and

[0029] g) It is possible to provide lifting procedure information by performing the step of outputting the entry point, exit point, and procedure vector generated in step f) above.

[0030] According to one embodiment of the present invention, the method may further include the step of measuring the distance between the first point and the second point extracted in step b) and automatically adjusting the slope of the third straight line according to the proportion of the face.

[0031] According to one embodiment of the present invention, the method may further include the step of calculating the distance between the generated entry point and exit point and the angle of the procedure vector to display the procedure vector in three dimensions.

[0032] According to one embodiment of the present invention, the method may further include the step of storing data of the generated entry point, exit point, and procedure vector, and loading previous data to provide an optimized procedure plan for repeated procedures on the same subject.

[0033] Another aspect of the present invention provides a device for providing lifting procedure information, comprising: an input unit for receiving a face image of a subject for a lifting procedure; an image analysis unit for extracting points located at the lateral canthus, the corner of the mouth, and the bottom of the nostril from the face image, and points located at the intersection points of straight lines generated from said points; a calculation unit for generating new points by calculating the distance between said extracted points and said points; a data generation unit for deriving entry points, exit points, and procedure vectors from said extracted or generated points; and an output unit for outputting said derived entry points, exit points, and procedure vectors.

[0034] According to one embodiment of the present invention, the device may further include a web client module for analyzing an image file uploaded by a user, an AI engine for image analysis, and a database server for storing analysis results.

[0035] According to one embodiment of the present invention, the device may further include a data storage unit that stores data of entry points, exit points, and procedure vectors for each procedure subject, and retrieves, analyzes, and modifies the stored data during repeated procedures.

[0036] According to one embodiment of the present invention, the output unit may further include a user interface configured to allow a user to check and modify an entry point, an exit point, and a procedure vector.

[0037] According to the method and apparatus for providing lifting procedure information of the present invention, optimal lifting procedure information based on the facial shape and structure of the subject of the lifting procedure can be provided to the user.

[0038] FIG. 1 is a drawing for explaining a lifting procedure information providing device according to one embodiment of the present invention.

[0039] FIG. 2 is a diagram showing major landmarks extracted from a face image obtained in a method for providing lifting procedure information according to an embodiment of the present invention and straight lines derived therefrom.

[0040] FIG. 3 is a diagram showing the process of deriving an entry point, an exit point, and a procedure vector to perform a procedure using a unidirectional needle with three lifting threads in a method for providing lifting procedure information according to one embodiment of the present invention.

[0041] FIG. 4 is a diagram showing the process of deriving an entry point, an exit point, and a procedure vector to perform a procedure using a bidirectional needle with three lifting threads in a method for providing lifting procedure information according to one embodiment of the present invention.

[0042] FIG. 5 is a diagram showing the process of deriving entry points, exit points, and procedure vectors for two additional procedures using a unidirectional needle after performing three lifting thread procedures in a method for providing lifting procedure information according to one embodiment of the present invention.

[0043] FIG. 6 is a diagram showing the process of deriving entry points, exit points, and procedure vectors for two additional procedures using a bidirectional needle after performing three lifting thread procedures in a method for providing lifting procedure information according to one embodiment of the present invention.

[0044] Throughout this specification, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0045] Throughout this specification, when a component is described as being “connected” to another component, this includes not only cases where a component is directly connected to another component, but also cases where another component exists between the two components to facilitate the connection.

[0046] Throughout this specification, when a component is described as being located "on" another component, this includes not only cases where a component is in contact with another component, but also cases where another component exists between the two components.

[0047] Throughout this specification, terms including ordinal numbers, such as "first" and "second," are used for the purpose of distinguishing one component from another and are not limited by said ordinal numbers. For example, within the scope of the invention, the first component may also be named the second component, and similarly, the second component may be named the first component.

[0048] It should be noted that in assigning reference numbers to the components of each drawing in this specification, identical components are assigned the same number as much as possible, even if they are shown in different drawings.

[0049] The embodiments can be implemented in various forms of products such as personal computers, laptop computers, tablet computers, smartphones, televisions, smart home appliances, kiosks, and wearable devices.

[0050] Artificial Intelligence (AI) systems are computer systems that implement human-level intelligence; unlike existing rule-based smart systems, they are systems in which machines learn and make decisions autonomously. As AI systems improve in recognition accuracy and gain a more accurate understanding of user preferences with continued use, existing rule-based smart systems are gradually being replaced by deep learning-based AI systems.

[0051] Artificial intelligence technology consists of machine learning and component technologies that utilize machine learning. Machine learning is an algorithmic technology that autonomously classifies and learns the characteristics of input data, while component technologies are technologies that mimic the functions of the human brain, such as cognition and judgment, by utilizing machine learning algorithms like deep learning; these technologies comprise fields such as linguistic understanding, visual understanding, reasoning / prediction, knowledge representation, and motion control.

[0052] The various fields where artificial intelligence technology is applied are as follows. Linguistic understanding refers to the technology of recognizing, applying, and processing human language and text, including natural language processing, machine translation, dialogue systems, question answering, and speech recognition / synthesis. Visual understanding refers to the technology of perceiving and processing objects like human vision, including object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and image enhancement. Inference and prediction refers to the technology of logically reasoning and predicting by judging information, including knowledge / probability-based inference, optimization prediction, preference-based planning, and recommendation. Knowledge representation refers to the technology of automatically processing human experiential information into knowledge data, including knowledge construction (data generation / classification) and knowledge management (data utilization). Motion control refers to the technology of controlling autonomous driving of vehicles and the movement of robots, including motion control (navigation, collision, driving) and manipulation control (behavior control).

[0053] Generally, to apply machine learning algorithms to real-world situations, training is performed using a trial-and-error method due to the inherent characteristics of the fundamental methodologies. In particular, deep learning requires hundreds of thousands of iterations. Since it is impossible to execute this in a real physical external environment, training is instead performed through simulations that virtually recreate the actual physical environment on a computer.

[0054] The present invention will be described in more detail below.

[0055] FIG. 1 is a drawing for explaining a lifting procedure information providing device according to one embodiment of the present invention.

[0056] The device according to the present invention includes an input unit (100). The input unit (100) is a module that receives a face image of a subject for a lifting procedure, and the user can upload an image file stored on a computer or smartphone or receive an image captured in real time through the input unit (100). For example, when uploading an image file, the file can be uploaded via a web client or through an external device such as a USB or memory card, and an image captured in real time can be received through a camera module included in the input unit.

[0057] Meanwhile, the input face image may undergo a preprocessing process such as removing background data using an algorithm that automatically extracts only the face area or adjusts the resolution to make it suitable for analysis within the input unit (100), and may detect errors that may occur during the image input process and provide appropriate feedback to the user.

[0058] In addition, the input unit (100) can additionally input information regarding the number of threads used in the lifting procedure and the directionality of the needles used.

[0059] The image analysis unit (200) analyzes a face image input through the input unit (100) to extract key points necessary for a lifting procedure and performs the role of generating additional data based thereon. According to one embodiment, the device may further include a web client module (210) for analyzing an image file uploaded by a user, an AI engine for image analysis, and a database server (220) for storing analysis results, and can precisely analyze the facial structure of the subject of the procedure by utilizing artificial intelligence (AI) based technology, in particular, a Face Landmark Detection model.

[0060] Face Landmark Detection is an AI-based face analysis technology that is an algorithm for automatically recognizing and extracting specific locations (landmark points) on a face image. In this invention, this technology can be utilized to generate key points and intersection points necessary for a procedure. The AI-based face analysis technology can be performed by combining, for example, a Dlib model, a Mediapipe Face Mesh model, or an OpenCV library and a Deep Learning model.

[0061] In the present invention, the image analysis unit (200) first automatically detects a face area in a face image and extracts the coordinates of the lateral canthus, tragus, corner of the mouth, and base of the nostril corresponding to major landmarks in the detected face area. The coordinates are expressed as (x, y) values ​​in pixel units and can be used to determine the facial proportions and symmetry of the subject of the procedure. In addition, a new reference point can be created by generating a straight line from the landmarks and calculating the intersection point of these straight lines. For example, the intersection point between the straight line connecting the lateral canthus and the corner of the mouth and the straight line connecting the tragus and the base of the nostril can be created as a reference point, and such a reference point can be used to set a procedure path by subdividing the subject's facial structure.

[0062] Meanwhile, the AI ​​model can be utilized to generate optimal points by learning the subject's facial characteristics and analyzing asymmetry. Through the AI ​​model, points can be generated after correcting asymmetrical structures by analyzing the distance difference between landmarks on the left and right sides of the face; additionally, newly generated points based on the center point between major landmarks or user-defined rules can be added to the treatment plan.

[0063] In the present invention, the computation unit (300) processes major points (landmarks) extracted or generated from the image analysis unit (200) and relationship data between points to generate new points necessary for a lifting procedure and optimize the procedure path. From this, optimal procedure information can be derived by mathematically and geometrically analyzing the facial structure of the subject of the procedure.

[0064] The Singi calculation unit (300) can calculate the distance between extracted landmark points to analyze the relative size and proportion of the face. For example, in the process of analyzing the size and proportion of the face by calculating the distance between the lateral canthus and the corner of the mouth, the distance between the tragus and the base of the nostril, etc., if two points are denoted as (x1, y1) and (x2, y2), the distance is It can be calculated as such, and by calculating the angle connecting the lateral canthus and the corner of the mouth based on the bottom of the nostril, and calculating the angle based on a vector connecting three points, it can be utilized to set the direction of the procedure vector. In addition, the calculation unit (300) can create a new reference point between facial landmarks based on the analyzed data. For example, it can create a midpoint between the lateral canthus and the corner of the mouth, or create a straight line intersection point between the lateral canthus - corner of the mouth and the tragus - bottom of the nostril.

[0065] Meanwhile, the above calculation unit (300) can analyze the subject's facial structure to calculate the degree of left-right asymmetry, generate data to correct the asymmetry, or calculate an optimal procedure vector connecting the entry point and the exit point.

[0066] In the present invention, the data generation unit (400) generates final information required for a lifting procedure based on processed data and derives it in the form of an entry point, an exit point, and a procedure vector. In this specification, the entry point refers to the starting point where a procedure instrument (e.g., a thread lifting cannula or needle) is substantially inserted during the lifting procedure, and the exit point refers to the point where the procedure instrument exits after the lifting procedure, and is set considering the tension of the skin tissue.

[0067] In the data generation unit (400), the entry point is set based on a landmark point of the face (e.g., lateral canthus, corner of the mouth, tragus, etc.) and can be derived by reflecting the data analyzed in the calculation unit (300), and the exit point is connected to the entry point and can be derived based on the calculation result at a location where the lifting effect can be best displayed. In addition, the procedure vector is a line connecting the entry point and the exit point, which determines the direction and intensity of the lifting, and the vector is generated by connecting the coordinates of the entry point and the exit point, and is generated in a direction where the lifting effect can be best displayed.

[0068] According to one embodiment of the present invention, the device may further include a data storage unit (410) that stores data of entry points, exit points, and procedure vectors for each procedure subject, and retrieves, analyzes, and modifies the stored data during repeated procedures. Accordingly, the results generated from the data generation unit (400) can be stored in the data storage unit (410) when necessary and utilized during repeated procedures.

[0069] In the present invention, the output unit (500) is the final step for delivering procedure data to a user, and provides an interface that intuitively provides the lifting procedure data generated by the data generation unit (400) to the practitioner or user. In the output unit (500), the generated entry point, exit point, and procedure vector are graphically represented in a 2D or 3D form. Additionally, detailed information of each point and vector, such as point data including accurate coordinate values ​​of the entry and exit points, distance and angle information between the points, and vector data including the length of the vector, the direction of the vector, the expected tension of the lifting thread, or information on skin deformation caused therefrom, can be provided to the user.

[0070] According to one embodiment of the present invention, the output unit (500) may further include a user interface configured to allow a user to view and modify entry points, exit points, and procedure vectors. Accordingly, the user can adjust the position of entry points or exit points in a drag-and-drop manner, update the connection relationships between points in real time, and reset the optimized procedure path by adjusting the direction and length of the vector. In addition, the user can immediately update and check the expected procedure results based on the modified data.

[0071] The method for providing lifting procedure information according to the present invention can be performed by the device described above and includes the following steps.

[0072] First, the above method performs the step of a) obtaining an image generated by photographing the face of a subject for a lifting procedure.

[0073] The aforementioned image acquisition step is the first step of the method for providing lifting procedure information, and it is a process of accurately and efficiently securing the facial image of the subject. This step guarantees the quality of the input facial image and can serve as a basis for extracting facial landmarks and generating procedure data to be used in subsequent steps.

[0074] In the above image acquisition step, a face image can be acquired by capturing the face in real time or uploading an existing image file, and multiple images captured from various angles can be input to precisely analyze the face asymmetry and 3D structure.

[0075] For example, in the case of real-time recording, the subject of the procedure checks the position of their face through the screen while capturing an image via the camera module, and the captured image is stored in an analyzable state so that it can be used for future image analysis.

[0076] Subsequently, the above method performs the step of b) extracting a first point located at the lateral canthus, a second point located at the tragus, a third point located at the mouth corner, and a fourth point located at the alar base from the acquired face image, and extracting a first straight line connecting the first point and the second point, a second straight line that is tangent to the jaw line and has the same slope, and a fifth point located at the intersection point of the second straight line and the third straight line connecting the third point and the fourth point.

[0077] This step is a process of extracting key landmarks from facial images and generating additional reference points based on the geometric relationships between them to provide accuracy in lifting procedures and personalized data.

[0078] In this step, four major landmarks are extracted from the acquired face image using an AI-based Face Landmark Detection model. The lateral canthus is located at the outer edge of the eye and serves as an important reference point reflecting the positional relationship between the eye and the face contour (Point 1, A in FIG. 2). The tragus is located at the anterior protrusion of the ear and serves as a point reflecting the face contour and substructure, which can be utilized for analyzing the jawline and jaw angle (Point 2, B in FIG. 2). Additionally, the corners of the mouth are located at the ends of the lips and serve as reference points reflecting facial asymmetry and the degree of deformation of facial muscles (Point 3, C in FIG. 2). The base of the nostril is located at the lowest part of the nostril and serves as the center of the face, which can be utilized for analyzing the ratio and symmetry with other points (Point 4, N in FIG. 2). The AI ​​model can return landmarks in a coordinate format from the input face image, and each point can be expressed in the form of pixel coordinates (x, y).

[0079] Meanwhile, in this step, a first straight line (X in FIG. 2), a second straight line (Y in FIG. 2), and a third straight line (Z in FIG. 2) are generated based on the above points, and a fifth point (D in FIG. 2) can be extracted from them. The first straight line and the third straight line are straight lines connecting the first point and the second point, and the third point and the fourth point, respectively, and can be derived based on the coordinates of the two points. The second straight line is a straight line that is tangent to the jawline and has the same slope, and can be derived by an AI model detecting the jawline from the acquired face image and calculating the average slope of the jawline. Once the second straight line and the third straight line are derived, the point where the two straight lines intersect can be set as the fifth point.

[0080] After step b) above, the landmarks designated on the face vary depending on the number of threads used in the lifting procedure and the directionality of the needles used, and accordingly, differences occur in the entry point, exit point, and procedure vector finally derived. According to one embodiment, the number of threads and the directionality of the needles used can be additionally obtained in step a).

[0081] Figure 3 is a photograph showing the process of deriving the entry point, exit point, and procedure vector to perform a procedure using a unidirectional needle with three lifting threads.

[0082] Referring to FIG. 3, c) a sixth point (E in FIG. 3) is created at a point 0.8 cm to 1.2 cm, most preferably 1 cm, in the direction of the second straight line tragus from the fifth point (D in FIG. 3) extracted in step b), and a seventh point (C1 in FIG. 3) is created at a point 1 / 2 of the distance between the third point and the fifth point on the third straight line. Subsequently, the length of the first straight line (X in FIG. 3) is measured, and if the length is less than 8.5 cm, an 8th point (M in FIG. 3) is created at a point 4 cm from the 1st point on the first straight line, and if the length is 8.5 cm or more, an 8th point is created at a point 4.5 cm from the 1st point on the first straight line, and a 9th point (R in FIG. 3) and a 10th point (L in FIG. 3) are created at points 0.8 cm to 1.2 cm to the right and left, respectively, of the 8th point on the first straight line, most preferably at a point 1 cm.

[0083] After step c) above, d) a first entry point (En1 in FIG. 3) is created on a straight line connecting the 7th point and the 9th point created in step c), at a distance of 1.5 cm to 2.5 cm from the 9th point, most preferably at a distance of 2 cm; a second entry point (En2 in FIG. 3) is created on a straight line connecting the 8th point and the 5th point, at a distance of 1.5 cm to 2.5 cm from the 8th point, most preferably at a distance of 2 cm; and a third entry point (En3 in FIG. 3) is created on a straight line connecting the 10th point and the 6th point, at a distance of 1.5 cm to 2.5 cm from the 10th point, most preferably at a distance of 2 cm.

[0084] In addition, the 7th point is created as the 1st exit point (Ex1 in FIG. 3), the 5th point as the 2nd exit point (Ex2 in FIG. 3), and the 6th point as the 3rd exit point (Ex3 in FIG. 3).

[0085] In addition, procedure vectors (v1, v2, v3 in FIG. 3) are generated that respectively indicate the first entry point and the first exit point, the second entry point and the second exit point, and the third entry point and the third exit point in the forward direction.

[0086] Afterwards, e) the entry point, exit point, and procedure vector generated in step d) above are output.

[0087] Figure 4 is a photograph showing the process of deriving the entry point, exit point, and procedure vector to perform a procedure using a bidirectional needle with three lifting threads.

[0088] Referring to FIG. 4, after step c), d) a first entry point (En1 in FIG. 4) is created on a straight line connecting the 7th point (C1 in FIG. 4) and the 9th point (R in FIG. 4) created in step c), at a point 1.5 cm to 2.5 cm away from the 9th point, most preferably at a point 2 cm away; a second entry point (En2 in FIG. 4) is created on a straight line connecting the 8th point (M in FIG. 4) and the 5th point (D in FIG. 4), at a point 1.5 cm to 2.5 cm away from the 8th point, most preferably at a point 2 cm away; and a third entry point (En3 in FIG. 4) is created on a straight line connecting the 10th point (L in FIG. 4) and the 6th point (E in FIG. 4), at a point 1.5 cm to 2.5 cm away from the 10th point, most preferably at a point 2 cm away.

[0089] In addition, the 7th point is created as the 1st exit point (Ex1 in FIG. 4), the 5th point as the 2nd exit point (Ex2 in FIG. 4), and the 6th point as the 3rd exit point (Ex3 in FIG. 4).

[0090] Subsequently, e) the distance between the first entry point and the seventh point generated in step d) is measured to calculate a value of L1, the distance between the second entry point and the fifth point is measured to calculate a value of L2, and the distance between the third entry point and the sixth point is measured to calculate a value of L3, and f) in step e), a point located L1 away from the first entry point on the straight line connecting the first entry point and the seventh point is created as the fourth exit point (Ex4 in FIG. 4), a point located L2 away from the first entry point on the straight line connecting the second entry point and the fifth point is created as the fifth exit point (Ex5 in FIG. 4), and a point located L3 away from the third entry point and the sixth point is created as the sixth exit point (Ex6 in FIG. 4).

[0091] In addition, a step of generating procedure vectors (v1, v2, v3, v4, v5, v6 in FIG. 4) that respectively indicate the first entry point and the first exit point, the first entry point and the fourth exit point, the second entry point and the second exit point, the second entry point and the fifth exit point, the third entry point and the third exit point, and the third entry point and the sixth exit point in the forward direction;

[0092] Afterwards, g) the entry point, exit point, and procedure vector generated in step f) above are output.

[0093] Figure 5 is a photograph showing the process of deriving the entry point, exit point, and procedure vector for two additional procedures using a unidirectional needle to perform two additional procedures after three lifting thread procedures.

[0094] Referring to FIG. 5, c) a sixth point (E' in FIG. 5) is created at a point 0.3 cm to 0.7 cm, most preferably 0.5 cm, in the direction of tragus along the second straight line from the fifth point (D' in FIG. 5) extracted in step b), and a seventh point (C2 in FIG. 5) is created at a point 2 / 3 of the distance between the third point (C in FIG. 5) and the fifth point along the third straight line, and the length of the first straight line is measured so that if the length is less than 8.5 cm, an eighth point (M in FIG. 5) is created at a point 4 cm from the second point along the first straight line, and if the length is 8.5 cm or more, an eighth point (M in FIG. 5) is created at a point 4.5 cm from the second point along the first straight line, and if the length is 8.5 cm or more, a ninth point (R in FIG. 5) and a 10 are created at points 0.3 cm to 0.7 cm, most preferably 0.5 cm, to the right and left of the eighth point, respectively, along the first straight line. Generates a point (L' in Fig. 5).

[0095] Subsequently, d) a first entry point (En1' in FIG. 5) is created on a straight line connecting the 7th point and the 9th point created in step c), at a distance of 1.5 cm to 2.5 cm from the 9th point, most preferably at a distance of 2 cm, and a second entry point (En2' in FIG. 5) is created on a straight line connecting the 10th point and the 6th point, at a distance of 1.5 cm to 2.5 cm from the 10th point, most preferably at a distance of 2 cm.

[0096] In addition, the 7th point is created as the 1st exit point (Ex1' in FIG. 5) and the 6th point as the 2nd exit point (Ex1' in FIG. 5), and a procedure vector (v1', v2' in FIG. 5) is created that indicates the 1st entry point and 1st exit point, and the 2nd entry point and 2nd exit point, respectively, in the forward direction.

[0097] Afterwards, e) the entry point, exit point, and procedure vector generated in step d) above are output.

[0098] Figure 6 is a photograph showing the process of deriving the entry point, exit point, and procedure vector for two additional procedures using a bidirectional needle to perform two additional procedures after three lifting thread procedures.

[0099] Referring to FIG. 6, after step c), d) a first entry point (En1' in FIG. 6) is created on a straight line connecting the 7th point (C2 in FIG. 6) and the 9th point (R' in FIG. 6) created in step c), at a point 1.5 cm to 2.5 cm away from the 9th point, most preferably at a point 2 cm away, and a second entry point (En2' in FIG. 6) is created on a straight line connecting the 10th point and the 6th point, at a point 1.5 cm to 2.5 cm away from the 10th point, most preferably at a point 2 cm away.

[0100] Subsequently, e) a step of calculating L1 value by measuring the distance between the first entry point and the seventh point generated in step d) above, and calculating L2 value by measuring the distance between the second entry point and the sixth point above, and f) a third exit point (Ex3' in FIG. 6) is created at a point L1 away from the first entry point on the straight line connecting the first entry point and the seventh point in step e), and a fourth exit point (Ex4' in FIG. 6) is created at a point L2 away from the first entry point on the straight line connecting the second entry point and the sixth point above.

[0101] In addition, the 7th point is created as the 1st exit point (Ex1' in FIG. 6) and the 6th point as the 2nd exit point (Ex2' in FIG. 6), and procedure vectors (v1', v2', v3', v4' in FIG. 6) are created by indicating the 1st entry point and the 1st exit point, the 1st entry point and the 3rd exit point, the 2nd entry point and the 2nd exit point, and the 2nd entry point and the 4th exit point, respectively, in the forward direction.

[0102] Afterwards, g) the entry point, exit point, and procedure vector generated in step f) above are output.

[0103] According to one embodiment of the present invention, the method may further include a step of measuring the distance between the first point and the second point extracted in step b) and automatically adjusting the slope of the third straight line according to the facial proportions. This step enables precise analysis to correct facial asymmetry and maximize the lifting effect.

[0104] The distance measurement above can calculate the distance between the coordinates (x1, y1) of the first point and the coordinates (x2, y2) of the second point using the Euclidean distance formula. Additionally, the facial proportions can be divided into the ratios of the upper part (eyes and forehead), the middle part (nose and mouth), and the lower part (chin), and the difference between the subject's face and the ideal proportions (e.g., 1:1:1) can be calculated. Based on the results of the facial proportion analysis, the slope of the third straight line can be adjusted; for example, if the face is narrow and long, the slope can be adjusted to be gentler, and if the face is wide and short, the slope can be adjusted to be steeper, and the adjusted slope can be applied to create entry points and exit points that fit the subject's facial structure.

[0105] According to one embodiment of the present invention, the method may further include the step of calculating the distance between the generated entry point and exit point and the angle of the procedure vector to display the procedure vector in three dimensions. This allows the spatial (3D) path of the lifting procedure to be visualized, enabling the practitioner to understand and apply the procedure path more clearly. For example, the spatial distance between the entry point and exit point and the vector angle between the direction vector of the procedure vector and a reference plane can be calculated, and the procedure vector can be visually displayed in three dimensions based on the calculated distance and angle. Additionally, by visualizing the relationship between the subject's facial contour and the vector as a three-dimensional model, the practitioner can review the expected results from various angles while adjusting the length and angle of the vector.

[0106] According to one embodiment of the present invention, the method may further include the step of storing data of the generated entry point, exit point, and procedure vector, and loading previous data to provide an optimized procedure plan for repeated procedures on the same subject.

[0107] The generated data, such as entry point coordinates, exit point coordinates, and the length and angle of the procedure vector, generated in the method of the present invention, can be stored in JSON, XML, or a relational database table, and such data can be linked to the subject's identifier (ID). In addition, if the same subject wishes to undergo a re-procedure, previous data can be retrieved and analyzed, and changes in the subject's face (such as lifting effects) can be compared based on the previous procedure data. Furthermore, based on the retrieved data, new point positions can be adjusted relative to the existing entry and exit points, or the length and direction of the vector can be reset according to changes in the face to automatically generate the next procedure plan.

[0108] The above detailed description is intended to illustrate and explain the present invention. Furthermore, the foregoing merely illustrates and describes preferred embodiments of the present invention, and as described above, the present invention may be used in various other combinations, modifications, and environments, and may be modified or altered within the scope of the concept of the invention disclosed herein, the scope equivalent to the foregoing disclosure, and / or the scope of the art or knowledge. Accordingly, the above detailed description of the invention is not intended to limit the present invention to the disclosed embodiments. Additionally, the appended claims should be interpreted as including other embodiments.

Claims

1. In a method performed by a device, a) A step of obtaining an image generated by photographing the face of a subject for a lifting procedure; b) Extract a first point located at the lateral canthus, a second point located at the tragus, a third point located at the mouth corner, and a fourth point located at the alar base from the face image obtained above, and A step of extracting a first straight line connecting the first and second points, a second straight line tangent to the jaw line and having the same slope, and a fifth point located at the intersection point of the second straight line and the third straight line connecting the third and fourth points; c) Generate a 6th point located 0.8 cm to 1.2 cm in the direction of the 2nd straight line tragus from the 5th point extracted in step b), and A seventh point is created located at half the distance between the third point and the fifth point on the third straight line, and The length of the first straight line is measured, and if the length is less than 8.5 cm, an 8th point is created at a point 4 cm from the 2nd point on the first straight line, and if the length is 8.5 cm or more, an 8th point is created at a point 4.5 cm from the 2nd point on the first straight line. A step of generating 9th and 10th points at points 0.8 cm to the right and 1.2 cm to the left, respectively, of the 8th point on the first straight line; d) Create a first entry point at a point 1.5 cm to 2.5 cm away from the ninth point on the straight line connecting the seventh point and the ninth point created in step c), and A second entry point is created at a point 1.5 cm to 2.5 cm away from the 8th point on the straight line connecting the 8th point and the 5th point, and A third entry point is created at a point 1.5 cm to 2.5 cm away from the 10th point on the straight line connecting the 10th point and the 6th point, and The above 7th point is created as the 1st exit point, the above 5th point as the 2nd exit point, and the above 6th point as the 3rd exit point, and A step of generating a procedure vector that indicates the first entry point and the first exit point, the second entry point and the second exit point, and the third entry point and the third exit point, respectively, in the forward direction; e) A method for providing lifting procedure information comprising the step of outputting the entry point, exit point, and procedure vector generated in step d) above.

2. In Claim 1, After step c) above, d) Create a first entry point at a point 1.5 cm to 2.5 cm away from the ninth point on the straight line connecting the seventh point and the ninth point created in step c), and A second entry point is created at a point 1.5 cm to 2.5 cm away from the 8th point on the straight line connecting the 8th point and the 5th point, and A third entry point is created at a point 1.5 cm to 2.5 cm away from the 10th point on the straight line connecting the 10th point and the 6th point, and A step of creating the 7th point as the 1st exit point, the 5th point as the 2nd exit point, and the 6th point as the 3rd exit point; e) Calculate the L1 value by measuring the distance between the first entry point and the seventh point generated in step d) above, and The L2 value is calculated by measuring the distance between the second entry point and the fifth point, and A step of calculating the L3 value by measuring the distance between the third entry point and the sixth point; f) In the above step e), a point located L1 away from the first entry point on the straight line connecting the first entry point and the seventh point is created as the fourth exit point, and A point located L2 away from the straight line connecting the second entry point and the fifth point is created as the fifth exit point, and Create the 6th exit point at a point L3 away from the straight line connecting the 3rd entry point and the 6th point, and A step of generating a procedure vector that indicates the first entry point and the first exit point, the first entry point and the fourth exit point, the second entry point and the second exit point, the second entry point and the fifth exit point, the third entry point and the third exit point, and the third entry point and the sixth exit point, respectively, in the forward direction; g) A method for providing lifting procedure information, wherein the step of outputting the entry point, exit point, and procedure vector generated in step f) above.

3. In a method performed by a device, a) A step of obtaining an image generated by photographing the face of a subject for a lifting procedure; b) Extract a first point located at the lateral canthus, a second point located at the tragus, a third point located at the mouth corner, and a fourth point located at the alar base from the face image obtained above, and A step of extracting a first straight line connecting the first and second points, a second straight line tangent to the jaw line and having the same slope, and a fifth point located at the intersection point of the second straight line and the third straight line connecting the third and fourth points; c) Generate a sixth point located 0.3 cm to 0.7 cm from the fifth point extracted in step b) above in the direction of the second straight line (Tragus), and A seventh point is created located at 2 / 3 of the distance between the third point and the fifth point on the third straight line, and The length of the first straight line is measured, and if the length is less than 8.5 cm, an 8th point is created at a point 4 cm from the 2nd point on the first straight line, and if the length is 8.5 cm or more, an 8th point is created at a point 4.5 cm from the 2nd point on the first straight line. A step of generating 9th and 10th points at points 0.3 cm to the right and 0.7 cm to the left, respectively, of the 8th point on the first straight line; d) Create a first entry point at a point 1.5 cm to 2.5 cm away from the ninth point on the straight line connecting the seventh point and the ninth point created in step c), and A second entry point is created at a point 1.5 cm to 2.5 cm away from the 10th point on the straight line connecting the 10th point and the 6th point, and The above 7th point is created as the 1st exit point, and the above 6th point is created as the 2nd exit point, and A step of generating a procedure vector that indicates the first entry point and the first exit point, and the second entry point and the second exit point, respectively, in the forward direction; e) A method for providing lifting procedure information comprising the step of outputting the entry point, exit point, and procedure vector generated in step d) above.

4. In Claim 3, After step c) above, d) Create a first entry point at a point 1.5 cm to 2.5 cm away from the ninth point on the straight line connecting the seventh point and the ninth point created in step c), and A step of creating a second entry point at a point 1.5 cm to 2.5 cm away from the 10th point on a straight line connecting the 10th point and the 6th point; e) a step of calculating an L1 value by measuring the distance between the first entry point and the seventh point generated in step d), and calculating an L2 value by measuring the distance between the second entry point and the sixth point; f) In the above step e), a point located L1 away from the first entry point on the straight line connecting the first entry point and the seventh point is created as the third exit point, and A point located L2 away from the straight line connecting the 2nd entry point and the 6th point is created as the 4th exit point, and The above 7th point is created as the 1st exit point, and the above 6th point is created as the 2nd exit point, and A step of generating a procedure vector that indicates the first entry point and the first exit point, the first entry point and the third exit point, the second entry point and the second exit point, and the second entry point and the fourth exit point, respectively, in the forward direction; and g) A method for providing lifting procedure information, wherein the step of outputting the entry point, exit point, and procedure vector generated in step f) above.

5. In any one of claims 1 to 4, A method further comprising the step of automatically adjusting the slope of the third straight line according to the proportion of the face by measuring the distance between the first point and the second point extracted in step b) above.

6. In any one of claims 1 to 4, A method further comprising the step of calculating the distance between the generated entry point and exit point and the angle of the procedure vector to display the procedure vector in three dimensions.

7. In any one of claims 1 to 4, A method comprising the step of storing data of the generated entry point, exit point, and procedure vector, and further including the step of loading previous data for repeated procedures on the same subject to provide an optimized procedure plan.

8. Input unit for receiving a face image of a patient undergoing a lifting procedure; An image analysis unit that extracts points located at the lateral canthus, tragus, corner of the mouth, and base of the nostril from the above face image, and points located at the intersection points of straight lines generated from said points; A calculation unit that calculates the distance between the extracted points and points to generate a new point; A data generation unit that derives entry points, exit points, and procedure vectors from the extracted or generated points; A device for providing lifting procedure information, comprising an output unit that outputs the above-derived entry point, exit point, and procedure vector.

9. In Claim 8, The above device further comprises a web client module for analyzing image files uploaded by a user, an AI engine for image analysis, and a database server for storing analysis results.

10. In Claim 8, The above device further includes a data storage unit that stores data of entry points, exit points, and procedure vectors for each procedure subject, and retrieves, analyzes, and modifies the stored data during repeated procedures.

11. In Claim 8, The above output unit is a device further comprising a user interface configured to allow a user to verify and modify entry points, exit points, and procedure vectors.

Images