Method for providing haircut guide using extended reality technology and haircut education device using same

Abstract

The present invention relates to a method for providing a haircut guide using extended reality (XR) technology and a haircut education device. The method, which is performed by a device for providing XR, comprises the steps of: scanning an indoor space in which a real object for haircut education is disposed around the position of a user wearing the device and visualizing same as a virtual space; outputting a three-dimensional virtual object on the visualized virtual space, and aligning and arranging same on the basis of the position of the real object; determining a target base according to the user's selection among a plurality of bases defined by partitioning a part of the surface of the virtual object; and visualizing and providing a haircut guide composed of grab points and cut points predefined on the basis of the target base, and a guide line connecting the points.

Description

Method for providing a haircut guide using augmented reality technology and a haircut training device using the same

[0001] The present invention relates to a technology for hair cutting education, and more specifically, to a technology that utilizes augmented reality technology to support a hair cutting practitioner (beginner or trainee) in performing hair cutting practice independently without the assistance of a professional.

[0002]

[0003] Extended Reality (XR) is one of the core element technologies of the Fourth Industrial Revolution and can be considered a concept that encompasses the technologies of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality. Extended Reality can provide new experiences and interactions by fusing the real world with the virtual world. Applications of Extended Reality technology are becoming visible in various fields, such as entertainment, education and training, and medical and healthcare.

[0004] The beauty service industry is recognized as a field requiring not only skilled techniques but also the practitioner's artistic sensibility and design. While it is difficult to completely replace these functions with artificial intelligence, the demand for services that can assist with specific tasks or accelerate work processing is expected to continue increasing due to factors such as rising labor costs. In the beauty service sector, which pursues external beauty, the application of Augmented Reality (XR) can also be utilized in areas such as entertainment and distance education.

[0005] For example, hair cutting education is currently conducted primarily through face-to-face instruction, but 21 remote universities in Korea are conducting practice-oriented non-face-to-face education, and as restrictions on face-to-face activities due to another pandemic are predicted in the future, non-face-to-face education methods are expected to continue to develop.

[0006] Therefore, there is a need to develop a system in the field of beauty service education that allows experts to conduct training and provide feedback remotely.

[0007]

[0008] One embodiment of the present invention aims to provide a method for providing a haircut guide using augmented reality technology and a haircut training device that can provide a 3D-based haircut guide through an augmented reality device screen when a practitioner wears a device equipped with augmented reality technology for haircut practice and positions themselves on an object (e.g., a mannequin) to perform a haircut.

[0009] One embodiment of the present invention aims to provide a method for providing a haircut guide and a haircut training device utilizing augmented reality technology, which recognizes the three-dimensional coordinates of the fingers holding the hair during a haircut and corrects the position of the practitioner's fingers by comparing them with the three-dimensional coordinates required for an appropriate haircut at that position.

[0010]

[0011] Among the embodiments, a method for providing a haircut guide using extended reality technology is performed in a device providing extended reality (XR), comprising: a step of scanning an indoor space in which a real object for haircut training is placed centered on the position of a user wearing the device and visualizing it as a virtual space; a step of outputting a 3D virtual object on the visualized virtual space and aligning and placing it based on the position of the real object; a step of determining a target base according to the user's selection among a plurality of bases defined by partitioning a part of the surface of the virtual object; and a step of visualizing and providing a haircut guide composed of a pre-defined Grab Point and Cut Point based on the target base, and a Guide Line connecting the points.

[0012] The step of visualizing the virtual space above may include the step of converting the indoor space into mesh data containing at least coordinate information.

[0013] The step of placing the virtual object may include adjusting at least one of the distance, height, and angle of the virtual object based on the coordinate information of the mesh data.

[0014] The step of determining the target base may include providing a user interface for the user's selection on the visualized virtual space and receiving the user's selection regarding the plurality of bases through the user interface.

[0015] The step of determining the target base may include a step of visually highlighting and displaying the target base by changing its color or border according to the user's selection.

[0016] The step of determining the target base may include the step of determining the transparency of the target base.

[0017] The step of providing the above visualization may include tracking the position of the user's finger to visualize it as a finger point, and if the distance between the finger point and the cut point is within a preset distance, changing at least one of the size, shape, and color of the finger point.

[0018] The step of providing the above visualization may include tracking the position of the user's finger to visualize it as a finger point, and if the distance between the finger point and the cut point is within a preset distance, changing at least one of the size, shape, and color of the cut point.

[0019] The step of providing the above visualization may include the step of terminating the provision of the haircut guide when a voice command or gesture input from the user is received while at least one of the size, shape, and color of the finger point is changed.

[0020] Among the embodiments, a hair cutting education device utilizing augmented reality technology includes: a spatial visualization unit that scans an indoor space in which a real object for hair cutting education is placed centered on the user's location and visualizes it as a virtual space; a virtual object placement unit that outputs a 3D virtual object on the visualized virtual space and arranges it based on the location of the real object; a base determination unit that determines a target base according to the user's selection among a plurality of bases defined by partitioning a part of the surface of the virtual object; and a guide providing unit that visualizes and provides a hair cutting guide composed of a pre-defined Grab Point and Cut Point based on the target base, and a Guide Line connecting the points.

[0021] Among the embodiments, the computer-readable recording medium is a computer-readable recording medium storing a computer program, and the computer program includes instructions for the processor to perform a method comprising: scanning an indoor space in which a real object for hair cutting education is placed centered on the user's location and visualizing it as a virtual space when executed by a processor; outputting a three-dimensional virtual object on the visualized virtual space and aligning and placing it based on the location of the real object; determining a target base according to the user's selection among a plurality of bases defined by partitioning a part of the surface of the virtual object; and visualizing and providing a hair cutting guide composed of a pre-defined Grab Point and Cut Point based on the target base, and a Guide Line connecting the points.

[0022] Among the embodiments, a hair cutting education system utilizing augmented reality technology includes: a hair cutting education device that scans an indoor space in which a real object for hair cutting education is placed centered on the user's location and visualizes it as a virtual space; and a computing device that is connected to the hair cutting education device via a network and stores and analyzes data regarding the user's learning progress and practice results; wherein the computing device is implemented to provide educational content for hair cutting techniques by linking with a database in which 3D models and cutting guide information regarding each hairstyle are stored.

[0023]

[0024] The disclosed technology may have the following effects. However, this does not mean that a specific embodiment must include all of the following effects or only the following effects; therefore, the scope of the rights of the disclosed technology should not be understood as being limited by this.

[0025] A method for providing a haircut guide and a haircut education device utilizing augmented reality technology according to one embodiment of the present invention can assist in haircut education by simplifying and displaying factors affecting haircut procedures as three-dimensional coordinate values.

[0026] Specifically, the present invention allows a practitioner to train themselves in haircut styles by applying various haircut styles to an educational mannequin, converting them into coordinate values ​​to be cut, and then visually guiding the position where the practitioner's fingers can move during the haircut.

[0027]

[0028] FIG. 1 is a drawing illustrating a haircut education system according to the present invention.

[0029] FIG. 2 is a drawing illustrating an embodiment of the system configuration of a haircut education device according to the present invention.

[0030] FIG. 3 is a drawing illustrating an embodiment of the functional configuration of a haircut education device according to the present invention.

[0031] FIG. 4 is a flowchart illustrating a haircut education method using augmented reality technology according to the present invention.

[0032] FIGS. 5a and 5b are drawings illustrating a base division for a haircut according to the present invention.

[0033] FIG. 6 is a drawing illustrating the configuration of a haircut guide according to the present invention.

[0034] FIG. 7 is a diagram illustrating a finger joint tracking point according to the present invention.

[0035] FIG. 8 is a drawing illustrating an embodiment of a main panel UI configuration according to the present invention.

[0036] FIGS. 9a to 9f are exemplary diagrams illustrating the cutting steps for each base according to the present invention.

[0037]

[0038] The description of the present invention is merely an example for structural or functional explanation, and therefore the scope of the present invention should not be interpreted as being limited by the examples described in the text. That is, since the examples are subject to various modifications and may take various forms, the scope of the present invention should be understood to include equivalents capable of realizing the technical concept. Furthermore, the objectives or effects presented in the present invention do not imply that a specific example must include all of them or only such effects; therefore, the scope of the present invention should not be understood as being limited by them.

[0039] Meanwhile, the meaning of the terms described in this application should be understood as follows.

[0040] Terms such as "first," "second," etc., are intended to distinguish one component from another, and the scope of rights shall not be limited by these terms. For example, the first component may be named the second component, and similarly, the second component may be named the first component.

[0041] When it is stated that one component is "connected" to another component, it should be understood that it may be directly connected to that other component, or that there may be other components in between. Conversely, when it is stated that one component is "directly connected" to another component, it should be understood that there are no other components in between. Meanwhile, other expressions describing the relationships between components, such as "between" and "exactly between," or "adjacent to" and "directly adjacent to," should be interpreted in the same way.

[0042] A singular expression should be understood to include a plural expression unless the context clearly indicates otherwise, and terms such as "include" or "have" are intended to specify the existence of the implemented features, numbers, steps, actions, components, parts, or combinations thereof, and should be understood not to preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0043] In each step, identifiers (e.g., a, b, c, etc.) are used for convenience of explanation and do not describe the order of the steps; the steps may occur differently from the specified order unless a specific order is clearly indicated in the context. That is, the steps may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

[0044] Unless otherwise defined, all terms used herein have the same meaning as generally understood by those skilled in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having meanings consistent with the context of the relevant technology and should not be interpreted as having an ideal or overly formal meaning unless explicitly defined in this application.

[0045]

[0046] FIG. 1 is a drawing illustrating a haircut education system according to the present invention.

[0047] Referring to FIG. 1, a haircut education system (100) may be implemented by including a haircut education device (110), a computing device (130), and a database (150). Here, the haircut education system (100) may correspond to a system capable of providing effective haircut education by utilizing XR technology. That is, the haircut education system (100) may provide an integrated education environment for implementing the haircut guide provision method according to the present invention.

[0048] For example, the hair cutting education system (100) can provide a virtual hair cutting guide through a hair cutting education device (110) and implement a real-time response of the hair cutting guide according to the user's movements (hand position, voice command and gesture, etc.), and can build 3D models and cutting guide information regarding various hairstyles through a database (150) and then provide educational content on various hair cutting techniques through a computing device (130) based on this, or provide personalized feedback by storing and analyzing the user's learning progress and practice results.

[0049] The haircut training device (110) may correspond to a terminal device that is worn directly by a user for haircut training. The haircut training device (110) may correspond to one device constituting the haircut training system (100) according to the present invention and may be implemented in various forms to provide extended reality (XR). For example, the haircut training device (110) may be implemented as an XR device such as a VR headset and AR glasses, and may include related sensors such as a camera, a motion sensor and a voice recognition sensor.

[0050] Additionally, the haircut training device (110) can serve as an interface between the user and the system and can act as an important medium connecting the real world and the virtual world. Specifically, the haircut training device (110) can visually provide a virtual haircut guide to the user within a virtual environment and can perform actions such as scanning the real space or tracking the user's movements through cameras and sensors. Furthermore, the haircut training device (110) may include a microphone and controller for receiving voice commands or gesture inputs from the user, and may include a speaker and earphones for voice guidance as needed.

[0051] Meanwhile, the haircut training device (110) can be connected to the computing device (130) via a wired or wireless network, and multiple haircut training devices (110) can be connected to the computing device (130) simultaneously.

[0052] The computing device (130) may correspond to one of the devices constituting the haircut education system (100) according to the present invention, and may be implemented as a computer or server that performs core computation and data processing functions of the haircut education system (100) in conjunction with the haircut education device (110). For example, the computing device (130) may process computations requiring high performance on behalf of the haircut education device (110) and may perform operations such as managing educational content and learning records. The computing device (130) may simulate hand movements, scissor movements, and hair movements as needed, and through this, may perform operations such as predicting or visualizing haircut results.

[0053] Additionally, the computing device (130) can be connected to the haircut training device (110) via a wired network or a wireless network such as Bluetooth, WiFi, and LTE, and can transmit and receive data with the haircut training device (110) through the network. To this end, the computing device (130) can be implemented in the form of a high-performance PC, workstation, or cloud server, depending on the installation and operation environment.

[0054] Meanwhile, in FIG. 1, the computing device (130) is shown as a device independent of the haircut training device (110), but it is not necessarily limited to this and can be implemented as a single device integrated with the haircut training device (110).

[0055] The database (150) may correspond to a storage device that stores various information required during the operation of the computing device (130). For example, the database (150) may store 3D models, textures, and related information of various hairstyles, and may store cutting guide information (target base, grab point, cut point, and guideline, etc.) according to each hairstyle, and may store user account information for hair cutting education, learning progress, and personal settings.

[0056] Meanwhile, in FIG. 1, the database (150) is shown as a device independent of the computing device (130), but it is not necessarily limited to this and can be implemented as a logical storage device included in the computing device (130).

[0057]

[0058] FIG. 2 is a drawing illustrating an embodiment of the system configuration of a haircut education device according to the present invention.

[0059] Referring to FIG. 2, the haircut training device (110) may include a processor (210), memory (230), user input / output unit (250), and network input / output unit (270).

[0060] The processor (210) can execute a procedure for performing a method of providing a haircut guide using augmented reality technology according to the present invention, manage memory (230) that is read or written during this process, and schedule the synchronization time between volatile memory and non-volatile memory in memory (230). The processor (210) can control the overall operation of the haircut training device (110) and is electrically connected to the memory (230), user input / output unit (250), and network input / output unit (270) to control the data flow between them. The processor (210) can be implemented as a CPU (Central Processing Unit) or GPU (Graphic Processing Unit), etc., of the haircut training device (110), but is not necessarily limited thereto.

[0061] The memory (230) may include an auxiliary storage device implemented as non-volatile memory such as an SSD (Solid State Disk) or HDD (Hard Disk Drive) and used to store all data required for the haircut training device (110), and may include a main memory device implemented as volatile memory such as RAM (Random Access Memory). Additionally, the memory (230) may store a set of instructions for the execution of the present invention, and the instructions may be executed by an electrically connected processor (210) so that a method for providing a haircut guide using augmented reality technology according to the present invention may be performed.

[0062] The user input / output unit (250) includes an environment for receiving user input and an environment for outputting specific information to the user, and may include an input device including an adapter such as a touch pad, touch screen, virtual keyboard, or pointing device, and an output device including an adapter such as a monitor or touch screen. In one embodiment, the user input / output unit (250) may correspond to a terminal connected via remote access, and in such case, the haircut training device (110) may correspond to an independent node of the network to which the terminal is connected.

[0063] The network input / output unit (270) provides a communication environment for connecting to other devices through a network and may include an adapter for communication such as a LAN (Local Area Network), MAN (Metropolitan Area Network), WAN (Wide Area Network), and VAN (Value Added Network). Additionally, the network input / output unit (270) may be implemented to provide short-range communication functions such as WiFi and Bluetooth, or wireless communication functions of 4G or higher for wireless transmission of data.

[0064]

[0065] FIG. 3 is a drawing illustrating an embodiment of the functional configuration of a haircut education device according to the present invention.

[0066] Referring to FIG. 3, a haircut training device (110) can perform a haircut guide providing method according to the present invention through a processor (210). To this end, the processor (210) of the haircut training device (110) may include a spatial visualization unit (310), a virtual object placement unit (330), a base determination unit (350), a guide providing unit (370), and a control unit (not shown in FIG. 3).

[0067] At this time, embodiments of the present invention are not required to include all of the above components simultaneously; depending on each embodiment, some of the components may be omitted, or some or all of the components may be selectively included. The operation of each component will be described in detail below.

[0068] The spatial visualization unit (310) can perform the operation of scanning an indoor space in which a real object for hair cutting education is placed centered on the user's location and visualizing it as a virtual space. Here, the user may be a person who learns or practices hair cutting skills as the subject using the hair cutting education system (100). Additionally, the real object may be an object existing in real space and may correspond to a physical mannequin used for hair cutting practice, and the mannequin may be a doll modeled after the shape of a human head and may be manufactured with hair of a material similar to real hair implanted in the scalp area.

[0069] Specifically, the space visualization unit (310) can create an augmented reality (AR) environment by scanning a physical space where hair cutting education takes place, such as a classroom or a practice room, and then overlaying a virtual hair cutting guide onto the actual space. To this end, the space visualization unit (310) can recognize the physical environment of an indoor space containing a real object through space scanning and create a 3D space model corresponding to the physical environment, and can build a visualization environment of a virtual object mapped to the indoor space based on the 3D space model.

[0070] In one embodiment, the spatial visualization unit (310) can perform the operation of converting an indoor space into mesh data that includes at least coordinate information. Specifically, the spatial visualization unit (310) can convert the indoor space into 3D mesh data using point data obtained from various sensors, such as a camera, a depth sensor, and a LiDAR (Light Detection and Ranging) sensor. Through this, coordinate information for each point of the surrounding environment and objects, such as furniture, walls, floors, and ceilings that constitute the indoor space, can be collected. At this time, the mesh data may correspond to data that represents the surface of the indoor space and actual objects as a set of small polygons (e.g., triangles). The spatial visualization unit (310) can generate a point cloud regarding the 3D space through spatial scanning, and can generate mesh data that includes 3D coordinate information (X, Y, Z) and color information (RGB) of each point based on the point cloud.

[0071] Meanwhile, the spatial visualization unit (310) can apply various algorithms for mesh data conversion and can accurately place virtual objects in real space or enable natural interaction with other real objects based on an accurate 3D spatial model generated through spatial mapping. For example, the operation of the spatial visualization unit (310) can be implemented through the Spatial Awareness of the HoloLens 2 device.

[0072] The virtual object placement unit (330) can perform the operation of outputting a 3D virtual object onto a visualized virtual space and then aligning and placing it based on the position of the actual object. At this time, the virtual object may correspond to a virtual 3D model with a defined hairstyle and may be pre-set and utilized by the hair cutting training device (110). Meanwhile, the virtual object may be stored and managed in a database (150), and the hair cutting training device (110) may receive and store one or more virtual objects from the computing device (130) and then transmit them to the virtual object placement unit (330) when executing a related operation.

[0073] Specifically, the virtual object placement unit (330) can create a virtual object at a specific location in virtual space and can place and align the virtual object using the location and orientation information of the actual object recognized by the space visualization unit (310). For example, a translation operation may correspond to a process of moving the virtual object so that its center point coincides with the center point of the actual object, and a rotation operation may correspond to a process of rotating the virtual object so that its direction coincides with the direction of the actual object. Additionally, the virtual object placement unit (330) may perform an operation to adjust the size of the virtual object to match the size of the actual object as needed.

[0074] In one embodiment, the virtual object placement unit (330) can perform an operation to adjust at least one of the distance, height, and angle of the virtual object based on the coordinate information of the mesh data. That is, the virtual object placement unit (330) can place a 3D model at the location of the mannequin using the position and direction information of the mannequin recognized by the spatial visualization unit (310) and rotate the 3D model to match the direction of the mannequin's head. At this time, the virtual object placement unit (330) can provide an interface that allows the user to finely adjust the distance (position), size (height), and angle of the virtual object as needed. Through this, the user can adjust the virtual object more accurately before performing haircut training.

[0075] For example, the virtual object placement unit (330) can display a “Tuning” button on the screen after placing the virtual object, and when the button is selected by the user, it can display three UIs: PLANE MOVE, MOVE Y, and ROTATE X. Each UI can be composed of up, down, left, right, up, down, or left and right buttons. Plane Move corresponds to a button that adjusts the up, down, left, and right positions of the mannequin, and can be designed to move 1 cm each time the button is pressed. Move Y corresponds to a button that adjusts the height of the mannequin, and can be designed to move 1 cm each time the button is pressed. Rotate X corresponds to a button that changes the angle of the mannequin, and can be designed to change 5 degrees each time the button is pressed.

[0076] The base determination unit (350) can perform the operation of determining a target base according to the user's selection among a plurality of bases defined by partitioning a portion of the surface of a virtual object. Here, a base may correspond to an area or zone in which the surface of a virtual object is logically divided. For example, a front hair portion, a side hair portion, a back hair portion, etc., may each be defined as a base, and each base may be represented as a set of faces constituting the mesh of a 3D model. Meanwhile, the base division for hair cutting according to the present invention will be explained in more detail through FIGS. 5a and 5b.

[0077] Additionally, the Target Base is a specific base selected by the user from among multiple bases and can serve as a standard for providing a haircut guide. For example, if the user wants to start practicing haircutting based on the bangs, the bangs can be selected as the Target Base. That is, the Target Base can correspond to the Cut Area where the haircut is to be performed. The Base Determination Unit (350) can determine the Target Base selected by the user from among multiple bases defined for the virtual object by utilizing base information predefined for each virtual object during the 3D modeling stage for the hairstyle.

[0078] In one embodiment, the base determination unit (350) may provide a user interface for user selection in a visualized virtual space and perform the operation of receiving a user's selection regarding a plurality of bases through the user interface. At this time, the user interface for user selection may be implemented in various forms, and a specific type of interface may be determined by considering ease of use, immersion, and system characteristics.

[0079] For example, when using a direct selection type interface based on visual emphasis, the user can select the desired base by pointing directly at or touching it with a controller or hand gesture while each base area is visually distinguished and displayed on the surface of a virtual object. As another example, when using a menu or list selection type interface, the user can select the desired base through a menu or list displayed on the screen in the form of text or icons. As yet another example, when using a voice command type interface, the user can select the desired base by pronouncing its number or name directly with their own voice.

[0080] Additionally, the base determination unit (350) can visually highlight and display a specific base when that base is selected by the user through a user interface. For example, the base determination unit (350) can distinguish the selected base from other bases by using methods such as changing the color of the selected base or making the border thicker.

[0081] In one embodiment, the base determination unit (350) may perform the operation of determining the transparency of a target base. To this end, the user interface for selecting a base may further include a menu for adjusting transparency. Accordingly, the user can select a desired base through the user interface and simultaneously adjust the transparency of the base. For example, the transparency of the base may be adjusted according to a transparency level, and the user interface may be implemented to include a menu for adjusting the transparency level.

[0082] The guide providing unit (370) can perform the action of visualizing and providing a haircut guide consisting of predefined grab points and cut points based on a target base, and guide lines connecting the points. Here, the haircut guide may correspond to visualized information that guides how to hold and cut hair to create a specific hairstyle. Specifically, the grab point corresponds to a virtual point indicating the position for holding the hair, the cut point corresponds to a virtual point indicating the position for cutting the hair, and the guide line corresponds to a virtual straight line or curve connecting the grab point and the cut point. The guide line can visually present the direction and angle of the cut, allowing the user to practice the cutting action accurately.

[0083] Specifically, the guide providing unit (370) can receive information about the target base from the base determining unit (350) and load cut guide information according to a pre-set hairstyle based on the target base into the memory (230). At this time, the cut guide information may include information about grab points, cut points, and guide lines for each base. Based on the loaded cut guide information, the guide providing unit (370) can sequentially generate grab points, cut points, and guide lines for the target base and then provide them by visualizing them on a virtual object. In addition, the guide lines can be expressed not only in the form of lines but also by applying various visual effects such as arrows, dotted lines, and color changes so that the user can easily understand them.

[0084] In one embodiment, the guide providing unit (370) may track the position of the user's finger and visualize it as a finger point, and if the distance between the finger point and the cut point is within a preset distance, it may perform the operation of changing and providing at least one of the size, shape, and color of the finger point. Here, the finger point may correspond to a visual representation of the user's finger position in a virtual space. For example, the finger point may correspond to the point of the user's fingertip recognized through the hand tracking function of the XR device.

[0085] That is, the guide providing unit (370) can update the visualization of the finger point in real time in response to the user's hand movements. For example, the user can move their fingers to cut hair while holding the hair in the cutting area of ​​the target base with their left index and middle fingers, and the guide providing unit (370) can track the position of the fingers and visualize the finger point by changing its color when the finger point enters within a certain radius centered on the cutting point.

[0086] Meanwhile, although the description here explains that the visualization of finger points indicating the position of the fingers is changed in response to the user's hand movements, it is not necessarily limited to this, and it is also possible to change the visualization of cut points instead of finger points as needed. For example, the guide providing unit (370) can update the visualization of cut points in real time in response to the user's hand movements. Specifically, when a Nape area is selected as the target base by the user, the guide providing unit (370) can visualize and display Grab Point, Guide Line, and Cut Point based on that base. The user can compartmentalize only the hair in the Nape area, fix the remaining hair on the head with tweezers, comb the hair in the Nape area, hold it with the left hand, and move toward the Cut Point while maintaining tension to align it, and the guide providing unit (370) can change and display the material (or size, shape, color, etc.) of the Cut Point point in response to this.

[0087] In one embodiment, the guide providing unit (370) may perform an operation to terminate the provision of a haircut guide when a user’s voice command or gesture input is received while at least one of the size, shape, and color of the finger point (or cut point) has been changed. The guide providing unit (370) may terminate the provision of the guide based on the user’s voice command while the haircut guide is provided. For example, if the user calls out “Cut Okay” after performing a hair cutting action by referring to the haircut guide, the guide providing unit (370) may terminate the guide provision operation by removing the visualization of the haircut guide for the corresponding target base. Additionally, the guide providing unit (370) may terminate the guide provision operation when it recognizes a specific pre-set gesture rather than the user’s voice.

[0088] The control unit (not shown in FIG. 3) controls the overall operation of the haircut training device (110) and can manage the control flow or data flow between the spatial visualization unit (310), the virtual object placement unit (330), the base determination unit (350), and the guide providing unit (370).

[0089]

[0090] FIG. 4 is a flowchart illustrating a haircut education method using augmented reality technology according to the present invention.

[0091] Referring to FIG. 4, the haircut training device (110) can perform the method of providing a haircut guide according to the present invention through a processor (210). More specifically, the haircut training device (110) can scan an indoor space in which a real object for haircut training is placed centered on the user's location through the processor (210) and visualize it as a virtual space (step S410). The haircut training device (110) can output a 3D virtual object on the visualized virtual space through the processor (210) and then arrange it by aligning it based on the location of the real object (step S430).

[0092] Additionally, the hair cutting training device (110) can determine a target base according to the user's selection among a plurality of bases defined by partitioning a portion of the surface of a virtual object through the processor (210) (step S450). The hair cutting training device (110) can visualize and provide a hair cutting guide consisting of pre-defined Grab Points and Cut Points based on the target base, and Guide Lines connecting the points, through the processor (210) (step S470).

[0093]

[0094] FIGS. 5a and 5b are drawings illustrating a base division for a haircut according to the present invention.

[0095] Referring to FIG. 5a, the method for providing a haircut guide according to the present invention can be performed independently for each of the 14 bases (Front, L / R Top, L / R Side, L / R Crown, Crown, L / R Back, Back, L / R Nape, and Nape) that are pre-divided for haircutting. In particular, since each base contains cut guide information for haircutting guidance, a haircut guide can be visualized and provided starting from the base desired by the user regardless of the order, and haircutting education can be conducted through this.

[0096] Specifically, the Nape area is the first area to be cut, corresponding to a rectangular shape with sides measuring 6cm in width and 5cm in height; the L / R Nape area is located to the left and right of the Nape area, corresponding to a trapezoidal shape with an upper side length of approximately 6cm and a lower side length of 3cm; the Back area is the most protruding part at the back that provides weight, corresponding to the area connecting points located approximately 3cm away from the center in all directions (up, down, left, and right); the L / R Back area is located to the left and right of the Back section, and its length varies depending on how the side areas are defined; the Crown area is responsible for the volume of the hairstyle, encompassing horizontal and vertical lines as well as the occipital and temporal regions, and corresponds to a triangular shape with the same area as the L / R Crown area; the L / R Top and L / R Side areas are relatively small sections, divided into two on the right and two on the left, and are areas where various changes can occur due to their significant impact on the face; and the Front area is a region that varies depending on the presence or absence of bangs, where the hair falls in the direction of gravity. Considering the point, it may correspond to a triangular area.

[0097] Meanwhile, a conventional haircut process can be performed in the order of Nape, Right Nape, Left Nape, Back, Right Back, Left Back, Crown, Right Crown, Left Crown, Right Side, Right Top, Left Side, Left Top, and Front.

[0098] Referring to Fig. 5b, the hairline area and the Front, Top, and Side sections may correspond to important areas where significant shape changes occur for each hairstyle. Accordingly, a more detailed base division can be applied to these sections. For example, in the case of Fig. (a), the existing Top area (L.Top in Fig. 5a) can be divided into sections with a width of about 2 cm from the hairline, and the remaining area can be divided horizontally into two parts to be subdivided into L.Front 1, L.Top 1, and L.Top 2, respectively; similarly, the existing Left Side area (L.Side in Fig. 5a) can also be divided into sections with a width of about 2 cm from the hairline to be subdivided into L.Front 2 and L.Side, respectively.

[0099] In addition, in the case of Figure (b), the existing Front area (Front in Figure 5a) can be subdivided into three zones (R.Front, Front, L.Front) based on the pivot point (510).

[0100]

[0101] FIG. 6 is a drawing illustrating the configuration of a haircut guide according to the present invention.

[0102] Referring to FIG. 6, the haircut guide according to the present invention may be provided by visualizing a pre-divided base (610). The haircut guide may include a grab point (620), a guide line (630), and a cut point (640). The base (610) may correspond to a cut area divided to the extent that hair grown on the surface of the head can be cut, and the cut area may be designed by imaging it as a plane for easy hair division.

[0103] More specifically, the grab point (620) can be defined as the point where the straight lines intersect by connecting the farthest corners among the corners of the base (610). The guideline (630) can be defined by assuming that the shape of the head is a sphere, connecting the grab point (620) and the center of the sphere (650) with a straight line, and setting the X, Y, and Z axis values ​​according to each haircut style based on the X, Y, and Z axis values ​​defined as (0, 0, 0) on the extension of the said straight line. At this time, the X, Y, and Z axis values ​​defined as (0, 0, 0) may correspond to the center of the sphere (650).

[0104] Additionally, the cut point (640) may correspond to the values ​​of the X, Y, and Z axes defined on the guideline (630) to obtain the desired hairstyle. That is, to produce an accurate haircut style, alignment between the virtual cut point and the actual cut line is required, and to perform an accurate haircut according to the haircut guideline, the coordinate values ​​at which hair cutting is performed may be pre-specified so that the cut point can be detected for each base (cut area). For example, the cut point may be set to a change of 0 degrees in the X-axis, a change of 0 degrees in the Y-axis, and a change of 14 cm in the Z-axis depending on the angle of the head. Consequently, the guideline (630) may correspond to a virtual straight line or curve connecting the grab point (620) and the cut point (640).

[0105] Meanwhile, when modeled to fit the head shape, which is a three-dimensional form, coordinate values ​​can be assigned to the length of the hair (Z-axis), the horizontal change overdirection (X), and the vertical change elevation (Y-axis), respectively. Specifically, coordinate values ​​of each base to be cut according to the hairstyle can be assigned, and the factors of change starting from those coordinate values—namely, the angle of the coordinate moving horizontally from the base coordinate value as the X-axis (overdirection), the angle of the coordinate moving vertically as the Y-axis (elevation), and the change in length towards the end of the hair as the Z-axis (length).

[0106]

[0107] FIG. 7 is a diagram illustrating a finger joint tracking point according to the present invention.

[0108] Referring to FIG. 7, when cutting hair, the hair panel is held using the index and middle fingers of the left hand. Since the hair must be combed and cut while maintaining tension for an accurate cut, the hair can be represented in the form of lines rather than points, whether horizontal or vertical. Additionally, as illustrated in FIG. 7, the hair cutting motion can be performed on the hair that is caught from the second joint point (710) of the left hand to the fingertip point (720) of the left hand. Therefore, when tracking fingers through an XR device according to the present invention, instead of visualizing the entire hand to account for performance degradation, the fingertip point (720) of the left hand can be tracked. For example, the fingertip point (720) of the left hand may include a point about 2 cm away from the fingertip of the left hand and can be visualized and represented as a finger point.

[0109] Additionally, the cut point provided as a visualization is expressed as three-dimensional coordinate information, but since the cut point viewed by the user is two-dimensional, it may appear as if alignment has occurred depending on the field of view. To compensate for this visual error, the hair cutting education device (110) according to the present invention may be designed to change the color of the finger point of the tracking finger when alignment between the cut point and the actual cut line occurs.

[0110]

[0111] FIG. 8 is a drawing illustrating an embodiment of a main panel UI configuration according to the present invention.

[0112] Referring to FIG. 8, the haircut training device (110) may install and run a haircut guide app that performs a haircut guide provision method. The haircut guide app may correspond to a dedicated application implemented to perform the haircut guide provision method according to the present invention. When the haircut guide app is executed, a main panel UI may be displayed within the area viewed by the user in a visualized virtual space.

[0113] Specifically, ① is an area that displays messages based on the progress status of the current step, and can be implemented as a TextMeshpro object with 'Done' for completed state and 'Ready' for uncompleted state. At this time, TextMeshpro is text for Unity and can provide control functions for text formatting based on features such as characters, words, line and paragraph spacing, kerning, aligned text, links, more than 30 rich text tags, support for multiple fonts and sprites, and custom styles.

[0114] Additionally, ② may include a step execution button and buttons to move to the previous and next steps as buttons related to step execution. The text of the step execution button may be displayed as “Start” if the current step has not been executed and as “ReStart” if the execution is completed; the text of the button to move to the previous step may be displayed as “<” and the text of the button to move to the next step may be displayed as “>”.

[0115] Additionally, ③ represents the currently active step among a total of 14 steps separated by base, and can be implemented as a TextMeshpro object and displayed as “Current Step / Total Steps”. ④ is a forced button for arbitrary program termination, which can be used when you want to return to the beginning or terminate the program. ⑤ can display the progress status for each step, and completed steps can be displayed in red and incomplete steps in black; the text can be implemented as a TextMeshpro object and the background as a Quad object.

[0116]

[0117] FIGS. 9a to 9f are exemplary diagrams illustrating the cutting steps for each base according to the present invention.

[0118] Referring to FIGS. 9a through 9f, the haircut training device (110) according to the present invention can perform a method of providing a haircut guide by running a haircut guide app. To this end, the haircut training device (110) can scan an indoor space in which a haircut training mannequin is placed centered on the location of a user wearing the device, visualize it as a virtual space, output a virtual mannequin modeled in 3D on the visualized virtual space, and then perform a process of aligning the actual mannequin with the virtual mannequin by adjusting the distance, height, and angle of the mannequin. The haircut training device (110) can provide a “Tuning” menu for alignment on the interface, and the user can directly adjust the distance, height, and angle of the mannequin using the ‘Plane Move’, ‘Rotate Y’, and ‘Rotate X’ buttons. Once the mannequin alignment step is completed, the haircut training device (110) can perform an operation for providing a haircut guide for each base.

[0119] Below, the Area Cut step for the major bases is described.

[0120] Referring to Fig. 9a, the operator can hold the bundle of hair in the partitioned 'Nape' section with the left hand and comb it with the right hand so that the second finger of the left hand moves toward the 'Cut Point'. When the left hand aligns with the 'Cut Point', the blue dot (finger point) on the left hand turns into a red dot; at this point, the operator uses scissors with the right hand to cut, and if the operator shouts 'Cut Okay' as indicated on the screen, the 'Menu Panel' may be displayed again. In the case of the Nape, if the position of the Cut Point is not parallel to the operator's heart position, it may be longer than the actual length.

[0121] Referring to Fig. 9b, the 'Back Area' is the zone responsible for the volume of the haircut. It is an important area where the angle of the elevation (Y) axis should be small when the head is flat, and large when the hair is to be made lighter. Also, unlike the nape area, it may appear shorter even if it is the same length of 14 cm.

[0122] Referring to Fig. 9c, the 'Crown Area' is the central region among the sections divided diagonally from the center of the Top Point and Golden Point; it corresponds to the part that controls the movement, texture, and height of the shape of the hair on the outermost surface of the hairstyle. Since it has a triangular base unlike other bases, it may be one of the areas where the height difference changes significantly depending on the angle of the fingers.

[0123] Referring to Fig. 9d, the 'Right Side Area' is the region that creates and expresses the outline shape and texture of the right side of the face; it is an area where even with the same style, changes in image can occur completely depending on the face shape. Since the side panel is the area with the most vertical plane among the head regions, there is less curvature of the head, allowing for both horizontal and vertical finger positions; however, holding it vertically while cutting can induce more natural layering.

[0124] Referring to Fig. 9e, the 'Right Top Area' can be one of the important parts that complement the face shape, along with the 'Front Area'. Unlike the back part, which forms a gentle curve, the vertical part of the side part forms a steep slope from the horizontal part of the top part, and if the range of the front part becomes smaller due to the see-through bang style, the range becomes relatively wider, and it may correspond to a part where there is a significant difference in length depending on the change in the axis.

[0125] Referring to Fig. 9f, the 'Front Area' is an area classified as side hair in the National Technical Qualification (General) haircut task. It corresponds to the area where hair falling toward the front hair when combed in the direction of gravity starting from the Top Point is cut above the eyes to ensure visibility. In this case, the range of the front hair obstructing the view can be defined as a triangular area, and the hair design can be changed into various styles by adjusting the range of the triangular area.

[0126]

[0127] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as described in the following claims.

[0128]

[0129] [Explanation of the symbol]

[0130] 100: Haircut Education System

[0131] 510: Pivot Point

[0132] 610: Base 620: Grab Point

[0133] 630: Guidelines 640: Cut Point

[0134] 650: Center of the sphere

[0135] 710: Left hand second joint point

[0136] 720: The tip of the left finger

Claims

1. A method performed on a device providing eXtended Reality (XR), A step of scanning an indoor space in which actual objects for hair cutting education are arranged, centered on the location of a user wearing the above device, and visualizing it as a virtual space; A step of outputting a 3D virtual object onto the visualized virtual space and then aligning and arranging it based on the position of the actual object; A step of determining a target base according to the user's selection among a plurality of bases defined by partitioning a portion of the surface of the virtual object; and A method for providing a haircut guide using augmented reality technology, comprising the step of visualizing and providing a haircut guide composed of pre-defined grab points and cut points based on the above target base, and guide lines connecting the points.

2. In paragraph 1, the step of visualizing into the virtual space A method for providing a haircut guide using augmented reality technology, characterized by including the step of converting the above indoor space into mesh data containing at least coordinate information.

3. In paragraph 2, the step of placing the virtual object A method for providing a haircut guide using augmented reality technology, characterized by including a step of adjusting at least one of the distance, height, and angle of the virtual object based on the coordinate information of the mesh data.

4. In paragraph 1, the step of determining the target base A method for providing a haircut guide using augmented reality technology, characterized by including the step of providing a user interface for the user's selection on the visualized virtual space and receiving the user's selection regarding the plurality of bases through the user interface.

5. In paragraph 4, the step of determining the target base A method for providing a haircut guide using augmented reality technology, characterized by including a step of changing the color or border of a target base according to the user's selection to visually emphasize and display it.

6. In paragraph 1, the step of determining the target base A method for providing a haircut guide using augmented reality technology, characterized by including a step of determining the transparency of the target base.

7. In paragraph 1, the step of providing by visualization above A method for providing a haircut guide using augmented reality technology, characterized by including the step of tracking the position of the user's finger and visualizing it as a finger point, and if the distance between the finger point and the cut point is within a preset distance, changing and providing at least one of the size, shape, and color of the finger point.

8. In paragraph 1, the step of providing by visualization above A method for providing a haircut guide using augmented reality technology, characterized by including the step of tracking the position of the user's finger and visualizing it as a finger point, and if the distance between the finger point and the cut point is within a preset distance, changing and providing at least one of the size, shape, and color of the cut point.

9. In Paragraph 7, the step of providing the above-mentioned visualization A method for providing a haircut guide using augmented reality technology, characterized by including the step of terminating the provision of the haircut guide when a voice command or gesture input from the user is received while at least one of the size, shape, and color of the finger point is changed.

10. A spatial visualization unit that scans an indoor space in which actual objects for hair cutting education are placed centered on the user's location and visualizes it as a virtual space; A virtual object placement unit that outputs a three-dimensional virtual object onto the visualized virtual space and then aligns and places it based on the position of the actual object; A base determination unit that determines a target base according to the user's selection among a plurality of bases defined by partitioning a portion of the surface of the virtual object; and A hair cutting education device utilizing augmented reality technology, comprising: a guide providing unit that visualizes and provides a hair cutting guide composed of pre-defined grab points and cut points based on the above target base, and guide lines connecting the points.

11. A computer-readable recording medium storing a computer program, When the above computer program is executed by a processor, A step of scanning an indoor space in which actual objects for hair cutting education are placed around the user's location and visualizing it as a virtual space; A step of outputting a 3D virtual object onto the visualized virtual space and then aligning and arranging it based on the position of the actual object; A step of determining a target base according to the user's selection among a plurality of bases defined by partitioning a portion of the surface of the virtual object; and A computer-readable recording medium comprising instructions for a processor to perform a method including the step of visualizing and providing a haircut guide composed of a pre-defined Grab Point and Cut Point based on the above target base, and a Guide Line connecting the points.

12. A haircut training device that scans an indoor space in which actual objects for haircut training are arranged centered on the user's location and visualizes it as a virtual space; and A computing device connected to the above-mentioned haircut training device via a network and storing and analyzing data regarding the user's learning progress and practice results; comprising The above computing device A hair cutting education system utilizing augmented reality technology, characterized by being implemented to provide educational content on hair cutting techniques by linking with a database storing 3D models and cutting guide information for each hairstyle.

Images