SYSTEM FOR MANAGING HAIR CONDITION INFORMATION AND METHOD FOR OPTIMIZING A COSMETIC CONSULTING SYSTEM

Description

[0001] The invention relates to a system for managing hair condition information and a method for optimizing a cosmetic consultation system.

[0002] In the field of cosmetic hair treatment, static data systems are known that provide information to users or customers based on data entered once.

[0003] The information provided is static. The systems are capable of extracting information from a data store based on user-specific inputs and providing the user with information regarding, for example, a hair color.

[0004] For example, a method is known that assists a user in selecting a hair color before dyeing their hair. Based on their previously measured hair color, the system can provide the user with a statistical prediction of the resulting hair color after treating their hair with a hair coloring product.

[0005] However, the system works with static hair reference colors as starting colors, which can be compared to the user's hair color before hair coloring, and static target hair color shades. Therefore, a user's actual hair color before a hair coloring process that lies between two adjacent hair reference colors is not classified according to their real hair color, but rather assigned to a similar reference hair color that may differ in shade. This results in inaccuracy in the specification of corresponding target hair colors. The user is presented with a corresponding reference hair color in the system as the hair condition result after the hair treatment. This can falsify a predicted hair condition result, which could lead to user dissatisfaction.Furthermore, the known systems are not designed to determine a difference between a predicted hair colour value and an actual hair colour value determined after a hair treatment and to optimise their user-specific information and information passed on to the user depending on the determined difference.

[0006] Document US 2014 / 0118521 A1 describes a system and a method for determining a color recipe for changing a hair color from a starting color to a target color. Document US 2005 / 0256733 A1 describes a system for displaying hair strands and determining the temporal development of a user's hair. Document US2007 / 0265867 A1 describes a method for assisting hairdressers in haircutting, in which a hairstyle is projected onto a display containing a user's hair. Document WO 2018219895 A1 does not belong to the prior art within the meaning of Articles 54(2) and (3) EPC. It discloses a method and a device for providing a hair treatment agent.

[0007] There is therefore a need for a system that updates stored hair condition information, e.g., a hair color shade of users, depending on actually achieved hair color results, and for a method by which the predicted hair condition information, e.g., a prediction of a hair appearance of users, can be optimized or specified more precisely.

[0008] Solutions to this problem are provided by the system according to claim 1 and the method according to claim 10.

[0009] The invention makes it possible to compare a predicted hair condition by means of a subsequent measurement of the actual hair condition after a user's hair treatment.

[0010] Furthermore, the invention makes it possible to determine a deviation between hair condition information stored in the system and an actual hair condition of a user after a hair treatment.

[0011] Various embodiments provide an optimized cosmetic consulting system.

[0012] The cosmetics consulting system can be set up as a learning cosmetics consulting system.

[0013] The invention provides an efficient consulting system that can update a database system provided for storing user-specific hair condition information by means of a difference in hair condition information that can be acquired after a hair treatment of a user's hair.

[0014] A system for managing hair condition information is provided. The system may comprise: at least one sensor for determining hair condition information of a user, a memory, wherein the memory is configured to store at least the hair condition information, and a processor, wherein the processor is configured to update at least the hair condition information in the memory based on a deviation of hair condition information of the user determined by means of the sensor after a hair treatment from predicted hair condition information of the user.

[0015] The storage device can comprise a server, a database, or a cloud. Information, for example in the form of data, can be read out, imported, replaced with updated data, or deleted from the storage device. The storage device can, for example, be a comprehensive database device in which personal or user-specific information regarding hair conditions and general information regarding hair treatment products can be stored. Furthermore, the storage device can comprise information that enables a user to be identified prior to a hair treatment, for example, with a hair treatment product from Schwarzkopf, by means of user identification. The term "hair condition prior to a hair treatment" can also be referred to as "initial hair condition."The term hair condition after a hair treatment by dyeing or coloring, bleaching or after treating hair with a cosmetic hair treatment product can also be referred to as hair condition result.

[0016] The memory can manage information for existing users already registered in a database system, and corresponding information can be created for new users. Furthermore, the information stored or stored in the memory can be accessed by a processor. The processor can be configured to store the information or data acquired by the sensor in the memory and to access the stored information or data.

[0017] The storage can be, for example, a large data storage, such as a data server, a cloud server, a constant information miner (KNIME) server, or a big data KNIME server.

[0018] The system may comprise a data management system. Furthermore, the system may comprise an algorithm, a calculation model, or a software program that can be executed, for example, by a processor. The algorithm may be stored, for example, in a processor or in a memory of a mobile device such as a smartphone or tablet, or in a stationary device such as a cloud or a smart mirror.

[0019] According to the inventive concept, it can be advantageously achieved that an optimization of the system is provided by updating the information stored in the memory and used for predicting hair conditions. This results in an optimized prediction of possible target hair colors based on desired hair shades selected by a user, for example, in a hair coloring process or a hair bleaching process.

[0020] Furthermore, according to the inventive concept, it can be advantageously achieved that a hair condition information management system learns by updating its internally stored data from previously performed hair treatments on users, by adjusting corresponding hair condition information storage values ​​in the memory based on hair conditions measured after a hair treatment. Thus, a more accurate prediction of, for example, a user's target hair color can be determined by means of the management system than is conventional. Furthermore, the performance of the management system can be improved.

[0021] Furthermore, increased user or customer satisfaction can be achieved when using cosmetic hair treatment products, for example Schwarzkopf hair treatment products.

[0022] Furthermore, it can be achieved that findings on hair color values ​​that arise from a variety of natural hairs, for example as a hair coloring result or hair bleaching result after a hair treatment, can be archived in a memory and retrieved again.

[0023] The hair condition information includes a hair damage level and a hair color tone. The hair damage level can be specified for a user's hair strand or hair fiber, for example, on a scale from 0 to 10, from 0 to 100, from slight to moderate to severe, etc. The hair damage level can, for example, include information about the condition of the hair cuticle, the hair medulla, and the hair fiber layer (cortex), etc. of the hair shaft. The hair damage level can, for example, include external damage and / or internal damage to the hair. For example, the damage level can be influenced by daily hair treatments, shampooing, brushing, heat treatment, chemical treatments, environmental factors, etc.

[0024] A hair color shade or a hair color value can, for example, be specified as an L, a, b color value in an L, a, b color space and stored in a memory. The hair color shade can also be specified as an RGB color value in an RGB color system or as a CMYK color value in a CMYK color system. The hair color shade can include color information, for example, a color shade parameterized with a* and b*.

[0025] However, it goes without saying that the hair condition information is not limited to the degree of hair damage and hair color, but can include other hair condition information. For example, in various embodiments, the sensor can comprise a hairbrush equipped with a sensor or a hair comb equipped with a sensor. The hairbrush or hair comb can comprise sensors for measuring forces acting on the bristles of the hairbrush or on the teeth of the comb. The measured forces when brushing or combing a user's hair can be stored in the brush or comb, for example, in an internal memory or transmitted to the memory via a wired or wireless connection. For example, hair condition information relating to hair smoothness or hair combability can be determined using the system.

[0026] In various embodiments, the sensor may comprise a near-infrared spectroscopy (NIR) sensor and / or a camera and a color calibration means.

[0027] In various embodiments, the degree of hair damage, also referred to herein as the degree of hair damage, can be determined using a molecular sensor or near-infrared spectroscopy (NIR) sensor. For example, the NIR sensor can be used to determine the degree of internal hair damage. With NIR sensor technology, molecular vibrations can be excited by electromagnetic radiation in the near-infrared range. The near-infrared range lies approximately in the range from 780 to 3000 nm. The near-infrared range can be divided into a short-wave range from 780 to 1400 nm and a long-wave range from 1400 nm to 3000 nm. With NIR spectroscopy, interactions between electromagnetic radiation and hair can be measured, and information about an absorption level or a reflection level can be obtained.For example, various hair components can be qualitatively or quantitatively determined from absorption spectra. Furthermore, material properties of hair, such as hair roughness, can be measured by evaluating surface scattering effects. Furthermore, an interference pattern generated by interfaces in spectra can be used to determine hair layer thickness. NIR spectroscopy can be particularly suitable for determining the water content, amino acid content, protein content, or lipid content of hair. Furthermore, NIR spectroscopy can be used, for example, to determine the fiber weight of hair. For example, the degree of light penetration through a hair or a strand of hair in the NIR wavelength range can be measured.

[0028] In near-infrared spectroscopy, for example, a distinction can be made between the reflection principle and the transmission principle. In the case of the reflection principle, the hair can be irradiated with white halogen light, for example. The reflected NIR component is detected by an NIR sensor. In the case of the transmission principle, the hair is irradiated with white halogen light. The penetrating halogen light can be detected by the NIR sensor. This allows information about the elasticity, degree of elongation, stiffness, cross-sectional area, shape, or density of hair to be determined, for example. An NIR sensor can be used, for example, to measure the moisture content of hair. This enables a high measurement resolution.

[0029] Various embodiments can enable a non-intrusive, contactless optical measurement of the degree of damage to a user's hair using an NIR sensor. This allows hair damage caused by mechanical influences to be detected and sustainably corrected using appropriate hair care products. The NIR sensor can be integrated into a smartphone or tablet, for example.

[0030] In various embodiments, a plurality of pieces of information regarding a degree of hair damage can be stored in the memory or in the NIR sensor, so that data obtained from the measured hair using the NIR sensor or from the measured strand of hair using the NIR sensor can be compared with data in the memory. Different damage levels can be stored in the memory for different degrees of hair damage.

[0031] In various embodiments, a person's hair color or hair shade, also referred to here as the user, can be determined using a camera or using a camera and a color calibration device. Any camera with sufficient resolution to capture a strand of hair or a single hair can be used as the camera. The camera can be a digital camera. For example, the camera can be a camera integrated into a smartphone or a tablet.

[0032] A color calibration agent, for example in the form of a calibration color chart or a calibration strand of hair, can be used to more precisely identify a user's hair color. In the case of a calibration color chart, a color range, for example, from light blonde through shades of brown to black, a variety of hair colors, is applied to the color calibration agent. Thus, using a calibration color chart, it is possible to obtain precise information about a user's hair color before and after a hair treatment using a cosmetic product, regardless of external light influences. A cosmetic product in this case can include a hair treatment product such as a hair care product (for example, a hair treatment, a hair oil, a hair mask, a conditioner), a hair dye, a hair styling product, a hair bleach, etc.When measuring a user's hair color, for example, a camera can capture not only the hair but also a calibration device attached next to the hair in an image. The image can be a digital image, for example. A processor can determine, for example, a hair region or an area of ​​hair in the captured image using common digital image analysis methods. A processor can use common digital image analysis methods to compare the color tones contained in the captured image with the color tones of the color calibration device contained in the image and determine a color that is most similar to a color on the color calibration device. The color tone determined by the processor can then be stored in a memory for archiving.

[0033] In various embodiments, the sensor can be an integrated mobile sensor comprising an NIR sensor, a camera, and a color calibration device. In various embodiments, a single mobile sensor, for example, a VIS / NIR sensor, can be implemented that can measure both the degree of hair damage and the current hair color of a user in a simple, quick, and uncomplicated manner. Furthermore, a measurement of a hair color and a measurement of a degree of hair damage can be performed almost simultaneously.

[0034] In various embodiments, a practical and cost-effective color calibration means for determining hair color tones can be used with a camera, for example a camera of a smartphone or a tablet.

[0035] Furthermore, an application, also abbreviated herein as a computer app or app, can be provided for various mobile platforms, which is intended for measuring at least one hair color using a camera and a color calibration device and for displaying measured hair condition information, such as a determined hair color of a user, a degree of hair damage of a user, a degree of internal hair damage of a user, possible predicted hair color tones, and other user-based information. The app can, for example, have a percentage or a graphical representation of a degree of hair damage. Using the computer app, a user can, for example, select at least one desired target hair color from target hair color tones graphically displayed in the computer app. Furthermore, ordering or repurchasing cosmetic hair treatment products can be carried out using the computer app.

[0036] In various embodiments, the sensor for use in a professional hair studio or in a premium hair salon may include additional sensors such as an NIR sensor.

[0037] In various embodiments, the system may further comprise a display device for displaying at least information based on the hair condition information stored in the memory. The display device may, for example, comprise a screen of a television, a smartphone, a tablet, or a smart mirror.

[0038] A smart mirror can be an intelligent mirror or a mirror-signal hybrid display. This can combine the advantages of a mirror with a digital display. On the one hand, the smart mirror can serve as a conventional mirror. On the other hand, the smart mirror can serve as a visual presentation screen or advertising board. For example, using a high degree of reflection, the smart mirror can display visually clear, real-time mirror images of a user and additional content next to the mirror image or overlapping it. The smart mirror can be used in the decision-making phase of a hair treatment. A smart mirror or multiple smart mirrors can be installed in hair salons, for example. Using the smart mirror, hair color tones digitally provided on the smart mirror can be virtually overlaid on the mirror image.For this purpose, the desired hair color can be superimposed on the mirror image using the Smart Mirror, enabling a realistic prediction of a user's hair color after a hair treatment. The Smart Mirror can also be used to present customer-specific treatment products such as a hair shampoo, a hair mask, a hair oil or other customer-specific advertising, etc. The Smart Mirror can be operated by a user and / or a hairdresser, for example, using a touchscreen. Furthermore, the Smart Mirror can have a wireless connection such as Wi-Fi or Bluetooth to exchange data with a sensor, mobile devices such as smartphones or tablets, a processor or a memory. The Smart Mirror can be controlled, for example, using a smartphone or tablet.For example, the smart mirror can have a full-screen mode, where the majority of the mirror surface is covered with digital information. Furthermore, the smart mirror can also be designed as a mobile device.

[0039] In various embodiments, the sensor can be implemented in a mobile device and the display device can be implemented in the mobile device and / or in a smart mirror.

[0040] The mobile device can be, for example, a smartphone, a tablet, etc. The camera of the smartphone or tablet can be configured to capture at least one digital image of a user's hair. The display device can be a screen of the smartphone or tablet. The display device can be implemented as a smart mirror that can display information based on the hair condition information captured by the at least one sensor.

[0041] The smart mirror can be configured to graphically display information to the user or a hairdresser advising them based on data from the memory. Furthermore, the smartphone, tablet, or smart mirror can be configured to display additional information to the user or hairdresser, such as information regarding the degree of hair damage, hair dryness, hair lightening status, current humidity, weather forecasts, etc. Furthermore, the display device can display possible target hair colors selectable by the user or hairdresser. Furthermore, the display device can display news and trends in the field of cosmetic hair treatment products or fashion.

[0042] In various embodiments, an exchange of information between the mobile device and the memory can be realized by means of an application (computer app). The system can, for example, be realized by means of an application, or computer app or can comprise these. The computer app can, for example, be an iOS app, Android app, etc. The computer app can, for example, be provided on the smartphone or tablet and comprise a program that gives the user written or graphic instructions on how to take pictures using the camera integrated in the smartphone or tablet. The computer app can also establish a wireless connection to the memory and vice versa, so that the images of hair taken by the at least one sensor or a degree of hair damage determined by a sensor can be transmitted to the memory via the computer app.The computer app can read data stored in the memory from the memory and make it available on the mobile device via the display. Of course, a wired connection for transferring information between the mobile device and the memory can also be provided. The computer app can provide access to the memory while on the move.

[0043] In various embodiments, the processor can further be configured to compare a degree of hair damage of the user before the hair treatment, detected by means of the sensor, with a plurality of hair damage degrees stored in the memory and / or to compare a hair color tone of the user before the hair treatment, detected by means of the sensor, with a plurality of hair color tones stored in the memory, to determine a most similar degree of hair damage and / or most similar hair color tone stored in the memory, and to provide a predicted hair condition and / or predicted hair color tone based on the respectively determined most similar degree of hair damage and / or the determined most similar hair color tone and a desired hair color of the user.

[0044] The memory can store stored hair damage levels and / or hair color shades or save them in the form of appropriate memory values, which can, for example, be assigned to a specific user. For example, one user can be assigned a brown hair color and a severe degree of hair damage, another user a black hair color and a mild degree of hair damage, and another user a light hair color and a moderate degree of hair damage. The information or data in the memory can be read in and out on a person-specific basis. Furthermore, the memory can contain a plurality of possible hair damage levels and values ​​for possible hair color shades.

[0045] For example, the system can present the user with possible hair colors via the display device, allowing the user to select at least one desired hair color from a total number of possible hair colors. The user can also select multiple desired hair colors from the total number of possible hair colors. For example, the system can present the user with a selection of five predicted hair colors based on five desired hair colors via the display device. However, the system is not limited to this, and it is understood that the system can display any number of predicted hair colors based on a total number of hair colors available in the portfolio to the user on the display device prior to a hair treatment.

[0046] The processor can compare the hair damage level determined by the sensor with a plurality of hair damage levels stored or stored in memory. For example, the processor can individually compare the hair damage level determined by the sensor with each of the plurality of hair damage levels stored in memory until the processor has determined a hair damage level in memory that most closely matches the hair damage level determined by the sensor. The processor can, for example, select the closest hair damage level and store it temporarily or permanently in memory.

[0047] For example, the processor can individually compare the hair color tone or hair color value determined by the sensor with each of the plurality of hair color tones stored in the memory until the processor has determined a hair color value in the memory that is closest to the hair color value determined by the sensor. The processor can, for example, select the closest hair color value and store it temporarily or permanently in the memory. The processor can also compare a desired hair color tone or desired hair color value selected by the user or selected desired hair colors or desired hair color values ​​with the hair color tones stored in the memory, select the closest hair color tone in the memory, and store it temporarily or permanently in the memory. The temporarily stored values ​​can therefore be available in the memory for later calculations by the processor.The values ​​can be cached in a processor memory.

[0048] Based on the nearest degree of hair damage determined in the memory, the hair color determined in the memory, and the at least one desired hair color selected by the user, the processor can predict or forecast at least one predicted hair condition using, for example, the display device. The user's predicted hair condition(s) can be displayed to the user via the screen on the smartphone, tablet, or smart mirror.

[0049] The smart mirror can, for example, provide a mirrored surface in which the user can see their reflection. The smart mirror can also include an integrated camera. The camera can take an image of the respective user. Using facial recognition, the user can be identified by retrieving and comparing the information in the image taken for facial recognition and the corresponding personalized information or personalized data in the memory. The personalized information can be displayed on the smart mirror depending on the user. Facial recognition can be implemented using known methods, for example an analysis of the characteristics of visible features in the frontal head area using a two-dimensional facial recognition method or a three-dimensional facial recognition method.

[0050] The system can further provide the user with a personalized or user-specific cosmetic hair treatment product, such as a hair shampoo, hair mask, hair dye, hair oil, etc., based on at least one desired hair color or at least one degree of hair damage. The information determined by the processor and memory can, for example, be forwarded to a filling station. The filling station can mix / produce a personalized or user-specific shampoo, hair dye, hair mask, hair oil, etc.

[0051] The system can further include a computer app and an online shop. Using the online shop, the user can purchase or reorder cosmetic hair treatment products specifically tailored to their needs online. The computer app and / or online shop can provide the user with a suitable user manual or voice-guided instructions for a particular cosmetic hair treatment product. These can be downloaded or accessed online.

[0052] In various embodiments, the processor may further be configured to determine a deviation between a hair color tone determined by means of the sensor before a hair treatment or a hair color tone predicted before a hair treatment and a hair color tone determined by means of the sensor after a hair treatment by comparing respectively associated hair color values.

[0053] The deviation can be a color tone difference or a color deviation amount. For example, the hair color determined by the sensor before a hair treatment can be subtracted from the hair color determined by the sensor after a hair treatment to determine a deviation.

[0054] In various embodiments, the hair color predicted before a hair treatment can be subtracted from the hair color determined by the sensor after a hair treatment in order to determine a deviation between these values. The hair color used to predict at least one desired hair color can be corrected for a determined deviation.

[0055] In various embodiments, the information used to predict a hair color tone can be optimized in the memory. Furthermore, the cosmetic consulting system used for user-specific consultations can optimize its stored hair condition information or its data archived in a memory with each treated user, because a hair condition comparison can improve a prognosis. Furthermore, the effectiveness of the personalized cosmetic consulting system can be increased. Furthermore, the personalized cosmetic consulting system can continually optimize predictable hair condition information with each consultation performed for a user. When conducting a plurality of user-specific cosmetic consultations using the system, coverage of different hair color tones can be achieved or a plurality of predicted hair color tones can be stored in the memory.The system allows users to benefit from the results of previously assisted users. Consequently, the user can benefit from treatments and measurements previously performed on the hair of other users. Furthermore, the cosmetic consultation system allows the creation of a comprehensive database based not on static hair condition information, but on real, measured hair condition information.

[0056] In various embodiments, the processor may further be configured to assign the hair condition information of the user detected by the sensor to the user in the memory.

[0057] In various embodiments, a history of hair damage levels and hair color tones can be created for a user. Based on the information about each individual user's hair stored over a certain period of time, a hair treatment success can be achieved over time. Statistical evaluations based on the hair condition information can also be performed for each user individually and for all users as a whole.

[0058] In various embodiments, a method for optimizing a cosmetic consultation system can be provided. The method can include: determining at least one piece of hair condition information of a user using at least one sensor before and after a hair treatment; determining a deviation between predicted hair condition information based on the user's hair condition information determined by the sensor before the hair treatment and between the user's hair condition information determined by the sensor after the hair treatment; and updating at least one piece of hair condition information used to determine the predicted hair condition in a memory based on the determined deviation.

[0059] In various embodiments, it can be achieved that only one sensor can be used to determine a hair condition of a user before a hair treatment and to determine a hair condition of a user after a hair treatment.

[0060] In various embodiments, this can provide an ever-improving prognosis over time with respect to a predicted hair appearance.

[0061] In various embodiments, the method may further comprise comparing the hair condition information of the user determined by means of the sensor before the hair treatment with the hair condition information of the user determined by means of the sensor after the hair treatment.

[0062] In various embodiments, the user can compare the condition of their hair before a hair treatment with the condition of their hair after a potential hair treatment. This allows the user to better determine the success of the hair treatment.

[0063] In various embodiments, determining hair condition information of the user may include determining a degree of hair damage using an NIR sensor and / or determining a hair color tone of the user using a camera and a color calibration means.

[0064] In various embodiments, determining hair condition information of the user may include determining a degree of hair damage using an NIR sensor and / or determining a hair color tone of the user using a photometer.

[0065] In various embodiments, determining hair condition information of the user may include determining a degree of hair damage and / or determining a hair color tone of the user using a VIS / NIR sensor.

[0066] In various embodiments, a non-intrusive, contactless optical measurement of the degree of damage to a user's hair can be achieved by using an NIR sensor. This allows hair damage caused, for example, by mechanical influences, to be detected and sustainably corrected.

[0067] In various embodiments, determining the predicted hair condition information may include: determining the degree of hair damage of the user before the hair treatment and / or determining the hair color of the user before the hair treatment, comparing the determined degree of hair damage with at least one of a plurality of hair damage degrees stored in the memory and / or comparing the determined hair color with at least one of a plurality of hair color tones stored in the memory, determining a most similar stored degree of hair damage and / or a most similar stored hair color in the memory, and providing a hair color predicted based on the respectively determined most similar stored degree of hair damage and / or on the determined most similar stored hair color and / or a predetermined desired hair color.

[0068] By comparing the hair condition after a hair treatment with a predicted hair condition, feedback can be obtained about the quality or effectiveness of a cosmetic hair treatment product under real conditions.

[0069] In various embodiments, the method may further comprise displaying a predicted hair color tone using a display device.

[0070] A user can be informed in a simple and convincing way about the condition of their hair after a hair treatment. This can support the user in their discovery and decision-making process and encourage them to use a cosmetic hair care product.

[0071] In various embodiments, updating may include at least updating a hair color tone and / or a hair damage level in the memory.

[0072] This can result in a more accurate prediction of a hair color shade using the cosmetic consultation system, thereby improving the quality of the cosmetic consultation system.

[0073] In various embodiments, an increase in the effectiveness of the cosmetic consulting system can be achieved.

[0074] In various embodiments, the accuracy of the hair color predictions can be achieved by the cosmetic consulting system by replacing previous hair color values ​​with further optimized hair color values.

[0075] The above-described embodiments and advantages refer to the system and the method.

[0076] Embodiments of the invention are illustrated in the figures and are explained in more detail below.

[0077] It shows Figure 1a schematic representation of a system for managing hair condition information according to various embodiments; Figure 2 a schematic representation of a system for managing hair condition information according to various embodiments; Figure 3 a schematic representation of a system for managing hair condition information according to various embodiments; Figure 4 a schematic representation of subcomponents of a system for managing hair condition information according to various embodiments; Figure 5 a flowchart illustrating a method for optimizing a cosmetic consulting system according to various embodiments.

[0078] In the following detailed description, reference is made to the accompanying drawings, which form a part of this application, and in which is shown by way of illustration specific embodiments in which the invention may be practiced.

[0079] In this regard, directional terminology such as "top," "bottom," "front," "back," "fore," "rear," etc., is used with reference to the orientation of the described figure(s). Since components of embodiments can be positioned in a number of different orientations, the directional terminology is for illustrative purposes and is in no way limiting. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention.

[0080] Furthermore, it is to be understood that the features of the various exemplary embodiments described herein may be combined with one another unless specifically stated otherwise.

[0081] The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.

[0082] A digital image can be understood herein as a data packet that can be represented by a data processing system as a two-dimensional (planar) arrangement of pixels, for example, in a coordinate system having an x-axis and a y-axis. Each pixel is assigned at least one piece of color information, which can be represented, for example, as the color of a pixel on a monitor or a printed dot on a printed image. The digital image can be, for example, a photograph taken with a digital camera or a single image from a video sequence recorded with a digital camera.

[0083] The terms "hair region" and "hair region area" are used synonymously herein. The hair region can comprise a plurality of pixels of a digital image that depict hair and can form a contiguous area or a surface consisting of a plurality of individual areas. A plane in which the hair region can be arranged can be determined, for example, by the x-axis and the y-axis of the digital image.

[0084] A "color" can be understood here as a combination of a hue (i.e. a spectral color impression, also called hue, which can be understood as what is considered the "actual color"), a color intensity (i.e. how intense the color appears, e.g. compared to a neutral gray, which is also called saturation, color saturation, colorfulness, chromaticity or color depth) and a brightness (i.e. how light or dark the color appears).

[0085] In various embodiments, the color information may, for example, have a parameterization in a known color space, for example in an L*a*b* color space (where L* indicates the brightness of a color, a* the green and red components, and b* the blue and yellow components of the color), in an RGB color space by color components in red, green, and blue, in a CMYK color space by color components in cyan, magenta, yellow, and black, or in any other color space.

[0086] The term "hue" can be understood here as a color value or the spectral color impression of a color, regardless of how this may be parameterized, for example as a point in a two-dimensional color space (e.g. a*b* of the L*a*b* system) or a ratio of color components (such as in the RGB color space or the CMYK color space).

[0087] In various embodiments, a color space from which the color information (hair color information and image color information) originates can be configured such that a determined or displayed color is independent of the medium through which the color is determined or displayed (e.g., screen, printer, scanner, human eye, etc.). The color space can be, for example, an L*a*b* color space, and the color information can be a hue parameterized, for example, using a* and b*. The uniform representation in the medium-independent color space makes it possible to present a realistic, expected coloring result.

[0088] Figure 1 is a schematic representation of a system 100 for managing hair condition information according to various embodiments.

[0089] According to various embodiments, the system for managing hair condition information may comprise a sensor 1. Sensor 1 may be a "two-in-one" sensor or a two-in-one sensor, which may comprise an NIR sensor and a camera. Sensor 1 may further comprise a color calibration means in the form of a color calibration card. Calibration colors may be applied to the color calibration card. Internal hair damage or the degree of hair damage can be analyzed using the NIR sensor. A realistic hair color of a user can be determined using the camera and the color calibration card.

[0090] Alternatively, the two-in-one sensor may comprise a VIS sensor and a NIR sensor or a NIR sensor and a photometer.

[0091] Furthermore, the system for managing hair condition information can comprise a storage 2. The storage 2 can be a big data KNIME server. By using the KNIME server, a simple and quick combination of modules for the preprocessing of customer data can be realized using a graphical user interface. By applying a KNIME server and big data analysis, for example, new connections and trends in the hair treatment product industry can be identified.

[0092] Furthermore, according to various embodiments, the system for managing hair condition information may comprise a processor 3. The processor 3 may be configured as a computing unit to write information or data to the memory 2 or to read information or data from the memory 2.

[0093] Sensor 1 can be connected to memory 2 via a wireless connection. The connection between sensor 1 and memory 2 can be implemented via a wired connection in various embodiments. Furthermore, processor 3 can be connected to memory 2 via a wireless connection. The connection between memory 2 and processor 3 can be implemented via a wired connection in various embodiments.

[0094] The system 100 for managing hair condition information according to various embodiments may provide a processor 3 that can wirelessly receive information or data from the sensor 1 and, for example, forward this data to the memory 2 and store it in the memory 2. Furthermore, according to various embodiments, the processor 3 may be provided in the memory 2. A wireless connection between the sensor 1, the memory 2, and the processor 3 may be implemented, for example, using a WLAN, Thread, ZigBee, NFC, Wibree, or Bluetooth connection. However, the invention is not limited thereto, and any suitable wireless connection may be implemented.

[0095] Figure 2 shows a schematic representation of a system 200 for managing hair condition information according to various embodiments.

[0096] Using sensor 1, a degree of hair damage 4a can be determined, for example, using an NIR sensor, and / or a hair color 4b, for example, using a camera and a color calibration agent. For this purpose, a user or a hairdresser can use sensor 1 to record a user's degree of hair damage 4a and / or a user's hair color 4b before a hair treatment. For example, a user's degree of hair damage 4a and / or a user's hair color 4b can be transmitted to storage 2 via a wireless connection 5a.

[0097] In the memory 2, for example, a comparison 6 of a hair damage degree 4a with a hair damage degree 8 stored in the memory 2 among a plurality of stored hair damage degrees can be performed. The hair damage degree from a plurality of hair damage degrees 8 stored in the memory 2 that is closest to the hair damage degree 4a determined by the sensor 1 can be determined by a processor and temporarily stored, for example, in the memory 2 or in the processor.

[0098] In the memory 2, for example, a comparison 7 of a hair color tone 4b with a hair color tone stored in the memory 2 among a plurality of stored hair color tones 9 can be performed. The hair color tone of a plurality of hair color tones 9 stored in the memory 2 that is closest to the hair color tone 4b determined by the sensor 1 can be determined by the processor and temporarily stored, for example, in the memory 2 or in the processor.

[0099] After determining a current degree of hair damage 4a and / or a current hair color 4b of the user by means of the sensor 1, the user or the hairdresser can select from a plurality of desired hair colors 11 stored in the memory 2. Based on a result 10 consisting of the determined degree of hair damage 8 and the determined hair color 10 as well as a desired hair color 11 selected by the user, a hair color prediction 12 can be provided, for example in the form of an image of the user's face with the selected desired hair color.

[0100] The hair color prediction 12 can be transmitted, for example, via a wireless connection 5b to a display device 13. Based on the hair color prediction 12, a graphical representation of the image can be presented to the user on the display device 13. The display device 13 can be, for example, a smartphone screen, a tablet screen, or a smart mirror. However, the present invention is not limited thereto, and other suitable display devices can be implemented.

[0101] For example, if it is determined after a user's hair treatment that a predicted hair condition deviates significantly from the hair condition determined by sensor 1 after a hair treatment, the processor can adjust the hair color prediction 12 accordingly. By adjusting or updating the hair color prediction 12, the system can be optimized for a more accurate prediction of a predicted hair color. At least one piece of hair condition information stored in memory 2 can be updated in order to make a better hair color prediction 12.

[0102] Figure 3 shows a schematic representation of a system 300 for managing hair condition information according to various embodiments.

[0103] The system 300 may determine the characteristics of the Figure 1 and 2 described systems 100 and 200.

[0104] In relation to the Figure 3 In the system 300 described above, a sensor 1 can be in contact with a processor 3 via a wireless connection 5a and can send information or data to the processor 3. Furthermore, the processor 3 can exchange information or data with a memory 2 via a wireless connection 5c.

[0105] In the system 300, hair condition information can be determined by means of the sensor 1 by means of a sensor hair condition recording 14a before a hair treatment of a user. The sensor 1 can comprise an NIR sensor. At least one hair area of ​​the user is detected by means of the NIR sensor before a hair treatment. The hair condition information detected by means of the NIR sensor can be compared with a plurality of hair information states that are stored in the memory 2 or another not in Figure 3 shown memory are compared.

[0106] Using the NIR sensor, various components or ingredients of the hair can be qualitatively or quantitatively determined from the absorption spectra, for example. The respective absorption spectrum or the respective reflection spectrum can be compared using an absorption spectrum or reflection spectrum stored in the memory 2, and a matching absorption spectrum or reflection spectrum can be determined in the memory 2, for example using the processor 3. Certain hair properties, for example, a water content in the hair, an amino acid content, a lipid content in the hair, a chemical composition of the hair, etc. After recording the user's hair before a hair treatment, information about the hair condition of the respective user can be provided based on the stored data.

[0107] Furthermore, using sensor 1 with a camera and a color calibration card, hair color information can be precisely captured before and after a hair treatment. After each measurement using sensor 1, a pair of measurement data, for example, the degree of hair damage of the user and the user's hair color, can be determined. In various embodiments, the measurement data can be measured independently of one another. The data can be assigned to the respective user and stored in memory 2.

[0108] According to various embodiments, for example, hair condition information can first be determined before a hair treatment using sensor 1, and the determined information can be stored in the memory. Then, for example, predicted hair condition information can be provided. Then, for example, hair condition information after a hair treatment can be determined using sensor 1 and stored in the memory. Based on the predicted hair condition information and the hair condition information determined after the hair treatment in memory 2, a comparison can be performed by processor 3. However, the present invention is not limited thereto, and it will be understood by those skilled in the art that other sequences are also feasible.

[0109] The user can select one or a plurality of target hair colors from a plurality of possible hair color values, for example, from a hair color palette, for example, hair color shades in which they would like to have their hair dyed or bleached. Based on the determined degree of hair damage of the user, the user's hair color determined by the sensor 1, and the desired hair color or shades selected by the user, the processor 3 can generate a predicted hair color image or a plurality of predicted hair color images 12. The at least one generated predicted hair color image 12 can be displayed on a display device, for example, via a wireless connection 5b.The at least one predicted hair color tone image 12 can, for example, be superimposed on a display device with an image taken of the user's hair before a hair treatment and combined, for example, by means of digital image processing.

[0110] The processor 3 can update the person-specific information or stored person-specific data stored in the memory. Updating the person-specific information can, for example, include overwriting previously stored hair condition information. The processor 3 can, for example, overwrite previously stored hair condition information for each user. For example, the processor 3 can replace a hair damage level determined during a previous hair condition measurement with a hair damage level measured later in the memory. The processor 3 can, for example, replace a hair color determined during a previous hair condition measurement with a hair color measured later in the memory.

[0111] Determining hair condition information, for example, a degree of hair damage and a hair color tone of the user, using a sensor hair condition recording 14b after a hair treatment can be performed as described with regard to the determination of hair condition information before a hair treatment. The hair condition determined after a user's hair treatment, for example, a degree of hair damage and / or a hair color tone, can be archived or stored for each user in the memory 2 by means of the processor 3.

[0112] System 300, using processor 2, can perform a comparison between a hair condition before a hair treatment and a hair condition after a hair treatment, for example, to improve the accuracy of the predicted or forecasted or future hair condition. For example, a hair color shade can be compared before and after a treatment and / or, for example, a degree of hair damage can be compared before and after a hair treatment.

[0113] Furthermore, the system 300 can, by means of the processor 3, compare a hair condition after a hair treatment with a predicted or forecasted or future hair condition provided before the hair treatment, as indicated by the reference numeral 15 in the Figure 3 is illustrated schematically. For example, a hair color after dyeing or bleaching the hair can be compared with a previously predicted hair color.

[0114] Furthermore, for example, a degree of hair damage after a hair treatment with a cosmetic hair treatment agent, for example with a hair shampoo, a hair mask, a hair dye or a hair oil, can be compared with a predicted degree of hair damage before the hair treatment.

[0115] A difference can be determined or calculated from the compared values, for example, hair color tones or hair color values ​​and / or degrees of hair damage or hair damage states. The difference can be obtained, for example, by subtracting one value from the other value. For example, a determined hair condition after a hair treatment can be subtracted from the predicted hair condition before the hair treatment. According to various embodiments, for example, a predicted hair condition before the hair treatment can be subtracted from a determined hair condition after a hair treatment.

[0116] At least one item of hair condition information from a plurality of items of hair condition information can be decreased or increased in the memory 2 by a respectively determined difference or a respectively determined difference by a hair color prediction update 16. For example, modifying a storage value by a difference resulting, for example, from a comparison between the predicted hair condition information and the actual hair condition information after a hair treatment can comprise increasing or decreasing the respective storage value in the memory 2. For example, a storage value in a memory cell of the database on, for example, a server, a cloud, etc. can be decreased by a predefined value using a subtraction function or increased by a predefined value using an addition function.The value reduced by the determined difference or the value increased by the determined difference can be stored in the memory, for example, in another memory cell or can be stored in the original memory cell, whereby the previous memory value can be overwritten.

[0117] Consequently, a system can be enabled that can improve an internal algorithm or an internal calculation model, for example, for determining predicted hair conditions, by comparing previous with subsequent values. The algorithm can be implemented, for example, in source code. The system can gain accuracy over time or with an increase in the number of before-and-after hair condition determinations. The system can thus represent a consulting system that learns over time. As a result of the system 300 learning over time and the increase in accuracy, a more accurate prognosis for the user and consequently greater user or customer satisfaction after the use of cosmetic care products and an increase in the effectiveness of the system 300 can be achieved.

[0118] Furthermore, system 300 can be used to collect user-based hair condition information. Thus, the preferences of a user or a plurality of users regarding hair color shades, cosmetic hair treatment products for use in cases of hair damage, etc., can be derived from the historical data stored in the memory. The hair condition information stored in memory 2 can also be made available for statistical evaluations. Data analysis can maximize the user's benefit.

[0119] Figure 4 shows a schematic representation of exemplary subcomponents 400 of a system 100, 200, 300 for managing hair condition information according to various embodiments.

[0120] The systems 100, 200 and 300 described above may, for example, comprise subcomponents 400, as shown schematically in the Figure 4In various embodiments, a smart mirror can be used as a display device 13, for example, in a professional hair salon. The smart mirror can comprise a combination of a conventional mirror and a digital screen. The conventional mirror and the digital screen can be superimposed. The conventional mirror can project a delay-free mirror image 18b of a user 18a, as in the Figure 4 The digital screen can be configured to display at least one piece of information 17 superimposed on the conventional mirror. As shown in the Figure 4As schematically illustrated, the information can, for example, comprise at least one predicted piece of user-specific hair condition information 17a, 17b, 17c, for example, at least one predicted hair color or at least one image of a user's head with a predicted hair color. For example, user-specific hair condition information 17a can comprise a darker hair color, user-specific hair condition information 17b can comprise a lighter hair color, and user-specific hair condition information 17c can comprise a combination of lightened and dark hair colors, for example highlights.

[0121] Furthermore, the smart mirror can display information of interest to the user, such as weather information 17d or general or personalized advertising 17e. The advertising can, in particular, include news in the areas of hair treatment or fashion. Furthermore, the smart mirror can be used to interactively display a cosmetic hair treatment product, such as a hair shampoo, a hair treatment, a hair dye, a hair mask, or a hair oil, etc., which can be individually mixed for the user after selection by the user. The information 17a to 17e displayed by the smart mirror can be tailored to the respective user. For example, the weather information 17d can relate to the user's current location. The personalized advertising 17e can, for example, suggest a cosmetic hair treatment product depending on the weather data.For example, in sunny weather, hair treatment products with UV protection can be suggested.

[0122] In various embodiments, the smart mirror can further comprise a facial recognition camera 19 for recognizing at least one face from a plurality of users stored in the memory 3. Using the facial recognition camera 19, the user can be identified before consulting a user 18a by capturing a facial region of the user 18a. The camera 19 can identify the respective person, for example, who is located in front of the smart mirror, using common methods for capturing people based on the person's face. After facial recognition, user-specific information can be displayed using the smart mirror.

[0123] Figure 5shows a flowchart comprising a method 500 for optimizing a cosmetic consulting system according to various embodiments.

[0124] The method 500 may include determining 510 at least one piece of hair condition information of a user using at least one sensor before and after a hair treatment. The method may further include determining 520 a deviation between predicted hair condition information based on the determined hair condition information of the user before the hair treatment and between the determined hair condition information of the user after the hair treatment. The method may further include updating 530 at least one piece of hair condition information used to determine the predicted hair condition in a memory based on the determined deviation.

Claims

1. A system for managing hair condition information, comprising: • at least one sensor (1) for determining a user's hair condition information, wherein the hair condition information includes a degree of hair damage and a hair color; • a memory (2), wherein the memory (2) is designed to store at least the hair condition information; and a processor (3), wherein the processor (3) is designed to compare a user's degree of hair damage before the hair treatment, detected by means of the sensor (1), with a plurality of degrees of hair damage stored in the memory (2), to compare a user's hair color before the hair treatment, detected by means of the sensor (1), with a plurality of hair colors stored in the memory (2), to determine a most similar degree of hair damage and most similar hair color stored in the memory (2), and • to provide a predicted hair condition and predicted hair color on the basis of the most similar degree of hair damage determined in each case and the most similar hair color determined and a user's desired hair color, wherein the processor is further designed to update at least one item of hair condition information in the memory (2) on the basis of a deviation of a user's hair condition information after a hair treatment, determined by means of the sensor (1), from a user's predicted hair condition information, and replace a degree of hair damage determined during a previous hair condition measurement and a hair color determined during a previous hair condition measurement with a degree of hair damage measured later and a hair color measured later in the memory.

2. The system according to claim 1, wherein the sensor (1) comprises a near-infrared spectroscopy sensor (NIR sensor) and / or a camera and a color calibration means.

3. The system according to claim 1, wherein the sensor (1) comprises a near-infrared spectroscopy sensor (NIR sensor) and / or a photometer.

4. The system according to claim 1, wherein the sensor (1) comprises a near-infrared spectroscopy sensor (NIR sensor) and / or a visible-light sensor (VIS sensor).

5. The system according to one of claims 1 to 4, wherein the system further comprises a display device (3) for displaying information based at least on the hair condition information stored in the memory (2).

6. The system according to claim 5, wherein the sensor (1) is produced in a mobile apparatus, and wherein the display device (3) is produced in the mobile apparatus and / or in a smart mirror.

7. The system according to claim 6, wherein an exchange of information between the mobile apparatus and the memory (2) is carried out by means of an application (App).

8. The system according to claim 1, wherein the processor is further designed to determine a deviation between a hair color before a hair treatment, determined by means of the sensor (1), or a hair color predicted before a hair treatment and a hair color after a hair treatment, determined by means of the sensor (1), by comparing associated hair color values in each case.

9. The system according to one of the preceding claims, wherein the processor is further designed to assign the user's hair condition information detected by means of the sensor (1) to the user in the memory (2).

10. A method for optimizing a cosmetic advice system, comprising: • determining at least one item of hair condition information of a user by means of at least one sensor (1) before and after a hair treatment, wherein the hair condition information includes a degree of hair damage and a hair color; • determining a deviation between predicted hair condition information based on the user's hair condition information before the hair treatment, determined by the sensor, and between the user's the hair condition information after the hair treatment, determined by the sensor; and • updating at least one item of hair condition information used to determine the predicted hair condition in a memory (2) on the basis of the determined deviation, wherein updating comprises replacing a degree of hair damage determined during a previous hair condition measurement and a hair color determined during a previous hair condition measurement with a degree of hair damage measured later and a hair color measured later in the memory; • wherein determining the predicted hair condition information comprises: • determining the user's degree of hair damage before the hair treatment and determining the user's hair color before the hair treatment, • comparing the determined degree of hair damage with at least one of a plurality of degrees of hair damage stored in the memory (2) and comparing the determined hair color with at least one of a plurality of hair colors stored in the memory (2), • determining a most similar stored degree of hair damage and a most similar stored hair color in the memory (2), and • providing a predicted hair color based on the most similar stored degree of hair damage determined in each case and on the most similar stored hair color determined and a predetermined desired hair color.

11. The method according to claim 10, wherein the method further comprises comparing the user's hair condition information before the hair treatment, determined by means of the sensor (1), with the user's hair condition information after the hair treatment, determined by means of the sensor (1).

12. The method according to claim 10, wherein updating comprises at least updating a hair color and / or a degree of hair damage in the memory (2).