Providing guidance on how to use a hair styling appliance

Abstract

A method is provided, the method comprising receiving image data from an image capture device, the image data comprising an image of a hair styling appliance; applying an image recognition algorithm to the received image data, wherein the image recognition algorithm is configured to identify an attachment of the hair styling appliance; generating, based on the identified attachment, guidance on how to use the hair styling appliance with the identified attachment; and displaying, on a display component of a user device, the guidance. A corresponding user device and hair styling system are also provided, as well as a non-transitory computer-readable medium storing instructions which lead to the execution of the provided method.

Description

[0001] PROVIDING GUIDANCE ON HOW TO USE A HAIR STYLING APPLIANCE

[0002] BACKGROUND

[0003] When using a hair styling appliance, particularly a new hair styling appliance, users often lack the skill or knowledge required to achieve a desired hairstyle.

[0004] SUMMARY

[0005] In a first aspect, the present invention provides a method comprising: receiving image data from an image capture device, the image data comprising an image of at least part of a hair styling appliance; applying an image recognition algorithm to the received image data, wherein the image recognition algorithm is configured to identify the hair styling appliance or an attachment of the hair styling appliance; generating, based on the identified hair styling appliance or attachment, guidance on how to use the hair styling appliance; and displaying, on a display component of a user device, the guidance. The method of the first aspect of the invention may be a computer-implemented method. In this manner, according to the first aspect of the invention, when a user uses a hair styling appliance, the user may view the display component of the user device in order to receive guidance (such as usage guidance or hair styling guidance) which is bespoke to that particular hair styling appliance or to the particular attachment that is being used with the hair styling appliance. This represents an improvement over the use of e.g. an instruction manual or an online tutorial, in which it is necessary for the user first to identify sections of the manual, and then to act on those instructions.

[0006] In the context of the present invention, the term “hair styling appliance” refers to any device which may be used to style a user’s hair in any way. The hair styling appliance may be an electrical hair styling appliance, and may be configured to style the hair for example by the application of heat, or by directing a flow of air towards the hair. It will be appreciated that other methods of styling hair are also envisaged. The hair styling appliance may comprise a hair straightener, a hair curler, a hairdryer, or any other device which may be used to style a user’s hair. The image recognition algorithm may identify the hair styling appliance or an attachment of the hair styling appliance. The term “attachment” is used herein to refer to a component which is removably attachable to the hair styling appliance. For example, the hair styling appliance may comprise a main body which comprises a first connector portion. The attachment may comprise a second connector portion which is complementary to the first connector portion, such that the attachment may be attached to the main body of the hair styling device by engagement of the first connector portion with the second connector portion.

[0007] The term “image capture device” is used to refer to any component which is capable of obtaining a visual representation of its surroundings, particularly those regions of the surroundings which are located within a field of view (FOV) of the image capture device. The image capture device may comprise a camera of the user device. More specifically, the image capture device may comprise a front-facing camera of the user device. Herein, a front-facing camera refers to a camera in the FOV of which a user will be while viewing the display component of the user device. In this way, a user is able to view the provided guidance without having to refer to another device, or having to e.g. change the position of the device. Furthermore, this enables the user to leave the device on a surface, while still being able to capture the appropriate image data, and view the provided guidance on the display component. This may be particularly useful when the hair styling appliance requires the use of two hands, as the user does not need to hold the user device. It is stated that the image data comprises an image of at least part of a hair styling appliance. This is intentionally broad, and should be understood to cover, among other things, a scenario in which the image data encodes the image in an electronic form which is suitable for processing by a computer.

[0008] The term “image recognition algorithm” is used to refer to any series of steps which can be applied to data which represents an image in order to identify, detect, or recognize some feature of that image. The image recognition algorithm may comprise a machine-learning model. Specifically, the image recognition algorithm may comprise a machine-learning model which has been trained to identify, detect, or recognize a predetermined plurality of hair styling appliances, or attachments for a hair styling appliance. Such a machine- learning model may comprise an artificial neural network, and the training data may comprise a plurality of data records, each record comprising an association between a training image containing an attachment, and a label identifying the attachment. The image recognition algorithm may entail the execution of at least two distinct steps. In a first step, the image recognition algorithm may be configured to detect the hair styling appliance or attachment in the received image data. Specifically, the image recognition algorithm may be configured to identify a subset of the image data which corresponds to the portion of the image containing the hair styling appliance or attachment. In a second step the image recognition algorithm may be configured to classify the detected hair styling appliance or attachment as one of a predetermined plurality of hair styling appliances or attachments. This second step may be executed only on the subset of the received image data which corresponds to the detected hair styling appliance or attachment, thereby reducing the computational demand required to execute it. In those implementations in which the image recognition algorithm is a machine-learning model such as an artificial neural network, the machine-learning model may comprise an encoder sub-model configured to execute the first step described above, and a classification submodel configured to execute the second step described above. The output of the image recognition algorithm may comprise hair styling appliance or attachment identification data, which comprises an indication of the algorithm. For example, the hair styling appliance or attachment identification data may comprise a hair styling appliance or attachment identifier.

[0009] The method of the first aspect of the invention comprises generating guidance on how to use the hair styling appliance. The term “generating” in this context should be treated broadly to refer to both generation of guidance from scratch, or alternatively, to selecting or retrieving existing guidance, e.g. guidance which is stored in a memory. The existing guidance may be stored in a memory of the user device, or may alternatively be obtained via a network such as a cellular network, or the Internet. Generating the guidance based on the identified attachment may comprise generating the guidance based on the hair styling appliance identification data, attachment identification data, a hair styling appliance identifier or an attachment identifier. For example, generating the guidance may comprise performing a lookup of the hair styling appliance identification data, attachment identification data, a hair styling appliance identifier or an attachment identifier in a lookup table, the lookup table storing associations hair styling appliance identification data, attachment identification data, hair styling appliance identifiers or attachment identifiers and guidance information. The guidance information may comprise the guidance itself, or may comprise data from which the guidance may be generated, which enables guidance to be generated in a manner which is better suited to the particular scenario.

[0010] “Guidance on how to use the hair styling appliance” refers to instructions to the user informing them, for example, of settings or motions to make with the hair styling appliance and / or attachment in order to achieve some desired effect. Specifically, the guidance may define one or more target usage characteristics, i.e. one or more ways in which the hair styling appliance and / or attachment should be used. Examples of target characteristics which may be specified or defined in the guidance may comprise one or more of the following: an action to perform with the hair styling appliance and / or attachment; a target position in which to hold the hair styling appliance and / or attachment; a target direction in which to move or rotate the hair styling appliance and / or attachment; a target speed at which to move or rotate the hair styling appliance and / or attachment; and a target orientation in which to place the hair styling appliance and / or attachment. These kinds of target usage characteristic are useful because the majority of hair styling operations include the motion (both translational and rotational) of a hair styling appliance and / or attachment. The one or more target usage characteristics may also comprise an amount of hair to place in the hair styling appliance and / or attachment. This may be particularly useful for devices such as hair straighteners or hair curlers. In addition to these motion-related characteristics, the target usage characteristics may also comprise device settings, such as temperature, mode of operation, and airflow rate. The target usage characteristics may also comprise an amount of time for which to use the hair styling appliance and / or attachment.

[0011] In order to provide ergonomic guidance to the user, the guidance may comprise one or more graphical indicators, the graphical indicators representing or describing the defined target usage characteristics. Herein, a “graphical indicator” should be understood to refer to a non-verbal or non-textual indicator. The graphical indicator may comprise a directional graphical indicator such as an arrow which indicates a direction in which the hair styling appliance and attachment should be moved or rotated, or a directional graphical indicator comprising a depiction of a path along which the hair styling appliance and / or attachment should be moved. Augmented reality may be used to improve the guidance provided to the user. “Augmented reality” is a term which is generally used to refer to an interactive experience that combines the real world and computer-generated content. In the context of the present invention, augmented reality may be applied by superimposing the guidance on how to use the hair styling appliance and / or attachment over a real-time video feed of the user on the display component. It will be appreciated that this is particularly advantageous when combined the graphical indicators representing or describing the defined target usage characteristics. Accordingly, the method of the first aspect of the invention may further comprise rendering the image data on the display component of the user device. In order to enhance the ease of use by the user, the image data may be displayed on the display component as a mirror image, so that the user’s movements are mirrored on the display component, rather than appearing to be in the opposite direction. The method may then further comprise superimposing the guidance over the rendered image data on the display component. In this way, the user is able to see themselves, and the guidance while using the user device. The simultaneous display of a mirror image of the user, along with the guidance on how to use the hair styling appliance and / or attachment greatly aids the user with the hair styling operation.

[0012] In order further to improve the guidance provided to the user, the method may comprise superimposing the guidance over a portion of the rendered image data depicting the hair styling appliance or the attachment of the hair styling appliance. This may involve superimposing the guidance so that it partially or completely covers the hair styling appliance or the attachment.

[0013] As discussed above, the image recognition algorithm may comprise detecting the hair styling appliance or the attachment in the received image data. This step may further comprise detecting the location of the hair styling appliance or the attachment of the hair styling appliance in the received image data. Superimposition of the guidance over the portion of the rendered image data depicting the hair styling appliance or the attachment of the hair styling appliance may then be based on the detected location of the hair styling appliance or the attachment or the hair styling appliance in the received image data. After detecting the location of the hair styling appliance or the attachment or the hair styling appliance, the image recognition algorithm may comprise generating location data representing the detected location. In this case, the superimposition may be based on the location data. By superimposing the guidance over the hair styling appliance or the attachment on the display component of the user device, the user is provided with clear guidance which enables them to identify exactly how to move, or where to place the hair styling appliance and / or attachment during the hair styling operation. For example, where the target usage characteristic comprises a target position or a target direction, the guidance may comprise an arrow superimposed on the hair styling appliance and / or attachment indicating the direction in which to move it (such as to move to the target position). Alternatively or additionally, when the target usage characteristic comprises a target position, the guidance may comprise a graphical representation (or equivalent) of the hair styling appliance and / or attachment which is superimposed over the desired location on the user’s hair, thereby instructing the user in which direction to move the hair styling appliance and / or attachment. Alternatively or additionally, when the target usage characteristic comprises a target rotation direction or target orientation, the guidance may comprise a curved arrow (or any other graphical representation of rotation direction) superimposed over the hair styling appliance and / or attachment.

[0014] The image data may comprise video of the hair styling appliance or at least part of the hair styling appliance. In other words, the image capture device may be configured to generate video data. The method may comprise sampling the received video data, and applying the image algorithm to a sampled snapshot of the video data. This process may be repeated at regular intervals, for example no less than once per second, no less than twice per second, no less than three times per second, no less than four times per second, no less than five times per second, no less than six times per second, no less than seven times per second, no less than eight times per second, no less than nine times per second, no less than nine times per second, or no less than ten times per second. In this way, it is possible to ensure that the guidance be updated in real time to ensure that it is always appropriate for the received video data. Correspondingly, as well as updating the guidance, the method may further comprise rendering the sampled snapshot of the video data. This process may be repeated at regular intervals, for example no less than once per second, no less than twice per second, no less than three times per second, no less than four times per second, no less than five times per second, no less than six times per second, no less than seven times per second, no less than eight times per second, no less than nine times per second, no less than nine times per second, or no less than ten times per second. The guidance may then be superimposed over the rendered video data for each sample, so that the user is able to view a real time mirror image of themselves with continuously updated guidance.

[0015] This real time provision of updated guidance to the user ensures that they are continuously receiving guidance which is specific to e.g. the position and orientation of the hair styling appliance and / or attachment at the time when the video data was sampled. Accordingly, the method may further comprise identifying, based on the received image data, a usage characteristic of the hair styling appliance and / or the attachment, wherein the guidance is generated at least partially based on the identified usage characteristic. These identified usage characteristics are not to be confused with the target usage characteristics: the identified usage characteristics are “real” characteristics describing what the user is doing at the time corresponding to the received image data, and the target usage characteristics are instructions, or desired characteristics. The usage characteristics may comprise one or more of the following: a position of the hair styling appliance and / or the attachment; an orientation of the hair styling appliance and / or the attachment; a direction of motion of the hair styling appliance and / or the attachment; a direction of rotation of the hair styling appliance and / or the attachment; a speed of motion of the hair styling appliance and / or the attachment; a speed of rotation of the hair styling appliance and / or the attachment; and an amount of hair held in the hair styling appliance and / or the attachment. By providing guidance which is tailored to the manner in which the user is using the hair styling device and / or attachment at a given time, and updating the guidance effectively in real time, while displaying that guidance superimposed over the continuously updated rendered image data, the user is provided with continuous guidance on how to use the hair styling appliance and / or attachment. This credibly assists the user in performing a technical task by means of a continued, guided human-machine interaction. This is credibly achieved because the updated guidance is determined at least in part based on measured usage characteristics, and even if the user is inaccurate in their response to the guidance, the updated guidance will be generated based on the updated usage characteristics. Furthermore the continuously updated guidance represents an ergonomically improved display of information.

[0016] The method may also comprise providing feedback to a user. Accordingly, the method may further comprise determining whether the identified usage characteristic meets a criterion indicating correct usage of the hair styling appliance and / or the attachment. The criterion may be that the identified usage characteristic differs from a target usage characteristic by no more than a predetermined threshold amount. If it is determined that the identified usage criterion does not meet the criterion, the method may further comprise causing the user device to generate an alert indicating incorrect usage. If it is determined that the identified user characteristic does meet the criterion, the method may further comprise causing the user device to generate an alert indicating correct usage. By providing real-time feedback in this manner, the method enables a user to correct any mistakes that they are making quickly in order to achieve a desired result.

[0017] The guidance may be determined based on other factors in addition to the detected attachment and, optionally, the determined usage characteristics. For example, the method of the first aspect of the invention may further comprise receiving a user input from a user interface of the user device, where the guidance is generated based also on the received user input. The user input may comprise one or more of a selection of a hair styling process (e.g. curling, straightening, blow-drying), a selection of a desired hair style. The guidance may then comprise instructions how to perform the hair styling process or achieve the desired hair style using the identified hair styling apparatus and / or attachment. By also determining the guidance based on a user input, guidance can be provided to a user based on a specific hair style or hair styling process, allowing the guidance to be more specifically designed for the exact needs of the user.

[0018] As well as providing guidance regarding the usage of the hair styling appliance in terms of e.g. motion and position of the device, the guidance may also comprise operating parameters of the device. For example, the method may comprise determining one or more operating parameters of the hair styling appliance based on the hair styling appliance or identified attachment. The guidance may then comprise those operating parameters. Or, the method may further comprise causing the hair styling appliance to operate according to the determined one or more parameters. For example, the method may further comprise transmitting an operating parameter signal to the hair styling appliance, the operating parameter signal encoding instructions which when executed by the hair styling appliance, cause it to operate according to the determined one or more operating parameters. The one or more operating parameters may comprise, for example, heater temperature, airflow rate, and airflow direction. The method may comprise transmitting the operating parameter signal via a Bluetooth connection. In some cases, a Bluetooth or other wireless connection between the user device and the hair styling appliance may not be available. In these cases, the guidance may comprise the operating parameters, enabling the user to adjust them manually.

[0019] A second aspect of the present invention provides a user device comprising a processor, and image capture device and a display component, wherein the processor of the user device is configured to execute the method of the first aspect of the invention. The user device may be in the form of a smartphone, a tablet, a laptop computer, a desktop computer, or any other suitable user device. The image capture device may be a camera, and in some cases may be a front-facing camera as outlined above. The user device may further comprise a memory which stores instructions, which when executed by the processor, cause the processor to execute the method of the first aspect of the invention. The user device may have stored thereon an application, the application comprising the instructions. The optional features set out previously in respect of the first aspect of the first aspect of the invention apply equally well to the second aspect of the invention, unless clearly technically incompatible, or where context dictates otherwise. These optional features are not repeated here, for brevity.

[0020] A third aspect of the invention provides a non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to execute the method of the first aspect of the invention. Again, the optional features set out previously in respect of the first aspect of the invention or the second aspect of the invention apply equally well to the third aspect of the invention, unless clearly technically incompatible, or where context dictates otherwise. These optional features are not repeated here, for brevity.

[0021] A fourth aspect of the invention provides a hair styling system which comprises the user device of the second aspect of the invention, a hair styling appliance and one or more attachments, each of which is removably attachable to the hair styling appliance. The hair styling appliance of the fourth aspect of the invention may be a hair straightener, a hair curler, a hairdryer,

[0022] Again, the optional features set out previously in respect of the first aspect of the invention, the second aspect of the invention, or the third aspect of the invention apply equally well to the fourth aspect of the invention, unless clearly technically incompatible, or where context dictates otherwise. These optional features are not repeated here, for brevity.

[0023] BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Fig. 1 shows a hair styling system comprising a hair styling appliance, an image capture device, and a user device.

[0025] Fig. 2 is a flowchart illustrating a high-level method of providing guidance on how to use a hair styling appliance and attachment.

[0026] Figs. 3 A and 3B are flowcharts illustrating a more detailed method of providing guidance on how to use a hair styling appliance and attachment.

[0027] Fig. 4 is a flowchart illustrating a process by which feedback, such as real time feedback may be provided to a user of the hair styling appliance and attachment.

[0028] Fig. 5 is a flowchart illustrating a process by which operating parameters of the hair styling appliance may be controlled.

[0029] Figs. 6 to 8 show example views on a user device performing the method of Fig. 2.

[0030] DETAILED DESCRIPTION Fig. 1 is a schematic diagram illustrating a hair styling system 100. The system includes hair styling appliance 200 with attachment 202, user device 300, and image capture device 400. In some cases, e.g. when the user device 300 is a smartphone or a laptop computer, the image capture device 400 may be part of the user device 300. It should be noted that in the description below, any, some or all features may be treated as optional, and the hair styling system 100 is presented as an example only. We first discuss the structure of the hair styling system 100, before describing its operation with reference to e.g. Fig. 2 to 5.

[0031] The hair styling appliance 200 and the user device 300 are connected such that they can exchange data between each other. The connection may be wireless, for example via a network such as the Internet, or a cellular network, or a Bluetooth connection.

[0032] Alternatively, the connection may be wired. It will be appreciated that various kinds of connection may be used. The user device 300 comprises a user interface module 301, hair styling appliance interface module 302, an image capture device interface module 303, a processor 304, a memory 306, and a display component 308. The user interface module 301 is a component which is configured to receive and process inputs from a user input device. The user input device may comprise e.g. a touchscreen (which may, for example, be part of the display component 308), a keyboard, a mouse, or any other device suitable for receiving a user input.

[0033] As the name suggests, the purpose of the hair styling appliance interface module 302 and the image capture device interface module 303 is to interface with the hair styling appliance 200 and the image capture device 400, respectively. The hair styling appliance interface module 302 and the image capture device interface module 303 may be implemented in any suitable form, be it a software module, a physical interface (such as a USB connection, or similar), or a network component configured to receive data- containing signals from, or transmit data-containing signals to the hair styling appliance 200 or the image capture device 400, respectively.

[0034] It will be noted that the processor 304 comprises several “modules” and “sub-modules”.

[0035] The modules (described in more detail later) may be implemented in the form of hardware modules within the processor 304, but may also be implemented in the form of software modules. The software modules may be represented, for example, by computer code comprising instructions which, when executed, cause the computer to execute the respective function associated with that module. In this sense, the modules may be interpreted as “functional modules”, which may be implemented in any computer-based manner, such that they are able to execute the function with which they are associated. The user device 300 may comprise a general-purpose computer such as a desktop computer, a laptop computer, a smartphone, a tablet, or the like.

[0036] The processor 304 comprises an image recognition algorithm application module 3040, which itself comprises an attachment identification submodule 30400 and a usage characteristic identification submodule 30402. The processor 304 further comprises a guidance generation module 3042, a comparison module 3043, an image rendering module 3044 and an output module 3046. The memory 306 stores an image recognition algorithm 3060. The overall image recognition algorithm 3060 may comprise various subalgorithms, where the term “sub-algorithm” is used to refer to a subset of the steps which make up the overall image recognition algorithm 3060. Each sub-algorithm results in the execution of steps which achieve a different task which contributes to the overall output of the image recognition algorithm 3060. In the example shown in Fig. 1, the image recognition algorithm 3060 comprises an attachment detection sub-algorithm 30600, an attachment identification sub-algorithm 30602, and a usage characteristic identification sub-algorithm 30604.

[0037] The memory 306 further stores a lookup table 3062 and usage criteria 3063. The memory 306 also includes a buffer 3064 which may be used to store data on a temporary basis, whereas the image recognition algorithm 3060, lookup table 3062, and usage criteria 3063 may be stored in persistent memory (not shown).

[0038] We now discuss the operation of the hair styling system 100. Fig. 2 shows a flowchart illustrating a high-level computer-implemented method. The method takes place while a user is using, or about to use, the hair styling appliance 200. In a first step S200, the image capture device 400 captures an image (which may be in the form of a video) of the hair styling appliance 200 and attachment 202, thereby generating image data encoding the captured image. Then, in step S202, the generated image data is transmitted to the user device 300, and is received via the image capture device interface module 303, and may be stored in the buffer 3064 of the memory 306 of the user device 300. In step S204, the image recognition algorithm application module 3040 of the processor 304 retrieves the image recognition algorithm 3060 from the memory 306, and applies the image recognition algorithm 3060 to the received image data stored in buffer 3064. By applying the image recognition algorithm 3060 to the received image data stored in the buffer 3064, the processor 304 is able to identify attachment 202 of the hair styling appliance 200 which is currently in use by the user. Then, in step S206, the guidance generation module 3042 generates guidance on how to use the identified attachment 202, based on the identified attachment 202. In step S208, the output module 3046 of the processor 304 outputs the generated guidance to the display component 308, which displays the guidance in step S210. Fig. 2 is a high-level description corresponding to a broad definition of a method that may be performed by the hair styling system 100. We now describe specific implementations of the method with reference to Figs. 3 A and 3B.

[0039] In step S300, the image capture device captures an image (which may be in the form of a video, or may comprise sampling video data) of the hair styling appliance 200 and attachment 202, thereby generating image data encoding the captured image. Then, in step S302, the generated image data is transmitted to the user device 300, and is received via the image capture device interface module 303, and may be stored in the buffer 3064 of the memory 306 of the user device 300. In step S304, which may take place at the same time, before, or after step S302 (or not at all), user input is received via the user interface module 301 of the user device 300. The user input may comprise, for example, a selection of a hair styling process which the user wishes to perform with the hair styling appliance 200 and attachment 202, or a hair style which the user wishes to achieve with the hair styling appliance 200 and attachment 202. The user interface module 301 may generate user input data encoding the user input, and may transmit that user input data to the guidance generation module 3042 of the processor 304, or to the buffer 3064 for temporary storage. We return to the user input data shortly. In step S306, the image recognition algorithm application module 3040 of the processor 304 retrieves the image recognition algorithm 3060 from the memory 306, and applies the image recognition algorithm 3060 to the received image data stored in buffer 3064. The image recognition algorithm 3060 may comprise three sub-algorithms, as discussion previously: an attachment detection sub-algorithm 30600, an attachment identification subalgorithm 30602, and a usage characteristic identification sub-algorithm 30604. In this manner, guidance may be generated based not only on the nature of the attachment 202, but also the way in which it is being used at a given time. The operation of the image recognition algorithm application module 3040 may be as follows:

[0040] • In a first step S308, the attachment identification submodule 30400 may retrieve the attachment detection sub-algorithm 30600 from the memory 306, and apply it to the received image data which may be stored in the buffer 3064. The function of the attachment detection sub-algorithm 30600 is to identify the portion of the received image data which corresponds to a depiction of the attachment 202 of the hair styling appliance 200. This data may then be stored in the buffer 3064.

[0041] • Having identified the portion of the receiving image data corresponding to the depiction of the attachment 202 of the hair styling appliance 200, in step S310, the attachment identification submodule 30400 may then retrieve the attachment identification sub-algorithm 30602 from the memory 306, and apply it to the portion of the received image data corresponding to the depiction of the attachment 202 of the hair styling appliance 200. The output of the attachment identification sub-algorithm 30602 is attachment identification data or an attachment identifier, which as the name suggests provides an indication of the nature of the attachment 202 of the hair styling appliance 200. The attachment identification data or attachment identifier may then be stored in the buffer 3064.

[0042] • In step S312, the usage characteristic identification submodule 30402 may retrieve the usage characteristic identification sub-algorithm 30604 from the memory 306. The usage characteristic identification sub-module 30402 may then apply the usage characteristic identification sub-algorithm 30604 either to the received image data, or only to the portion of the received image data corresponding to the depiction of the attachment 202 of the hair styling appliance 200. The output of the usage characteristic identification sub-algorithm 30604 is usage characteristic data which as the name suggests provides an indication of a usage characteristic of the attachment 202 of the hair styling appliance 200. As discussed earlier in this application, the usage characteristic data may define one or more of the following: a position of the hair styling appliance; an orientation of the hair styling appliance; a direction of motion of the hair styling appliance; a direction of rotation of the hair styling appliance; a speed of motion of the hair styling appliance; a speed of rotation of the hair styling appliance; and an amount of hair held in the hair styling appliance. The usage characteristic data may then also be stored in the buffer 3064. It should be noted that step S312 may also take place before steps S308 and S310, or alternatively in parallel with steps S308 and / or S310.

[0043] At this point, user input data, attachment identification data, and usage characteristic data has been obtained, and optionally stored in the buffer 3064. It is this data based on which the guidance is generated. Accordingly, in step S314 the guidance generation module 3042 of the processor 304 generates the guidance on how to use the hair styling appliance 200 and attachment 202 based on the data stored in the buffer 3064. As discussed earlier in this application, the term “generated” should be treated broadly so as to cover the generation of brand-new guidance, or the identification and selection of existing guidance from some repository or database. For example, in one implementation, the guidance generation module 3042 may execute a lookup based on the data stored in the buffer 3064 in the lookup table 3062 stored in the memory 306. The lookup table 3062 may comprise associations between e.g. attachment identification data, and / or usage characteristic data, and guidance on how to use the hair styling appliance 200 and attachment 202. In such cases, the guidance generation module 3042 may execute a query comprising at least the attachment identification data and optionally the usage characteristic data, in order to retrieve the appropriate guidance on how to use the hair styling appliance 200 and attachment 202. The guidance on how to use the hair styling appliance 200 and attachment 202 may comprise target usage characteristics, such as an action to perform with the hair styling appliance and attachment; a target position in which to hold the hair styling appliance and attachment; a target direction in which to move or rotate the hair styling appliance and attachment; a target speed at which to move or rotate the hair styling appliance and attachment; or an target orientation in which to place the hair styling appliance and attachment.

[0044] A more ergonomic experience may be provided to the user by superimposing the guidance on how to use the hair styling appliance 200 and attachment 202 over an image of the user and the hair styling appliance 200 and attachment 202. Accordingly, in step S316 the image rendering module 3044 may, based on the received image data and the generated guidance on how to use the hair styling appliance 200 and attachment 202, generate rendering instructions, which when executed by the display component 308 or processor 304, cause the display component 308 to display the generated guidance on how to use the hair styling appliance 200 and attachment 202 superimposed over a representation of the received image data on which the guidance is based. As we have discussed elsewhere in this application, it is particularly advantageous if a graphical representation or indicator of the guidance, e.g. an arrow is displayed over the portion of the image containing the hair styling appliance 200 and attachment 202, the graphical representation clearly indicating the target usage characteristic to the user. In step S318, the image rendering module 3044 transmits the image rendering instructions to the display component 308. Then, in step S320, the display component 308 displays the guidance on how to use the hair styling appliance 200 and attachment 202, by executing the instructions generated by the image rendering module 3044. The process of Figs. 3A and 3B may be repeated at regular intervals, e.g. by periodically sampling received video data (i.e. to generate the received image data), in order to provide real time guidance on how to use the hair styling appliance 200 and attachment 202.

[0045] As well as providing guidance on how to use the hair styling appliance 200 and attachment 202, the method also enables feedback, such as real time feedback to be provided to the user while using the hair styling appliance 200 and attachment 202. Fig. 4 is a flowchart illustrating an exemplary method by which feedback may be generated and provided to the user. This process may be executed at predetermined intervals, for example immediately after, or within a predetermined duration of time after the guidance on how to use the hair styling appliance 200 and attachment 202 has been displayed on the display component 308, at which point it is assumed that the user is following the guidance. It should be noted that the method of Fig. 4 may be integrated with the method of Figs. 3 A and 3B, e.g. to rely on the same received image data, and the same usage characteristic data. The manner in which the methods may be integrated will become clear from the description below. In a first step S400, the image capture device 400 captures an image (which may be in the form of a video, or may comprise sampling video data) of the hair styling appliance 200 and attachment 202, thereby generating image data encoding the captured image, which may then be transmitted to the user device 300, whereupon it is received via the image capture device interface module 303 and stored in the buffer 3064 of the memory 306. Then, in step S402, the usage characteristic identification submodule 30402 of the image recognition algorithm application module 3040 may retrieve the usage characteristic identification sub-algorithm 30604 from the memory 306, and apply it to the received image data. As before, the output of the usage characteristic identification sub-algorithm 30604 is usage characteristic data which as the name suggests provides an indication of a usage characteristic of the attachment 202 of the hair styling appliance 200. As discussed earlier in this application, the usage characteristic data may define one or more of the following: a position of the hair styling appliance; an orientation of the hair styling appliance; a direction of motion of the hair styling appliance; a direction of rotation of the hair styling appliance; a speed of motion of the hair styling appliance; a speed of rotation of the hair styling appliance; and an amount of hair held in the hair styling appliance. The usage characteristic data may then also be stored in the buffer 3064. In step S404, the comparison module 3043 may retrieve the stored usage criteria 3063 from the memory 306. The usage criteria 3063 may define a threshold difference between the usage characteristic data and target usage characteristics, e.g. according to the guidance on how to use the hair styling appliance 200 and attachment 202. Then, the comparison module may then compare the usage characteristic data stored in the buffer 3064 with target usage characteristic data in order to determine in step S406 whether the usage criteria 3063 are met, for example, whether the difference between the two is less than a predetermined threshold. If it is determined that the usage criteria 3063 are met, in step S408 feedback indicating that the usage criteria 3063 are met may be displayed to the user via the display component 308. In contrast, if it is determined that the usage criteria 3063 are not met, in step S410 feedback indicating that the usage criteria 3062 are not met may be displayed to the user via the display component 308. The feedback may comprise additional guidance on how to rectify the issue, e.g. in the form of a graphical indicator.

[0046] In addition to providing guidance on how to use the hair styling appliance 200 and attachment 202 in terms of target usage characteristics as outlined previously, the method may also comprise determining operating parameters of the hair styling appliance 200 and attachment 202, and causing the hair styling appliance 200 and attachment 202 to operate using those parameters. Fig. 5 is a flowchart which illustrates a method by which this may be achieved. As discussed with respect to Fig. 4, the method of Fig. 5 may be integrated with the method of Figs. 3A and 3B, and / or Fig. 4. For example, the method of Fig. 5 may rely on the same received image data, or the same attachment identification data or attachment identifier. The manner in which the methods may be integrated will become clear from the description below.

[0047] In a first step S500, the image capture device 400 captures an image (which may be in the form of a video, or may comprise sampling video data) of the hair styling appliance 200 and attachment 202, thereby generating image data encoding the captured image, which may then be transmitted to the user device 300, whereupon it is received via the image capture device interface module 303 and stored in the buffer 3064 of the memory 306. Then, in step S502 the image recognition algorithm application module 3040 may apply the image recognition algorithm 3060 to the received image data stored in the buffer 3064. Specifically, the attachment identification submodule 30400 may retrieve and apply the attachment detection sub-algorithm 30600 and the attachment identification sub-algorithm 30602 as described previously in this patent application, thereby generating attachment identification data or an attachment identifier. Each attachment 202 which can be used with the hair styling appliance 200 may have a different set of optimal operating parameters which are selected to obtain the best hair styling results. In step S504, one or more operating parameters, e.g. heater temperature, airflow speed, and airflow direction are selected based on the attachment identification data or attachment identifier. Then, in step S506 it may be determined whether the user device 300 has a connection to the hair styling appliance 200, e.g. a wired connection or a wireless connection, such as a Bluetooth connection. If it is determined that the user device 300 does have a connection to the hair styling appliance 200, the processor 304 or another component of the user device 300 may generate in step S508 an operating parameter signal encoding instructions which when executed by the hair styling appliance, cause it to operate according to the determined one or more operating parameters, and transmit it to the hair styling appliance 200 via the hair styling appliance interface module 302. If it is determined that the user device 300 does not have a connection to the hair styling appliance 200, the guidance generation module 3042 may incorporate in step S510 the operating parameters into the guidance on how to use the hair styling appliance 200 and attachment 202, so that a user may manually set the appropriate operating parameters.

[0048] Figs. 6 to 8 illustrate what a user may see when using e.g. hair styling appliance 200 and user device 300.

[0049] Fig. 6 shows a view of the hair styling appliance 200 in the display component 308. In the captured image on the display component 308, it can be seen that the portion of the image depicting the attachment of the hair styling appliance 200 has been identifiedand the attachment identified, e.g. by application of the image recognition algorithm 30600 by the attachment identification sub-module 30400, as an “Airwrap™ barrel”.

[0050] Figs. 7 and 8 depict different ways in which guidance may be provided to a user. Fig. 7 shows step by step guidance, including images, of how to use the detected attachment. Fig. 8 illustrates a scenario in which a graphical indicator in the form of an arrow is superimposed over the hair styling appliance 200, specifically the attachment thereof in a real-time video feed of a user, obtained e.g. using the front-facing camera the user device 300.

[0051] The features disclosed in the foregoing description, or in the following claims, or in the accompanying drawings, may be used separately or in any combination thereof. Moreover, while specific examples have been described above, many equivalent modifications and variations will be apparent to those skilled in the art when given this disclosure. Accordingly, the examples set forth above are considered to be illustrative and not limiting. Various changes to the described examples may be made without departing from the scope of the invention as defined by the claims.

Claims

CLAIMS1. A method comprising: receiving image data from an image capture device, the image data comprising an image of at least part of a hair styling appliance; applying an image recognition algorithm to the received image data, wherein the image recognition algorithm is configured to identify the hair styling appliance or an attachment of the hair styling appliance; generating, based on the identified attachment, guidance on how to use the hair styling appliance; and displaying, on a display component of a user device, the guidance.

2. The method of claim 1, further comprising: receiving a user input from a user interface of the user device; and wherein the guidance is generated based on the user input.

3. The method of claim 2, wherein: the user input comprises one or more of: a selection of a hair styling process; or a selection of a desired hair style; and the guidance comprises instructions how to perform the hair styling process or achieve the desired hair style using the identified hair styling appliance and / or attachment.

4. The method of any one of claims 1 to 3, wherein: the guidance defines target usage characteristics, the target usage characteristics comprising one or more of: an action to perform with the hair styling appliance and / or attachment; a target position in which to hold the hair styling appliance and / or attachment; a target direction in which to move or rotate the hair styling appliance and / or attachment; a target speed at which to move or rotate the hair styling appliance and / or attachment; andan target orientation in which to place the hair styling appliance and / or attachment.

5. The method of claim 4, wherein: the guidance comprises one or more graphical indicators, the graphical indicators representing or describing the defined target usage characteristics.

6. The method of any one of claims 1 to 5, further comprising: rendering the image data on the display component of the user device; and superimposing the guidance over the rendered image data on the display component.

7. The method of claim 6, further comprising: superimposing the guidance over a portion of the rendered image data depicting the hair styling appliance or the attachment of the hair styling appliance.

8. The method of any one of claims 1 to 7, wherein the image data comprises video of at least part of the hair styling appliance.

9. The method of any one of claims 1 to 8, further comprising: based at least on the identified attachment, determining one or more operating parameters of the hair styling appliance; and causing the hair styling appliance to operate according to the determined one or more operating parameters.

10. The method of claim 9, wherein: the one or more operating parameters comprise: heater temperature; airflow rate; and airflow direction.

11. The method of any one of claims 1 to 10, further comprising: identifying, based on the received image data, a usage characteristic of the hair styling appliance and / or the attachment; and wherein the guidance is generated based on the usage characteristic, and the usagecharacteristic comprises one or more of: a position of the hair styling appliance and / or the attachment; an orientation of the hair styling appliance and / or the attachment; a direction of motion of the hair styling appliance and / or the attachment; a direction of rotation of the hair styling appliance and / or the attachment; a speed of motion of the hair styling appliance and / or the attachment; a speed of rotation of the hair styling appliance and / or the attachment; and an amount of hair held in the hair styling appliance and / or the attachment.

12. The method of claim 11, further comprising: determining whether the identified usage characteristic meets a criterion indicating correct usage of the hair styling appliance and / or the attachment; and if it is determined that the identified usage characteristic does not meet the criterion, causing the user device to generate an alert indicating incorrect usage; optionally, if it is determined that the identified usage characteristic does meet the criterion, causing the user device to generate an alert indicating correct usage.

13. The method of any one of claims 1 to 12, wherein: the image recognition algorithm is configured to: detect the hair styling appliance or the attachment in the received image data; and classify the attachment as one of a predetermined plurality of hair styling appliances or attachments.

14. A user device comprising a processor, an image capture device and a display component, the processor configured to perform the method of any one of claims 1 to 13.

15. A non-transitory computer-readable medium storing instructions that, when executed, cause one or more processors to perform the method of any one of claims 1 to 13:

16. A hair styling system comprising: the user device of claim 14; a hair styling appliance; andone or more attachments, each of which is removably attachable to the hair styling appliance.

Images