Prediction of the user's appearance after treatment

Abstract

According to one aspect, an apparatus is provided that includes a processor configured to receive image data related to a user 102 of a personal care device 104, the personal care device being used to treat a portion of the user, receive device operation data related to the personal care device, determine location information for at least a processing element 112 of the personal care device relative to the user, generate an image 120 representing a predicted appearance of the portion of the user after treatment using the personal care device based on the received image data, the received device operation data, and the determined location information, and display the generated image on a representation of the user.

Description

[Technical Field]

[0001] The present invention relates to personal care, and more particularly to predicting the appearance of a user of a personal care device after use of the device. [Background technology]

[0002] When performing personal care procedures, such as shaving or trimming hair, it is often desirable to perform that particular procedure precisely to achieve a desired result. For example, when trimming a beard, a user may intend for the beard to be trimmed equally on both sides of the face, and may intend for the beard to appear symmetrical.

[0003] To assist users, they may perform personal care activities in front of a mirror so they can see their own reflection, or in front of a device that can display a live image of the user as the activity is being performed. Even then, it can be difficult to know what the outcome of a personal care activity will be. Summary of the Invention [Problem to be solved by the invention]

[0004] Unlike existing systems, embodiments of the present disclosure provide a mechanism by which a user can see a visual prediction of the results of a personal care routine before the routine is completed. The inventors have recognized that by using various data, it is possible to generate an image showing the effects of using a personal care device, thereby allowing the user to see the effects before using the device. For example, a user of a shaving device can see a representation of their face, including modifications to show how the user's face may look if the shaving device is applied to a particular part of their face. In this way, the user can make a decision regarding whether to proceed with a process (e.g., a shaving procedure) before any irreversible changes are made. Furthermore, by displaying predicted modifications to the user's facial representation in a position based on the position of the personal care device, the user can more accurately position the device in the intended location, thereby making it easier for the user to perform the personal care routine as intended. [Means for solving the problem]

[0005] According to a first particular aspect, an apparatus is provided that includes a processor configured to receive image data related to a user of a personal care device used to treat a portion of the user, receive device operation data related to the personal care device, determine location information of at least a processing element of the personal care device relative to the user, generate an image representing a predicted appearance of the portion of the user after treatment using the personal care device based on the received image data, the received device operation data, and the determined location information, and display the generated image on a representation of the user.

[0006] According to some embodiments, the processor is further configured to determine a degree of deformation of the user's surface by the personal care device based on the received image data, and to generate an image representing a predicted appearance of a portion of the user's surface further based on the determined degree of deformation of the user's surface.

[0007] The processor, in some embodiments, is configured to generate an image representing a predicted appearance of a part of the user further based on the output of a sensor of the personal care device.

[0008] In some examples, the device operation data includes a size of a processing element of the personal care device, and the processor is configured to generate an image representing a predicted appearance of a portion of a user having a size based on the size of the processing element.

[0009] The device operation data includes data indicative of an orientation and / or movement of the personal care device, and the processor is configured to generate an image representing a predicted appearance of a portion of the user, the image having a size based on the orientation / movement data.

[0010] In some examples, the processor is further configured to determine, based on the received image data, an indication of a body part of the user to be treated using the personal care device, and to generate an image representing a predicted appearance of a portion of the user, the image having a size further based on the indication of the body part.

[0011] In some embodiments, the apparatus comprises an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone, or a wearable device.

[0012] According to a second aspect, a computer-implemented method is provided, comprising the steps of receiving image data relating to a user of a personal care device, the personal care device being used to treat a part of the user; receiving device operation data relating to the personal care device; determining location information of at least a processing element of the personal care device relative to the user; generating an image representing a predicted appearance of the part of the user after treatment using the personal care device based on the received image data, the received device operation data, and the determined location information; and displaying the generated image on a representation of the user.

[0013] The computer-implemented method further includes alternating between displaying the user's representation and the generated image on the user's representation.

[0014] In one embodiment, the computer-implemented method further includes determining an amount of deformation of a surface of the user by the personal care device based on the received image data, wherein generating an image representing a predicted appearance of a portion of the user is further based on the determined amount of deformation of the surface of the user.

[0015] According to a third aspect, there is provided a computer program product comprising a non-transitory computer readable medium having computer readable code embodied therein that, when executed by a suitable computer or processor, causes the computer or processor to perform the steps of the methods disclosed herein.

[0016] According to a fourth aspect, there is provided a personal care system comprising: a personal care device having a processing element to be used to treat a portion of a user; an image capture device to capture image data relating to a user of the personal care device; a display unit; and a processing device that operates the image capture device to capture image data relating to a user of the personal care device, receives device operation data relating to the personal care device, determines location information of at least the processing element of the personal care device relative to the user, generates an image representing a predicted appearance of the portion of the user after treatment using the personal care device based on the captured image data, the received device operation data, and the determined location information, and causes the generated image to be displayed on a representation of the user on the display unit.

[0017] In some examples, the personal care device includes a first sensor configured to measure a force or pressure applied by the personal care device to a user, and the processing device is configured to generate an image representing a predicted appearance of a portion of the user further based on an output of the first sensor.

[0018] The personal care device, in some embodiments, includes a second sensor configured to measure orientation and / or movement data related to the personal care device, and the processing unit is configured to generate an image representing a predicted appearance of a portion of the user further based on an output of the second sensor.

[0019] In some examples, the personal care device comprises a device selected from the group including a hair trimming device, a shaving device, a hair treatment device, a photoepilation device, a skin treatment device, a skin revitalization device, and a product application device.

[0020] These and other aspects will be apparent from and elucidated with reference to the embodiments described hereinafter.

[0021] Exemplary embodiments will now be described, by way of example only, with reference to the following drawings: [Brief explanation of the drawings]

[0022] [Figure 1] FIG. 1 is a diagram of a user performing a personal care activity. [Figure 2] 1 is a schematic diagram of an example apparatus according to various embodiments. [Figure 3A-3C] 1A-1C are diagrams of images generated in accordance with various embodiments. [Figure 4] 1A-1C are diagrams of images generated in accordance with various embodiments. [Figure 5A-5B] 1A-1C are diagrams of images illustrating various embodiments of the present invention. [Figure 6] 1 is a flowchart of an example method according to various embodiments. [Figure 7] 10 is a flowchart of a further example method according to various embodiments. [Figure 8] 1 is a schematic diagram of a processor in communication with a computer-readable medium. [Figure 9] 1 is a schematic diagram of a personal care system. DETAILED DESCRIPTION OF THE INVENTION

[0023] According to various embodiments of the present invention, methods, apparatus, systems, and computer program products are provided that allow a user of a personal care device to see a visual indication of the effectiveness of a personal care procedure before the procedure is completed. Various embodiments are described in the context of personal care procedures performed using personal care devices such as hair care devices and skin care devices. However, it will be understood that the disclosed embodiments may be practiced using any type of personal care device.

[0024] Referring to the drawings, Figure 1 is an illustration of a user 102 of a personal care device 104. In this example, the personal care device 104 comprises a shaving device of a type used to shave hair, for example, from the face of the user 102. In some cases, particularly when the user 102 is unable to directly view the part of their body being treated, the user may perform the personal care activity (e.g., shaving) in front of a mirror so that they can more accurately position the personal care device 104 to more easily achieve the desired results. In the example shown in Figure 1, the user 102 is performing the personal care activity in front of a display device 106 that may display a representation of at least a portion of the user, such as a mirror image of the user or a representation captured using a camera.

[0025] In some examples, the display device 106 comprises an interactive mirror. The interactive mirror, sometimes called a smart mirror, is a unit that, in addition to functioning as a mirror to show the user a mirrored image of themselves, can also display information to the user. Information such as text, images, and video is displayed on the display portion of the interactive mirror, which is positioned, for example, behind a mirrored (or partially mirrored) panel or a mirrored (or partially mirrored) surface. In this manner, the display screen, or a portion thereof, can be viewed through the mirror portion, allowing the user to simultaneously view their own mirrored image and the information presented on the display screen. The interactive mirror 106 includes one or more sensors, such as an imaging device 108 (e.g., a camera) that can capture an image (e.g., of the user 102) that can be displayed on the interactive mirror's screen or used to determine data (e.g., device position data) as described below. The interactive mirror 106 is connected (wirelessly or via a wired connection) to one or more other devices, such as the personal care device 104. Processing circuitry within the interactive mirror 106 receives data from the personal care device 104 (and / or other connected devices) and displays information related to the connected devices to the user.

[0026] In other examples, an alternative display device 106 is used by the user 102 instead of the interactive mirror. For example, the user 102 performs the personal care activity in front of a smartphone, tablet computer, laptop computer, or some other display device capable of displaying the user's expression along with other information. For example, the camera 108 may form part of the display device or may be a separate device connected to the display device 106.

[0027] The personal care device 104 comprises a body 110 and a processing element 112 for performing the intended processing of the personal care device. For example, in a shaving device, the processing element 112 comprises a shaving head having blades that cut hair during use. The body 110 of the personal care device 104 houses various components. In some examples, the personal care device 104 includes one or more sensors, such as a first sensor 114 and / or a second sensor 116, for measuring data related to the personal care device and / or its use.

[0028] Various steps of the methods disclosed herein are performed using one or more processors, such as processor 118, that form part of a computing device or cloud computing environment connected to the display device 106. In examples where the display device 106 comprises part of a computing device (e.g., a smartphone or tablet computer), the processor 118 also forms part of the computing device. In the example shown in FIG. 1 , the processor 118 forms part of the interactive mirror 106. According to embodiments of the present invention, during use of the personal care device 104, the processor 118 uses various data (e.g., image data acquired using the camera 108 and / or data acquired using the sensors 114, 116) to generate an image 120 that represents a predicted appearance of a portion of the user 102 after processing using the personal care device 104. The generated image 120 comprises a patch that can be displayed on the display device 106 together with a representation (e.g., a mirror image or a generated representation) of the user 102. For example, the generated image 120 is presented as an overlaid or superimposed region on the display device 106. In this way, the user 102 can see themselves (i.e., a representation of themselves) and at the same time see a prediction of what they will look like if they continue to use the personal care device 104 in a particular area.

[0029] In some embodiments, the generated image 120 is displayed on the display device 106 when the personal care device 104 approaches the user 102 (e.g., when the personal care device is within a predetermined threshold distance from the user), but before the processing element 112 processes the user. Furthermore, the position of the generated image 120 relative to the representation of the user 102 on the display device 106 is based on the position of the personal care device 104 or the position of the processing element 112 of the personal care device, such that movement of the processing element 112 results in movement of the image 120 on the display device. Thus, before performing a personal care action that may result in irreversible changes, the user 102 can view the predicted results shown by the generated image 120 and decide whether to proceed with the personal care action.

[0030] According to a first aspect, the present invention provides an apparatus. Figure 2 is a schematic diagram of an example of an apparatus 200 for use in implementing embodiments of the present invention. The apparatus 200 comprises a processor 202, which may include or be functionally similar to processor 118. The apparatus 200 may comprise or form part of a computing device, such as a smartphone or tablet computer, or may comprise or form part of an interactive mirror. The processor 200 is configured to receive image data relating to a user 102 of a personal care device 104, which will be used to process a portion of the user. The image data may be obtained, for example, from an image capture device or camera 108 forming part of the computing device or interactive mirror, or from an image capture device or camera separate from the apparatus 200 but capable of transmitting image data thereto. The image data, in any known image format and captured using known image capture technology, includes a portion of the user 102 and, in some examples, also part or all of the personal care device 104. In examples where an image of at least a portion of the personal care device 104 is captured in addition to an image of at least a portion of the user 102, information can be determined from the image data, such as data indicative of the relative position, orientation, and / or movement of the personal care device 104 and the user 102.

[0031] The camera 108 may comprise a 2D or 3D camera (e.g., a stereo camera) and may use techniques such as time-of-flight measurement. Data acquired using the camera 108 is used to create a 2D and / or 3D model of at least a portion of the user 102. Determining the location and / or orientation of the personal care device 104 relative to the user 102 (sometimes referred to as device tracking) is achieved by monitoring the user's position in the captured image. Once the user's face is captured in the image data, facial landmarks (e.g., points on the eyes, nose, mouth, etc.) are used to detect the position and orientation of the face. The landmark locations are then incorporated onto a pre-recorded 3D facial model of the user 102. The position and / or orientation of the personal care device 104 is obtained by detecting landmarks on the personal care device (e.g., reference points or device corners), sometimes referred to as device landmarks. These device landmarks may be inherent to the device aspects or may be specifically incorporated into the personal care device to improve tracking capabilities (e.g., green dots at specific locations on the device). The device landmarks are analyzed relative to facial landmarks of the user 102 to provide data indicative of the position and / or orientation of the personal care device relative to a part 102 of the user (eg, the face).

[0032] The processor 202 is also configured to receive device operation data related to the personal care device 104. The device operation data includes data indicative of the type or nature of the personal care device 104 being used and / or details of the processing element 112 being used on the personal care device. For example, device identification data may indicate the type of personal care device being used and / or parameter information may indicate a setting (e.g., a cutting length). In some embodiments, the device operation data includes data acquired using one or more sensors associated with the personal care device 104. For example, the device operation data may be acquired from a sensor or sensors located within the personal care device 104 or from a sensor or sensors external to but associated with the personal care device. In other examples, the device operation data includes data related to the position, orientation, and / or movement of the device relative to a reference, such as the apparatus 200 or the user 102. As such, the device operation data may be data about the personal care device 104 stored before use of the device or data acquired in real time during use of the personal care device.

[0033] The device operation data may be received from the personal care devices 104 themselves or from storage (e.g., memory) associated with the processor 202 where such data is stored. For example, the memory may store a database containing device operation data for several personal care devices 104.

[0034] The processor 202 is further configured to determine position information of at least the processing element 112 of the personal care device 104 relative to the user 102. The position information includes an indication of the location or position of the at least the processing element 112 relative to a reference point or reference, such as the user 102 or a portion of the apparatus 200, the orientation of the at least the processing element relative to the reference point or reference, the distance from at least a portion of the processing element to the reference point or reference, and / or the direction of movement of the at least the processing element relative to the reference point or reference. The position information is determined from received image data related to the user of the personal care device 104 and / or from one or more other sources, such as device operation data and sensors within the personal care device.

[0035] The processor 202 is further configured to generate an image 120 representing a predicted appearance of a portion of the user 102 after processing using the personal care device 104 based on the received image data, the received device operation data, and the determined location information. The processor 202 is further configured to cause the generated image to be displayed on a representation of the user 102. For example, the image 120 and the representation of the user are presented on the display 106. In examples where the display 106 forms part of a computing device such as a smartphone or tablet computer, the representation of the user 102 is an image or live video footage (i.e., image data) of the user acquired using the image capture device 108. In examples where the display 106 forms part of an interactive mirror, the representation of the user 102 is a mirror image of the user in the mirror.

[0036] The image 120 representing the predicted appearance of a portion of the user 102 is sized such that it is generally smaller than the display 106 on which the representation of the user 102 is presented, and smaller than the user's representation. The image 120 can be thought of as a patch or mask (e.g., square or rectangular in shape) intended to cover or replace a portion of the user's representation. For example, if the user 102 is performing a shaving act to shave one of their sideburns, the image 120 generated by the processor 202 includes a patch (e.g., rectangular) representing the appearance of a portion of the side of the user's face that is intended to be shaved using the personal care device 110 (e.g., a shaver). The image 120 includes a representation of the user's skin, either hairless or with relatively short hair, that is presented to the user 102 as a mask, overlay, or otherwise superimposed on the user's representation on the display 106.

[0037] To generate an image representing the predicted appearance of a portion of the user 102 after processing, the processor 202, in some embodiments, uses pre-stored data (e.g., data stored in memory) that indicates or describes how a particular portion of the user may appear if a personal care activity is performed. For example, in the shaving example, the generated image 120 may include a stored image of fully shaved skin so that the user 102 can see what that particular portion of their body may look like once fully shaved. A more accurate prediction of the appearance of the portion of the user may be made with additional data available to the processor 202. For example, data indicative of the user's skin color, tone, complexion, etc. may be determined from the received image data, and such data may be used to generate the image 120 of the predicted appearance of the portion of the user 102, thereby making the generated image more realistic.

[0038] In some examples, device operation data associated with a personal care device (e.g., a shaver) 110 is used to improve the prediction. FIG. 3 is an illustration of three different examples of images 120 generated using device operation data associated with a shaver. In each example, a user's 102 sideburns are shown along with a portion of the user's hair. In FIG. 3A, the shaver's device operation data indicates that the shaver's processing elements 112 are set to perform a full shave (e.g., the shaving guide is not in place). In this example, image 120 shows a fully shaved portion of the user's skin that will replace the sideburns. In FIG. 3B, the shaver's device operation data indicates that the shaver's processing elements 112 are set to cut the user's hair very short, resulting in image 120 showing a portion of the user's skin with a rough shave that replaced the sideburns. 3C, the shaver's device operation data indicates that the shaver's processing element 112 is set to simply trim the user's hair, resulting in image 120 showing a portion of the user's skin with hair slightly shorter than the current hair length in the user's sideburn area. In some examples, device operation data indicating the characteristics of the processing element 112 may be obtained automatically from the personal care device 104, and in some examples, the user may provide details of the processing element (e.g., via a user interface, not shown), such as the intended cutting length.

[0039] The appearance (e.g., size, shape, and / or orientation) of image 120 generated by processor 202 is based on data available to processor 202, including, for example, received image data, received device operation data, and / or determined location information. Figure 4 is an illustration of two different examples of the appearance of image 120. In the first example, labeled 402, the generated image 120 is relatively small and covers a small portion of the representation of user 102. In the second example, labeled 404, the generated image 120 is relatively larger and covers a larger portion of the representation of user 102.

[0040] The processor 202 determines from image data (e.g., from the camera 108) that the personal care device 104 is to be used to shave the user's 102's sideburns in example 402 and to shave the user's cheeks in example 404. In some examples, if a relatively smaller portion of the user is to be processed using the personal care device 104, the generated image 120 will be relatively smaller (example 402), while if a relatively larger portion of the user is to be processed, the generated image will be relatively larger (example 404). Device operation data associated with the personal care device 104 indicates the orientation in which the personal care device 104 is being held relative to the user's 102's head. The orientation of the image 120 generated by the processor 202, in some examples, corresponds to the orientation of at least a portion of the personal care device 104, such as the processing element 112. The device operation data and / or position information of the processing element 112 and / or the personal care device 104 provides an indication of the speed of movement of the personal care device relative to the user 102. For example, when shaving a relatively smaller area, such as sideburns, the user 102 may move the personal care device 104 more slowly than when shaving a larger area, such as the cheeks or neck. In another example, the received image data is used to determine which portion of the user 102 will be processed using the personal care device 104, and this is used to determine the size of the image 120. For example, the processor 202 is configured to determine, based on the received image data, an indication of a body part of the user 102 that will be processed using the personal care device 104. The processor 202 is configured to generate the image 120 representing the predicted appearance of the portion of the user 102, with the size further based on the indication of the body part.

[0041] When the personal care device 104 is determined to be moving at a relatively high speed, the generated image 120 will be relatively larger than when the personal care device is determined to be moving at a relatively low speed, in which case the device operation data includes data indicative of the orientation and / or movement of the personal care device 104. The processor 202 is configured to generate the image 120, representing the predicted appearance of a portion of the user 102, with a size based on the orientation / movement data. Various limits and thresholds are defined and used by the processor 202 when determining the appearance of the image 120.

[0042] In some embodiments, the size of the image 120 corresponds to or is based on details of the processing elements 112 of the personal care device 104. For example, the device operation data comprises the size of the processing elements 112 of the personal care device 104. The processor 202 is configured to generate the image 120 representing the predicted appearance of a portion of the user 102, the image 120 having a size based on the size of the processing elements 112.

[0043] In some embodiments, the processor 202 is configured to determine the degree of deformation of the surface of the user 102 by the personal care device 104 based on the received image data. For example, some personal care devices are used by touching the processing element 112 of the personal care device 104 against the skin of the user 102 or by pressing the processing element against the skin of the user. Contact between the processing element 112 (or any other part of the personal care device 104) and the surface (e.g., skin) of the user 102 causes deformation of the surface. Using the received image data (e.g., image data acquired using the camera 108), the amount or degree of deformation is measured or determined, which is taken into account when generating the image 120. The image data is used, for example, to determine the depth of the personal care device 104 in a 3D model of the user 102. In some embodiments, parameter information related to the surface of the user is used to improve the determination of the amount of deformation. For example, skin elasticity values ​​at various locations on the user's body are used. Known values ​​of skin elasticity are stored, for example, in a memory accessible to the processor 202. In some examples, data indicative of the user's race and / or age is used to determine the amount of skin deformation. In this case, the processor 202 is further configured to generate an image representing a predicted appearance of a portion of the user 102 further based on the determined degree of deformation of the user's surface. For example, if the received image data indicates that the user's 102's skin has been deformed by the personal care device 104, the image 120 generated by the processor 202 will show such deformation.

[0044] In other examples, the deformation of the skin of the user 102 resulting from the personal care device 104 is determined or measured in another manner. For example, the first sensor 114 and / or the second sensor 116 comprise a force sensor or a pressure sensor for measuring the amount of force or pressure applied to the surface of the user 102 by the personal care device 104. Data acquired using the sensors 114, 116 is used in generating the image 120. For example, an indication of the amount of force applied to the skin of the user 102 is used to predict the amount of skin deformation, and this deformation is displayed in the image 120. In this manner, the processing unit 202 is configured to generate the image 120 representing a predicted appearance of a portion of the user 102 further based on the output of the sensors 114, 116 of the personal care device 104.

[0045] In some examples, the image 120 is displayed on the representation of the user (e.g., on the display 106) only when certain conditions are met. For example, the image 120 is displayed only if the personal care device 104 is determined to be within a predetermined threshold range from the user 102. FIG. 5 is a diagram of two example representations of a user 102 and a personal care device 104 according to embodiments of the present invention. In FIG. 5A, data available to the processor 202 (e.g., received image data, received device operation data, and / or determined location information) indicates that the personal care device 104 is beyond a threshold distance from the user 102. In this example, the image 120 is not displayed on the representation of the user 102. However, in FIG. 5B, data available to the processor 202 indicates that the personal care device 104 is within a threshold distance from the user 102. In this example, the image 120 is displayed on the representation of the user 102. By displaying the image 120 only when the personal care device 104 is within a predetermined threshold distance from the user 102, the processor 202 can determine the location of the user's intended treatment with a greater level of certainty. Furthermore, the user 102 has some control over when the image 120 will be displayed on the display 106. For example, if the user 102 wishes to see a non-overlaid representation of the image 120, the user can simply move the personal care device 104 away from their face.

[0046] As briefly noted above, device 200 comprises or forms part of a computing device. In some examples, device 200 comprises an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone, or a wearable device (e.g., a smartwatch).

[0047] According to a second aspect, the present invention provides a method. FIG. 6 is a flowchart of an example of method 600. Method 600, including a computer-implemented method, may be considered a method for predicting the appearance of a user after treatment with a personal care device. Method 600 includes, in step 602, receiving image data related to a user 102 of a personal care device 104, where the personal care device will be used to treat a portion of the user. In step 604, method 600 includes receiving device operation data related to the personal care device 104. In step 606, the method includes determining location information of at least a processing element 112 of the personal care device 104 relative to the user 102. In step 608, the method includes generating an image 120 representing a predicted appearance of the portion of the user 102 after treatment with the personal care device 104 based on the received image data, the received device operation data, and the determined location information. Method 600 includes, in step 610, displaying the generated image 120 on a representation of the user 102. For example, image 120 is displayed on a display 106.

[0048] 7 is a flowchart of a further example of a method 700. Method 700 includes a computer-implemented method and includes one or more steps of method 600. Method 700 includes, in step 702, alternating between displaying a representation of the user 102 and a generated image 120 on the representation of the user. In this case, image 120 is periodically displayed and removed on the representation of the user 102, such that image 120 repeatedly appears for a short period of time (e.g., 0.5 seconds or 1 second). In this way, the user 102 can compare how they currently look with how they would look if they proceeded using the personal care device 104.

[0049] In other embodiments, the display and / or removal of the image 120 from the display is controlled by the user 102. For example, the user 102 may make a predetermined movement or gesture (e.g., using a finger, hand, their head, a facial expression, or a predetermined movement of the personal care device) that is captured using the camera 108 and interpreted as an indication that the user wishes to display or remove the image 120 from the display image 120. In another example, a pause in the movement of the personal care device 104 by the user 102 is detected and recognized as a signal to the display image 120. In this manner, the user can stop moving the personal care device 104 when they want to understand what effect further movement of the device may have. In other embodiments, the display and / or removal of the image 120 from the display is performed through user interaction with a user interface of the personal care device 104 or a computing device (e.g., an interactive mirror or tablet computer) housing the display 106. For example, the user 102 presses a button to toggle between displaying and not displaying the image 120.

[0050] In step 704, the method 700 includes determining an amount of deformation of the surface of the user 102 by the personal care device 104 based on the received image data. For example, contact between the personal care device 104 and the skin of the user 102 causes deformation of the skin, and the amount and nature of the deformation are determined. Generating an image 120 representing a predicted appearance of a portion of the user 102 (step 608) is further based on the determined amount of deformation of the user's surface. In this case, the image 120 generated in step 608 includes the surface deformation.

[0051] One or more steps of the methods 600 , 700 are performed using the processor 202 of the device 200 .

[0052] According to a third aspect, the present invention provides a computer program product. Figure 8 is a schematic diagram of an example processor 802 in communication with a computer-readable medium 804. According to various embodiments, the computer program product comprises a non-transitory computer-readable medium 804 having computer-readable code embodied thereon that is configured, when executed by a suitable computer or processor 802, to cause the computer or processor to perform the steps of methods 600, 700 disclosed herein. The processor 802 may comprise or be similar to the processors 118, 202 discussed above.

[0053] According to a fourth aspect, the present invention provides a personal care system. Figure 9 is a schematic diagram of an example of a personal care system 900. The personal care system 900 comprises a personal care device 104 having a processing element 112 that will be used to process a portion of a user 102. The personal care system 900 also comprises an image capture device 108 configured to capture image data related to a user of the personal care device 104. The image capture device 108 comprises, for example, a 2D or 3D camera. The personal care system 900 also comprises a display unit 106 (e.g., a display of an interactive mirror or a computing device). The personal care system 900 also comprises a processing unit 202, 802. The processing unit 118, 202, 802, the display unit 106, and / or the image capture device 108 may form part of a single unit or component, such as a computing device or an interactive mirror. The personal care device 104, the display unit 106, and the image capture device 108 all communicate with the processing unit 118, 202, 802, for example, via a wired or wireless connection.

[0054] The processing device 118, 202, 802 is configured to operate the image capture device 108 to capture image data related to the personal care device 104 of the user 102, receive device operation data related to the personal care device, determine position information of at least the processing element 112 of the personal care device relative to the user, generate an image representing the predicted appearance of a portion of the user after treatment using the personal care device based on the captured image data, the received device operation data, and the determined position information, and display the generated image on a representation of the user on the display unit.

[0055] In some embodiments, the personal care device 104 comprises a first sensor 114 configured to measure the force or pressure applied by the personal care device 104 to the user 102. For example, the personal care device 104 comprises a resistive sensor, a capacitive sensor, and / or a piezoelectric sensor to measure the force applied by the processing element 112 of the personal care device to the skin of the user 102 during use. The processing unit 118, 202, 802 is configured to generate an image 120 representing a predicted appearance of a portion of the user 102 further based on the output of the first sensor 114.

[0056] In some embodiments, the personal care device 104 includes a second sensor 116 configured to measure orientation and / or movement data related to the personal care device. For example, the personal care device 104 includes one or more of an accelerometer, a magnetometer, a gyroscope, and an inertial measurement unit (IMU) configured to measure data related to the orientation of the personal care device (e.g., relative to the ground) and / or any movement of the personal care device during use. The processing unit 118, 202, 802 is configured to generate an image 120 representing a predicted appearance of a portion of the user 102 further based on the output of the second sensor 116.

[0057] As noted above, the present invention may be used in the field of personal care, or any field in which a treatment involving a user occurs. In some embodiments, the personal care device 104 comprises a device selected from the group including a hair trimming device, a shaving device, a hair treatment device, a photoepilation device, a skin treatment device, a skin revitalization device, and a product application device (e.g., a device for applying a product such as a cream, lotion, or cosmetic product to a user).

[0058] The embodiments of the invention disclosed herein provide a mechanism by which a user can review and anticipate the expected results of performing a personal care activity before actually performing the activity. This is accomplished by predicting some of the user's appearance if the personal care activity is performed and displaying an image depicting the predicted appearance to the user before performing the activity. In this manner, the user can make an informed decision regarding whether or not to proceed with the personal care activity. Furthermore, by foreseeing the expected results of performing a personal care activity, the user can perform the personal care activity more accurately and in less time, reducing the power used by the personal care device and reducing wear on components (e.g., processing elements) of the personal care device.

[0059] The processor 118, 202, 802 comprises one or more processors, processing units, multi-core processors, or modules configured to control or program the device 200 in the manner described above. In certain implementations, the processor 118, 202, 802 comprises multiple software and / or hardware modules, each configured to perform or intended to perform individual or multiple steps of the methods described herein.

[0060] The term "module," as used herein, is intended to include a hardware component, such as a processor or component of a processor configured to perform a particular function, or a software component, such as a set of instruction data that has a particular function when executed by a processor.

[0061] It will be understood that embodiments of the present invention may also apply to computer programs, particularly those on or in a carrier, adapted to carry out the present invention. The program may be in the form of source code, object code, a combination of source and object code, such as a partially compiled form, or any other form suitable for use in carrying out the methods according to embodiments of the present invention. It will also be understood that such programs may have many different architectural designs. For example, program code implementing the functionality of a method or system according to the present invention may be further divided into one or more subroutines. Many different ways of distributing functionality among these subroutines will be apparent to those skilled in the art. The subroutines may be stored together in an executable file to form a self-contained program. Such an executable file may contain computer-executable instructions, such as processor instructions and / or interpreter instructions (e.g., Java interpreter instructions). Alternatively, one or more or all of the subroutines may be stored in at least one external library file and linked with the main program, e.g., statically or dynamically, at run time. The main program contains at least one call to at least one of the subroutines. The subroutines may also contain function calls to each other. An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing stage of at least one of the methods described herein. These instructions may be further divided into subroutines and / or stored in one or more files, which may be linked statically or dynamically. Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and / or products described herein. These instructions may be further divided into subroutines and / or stored in one or more files, which may be linked statically or dynamically.

[0062] The carrier of a computer program may be any entity or device capable of carrying the program. For example, the carrier may comprise a data storage medium such as a ROM, for example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a hard disk. Furthermore, the carrier may be a transmissible carrier, such as an electric or optical signal which may be conveyed via an electric or optical cable or by radio or other means. The program may be embodied by such a signal, and the carrier may be constituted by such a cable or other device or means. Alternatively, the carrier may be an integrated circuit in which the program is embedded, this integrated circuit being adapted for, or used for, performing the relevant method.

[0063] Upon implementing the principles and techniques described herein, those skilled in the art will understand and realize variations of the disclosed embodiments, by studying the drawings, the disclosure, and the appended claims. In the claims, the word "comprises" does not exclude other elements or steps, and the singular does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain methods are recited in mutually different dependent claims does not indicate that a combination of these methods cannot be used to advantage. A computer program may be stored or distributed on a suitable medium, such as an optical storage medium or a solid-state medium, which may be supplied together with or as part of other hardware, or may also be distributed in other forms, for example, via the Internet or other wired or wireless telecommunications systems. Any reference signs in the claims should not be construed as limiting their scope.

Claims

1. receiving image data relating to a user of a personal care device used to treat a portion of the user; receiving device operation data associated with the personal care device; determining location information of at least a processing element of the personal care device relative to the user; generating an image representing a predicted appearance of the portion of the user after treatment with the personal care device based on the received image data, the received device operation data, and the determined location information; displaying the generated image on the user's representation; a processor; Device.

2. The processor further comprises: determining a degree of deformation of the user's surface by the personal care device based on the received image data; The apparatus of claim 1 , further comprising: generating the image representing the predicted appearance of the portion of the person based on the determined degree of deformation of the surface of the person.

3. The apparatus of claim 1 or claim 2, wherein the processor generates the image representing the predicted appearance of the part of the user further based on the output of a sensor of the personal care device.

4. the device operational data includes a size of the processing element of the personal care device; The apparatus of claim 1 , wherein the processor generates the image representing the predicted appearance of the portion of the user, the image having a size based on the size of the processing element.

5. the device operation data includes data indicative of an orientation and / or a movement of the personal care device; 5. The apparatus of claim 1, wherein the processor generates the image representing the predicted appearance of the portion of the user, the image having a size based on the orientation / motion data.

6. The processor further comprises: determining, based on the received image data, an indication of a body part of the user to be treated using the personal care device; 6. The apparatus of claim 1, wherein the apparatus generates the image representing the predicted appearance of the portion of the user, the image having a size further based on the indication of the body part.

7. The apparatus of claim 1 , wherein the apparatus comprises an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone, or a wearable device.

8. receiving image data relating to a user of a personal care device, the personal care device being used to treat a portion of the user; receiving device operational data associated with the personal care device; determining location information of at least a processing element of the personal care device relative to the user; generating an image representing a predicted appearance of the portion of the user after treatment with the personal care device based on the received image data, the received device operation data, and the determined location information; displaying the generated image on a representation of the user; 11. A computer-implemented method comprising:

9. The computer-implemented method of claim 8 , further comprising the step of alternating between displaying the representation of the user and the generated image on the representation of the user.

10. determining an amount of deformation of the user's surface by the personal care device based on the received image data; generating the image representing the predicted appearance of the portion of the user is further based on the determined amount of deformation of the surface of the user.

10. A computer-implemented method according to claim 8 or claim 9.

11. a personal care device having a treatment element to be used to treat an area of ​​a user; an image capture device that captures image data relating to the user of the personal care device; A display unit; a treatment device, the treatment device comprising: operating the image capture device to capture image data relating to the user of the personal care device; receiving device operation data associated with the personal care device; determining location information of at least the processing element of the personal care device relative to the user; generating an image representing a predicted appearance of the portion of the user after treatment with the personal care device based on the captured image data, the received device operation data, and the determined location information; A personal care system that causes the generated image to be displayed on the display unit over a representation of the user.

12. The personal care device comprises: a first sensor that measures a force or pressure applied to the user by the personal care device; 12. The personal care system of claim 11, wherein the processing unit generates the image representing the predicted appearance of the portion of the user further based on the output of the first sensor.

13. The personal care device comprises: a second sensor for measuring orientation and / or movement data relating to the personal care device; 13. The personal care system of claim 11 or 12, wherein the processing device generates the image representing the predicted appearance of the part of the user further based on the output of the second sensor.

14. 14. The personal care system of any one of claims 11 to 13, wherein the personal care device comprises a device selected from the group including a hair trimming device, a shaving device, a hair treatment device, a photoepilation device, a skin treatment device, a skin revitalization device, and a product application device.

Images