An apparatus, computer implemented method and personal care system

Abstract

According to an aspect, there is provided an apparatus comprising: a processor configured to receive image data regarding a user (102) of a personal care device (104), wherein the personal care device is to be used for treating a part of the user; receive device operation data related to the personal care device; determine location information of at least a treatment element (112) of the personal care device relative to the user; generate, based on the received image data, the received device operation data, and the determined location information, an image (120) representing a predicted appearance of the part of the user after treatment using the personal care device; and provide the generated image for display on a representation of the user.

Description

Technical Field

[0001] This invention relates to personal care, and more specifically, to predicting the appearance of a user of a personal care device after using the device. Background Technology

[0002] When performing personal care activities such as shaving or trimming hair, it is often expected that specific activities will be performed precisely to achieve the desired results. For example, when trimming a beard, a user may expect the beard to be trimmed similarly on both sides of the face and may expect the beard to look symmetrical.

[0003] To assist users, they can perform personal care activities in front of a mirror, allowing them to see their own reflection, or they can perform these activities in front of a device that displays a live image of themselves as the activity is performed. Even so, it may be difficult to know the outcome of the personal care activity. Summary of the Invention

[0004] Compared to existing systems, embodiments of this disclosure provide a mechanism by which a user can see a visual prediction of the outcome of a personal care activity before performing it. The inventors have recognized that by using various data, it is possible to generate images illustrating the effects of using a personal care device, allowing the user to see the device's effects before using it. For example, a user of a shaving device can view a representation of their face, including modifications illustrating how the user's face might look if the shaving device were applied to specific parts of their face. In this way, the user is able to make a decision about whether to continue the process (e.g., the shaving process) before making any irreversible changes. Furthermore, by displaying the predicted modifications on the representation of the user's face based on the location of the personal care device, the user is able to more precisely position the device in the intended location, making it easier for the user to perform the personal care activity as intended.

[0005] According to a first aspect, an apparatus is provided, comprising: a processor configured to receive image data relating to a user of a personal care device, wherein the personal care device will be used to process a portion of the user; receiving device operation data associated with the personal care device; determining position information of at least a processing element of the personal care device relative to the user; generating an image representing a predicted appearance of the portion of the user after processing with the personal care device, based on the received image data, the received device operation data, and the determined position information; and providing the generated image for display on the user's representation.

[0006] According to some embodiments, the processor may also be configured to determine the degree of deformation of the user surface caused by the personal care device based on the received image data. The processor may also be configured to further generate an image representing the predicted appearance of that portion of the user's surface based on the determined degree of deformation.

[0007] In some embodiments, the processor may be configured to further generate an image representing the predicted appearance of that part of the user based on the output of the sensors of the personal care device.

[0008] In some examples, device operating data may include the dimensions of the processing element of a personal care device. The processor may be configured to generate an image representing the predicted appearance of that part of the user's body, with dimensions based on the size of the processing element.

[0009] Device operation data may include data indicating the orientation and / or movement of the personal care device. The processor may be configured to generate an image representing the predicted appearance of that part of the user's body, with dimensions based on the orientation / movement data.

[0010] In some examples, the processor may also be configured to determine indications of a body part of a user to be treated with a personal care device based on the received image data. The processor may also be configured to generate an image representing the predicted appearance of that body part of the user, with dimensions further based on the indications of the body part.

[0011] In some embodiments, the device may include an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone, or a wearable device.

[0012] According to a second aspect, a computer-implemented method is provided, comprising: receiving image data concerning a user of a personal care device, wherein the personal care device will be used to process a portion of the user; receiving device operation data associated with the personal care device; determining position information of at least a processing element of the personal care device relative to the user; generating an image representing a predicted appearance of the portion of the user after processing with the personal care device, based on the received image data, the received device operation data, and the determined position information; and displaying the generated image on a representation of the user.

[0013] The computer-implemented method may also include displaying the user's representation and the generated image on the user's representation in an alternating manner.

[0014] In some embodiments, the computer-implemented method may further include determining, based on the received image data, the amount of deformation of a user surface caused by a personal care device. An image representing the predicted appearance of that portion of the user's surface may be further generated based on the determined amount of deformation.

[0015] According to a third aspect, a personal care system is provided, comprising: a personal care device having a processing element for processing a portion of a user; an image capture device configured to capture image data relating to the user of the personal care device; a display unit; and a processing means configured to operate the image capture device to capture image data relating to the user of the personal care device; receive device operation data associated with the personal care device; determine position information of at least the processing element of the personal care device relative to the user; generate an image representing a predicted appearance of the portion of the user after processing with the personal care device based on the captured image data, the received device operation data, and the determined position information; and provide the generated image for display on the display unit on the user's representation.

[0016] In some examples, the personal care device may include a first sensor configured to measure the force or pressure applied to the user by the personal care device. The processing unit may be configured to further generate an image representing the predicted appearance of that part of the user's body based on the output of the first sensor.

[0017] In some cases, the personal care device may include a second sensor configured to measure orientation data and / or motion data with respect to the personal care device. The processing unit may be configured to further generate an image representing the predicted appearance of that part of the user's body based on the output of the second sensor.

[0018] In some examples, personal care devices may include devices selected from the group consisting of: hair trimming devices, shaving devices, hair treatment devices, phototherapy devices, skin treatment devices, skin regeneration devices, and product application devices.

[0019] These and other aspects will become apparent and will be illustrated with reference to the embodiments described below. Attached Figure Description

[0020] Exemplary embodiments will now be described by way of example only with reference to the following figures, in which:

[0021] Figure 1 This is an illustration of a user performing personal care activities;

[0022] Figure 2 These are schematic diagrams illustrating examples of devices according to various embodiments;

[0023] Figure 3A , 3B 3C are illustrations of images generated according to various embodiments;

[0024] Figure 4These are illustrations of images generated according to various embodiments;

[0025] Figure 5A and 5B These are illustrations showing various embodiments of the invention in use;

[0026] Figure 6 This is a flowchart illustrating examples of methods according to various embodiments;

[0027] Figure 7 This is a flowchart of another example of a method according to various embodiments;

[0028] Figure 8 It is a schematic diagram of a processor communicating with a computer-readable medium; and

[0029] Figure 9 This is a schematic diagram of a personal care system. Detailed Implementation

[0030] According to various embodiments of the present invention, methods, apparatus, and systems are provided that enable users of personal care devices to view visual indications of the effects of performing personal care activities before performing such activities. Various embodiments are described in the context of performing personal care activities using personal care devices such as hair care devices and skin care devices. However, it should be understood that the disclosed embodiments can be implemented using any type of personal care device.

[0031] Refer to the attached diagram. Figure 1 This is an illustration of a user 102 using personal care device 104. In this example, personal care device 104 includes a shaving device for, for example, shaving hair from the face of user 102. In some cases, particularly when user 102 cannot directly see the part of their body being treated, the user can perform personal care activities (such as shaving) in front of a mirror, allowing them to more precisely position the personal care device 104, thus making it easier to achieve the desired results. Figure 1 In the example shown, user 102 is performing a personal care activity in front of a display device 106 that is capable of displaying at least a representation of the user (e.g., the user's reflection or a representation of the user that has been captured by a camera).

[0032] In some examples, display device 106 may include an interactive mirror. An interactive mirror, sometimes called a smart mirror, is a unit that, in addition to showing a user his or her reflection as a mirror, can also display information to the user. Information such as text, images, and video may be displayed on a display portion of the interactive mirror, which may be located, for example, behind a mirror (or partial mirror) panel or a mirror (or partial mirror) surface. In this way, the display screen or a portion thereof is visible through the mirror portion, allowing the user to simultaneously see their reflection and the information on the display screen. Interactive mirror 106 may include one or more sensors, such as an imaging device 108 (e.g., a camera) capable of capturing images (e.g., an image of user 102), which may be displayed on the screen of the interactive mirror or used to determine data (e.g., device location data), as described below. Interactive mirror 106 may be connected (wirelessly or via a wired connection) to one or more other devices, such as personal care device 104. Processing circuitry within interactive mirror 106 may receive data from personal care device 104 (and / or from other connected devices) and may display information related to the connected devices to the user.

[0033] In other examples, user 102 may use an alternative display device 106 instead of the interactive mirror. For example, user 102 may perform personal care activities in front of a smartphone, tablet, laptop, or other display device capable of displaying the user's representation and other information. For example, camera 108 may be part of the display device or may be a standalone device connected to display device 106.

[0034] Personal care device 104 may include a body 110 and a processing element 112 for performing the intended treatments of the personal care device. For example, in a shaving device, the processing element 112 may include a razor head having blades that cut hair during use. The body 110 of personal care device 104 may accommodate various components. In some examples, personal care device 104 may include one or more sensors, such as a first sensor 114 and / or a second sensor 116 for measuring data related to the use of the personal care device and / or its use.

[0035] The various steps of the methods disclosed herein can be performed using one or more processors, such as processor 118, which may form part of a computing device or cloud computing environment connected to display device 106. In an example where display device 106 includes part of a computing device (e.g., a smartphone or tablet computer), processor 118 may also form part of the computing device. Figure 1In the example shown, processor 118 forms part of interactive mirror 106. According to embodiments of the invention, during use of personal care device 104, processor 118 can use various data (e.g., image data acquired using camera 108 and / or data acquired using sensors 114, 116) to generate an image 120 representing a predicted appearance of a portion of user 102 after processing with personal care device 104. The generated image 120 may include patches that can be displayed on display device 106 along with the representation of user 102 (e.g., a reflection or the generated representation). For example, the generated image 120 may be presented as overlapping or superimposed areas on display device 106. In this way, user 102 is able to view themselves (i.e., their representation) and simultaneously see a prediction of what they would look like if they continued to use personal care device 104 in a particular area.

[0036] In some embodiments, the generated image 120 may be displayed on the display device 106 when the personal care device 104 approaches the user 102 (e.g., when the personal care device is within a defined threshold distance of the user), but before the processing element 112 of the personal care device processes the user. Furthermore, the position of the generated image 120 relative to the representation of the user 102 on the display device 106 may be based on the position of the personal care device 104 or the position of the processing element 112 of the personal care device, such that movement of the processing element 112 causes movement of the image 120 on the display device. Therefore, before performing a personal care activity that could lead to irreversible changes, the user 102 can view the predicted outcome shown by the generated image 120 and decide whether to continue the personal care activity.

[0037] According to a first aspect, the present invention provides an apparatus. Figure 2This is a schematic diagram of an example of a device 200 that may be used in embodiments of the present invention. Device 200 includes a processor 202. Processor 202 may include or be functionally similar to processor 118. Device 200 may include or be part of a computing device such as a smartphone or tablet computer, or may include or be part of an interactive mirror. Processor 202 is configured to receive image data about a user 102 of a personal care device 104, which will be used to process a portion of the user. Image data may be acquired, for example, from an image capturing device or camera 108 that is part of the computing device or interactive mirror, or from an image capturing device or camera that is separate from device 200 but capable of transmitting image data to device 200. Image data captured using known image capturing techniques in any known image format may include a portion of the user 102, and in some examples, may also include some or all of the personal care device 104. In an example where images of at least a portion of the personal care device 104 are captured in addition to images of at least a portion of the user 102, information such as data indicating the relative position, orientation, and / or movement of the personal care device 104 and the user 102 can be determined from the image data.

[0038] Camera 108 may include a 2D or 3D camera (e.g., a stereo camera) and is capable of using techniques such as time-of-flight measurement. Data acquired using camera 108 can be used to create a 2D and / or 3D model of at least a portion of user 102. Determining the position and / or orientation of personal care device 104 relative to user 102 (sometimes referred to as device tracking) can be achieved by monitoring the user's position in the captured images. When the user's face is captured in the image data, facial landmarks (e.g., points of eyes, nose, mouth, etc.) can be used to detect facial position and orientation. The positions of the landmarks are then incorporated into a pre-recorded 3D facial model of user 102. The position and / or orientation of personal care device 104 can be obtained by detecting landmarks on the personal care device (e.g., reference points or corners of the device), which are sometimes referred to as device landmarks. These device landmarks may be inherent to the device or may be specifically integrated into the personal care device to improve tracking capabilities (e.g., green dots at specific locations on the device). Device landmarks can be analyzed relative to the facial landmarks of user 102 to provide data indicating the position and / or orientation of the personal care device relative to that part of user 102 (e.g., face).

[0039] The processor 202 is also configured to receive device operation data associated with the personal care device 104. The device operation data may include data indicating the type or nature of the personal care device 104 used, and / or details of the processing element 112 used on the personal care device. For example, device identification data may indicate the type of personal care device used, and / or parameter information may indicate settings (e.g., cutting length). In some embodiments, the device operation data may include data acquired using one or more sensors associated with the personal care device 104. For example, the device operation data may be acquired from one or more sensors located within the personal care device 104, or from one or more sensors located outside the personal care device but associated with it. In other examples, the device operation data may include data relating to the position, orientation, and / or movement of the device relative to a reference such as device 200 or user 102. Thus, the device operation data may be data about the personal care device 104 that has been stored prior to device use, or data acquired in real time during use of the personal care device.

[0040] Device operation data can be received from the personal care device 104 itself or from storage associated with the processor 202 (e.g., a memory), where such data is stored. For example, the memory may store a database containing device operation data for several personal care devices 104.

[0041] The processor 202 is also configured to determine position information of at least the processing element 112 of the personal care device 104 relative to the user 102. The position information may include the position or orientation of at least the processing element 112 relative to a reference point or object (e.g., the user 102 or a portion of the device 200), the orientation of at least the processing element relative to the reference point or object, the distance from at least a portion of the processing element to the reference point or object, and / or an indication of the direction of movement of at least the processing element relative to the reference point or object. The position information may be determined from received image data about the user of the personal care device 104 and / or from one or more other sources, such as device operation data and sensors within the personal care device.

[0042] Processor 202 is also configured to generate an image 120 representing a predicted appearance of that portion of user 102 after processing with personal care device 104, based on received image data, received device operation data, and determined location information. Processor 202 is also configured to provide the generated image for display on the representation of user 102. For example, image 120 and the user's representation may be presented on display 106. In an example where display 106 forms part of a computing device such as a smartphone or tablet, the representation of user 102 may be an image of the user or a live video sequence (i.e., image data) acquired using image capture device 108. In an example where display 106 forms part of an interactive mirror, the representation of user 102 may be the user's reflection in the mirror.

[0043] Image 120, representing the predicted appearance of that portion of user 102, may generally be smaller than the display 106 on which the representation of user 102 is presented, and may be resized such that it is smaller than the user's representation. Image 120 may be considered a patch or mask (e.g., a square or rectangular shape) intended to cover or replace a portion of the user's representation. For example, if user 102 is performing a shaving activity to shave one of their sideburns, image 120 generated by processor 202 may include a patch (e.g., a rectangle) representing the appearance of a portion of the side of the user's face intended to be shaved using personal care device 110 (e.g., a razor). Image 120 may include a representation of user skin with no hair or short hair, and this may be presented to user 102 as a mask, overlay, or otherwise superimposed on the user's representation on display 106.

[0044] To generate an image representing the predicted appearance of that part of user 102 after processing, in some embodiments, processor 202 may use pre-stored data (e.g., data stored in memory) that indicates or describes how a particular part of the user might appear if a personal care activity is performed. For example, in a shaving example, the generated image 120 may include a stored image of clean-shaved skin, allowing user 102 to see that a particular part of their body looks clean-shaved. Additional data available to processor 202 may be used to make a more accurate prediction of the appearance of that part of the user's body. For example, data indicating the user's skin color, tone, skin tone, etc., may be determined from the received image data, and such data may be used to generate image 120 of the predicted appearance of that part of user 102, making the generated image more realistic.

[0045] In some examples, device operation data associated with personal care devices (such as razors) 110 can be used to improve predictions. Figure 3 is an illustration of three different examples of images 120 generated using device operation data associated with razors. In each example, the sideburns of user 102 are shown as a portion of the user's hair. Figure 3A In this example, the razor's device operation data can instruct the razor's processing element 112 to be set to perform a clean shave (e.g., without shaving guidance in the appropriate area). Therefore, in this example, image 120 can show a cleanly shaved portion of the user's skin instead of sideburns. Figure 3B In this image, the razor's device operation data can instruct the razor's processing element 112 to be set to cut the user's hair very short, and therefore, image 120 can show a portion of the user's skin, where sideburns are replaced with stubble. Figure 3C In this context, the razor's device operation data may instruct the razor's processing element 112 to be set to trim only the user's hair; thus, image 120 may show a portion of the user's skin with hair slightly shorter than the user's current hair length in the sideburn area. In some examples, the device operation data indicative of the nature of the processing element 112 may be automatically acquired from the personal care device 104, while in other examples, the user may provide (e.g., via a user interface, not shown) details of the processing element, such as the intended cut length.

[0046] The appearance (e.g., size, shape, and / or orientation) of the image 120 generated by the processor 202 may be based on data available to the processor 202, including, for example, received image data, received device operation data, and / or determined location information. Figure 4 These are illustrations of two different examples of the appearance of image 120. In the first example, labeled 402, the resulting image 120 is relatively small, covering a smaller proportion of the representation of user 102. In the second example, labeled 404, the resulting image 120 is relatively large, covering a larger proportion of the representation of user 102.

[0047] Processor 202 can determine from image data (e.g., from camera 108) that personal care device 104 will be used to shave the sideburns of user 102 in example 402 and to shave the user's cheeks in example 404. In some examples, if personal care device 104 is to be used to process a relatively small portion of the user, the generated image 120 may be relatively small (example 402), while if a relatively large portion of the user is to be processed, the generated image may be relatively large (example 404). Device operation data associated with personal care device 104 may indicate the orientation in which personal care device 104 is held relative to the head of user 102. In some examples, the orientation of image 120 generated by processor 202 may correspond to the orientation of at least a portion of personal care device 104 (such as processing element 112). Device operation data and / or position information of processing element 112 and / or personal care device 104 may provide an indication of the speed of movement of the personal care device relative to user 102. For example, when shaving a relatively small area such as sideburns, user 102 may move personal care device 104 more slowly than when shaving a larger area such as the cheek or neck. In other examples, the received image data can be used to determine which part of user 102 to treat with personal care device 104, and this can be used to determine the size of image 120. For example, processor 202 may be configured to determine an indication of the body part of user 102 to be treated with personal care device 104 based on the received image data. Processor 202 may be configured to generate image 120 representing the predicted appearance of that part of user 102, with dimensions further based on the indication of the body part.

[0048] When the personal care device 104 is determined to be moving relatively quickly, the generated image 120 may be relatively larger than when the personal care device is determined to be moving relatively slowly. Therefore, device operation data may include data indicating the orientation and / or movement of the personal care device 104. The processor 202 may be configured to generate an image 120 representing the predicted appearance of this portion of the user 102, the image having dimensions based on the orientation / movement data. When determining the appearance of the image 120, the processor 202 may define and use various constraints and thresholds.

[0049] In some embodiments, the size of image 120 may correspond to or be based on the details of processing element 112 of personal care device 104. For example, device operation data may include the size of processing element 112 of personal care device 104. Processor 202 may be configured to generate image 120 representing a predicted appearance of that portion of user 102, the image having dimensions based on the size of processing element 112.

[0050] In some embodiments, processor 202 may be configured to determine the degree of deformation of the surface of user 102 by personal care device 104 based on received image data. For example, some personal care devices may be used by contacting or pressing the processing element 112 of personal care device 104 against the skin of user 102. Contact between processing element 112 (or any other part of personal care device 104) and the surface of user 102 (e.g., skin) may cause surface deformation. Using the received image data (e.g., image data acquired using camera 108), the amount or degree of deformation may be measured or determined, and this may be taken into account when generating image 120. The image data may be used, for example, to determine the depth of personal care device 104 in a 3D model of user 102. In some embodiments, parametric information relating to the user's surface may be used to improve the determination of the amount of deformation. For example, skin elasticity values ​​at different locations on the user's body may be used. For example, known values ​​of skin elasticity may be stored in memory accessible to processor 202. In some examples, data indicating the user's race and / or age may be used to determine the amount of skin deformation. Therefore, processor 202 can also be configured to further generate an image representing the predicted appearance of that portion of user 102 based on the determined degree of deformation of the user surface. For example, if the received image data indicates that the skin of user 102 has been deformed by personal care device 104, then image 120 generated by processor 202 can show such deformation.

[0051] In other examples, the deformation of the user 102's skin caused by the personal care device 104 can be determined or measured in another manner. For example, the first sensor 114 and / or the second sensor 116 may include force or pressure sensors to measure the amount of force or pressure applied by the personal care device 104 to the surface of the user 102. When generating image 120, the data acquired using sensors 114, 116 can be used. For example, an indication of the amount of force applied to the user 102's skin can be used to predict the amount of skin deformation, which can be displayed in image 120. Thus, processor 202 can be configured to further generate image 120 representing the predicted appearance of that portion of the user 102 based on the output of sensors 114, 116 of the personal care device 104.

[0052] In some examples, image 120 may be displayed on the user's representation (e.g., on display 106) only when certain conditions are met. For example, image 120 may only be displayed when personal care device 104 is determined to be within a defined threshold distance of user 102. Figure 5 is an illustration of two examples of representations of user 102 and personal care device 104 according to an embodiment of the present invention. Figure 5AIn this example, data available to the processor 202 (e.g., received image data, received device operation data, and / or determined location information) can indicate that the personal care device 104 is beyond a threshold distance from the user 102. In this example, image 120 may not be displayed on the user 102's representation. However, in... Figure 5B In this example, the data available to the processor 202 can indicate that the personal care device 104 is within a threshold distance from the user 102. In this example, image 120 is displayed on the user 102's representation. By displaying image 120 only when the personal care device 104 is within the defined threshold distance of the user 102, the processor 202 is able to determine the user's intended processing location with a high degree of confidence. Furthermore, the user 102 has some control over when image 120 is displayed on the display 106. For example, if the user 102 wishes to view the representation without image 120 obscuring it, they can simply remove the personal care device 104 from their face.

[0053] As briefly mentioned above, device 200 may include or form part of a computing device. In some examples, device 200 may include an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone, or a wearable device (such as a smartwatch).

[0054] According to a second aspect, the present invention provides a method. Figure 6 This is a flowchart of an example of method 600. Method 600, which may include a computer-implemented method, can be considered as a method for predicting the appearance of a user after processing with a personal care device. In step 602, method 600 includes receiving image data of a user 102 with respect to a personal care device 104, wherein the personal care device will be used to process a portion of the user. In step 604, method 600 includes receiving device operation data associated with the personal care device 104. In step 606, the method includes determining position information of at least one processing element 112 of the personal care device 104 relative to the user 102. In step 608, the method includes generating an image 120 representing the predicted appearance of that portion of the user 102 after processing with the personal care device 104 based on the received image data, the received device operation data, and the determined position information. In step 610, method 600 includes displaying the generated image 120 on a representation of the user 102. For example, image 120 may be displayed on a display 106.

[0055] Figure 7This is a flowchart of another example of method 700. Method 700 may include a computer-implemented method and may include one or more steps of method 600. In step 702, method 700 may include an image 120 generated on a display of user 102's representation and user's representation in an alternating manner. Thus, image 120 may be periodically displayed on user 102's representation and removed, such that image 120 repeats for a short period of time (e.g., 0.5 seconds or 1 second). In this way, user 102 is able to compare how they currently look with how they look when being processed using personal care device 104.

[0056] In other embodiments, the display and / or removal of image 120 from the display may be controlled by user 102. For example, user 102 may perform a defined movement or gesture (e.g., using fingers, hands, their head, facial expressions, or a defined movement of the personal care device), which may be captured by camera 108 and interpreted as an indication that the user wishes to display or remove image 120 from the display. In another example, a pause in movement of personal care device 104 by user 102 may be detected and identified as a signal to display image 120. In this way, the user may stop moving personal care device 104 when they want to understand what the effects of further movement of the device might be. In other embodiments, the display and / or removal of image 120 from the display may be achieved via user interaction with a user interface of personal care device 104 or a computing device housing display 106 (e.g., an interactive mirror or tablet computer). For example, user 102 may press a button to toggle between displaying and not displaying image 120.

[0057] In step 704, method 700 may include determining the amount of deformation of the surface of user 102 by personal care device 104 based on the received image data. For example, contact between personal care device 104 and the skin of user 102 may cause deformation of the skin, and the amount and nature of the deformation may be determined. An image 120 representing the predicted appearance of that portion of user 102 may be generated (step 608) based on the determined amount of deformation of the user's surface. Therefore, the image 120 generated in step 608 may include the deformation of the surface.

[0058] One or more steps of methods 600 and 700 may be performed using the processor 202 of the device 200.

[0059] According to another aspect, a computer program product is provided. Figure 8This is a schematic diagram of an example of a processor 802 communicating with a computer-readable medium 804. Depending on the subject, a computer program product may include a non-transitory computer-readable medium 804 having computer-readable code contained therein, configured to cause, when executed by a suitable computer or processor 802, to perform the steps of the methods 600, 700 disclosed herein. The processor 802 may include or be similar to the processors 118, 202 discussed above.

[0060] According to a fourth aspect, the present invention provides a personal care system. Figure 9 This is a schematic diagram of an example of a personal care system 900. The personal care system 900 includes a personal care device 104 having a processing element 112 for processing a portion of a user 102. The personal care system 900 also includes an image capture device 108 configured to capture image data of the user with respect to the personal care device 104. The image capture device 108 may include, for example, a 2D or 3D camera. The personal care system 900 also includes a display unit 106 (e.g., an interactive mirror or a display of a computing device). The personal care system 900 also includes processing devices 202, 802. The processing devices 118, 202, 802, display unit 106, and / or image capture device 108 may form part of a single unit or component, such as a computing device or an interactive mirror. The personal care device 104, display unit 106, and image capture device 108 may all communicate with the processing devices 118, 202, 802, for example, via wired or wireless connections.

[0061] Processing devices 118, 202, and 802 are configured to operate image capture device 108 to capture image data of user 102 of personal care device 104; receive device operation data related to personal care device; determine position information of at least processing element 112 of personal care device relative to user; generate an image representing the predicted appearance of that part of the user after processing with personal care device based on the captured image data, received device operation data, and determined position information; and provide the generated image to display the user's representation on display unit.

[0062] In some embodiments, the personal care device 104 may include a first sensor 114 configured to measure the force or pressure applied to the user 102 by the personal care device 104. For example, the personal care device 104 may include a resistive sensor, a capacitive sensor, and / or a piezoelectric sensor to measure the force applied to the skin of the user 102 by the processing element 112 of the personal care device during use. The processing devices 118, 202, 802 may be configured to further generate an image 120 representing a predicted appearance of that portion of the user 102 based on the output of the first sensor 114.

[0063] In some embodiments, the personal care device 104 may include a second sensor 116 configured to measure orientation data and / or motion data with respect to the personal care device. For example, the personal care device 104 may include one or more of an accelerometer, magnetometer, gyroscope, and inertial measurement unit (IMU) configured to measure the orientation (e.g., relative to the Earth) of the personal care device and / or data related to any movement of the personal care device during use. Processing devices 118, 202, 802 may be configured to further generate an image 120 representing a predicted appearance of that portion of the user 102 based on the output of the second sensor 116.

[0064] As described above, the present invention can be used in the field of personal care, or any field of treatment of a user. In some embodiments, the personal care device 104 may include devices selected from the group consisting of: hair trimming devices, shaving devices, hair treatment devices, phototherapy devices, skin treatment devices, skin regeneration devices, and product application devices (e.g., devices for applying products such as creams, lotions, cosmetics, etc., to a user).

[0065] The embodiments of the invention disclosed herein provide a mechanism by which a user can view and anticipate the possible effects of performing a personal care activity before actually performing it. This is achieved by predicting a portion of the user's appearance during the personal care activity and displaying the user an image depicting the predicted appearance before the activity. In this way, the user can make an informed decision about whether to continue the personal care activity. Furthermore, by anticipating the possible outcomes of performing a personal care activity, the user can perform the activity more accurately and quickly, reduce the power used by the personal care device, and reduce wear and tear on the components of the personal care device, such as processing elements.

[0066] Processors 118, 202, and 802 may include one or more processors, processing units, multi-core processors, or modules configured or programmed to control device 200 in the manner described herein. In certain embodiments, processors 118, 202, and 802 may include multiple software and / or hardware modules, each configured to perform or be used to perform one or more steps of the methods described herein.

[0067] As used herein, the term "module" is intended to include hardware components, such as processors or processor components configured to perform a particular function, or software components, such as a set of instructions or data that have a particular function when executed by a processor.

[0068] It should be understood that embodiments of the present invention are also applicable to computer programs, particularly computer programs on or within a carrier in which the present invention is practiced. The program may be in the form of source code, object code, intermediate source code, and object code, such as in a partially compiled form, or any other form suitable for use in implementations of methods according to embodiments of the present invention. It should also be understood that such programs may have many different architectural designs. For example, program code implementing the functionality of the method or system according to the present invention may be subdivided into one or more subroutines. Many different ways of distributing functionality among these subroutines will be apparent to those skilled in the art. Subroutines may be stored together in an executable file to form a self-contained program. Such executable files may include computer-executable instructions, such as processor instructions and / or interpreter instructions (e.g., Java interpreter instructions). Alternatively, one or more or all of the subroutines may be stored in at least one external library file and linked to the main program, for example, statically or dynamically at runtime. The main program contains at least one call to at least one subroutine. Subroutines may also include function calls to each other. Embodiments relating to computer program products include computer-executable instructions corresponding to each processing stage of at least one method set forth herein. These instructions may be subdivided into subroutines and / or stored in one or more files that can be statically or dynamically linked. Another embodiment relating to a computer program product includes computer-executable instructions for each apparatus corresponding to at least one of the systems and / or products set forth herein. These instructions may be subdivided into subroutines and / or stored in one or more files that can be statically or dynamically linked.

[0069] The carrier of a computer program can be any entity or device capable of carrying the program. For example, the carrier can include data storage, such as ROM, e.g., CD-ROM or semiconductor ROM, or magnetic recording media, e.g., hard disk. Furthermore, the carrier can be a transmissible carrier such as electrical or optical signals, which can be transmitted via cables or optical fibers or by radio or other means. When the program is contained in such signals, the carrier can be constituted by such cables or other devices or equipment. Alternatively, the carrier can be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform the relevant method or to be used in the performance of the relevant method.

[0070] By studying the accompanying drawings, the disclosure, and the appended claims, those skilled in the art can understand and practice variations of the disclosed embodiments in practicing the principles and techniques described herein. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite articles "a" or "an" do not exclude multiple. A single processor or other unit may perform the functions of several items listed in the claims. The fact that certain measures are recited in mutually different dependent claims does not imply that combinations of these measures cannot be advantageously used. Computer programs may be stored or distributed on suitable media, such as optical storage media or solid-state media provided with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems. Any reference numerals in the claims should not be construed as limiting the scope.

Claims

1. An apparatus (200) comprising: The processor (202) is configured as follows: Receive image data of a user (102) with respect to a personal care device (104), wherein the personal care device will be used to process a part of the user; Receive device operation data related to the personal care device, wherein the device operation data includes data indicating the orientation and / or movement of the personal care device (104); Determine the position information of at least the processing element (112) of the personal care device relative to the user; Based on the received image data, the received device operation data, and the determined location information, an image (120) is generated, which represents the predicted appearance of the user's part after processing with the personal care device. Generate the image (120) representing the predicted appearance of the user's part, the image (120) having dimensions based on the orientation / motion data; as well as The generated image is provided for display on the user's display.

2. The apparatus (200) according to claim 1, wherein the processor (202) is further configured to: Based on the received image data, the degree of deformation of the user's (102) surface caused by the personal care device (104) is determined; and The image representing the predicted appearance of the user's portion is also generated based on the determined degree of deformation of the user's surface.

3. The apparatus (200) according to claim 1 or 2, wherein the processor (202) is configured to generate, based on the output of the sensors of the personal care device (104), the image representing the predicted appearance of the portion of the user (102).

4. The apparatus (200) according to claim 1 or 2, wherein the processor (202) is further configured to: Based on the received image data, an instruction is determined for the portion of the user (102) to be processed using the personal care device (104); and Generate an image (120) representing the predicted appearance of the portion of the user, the image (120) having a size based on the indication of the portion.

5. The device (200) according to claim 1 or 2, wherein the device includes an interactive mirror, a desktop computer, a laptop computer, a tablet computer, a smartphone, or a wearable device.

6. An apparatus (200) comprising: The processor (202) is configured as follows: Receive image data of a user (102) with respect to a personal care device (104), wherein the personal care device will be used to process a part of the user; Receive device operation data related to the personal care device, wherein the device operation data includes the dimensions of the processing element (112) of the personal care device (104); Determine the position information of at least the processing element (112) of the personal care device relative to the user; Based on the received image data, the received device operation data, and the determined location information, an image (120) is generated, which represents the predicted appearance of the user's part after processing with the personal care device. Generate the image (120) representing the predicted appearance of the user's portion, the image (120) having a size based on the size of the processing element; as well as The generated image is provided for display on the user's display.

7. A computer-implemented method (600), comprising: Receive image data of a user with respect to a personal care device (104), wherein the personal care device will be used to process a portion of the user (102); Receive device operation data related to the personal care device, wherein the device operation data includes data indicating the orientation and / or movement of the personal care device (104); Determine the position information of at least the processing element (112) of the personal care device relative to the user; Based on the received image data, the received device operation data, and the determined location information, an image (120) is generated, which represents the predicted appearance of the user's part after processing with the personal care device. Generate the image (120) representing the predicted appearance of the user's part, the image (120) having dimensions based on the orientation / motion data; as well as The generated image is displayed on the user's display.

8. The computer-implemented method (600, 700) according to claim 7, further comprising: The user's representation and the image generated on the user's representation are displayed alternately.

9. The computer-implemented method (600, 700) according to claim 7 or 8, further comprising: Based on the received image data, the amount of deformation of the user's (102) surface caused by the personal care device (104) is determined; The generation of the image (120) representing the predicted appearance of the user's portion is also based on the determined amount of deformation of the user's surface.

10. A personal care system (900), comprising: Personal care device (104) having a processing element for processing a part of the user; An image capture device (108) is configured to capture image data about the user of the personal care device; The sensor (116) is configured to measure orientation data and / or motion data with respect to the personal care device; Display unit (106); and The processing units (202, 802) are configured as follows: Operate the image capture device to capture image data of the user regarding the personal care device; Receive device operation data related to the personal care device; Determine the position information of at least the processing element of the personal care device relative to the user; Based on the captured image data, the received device operation data, and the determined location information, an image is generated that represents the predicted appearance of the user's part after processing with the personal care device. as well as The generated image is provided for display on the display unit on the user's representation, wherein the processing device is configured to generate the image representing the predicted appearance of the user's portion based on the output of the sensor.

11. The personal care system (900) of claim 10, wherein the personal care device comprises: Another sensor (114) is configured to measure the force or pressure applied to the user by the personal care device; The processing device is configured to generate the image representing the predicted appearance of the user's part based on the output of the other sensor.

12. The personal care system (900) according to any one of claims 10 to 11, wherein the personal care device (104) comprises a device selected from the group consisting of: hair trimming devices, shaving devices, hair treatment devices, phototherapy devices, skin treatment devices, skin regeneration devices, and product application devices.

Images