Device and method for visualizing a part of a user's face
A device with image stabilization and processing enhances cosmetic application by compensating for vision defects, improving precision and comfort during makeup application.
Patent Information
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- LOREAL SA
- Filing Date
- 2024-12-12
- Publication Date
- 2026-06-19
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Device and method for visualizing a part of a user's face technical field
[0001] The present invention relates to the performance of a cosmetic treatment, in particular the application of a makeup or skincare product, and more particularly aims to improve the visual comfort and application performance of people suffering from a vision defect during this cosmetic treatment. Previous technique
[0002] Magnifying mirrors, usually mounted on adjustable brackets, are commonly found in bathrooms, allowing people to closely examine a specific area of their face. These mirrors have been known for a very long time. However, their use remains somewhat difficult, as the user must position themselves precisely in relation to the mirror. Furthermore, the image is very easily distorted.
[0003] More recently, makeup assistance devices have been proposed, implementing a smartphone equipped with a camera capable of capturing images of the user's face in a frontal position. After acquisition, these images are enlarged and displayed on the screen, with the possibility of adjusting the brightness if necessary.
[0004] US patent 9 594 948 B2 discloses a virtual makeup device, enabling a user to continuously acquire images of their face and view different virtually applied makeup looks on a screen.
[0005] Application CN 109063671 A discloses a makeup aid device configured to acquire a series of images of a user's face and display modified images containing information intended to guide the user during makeup application.
[0006] A virtual visualization device for eyebrow coloring is also known from application CN 111914604A.
[0007] Furthermore, it is common for individuals to develop presbyopia after a certain age, or to be affected by myopia or hyperopia, which may require the wearing of glasses.
[0008] On the one hand, wearing glasses can make applying makeup, particularly around the eyes, difficult, as they can be cumbersome when worn. On the other hand, the user may find it difficult to perform precise and accurate movements when applying makeup without glasses.
[0009] There therefore remains a need to improve the devices that assist in the application of a cosmetic product in order to remedy the problems mentioned above. Summary of the invention
[0010] The invention aims to meet this need and achieves this, according to one of its aspects, by means of a device for viewing a part of a user's face, comprising at least one screen and a camera for continuously acquiring images of the user's face so as to allow the user to view images displayed by the screen when facing the camera, the acquired images including an area of interest of the user's face, the device being configured to generate, from the acquired images, enlarged stabilized images of the area of interest and display them on the screen, image processing being carried out prior to the display of the images, the images displayed on the screen being processed so as to compensate at least partially for at least one vision defect of the user, in particular a defect chosen from presbyopia and hyperopia.
[0011] Thanks to the invention, the user's visual comfort is improved during face makeup application.
[0012] The user can, in particular, apply a cosmetic product without their glasses or corrective lenses. The product can thus be applied relatively precisely and quickly. Specifically, the invention can allow, when the aforementioned image processing is performed, individuals suffering from presbyopia, myopia, or hyperopia to apply makeup without wearing glasses or corrective lenses.
[0013] Enlarging the images allows the user to view details more easily in the area being observed than without enlargement.
[0014] By "stabilized image", it is understood that the displayed image is centered with respect to the same reference point, even when the camera is subjected to certain vibrations or small amplitude movements of the user.
[0015] Image stabilization can provide a more precise viewing experience. In particular, the user is better able to benefit from the viewed images, even if suffering from a condition affecting their motor skills, such as Parkinson's disease, multiple sclerosis, or essential tremor. Blurring due to certain movements of the user and / or the camera can be at least partially avoided.
[0016] In addition, the device according to the invention is relatively simple to use and allows the user to use it autonomously and ergonomically.
[0017] The term “camera” here encompasses all digital image acquisition devices operating in the visible or near-infrared range, of any resolution and technology.
[0018] By "enlarged image," it is understood that the image is displayed at a larger size than the acquired image, the displayed image being linked to at least one area of the acquired image by a predefined magnification factor (also called "zoom"). Preferably, the zoom is applied to the same location for each of the acquired images. For example, the zoom is applied to an area located approximately in the center of each of the acquired images, or to one of the corners of each of the acquired images.
[0019] Image resolution refers to the number of pixels contained in the image per unit length.
[0020] The definition of an image refers to the number of pixels that an image contains in width and height, i.e. the number of columns and number of rows of pixels.
[0021] The term "predetermined area of interest" refers to a specific region of the user's face, defined prior to the display of the enlarged stabilized image. The area of interest can be defined manually by the user or automatically by the device according to certain predefined criteria.
[0022] “Image processing” refers to all techniques used to modify images in order to improve them. This may involve adjusting contrast, sharpness, and resolution, or applying filters and digital transformations, using, for example, machine learning models such as convolutional neural networks to optimize image quality and interpretation. This definition also encompasses any modification of the image perceived by the user that is not due to digital processing, particularly one caused by the presence of one or more optical components on the device's screen, such as a refractive component like one or more lenses.
[0023] By "compensating for a vision defect," it is understood that image processing makes it possible to correct, at least partially, visual problems such as presbyopia, myopia, or hyperopia by adapting the displayed image seen by the user to improve their visual perception. The user is thus able to better discern the details of the displayed image, which has been processed, than those of the same image without processing. Device
[0024] The device may be a smartphone, a tablet, a laptop, or a connected mirror. A "connected mirror," also called a digital mirror, is defined here as a mirror integrating digital display capabilities and communication with other devices or networks, generally via wireless technologies such as Wi-Fi, Bluetooth, or other communication protocols. In the context of the invention, a connected mirror can be used to display additional information, receive user commands, or interact with other connected devices. In particular, the connected mirror may include a reflective surface, notably a semi-reflective metallic layer, behind which a screen is placed. The information or images displayed on the screen can thus replace or be superimposed on the image reflected by the semi-reflective surface.
[0025] The device may be portable, in particular configured to be held in one hand. Alternatively, the device may not be held by the user, for example, it may be placed on a fixed support, such as a table or shelf, or it may be fixed to a wall. Camera
[0026] The camera may include one or more CMOS or CDD type sensors. The camera may be configured to acquire color or monochrome images.
[0027] The camera may include electromechanical stabilization means, configured to stabilize the optics or the camera sensor.
[0028] The camera may be front-facing, so as to observe the user when the latter is facing the screen of the device.
[0029] The device may include several cameras, in particular having different focal lengths and / or distinct viewing axes. It may thus be possible to effectively capture the user's face from different viewing angles or with different optical magnifications. Screen
[0030] The screen can be of any type, for example an LCD (from the English “Liquid Crystal Display”), OLED (or “Organic Light- Emitting Diode”), or AMOLED (or “Active Matrix Organic Light- Emitting Diode”).
[0031] The screen can define a rectangular surface. The screen resolution can be high definition (HD) i.e. 1280 pixels by 720 pixels, Full HD i.e. 1920 pixels by 1080 pixels, 4K i.e. 3840 pixels by 2160 pixels, or higher.
[0032] The screen may be substantially flat over its entire surface. Alternatively, the screen may be curved over at least part of its surface, or even over its entire surface.
[0033] The screen may have a larger dimension of less than 100 cm, preferably less than 50 cm, in particular between 10 and 40 cm. By "largest dimension" here refers to the greatest distance between two points located on the surface of the screen.
[0034] The screen can be touch-sensitive. Interface, memory and processor
[0035] The device may include an interface.
[0036] The interface can be configured to allow the user to execute commands. In particular, when the screen is touch-sensitive, the screen can be part of the interface.
[0037] The device may include a memory, in particular configured to store images from the camera and / or displayed on the screen.
[0038] The device may include one or more processors, configured to carry out all or part of the steps of the process according to the invention.
[0039] In particular, the memory can store images acquired from the user's face, including images acquired during a treatment or care applied to the user's face. Reference image and area of interest
[0040] The acquired images may include a reference image. The area of interest may be visible on the reference image.
[0041] The area of interest may correspond to a specific area of the user's face, which may not encompass the entire face.
[0042] The device may include a pre-recorded list of areas of interest.
[0043] In particular, the area of interest may be a region of one of the user's eyes, including the eyebrow, upper eyelid, lower eyelid, eyelashes, contour of the eye, or the corner of the eye. The area of interest may encompass both of the user's eyes.
[0044] Alternatively, the area of interest may be the user's nose, one of the cheeks, mouth, forehead, or chin. The area of interest may be the user's entire face. Defining the entire face as the area of interest is particularly suitable for applying a treatment or care to the entire face.
[0045] The interface may allow the user to manually define the area of interest, in particular by selection from a drop-down menu displayed on the screen or by selecting a sub-region of an image acquired and displayed on the screen.
[0046] The drop-down menu displayed on the screen can contain at least one, preferably at least two, or even at least three, or more than four, different areas of interest. It should be understood here that the user can select, for example, one of the eyes or the nose as the area of interest. The selection of the area of interest from the drop-down menu can be made using one or more buttons on the interface. If the screen is touch-sensitive, the selection of the area of interest can be made by simply touching the screen.
[0047] A sub-region of the reference image can be selected using one or more buttons on the interface. If the screen is touch-sensitive, the area of interest can be selected by simply touching and / or swiping. with one or more fingers on the screen. For example, the area of interest is a region of the reference image on which the user zooms.
[0048] The device can be configured to determine the area of interest automatically by image analysis.
[0049] For example, when a cosmetic product applicator, such as a mascara brush, applicator tip, stick, sponge, or puff, is detected near the user's face, the area of interest is defined as the region treated by the applicator. "Detected near" means that the distance between the applicator and the user's face, as assessed from an image acquired by the camera, is less than a predefined threshold.
[0050] Alternatively, when a cosmetic product applicator is detected near the user's face, the area of interest can be determined from the type of applicator and / or the type of cosmetic treatment normally performed via the applicator.
[0051] The term "applicator" here refers to any tool used to apply a cosmetic product, but also, by extension, to one or more fingers of a hand. The applicator may be a pencil, a brush, a stick, a mousse, among other things.
[0052] The area of interest can be readjusted according to the amplitude of the user's movements. For example, the area of interest can be enlarged if the applicator's movements have an amplitude greater than a first predefined amplitude threshold, or the area of interest can be reduced if the applicator's movements have an amplitude less than a second predefined amplitude threshold. Readjusting the area of interest during use results in a responsive device, improving user comfort.
[0053] Alternatively, the area of interest can be locked once defined. In particular, the device can be configured to continuously display images of the area of interest after it has been defined.
[0054] The area of interest can be redefined using a user command. Images
[0055] At least part of the acquired images may include the area of interest.
[0056] At least a portion of the acquired images can be recorded in the memory of the Optionally, acquired images that do not include the area of interest can be ignored by the device and not saved. Images can be processed on the fly without saving.
[0057] The acquired images can be acquired by the device according to a predefined acquisition frequency, in particular greater than 24 Hz, better at 60 Hz, even better at 90 Hz, or even at 120 Hz.
[0058] The acquisition frequency is preferably high enough to obtain a smooth visualization for the user.
[0059] Each of the displayed images corresponds to an acquired image and the acquired image can in particular be enlarged, and / or recalibrated, and / or processed before being displayed.
[0060] Each of the displayed images may include the area of interest.
[0061] The display of images may vary depending on the screen size of the device. For example, with a large screen in the case of a connected mirror, it is possible to display the entire face of the user while maintaining a sufficient level of detail in the area of interest.
[0062] The images displayed may be in color, or in black and white. Stabilization
[0063] At least one of the displayed images, in particular each of the displayed images, can be stabilized.
[0064] The stabilized image(s) can be recorded in the device's memory.
[0065] The acquired images may include at least one reference image. The device may be configured to stabilize the displayed image by registering the corresponding acquired image with respect to the reference image.
[0066] By "registration of the acquired image with respect to the reference image," it is understood that the acquired image is recentered by taking the reference image as a reference. This registration ensures that the images maintain the same centering as the reference image. The acquired images thus registered are hereinafter referred to as "registered acquired images."
[0067] Image registration can be a translation of the image along two non-parallel directions of the acquired image. In particular, image registration can be a translation along two perpendicular directions of the acquired image, notably along a first horizontal direction and a second vertical direction. Alternatively, other geometric transformations can be modeled to obtain global or local deformations.
[0068] Registration can maximize the pixel-by-pixel correspondence of the acquired image with the area of interest of the reference image by considering each pixel and / or its neighborhood. Alternatively, points of interest can also be used to calculate the optimal transformation.
[0069] Alternatively, registration can be performed using at least one predetermined facial landmark. In this case, registration is not performed using a reference image, but using at least one facial landmark visible in the acquired images.
[0070] The predetermined reference point can be a physical reference point on the user's face. For example, it can be one or more points on the nose, mouth, eyes, ears, facial contour, or a combination thereof.
[0071] For a given acquired image, the device can be configured to detect the predetermined physical marker on the acquired image and re-register said image, so that said marker remains either at a predefined position on the displayed image.
[0072] Alternatively, stabilization can be partially achieved from stabilization means directly integrated into the camera of the device.
[0073] Stabilization can be performed before enlarging the acquired image. Alternatively, stabilization can be performed after enlarging the acquired image. Enlargement
[0074] At least one of the acquired images, in particular each of the acquired images, can be enlarged. In particular, at least one of the registered acquired images, in particular each of the registered acquired images, can be enlarged.
[0075] At least one of the acquired images, in particular each of the acquired images, can be enlarged by a predefined scale factor, for example between 1 and 5, better between 1 and 4, even better between 1 and 3, the limit 1 being excluded.
[0076] The scale factor can be constant for all corresponding acquired image / displayed image pairs.
[0077] Alternatively, the scaling factor may not be constant for all corresponding acquired and displayed images. A non-constant scaling factor can, for example, compensate for relative movement of the user moving away from or towards the camera.
[0078] The enlarged image(s) may include the entire area of interest. Alternatively, the enlarged image(s) may include only a sub-region of the area of interest. Image processing
[0079] The device can be configured to perform image processing of enlarged images.
[0080] Image processing can be carried out prior to the display of the image in order to compensate for a vision defect chosen from presbyopia and hyperopia.
[0081] Image processing can increase the resolution of the displayed image.
[0082] Each of the displayed images can be processed in such a way as to increase its resolution.
[0083] The resolution of the displayed image can be increased by means of "super-resolution" type algorithms.
[0084] The term "super-resolution" here refers to a set of algorithms and techniques used to improve or increase the resolution of a given image, in particular by oversampling it. "Super-resolution" algorithms may include classical interpolation methods, machine learning, or even deep learning.
[0085] Thanks to the increased resolution, the displayed images are sharper and more visible to the user, especially when enlarged.
[0086] Image processing can increase the contrast and / or sharpness of the displayed image.
[0087] Image processing may include the application of a digital filter accentuating contours of the displayed image, or involving a model based on a machine learning method, this model preferably including the implementation of a convolutional neural network.
[0088] The convolutional neural network may have been trained to overcorrect an image so that this overcorrection, once degraded by the visual defect to be corrected, is close to the original image when the overcorrected image is seen by the user with the vision defect.
[0089] A filter that accentuates the contours of the displayed image is, for example, a high-pass filter, or a non-linear masking (from the English "unsharp masking").
[0090] The image processing applied can be selected by the user via the interface from among several types of image processing, or be generated automatically from a description by the user of his vision defect.
[0091] Various types of image processing can be pre-programmed in the device's memory, or in any other medium, for example a remote server, accessible by the device through communication means.
[0092] Image processing is selected, for example, via a drop-down menu displayed on the screen.
[0093] The device can be configured to display one or more examples of different image processing on the screen. The user can thus choose the type of processing they deem optimal to compensate for their vision impairment, for example.
[0094] The user's description of their vision defect includes, for example, the entry of information relating to the user's vision defect via the interface. This information may include, for one eye or each eye, the type of vision defect, the correction value, the degree of astigmatism, and / or the orientation of the astigmatism.
[0095] The interface can be configured to allow the user to calibrate their vision defect, the interface including calibration means for adjusting the image processing to be applied. By "calibrating one's vision defect," it is necessary to This means understanding that the user can execute real-time commands to directly adjust the type of image processing applied. For example, the interface may include gauges and sliders for fine-tuning the image processing. This allows the user to select the correction they deem optimal.
[0096] Alternatively, image processing can be carried out using one or more optical components, in particular one or more lenses, arranged on the screen of the device.
[0097] The image processing according to the invention can be adapted to several types of users, possessing different vision defects.
[0098] The device can be arranged to take at least one image through a corrective lens of a frame of the user, and from this image determine the image processing to be applied in order to compensate for a vision defect of the user.
[0099] The term "hyperopia" here refers to a refractive error that results in blurred vision at both near and far distances. Presbyopia is an optical anomaly linked to the aging of the lens. It is therefore an inevitable phenomenon affecting everyone.
[0100] The term "presbyopia" here refers to an inevitable age-related visual impairment that results in the loss of the lens's elastic deformation capacity. This affects the ability to focus at near objects, and thus impairs near vision.
[0101] The displayed image may include at least one piece of information informing the user about the treatment or care to be carried out.
[0102] The information informs the user, for example, about the area of the face on which to apply a cosmetic product, and / or about the type of applicator gestures to perform, and / or the intensity of the movement to perform.
[0103] The information may include a highlighted outline.
[0104] The trace may be semi-transparent.
[0105] The outline may have uniform opacity. Uniform opacity means that the outline has the same degree of opacity (or transparency) over its entire surface. Alternatively, the outline may have variable opacity, with the opacity increased in one or more areas of the outline requiring the application of a larger quantity of cosmetic product and / or a greater intensity of application. This allows the user to more easily identify how to apply a given cosmetic product.
[0106] The information displayed may include the outline of a makeup design.
[0107] For example, the information displayed may include the outline of makeup for an eyebrow, and / or an eyelid, and / or the contour of the eye.
[0108] The device can be configured to analyze an image of the user's made-up face and generate information facilitating the subsequent reproduction of the makeup
[0109] The device can be configured to generate said information from an image acquired of makeup applied during the last use of the device, this acquired image being stored in the device's memory.
[0110] The device can be configured to generate information from an image acquired of initial makeup applied to one area of the first eye. This information can then be transformed, notably by axial symmetry with respect to a facial axis of symmetry, so as to inform the user about the steps to take to apply makeup to the other eye. The device thus makes it easier to maintain symmetry when applying makeup to several areas of the face. Visualization method
[0111] The invention also relates, independently or in combination with the foregoing, to a method for viewing a part of a user's face implemented by a device comprising at least one screen and a camera for continuously acquiring images of the user's face, in particular a device as defined above, the method comprising:
[0112] - the detection of a predefined area of interest on the user's face,
[0113] - the display of a stabilized enlarged image of the area of interest.
[0114] The device used to implement the process may have all or part of the characteristics described above.
[0115] Thus, it is possible to obtain an enlarged and stabilized visualization of an area of interest.
[0116] Advantageously, the method involves the application of a treatment or cosmetic product to the area of interest by the user viewing the displayed image.
[0117] Preferably, image processing is carried out prior to the display of the image, the displayed image being processed in such a way as to compensate for a defect in the user's vision.
[0118] The method advantageously includes a vision defect calibration step, comprising the selection of an image processing from among several types of image processing pre-programmed in the device, or the automatic generation of an image processing from a description by the user of his vision defect.
[0119] Image processing selection is, for example, carried out via a drop-down menu displayed on the screen.
[0120] The calibration may include displaying one or more different image processing examples on the screen. The image processing example(s) may understand the application of image processing to a given acquired image.
[0121] The user's description of their vision defect may include the entry of information relating to the user's vision defect via the interface. This information may include, for one eye or each eye, the type of vision defect, the correction value, the degree of astigmatism, and / or the orientation of the astigmatism.
[0122] The method may include the continuous acquisition of images, acquired by the camera, of the area of interest of the user's face. Cosmetic treatment process
[0123] The invention also relates to a cosmetic treatment method, comprising:
[0124] - the display of a stabilized, enlarged image of an area of interest by putting in work of the aforementioned process,
[0125] - the application of a treatment or cosmetic product to the area of interest by the user viewing the displayed image.
[0126] Image processing can be carried out prior to the display of the image, the displayed image being processed in such a way as to compensate for a defect in the user's vision. computer program product
[0127] The invention also relates, independently or in combination with the foregoing, to a computer program product intended to be implemented by a device comprising at least one screen, a processor, memory, and a camera for continuously acquiring images of a user's face, this computer program product comprising code instructions which, when the program is executed by the processor, cause the processor to:
[0128] - detect a predetermined area of interest on a reference image acquired by the camera, - display on the screen a stabilized, enlarged image of the area of interest, and preferably, - to perform image processing prior to displaying the image in order to compensate for a user's vision defect. Brief description of the drawings
[0129] The invention will be better understood upon reading the detailed description that follows, the non-limiting examples of embodiments thereof, and upon examination of the accompanying drawing, in which:
[0130] [Fig.1] Fig.1 illustrates, schematically and partially, a user implementing an example of a device according to the invention,
[0131] [Fig.2] Fig.2 illustrates, schematically and partially, the display step of an image processed to compensate for a user's vision defect,
[0132] [Fig.3] Figure [Fig.3] illustrates steps of an example of a process according to the invention,
[0133] [Fig.4a] Fig.4a illustrates, schematically and partially, examples of Eyebrow makeup outlines,
[0134] [Fig.4b] Fig.4b illustrates, schematically and partially, examples of eye makeup outlines, and
[0135] [Fig.4c] Fig.4c illustrates, schematically and partially, examples of Eye contour makeup outlines. Detailed description
[0136] Figure 1 illustrates a user U using the device 1 according to the invention. As illustrated, the device 1 can be a smartphone, but it could be any other suitable device.
[0137] Screen 2 may be rectangular in shape, as illustrated.
[0138] This screen 2 can be touch-sensitive.
[0139] Device 1 includes in the example considered a front camera 3.
[0140] In the illustrated example, user U applies a treatment or care to the eye area using an applicator 4.
[0141] Device 1 is configured to acquire a sequence of images of the face of user U.
[0142] The reference image Irefest for example an image of the user's entire face.
[0143] The area of interest Ir oi is in this example the region of the eye being treated.
[0144] The Iref area of interest can be manually selected by the user U on the reference image Iref displayed on screen 2.
[0145] Device 1 is configured to enlarge the reference image Iref in the area of interest Iroi.
[0146] Stabilization is carried out so as to maintain a relatively static appearance of the area of interest Iroi on the images displayed on screen 2.
[0147] Fig. 2 illustrates an example of processing applied to the displayed images.
[0148] The upper left image A1 is an enlarged representation of the area of interest Iroi as displayed on device 1 without corrective processing, while the lower left image A2 is an enlarged representation of the area of interest Iroi as perceived by the user U with his vision defect.
[0149] The upper right image A3 is an enlarged representation of the corrected area of interest Iroi as displayed on the device 1 with correction. The image features can be enhanced by increasing contrast and resolution, in particular by implementing a super-resolution algorithm. The lower right image is an enlarged representation of the corrected area of interest Iroi as perceived by the user U with their visual impairment.
[0150] It is clear from [Fig.2], by comparing images A2 and A4, that the perception of details by the user U is improved thanks to the invention.
[0151] The [Fig.3] is a schematic representation of steps of an example of a process according to the invention.
[0152] At step 10, images are continuously acquired by the camera 3 of the device 1.
[0153] The method may include an optional step 12 of calibrating the vision defect of user U. To do this, user U selects, for example, the image processing that best compensates for their vision defect from among several examples of image processing applied to one or more images displayed on the screen 2. The images displayed on the screen may be images acquired by the camera 3 during step 10.
[0154] The method includes in this example a step 14 of defining a reference image Iref and an area of interest Iroi. For example, the user U manually selects the area of interest Iroi by zooming in on an image displayed on screen 2, the displayed image then being taken as the reference image Iref.
[0155] In step 16, each acquired image is registered with respect to the reference image Iref, for example by maximizing the alignment of the acquired image with the area of interest (Loi) of the reference image Iref. The registered acquired image can be saved in the device's memory. Registering the acquired image thus stabilizes the image displayed on screen 2 in step 20.
[0156] In step 18, the acquired registered image is enlarged, for example by a digital zoom.
[0157] The enlarged image from step 18 can be processed to compensate for a user's vision defect U, chosen from presbyopia, hyperopia, and myopia, before being displayed. The image processing applied can, alternatively or simultaneously, increase the contrast and / or sharpness of the displayed image.
[0158] It is possible to embed information in the displayed processed image to help the user U perform a cosmetic treatment, for example, applying makeup. This information is presented, for example, in the form of a highlighted line 30, 32, 34 displayed on the image.
[0159] Fig. 4a illustrates various examples of eyebrow makeup designs 30 that may be displayed.
[0160] Fig. 4b illustrates different makeup designs for the upper eyelids 32.
[0161] Fig. 4c illustrates different makeup designs for the contours of the eyes 34.
[0162] Of course, the invention is not limited to the examples just described. The invention can be applied to the correction of other vision defects than those stated.
Claims
Demands
1. A device (1) for viewing a part of a user's (U) face comprising at least one screen (2) and a camera (3) for continuously acquiring images of the user's (U) face so as to allow the user to view images displayed by the screen when facing the camera (2), the acquired images including a region of interest (Iroi) of the user's (U) face, the device (1) being configured to generate, from the acquired images, enlarged stabilized images of the region of interest (Iroi) and display them on the screen (2), image processing being carried out prior to the display of the images, the images displayed on the screen (2) being processed so as to compensate at least partially for at least one vision defect of the user (U), in particular a defect chosen from presbyopia and hyperopia.
2. Device (1) according to the preceding claim, image processing increasing the resolution and / or contrast and / or sharpness of the displayed image.
3. Device (1) according to any one of the preceding claims, image processing comprising the application of a digital filter accentuating contours of the displayed image, or involving a model based on a machine learning method aimed at compensating for the user's vision defect (U), this model preferably comprising the implementation of a convolutional neural network.
4. Device (1) according to any one of the preceding claims, the device (1) comprising an interface (3), the image processing applied being selected by the user (U) via the interface (3) from among several types of pre-programmed image processing, or being generated automatically from a description by the user (U) of his vision defect.
5. Device (1) according to claim 4, interface (3) being configured to allow the user (U) to calibrate their vision defect, interface (3) comprising calibration means for adjusting the image processing to be applied.
6. Device (1) according to any one of the preceding claims, the device (1) comprising an interface (3) enabling the user (U) to manually define the area of interest (Iroi), in particular by selection from a drop-down menu displayed on the screen (2) or by selecting a sub-region of an image acquired and displayed on the screen (2).
7. Device (1) according to any one of the preceding claims, device (1) being configured to determine the area of interest (Iroi) automatically by image analysis.
8. Device (1) according to the preceding claim, wherein when an applicator (4) of a cosmetic product is detected in the vicinity of the user's face (U), the area of interest (Iroi) is defined as the region treated by the applicator (4).
9. Device (1) according to claim 7, wherein when a cosmetic product applicator (4) is detected near the user's face (U), the area of interest (Iroi) is determined from the type of applicator (4) and / or the type of cosmetic treatment normally performed via the applicator (4).
10. Device (1) according to any one of the preceding claims, the acquired images comprising at least one reference image (Iref), the device being configured to stabilize the displayed image by registration of the corresponding acquired image with respect to the reference image (Iref).
11. Device (1) according to the preceding claim, registration maximizing the pixel-by-pixel correspondence of the acquired image with the area of interest (Iroi) of the reference image (Iref), or registration being performed from at least one predetermined face marker.
12. Device (1) according to any one of the preceding claims, the displayed image comprising at least one piece of information informing the user about a treatment or care to be carried out, this information preferably comprising a highlighted trace (32,33,34).
13. Device (1) according to any one of the preceding claims, device (1) being configured to analyze an image of the user's made-up face (U) and generate information facilitating the subsequent reproduction of the makeup.
14. Device (1) according to any one of the preceding claims, the area of interest (Iroi) being a region of the user's eye (U).
15. Device according to any one of the preceding claims, the vision defect being chosen from presbyopia and hyperopia.
16. A method for viewing a part of a user's face (U) implemented by a device (1) comprising at least one screen (2) and a camera (3) for continuously acquiring images of the user's face (U), in particular a device (1) according to any one of the preceding claims, the method comprising: - the detection of a predefined area of interest (Iroi) of the user's face (U), - the display of a stabilized enlarged image of the area of interest (Iroi).
17. A cosmetic treatment method comprising: - displaying a stabilized enlarged image of an area of interest (lroi) by implementing the method according to claim 16, - applying a treatment or cosmetic product to the area of interest (Iroi) by the user (U) viewing the displayed image.
18. A method according to one of the two preceding claims, image processing being carried out prior to the display of the image, the displayed image being processed in such a way as to compensate for a defect in the user's vision (U).
19. Product computer program intended to be implemented by a device (1) comprising at least one screen (2), a processor, a memory and a camera (3) for continuously acquiring images of a user's face (U), in particular a device (1) according to any one of claims 1 to 15, the product computer program comprising code instructions which, when the program is executed by the processor, cause the processor to: - detect a predetermined area of interest (Iroi) on a reference image (Iref) acquired by the camera (3), - display on the screen (2) a stabilized enlarged image of the area of interest (Iroi), and preferably, - perform image processing prior to displaying the image so as to compensate for a vision defect of the user (U).