Method for capturing a high-quality image of a user's body area

Abstract

Method for capturing a qualitative image of a user's body area The present invention relates to a method for capturing a qualitative image of a user's body area, by an electronic capture device (16) intended to be manipulated by the user, the body area being the user's face or part of the face or the user's hair, the electronic capture device (16) comprising an image acquisition unit (18), a display (22) and a data processing unit (20), the method comprising the following steps: the acquisition, by the image acquisition unit (18), of an image of the user's body area, the processing, by the data processing unit (20), of the acquired image to determine parameters characterizing the acquired image, and the evaluation, by the data processing unit (20), of the quality of the acquired image by comparing the determined parameters to thresholds.Figure for the abridged version: 1.

Description

Title of the invention: Method for capturing a qualitative image of a user's body area

[0001] The present invention relates to a method for capturing a qualitative image of a user's body area. The invention also relates to an electronic device for capturing a qualitative image of a user's body area.

[0002] Given the wide diversity of users, it is often quite difficult to predict the impact of applying a product on a user. By impact, we mean a different color, allergic reactions, or less satisfactory results following the application of a product to a specific area of ​​the body. For example, in the field of dermatology, it is complex to predict the color and therefore the final result when a user applies lipstick, since the result is not always exactly the same depending on the user's skin type or skin tone. This same problem arises for other products, such as an under-eye serum or an anti-wrinkle cream, since these products can sometimes treat the skin differently depending on the user's skin type or skin tone.

[0003] In this context, it is also important to develop cosmetic product preparation processes with a better carbon footprint, capable of reducing the generation of carbon dioxide throughout the product's life.

[0004] Taking images of a user's body on which a cosmetic product has been applied allows for a better assessment of the impact of the cosmetic product.

[0005] However, image acquisition requires the user to consider a large number of parameters during image capture so that the image can be used later to make the correct diagnosis. This results in lengthy and complex image capture procedures that the user often finds difficult to follow correctly. Thus, the number of usable images is often much lower than the number of images received.

[0006] One object of the invention is therefore to propose a simple method to implement making it easier to capture a qualitative image of a body area of ​​a user.

[0007] To this end, the invention relates to a method for capturing a qualitative image of a user's body area, by means of an electronic capture device intended to be manipulated by the user, the body area being the user's face or a part of the face, or the user's hair, the electronic device of capture comprising an image acquisition unit, a display and a data processing unit, the method comprising the following steps: a. the positioning, by the user, of the electronic device so that the user's body area is within the field of vision of the electronic device's image acquisition unit, b. the acquisition, by the image acquisition unit, of an image of the user's body area, c. the processing, by the data processing unit, of the acquired image to determine parameters characterizing the acquired image, the processing including the determination of a three-dimensional mesh of the body area imaged on the acquired image, at least one parameter being determined as a function of the determined three-dimensional mesh, d. the evaluation, by the data processing unit, of the quality of the acquired image by comparing the parameters determined at thresholds, at the end of the comparison, the acquired image being considered as a qualitative image intended for capture or a non-qualitative image, and e. displaying the acquired image on the display with an indicator showing whether the acquired image is a quality image intended to be captured or a non-quality image.

[0008] This simplified procedure makes it possible to encourage users reluctant to use existing procedures to take image captures, and to reduce the number of unusable image captures for establishing a dermatological diagnosis.

[0009] According to other advantageous aspects of the invention, the method comprises one or more of the following features, taken individually or in all technically possible combinations:

[0010] - the method includes a step of capturing the acquired image when the image acquired is a qualitative image, preferably with the capture step being performed automatically;

[0011] - the acquisition, processing, evaluation, and display steps are repeated in continuous until a high-quality image is displayed;

[0012] - the or at least one parameter determined according to the three-dimensional mesh is chosen from the following parameters: the uniformity of lighting on the body area reproduced on the acquired image, the color of the light, the brightness, the distance from the face / head, the orientation of the face, the obstruction of part(s) of the face and the presence of facial expressions on the body area reproduced on the acquired image;

[0013] - at least one specific parameter is chosen from the following parameters: the resolution of the body area displayed on the acquired image, the proportion of blur on the acquired image, the presence of noise on the acquired image, parameters relating to the positioning of the body area restored on the acquired image, parameters relating to certain portions, such as the eyes, of the body area restored on the acquired image, and parameters relating to the presence of elements masking the body area restored on the acquired image;

[0014] - the acquisition step is triggered following a command transmitted to the device electronic capture by an electronic data capture system;

[0015] - the capture step includes the transmission of the qualitative image to a server and the storage of the qualitative image on the server, the process further comprising a step of transmitting the qualitative image from the server to the electronic data capture system;

[0016] - the or each qualitative image captured is intended to be used for analysis the effect of applying a cosmetic product on the user's body area.

[0017] The invention also relates to an electronic device for capturing a qualitative image of a user's body area, the electronic capture device being intended to be manipulated by the user, the body area being the user's face or part of the face or the user's hair, the electronic device comprising an image acquisition unit, a display and a data processing unit, the electronic capture device being configured to implement at least the acquisition, processing, evaluation, and display steps of a method as described above.

[0018] Following other advantageous aspects of the invention, the electronic capture device is a smartphone.

[0019] The invention will become clearer upon reading the following description, given solely by way of non-limiting example, and made with reference to the drawings in which:

[0020] [Fig-1] [Fig.1] is a schematic representation of an example of a device electronic capture of a qualitative image of a user's body area interacting with an electronic data capture system and a server; and

[0021] [Fig.2] [Fig.2] is a flowchart of an example of a method for capturing a qualitative image of a user's body area.

[0022] Figure [1] shows a set 10 comprising a server 12, an electronic data entry system 14 and an electronic device 16 for capturing a qualitative image of a user's body area.

[0023] Server 12 is suitable for backing up data from external devices.

[0024] Server 12 is, for example, a Google Cloud backup system suitable for managing services and data. Those skilled in the art will understand that other Virtual server providers, such as Microsoft Azure or Amazon Web Services (AWS), can also be used. Furthermore, those skilled in the art will understand that a local server can also be used instead of a virtual server and that this local server can be managed by a third party. For example, Server 12 can be leased to other companies for service and data management.

[0025] The electronic data entry system 14 is suitable for collecting clinical data in electronic form.

[0026] The electronic data entry system 14 is, for example, a computer application for collecting information in the form of a form.

[0027] Preferably, the electronic data capture (EDC) system 14 is used primarily in human clinical trials.

[0028] The electronic device 16 is capable of being handled by the user.

[0029] Preferably, the electronic device 16 is a portable device.

[0030] The electronic device 16 is, for example, a smartphone (in (English smartphone) capable of capturing an image of a user. Those skilled in the art will understand that the term "capture" is used to refer to taking and saving a high-quality image of a user's body area.

[0031] In the example illustrated by [Fig.1], the electronic device 16 comprises an image acquisition unit 18, a data processing unit 20, and a display 22.

[0032] The image acquisition unit 18 is capable of acquiring an image of the user's body area.

[0033] For example, the image acquisition unit 18 is a camera. Preferably, the camera has a resolution of at least seven megapixels to ensure that the image acquired of the user's body area has sufficient quality.

[0034] The data processing unit 20 interacts with a computer program product.

[0035] The data processing unit 20 comprises a processor 24 and a memory 26.

[0036] The computer program includes an information storage medium.

[0037] For example, the information support is a medium readable by the data processing unit 20. In another example, the readable information support is a medium suitable for storing electronic instructions and capable of being coupled to a bus of a computer system.

[0038] By way of example, the information medium is a USB key, a floppy disk or flexible disk (from the English name "Floppy disk"), an optical disc, a CD-ROM, a magneto-optical disc, a ROM memory, a RAM memory, an EPROM memory, an EEPROM memory, a magnetic card or an optical card.

[0039] The computer program containing the program instructions is stored on the information medium.

[0040] The computer program is loadable onto the data processing unit 20 and is adapted to drive the implementation of some of the steps of a method for capturing a qualitative image of a user's body area, when the computer program is implemented on the processing unit 20.

[0041] The display 22 is capable of displaying an image of a body area of ​​the user. The display 22 is, for example, the screen of a smartphone.

[0042] The operation of the electronic device 16 according to the invention will now be described with regard to [Fig.2] representing a flowchart of the method, according to the invention, of capturing a qualitative image of a body area of ​​a user.

[0043] The body area considered is the user's face or part of the face (for example, the eyes or lips), or the user's hair.

[0044] The method includes a step 100 of positioning, by the user, of the electronic device 16 so that a body area of ​​the user is in the field of vision of the image acquisition unit 18 of the electronic device 16.

[0045] When the electronic device 16 is a smartphone, the user positions the electronic device 16 so as to acquire a selfie or an image of part of their face or head. The acquisition can also be carried out by an operator.

[0046] The method includes a step 110 of acquiring, by the image acquisition unit 18, the image of the user's body area.

[0047] For example, the acquisition step 110 is triggered following a command transmitted to the electronic capture device 16 by the electronic data capture system 14.

[0048] Alternatively, acquisition step 110 is triggered following a command resulting from a user action.

[0049] The process includes a step 120 of processing, by the data processing unit 20, the acquired image to determine parameters characterizing the acquired image.

[0050] The processing includes determining a three-dimensional mesh of the body area imaged on the acquired image.

[0051] A three-dimensional mesh is, for example, a spatial discretization of the body area, that is, a transposition of an infinite number of points of the body area into a finite equivalent of points of the body area. In other words, a three-dimensional mesh is a geometric model of a domain by proportionate and well-defined elements.

[0052] The determination of the three-dimensional mesh includes, for example, the detection of the body area under consideration on the acquired image, followed by a meshing of the detected body area. Optionally, the position of the user's irises is also determined.

[0053] For example, mesh determination is carried out using Google Mediapipe tools. Other algorithms based on 3D morphable models can also be used.

[0054] At least one parameter is determined as a function of the determined three-dimensional mesh.

[0055] Preferably, the or at least one parameter determined according to the three-dimensional mesh is chosen from the following parameters: the uniformity of the lighting on the body area reproduced on the acquired image, the color of the light, the brightness, the distance from the face / head, the orientation of the face, the obstruction of part of the face, the presence of facial expressions on the body area reproduced on the acquired image.

[0056] Preferably, one or more other parameters are also determined. Such parameters are chosen from the following: - the resolution of the body area displayed on the acquired image. - the proportion of blur on the acquired image. - the presence of noise on the acquired image. - parameters relating to the positioning of the body area displayed on the acquired image. - parameters relating to certain portions, such as the eyes, of the body area reproduced on the acquired image. For example, in the case of the eyes, the parameters are the direction of gaze, the opening of the eyes, or the presence of glasses. - parameters relating to the presence of elements masking the body area rendered on the acquired image. Such elements are, for example, hair, accessories or makeup.

[0057] The process includes a step 130 of evaluating, by the data processing unit 20, the quality of the image acquired by comparing the parameters determined to thresholds.

[0058] Preferably, each determined parameter is compared to a threshold.

[0059] At the end of the comparison, the acquired image is considered to be a qualitative image intended to be captured or a non-qualitative image.

[0060] For example, the acquired image is considered to be a non-qualitative image when one or more of the following comparisons are verified: - the uniformity of lighting on the body area reproduced on the acquired image is less than a threshold. - the color of the light is not within a predetermined range of colors. - the brightness is below a brightness threshold. - the body area displays facial expressions (smile for example). - the resolution of the body area displayed on the acquired image is lower at a threshold. - the proportion of blur on the acquired image is greater than a threshold. - the presence of noise on the acquired image is greater than a threshold. - the body area is not positioned in the center of the image. - elements obscure the body area shown in the acquired image.

[0061] The method includes a step 140 of displaying the acquired image, on the display 22, with an indicator showing whether the acquired image is a qualitative image intended to be captured or a non-qualitative image.

[0062] The indicator is a visual indicator.

[0063] For example, the indicator is a green check mark on the acquired image. Alternatively, the indicator is a red check mark on the acquired image.

[0064] Preferably, acquisition step 110, processing step 120, evaluation step 130, and display step 140 are repeated continuously until a high-quality image is displayed. In other words, if the acquired image is not a high-quality image, the capture is not performed and the process returns to step 110. In some cases, the relative positioning of the body area with respect to the electronic device 16 is modified.

[0065] Preferably, the method includes a step 150 of capturing the acquired image when the acquired image is a qualitative image.

[0066] Preferably, capture step 150 is performed automatically. Alternatively, capture step 150 is performed upon receipt of a command from the user.

[0067] In a specific embodiment, the capture step 150 includes the transmission of the qualitative image to the server 12 and the storage of the qualitative image on the server 12. The method further includes a step of transmitting the qualitative image from the server 12 to the electronic data capture system 14.

[0068] Alternatively, the captured image is stored on a memory 26 of the electronic device 16.

[0069] For example, the qualitative image(s) captured can be used to analyze the effect of applying a cosmetic product to the user's body area. In this case, a cosmetic product has, for example, been previously applied to the user's body area.

[0070] As an example, the image of the user's body area can be used to establish a dermatological diagnosis.

[0071] Thus, the electronic device 16 is equivalent to a virtual assistant and helps the user capture a high-quality image. The advantage of such a virtual assistant is that it can reduce the time required to capture a high-quality image and capture only high-quality images. Image capture is also simplified.

[0072] The invention then makes it possible to propose a simple method to implement allowing to facilitate the capture of a qualitative image of a body area of ​​a user.

[0073] A person skilled in the art will understand that the embodiments and variants described above can be combined to form new embodiments provided that they are technically compatible.

Claims

Demands

1.

2.

3. Method for capturing a high-quality image of a body area of a user, by an electronic capture device (16) intended to be manipulated by the user, the body area being the face or part of the face of the user or the user's hair, the electronic capture device (16) comprising an image acquisition unit (18), a display (22) and a data processing unit (20), the method comprising the following steps: a. the positioning, by the user, of the electronic device e (16) so that the user's body area is within the field of vision of the image acquisition unit (18) of the electronic device (16), the acquisition, by the image acquisition unit (18), of an image of the user's body area, the processing, by the data processing unit (20), of 1 'image acquired to determine parameters characterizing the acquired image, the processing including the determination of a three-dimensional mesh of the body area imaged on the acquired image, at least one parameter being determined as a function of the determined three-dimensional mesh, the evaluation, by the data processing unit (20), of the image quality acquired by comparing parameters determined at thresholds; at the end of the comparison, the acquired image is considered to be either a qualitative image intended for capture or a non-qualitative image, and displaying the acquired image on the display (22) with an i indicator showing whether the acquired image is a high-quality image intended for capture or a non-high-quality image. A method according to claim 1, wherein the method comprises a step of capturing the acquired image when the acquired image is a qualitative image, preferably the capture step being carried out automatically. A method according to claim 1 or 2, wherein the steps acquisition, processing, evaluation, and display are repeated continuously until a qualitative image is displayed.

4. A method according to any one of claims 1 to 3, wherein one or more parameters determined according to the three-dimensional mesh are chosen from among the following parameters: the uniformity of lighting over the body area reproduced on the acquired image, the color of the light, the brightness, the distance from the face / head, the orientation of the face, the obstruction of part(s) of the face and the presence of facial expressions on the body area reproduced on the acquired image.

5. A method according to any one of claims 1 to 4, wherein at least one specified parameter is chosen from among the following parameters: the resolution of the body area restored on the acquired image, the proportion of blur on the acquired image, the presence of noise on the acquired image, parameters relating to the positioning of the body area restored on the acquired image, parameters relating to certain portions, such as the eyes, of the body area restored on the acquired image, and parameters relating to the presence of elements masking the body area restored on the acquired image.

6. A method according to any one of claims 1 to 5, wherein the acquisition step is triggered following a command transmitted to the electronic capture device (16) by an electronic data capture system (14).

7. A method according to claims 2 and 6, wherein the capture step includes the transmission of the qualitative image to a server (12) and the storage of the qualitative image on the server (12), the method further comprising a step of transmitting the qualitative image from the server (12) to the electronic data capture system (14).

8. A method according to any one of claims 1 to 7, wherein the qualitative image or each image captured is intended to be used to analyze the effect of the application of a cosmetic product on the user's body area.

9. An electronic device (16) for capturing a qualitative image of a user's body area, the electronic capture device (16) being intended to be manipulated by the user, the body area being the user's face or a part of the face or the user's hair, the electronic device (16) comprising an image acquisition unit (18), a display (22) and a data processing unit (20), the electronic device

10. (16) capture being configured to implement at least the acquisition, processing, evaluation, and display steps of a method according to any one of claims 1 to 8. Electronic capture device (16) according to claim 9, wherein the electronic capture device (16) is a smartphone.

Images