Processing equipment and methods

By using an optical diffuser and an imaging unit in a processing device, image processing for determining contact between the device and the skin is simplified, the complexity and cost issues of the prior art are resolved, and simple contact detection is achieved.

CN114828956BActive Publication Date: 2025-09-30KONINKLIJKE PHILIPS NV
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080088452.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-12-20
Filing Date
2020-12-16
Publication Date
2025-09-30
Estimated Expiration
2040-12-16

AI Technical Summary

Technical Problem

Existing processing devices require complex imaging processing technology to determine contact with the skin, and typically each accessory requires a dedicated skin contact sensor, increasing cost and complexity.

Method used

An optical diffuser and an imaging unit are used to diffuse or scatter light through the optical diffuser, and an image obtained by the imaging unit is used to determine whether the device is in contact with the skin, thereby simplifying image processing technology.

Benefits of technology

By simplifying image processing technology, it can effectively determine the contact between the device and the skin, reducing the need for dedicated skin contact sensors and reducing device cost and complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114828956B_ABST
    Figure CN114828956B_ABST
Patent Text Reader

Abstract

According to one aspect, a treatment device for performing a treatment operation on or for a subject is provided. The treatment device comprises: an optical diffuser disposed on the treatment device such that, when the treatment device is used to perform the treatment operation, an outer surface of the optical diffuser is in proximity to or in contact with the subject's skin; and an imaging unit for obtaining one or more images using light that passes through the optical diffuser and enters the treatment device. The treatment device is further configured to provide the one or more images to a processing unit to determine whether the treatment device is in contact with the skin.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a treatment device for performing a treatment operation on a subject and a method for determining whether a treatment device is in contact with the skin. Background Art

[0002] Many treatment devices will be used when a portion of the device is in contact with the subject's skin or appropriately close to the subject's skin. Examples include devices that use various techniques such as shaving, electrolysis, plucking, laser and light therapy (called photoepilation or intense pulsed light IPL) and injection treatment anti-androgens to remove unwanted hair. Treatment devices for reducing hair growth and treating acne also need to be in contact with the skin. Skin contact devices can also be used to provide massage to the subject, for providing physical therapy, for applying patches (such as electrocardiogram electrodes, etc.) to the subject, and for ultrasound measurements.

[0003] Light-based hair removal is a treatment used to inhibit hair growth by exposing the skin to bright flashes or pulses of light, which may be referred to as IPL (Intense Pulsed Light), where the light pulses are generated by a lamp or bulb. Alternatively, a laser or one or more light-emitting diodes (LEDs) can be used to generate the flashes or pulses. The light penetrates the skin and is absorbed in the hair root (among other places). The temperature of the hair root rises, and subsequently the temperature of the surrounding tissue. If the temperature rise is sufficient, hair growth is inhibited. This method is called photothermolysis. Contact with the skin is required for successful treatment and to prevent the light pulses from being directed into other parts of the body, such as the eyes, which could cause damage. Therefore, it is necessary to provide a method for determining whether the device is in contact with the skin.

[0004] Skin contact sensors measure parameters, such as capacitance and contact pressure, that indicate whether the treatment device is in contact with the skin. These sensors are integrated into the portion of the device that comes into contact with the skin. It is often desirable for this portion of the device to be removable and interchangeable with different attachments, each tailored to a different application or body part. Currently, skin contact sensors are required on all attachments.

[0005] EP 3 388 011 A1 discloses a light-based skin treatment device having a treatment light exit window through which, during operation, treatment light generated by a treatment light source is applied to the user's skin. The treatment light exit window is formed by a main surface of an optical waveguide. The device also includes an image sensor arranged to generate an image of the skin during operation. The image sensor is arranged to receive light that exits the waveguide via an imaging light exit surface of the waveguide. The imaging light exit surface is arranged so that the image sensor can receive imaging light generated by the imaging light source and guided by total internal reflection via the main surface. Furthermore, the imaging light exit surface is arranged so that ambient light entering the waveguide via the main surface cannot reach the image sensor via the imaging light exit surface without being internally reflected in the waveguide. When the skin is in contact with the main surface, the imaging light will exit the waveguide via the main surface at locations where the skin surface is in contact with the main surface, and will be internally reflected by the main surface at locations where the skin is not in contact with the main surface, such as at the locations of skin pores and wrinkles. As a result, the image sensor produces skin images that display skin structure, such as pores and wrinkles. When there's no skin in contact with the primary surface, all imaging light is internally reflected from the primary surface, resulting in a uniform image devoid of detail. Because ambient light entering the waveguide via the primary surface cannot directly reach the image sensor, the uniform image lacks any detail from the device's surroundings. Consequently, user privacy is protected. Summary of the Invention

[0006] Imaging units are increasingly being included in treatment devices to obtain images of areas of a subject to be treated and that have been treated. The use of an imaging unit embedded in a treatment device can provide potential benefits, such as guiding treatment via displacement measurements, and evaluating the effectiveness of treatment. In order to minimize the cost increase of the treatment device due to the addition of an imaging unit and associated processing circuitry, it is considered whether the imaging unit can be used to perform the functions of some existing sensors in the treatment device, so that these sensors can be omitted. In particular, it would be beneficial to use an imaging unit to detect contact with the skin, rather than requiring a dedicated skin contact sensor (particularly in the case where each individual accessory of the treatment device has its own skin contact sensor assembly). However, it has been found that relatively complex imaging processing techniques are required to process the obtained images to determine whether the treatment device is in contact with the skin, and this is undesirable in (generally) handheld devices. Therefore, the object of the present invention is to provide an improved treatment device, which includes an imaging unit and can be used to determine whether the treatment device is in contact with the skin with a reduced processing burden.

[0007] According to a first aspect, a treatment device for performing a treatment operation on or for a subject is provided, the treatment device comprising an optical diffuser arranged on the treatment device such that, when the treatment device is used to perform the treatment operation, an outer surface of the optical diffuser is proximate to the skin of the subject; and an imaging unit for obtaining one or more images using light that enters the treatment device through the optical diffuser; wherein the treatment device is further configured to provide the one or more images to the processing unit for determining whether the treatment device is in contact with the skin. Thus, the first aspect provides the ability to determine whether the treatment device is in contact with the skin using the imaging unit in the treatment device.

[0008] In these embodiments, the processing device further comprises an optical waveguide for enabling light to enter and exit the processing device.

[0009] In some embodiments, an outer surface of the light diffuser is in contact with the light waveguide. In alternative embodiments, an inner surface of the light diffuser is in contact with the light waveguide.

[0010] In some embodiments, the light guide and / or light diffuser has an anti-reflective coating to minimize light reflection from the light guide and / or light diffuser.

[0011] In some embodiments, the light diffuser is arranged to cover the light waveguide so that any light passing through the light waveguide also passes through the light diffuser.

[0012] In an alternative embodiment, the light diffuser is arranged to partially cover the light waveguide so that only some of the light passing through the light waveguide also passes through the light diffuser. In some embodiments, the light diffuser is arranged outside the light waveguide to form a boundary so that light passing through the central portion of the light waveguide does not pass through the light diffuser.

[0013] In some embodiments, the processing device further comprises a light source arranged within the processing device to generate light when the imaging unit obtains the one or more images.

[0014] In some embodiments, the processing device is configured to perform light-based processing. In some embodiments, the processing device further comprises a processing light source configured to generate light to perform the light-based processing.

[0015] According to a second aspect, a system is provided, comprising a processing device for performing a processing operation on or on a subject according to the first aspect or any embodiment thereof; and a processing unit configured to receive one or more images from the imaging unit and process the one or more images to determine whether the processing device is in contact with the skin.

[0016] In some embodiments, the processing unit is included in the processing device. In alternative embodiments, the processing unit is separate from the processing device.

[0017] According to a third aspect, a method for determining whether a treatment device is in contact with the skin is provided. The method comprises receiving one or more images of light that enters the treatment device through an optical diffuser of the treatment device, and processing the received one or more images using a processing unit to determine whether the treatment device is in contact with the skin.

[0018] In some embodiments, the processing step includes determining whether the device is in contact with the skin by comparing the one or more images obtained to one or both of the following: (i) a first reference image obtained when the skin is not in contact with the optical diffuser, and (ii) a second reference image obtained when the skin is in contact with the optical diffuser.

[0019] According to a fourth aspect, there is provided a computer program product comprising a computer-readable medium having computer-readable code embodied therein, the computer-readable code being configured such that, when executed by a suitable computer or processing unit, the computer or processing unit is caused to perform a method for determining whether a treatment device is in contact with the skin. The method comprises receiving one or more images of light entering the treatment device through an optical diffuser of the treatment device, and processing the received one or more images to determine whether the treatment device is in contact with the skin.

[0020] These and other aspects will be apparent from and elucidated with reference to one or more of these and the described embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Exemplary embodiments will now be described, by way of example only, with reference to the following drawings, in which:

[0022] Figure 1 is a diagram of an exemplary processing device;

[0023] Figure 2 Two exemplary embodiments of the present invention are shown;

[0024] Figure 3 is a block diagram of an exemplary system including a processing device and apparatus according to various embodiments;

[0025] Figure 4 shows an image obtained by an imaging unit according to the present invention;

[0026] Figure 5 is a flow chart illustrating an exemplary method for determining whether a treatment device is in contact with the skin. DETAILED DESCRIPTION

[0027] As described above, relatively complex imaging processing techniques may be required to process the image obtained by the imaging unit, which is arranged on the treatment device or arranged outside the treatment device (separately), to determine whether the treatment device is in contact with the skin. Therefore, the present disclosure provides an optical diffuser on the portion of the treatment device that is to contact the skin, and the imaging unit within the treatment device obtains an image of the light that has passed through the optical diffuser. The optical diffuser, also known as a light diffuser, diffuses or scatters the light passing therethrough and reduces or removes high-intensity bright spots. The light diffuser can be formed from a translucent material, such as frosted glass, holographic polycarbonate, or opal glass. Typically, the light diffuser will be used to strongly diffuse light from an object that is spatially separated from the light diffuser (such as skin), while less strongly diffusing light from an object that is in contact with the light diffuser. This means that when the object (such as skin) is spatially separated from the optical diffuser, the image of the object obtained by the imaging unit through the optical diffuser will be very blurry, or the object may not be visible at all. However, when an object is in contact with (or very close to) the light diffuser, the object can be clearly or more clearly distinguished in the acquired image. Comparing the acquired image with a reference image showing skin contact and / or a reference image showing no contact (with the skin or otherwise) can indicate whether the treatment device is in contact with the skin. Therefore, by providing a light diffuser on the treatment device so that the outer surface of the light diffuser is close to (near) or in contact with the subject's skin when the treatment device is used to perform a treatment operation, and providing an imaging unit within the treatment device that is capable of generating an image from light that has passed through the light diffuser into the treatment device, the image can be processed using relatively simple image processing techniques to determine whether the treatment device is in contact with the skin.

[0028] The processing of the image obtained by the imaging unit may be performed by the processing device (eg, by a processing unit in the processing device), or by a processing unit in a separate device.

[0029] Figure 1 is a diagram of an exemplary treatment device 2 that can be used to apply energy pulses (e.g., light pulses) to an area of ​​skin. It should be understood that Figure 1 The processing device 2 in FIG. 1 is merely an example of a processing device 2 with which the present invention may be used, and the processing device 2 is not limited to Figure 1or as an energy-based treatment device. In some embodiments, the treatment device 2 is held in one or both hands of a user during use. The treatment device 2 is used on the body of a subject (e.g., a human or animal) and performs some treatment operation on the subject's body when the treatment device 2 is in contact with the subject's skin. In some embodiments, the treatment device 2 performs some treatment operation on the subject's skin. Some exemplary treatment operations include, but are not limited to, removing unwanted hair by any of shaving, electrolysis, laser, and light therapy (known as photoepilation or intense pulsed light IPL); dermatological (skin) treatments, including hair growth reduction, treatment of acne, phototherapy treatment, skin rejuvenation, skin tightening, or port-wine stain treatment; and pain relief. Alternatively, the treatment device 2 can be used to perform an ultrasound scan on a body part.

[0030] As described herein, the processing device 2 is operated or used by a "user," and the processing device 2 is used on the body of a "subject." In some cases, the user and the subject are the same person, i.e., the processing device 2 is held in the hand and used by the user themselves (e.g., on the skin of their leg). In other cases, the user and the subject are different people, e.g., the processing device 2 is held in the hand and used by the user on another person.

[0031] The treatment device 2 includes a housing 4 including at least a handle portion 5 and a head portion 6. The handle portion 5 is shaped so that a user can hold the treatment device 2 in one hand. The head portion 6 is located at a head end 8 of the housing 4. When a treatment operation is to be performed on the body or skin of a subject, the head portion 6 is placed in contact with the subject's skin.

[0032] exist Figure 1 In the embodiment shown, the processing device 2 is configured to perform processing operations using energy or energy pulses (e.g. light or light pulses). Figure 1 , the head 6 includes an orifice 10 arranged in or on the housing 4 so that the orifice 10 can be placed adjacent to or on the skin of the subject (i.e., in contact with the skin of the subject). The treatment device 2 includes one or more energy sources 12 for generating energy pulses that are applied to the skin of the subject via the orifice 10 and achieve a treatment operation. The one or more energy sources 12 are arranged in the housing 4 so that energy pulses are provided from the one or more energy sources 12 through the orifice 10. The orifice 10 can be in the form of an opening at the head end 8 of the housing 4 and can include an optical waveguide 13 that is transparent or translucent to the energy pulses (i.e., the energy pulses can pass through the optical waveguide 13).

[0033] exist Figure 1In the exemplary embodiment shown, the aperture 10 and light guide 13 have a generally rectangular shape, which results in a generally rectangular skin treatment area on the skin. It should be understood that the aperture 10 and / or light guide 13 can have any other desired shape. For example, the aperture 10 and / or light guide 13 can be square, oval, circular, or any other polygonal shape.

[0034] exist Figure 1 In the embodiment shown, the light diffuser 14 is disposed in the aperture 10 and the imaging unit 16 is within the head 6. The light diffuser 14 may be disposed in contact with the light waveguide 13, and the light waveguide 13 may provide mechanical strength to the light diffuser 14. Figure 2 As described above, different arrangements of the light guide 13 and the light diffuser 14 are possible. In alternative embodiments, the light diffuser 14 and the light waveguide 13 are integrated with each other. Depending on the type of light diffuser 14 used in the processing device 2, one or both major surfaces of the light diffuser 14 may not be smooth. For example, the diffusing properties of the light diffuser 14 may be provided by a rough or textured surface.

[0035] As noted herein, images obtained by imaging unit 16 of light passing through light diffuser 14 into the treatment device can be used to determine whether the treatment device is in contact with the skin. It will be appreciated that light diffuser 14 can be of any shape and can fully or partially cover aperture 10.

[0036] In some embodiments, treatment device 2 may further include a light source associated with imaging unit 16 and configured to generate light when imaging unit 16 acquires an image. That is, when aperture 10 is in full contact with the skin, very little or no light may enter treatment device 2 through aperture 10, and imaging unit 16 may be unable to generate an image suitable for processing to determine whether treatment device 2 is in contact with the skin. Accordingly, a light source associated with imaging unit 16 may be configured to generate light that is emitted through aperture 10, light guide 13, and light diffuser 14 to illuminate an "imaging area" in front of aperture 10, where skin is expected to be when treatment device 2 is in use. Typically, the light source associated with imaging unit 16 is a different light source than light source 12 used to effectuate treatment operations.

[0037] exist Figure 1In the illustrated embodiment, the imaging unit 16 and the energy source 12 share the same aperture 10 and optical waveguide 13 (if present). That is, the imaging unit 16 generates an image from light entering the treatment device 2 through the aperture 10, and the energy source 12 emits energy out of the treatment device 2 through the aperture 10. However, in alternative embodiments, the treatment device 2 may be provided with a first aperture that can be used to detect contact with the skin (i.e., the imaging unit 16 can generate an image from light entering the treatment device 2 via the first aperture) and a second aperture (aperture 10) that can be used for treatment operations (i.e., energy from the energy source 12 exits the treatment device 2 through the second aperture). In these embodiments, the light diffuser 14 will be associated with the first aperture and may fully or partially cover the first aperture.

[0038] In embodiments where the imaging unit 16 and the energy source 12 share the same aperture 10 and light guide 13 (if present), or where the imaging unit 16 has associated light elements for illuminating the imaging area, the light guide 13 and / or the light diffuser 14 may have an anti-reflective coating to minimize reflection of energy (particularly light) from the light guide 13 and / or the light diffuser 14. The anti-reflective coating may help prevent energy emitted by the energy source 12 or other light source from being reflected by the light waveguide 13 and / or the light diffuser 14 back to the energy source 12 or other light source, thereby allowing the energy / light to pass through the light waveguide 13 and the light diffuser 14 and treat / irradiate the skin.

[0039] One or more energy sources 12 can generate any suitable type of energy for performing the treatment operation, such as light, sound, radio frequency (RF) signals, microwave radiation, and plasma. In the case of an energy source 12 that generates light, the energy source 12 can be configured to generate light pulses of any suitable or desired wavelength (or wavelength range) and / or intensity. For example, the energy source 12 can generate visible light, infrared (IR) light, and / or ultraviolet (UV) light. Each energy source 12 can include any suitable type of light source, such as one or more light-emitting diodes (LEDs), a flash lamp (e.g., a xenon flash lamp), one or more lasers, etc. In a preferred embodiment, the treatment device 2 is used to perform photoepilation, and the energy source 12 provides intense light pulses. For example, the energy source 12 can provide light pulses with a spectral content in the range of 560-1200 nanometers (nm) for a duration of approximately 2.5 milliseconds (ms), because these wavelengths heat the hair and the melanin in the hair root through absorption, which places the hair follicles in a quiescent state and prevents hair regrowth. In the case of an energy source 12 that generates sound, the energy source 12 may be configured to generate sound pulses at any suitable or desired wavelength (or range of wavelengths) and / or intensity. For example, the energy source 12 may be an ultrasonic transducer.

[0040] The one or more energy sources 12 are configured to provide energy pulses. That is, the energy source 12 is configured to generate energy at a high intensity for a short time (e.g., less than 1 second). The intensity of the energy pulse should be high enough to achieve a treatment operation on the skin or body part adjacent to the orifice 10.

[0041] Of course, despite Figure 1 The illustrated embodiment is a treatment device 2 for performing an operation using energy or energy pulses, but it should be understood that the head 6 can be configured to provide or perform other types of operations. For example, the treatment device 2 can be a shaver or hair trimmer, in which case the head 6 can include one or more cutting blades or sheets for cutting hair when the head 6 is in contact with the skin. As another example, the treatment device 2 can be an ultrasound probe for obtaining ultrasound images. In this example, the head 6 can include an ultrasound transducer for generating ultrasound waves and an ultrasound receiver for receiving ultrasound waves reflected from the body. In these alternative types of treatment devices, the treatment device 2 will be provided with an aperture at a location on the treatment device 2 that contacts the skin when the treatment device 2 is in place to perform a treatment operation. A light diffuser 14 is disposed in the aperture, and an imaging unit 16 generates an image from light that passes through the light diffuser 14 and enters the treatment device 2 where the imaging unit 16 is located.

[0042] The illustrated treatment device 2 further comprises a skin color sensor 18 located on or in the head 6 for determining the skin color of the skin with which the head 6 is in contact. The skin color sensor 18 measures a parameter indicative of the skin color and generates a measurement signal (referred to as a "skin color measurement signal") comprising a time series of measurements of the parameter. Typically, a skin color sensor is used in treatment devices 2, particularly in photo-epilatories, to ensure that light pulses have an intensity appropriate for the type of skin being treated, or even to prevent light pulses from being generated if the skin type is unsuitable for light pulses (e.g., darker skin with a much higher melanin content).

[0043] In some embodiments, skin color sensor 18 may be a light sensor, and the parameter measured by the light sensor may be the intensity or level of light reflected from the skin at a specific wavelength or wavelengths. The measured intensity or level of reflected light at the specific wavelength(s) may indicate skin color. The measured intensity or level of reflected light may be based on the concentration of melanin in the skin, and thus the measured intensity or level may indicate melanin concentration. Melanin concentration may be derived, for example, from measurements of light reflected at wavelengths of 660 nm (red) and 880 nm (infrared).

[0044] The illustrated treatment device 2 also includes a user control 20 that is operable by a user to activate the treatment device 2 so that the head 6 performs a desired treatment operation on the subject's body (e.g., generating energy pulses from one or more energy sources 12). The user control 20 may be in the form of a switch, button, touchpad, or the like.

[0045] Although not in Figure 1 As shown in the figure, the head 6 can be formed as a detachable attachment for use on a specific body part. The detachable attachment is also referred to as a detachable head in this document. A plurality of detachable attachments can be provided, each attachment having a respective shape and a respective aperture size, and the attachment can be selected for use on the treatment device 2 according to the body part to be treated. For example, different attachments can be provided for use on the face, for the armpits, for the bikini line, and for general use on the body (e.g., a larger body surface area). Each attachment has a corresponding aperture 10 and a light diffuser 14 in / on the aperture 10. However, the imaging unit 16 is part of the main body of the treatment device 2 and is not removed when the attachment is changed.

[0046] Figure 2 Two exemplary arrangements of the light guide 13 and the light diffuser 14 relative to each other in the processing device 2 are shown, Figure 2 (a) shows a first arrangement, Figure 2 (b) shows a second arrangement. Figure 2 (a) and Figure 2 (b) also shows two different configurations of the light diffuser 14 .

[0047] therefore, Figure 2 (a) and Figure 2 (b) shows a cross section through two exemplary treatment devices 2 in contact with skin 20, each treatment device comprising an aperture 10, an optical waveguide 13, an optical diffuser 14, an imaging unit 16, a light source 12 and an anti-reflective coating 22. The imaging unit 16 is located inside the treatment device 2 to generate an image from light that has passed through the aperture 10, the optical waveguide 13 and the optical diffuser 14. The light source 12 is used to generate light pulses for the treatment operation. The aperture 10 through which the light passes to reach the imaging unit 16 is the same aperture through which the light pulses pass to reach the treatment area. Figure 2 In (a), the light guide 13 and the light diffuser 14 are arranged so that when the treatment device 2 is in contact with the skin, the light guide 13 is between the skin and the light diffuser 14. Therefore, the outer surface of the light diffuser 14 (i.e., relative to the "outside" of the treatment device 2, so the outer surface of the light diffuser 14 is closer to the skin than the inner surface) is in contact with (the inner surface of) the light waveguide 13. Figure 2In (b), the light guide 13 and the light diffuser 14 are arranged so that when the treatment device 2 is in contact with the skin, the light diffuser 14 is located between the skin and the light guide 13. Therefore, the inner surface of the light diffuser 14 is in contact with (the outer surface of) the light guide 13. Figure 2 The benefit of the arrangement in (a) is that, since the surface of the light diffuser 14 can be roughened, it does not directly contact the skin, but rather the skin contacts the light waveguide 13, which typically has a smooth surface. This can make the arrangement in the aperture 10 less likely to attract and retain dust, oil, etc., and easier to clean. However, in order for the light diffuser 14 to provide the desired characteristics in the image obtained (i.e., the image is largely uniform until it comes into contact with an object (e.g., skin)), in (a) Figure 2 In the arrangement of (a), the optical waveguide 13 needs to be quite thin, for example, about 0.1 millimeters (mm).

[0048] exist Figure 2 In the embodiment shown in (a), the anti-reflection coating 22 is provided on the outer surface of the optical waveguide 13. Figure 2 In the embodiment shown in (b), the anti-reflective coating 22 is provided on the inner surface of the light guide 13. Those skilled in the art will appreciate that the anti-reflective coating 22 may alternatively be located on the light diffuser 14, or between the light guide 13 and the light diffuser 14.

[0049] The light diffuser 14 may fully or partially cover the light waveguide 13. For example, the light diffuser 14 may be arranged to cover the light waveguide 13 so that any light passing through the light waveguide 13 also passes through the light diffuser 14. Figure 2 (a) using this arrangement (although it should be understood that it is not limited to Figure 2 (a) and the light guide 13 / light diffuser 14 arrangement shown in FIG. Figure 2 (a) shows an example image 24 showing how much of the image will include light that has passed through the light diffuser 14. Alternatively, the light diffuser may be arranged to partially cover the light waveguide 13 so that only some of the light that passes through the light waveguide 13 also passes through the light diffuser 14. Figure 2 In the example of (b), the light diffuser 14 is arranged around the outside (edge) of the light waveguide 13 so that light passing through the central portion of the light waveguide 13 does not pass through the light diffuser 14. Therefore, the light diffuser 14 forms a boundary around the light waveguide 13. Figure 2 (b) using this arrangement (although it will be appreciated that it is not limited to Figure 2 (b) and the light guide 13 / light diffuser 14 arrangement shown in FIG. Figure 2(b) shows an example image 26 that illustrates how much of the image will include light that has passed through the optical diffuser 14. Specifically, the example image 26 includes a central portion 28 where the optical diffuser 14 is not present, and a border / edge portion 30 where the optical diffuser 14 is present. Embodiments in which the optical diffuser 14 only partially covers the aperture 10 provide the advantage that most of the treatment energy (e.g., light) emitted by the energy source(s) 12 can pass through the aperture 10 without being substantially inhibited by the optical diffuser 14. In these embodiments, image processing for determining whether the treatment device 2 is in contact with the skin can be limited to processing the portion of the image corresponding to the location of the optical diffuser 14 (e.g., the processing can be limited to the border / edge region 30 in the example image 26).

[0050] Figure 3 is a block diagram of an exemplary system 40 including a treatment device 2 and a device 42 for determining whether the treatment device is in contact with the skin. Figure 3 In the embodiments described herein, device 42 is a separate device from processing device 2, and thus device 42 may be in the form of an electronic device such as a smartphone, smartwatch, tablet computer, personal digital assistant (PDA), laptop computer, desktop computer, remote server, smart mirror, etc. In other embodiments, device 42, and in particular the functionality provided by device 42, is part of processing device 2. In other embodiments, the functionality of device 42 described below may be split between processing device 2 and a separate device 42.

[0051] Figure 3 Only the imaging unit 16 of the processing device 2 is shown, and it should be understood that in practice, the processing device 2 includes other components than those shown, such as (one or more) energy sources 12, a power supply, a control unit, etc. The imaging unit 16 is configured to generate one or more images (or video sequences) from the light that has passed through the light diffuser 14. The imaging unit 16 may include any suitable components for capturing images, such as a charge coupled device (CCD) and one or more lenses and / or mirrors. In some embodiments, the imaging unit 16 is a camera, such as a digital camera.

[0052] Device 42 includes a processing unit 46 that generally controls the operation of device 42 and enables device 42 to perform the methods and techniques described herein. Briefly, processing unit 46 receives one or more images from imaging unit 16 and processes the image(s) to determine whether the treatment device is in contact with the skin.

[0053] Thus, processing unit 46 can be configured to receive images from imaging unit 16, directly in embodiments where device 42 is part of processing device 2, or via another component in embodiments where processing device 2 is separate from device 42. In either case, processing unit 46 can include or comprise one or more input ports or lines for receiving images (or signals carrying information representing images) from imaging unit 16 or other appropriate components. Processing unit 46 can also include or comprise one or more output ports or lines for outputting a signal indicating whether the processing device is in contact with the skin.

[0054] The processing unit 46 can be implemented in a variety of ways using software and / or hardware to perform the various functions described herein. The processing unit 46 may include one or more microprocessors or digital signal processors (DSPs) that can be programmed using software or computer program code to perform the desired functions and / or control the components of the processing unit 46 to achieve the desired functions. The processing unit 46 can be implemented as a combination of dedicated hardware that performs certain functions (e.g., amplifiers, preamplifiers, analog-to-digital converters (ADCs) and / or digital-to-analog converters (DACs)) and processors that perform other functions (e.g., one or more programmed microprocessors, controllers, DSPs, and related circuits). Examples of components that may be employed in various embodiments of the present invention include, but are not limited to, conventional microprocessors, DSPs, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), hardware for implementing neural networks, and / or so-called artificial intelligence (AI) hardware accelerators (i.e., processors that can be used with a main processor or other hardware specifically designed for AI applications).

[0055] Processing unit 46 may include or be associated with a memory unit 48. Memory unit 48 may store data, information, and / or signals (including images) for use by processing unit 46 in controlling the operation of device 42 and / or in executing or performing the methods described herein. In some implementations, memory unit 48 stores computer-readable code executable by processing unit 46 to cause processing unit 46 to perform one or more functions, including the methods described herein. In certain embodiments, the program code may be in the form of an application for a smartphone, tablet, laptop, computer, or server. The memory unit 48 may include any type of non-transitory machine-readable medium, such as cache or system memory, including volatile and non-volatile computer memory, such as random access memory (RAM), static RAM (SRAM), dynamic RAM (DRAM), read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM), and electrically erasable PROM (EEPROM), and the memory unit may be implemented in the form of a memory chip, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD), or a Blu-ray disk), a hard disk, a tape storage solution, or a solid-state device (including a memory stick, a solid-state drive (SSD), a memory card, etc.).

[0056] exist Figure 3In the illustrated embodiment, since device 42 is shown as being separate from processing device 2 / imaging unit 16, device 42 also includes interface circuitry 50 to enable device 42 to receive images from imaging unit 16. Interface circuitry 50 in device 42 enables data connection and / or data exchange with other devices, including any one or more of imaging unit 16, processing device 2, servers, databases, user devices, and sensors. The connection to imaging unit 16 (or any electronic device, such as processing device 2) can be direct or indirect (e.g., via the Internet), and thus interface circuitry 50 can enable a connection between device 42 and a network via any desired wired or wireless communication protocol, or directly between device 42 and another device (such as imaging unit 16 and / or processing device 2). For example, interface circuitry 50 can operate using WiFi, Bluetooth, Zigbee, or any cellular communication protocol (including, but not limited to, Global System for Mobile Communications (GSM), Universal Mobile Telecommunications System (UMTS), Long Term Evolution (LTE), Advanced LTE, etc.). In the case of a wireless connection, the interface circuit 50 (and therefore the device 42) may include one or more suitable antennas for transmitting / receiving over a transmission medium (e.g., air). Alternatively, in the case of a wireless connection, the interface circuit 50 may include a device (e.g., a connector or plug) that enables the interface circuit 50 to be connected to one or more suitable antennas external to the device 42 for transmitting / receiving over a transmission medium (e.g., air). The interface circuit 50 is connected to the processing unit 46.

[0057] Despite Figure 3 Not shown, but device 42 may include one or more user interface components, including one or more components that enable a user of device 42 to input information, data, and / or commands into device 42 and / or enable device 42 to output information or data to a user of device 42. The user interface may include any suitable input means, including but not limited to a keyboard, a keypad, one or more buttons, switches, or dials, a mouse, a track pad, a touch screen, a stylus, a camera, a microphone, etc., and the user interface may include any suitable output means, including but not limited to a display unit or screen, one or more lights or light elements, one or more speakers, a vibration element, etc.

[0058] It should be understood that a practical implementation of the device 42 may include Figure 3 Additional components are shown. For example, device 42 may also include a power source, such as a battery, or components for enabling device 42 to be connected to a mains power source.

[0059] As described above, the technology described herein is intended to provide a method for determining whether a treatment device 2 is in contact with the skin. In particular, it has been found that images obtained using light passing through an optical diffuser 14 can be more easily processed to determine whether the treatment device 2 is in contact with the skin than images obtained without the use of an optical diffuser.

[0060] Figure 4 The images shown were taken using an embodiment of the present invention. Figure 4 In (a), the treatment device is close to but not in contact with the skin (especially the fingers), whereas Figure 4 In (b), the treatment device is in contact with the skin (particularly a finger). The light diffuser 14 is used to diffuse or scatter the light so that the image is relatively uniform when the treatment device is not in contact with the skin. When the treatment device is in contact with the skin, the image shows clearer features representing skin details. Figure 4 Two images are shown that are easily distinguishable. Analyzing the clarity and / or contrast of the images enables determination of contact, and in some embodiments, the degree of contact, between the treatment device and the skin.

[0061] Figure 5 The flowchart in FIG. 1 illustrates an exemplary method for determining whether a processing device 2 is in contact with skin according to the techniques described herein. One or more steps of the method may be suitably performed by processing unit 46 in device 42 in conjunction with any of memory unit 48 and interface circuitry 50 of device 42 and / or imaging unit 16. Processing unit 46 may perform one or more steps in response to executing computer program code that may be stored on a computer-readable medium (e.g., memory unit 48). In step 101, one or more images of a first skin area are received. When the images are generated by imaging unit 16, the images may be received directly from imaging unit 16, e.g., in real time or near real time. Alternatively, the images may be received from imaging unit 16 in a separate processing device 2 via interface circuitry 50. Alternatively, the images may have been pre-generated by imaging unit 16 and stored, for example, in memory unit 48, a memory unit associated with processing device 2 or imaging unit 16, or in a remote database, in which case step 101 may include processing unit 46 obtaining or retrieving the images from a storage location (e.g., from memory unit 48, etc.).

[0062] In step 103, one or more images are processed to determine whether the processing device 2 is in contact with the skin.

[0063] In some embodiments of step 103, processing unit 46 may process the image with the goal of identifying one or more skin features in the image, such as hair, pores, moles, scars, etc. In some embodiments, if processing unit 46 cannot identify any skin features in the image, processing unit 46 may determine that processing device 2 is not in contact with the skin. In these embodiments, if processing unit 46 can identify any skin features in the image, processing unit 46 may determine that processing device 2 is in contact with the skin.

[0064] In some embodiments, as part of step 103, one or more images may be compared to one or both of a first reference image previously acquired when the skin was not in contact with the optical diffuser 14 and a second reference image previously acquired when the skin was in contact with the optical diffuser 14. Due to the presence of the optical diffuser 14, images acquired when the treatment device is not in contact with the skin are significantly more uniform than when the treatment device is in contact with the skin. In particular, when the treatment device is not in contact with the skin, features of the skin will be blurred in the image, and contrast in the image will be low. When contact exists between the skin and the treatment device 2, the clarity and / or contrast of the image is increased (or high), and skin and skin features (e.g., hair, pores, moles, scars, etc.) in the image may be visible or detectable (e.g., sharp and unblurred) despite the presence of the optical diffuser 14. In some embodiments, an image processing algorithm may determine and compare the clarity and / or contrast of the acquired image with the clarity and / or contrast of the reference image to determine whether the treatment device is in contact with the skin. Image clarity relates to the sharpness of the edges of visible features in the image. Contrast is the relative difference between light and dark areas of an image.

[0065] In some embodiments of step 103, a trained machine learning model (MLM) is used to process one or more images to determine whether the treatment device is in contact with the skin. The MLM can be any suitable type of MLM, such as a classical machine learning model, for example, using feature extraction such as a support vector machine, decision tree, random forest, or the like, or an artificial neural network, such as a deep neural network, which has multiple layers between an input layer and an output layer and identifies linear or nonlinear relationships between the input and output layers. The MLM evaluates each image to classify whether the treatment device is in contact with the skin. In some embodiments, the MLM directly receives the image and performs all necessary analysis and processing of the image to determine whether contact exists between the treatment device and the skin or to determine the extent of contact. This is particularly true for an MLM that is an artificial neural network, such as a deep neural network. In other embodiments, such as when a classical MLM is used, the image can be processed before being provided to the MLM, for example, to determine the values ​​of one or more features associated with the image, and these values ​​can be provided to the MLM for analysis (optionally in addition to the image) to determine whether the treatment device is in contact with the skin.

[0066] Then, despite Figure 5 Not shown, but a signal may be output indicating whether the treatment device is in contact with the skin. In some embodiments, the indication may be simply "in contact" or "no contact." In other or additional embodiments, the indication may include additional information regarding the degree of contact between the treatment device 2 and the skin.

[0067] The signal can be provided to a user interface component of the device 42 or the processing device 2, and the signal is configured to cause the user interface component to indicate whether the processing device is in contact with the skin. For example, if it is determined that the processing device is not in contact with the skin, the signal can cause a red light on the processing device 2 to be illuminated. Similarly, if it is determined that the processing device is in contact with the skin, the signal can cause a green light on the processing device 2 to be illuminated. The user of the processing device 2 will be able to use these indications to determine whether to trigger a light pulse at the current position of the processing device 2. As another example, in the case where the device 42 is in the form of a smartphone or a similar type of device, feedback on whether the processing device is in contact with the skin can be provided to the user or subject via an app (software application) executed on the device 42. Those skilled in the art will appreciate that other ways of providing feedback to the user on whether the processing device is in contact with the skin can include, for example, the use of a display screen, a speaker, tactile feedback, etc.

[0068] Alternatively (or additionally), if conditions are appropriate (e.g., the treatment device 2 is in contact with the skin, the tone of the skin in contact with the treatment device 2 is suitable for receiving the light pulse, etc.), the treatment device 2 can automatically trigger the light pulse, a signal can be provided to the control unit of the treatment device 2, and the control unit can use the signal as part of deciding whether to use the energy pulse to treat the skin area currently adjacent to the orifice 10.

[0069] Step 103 may include processing one or more images to determine the degree of contact between the treatment device and the skin. The degree of contact may be represented as a score, such as a high score indicating good / complete contact and a low score indicating poor / no contact. In some embodiments, the determined degree of contact may be compared to a threshold. In some embodiments, if the determined degree exceeds the threshold, it may be determined that the treatment device has sufficient contact for the treatment to be performed, and vice versa.

[0070] Thus, there is provided an improved treatment device comprising an imaging unit which can be used to determine whether the treatment device is in contact with the skin.

[0071] Variations of the disclosed embodiments may be understood and implemented by those skilled in the art in practicing the principles and techniques described herein, by studying the drawings, the disclosure and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may perform the functions of several items recited in the claims. The fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. The computer program may be stored or distributed on a suitable medium, such as an optical storage medium or solid-state medium provided with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems. Any reference signs in the claims should not be construed as limiting the scope.

Claims

1. A treatment device (2) for performing a treatment operation on or on a subject, wherein the treatment device is configured to provide one or more images (24, 26) to a processing unit (46) for determining whether the treatment device is in contact with the skin based on the clarity and / or contrast of the one or more images, It is characterized in that The processing device further includes: a light diffuser (14) disposed on the treatment device such that an outer surface of the light diffuser is in proximity to or in contact with the subject's skin when the treatment device is used to perform the treatment operation; and An imaging unit (16) for obtaining the one or more images (24, 26) using light entering from the skin through the light diffuser into the treatment device.

2. The processing device (2) according to claim 1, wherein the processing device further comprises an optical waveguide (13) for enabling light to enter and leave the processing device.

3. The processing device (2) according to claim 2, wherein the outer surface of the light diffuser (14) is in contact with the optical waveguide (13).

4. The processing device (2) according to claim 2, wherein an inner surface of the light diffuser (14) is in contact with the optical waveguide (13).

5. The processing device (2) according to any one of claims 2 to 4, wherein the optical waveguide (13) and / or the optical diffuser (14) has an anti-reflection coating (22) to minimize light reflections from the optical waveguide and / or the optical diffuser.

6. The processing device (2) according to any one of claims 2 to 4, wherein the light diffuser (14) is arranged to cover the light waveguide (13) so that any light passing through the light waveguide also passes through the light diffuser.

7. The processing device (2) according to any one of claims 2 to 4, wherein the light diffuser (14) is arranged to partially cover the light waveguide (13) so that only a part of the light passing through the light waveguide also passes through the light diffuser.

8. The processing device (2) according to claim 7, wherein the light diffuser (14) is arranged along at least a first edge (30) of the optical waveguide (13) so that light passing through a central portion (28) of the optical waveguide does not pass through the light diffuser.

9. The processing device (2) according to any one of claims 1 to 4 and 8, wherein the processing device further comprises a light source arranged within the processing device to generate light when the imaging unit (16) obtains the one or more images (24, 26).

10. The processing device (2) according to any one of claims 1 to 4 and 8, wherein the processing device is adapted to perform light-based processing.

11. The processing device (2) according to claim 10, wherein the processing device further comprises a processing light source (12) for generating light to perform the light-based processing.

12. A system comprising: The treatment device (2) according to any one of claims 1 to 11, for performing a treatment operation on or on a subject; as well as A processing unit (46) is configured to receive one or more images (24, 26) from the imaging unit (16) and process the one or more images to determine whether the treatment device is in contact with the skin based on the clarity and / or contrast of the one or more images.

13. A method for determining whether a treatment device (2) is in contact with the skin, the method comprising: receiving one or more images (24, 26) of light entering the treatment device from the skin through a light diffuser (14) of the treatment device; as well as The one or more received images are processed using a processing unit (46) to determine whether the treatment device is in contact with the skin based on the clarity and / or contrast of the one or more images.

14. A method according to claim 13, wherein the processing includes determining whether the processing device (2) is in contact with the skin by comparing the one or more images (24, 26) obtained with one or both of the following items: (i) a first reference image obtained when the skin is not in contact with the light diffuser (14), and (ii) a second reference image obtained when the skin is in contact with the light diffuser.

15. A computer program product comprising a computer-readable medium having computer-readable code embodied therein, the computer-readable code being configured such that, when executed by a suitable computer or processing unit (46), the computer or processing unit is caused to perform the method according to any one of claims 13 to 14.

Citation Information

Patent Citations

  • Aesthetic treatment device and method

    CN104721968A

  • Skin treatment system

    CN107072552A