Cradle for creating a color cloud

Abstract

A bracket is provided for capturing video of an object such as hair. The video can then be used to extract and visualize color information associated with the material using a color cloud. The color cloud contains all colors present in one or more frames of the video. The bracket includes a video recording device capable of viewing the material through a window on the bracket. A smartphone can be used with the bracket to act as the video recording device and to provide illumination.

Description

[0001] Cross-reference to related applications

[0002] This application claims the benefit of U.S. Application No. 17 / 107,073, filed November 30, 2020, and French Application No. FR2101813, filed February 25, 2021, the entire contents of each of which are incorporated herein by reference. Background Technology

[0003] Spectrophotometers are used to read the color of hair samples, but they only provide a single digital representation of the material as a single RGB, L*a*b*, LCh, or HSV triplet, and typically only read areas smaller than 1 cm x 1 cm. Furthermore, when comparing two materials, analysis is limited to Euclidean distances (e.g., Δ-) in the color space between the two materials. Furthermore, the threshold for detection in hair color has not yet been determined. Additionally, a single color (e.g., RGB or L*a*b*) is the average color of the measured area, and the average color is not concrete but a mathematical concept. Theoretically, for example, one might take the average color of a hair region, and that color might not even exist in that hair region. Summary of the Invention

[0004] This disclosure relates to an apparatus for creating a color cloud, comprising: a cradle having: a first end; a second end having a window; and at least one wall connecting the first end and the second end; and a video recording device at the first end of the cradle, wherein the video recording device is configured to capture video of material visible through the window. In another aspect, this disclosure also relates to a system for creating a color cloud for an object, comprising: a cradle having: a first end; a second end having a window; and at least one wall connecting the first end and the second end; an image sensor attached to the first end of the cradle, wherein the image sensor is configured to capture multiple digital images of an object visible through the window; and processing circuitry operatively coupled to the image sensor and configured to: generate a 3D virtual representation of color information associated with the multiple digital images of the object; and, based on one or more inputs associated with the 3D virtual representation of the color information of the object, identify one or more salient features of the object, and generate one or more virtual instances of identifiers indicating the salient features of the object on a graphical user interface display.

[0005] In one embodiment, the video recording device is a camera on a mobile device.

[0006] In one embodiment, the device further includes a light source attached to at least one of the first end, the second end, and the at least one wall.

[0007] In one embodiment, the light source is a flash on a mobile device.

[0008] In one embodiment, the apparatus further includes processing circuitry connected to the video recording device and configured to create a color cloud from the video of the material.

[0009] In one embodiment, the device further includes a retainer attached to the first end of the bracket to hold the video recording device.

[0010] In one embodiment, the second end is colored with multiple colors adjacent to the window for color separation. Attached Figure Description

[0011] Figure 1 The video shows a user dragging a bracket across their hair to capture video and create a color cloud for their hair.

[0012] Figure 2 This demonstrates one method for creating and utilizing color clouds.

[0013] Figure 3 A first embodiment of the bracket is shown.

[0014] Figure 4 A second embodiment of the bracket is shown, wherein the bracket can be attached to a smartphone.

[0015] Figure 5A The image shows a user's hair used to capture video, where the video is captured across the length of the user's hair (starting from the roots and ending at the ends).

[0016] Figure 5B An example of a video with multiple frames arranged in chronological order is shown, in which the user captures a video of their hair, starting at the roots and ending at the tips.

[0017] Figure 6 An example of a single color cloud is shown, displaying all the colors from each frame of the video.

[0018] Figure 7 An example of a color cloud with color and frequency information is shown.

[0019] Figure 8Examples of four different color clouds are shown. These four different color clouds were created from samples and then superimposed in the L*a*b* color space (projected on the L* and b* dimensions) to visualize their similarities and differences.

[0020] Figure 9 The video directly shows the shared and unique colors among different hair types. Detailed Implementation

[0021] This disclosure describes a physical device and a unique algorithm that can quantify the optical reflectance of any material (such as hair samples and real hair on a human head) in a highly repeatable, portable manner and workable in any lighting environment. The device (which will be referred to as a bracket) can be used on the material (such as hair) and a color cloud algorithm is used to analyze the material to obtain a holistic digital representation of the material (defined herein as a color cloud). This color cloud can be compared with other reflective materials or other color clouds of the same reflective material at different points in time (e.g., colored hair before and after washing). Embodiments disclosed herein extract existing colors from video captures of the material (and do not manipulate them in any arithmetic way to produce a net result). This technique can use a robust color set as its basis for detecting minute color changes.

[0022] Figure 1 An example use case is illustrated. User 101 can pick up bracket 102 and drag it over their hair 103. As bracket 102 is dragged over the user's hair 103, the bracket can acquire a video of the hair 103. A color cloud algorithm can be used to analyze the video to generate a color cloud.

[0023] Figure 2 This is a flowchart illustrating one embodiment. In S202, a video of material (such as a user's hair) is obtained using a bracket. For example, to create a color cloud for a user's hair, the user can move the bracket along the entire length of their hair (i.e., from root to tip). In S204, a color cloud is created from one or more frames of the video. Essentially, all colors in these one or more frames are extracted and displayed in the color cloud. In S206, the color cloud is compared with other color clouds. This comparison can be used for color matching and / or color differentiation.

[0024] A bracket is a device that allows people to capture video of materials, thereby creating a color cloud of the material. Figure 3An example of a bracket is shown (solid lines indicate the exterior of the bracket, while dashed lines indicate the interior). The bracket has: a first end 301; a second end 302; a window 303 on the second end 302; and a wall 304 connecting the first end 301 and the second end 302. In one embodiment, the first end 301 and the second end 302 are at opposite ends of the bracket. An image sensor (such as a video recording device 305) can be attached to the first end 301 inside the bracket to capture video of any material 306 (e.g., hair) visible through the window 303. Additionally, the bracket may have processing circuitry 308 connected to the video recording device 305 and configured to: create a color cloud from the video of the material 306, compare the created color cloud with a previous color cloud, etc. The second end 302 of the bracket may be colored with a predetermined set of colors 309 adjacent to the window 303 for color separation when captured by the video recording device 305. The video can capture both material 306 passing through window 303 and a predetermined set of colors 309 adjacent to window 303; then, when determining the color of material 306, the predetermined (i.e., known) colors can be used as a reference. A lamp 307 can also be attached to the bracket to provide an adequately lit field of view from the video recording device 305 to window 303. The bracket can be used to maintain a consistent distance between the video recording device 305 and the material 306 when recording video. The bracket may also have a handle 310.

[0025] Processing circuitry 308 may include a color cloud unit and a salient feature unit. The color cloud unit may include circuitry coupled to an image sensor and configured to generate a 3D virtual representation of color information associated with multiple digital images of an object, such as regions indicating color frequency of occurrence, color variation, or color intensity distribution associated with the object. The salient feature unit may include circuitry configured to identify one or more salient features of the object based on one or more inputs associated with the 3D virtual representation of the object's color information, and to generate one or more virtual instances of identifiers indicating the salient features of the object on a graphical user interface display. In one embodiment, the object may be hair, and the 3D virtual representation may be hair color information and / or hair feature information associated with the multiple digital images of the hair. Additionally, the 3D virtual representation may include voxels with varying intensities to indicate the color frequency of a specific feature associated with the imaged object. Examples of feature information include: object identification data, object feature data, color frequency data, color variation data, color intensity data, presence or absence of color data, frame-by-frame or pixel-by-pixel color analysis information, etc. Non-limiting color information may include: hue, tint, tone, shade, etc. In one embodiment, the hue of the base color is a lighter form of that color, and the chroma is a darker form. In another embodiment, hue refers to the brightness (color) or darkness (chroma) of the base color. If the image object is hair, the 3D virtual representation may include hair feature information, which includes voxels indicating the following: gray hair coverage, gloss, radiance, and uniformity associated with the plurality of digital images of the hair. Examples of hair features may include: hair damage state, concentration of artificial colorants, color distribution, gray hair coverage, texture, gloss, distribution density, scalp features, etc.

[0026] Figure 3 The main body of the bracket is essentially a hollow right-angled prism with a window 303 at one end. In one embodiment, when the window 303 is covered, the only light inside the bracket body can come from the lamp 307. This allows for consistent lighting conditions within the bracket. Furthermore, in other embodiments, the bracket can have different shapes, such as cylinders, cubes, trapezoidal prisms, etc. The bracket can also have a screen that can be used to visualize color clouds.

[0027] In one embodiment, the first end of the bracket can be configured to use a camera from a mobile device (e.g., a smartphone) as a video recording device. Figure 4An example is shown where the first end 401 of the holder can be an attached smartphone 402. A camera 403 on the smartphone 402 can capture video of the material 404 through a window 405 on the second end 406. Additionally, processing circuitry already in the smartphone 402 can be used to create a color cloud. The color cloud and other relevant information can be visualized directly on the smartphone's screen. Furthermore, the smartphone's flash 407 can be used to provide a well-lit field of view from the smartphone's camera 403 to the window 405. The holder may also have a retainer 408 that allows the smartphone 402 to be properly attached to the holder when in use and detached from the holder when not in use.

[0028] The captured video can be material from which color clouds need to be generated. The bracket should be positioned such that the video recording device can capture video of the material through the opening in the bracket provided by the window. The window can be positioned directly against the material to prevent external light from entering the interior of the bracket. An example of material could be hair on a head. In this case, the bracket can start by capturing video from the roots of the hair and then be dragged across the hair to the ends.

[0029] In one embodiment, the video (which comprises multiple frames) can be at least six seconds long and at least 60 frames per second. If the video captures human hair or a hair sample, the hair can be straight or curly.

[0030] Videos used to obtain material can include videos capturing someone's hair. Figure 5A and Figure 5B An example is shown in the image. First, refer to... Figure 5A The video captures the entire length of the model's hair, starting from the root 51a and moving downwards towards the tip 52a. Figure 5B This shows each frame of the captured video laid out in chronological order (from...). Figure 5A ), where the top left frame 51b is the hair root 51a and the bottom right frame 52b is the hair tip 52a. In another embodiment, the video used to acquire the material may include video capturing a length less than the entire length of a person's hair (e.g., capturing only half of a person's hair). Note that video can be captured in other directions besides downwards, such as upwards or at an angle.

[0031] A color cloud algorithm can be used to create a color cloud from one or more frames of a video. The color cloud algorithm can extract color information from the one or more frames. The color cloud contains every color present in one or more of the frames. In another embodiment, the color cloud contains: every color present in one or more of the frames, and the frequency of each color present in one or more of the frames. In yet another embodiment, the color cloud contains: every color present in one or more of the frames, and the frequency of each color present in one or more of the frames, wherein the frequency exceeds a minimum predetermined threshold.

[0032] In one embodiment, a color cloud algorithm can generate a color cloud by extracting all colors from a single frame of a video. For example, in Figure 5B In this approach, a separate color cloud can be created for each frame. The color cloud created for each frame can include all the colors present in that single frame, and in another embodiment, it can include the frequency of each color present in that single frame.

[0033] In another embodiment, a color cloud algorithm can generate a color cloud by extracting cumulative colors from a set of frames in a video (rather than from a single frame). For example, refer again... Figure 5B A color cloud can be generated for each group of 10 frames, wherein the color cloud created for each group of 10 frames includes all colors present in the 10 frames of that particular group, and in another embodiment includes the frequency of each color present in the 10 frames of that group.

[0034] Figure 6 The image shows an example of a color cloud, where the color cloud uses a color space to display every color across all frames of the video. Because the video is time-based, selecting a specific frame allows for the creation of a color cloud at a specific point in time and / or a time range.

[0035] Once the color cloud algorithm has extracted all the colors from one or more frames of a video, the color cloud can be displayed in a variety of ways. For example, colors can be displayed in a color space; color spaces can use coordinates (such as L*a*b*, RGB, LCh, HSV, etc.) to convey color information.

[0036] In another embodiment, the color cloud may include the frequency (i.e., number of times) that each color is present in the one or more frames of the video. Figure 7An example is shown where a brighter pixel represents a higher frequency of color, and vice versa. An outer color cloud 71 (i.e., the complete color cloud) captures every color present in the one or more frames, while an inner color cloud 72 (i.e., the optimized color cloud) captures colors present at higher frequencies. The threshold used to determine whether a color exists at a higher frequency can be adjusted depending on the application. In one case, only the inner color cloud 72 is used, and low-frequency (i.e., low-information) colors are removed as noise.

[0037] In another embodiment, the color cloud can be used to identify hair features such as gray coverage, shine, brightness, evenness, glow, and so on. For example, color and frequency information from the color cloud can be used to filter “low-information” colors and enhance color detection to extract the amount of gray hair a person has. As another example, the shine level of hair can be calculated by looking at the mean, variance, and spatially connected cluster of L* values ​​in the hair's color cloud; high variability indicates a wide range of L* values ​​from dark to light, and high spatially connected L* values ​​indicate bands of shine, both of which, when combined, relate to a person's perception of shine.

[0038] Color clouds can be compared with other color clouds to identify similarities and differences. This enables color change detection and color matching. Figure 8 The example shown is a comparison with other color clouds. Color clouds are generated for two unwashed samples and the same two samples after cleaning. Overlapping color cloud portions indicate color similarity (i.e., colors present in both samples), while non-overlapping portions indicate color differences (i.e., colors not shared between samples). This technique quantifies the overlap and non-overlap of groups of colors in a color space (e.g., the number of groups, group similarity, average color of the groups).

[0039] In addition, the similarities and differences between hair colors can be visualized back on the video. Figure 9 An example is shown where color clouds were created for samples before and after washing. Darker areas on the hair indicate shared colors, while lighter areas indicate unique colors. Similarities and differences between these color clouds can be identified and visualized directly on the samples. In other words, a user can replay one of the videos used to capture the hair and display similarities / differences directly on the hair in the video. This is done by simply matching the color of a video pixel against a color contained in either of the two different color clouds or the overlap of the two different color clouds. For example, a video pixel color that matches either a color in the overlap or intersection of the color clouds will be colored darker in the visualized video.

[0040] In another embodiment, the atlas of hair samples may have a catalog of color clouds created for each hair sample. Any subsequent capture of hair can then generate a color cloud, which is compared to samples in the atlas to determine the closest match (i.e., the most similar in color). For good differentiation, a sample should be more similar to itself than to other samples.

[0041] The technologies described in this article can capture a wide range of reflective surfaces (e.g., from hair samples and hair heads) to accurately and robustly measure heterogeneous materials (such as color) and to accurately and robustly measure hair color changes. Applications of these technologies can include: measuring color changes more accurately and reproducibly than existing instruments (e.g., spectrophotometers); measuring the color of human hair (as a hair colorist would); measuring gray hair coverage (e.g., measuring the amount of gray hair in a person's hair roots to indicate how much hair coloring product to use); measuring hair health (e.g., based on shine levels, where too little shine can indicate dullness and hair damage); dynamic visualization of hair before and after coloring and / or washing, and more. The technologies described in this article can also allow for color assessment at home, in-store display and visualization, and product recommendations for at-home consumers. For example, consumers can download an app to their phones to capture video and create color clouds. The app can then further recommend hair products based on certain characteristics of the hair (e.g., specific hair color products can be recommended based on the user's hair color, gray hair level, and a survey performed on the app). In addition, the trays can be portable (e.g., foldable cardboard trays, 3D printed trays, etc.).

Claims

1. A system for creating a color cloud for hair, comprising: The bracket has: a first end; and a second end having a window; And at least one wall connecting the first end and the second end; An image sensor is attached to the first end of the bracket, wherein the image sensor is configured to capture multiple digital images of hair visible through the window; as well as Processing circuitry, operatively coupled to and configured to, Generate a three-dimensional virtual representation of color information associated with the plurality of digital images of the hair, wherein the three-dimensional virtual representation includes the frequency of color occurrence in the plurality of digital images; and Based on one or more inputs associated with a three-dimensional virtual representation of the hair's color information, one or more salient features of the hair are identified, and one or more virtual instances of identifiers indicating the salient features of the hair are generated on a graphical user interface display.

2. The system of claim 1, wherein the image sensor is a camera on a mobile device.

3. The system according to claim 1, further comprising: A light source, which is attached to at least one of the first end, the second end, and the at least one wall.

4. The system of claim 3, wherein the light source is a flash on a mobile device.

5. The system according to claim 1, further comprising: A retainer is attached to the first end of the bracket to hold the image sensor.

6. The system of claim 1, wherein the second end is colored with a variety of colors adjacent to the window for color separation.

7. The system of claim 1, wherein the plurality of digital images of the hair are contained in a video of the user's hair, and wherein the video includes a plurality of frames captured by the image sensor as the bracket moves over the user's hair.

8. The system according to claim 1, wherein, The color cloud represents each color present in multiple frames of the video.

9. The system according to claim 1, wherein, Colors present in multiple digital images with frequencies below a predetermined threshold are removed from the 3D virtual representation as noise.

Images