System for displaying a light projected image, method for generating a light image and projecting the light image onto an object, method of processing a digital image

Abstract

A digital image is divided into N groups of pixels based on their pixel attributes. Based on this, N projected images are generated. Each projected image displays the light intensity of one group of pixels under basic white light, and the light intensities of the other pixels under different light intensities. The pixel attribute used for division is preferably grayscale value, and the remaining pixels are preferably also projected under basic white light.

Description

Technical Field

[0001] The present invention relates to a system for displaying light-projected images, the system comprising means for inputting an image and means for providing image information to a light-projection device for applying an image to an object using different coloring methods to display a light image on the object.

[0002] The present invention also relates to a method for generating an optical image and projecting the optical image onto an object. Background Technology

[0003] French patent FR 2683769 describes a method for projecting an image onto a carpet. Fine details are applied with an airbrush, while the rest is colored.

[0004] GB 1366724 demonstrates a method and system for converting a color image into a line drawing, wherein the color areas in the line drawing are specified by numbers. The line drawing can be transferred onto a transparent material and projected onto a wall or other surface.

[0005] GB2127753 demonstrates the use of slides to project such line drawings onto a background. The line drawing consists of large and small areas surrounded and separated by lines. Each large and small area is assigned a visible number. A set of different colors of pigment are presented in the image, and the pigments are assigned corresponding numbers. The actual image is created by drawing all the numbered large and small areas using pigment options that match the indicated corresponding numbers.

[0006] Commercial services now offer programs for converting photos into line drawings, where colors are indicated by numbers.

[0007] Known systems and methods have several drawbacks. Drawings are often complex and detailed, and the commonly used black lines required to separate areas can interfere with the image, especially with lighter colors. Furthermore, it is difficult to use paint to create overlays to ensure they are no longer visible in the final result. The disadvantage of projecting a set of numbered lines is that the lines in the projection are very thin and difficult to see without a clearly focused light projection setting. Additionally, the size of the area that the lines can enclose is limited because closely spaced and complex-shaped areas are too small to be easily distinguished when filling in paint.

[0008] Direct projection of a color image avoids the drawbacks of lines, but has other disadvantages: if the color of the light resembles the color to be painted, it is often difficult to correctly distinguish different colors, and it is often difficult to tell whether something has already been painted. Furthermore, if the painted area contains empty spots or streaks, they cancel each other out; the red pigment in the projected red area is virtually indistinguishable from the unpainted red area compared to the painted portion. The eye perceives a chaotic environment and is optically confused, constantly trying to distinguish whether it is observing the color of light or the color of the applied pigment.

[0009] A general drawback of existing systems and methods is that the painter's freedom to choose creative colors is limited by strict instructions on the required colors to ensure that the image will have exactly the same colors, or the number of colors to be used cannot be chosen by the painter but is predetermined.

[0010] Therefore, a new system and method are needed that can prevent or at least reduce the identified drawbacks. Summary of the Invention

[0011] Therefore, the system according to the invention is characterized in that it includes means for dividing an input image or a screenshot thereof or an edited version of the input image or a screenshot thereof into three or more sub-regions based on pixel attributes and image information, each sub-region having a specific range of pixel attributes, and the image information including information for displaying a set of three or more projected images, wherein the pixel attribute groups of the projected images are preferably divided based on grayscale ranges and for each set of pixel attributes, one of the three or more sub-regions is displayed with substantially colorless light having a first light intensity, and the remaining portion of the image or the remaining portion of a screenshot of the image is displayed with light having a second light intensity different from the first light intensity, wherein the sub-regions collectively at least substantially cover the image or the screenshot of the image.

[0012] For the purposes of this invention, the light projection device can be, for example, a projector that projects a light image from a distance onto an object during use, or, for example, a digitally controlled VDU or lightbox on which a user can place at least partially transparent objects.

[0013] For the purposes of this invention, in a preferred embodiment, the object may be a canvas, and as a further example, it may be a piece of paper, and in embodiments where the projector is used at a distance from the object to be painted according to the projection, it may be a wall, door, fence, or other object such as a car roof, advertising sign, or the side of a truck.

[0014] Unlike existing systems and methods that provide all information in a single image, the image information in the system and method according to the invention is divided into a series of projected images, and the system according to the invention establishes three or more sub-regions within the input image or within a screenshot of the input image, with pixels within a range of pixel attributes specific to each sub-region, preferably a specific grayscale range. The image information provided to the projector includes information for displaying a set of three or more projected images. Each projected image in the set displays one of the three or more sub-regions using substantially colorless light of a first light intensity.

[0015] In each of the projected images in this set, the remainder of the image or the remainder of a screenshot of the image is indicated by light of a second intensity different from the first light intensity. The projected images collectively at least substantially cover the image or a screenshot of the image. The use of light-colored areas to be drawn and dark-colored areas not to be drawn can also be implemented in reverse, such that the drawing instructions are actually used to fill in the unlit areas in each projection step.

[0016] Before dividing the image into three or more regions, you can edit the input image first, for example by applying automatic contrast adjustment, changing the brightness, changing the contrast, changing the shape of the screenshot, processing the photo or screenshot with Photoshop, inserting part of another photo, etc.

[0017] Preferably, the light in the rest of the image or screenshot is substantially colorless.

[0018] In this embodiment, the remainder of the image or a screenshot of the image may be represented using colored light.

[0019] In an embodiment, information about the sub-region may include the shading method to be used and / or the technical steps to be performed for the sub-region in question, and this may be given for each color in each individual step to be drawn. The sub-region to be drawn is progressively projected with colorless white light, while parts that do not need to be drawn using the shading method in question or are technically unsuitable are also represented by colorless white light. Differences in light intensity indicate what should be drawn or painted.

[0020] Unlike known prior art techniques that project a single image using all information, in the system and method according to the invention, three or more projected images are projected individually in a sequential manner. Relevant portions of the accompanying drawings, along with the information required for the projected images and discussed steps in the embodiments, are presented to the user for each step in order to realistically depict the shape.

[0021] The projected image does not display dividing lines, thus avoiding interference from multiple different dividing lines in the search for color projection areas in the light image. Where dividing lines exist, it is unclear which color should be used to draw two or three adjacent areas between the dividing lines when searching for further directions of the area to be drawn. This invention avoids this problem. For each projected image indicating one or more color areas to be drawn using colorless light, the rest of the image is displayed with different light intensities, for example, making it at least substantially dark, preferably completely dark. During the relevant application steps, the user does not receive any confusing information about a part of the image or screenshot that does not require any operation, thus greatly reducing any possible confusion.

[0022] Preferably, the portion of the image to be drawn is represented by white light, while the remaining portion not drawn is not illuminated. In an embodiment, a small amount of light may be projected onto the undrawn portion relative to the amount of light projected onto the portion to be drawn. In an embodiment, if white light of a certain intensity is used to project the portion to be drawn or painted, the remaining portion of the image or screenshot may be projected at a lower intensity, for example, ten or fifty times lower. Typically, there is sufficient ambient light to keep the undrawn portion visible, but if the ambient light is very low, such as in a dark room, it may be useful to project some light onto the undrawn portion.

[0023] In this method, and when using the system according to the invention, the user is not overwhelmed by excessive color information about all other colors that still need to be drawn. Each projected image in the set of projected images provides only information about the colors to be applied in each step in the area to be distinguished by light or by light, and for each step, the user can focus on the colors to be specifically applied to the object for a particular part of the image or screenshot.

[0024] Unlike existing methods and systems, no drawing instructions need to be provided to the material to be used, because in a preferred embodiment of the system according to the invention, they are essentially all incorporated into the information expressed by light, thus requiring no preparation, and changing the choice of the image to be drawn remains easy. The use of the material according to the invention, particularly the object to be drawn, preferably a canvas, can also be a standard material used for conventional painted images. When using a single projected image with all the information in a known projection system, sometimes parts that must be drawn in a certain color are forgotten, or color codes are misused.

[0025] When using such a system for projection, it is also pre-determined that the entire image should be visible on the object to be drawn, to ensure that the numbering indicators of the color areas are always visible and not omitted in the display.

[0026] This prevents or greatly reduces the painter's freedom to choose, for example, to present a larger or smaller version or to present only a portion of the image on the object. This invention prevents this because each color of the bright area to be applied as light is visible and there is no color indication in that area. This frees the user from having to figure out what they should do and allows them the freedom to decide what size and which part of the image to apply to the object.

[0027] To ensure the success of this process on known systems, the selection of pigments is predetermined and fixed. This invention grants the person performing the coating a degree of freedom in determining the colors, and as long as the contrast value of the selected colors increases or decreases in each projection step, a realistic and recognizable representation of the subject to be painted will be achieved.

[0028] Another advantage is that the color can be fully applied and the result is immediately visible, whereas in known systems and methods, the color number is also erased during the coloring process, so the instruction is no longer visible.

[0029] Those performing the method according to the invention can easily see which parts of the highlighted area have been colored and which parts still need to be colored. The bright and substantially colorless light makes it easy to see whether the areas distinguished by light have been drawn or painted, and how well the drawing or painting is done; any missing lines, stripes, or portions are immediately visible against the background color or undrawn objects. It is also quick and easy to see whether the drawing or painting has correctly filled the area to be drawn or painted.

[0030] When drawing according to the present invention, the painter enjoys a certain degree of creative freedom regarding the colors to be used, partly because the system provides a system where depth and shape are paramount and does not necessarily assume that the colors of the image to be drawn will be consistent with the colors of the original image.

[0031] Another advantage of the invention is that the system and method for drawing according to the invention can be used by both colorblind and non-colorblind people, especially if the system provides color suggestions. Colors are applied sequentially, so even colorblind people can see if it is correct. Colorblind people can read little or no information from color projections, and also little information from images drawn in numbers; they color in numbers, but often there are too many numbers, and the colors of the numbers are usually represented by images as well. One in twelve men suffers from some form of colorblindness.

[0032] In a preferred embodiment, the number of projected images in a set is less than or equal to 12, preferably less than or equal to 8. In another preferred embodiment, the number of projected images is 4, 5, 6, or 7. Insufficient projected images result in relatively shallow drawing or painting depth, while too many projected images lead to excessive operations.

[0033] The system is preferably configured such that the projected images are displayed in an order of increasing or decreasing grayscale values. Painters can work from light to dark, that is, first draw or paint the part of the image with the lowest grayscale value, then draw the part with the second lowest grayscale value, and so on, or they can work from dark to light.

[0034] The system preferably includes means that enable a user to take a screenshot from an input image, then analyze the screenshot and project it via a projection image. This allows for drawing, for example, using a portion of a larger photograph (e.g., a face).

[0035] The device for taking screenshots is preferably designed to allow the user to select the location, size, and / or shape of the screenshot. The user can then select which part of the face, for example, to use. The system may include means for analyzing the input image and providing the screenshot. The system may, for example, use facial recognition to find the outline of a face in the image, and based on that outline, find screenshots of potential interest and display them in a presentation of the image. The user can then adjust the shape or size according to their preferences.

[0036] In one embodiment, the device includes output features for displaying one or more color schemes to be used along with the projected image when a color region of the projected image is applied to or near an object. This enables a variety of functions, including using projected light to highlight colors to be used on a color palette, or indicating colors to be used in each processing step via light. The features can be displayed below, above, or beside the object. Additionally, or as shown, the projected image information can be sent to a user via other channels (e.g., through an application or website) simultaneously with the projected image information, which the user can open, receive, and display on a portable image display device (e.g., a tablet computer, a smartphone). Alternatively, the light projection device can also consist of a tablet computer on which the projected image can be displayed and placed below a partially translucent object to draw the light image to be projected.

[0037] Displaying features of one or more color devices for applying color areas together with a projected image to facilitate system use. The features of the color device can be one or more of the following: color, name, number, manufacturer, or a mixing ratio of one or more colors. Specifying which colors are needed to display the desired color mixing information, and the required mixing ratio, is particularly important if the object is redrawn to faithfully reproduce the original colors.

[0038] Preferably, as a minimum requirement, the color is associated with information such as name, number, and / or manufacturer. The color is displayed, preferably near the edge of the image, allowing the user to quickly check if the correct colorimeter is being used. In embodiments, the device includes a moving mechanism that allows the user to move the color display on the projected image. This allows the user to place the color indicator where needed. It allows the user to place the color indicator in the most convenient location, such as on a palette in front of the object, to highlight the color to be used on the palette. The instructions provided by the system of the present invention may also include instructions regarding mixing and / or blending two or more colors to be used, as well as instructions on the dosage of the color to be used on the palette.

[0039] For the purposes of this invention, the term "color" refers to, but is not limited to, acrylic paint, oil paint, water-based paint, ink, felt-tip pencil, colored pencil, crayon, colored crayon, and / or spray paint. It can be oil-based pigment, synthetic pigment, or water-based pigment. In embodiments, the coloring device may also be a clear varnish layer or a coloring device with a limited color density.

[0040] In a preferred embodiment, the device further includes input features for inputting projected images from an existing set of photographs.

[0041] Users can use cherished photographs to create paintings, such as depicting the face of a relative. In one embodiment, the user can also choose to copy an image from a photo collection.

[0042] In a preferred embodiment, for an image to be painted, there may be two or more sets of sub-regions to be painted. The system is configured such that after displaying a first set of projected images to apply a first layer of paint, one or more additional sets of projected images are displayed to apply one or more layers of paint on top of the first layer. These layers of paint are preferably not very transparent or only partially cover the earlier layers. This allows the image to be applied to multiple glaze layers. This embodiment does not require a second or continuous partially transparent layer applied to the entire image, and such limitation can be applied to one or more portions of the image.

[0043] The number of projected images in each layer can vary. In an embodiment, the number of projected images in the first layer (lower layer) is less than the number of projected images in the second layer (upper layer). For example, the first layer has 3 or 4 projected images, while the second layer has 5, 6, or 7 projected images.

[0044] In this invention, the application of coloring methods is not limited to brushes or pens, but can also include palette knives, hands or fingers, stamps, air brushes or sponges.

[0045] In a preferred embodiment, the image information includes information on a greater number of projected images of the selected image, wherein each projected image indicates the portion of the projected image to be applied by means of at least substantially colorless light and indicates the specific portion of the projected image to be applied within the image to be applied by making the remainder of the image to be applied colorless, the remainder of the image to be applied not containing any information about the specific projected image to be applied for each projected image, wherein the associated projected images at least substantially cover the image, and each projected image contains information about a specific grayscale range that does not overlap or at least hardly overlaps with each other, and the number of projected images is equal to or greater than 3.

[0046] In this preferred embodiment, a greater number of projected images are displayed.

[0047] The system according to one of these preferred embodiments allows users to construct the image to be applied in layers, which greatly increases the possibility of recreating an image that is faithful to the original image or artistically expressive according to the user's judgment. Existing systems or methods cannot achieve this.

[0048] Similarly, for the second and other layers, the number of projected images can preferably be between 4 and 12, and most preferably 4, 5, 6 or 7.

[0049] For the second and additional layers, transparent or partially transparent varnish layers can be linked to one or more projected images.

[0050] In a preferred embodiment, the device includes an output for displaying characteristics for following instructions based on a projected image to mix two or more coloring methods and mixing instructions on an object to blend colors on the projected image. In this embodiment of the invention, the light-projected image can be used to indicate to the user which colors (e.g., adjacent colors that are still wet and usable) can or must be partially mixed together. This must be done in areas, specifically in those areas marked with no color light, and definitely not in areas without photons. The method according to the invention can also be used, for example, to add other elements to the subject to be drawn, such as text, decorative elements, or other elements not present in the original image.

[0051] For both lay and trained artists, the transition from one color to another adjacent color is difficult to determine and even more difficult to apply. This is because, in this case, there is no abrupt separation of one color from another, but rather instructions indicating areas where a certain color mixing of the two colors is necessary or useful for achieving better results in matching already applied colors. In a preferred embodiment, the system uses projected images to indicate transitions to adjacent colors that can be merged by using shading techniques or by mixing editable colors within these projected image areas. This enables a more realistic similarity and a more professional look. Existing systems or methods cannot provide such detailed painting instructions.

[0052] In this embodiment, the device analyzes the subject to be drawn based on the input image. It is difficult for a user to determine the transition from one color region to another adjacent color region, especially if the subject in the image is drawn with a color different from the true color of the original image. The system calculates and determines the contrast of grayscale values ​​and identifies the regions where the transition to the next color region occurs, optimally balanced with the light intensity values ​​of the colors to be applied, and within which the contrast values ​​converge. In this embodiment, the system analyzes the grayscale values ​​for the contrast sub-regions and allows the user a certain tolerance in selecting the color set to be used, provided that the colors in the selected set have sufficient contrast in grayscale distances from each other according to the system. This prevents the user from being constrained by predetermined color combinations, instead providing the user with space to make their own creative choices. A key feature of this invention is that, unlike many examples of prior art including digital drawing applications, it allows for a degree of freedom in color selection, where colors are predetermined and cannot be adjusted within a specific range.

[0053] In digital painting embodiments, changing colors can compromise the fidelity of the original reproduction and negatively impact the final result when assessing whether the painted subject is faithful to the original. Existing techniques, such as digital painting, also do not provide for backgrounds or other areas omitted from the image.

[0054] In an embodiment of the invention, the apparatus includes a providing function for providing a color image to a converter to convert the color image into grayscale values ​​and into a plurality of projected images, wherein a grayscale range is assigned to each of the plurality of projected images and the grayscale ranges together constitute a substantially uninterrupted grayscale range from bright to dark.

[0055] Projected images can be provided directly to the system; for example, a set of projected images of paintings from a standard subject database photo set, such as those used to paint "The Night Watchman" or "Sunflowers." In this case, the system's input can be used directly without any further conversion, as it is already prepared and stored in the system's database.

[0056] Preferred embodiments enable the provision of images in grayscale values. For example, this allows old black-and-white photographs to be converted into projected images and used to create color paintings or drawings.

[0057] There are several methods to convert a grayscale image into a projected image, in which a set of pixels with grayscale values ​​in the projected image is converted into certain grayscale ranges in a subregion.

[0058] Grayscale values ​​can be represented numerically, with the most commonly used scales ranging from 0 to 256. The first possible segmentation of a pixel is to divide this scale into equal parts. A second possible distribution is that the grayscale range gradually decreases towards the middle of the scale compared to the lowest and highest grayscale values.

[0059] The third possible segmentation method is as follows:

[0060] A grayscale histogram is created from the grayscale values ​​of the image pixels. The image can be the entire image, a screenshot, or an edited version of the image. Next, when a total of M pixels use n grayscale ranges, the M / n pixels with the lowest grayscale values ​​are displayed in the first projected image, the M / n pixels with the highest grayscale values ​​are displayed in the last projected image, and each other projected image consists of M / n pixels.

[0061] In the latter type of segmentation, the segmentation depends on the grayscale content of the input image, therefore the grayscale image must be analyzed before segmentation. Part of the invention provides a system in which grayscale segmentation is performed within a portion of a subject outlined by the user in the image, and grayscale values ​​outside the outlined area are not converted to values ​​higher or lower than those within the outlined area. This step according to the invention prevents one or more projected images from displaying light projection areas entirely outside the subject, thereby reducing the number of colors required for the subject itself.

[0062] In embodiments where the user specifies a set of colors or a set of coloring methods, the subject can be divided into grayscale ranges, each grayscale range covering the area surrounding the specified color grayscale value.

[0063] In embodiments that use black and white photographs to create color paintings or color drawings, the system is preferably equipped with an input function that allows the user to input the desired colors for one or more projected images after they have been displayed, and enables the device to select and display features of the coloring device that match the input colors.

[0064] In embodiments of creating color paintings or drawings using black and white photographs, the system is preferably equipped with a shape analyzer that analyzes the shapes in the black and white photograph and uses the device to display the features of the coloring apparatus that match the analyzed shapes.

[0065] Many shapes are known and recognizable, such as trees, bushes, sky, clouds, faces, hands, clothes, hats, and the ground. Based on the shape and its average grayscale value, the best-matching color can be estimated. In a preferred embodiment, the system simultaneously includes an input function that allows the user to input colors and a shape analyzer. The colors entered by the user for certain parts of a black and white photograph can provide information to the system, which can then be utilized by the shape analyzer, which is part of this invention.

[0066] In one embodiment, the device includes another supply function for supplying a color image to another converter, which converts the color image into a grayscale image.

[0067] Color images can be converted into grayscale images.

[0068] Several methods exist for this conversion. A summary of methods for converting color images to grayscale images (color-to-grayscale conversion) can be found in M. Cadik's "Perceptual Evaluation of Color-to-Grayscale Image Conversions," published in *Pacific Graphics 2008*, Volume 27, Issue 7 (2008), and other publications. Another example can be found in "Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Videos," co-authored by Kaleigh Smith, Pierre-Edouard Landes, Joelle Thollot, and Karol Myszkowski, published in *European Graphics 2008*, Volume 27, Issue 2 (2008).

[0069] Converting a color image to grayscale, then to grayscale tones, and finally to a projected image, along with displaying the color features, allows laypeople or novice artists to realistically paint color images on objects such as canvases or paper. This is because a painting is typically composed of different colors that blend together, making them indistinguishable or impossible to separate with lines defining specific color areas. A recognizable, realistic copy is not necessarily the result of reproducing the original image with the same colors; specifically, it is the result of using color for each color area to be reproduced, with the color contrast or contrast value producing a contrast that is essentially the same as the original.

[0070] In an embodiment, the color used for drawing or painting a sub-region of each projected image is determined by the system according to the invention, or provided to the user as a possible color combination, or input by the user into the system.

[0071] In a preferred embodiment, the system includes a measuring device for measuring the properties of the pigment, wherein the measuring device includes a camera.

[0072] The pigment properties to be measured can be color values ​​and / or grayscale values.

[0073] The measuring device can be used for a variety of purposes.

[0074] A. The system may recommend one or more pigments, or a mixture of pigments. When selecting pigments, users may make mistakes, such as choosing the wrong pigment to paint with, or choosing the correct pigment but planning to apply it in the wrong order. Measuring the properties of the pigment to be used in the measuring device before painting allows for checking whether the pigment to be used is the intended one. This is especially important if the user is colorblind, or if the ambient light is dim or colored, making it difficult or impossible for the user to use color alone as a reference to check if the correct color will be used. Measuring attributes, color, and / or grayscale values ​​can prevent errors. If the system displays a mixed color, the measurement can provide a clear answer as to whether the mixed mixture has the expected color and / or grayscale value. If the color is incorrect, the system can instruct the user to mix more of one or more components. If the color is correct, but the pigment is too light or too dark, the system can suggest that the user add white or black to lighten or darken the pigment. After correcting the mixture, new measurements can be taken to determine whether the color and / or grayscale value of the pigment used is acceptable.

[0075] B. If the user selects one or more specific pigments for use, the measurement system can measure both the grayscale value and the color value of the pigment to be used. Based on the grayscale value measured for the user's selected pigment, the system can establish one or more sub-regions. These sub-regions are also determined by the grayscale values ​​of the selected pigments. If the grayscale value of the selected pigment is not ideal, the system can also suggest that the user adjust the color or grayscale value of one or more of the selected pigments, for example, by mixing in white or black pigment. For example, in a series of five selected pigments, two pigments have essentially the same initial grayscale value, while the grayscale values ​​of the other pigments are significantly different. It may then be beneficial to adjust the grayscale value of at least one of the selected pigments by making the pigment lighter or darker.

[0076] In a preferred embodiment, the measuring device is equipped with a lamp that emits substantially white light. This allows all the pigments to be measured to be illuminated in the same known manner during measurement.

[0077] In a preferred embodiment, the system provides users with a degree of freedom, allowing them to creatively choose color combinations, but the selected color combinations must undergo a similar gradation to the original artwork. Skilled painters can choose the correct colors to create a faithful comparison with the original in a realistic color reproduction, but mixing pigments to create the correct colors is difficult. Embodiments of the invention take into account the possible available colors and perform digital analysis of color regions. Colors and pigments are made and determined by the available pigments. Besides using (CMYK and RGB) color systems and printing techniques with high color fidelity, many painters use pigments, even the three primary colors, whose wet appearance differs significantly from their dried color. Often, artists can be identified by the colors they choose to faithfully reproduce the subject matter; these specific artists repeatedly use these colors as a hallmark of their work. In this sense, the system according to the invention provides space for identifiable creative choices that can be adopted as a personally recognizable style.

[0078] An embodiment of the invention includes an input system for a user to input some projected images. In this embodiment, the user can input the projected images themselves.

[0079] In one embodiment, the system includes an analyzer and a comparator. The analyzer analyzes the input color and / or grayscale image, and the comparator compares the analysis results with a database containing pigment data. It also prepares and displays one or more pigment sample sets for use with the user and previews the achievable results. In these embodiments, the system evaluates the projected image to determine which color best matches the average color contrast. For example, it selects a coloring method whose grayscale contrast and color point best match the average grayscale value and average color point of the projected image by calculating the average color value of the projected image and searching a database of pigments or coloring methods. The result of this comparison determines a sample color set. The system can generate multiple different sample sets. For example, a user can indicate a preference for certain colors or color combinations. The system can then generate multiple color sample sets, compare them with the specified preference, and present them to the user in descending order of match to the specified preference, so that the set of color combinations can be used as a palette for painting or coloring.

[0080] The projected image of an image includes the portion of the original image whose gray values ​​lie between the lower and upper gray values ​​specified in the projected image.

[0081] In an embodiment of the invention, the system includes a light projection device.

[0082] In an embodiment of the invention, the device includes a website or application capable of using digital services to provide a set of projected images for a subject based on a specified and / or input image.

[0083] The website or application preferably includes an input function and an output function, the input function being used to enable a user to send an image so as to present a projected image made from the sent image, and the output function being used to send the projected image to the user's light projection device, preferably together with the specification of features of available coloring methods, to link the use of the website or application to control the light projection device so as to display the projected image on or under the canvas or drawing paper.

[0084] Preferably, if the light projection device is located below the canvas or drawing paper, the canvas or drawing paper to be drawn on is slightly translucent, so that it can visually follow the projected image.

[0085] Preferably, when displaying a projected image, the device includes an input function that allows the user to specify the desired technique or style, and the device also includes an output function for displaying instructions or suggestions based on the specified desired technique. This allows the user to practice a particular application method or technique. For example, the instructions for the desired technique or style could be instructions for the materials to be used, such as a paintbrush, brush size, type of brush, knife, airbrush, hand, or instructions for Impressionism, Expressionism, Realism, Hyperrealism, etc.

[0086] The present invention also embodies a method for applying a selected image as a color image to an object, the method having a set of projected images corresponding to certain grayscale ranges of the selected image, projected in descending or ascending order of grayscale values, and applying color to each projected image of the illuminated portion using a color scheme selected or displayed for the projected images.

[0087] In a preferred embodiment, the object is a canvas, and a background texture layer and / or background color are applied to the canvas before the projected image is displayed. The canvas is not colored in the brightest or darkest parts of the projected image. Preprocessing the background may be necessary to achieve a certain effect or technique, in conjunction with color application techniques or the materials used.

[0088] In this embodiment, the background to be drawn is not a surface to be drawn in the projected image, so empty spaces are left in order to retain the background color in these areas, or the artist may decide whether to use a background with color or some kind of texture.

[0089] In the method of the present invention, the display order of the projected images is generally preferably from light to dark or from dark to light, which is better for certain depiction effects.

[0090] The present invention also relates to a method for processing digital images, in which the digital image is converted into a digital grayscale image, the digital grayscale image is divided into three or more sub-regions according to pixel grayscale values, each sub-region having a specific grayscale range, and a set of digital images comprising three or more sub-regions is generated from the digital grayscale image, wherein each digital image includes one of the three or more sub-regions, the pixels of the sub-region are assigned pixel values ​​corresponding to a first light intensity that displays almost colorless light, while the remainder of the digital image is assigned pixel values ​​corresponding to a second light intensity different from the first light intensity, and these common sub-regions at least substantially cover the entire digital image.

[0091] In summary, this invention provides a painting technique that, through the use of a light projection system, can create images on a canvas that are virtually identical to the original artwork. In this system, color regions compared by a computer are converted into grayscale ranges. The object is then illuminated with essentially white light using light projection technology, projecting the grayscale ranges onto the object. The user then applies a color of their choice or a color indicated by the system to each projected image. This invention also provides a method for editing digital images and generating a set of digital images, which, according to this invention, can be used for projection in painting mode.

[0092] The present invention also relates to a computer program containing instructions for implementing the method of the present invention. A computer program according to the present invention may include instructions for implementing one or more different embodiments of the method according to the present invention.

[0093] The present invention also relates to computer code, including instructions for performing the methods of the present invention. Computer code according to the present invention may include instructions for performing one or more different embodiments of the methods according to the present invention.

[0094] The present invention also relates to a set of projected images produced according to the method of the present invention. Attached Figure Description

[0095] These and other aspects of the invention will now be described, and illustrated with reference to the accompanying drawings:

[0096] The diagrams included in the figure are as follows:

[0097] Figure 1 This image is shown from a digital publication that uses an online color separation system called PBNify.

[0098] Figure 2 This diagram illustrates color separation based on the PBNify system, where Figure 1 The original image was segmented into a limited number of colors.

[0099] Figure 3 Show Figure 2 A diagram showing color segmentation, where each color is outlined with lines and numbers can be labeled on each line.

[0100] Figure 4 and Figure 5A , Figure 5B and Figure 5C A schematic diagram of the system of the present invention is shown.

[0101] Figure 6 and Figure 7 A flowchart of an embodiment of the present invention is provided.

[0102] Figures 8 to 16Embodiments of the present invention are shown.

[0103] Figures 17 to 25 Another embodiment of the invention is shown.

[0104] Figures 26 to 58 Further aspects of embodiments of the present invention are shown. Detailed Implementation

[0105] Figures 1 to 3 Existing technologies were showcased.

[0106] Figure 1 The image shown is from a digital publication that introduces an online color separation system called PBNify.

[0107] Figure 2 This diagram illustrates color segmentation based on the PBNify system, where if Figure 1 If the original image has been segmented into a finite number of colors, then the image has been digitally segmented into color regions with equal color values.

[0108] Figure 3 Show Figure 2 The diagram illustrates the color division, with each color outlined by lines. Numbers can be placed within each outlined area to indicate whether the selected finite color value applies to the area within the lines.

[0109] Therefore, areas of the same color are marked with the same number.

[0110] If according to Figure 3 When a painting is projected onto a canvas, all colored areas are displayed simultaneously, making it difficult to determine if the colors used during the painting process were correct. Painting the same color in a light projection is particularly tricky if only a color image is projected, as similar colors cancel each other out, making it difficult to discern whether color has been applied to a particular area, or if one is only seeing the color of the light. This means that finding results in such a system can be difficult, and the search is also ineffective because the completed work cannot be observed.

[0111] Figure 4 A light projection apparatus for projecting light using a projector, according to the present invention, is shown. Figure 4 Computer 41 is shown, which receives digital images. Digital images can be input in various ways, such as via email, mobile phone, social media, cloud services, etc. The input digital images are then edited and converted into a set of three or more optically projected images. These projected images are projected by projector 42. Figure 4One of the projected images 46 is shown on canvas 43. A mobile device can also be used instead of a computer. Further information can be projected along with the projected image. The system can be equipped with a camera 45. This allows the system to monitor ongoing operations and project any instructions as needed. The system can also include a website, accessible via a smartphone or other portable device (as shown by device 44 in the upper right corner of the figure), where photos are sent and edited. Device 44 can also be used to control the projector 42, such as switching to the next projected image. This set of projected images may be sent from the website to the projector 42 via the portable device 44. The website itself can also include a set of projected images, and the website can send information about the combination of projected images from a database to the user so that the user can select a set of projected images from the combination.

[0112] The website can also include a set of projected images that users have previously used or selected, which can be added to the database and shared with other users. This allows users to create a painting based on photos of deceased loved ones, resulting in increasingly realistic artwork. For example, color choices deemed unsatisfactory in the second version, or the number of projected images selected in the first version, can be corrected or improved in the next version. Furthermore, several different sets of projected images of the same image can be layered on top of each other in multi-layered, partially transparent glazes.

[0113] The principle of "practice makes perfect" also applies to the painting system and method of this invention; therefore, it is best to preserve used projection sets for further refinement or improvement in preferred embodiments of the system. Information 47 can be projected below or beside the projected image along with it. The computer has input functionality for inputting digital images, for example, via wireless connection using antenna 58, but can also be directly connected via a landline telephone or a USB port with a camera.

[0114] Figure 5A , Figure 5B and Figure 5C An embodiment of the light projection device according to the present invention is shown, which performs light projection via a digitally controlled visual display device 51 on which a partially translucent object 43, such as a canvas or transparent paper, can be placed. Other functions of the relevant parts in Figure 5 are also shown. Figure 4 The description is consistent with that in the text. Figure 5B A tool for the system of the present invention is shown. The tool includes a stand 52 for a portable visual display device housing a device 51, and a cover 53 with a transparent portion, which is placed on the stand 52 during operation. A cavity 55 is provided between the cover 53 and the stand 52. The device 51 can be placed in this cavity 55. During operation, at least a partially transparent object 43 is placed on the cover 53, and a clamping component 54 is placed on the object 43. Figure 5C The dimensions shown are for illustrative purposes only and should not be considered limiting dimensions.

[0115] Figure 6 and Figure 7 A schematic flowchart illustrating an embodiment of the present invention is shown. The flowchart illustrates both the steps of the method, such as converting a color image into a pixel-attribute or grayscale image, and the components of the system, such as a converter for converting a color image into a grayscale image. In step 61, a digital full-color image, such as a full-color photograph, is introduced into the system's input feature 61. Optionally, pixel attributes or a grayscale image may also be introduced into the system's input feature in step 62. In step 63, a screenshot of the photograph or image can be taken using the screenshot device 63 in the system.

[0116] If the input is a color image, the converter 64 in the system can convert it to a grayscale photo in step 64, either before or after cropping. The grayscale photo can also be edited in step 75. Editing steps can also be used to create screenshots and / or convert to grayscale photos. Depending on whether a grayscale range is used to divide the grayscale image, the grayscale image is divided into N sub-regions.

[0117] The segmented image can be displayed on the system's image display device 71 in step 71. Users can influence various characteristics, such as contrast, the number of sub-regions, and desired colors. Users can also select and input the desired style, color, and application method.

[0118] Based on the input or modified parameters, N sets of projected images are generated in step 93. Under the user's control, the projected images are projected sequentially, starting with the first projected image.

[0119] Figure 8 A photograph of the person is shown. Figures 9 to 16 This demonstrates how this photograph is processed step-by-step using the system of the present invention.

[0120] Figure 9 Show Figure 8The digitally edited version of the photograph is divided into three color regions, each representing a portion of the grayscale spectrum with the same grayscale value, making the three regions visible in ascending order. These colors include: white for the brightest color group, i.e., colors with grayscale values ​​between the brightest and a first threshold; gray in the middle of the grayscale spectrum, i.e., colors with grayscale values ​​between the first and second thresholds; and black for all dark regions, i.e., colors with grayscale values ​​below the second threshold. In this way, these three values ​​converge on all colors belonging to the same numerical range within a certain range. In this example, the photograph is subdivided into different grayscale ranges. This is a preferred embodiment. The photograph can also be subdivided into pixel value regions. Pixel values ​​typically have four coordinates: for example, RGB (or CMY) and luminance or grayscale value. These four pixel values ​​cover four-dimensional space. Subdivision can be made based on pixel value regions in four-dimensional space. Further subdivision of pixel value groups and corresponding pixel value regions is as follows: the average change in grayscale and / or color values ​​of all pixels in the photograph is measured over the area surrounding the pixel, such as a 3x3 or 5x5 pixel area centered on the relevant pixel. Pixels with relatively large variations are located at the sharp edges of photographic elements, or where colors transition from one to a distinctly different color. Pixels with relatively small variations are located in solid color areas. Based on the average variation, pixels can be divided into different pixel value groups: sharp edges form one group, soft edges form another, areas where brightness or color gradually changes to another form yet another, and solid color areas form yet another.

[0121] Pixel values ​​can also be grouped using a combination method. For example, a specific group of pixel values ​​is reserved for the pixels representing the hardest edges—that is, the pixels whose value changes the most around them. The remaining pixels are then subdivided into grayscale values. Drawing based on grayscale regions can be done, but this can highlight the hardest edges.

[0122] In the preferred embodiment shown, segmentation is performed only based on the grayscale value of the pixels. This works very well.

[0123] Figure 10 The object to be drawn is shown, and its surface (22) is shaded by diagonal lines.

[0124] Figure 11 The projection according to the present invention shows that only the brightest of the three colored regions can be considered as a white region (1), while the two color regions of the middle and darkest color spectrums are black. That is, when the image is projected onto the surface to be drawn in the black region (2), they do not emit light, do not allow any light to pass through, and do not display any light on the canvas. In this case, if the image is displayed with a projector, only the white region (1) on the canvas will be able to see light.

[0125] Figure 12 This shows which areas on the surface to be painted still show the lightest color of pigment, and which areas still show... Figure 7 The original surface (22) of the surface to be drawn is shown as a shaded area.

[0126] Figure 13 The projection diagram produced according to the present invention shows that only the middle white area (1) is visible among the three colored areas, while the two color areas of the lightest and darkest gray ranges are black. When such an image is projected onto a surface to be drawn with black shadow areas (2), no light is allowed to pass through, and no light is displayed on the canvas. In this case, only the white part (1) of the canvas can see light.

[0127] Figure 14 Show the lightest color of the pigment on the surface to be painted and according to Figure 13 As described above, which areas remain visible and which parts are still displayed after applying pigments or other media to the intermediate chromatographic projection? Figure 7 The original surface (22) of the surface to be coated with pigment is shown as a shaded area. Figure 15 The projection according to the invention shows that only the darkest area among the three tinted regions is a visible white area (1), while the two color areas in the brightest gray range and the middle gray range are black. When such an image is projected onto a surface to be drawn with black shadow areas (2), no light is allowed to pass through, and no light is displayed on the canvas. In this case, if the image is displayed by a projector, only the white portion (1) on the canvas will be visible to light, which is the darkest of the three colors to be used.

[0128] Figure 15 The projection according to the invention shows that only the darkest area among the three tinted regions is a visible white area (1), while the two color areas in the brightest gray range and the middle gray range are black. When such an image is projected onto a surface to be drawn with black shadow areas (2), no light is allowed to pass through, and no light is displayed on the canvas. In this case, if the image is displayed by a projector, only the white portion (1) on the canvas will be visible to light, which is the darkest of the three colors to be used.

[0129] Figure 16 This illustration shows all three projections of a color image drawn on a surface according to an embodiment of the invention. The lightest grayscale group is white, the middle grayscale group is gray, and the darkest grayscale group is black. The result of coloring according to the coloring steps is... Figure 6 The results of the system of the present invention shown are basically the same.

[0130] Figure 17 An embodiment of the invention is shown, in which the system does not indicate any continuous area that needs to be colored, but rather a schematically positioned set of circles. These circles have a certain size according to the color value they represent, so as to contrast with the background in which they are located, and together they convert the desired image into circles of a certain size, and can also be converted into a certain color if necessary.

[0131] Figure 18 The diagram shows a projection image produced according to the present invention, in which only the largest circles are displayed by light, so that the positions of these circles can be identified and they can be given color.

[0132] Figure 19 A projection image produced according to the present invention is shown, in which only small circles are displayed with light to identify where they should be placed and to provide a coloring method.

[0133] Figure 20 The diagram illustrates a similar circle placement arrangement according to the invention, where the circles in all projected images are the same size, but the grayscale value determines which circles belong to the same color.

[0134] Figure 21 The diagram shows a projected image produced according to the present invention, in which only the darkest circles are displayed by light, so that it is possible to identify where these circles should be placed and to provide a coloring method.

[0135] Figure 22 The projection image produced according to the present invention is shown, wherein only the lightest color circles or groups of color circles are displayed by light in order to identify where they should be placed and to provide a coloring method.

[0136] Figure 23 An embodiment of the invention is shown, in which the system does not represent any set of continuous areas that need to be colored, but rather a set of square shapes schematically positioned within a rhombus pattern. Based on the color values ​​they represent, they represent a specific color in the image, thus contrasting with the adjacent square shapes they occupy, and together transforming the desired image into a continuous square area of ​​a certain size, which can also be converted into a specific color if necessary.

[0137] Figure 24 This illustrates the use of the present invention. Figure 23 The technology shown projects images in which only the darkest square areas of the rhombus pattern are illuminated to identify where they should be placed and to provide a coloring method.

[0138] Figure 25 This illustrates the use of the present invention. Figure 23 The technology shown projects images in which only the brightest square areas of the diamond pattern are displayed by light, in order to identify where they should be placed and to provide a way of coloring.

[0139] Figure 26 The image shows an overexposed photograph, with a bar chart below the image illustrating a color gradient that balances the image, from light to dark, with the majority of the gradient being light colors.

[0140] Figure 27 Show Figure 26 In well-lit photographs, the bar chart at the bottom shows a chromatographic gradient that is balanced with the image and evenly distributed from light to dark. The grayscale bars at the bottom of the photograph show a particularly uniform gradient from light to dark.

[0141] Figure 28 Show Figure 26 In an underexposed photo, the bar chart below the photo shows a color gradation that balances the photo, increasing from light to dark, with a larger portion of the color gradation in the darker color spectrum.

[0142] Figure 29 Show Figure 28 In underexposed photos, lighter areas occupy more space. This can be corrected by applying a set of four colors to these four areas, with the mid-tones having a higher proportion of light colors. Figure 30 The intermediate colors in a uniformly distributed color scheme are darker, and using a relatively darker color when applying it can correct underexposure in photos.

[0143] Figure 30 Show Figure 27 In a well-exposed photograph, the image is divided into four tonal zones, with the colors in these zones progressively darker to create the perfect shape of the face. Applying relatively light mid-tones to these zones would result in an overexposed image, while applying relatively dark mid-tones would result in an underexposed image.

[0144] Figure 31 Show Figure 26 In an overexposed photo, the shadows take up more space. This can be corrected by applying a set of four colors to these four areas, with the mid-tones having a higher proportion of... Figure 30 The intermediate colors in a uniformly distributed color scheme are lighter, and using a relatively lighter color when applying it can correct the overexposure of the photo.

[0145] Figure 32 Showing from Figure 29 The resulting third type of darkest color, from lightest to darkest, is the light projection. Figure 29The image shown is underexposed; that is, the middle colors of the four relatively light color scheme from light to dark are not properly exposed. Figure 30 The third darker area in the color scheme, compared to the lightest to darkest color, is limited to areas painted with the third darker color in ascending order.

[0146] Figure 33 Showing from Figure 30 The resulting third deepest color is the light projection from light to dark. Figure 30 The image shows a well-exposed photograph. In other words, if the intermediate colors of the four color schemes from light to dark match the uniformly increasing dark gradient from light to dark, then the area to be painted can be determined by using a third dark color in ascending order.

[0147] Figure 34 Showing from Figure 31 The third darkest color derived from an overexposed photograph is the light projection from light to light. In other words, if the intermediate colors in a four-color scheme, from light to dark, are relatively dark... Figure 30 Compared to the color used in the third darker area of ​​the color scheme, the areas to be painted with the third darker color are determined in ascending order.

[0148] Figure 35 Show Figure 27 In a well-exposed photograph, the image is divided into three color regions, with the colors in these three regions progressively darker to give the face the correct shape. If color is applied to these regions, gradually darkening the colors proportionally, the final result will give the impression of a natural facial shape, as if the image were a well-exposed photograph.

[0149] Figure 36 Show Figure 27 In a well-exposed photograph, the image is divided into five color zones, each progressively darker to represent the correct shape of the face. Applying progressively darker pigments to these zones creates the illusion of a natural-looking face, as if the image were a well-exposed photograph.

[0150] Figure 37 Show Figure 27 In a well-exposed photograph, the image is divided into seven color zones, each progressively darker to represent the correct shape of the face. Applying progressively darker pigments to these zones creates the illusion of a natural-looking face, as if the image were a well-exposed photograph.

[0151] Figure 38 This illustrates the application of the present invention in a light projection device. Figure 42The image shows a projection of the lightest color of the pigment onto a palette, highlighting which colors on the palette belong to the projected area. This allows the painter to easily identify which pigment to use. The magnified view above clearly shows that even the smallest lines and areas requiring color can be easily distinguished from parts that should not be painted with that color.

[0152] Figure 39 The light projection according to the invention is shown from Figure 42 The image shown depicts the second lightest color. In the light projection settings, the color is applied to the palette, and the light projection displays which color belongs to the displayed color projection area, so that the painter clearly knows which color to use and highlights it as the second lightest color on the palette.

[0153] Figure 40 The light projection according to the invention is shown from Figure 42 The image shown depicts the second darkest color. In the light projection settings, the color is applied to the palette, and the light projection displays which color belongs to the displayed color projection area, so that the painter clearly knows which color to use and highlights it as the second darkest color on the palette.

[0154] Figure 41 This illustrates the application of the present invention in a light projection device. Figure 42 The darkest color in the image is used for painting with light projection. The color is applied to the palette in the light projection, and it is marked which color belongs to the displayed color projection area so that the painter knows clearly which color to use and highlights it as the darkest color on the palette.

[0155] Figure 42 Showing the invention Figure 45 The image in the image has been edited. Figures 38 to 41 The area is divided into different color regions, with the white background remaining uncolored.

[0156] Figure 43 An image according to the invention is shown, in which light-colored image areas represent, according to the painting techniques to be followed. Figure 38 and Figure 39 The two adjacent colors shown can be mixed together or in areas where they can be mixed together, in order to soften the abrupt transition from one coloring method to the next, while the partially illuminated areas indicate areas where these used coloring methods should not be mixed together. According to the invention, the indicator above the palette indicates the two colors related in this step, and the indicator can also show the possible mixing ratios.

[0157] Figure 44 The invention will show that Figure 43 The image shown is a projection map of the brightest region, divided into 12 regions according to grayscale range.

[0158] Figure 45 Show an image or photograph of the input system.

[0159] Figure 46 The invention illustrates the application of the present invention. Figure 45 The implementation of the image shown, in which the colored areas have been outlined according to existing techniques, and Figure 38 The enlarged portion is also drawn according to existing technology, and the location of any indications (such as colored numbers) is limited to the outline area where clear numbers can still be placed.

[0160] Figure 47 The full color spectrum converted to grayscale values ​​is shown for reference, with color segmentation based on the CMYK color system commonly used in printing technology. White (W), cyan (C), magenta (M), yellow (Y), and black (B) are all shown in [the original text]. Figure 47 Within the chromatographic range.

[0161] Figure 48 The system and method according to the present invention will be shown Figure 47 The full color spectrum is divided into four grayscale regions. The brightest regions include white and yellow, and the darkest regions include C and B colors.

[0162] Figure 49 The system according to the invention will be shown Figure 47 The entire color spectrum is divided into seven color regions.

[0163] Figure 50 The projection steps according to the invention are shown, with the left side being the area to be drawn highlighted with a first light intensity, and the right side being the area identified by precisely highlighting only the area around it in the first light intensity, the area to be drawn including the portion that is substantially unilluminated in the second light intensity.

[0164] Figure 51The input photo is shown on the left. The dotted line in the photo represents a cut. The system displays this photo with the screenshot on an image display device (such as an iPad, iPhone, or computer screen). The user can then modify the screenshot, such as moving, zooming, changing the aspect ratio, rotating, and / or adjusting the edge points or the number of edge points. A grayscale histogram of the entire photo is plotted below the left-hand photo. Once the final version of the screenshot is saved or approved by the user, the system analyzes the pixels in the screenshot. The middle photo shows the screenshot effect. A grayscale histogram of the screenshot is provided below the middle photo. In this embodiment, the system can edit the grayscale values ​​of the screenshot to improve contrast. For example, the grayscale values ​​can be extended to the full range of 0 to 255. Next, all pixels in the first scale with grayscale values ​​between 0 and 255 (0 representing black, 255 representing the highest intensity) will be assigned a grayscale value of 0 (black). Pixels in the second scale will be assigned a grayscale value of 85, pixels in the third scale will be assigned a grayscale value of 170, and pixels in the brightest scale will be assigned a grayscale value of 255 (white at the highest light intensity). These pixels, assigned grayscale values, will then be displayed to the user as a grayscale image. This is... Figure 51 The image displayed on the right shows the finished painting. This image allows the user to understand the desired effect. Generally, users will not see a histogram. Afterwards, the user can give their approval. The right-hand image includes four sub-regions, which is somewhere in between. Figure 35 (three sub-regions) and Figure 36 (Between the five sub-regions). In this embodiment, the system will display several possible division methods to the user, such as... Figure 35 , Figure 36 and Figure 37 The diagram in the image, Figure 35 This explains the division into three partitions. Figure 36 It explains the division into five partitions, and Figure 37This describes the scenario where the image is divided into seven zones. The system also allows users to adjust the size of the image to be drawn, making it darker or lighter. This allows users to relatively increase or decrease the size of different sub-regions. If a portion of the image is made lighter, the lightest part will display more pixels. If the user is satisfied, they can approve the change. The system then creates the sub-regions and projects the first image; for example, the brightest pixel in the image on the right is displayed as white light (intensity 255), and the remaining pixels are displayed as 0. The user selects a color, or the system suggests a color with a grayscale value in the brightest part, and the user uses this color to color the white light portion. Once the user's approval is complete, the system projects the second brightest pixel. This process repeats until all projected images are complete. Depending on the underlying color used, it's possible that the underlying color is the same pigment used for the darkest pixel, i.e., the last projected image. In this case, if the user is satisfied, no additional pigment needs to be drawn for the darkest pixel.

[0165] Figure 52 It demonstrates how users can control the generation of sub-regions, thus allowing them to make their own creative choices on how to segment an image into projected images.

[0166] In this preferred embodiment, the user can input an image, as indicated by the "New Image" button in the figure. The user can then decide to take a screenshot of the image. The size and shape of the screenshot can be set. The screenshot portion forms part of the input image, which the user wishes to draw or paint on. In this embodiment, the screenshot is displayed below the image. The figure shows the same screenshot, but with a darker or lighter shade on the left and right sides. The user can use the cursor to select the relevant darker or lighter image to make the cropping effect darker or lighter. The figure illustrates an image editing operation to adjust brightness. In embodiments of the invention, other forms of editing can also be performed, such as changing contrast, image sharpness, screenshot size and shape, etc. In certain embodiments, Photoshop-like operations or adding or omitting elements can also be performed. The user can see below the screenshot how it is divided into sub-regions. This allows the user to check whether the division is too coarse to avoid losing too much detail, or too fine to avoid making it difficult to draw. In embodiments where the user can input the drawing method they want to use, the system can provide suggestions on the number of sub-regions.

[0167] If a coarser painting tool such as a palette knife is chosen, the optimal number of sub-areas will be less than when using a fine brush. In this embodiment, the system includes an input function allowing the user to select a painting style, and preferably includes an output function to display the image to the user after processing it according to the selected painting style. In specific implementations, the image can be displayed via projection or on the user's portable display device. Selectable styles include Impressionism, Expressionism, Cubism, Picasso or Dali style paintings, cartoon styles that enlarge certain parts of the face (such as eyes, lips, or ears), distorted mirror effects, and images that are converted into... Figures 14 to 22 Images shown are composed of blocks or points.

[0168] In a preferred embodiment, the system is configured to select one or more sets of pigments for a sub-region after it has been created, and to present one or more sets of pigments to the user.

[0169] Figures 53 to 56 One possible method is shown.

[0170] Figure 53 The leftmost column shows grayscale values ​​from black (0) to the highest intensity white light (255).

[0171] You can assign a grayscale value to each pigment. This is no different from converting a color to grayscale. The middle column shows the grayscale values ​​for pigments A through K. These pigments can then be divided into four groups. Figure 52 The diagram shows groups 1 through 4. Group 1 has the highest grayscale value, which is white or close to white, while group 4 has the lowest grayscale value, which is black or dark gray. Figure 53 The same situation is shown, but it is divided into six groups.

[0172] exist Figure 53 and Figure 54 In this model, grayscale values ​​are divided into four or six groups on average. This is not the only possible method of division. Figure 55 This shows a finer division of the distribution near the gray center than at the edges. Each gray range [Translator's note: This part in the original text appears to be a typo] Of course, dividing another gray range may change the distribution of pigment between groups.

[0173] In a preferred embodiment of the invention, the system is configured to determine one or more suitable color schemes and present them to the user as possible available groups. When determining a set of potentially useful color schemes, it is best to follow these rules:

[0174] - Select the coloring method for each sub-region within the grayscale range.

[0175] - The difference in grayscale values ​​between the two selected coloring methods should be greater than the basis difference. The basis difference is best determined using the following method:

[0176] Basis = (average width of the selected color grayscale range) / N, where N is at most 4, preferably 3, and optimally 2.

[0177] The choice of pigment may depend on the user's preference for certain colors, such as red, green, or blue.

[0178] The grayscale value difference between the two selected colors should be more than one-quarter of the grayscale range width, preferably more than one-third, or even more than half. If the grayscale values ​​of the two selected pigments are small, the optical effect will be poor.

[0179] Figure 56 The diagram shows a scheme containing 60 paint options, each displayed in gray. Figure 55 In China, paints are divided into 14 groups. Group 1 is the lightest group, including titanium white, and Group 14 is the darkest group, including a group of very dark colors.

[0180] Obviously, the present invention is not limited to the examples described above.

[0181] Figure 57 An embodiment is shown in which a sub-region 57A is projected, and an attenuated version 57B is also projected, for example, portions of the original image that do not belong to the projected sub-region 57A, i.e., the remainder of the image, are projected with only one-quarter or one-third of their original intensity. This allows the user to better estimate the location of the sub-region within the entire original image. In this embodiment, the method allows the user to choose whether to display the remaining portion of the image adjacent to the sub-region in an attenuated version, and / or adjust the intensity of the remaining portion of the image.

[0182] Figure 58 An embodiment is shown in which an image is displayed to a user via virtual reality glasses 58. The user can see a sub-area virtually projected onto a canvas and can draw on it. Onlookers cannot see the sub-area, but only the canvas to be drawn on.

[0183] This provides onlookers with a mysterious working method, allowing users to "conjure" a well-known and beautiful painting "out of thin air." Virtual reality glasses come in different versions, designed to provide users with image information projected directly onto their eyes or inside the glass. According to the present invention, both projection methods can be used as systems for displaying light-projected images. In the image seen by the virtual reality glasses wearer, the light-projected image can be seen projected onto the object to be drawn; therefore, visually, for the virtual reality glasses wearer, the light-projected image is projected onto the object to be drawn.

[0184] In short, the present invention can be summarized as follows:

[0185] The digital image is divided into N groups of pixels based on their pixel attributes. Based on this, N groups of projected images are generated. Each projected image displays the light intensity of one group of pixels under basic white light, and the light intensities of the other pixels under different light intensities. The pixel attribute used for division is preferably grayscale value, and the remaining pixels are preferably also projected under basic white light.

Claims

1. A system for displaying a light-projected image, comprising means for inputting an image and means for providing image information to a light-projection device, the light-projection device being used to draw or paint an image on an object using different coloring methods to display a light image on the object, characterized in that, The system includes means for dividing the input image, a screenshot of the input image, or an edited version of the input image into three or more sub-regions based on pixel attributes, each sub-region having a specific range of pixel attributes. The image information includes information for displaying a set of three or more projected images, each projected image displaying one or more projected images, and each of the three or more projected images displays one of the three or more independent sub-regions with substantially colorless light having a first light intensity, and displays the remainder of the image or the remainder of the screenshot of the image with light of a second light intensity different from the first light intensity. The sub-regions collectively at least substantially cover the image or the screenshot of the image, wherein the sub-regions are divided based on pixel grayscale values, and each sub-region has a specific grayscale range.

2. The system according to claim 1, wherein, The quotient of the first light intensity and the second light intensity is at least greater than 2 or at least less than 0.

5.

3. The system according to claim 2, wherein, The quotient of the first light intensity and the second light intensity is at least greater than 10 or at least less than 0.

1.

4. The system according to claim 3, wherein, The quotient of the first light intensity and the second light intensity is at least greater than 50 or at least less than 0.

02.

5. The system according to claim 2, wherein, The first light intensity is greater than the second light intensity.

6. The system according to claim 1, wherein, Each projected image displays the remainder of the image or the remainder of a screenshot of the image in substantially colorless light.

7. The system according to claim 1, wherein, The projected image group includes 4, 5, 6 or 7 projected images.

8. The system according to claim 1, wherein, The system is configured to continuously display three or more projected images from a set of projected images in order of increasing or decreasing grayscale values.

9. The system according to claim 1, characterized in that, The system includes a device that enables a user to take a screenshot based on an input image.

10. The system according to claim 9, characterized in that, The device for taking screenshots is configured to enable the user to select the location, size, and / or shape of the screenshot.

11. The system for displaying optically projected images according to claim 1, characterized in that, The device includes an output feature for displaying, together with the projected image, one or more shading characteristics for indicating purposes, by means of light projected onto or beside the object, when a sub-region belonging to the projected image is applied.

12. The system for displaying a light projection image according to claim 1, wherein, The device also includes input features for inputting three or more sets of projected images from an existing database combination.

13. The system for displaying a light projection image according to claim 1, wherein, The device includes features that provide grayscale images.

14. The system for displaying a light projection image according to claim 1, wherein, The device includes a supply function for supplying a color image to a converter to convert the color image into a grayscale image.

15. The system for displaying a light projection image according to claim 1, wherein, The system includes an input function that allows a user to input a set of three or more projected images.

16. The system for displaying a light-projected image according to claim 11, 12 or 13, wherein, The system includes: an analyzer for analyzing input color images or screenshots and / or grayscale images or cropped images; and a comparator for comparing the analysis results with a database containing color data, and preparing and displaying one or more sets of color samples that match the analysis results to the user.

17. The system for displaying a light projection image according to claim 1, wherein, The projected image includes a sub-region whose grayscale values ​​are between the lower limit and the upper limit of a specific grayscale value of the projected image.

18. The system for displaying a light projection image according to claim 1, wherein, The system includes a projector or digital screen for displaying three or more projected images.

19. The system for displaying a light projection image according to claim 1, wherein, The device includes an internet website or application that can use digital services to provide a set of projected images for the input image.

20. The system for displaying a light projection image according to claim 1, wherein, The device includes an internet website or application that includes input options that allow a user to input an image or screenshot to generate a set of projected images to be displayed for the input image or screenshot. The device also includes an output feature that displays the generated projected images to a user for use in the light projection setup.

21. The system for displaying a light projection image according to claim 1, wherein, The system includes input features that enable a user to change the attributes of the input image.

22. The system for displaying a light projection image according to claim 21, wherein, The system is configured to allow a user to change one or more of the following attributes of the input image: - Brightness; - Contrast; - Screenshot size; - Screenshot shape; - Screenshot detail level.

23. The system for displaying a light projection image according to claim 1, wherein, The device includes input features that enable a user to specify a desired technique or style, and the device includes output features that provide instructions or suggestions based on the specified desired technique so that the desired technique can be used when creating the work.

24. The system according to claim 1, wherein, The system includes a measuring device for measuring the color characteristics of the applied pigment, and the measuring device includes a camera for observing the color attributes.

25. The system according to claim 24, wherein, The measuring device is equipped with a lamp that emits essentially white light.

26. A method for generating an optical image and projecting the optical image using the system of claim 1, wherein, The projected image is projected in stages in order of increasing or decreasing brightness, and color is applied to each luminous part using a coloring method selected or displayed for the projected image.

27. A method for drawing a picture using the system of any one of claims 1 to 15 or 17 to 26, wherein the object is a canvas having a background texture and / or color before displaying a projected image, wherein the canvas is not colored for the brightest or darkest projected image, and the background texture and / or color remains visible as part of the picture to be applied.

28. A method for drawing a picture according to claim 27, wherein, The background of the image to be drawn is not used as the surface to be drawn and is therefore left blank, while retaining the color of the background to be drawn. The projected image only displays the subject or a screenshot of the image displayed on the screen.

29. A method for processing digital images, wherein, A digital image is converted into a digital grayscale image. The digital grayscale image is divided into three or more sub-regions based on pixel grayscale values. Each sub-region has a specific grayscale range. A set of three or more digital images is generated based on the digital grayscale image. Each image in the set of digital images includes one of the three or more sub-regions. The pixels of the sub-region are assigned pixel values ​​corresponding to a first light intensity that displays almost colorless light. The remaining part of the digital image is assigned pixel values ​​corresponding to a second light intensity that is different from the first light intensity. These common sub-regions at least substantially cover the digital image.

30. The method of claim 29, wherein the digital image is edited before being converted into the digital grayscale image.

Images