System for displaying a light projection image, method for generating a light image and projecting the light image onto an object, and method for processing a digital image - Patents.com

Abstract

The digital image is divided into N pixel groups based on a pixel property. Based on this division, a set of N projection images is generated. Each projection image shows one of the groups of pixels in substantially white light at one light intensity and the other pixels in a different light intensity. Preferably, the pixel property on which the division is based is a grayscale value, and preferably the remaining pixels are also projected with substantially white light.

Description

[Technical field]

[0001] The present invention relates to a system for displaying a light projection image, comprising means for inputting a picture, means for providing image information to a light projection setup for displaying a light image on an object in order to apply the picture to the object using different color means.

[0002] The invention also relates to a method for generating a light image and projecting the light image onto an object. [Background technology]

[0003] French patent FR2683769 shows how an image can be projected onto a carpet, with the fine details being airbrushed and the rest being painted.

[0004] GB1366724 shows a method and system for converting a color image into a line drawing and specifying color areas in the line drawing by numbers. The line drawing can be transferred to a transparent material and projected onto a wall or other surface.

[0005] GB2127753 shows the use of a slide to project such a line drawing onto a background. The line drawing consists of small and large areas surrounded and separated by lines. Each small and large area is marked with a visible number. A set of different colours is suggested as paints, and the paints are marked with corresponding numbers. The actual picture is created by painting all the numbered small and large areas with the paint option that matches the corresponding number shown.

[0006] Commercial services now offer programs that convert photographs into line drawings with color-by-number instructions.

[0007] Known systems and methods have several drawbacks: drawings are often complex and contain many details, and the black lines necessary to separate areas often disrupt the picture, especially in the case of bright colors, and it is difficult to paint the drawing using paint so that they do not appear in the final result. A drawback of paint-by-number projection is that a series of lines are difficult to see unless the lines in the projection are thin and the light projection setup is clearly focused, and furthermore the dimensions of the area enclosed by the lines are limited, since too small areas close to each other and of complex shape become difficult to distinguish when filling in the color.

[0008] Direct projection of a color image in color does not have the drawbacks introduced by lines, but has other drawbacks: it is often difficult to properly distinguish between different colors, it is usually difficult to identify if something is already colored when the color of the light appears to be the color to be colored and cancel each other out, and if the colored area contains empty dots or stripes, the red coloring on the red projected color area is virtually impossible to distinguish from the non-colored parts of the red area compared to the colored parts, and the eye perceives a problematic environment and continues to be visually confused as it tries to distinguish whether it is seeing the color of the light or the colored color.

[0009] A common drawback of existing systems and methods is that the painter's creative freedom of color choice is limited to strict color instructions to ensure that the picture turns out exactly the same color, or in cases where the number of colors to be used cannot be selected by the person painting the picture, but is predetermined.

[0010] Therefore, there is a need for new systems and methods that can prevent or at least mitigate these and other disadvantages. Summary of the Invention

[0011] To this end, the system according to the invention comprises means for dividing the input picture or a crop thereof or an edited version of the input picture or a crop thereof into three or more sub-areas based on pixel properties of pixels having a predetermined pixel property range, image information comprising information for displaying, for each sub-area, a set of three or more projected images having groups of pixel properties preferably divided based on a greyscale range, and for each group of pixel properties, one projected image of the set displaying one of the three or more sub-areas is displayed with substantially uncolored light of a first light intensity and the remaining part of the picture or the picture crop is displayed with light of a second light intensity different from the first light intensity, the sub-areas together at least substantially covering the picture or the picture crop.

[0012] For the purposes of the present invention, a light projection setup may for example be a projector which, in use, projects a light image onto an object from a distance, or it may be, for example, a digitally controlled VDU or light box onto which the user can place an at least partially transparent object.

[0013] For purposes of the present invention, in a preferred embodiment the object may be a painting canvas, and by way of further example a piece of paper, and in embodiments in which a projector is used at some distance from the object to be colored by projection, a wall, a door, a fence, or other object such as the roof of a car, an advertising billboard, or the side of a truck.

[0014] In contrast to existing systems and methods in which the system provides all information in a single image, the image information in the system and method according to the present invention is divided into a series of projected images, and the system according to the present invention establishes three or more sub-areas within the input picture, or within a cutout of the input picture, each sub-area having a unique pixel characteristic range, preferably pixels within a particular grayscale range. The image information provided to the projector includes information for displaying the three or more projected images as a set, each projected image of the set displaying one of the three or more sub-areas having substantially colorless light of a first light intensity.

[0015] In each of the projected images of the set of projected images, the remainder of the picture or the remainder of the picture cutout is shown by light of a second light intensity different from the first light intensity. Collectively, the projected images at least substantially cover the picture or the picture cutout. The use of colored light and uncolored dark areas can also be implemented in reverse, since the coloring instructions actually serve to fill in unilluminated areas at each projection step.

[0016] Before being divided into three or more regions, the input picture may first be edited by applying auto-contrast, changing the brightness, changing the contrast, changing the shape of the crop, Photoshopping the photo or crop, inserting part of another photo, etc.

[0017] Preferably, the light in the remainder of the picture or cutout is substantially uncolored.

[0018] In an embodiment, the remainder of the picture or a cutout of the picture may be represented using colored light.

[0019] In an embodiment, the information of the subareas may include the color means used and / or the technical steps to be performed for the subarea in question, which may be specified for each color in the individual steps of coloring. The subareas to be colored are projected stepwise by colorless light, white light, and the parts not painted or technically adapted using the color means in question are also displayed by colorless white light. The difference in light intensity indicates what needs to be painted or drawn.

[0020] In contrast to known prior art where all information is projected in a single image, in the system and method according to the invention, three or more projection images are projected separately in succession. For the relevant parts of the drawings and in the embodiment, for shape-true coloring, the projection image in question and the information required for the step are presented to the user step by step.

[0021] Since no dividing lines are displayed in the projection image, it is avoided that the search for color projection areas in the light image is hindered by the presence of several different dividing lines. If there are dividing lines, when searching for further courses of areas to color, it is not clear which color of the adjacent 2 or 3 areas between the dividing lines should be used for coloring. This problem is avoided by the present invention.

[0022] In each projected image, where the uncolored light shows one or more color regions to be colored, the remaining parts of the picture are shown by different light intensities, for example, while remaining at least substantially unilluminated, preferably completely unilluminated, etc. The possibility of confusion is greatly reduced, since the user is not given confusing information about parts of the picture or cutouts that do not require action during the application step in question.

[0023] Preferably, the part of the picture that is to be colored is shown with white light, while the remaining part that is not to be colored is left unilluminated. In an embodiment, it is possible to project a small amount of light onto the part that is not to be colored, compared to the amount of light projected onto the part that is to be colored. In an embodiment, when the part that is to be colored or drawn is projected with white light of a given light intensity, it is possible to project the remaining part or cutout of the picture with a lower light intensity, for example, 10 to 50 times less light. In many cases, there is enough ambient light to make the part that is not to be colored visible, but when there is very little ambient light, e.g., when there is no coloring, in a dark room, it is useful to project some light onto the part that is not to be colored.

[0024] When using the method and system according to the invention, the user is not overburdened with excessive color information regarding all the other colors that are yet to be colored. Each projection image of the sequence of projection images provides only the color information implemented at each step of the light-delimited area, and at each step the user can focus on the color that is specifically applied to the cutout applied to a particular part or object of the picture.

[0025] In contrast to existing methods and systems, according to a preferred embodiment of the system of the present invention, the materials used do not need to provide coloring instructions, since they are almost entirely embedded in the information to be displayed by light, so no preparation is required, and it is still easy to change the selection of the picture to be colored. The materials used according to the present invention, and in particular the object to be colored, preferably a painting canvas, can be standard materials also used for pictures painted in a traditional way. When using a single projected image containing all the information in known projection systems, it is easy to forget the parts that should be colored in a certain color or to get the color number wrong.

[0026] It has also been determined in advance that when using such a projection system, the entire picture must be visible on the object being colored to ensure that the indication of the color area numbers is always visibly displayed and not omitted from the display.

[0027] This prevents or greatly reduces the possibility of the painter having free choice, for example to zoom in or out on the object, or to display only a portion of the picture. The present invention prevents this, since each applied color is seen as a bright area of ​​light, with no indication of color in that area. This frees the user from having to search for what to do, and allows them the freedom to decide which portion of the picture to apply to the object.

[0028] For the process to be successful in known systems, the choice of coloring is pre-established and fixed. The present invention gives the person executing the application some freedom of choice in determining the color, and as long as the contrast value of the selected color increases or decreases with each projection step that is colored, there is a realistically perceptible representation of the depicted object.

[0029] A further advantage is that the colouring can be completed as a whole and it is immediately clear whether the colouring is complete as a whole, whereas in known systems and methods the colour number is also painted when the colour is applied, so that the indication becomes invisible.

[0030] A person carrying out the method according to the invention can easily see which parts of the highlighted area have already been colored and which parts still need to be colored.

[0031] The bright, substantially uncolored light allows one to easily see if a color projection area of ​​the light-bounded region has already been colored or painted, and if it has been painted successfully, any missed lines, stripes, or areas are immediately visible due to the color of the background or color of the uncolored object. It also allows one to quickly and easily see if the color or painting is properly filling the area to be colored or painted.

[0032] When coloring in accordance with the present invention, the artist enjoys a degree of creative freedom as to the colors used, in part because the system provides a system in which depth and shape are the most decisive factors, and does not necessarily expect the colors of the painted picture to be faithful to the colors of the original picture.

[0033] Another advantage of the present invention is that the painting system and method according to the present invention can be used by color-blind individuals as well as non-color-blind individuals, especially in cases where the system suggests colors. All colors are applied consecutively so that even color-blind people can see if this is done correctly.

[0034] Color-blind people can get little or no information from color projections and very little from paint-by-number images; they paint over the numbers, and there are usually so many of them that the colors of the numbers are often also shown in the pictures. One in twelve men has some form of color-blindness.

[0035] In preferred embodiments, the number of projected images in a set is 12 or less, preferably 8 or less. In preferred embodiments, the number of projected images is 4, 5, 6 or 7. An insufficient number of projected images can result in a picture or drawing with a relatively shallow depth, while too many projected images can result in too much action.

[0036] The system is preferably set up so that the projected images are displayed in ascending or descending order of greyscale value: the artist can work from light to dark, i.e., first paint or draw the part of the image with the lowest greyscale value and then paint or draw the part with the second lowest greyscale value, or the artist can work from dark to light.

[0037] The system preferably comprises means allowing a user to create a cut-out from an input image, which cut-out is analysed and projected by means of a projected image, making it possible, for example, to create a painting using parts of faces, etc., from a larger photograph.

[0038] The means for creating the cutout are preferably designed to allow the user to select the position, size and / or shape of the cutout. The user can for example select which part of the face to use. The system may comprise means for analysing the input picture and suggesting cutouts. The system is capable of finding the contours of the face in the picture. Based on this, potentially interesting cutouts are found by face recognition and shown in the presentation of the picture. The user can adjust the shape and size as desired.

[0039] In an embodiment, the means comprises an output capability for displaying together with the projected image the characteristics of one or more color means used when applying the color region of the projected image on or adjacent to the object. This allows several things, such as using the projected light to highlight the colors used on a color palette, or using light to indicate the colors at each process step. The characteristics can be displayed under, on or next to the object. Additionally or alternatively, while the projected image is being projected, information may be transmitted to the user through other channels on a portable image display terminal, such as a tablet computer or a smartphone, that the user can open, receive and display, such as an application or an internet site, while the light projection setup can consist of a tablet computer that can be placed under a partially translucent object to display the projected image and to depict the projected light image.

[0040] The use of the system is facilitated by displaying, along with the projected image, the characteristics of one or more color tools for applying the color region.

[0041] The color tool characteristic can be one or more of the following: a color, one or more color names, numbers, manufacturers, or mix ratios. The desired color mix information is displayed by specifying which colors are to be combined and in what mix ratios, especially when the object is to be repainted to remain faithful to the original color.

[0042] As a minimum requirement, the colors are preferably displayed with a designation such as name, number, and / or manufacturer. Displaying the colors, preferably next to an edge of the picture, allows the user to immediately verify that the correct color means is being used. In an embodiment, a shifting means is provided that allows the user to shift the display of the colors on the projected image. This allows the user to position the display of the colors where it is most convenient for the user, for example, a color palette in front of an object, or where on the palette it highlights the color to be used. The instructions provided by the system of the invention may also include mixing instructions for mixing two or more colors together to combine to dose the color on the palette.

[0043] For the purposes of the present invention, the term color means is understood to refer, but is not exhaustive, to acrylic paints, oil paints, water-based paints, inks, felt-tip pens, colored pencils, wax crayons, colored crayons and / or spray paints. Paints can be oil-based, synthetic or water-based. In an embodiment, the color means may be a transparent varnish layer or a color means with limited color strength.

[0044] In a preferred embodiment, this means also comprises an input function for inputting projected images from an existing portfolio.

[0045] A user may use, for example, photos of people important to them, such as the faces of relatives, to create the painting. In an embodiment, a user may also choose to copy pictures from a portfolio.

[0046] In a preferred embodiment, for one picture to be drawn, there may be more than one set of sub-areas to be drawn, and the system is configured such that a first layer is applied after the first set of projected images is displayed, and one or more further sets of projected images are displayed to apply one or more further layers of paint on top of the first layer, preferably with less opacity or only partially covering the previous layer. This allows the picture to be applied in multiple glazing layers. This embodiment does not require the second layer or successive partially transparent layers to be applied to the entire picture, but can be limited to one or more portions of the picture.

[0047] The number of projected images per layer may vary: in an embodiment, the first or lower layer has fewer projected images than the second or upper layer, e.g., 3 or 4 for the first layer and 5, 6 or 7 for the second layer.

[0048] In the present invention, the application of color means in the present invention is not limited to brushes and pens, but application using palette knives, hands or fingers, stamps, airbrushes, sponges, etc. is also possible.

[0049] In a preferred embodiment, the image information comprises information about more projected images of the selected picture, each projected image indicating a portion of the picture to which it is applied that is specifically applied to the projected image in question by indicating the portion that is applied to the projected image in question with at least substantially colorless light, leaving the remaining parts of the picture to which it is applied without illumination, not including any information regarding the specific projected image applied to each projected image, and the combined projected image at least substantially covers the picture, such that each projected image comprises information of a specific greyscale range, the greyscale ranges do not overlap or at least do not substantially overlap, and the number of projected images is 3 or more.

[0050] In this preferred embodiment, many more projected images are displayed. The system according to one of these preferred embodiments allows the user to build up the applied picture in layers, greatly increasing the possibility of recreating a picture that is faithful to the original or an artistic expression at the user's discretion. No existing system or method allows this. Also, for the second layer and beyond, the number of projected images is preferably 4 to 12, and most preferably 4, 5, 6, or 7. For the second layer and beyond, a transparent or partially transparent varnish layer can be linked to one or more projected images.

[0051] In a preferred embodiment, the means comprises an output displaying characteristics for following instructions according to the projected image, which characteristics help to mix two or more color means on the object and include mixing instructions for merging colors on the projected image. In this embodiment according to the invention, it is possible to use the light projected image to indicate to the user which colors, for example adjacent colors that are still wet and still workable, may or must be mixed partially or partially. This must be done within the area, and in particular within the projection area marked with colorless light, and not in the subareas that are not illuminated. This method according to the invention can also be used to add additional elements to the object to be drawn, such as, for example, text, decorative elements or other elements that are not in the original picture.

[0052] Transitions from one color to another adjacent color are difficult to judge and even more difficult to apply, even for amateurs and trained artists. This is because in that case, instructions are needed to indicate areas where a given color mix of two colors can help to achieve better results in matching already applied colors, rather than strictly separating one color from another. In a preferred embodiment, the system uses projected images to indicate where transitions to adjacent colors can be merged using color mix means or by mixing editable colors in these projected image areas. This allows for a more realistic look and a more professional appearance. Existing systems and methods are not capable of providing such detailed coloring instructions.

[0053] In an embodiment, the means analyzes the object to be drawn from the input picture. It is difficult for the user to judge the transition from one color area to another adjacent color area, especially when the object of the picture is drawn in colors other than the colors faithful to the original picture. The system calculates and determines the contrast of the grayscale values ​​and determines the area where the applied color is best balanced with the light intensity values ​​used, and where the transition to the next color area is located, and in which light area the contrast values ​​match. In an embodiment, the system analyzes the grayscale values ​​used for the contrast subareas, and the user is left with a certain latitude to select the set of colors to be used, provided that the colors of the selected set of colors have sufficient contrast in grayscale distance from each other according to the system. This allows the user room to make his own creative choices by the system, without being stuck to a pre-determined color combination. The present invention is characterized by allowing a certain degree of freedom in choosing colors, in contrast to many examples of the prior art, including paint-by-number applications, where the colors are pre-determined and adjusting the colors within a certain range is not an option.

[0054] Changing colors in a color-by-number embodiment can compromise the faithful reproduction of the original and can negatively impact the final result when assessing whether the depicted subject is faithful to the original. Conventional techniques such as color-by-number also do not allow for the omission of backgrounds or other areas within a picture.

[0055] In one embodiment according to the invention, the means comprises a supply function for supplying an image of color values ​​to a converter for converting the color image to grayscale values, a grayscale range being assigned to each projected image, the grayscale range being divided into a number of projected images which together constitute a substantially uninterrupted grayscale range from light to dark.

[0056] The projection images can be fed directly into the system with a set of projection images of paintings from a standard subject database portfolio, for example to depict a night watchman or a sunflower, in which case the input to the system has been previously prepared and stored in the system's database and can be used directly without further transformation.

[0057] In a preferred embodiment, images can be provided in greyscale values, allowing, for example, old black and white photographs to be converted into projected images that can then be used to create colour paintings or drawings.

[0058] There are several ways to convert a grayscale image into a projected image, where a collection of pixels with grayscale values ​​are converted into a specific grayscale range within a subarea.

[0059] Grayscale values ​​can be represented digitally, the most commonly used scale values ​​are 0 to 255. The first possible division of a pixel is one that divides this scale into equal ranges. The second possible distribution is one in which, towards the center of the scale, the grayscale range becomes gradually smaller than the minimum and maximum grayscale values.

[0060] A third possible division can be made as follows: A grayscale histogram is created with the grayscale values ​​of the pixels of an image, which may be either the entire picture, a crop of the picture, or an edited version thereof. Then, if we use n grayscale ranges for a total of M pixels, the M / n pixels with the lowest grayscale value will appear in the first projected image, the M / n pixels with the highest grayscale value in the last projected image, and so on, so that every other projected image will consist of a group of M / n pixels.

[0061] This latter segmentation requires that an analysis of the grayscale image be performed prior to segmentation, since the segmentation depends on the grayscale value content of the input picture. Part of the present invention provides a system where this gray value segmentation is performed on the part of the object in the picture that the user has outlined, and the gray values ​​outside this outline are not converted to higher or lower values ​​than the gray values ​​of the area inside the outline. This step according to the present invention can prevent one or more projected images from showing light projection areas that are only outside the object, thus reducing the number of colors required for the object itself.

[0062] In embodiments where a user has specified a set of colors or color means, this allows the object to be divided into grayscale ranges, each covering an area around the grayscale value of a specified color.

[0063] In embodiments in which a color picture or drawing is produced using black and white photography, the system is preferably provided with an input feature that enables a user, after being shown one or more projected images, to input a desired color for one or more of the projected images and cause the means to select and display a characteristic of the color means that matches the input color or colors.

[0064] In an embodiment in which a black and white photograph is used to create a color painting or drawing, the system is preferably provided with a shape analyzer for using means to analyze the shape of the black and white photograph and display the characteristics of color means that match the analyzed shape.

[0065] Many shapes are known and recognizable, such as trees, shrubs, sky, clouds, faces, hands, clothing, hats, the globe, etc. Based on the shape and the average gray value of the shape, an estimate of the best matching color can be made. In a preferred embodiment, the system is provided with both an input feature that allows the user to input a color, and a shape analyzer. The color entered by the user for a given portion of the black and white photograph provides information to the system that can be used by the shape analyzer as part of the present invention.

[0066] In one embodiment the means comprises a further providing functionality for providing the colour image to a further converter which converts the colour image to a greyscale image.

[0067] It can convert color images to grayscale images.

[0068] There are several ways to do this, and an overview of some methods for converting color images to grayscale images (color to grayscale conversion) can be found in "Perceptual Evaluation of Color-to-Grayscale Image Conversions" by M. Cad▲i▼k, Pacific Graphics 2008 Vol.27 (2008), No.7, and other publications. Another example is given in "Apparent Grayscale: A Simple and Fast Conversion to Perceptally Accurate Images and Video" by Kaleigh Smith, Pierre-Edouard Landes, Joe▲e▼lle Thollot, and Karol Myszkowski, EUROGRAPHICS 2008, Vol.27 (2008), No.2.

[0069] By converting a color image into a grayscale image, then into an image of gray hues, then into a projected image, and displaying the projected image with its color characteristics, it becomes possible for an amateur or novice artist to draw a color image on an object such as a canvas, or to draw or paint on paper, with a faithfulness to the original. This is also a result of the fact that pictures are often composed of different colors that are not recognizable or that blend into one another, such as being separated by lines that separate areas of a given color. A recognizable reproduction that is faithful to the original is not necessarily the result of reproducing the original picture in the same colors, but it is specifically the result of the use of colors whose contrast or contrast value provides substantially the same contrast as known from the original picture for each color area reproduced.

[0070] In an embodiment, the colors used to paint or render each projected image sub-area are determined by the system according to the invention, or are presented to the user as possible combinations of colors, or are input to the system by the user.

[0071] In a preferred embodiment, the system comprises a measurement setup for measuring a property of the paint, the measurement setup comprising a camera.

[0072] The paint property measured can be a color value and / or a grayscale value.

[0073] The measurement setup can be used for multiple purposes.

[0074] A. The system may have suggested one or more paints or mixtures of paints. When selecting paints, the user may make mistakes, for example by selecting the wrong paint for a painting, or by selecting the right paints but planning to apply them in the wrong order. Measuring the physical properties of the paints used with pre-application measurement equipment can ensure that the paint used is the intended paint. Especially if the user is color blind or if the surrounding light is dim or colored, it may be difficult or impossible for the user to use only color as a reference to see if the correct color is applied. Measuring properties, colors, and grayscale values ​​can prevent mistakes. If the system suggested a color mix, the measurement provides a final answer as to whether the created mixture has the expected color and / or gray value. If the color is not appropriate, the system can instruct the user to mix one or more components. If the color is correct but the paint is too light or too dark, the system advises the user to mix white or black to make the paint lighter or darker. After correcting the mixture, a new measurement can be performed to determine whether the color and / or grayscale value of the paints used are acceptable.

[0075] B. When the user selects one or more predefined paints to be used, the measurement system can measure the grayscale values ​​and possibly also the color values ​​of the paints to be used. Depending on the grayscale values ​​measured for the paints selected by the user, the system can establish one or more sub-areas. The sub-areas can also be determined by the grayscale values ​​of the selected paint or paints. If the distance of the grayscale values ​​of the selected paints is not favorable, the system can also suggest to the user that one or more colors or grayscale values ​​of the selected paints should be adjusted, for example by mixing with white or black paint. An example is a series of five selected paints, two of which have substantially identical grayscale values, while the other paints have clearly different grayscale values. It may then be beneficial to adjust at least one grayscale value of the selected paints by lightening or darkening the paint.

[0076] In a preferred embodiment, the measuring device is equipped with a lamp emitting substantially white light, so that all paints to be measured are illuminated in the same known manner during the measurement.

[0077] In a preferred embodiment, the system leaves the user some freedom to make creative choices regarding the colors used together, provided that the combination of colors selected undergoes the same ascending steps as the original. A skilled artist can select the appropriate colors to compare faithfully with the original in a realistic color reproduction, but it is difficult to create the appropriate color by mixing paints. An embodiment of the present invention provides a digital analysis of the color space taking into account the available colors. Colors and paints are made and determined by the available pigments. Outside of printing technology, where the (CMYK and RGB) color systems are used and the colors are reliable, many paints for artists, even primary colors, have many differences in terms of how the paint looks wet compared to the color after drying. A skilled artist can often be recognized by the colors he or she chooses to faithfully reproduce the subject matter that the particular artist uses repeatedly as a characteristic of their work, and in this sense the system according to the present invention provides a room for recognizable creative choices and these characteristic choices can be adopted as a personally recognizable style.

[0078] An embodiment in accordance with the present invention provides an input system for the number of projected images to be input by a user. In such an embodiment, the user may input the projected images themselves.

[0079] In an embodiment, the system comprises an analyzer for analyzing the input color and / or grayscale image, and a comparator for comparing the analysis result with a database containing paint and paint data, and for preparing and displaying to the user one or more sample sets of paints to be used together, showing a preview of the achievable results. In such an embodiment, the system performs an evaluation of the projected image to determine which color best matches the average color contrast. For example, it calculates the average color value of the projected image and searches a database of paints or color measures to select the color measures whose grayscale contrast and color point best match the average grayscale value and average color point of the projected image. The result of such a comparison determines the sample color set. The system can generate several different sample sets. For example, the user can indicate a preference for a particular color or color combination. The system then generates several color sample sets, compares them with the specified preference, and presents this set of color combinations to the user in ascending order of matching with the specified preference for use as a paint palette for paints or colorings.

[0080] The projected image of a picture comprises the portions of the original picture having grayscale values ​​between the lower and upper grayscale values ​​characteristic of the projected image.

[0081] In an embodiment according to the invention, the system comprises an optical projection setup.

[0082] In an embodiment according to the invention, the means comprises an internet site or application that enables the use of a digital service to provide a set of projected images to a target from a specified image and / or input picture.

[0083] The internet site or app preferably has an input functionality that allows a user to submit pictures and present a projected image that is created from the submitted picture, and an output functionality that transmits the created projected image to the user's light projection setup, preferably linked for use with a site or application that controls the light projection setup for specifying the characteristics of the color means available and for displaying the projected image on or below the canvas or paper to paint on.

[0084] If the light projection setup is underneath the canvas or paper so that the projected image can be visually followed, then it is preferred that the canvas or paper being painted on is slightly translucent.

[0085] Preferably, the means includes an input function to allow a user to indicate a desired technique or style when displaying the projected image, and the means includes an output function to provide instructions or suggestions in response to the specified desired technique, thereby allowing the user to practice a particular application style or technique. Indications of a desired technique or style may include, for example, an indication of a material to be used, such as a brush, a brush size, a brush type, a knife, an airbrush, a hand, or impressionism, expressionism, realism, hyperrealism, etc.

[0086] The present invention is also a method for applying a selected picture to an object as a color picture, in which a series of projected images corresponding to a particular grayscale range of the selected picture are projected in descending or ascending order of grayscale value, and color is applied to each of the projected images in the illumination portion using color means selected or displayed for the projected images.

[0087] In a preferred embodiment, the object is a painting canvas, and prior to displaying the projected image, the painting canvas is provided with a background texture layer and / or background color, leaving the painting canvas unpainted for the lightest and darkest projected images. A pre-processed background may be required to achieve certain effects or certain techniques in combination with the color application techniques and materials used.

[0088] In embodiments where the background of the drawn picture is not included as a surface to be drawn into the projected image and is therefore left open, it is up to the discretion of the person painting or drawing whether to preserve the background color in these areas or to apply a background with color or a particular texture.

[0089] In the method according to the invention, the order in which the projected images are displayed may be from light to dark, which is usually preferred, or from dark to light, which gives a better effect for a given depiction.

[0090] The invention also relates to a method of processing a digital picture, the digital picture being converted into a digital greyscale picture, the digital greyscale picture being divided into three or more sub-areas based on pixel greyscale values ​​having a particular greyscale range for each sub-area, and a set of three or more digital images being generated from the digital greyscale picture, each digital image of the set comprising one of the three or more sub-areas, the pixels of which are assigned pixel values ​​corresponding to a display having substantially uncoloured light of a first light intensity, and the remainder of the digital picture being assigned pixel values ​​corresponding to light of a second light intensity different from the first light intensity, with the combined sub-areas at least substantially covering the digital picture.

[0091] In brief, the present invention provides a painting technique that allows a picture to be painted on a canvas that is faithful to the original, by using a light projection system where the color regions compared by a computer are converted to a grayscale range and projected onto the object, by using light projection to illuminate the object with substantially white light, and then applying a color selected by the user or dictated by the system to each illuminated projected image. The present invention also provides a method for editing the digital picture and generating a set of digital images that can be used for projection in a painting mode according to the present invention.

[0092] The invention also relates to a computer program comprising instructions for carrying out the method according to the invention. The computer program according to the invention may comprise instructions for carrying out one or more different embodiments of the method according to the invention.

[0093] The invention also relates to a computer code comprising instructions for carrying out the method according to the invention. The computer code according to the invention may comprise instructions for carrying out one or more of the various embodiments of the method according to the invention.

[0094] The invention also relates to a set of projection images generated according to the method according to the invention.

[0095] These and further aspects of the invention are described below and illustrated in the drawings. [Brief description of the drawings]

[0096] The figures included in the drawings show: FIG. 1 shows a picture known from a digital publication regarding the operation of an online color separation system called PBNify. FIG. 2 shows the PBNify system's representation of color separation, where the original picture of FIG. 1 has been split into a limited number of colors. FIG. 3 shows the color division of FIG. 2, with each color surrounded by a line and a number being able to be placed within the outline of each line. 4 and 5A, 5B and 5C show schematic examples of systems according to the invention. 6 and 7 provide flow charts of embodiments of the present invention. 8 to 16 show one embodiment of the present invention. 17 to 25 show diagrams of further embodiments of the present invention. 26 to 58 show further aspects of embodiments of the present invention.

[0097] 1 to 3 show the prior art.

[0098] FIG. 1 illustrates the operation of an online color separation system called PBNify, and shows a known picture from a digital publication in which the method is described.

[0099] FIG. 2 shows a representation of color separation by the PBNify system, i.e., if the original picture of FIG. 1 is divided into a limited number of colors, the picture is digitally divided into color regions of the same color value.

[0100] Figure 3 shows a representation of the color division of Figure 2, but with each color outlined and within each outlined area a number can be placed indicating whether a limited number of selected color values ​​are applicable to the area within the line.

[0101] Therefore, areas of the same color are given the same number.

[0102] When a picture is projected on a canvas according to Figure 3, all color areas are displayed simultaneously, so it remains difficult to discover whether the application of color during painting is correct. When simply projecting a picture in color, painting a color with the same color light projection is very difficult, since like colors cancel each other out, and as a result, it becomes difficult to know whether a certain area already has some painting done or only the color of the light that is visible. This means that such results can be difficult to discover with such a system, and this search is hindered by the lack of visible observation of the work already done.

[0103] FIG. 4 shows a light projection setup according to the invention, showing light projection using a projector. FIG. 4 shows a computer 41, which receives a digital picture. There are various ways to input a digital picture, such as from email, mobile phone, social media, cloud services, etc. The input digital picture is then converted into a set of three or more light projection images, after any editing. The projection images are projected by a projector 42. FIG. 4 shows an example of a projection image 46 on a canvas 43. A mobile device can also be used instead of a computer. Further information can be projected together with the projection images. The system can be provided with a camera 45, which allows the system to monitor what is being done and project instructions if necessary. The system can also comprise a website, for example, accessed by a smartphone or another mobile device, as shown as device 44 in the top right corner of the figure, where the photos are sent to the website and editing is done on the website, and device 44 can also be used when controlling projector 42, for example to switch to the next projection image. The set of projection images can also be sent from the website to projector 42 via mobile device 44. The website itself may also include a portfolio of sets of projection images, and the website may transmit information about the sets of projection images in the database portfolio to the user, allowing the user to select a set of projection images from the portfolio.

[0104] The website may also include a portfolio of sets of projected images previously used or selected by the user, which can be added to the database portfolio and shared with other users. This allows the user to, for example, create a painting based on a photograph of a deceased loved one, so that the painting resembles them better, and to correct, for example, in the second version, a choice of colors that was ultimately deemed unsatisfactory, or the choice of the number of projected images in the first version, which may be improved in further versions, so that several different sets of the same images may be applied to each other with multiple glazing layers of partially transparent colors.

[0105] 'Practice makes perfect' also applies to the use of the system and method for painting according to the present invention, and therefore used projection sets are preferably stored for further refinement or improvement in preferred embodiments of the system. Information 47 can be projected with the picture, either underneath or next to the projected picture. The computer is provided with input facilities for inputting digital images, for example wireless using antenna 58, but this could also be via a landline phone or directly connected to a camera via a USB port.

[0106] 5A, 5B and 5C show an embodiment of a light projection setup according to the invention, showing light projection by a digitally controlled visual display unit 51 on which a partially translucent object 43, such as a canvas or a transparent paper, is placed. The other features of the relevant parts of FIG. 5 here correspond to the description of FIG. 4. FIG. 5B shows a tool for a system according to the invention. This tool consists of a support 52 for a portable visual display unit containing a device 51 and a cover 53 having a transparent part that is placed on the support 52 during operation. A cavity 55 remains open between the cover 53 and the support 52. The device 51 can be placed in this cavity 55. During operation, the at least partially transparent object 43 is placed on the cover 53 and the clamping part 54 is placed on the object 43. The dimensions shown in FIG. 5C are examples. They are not limiting dimensions.

[0107] 6 and 7 show a schematic flow chart of one embodiment of the present invention. The flow chart shows both method steps, such as converting a color image to a pixel property or grayscale image, and parts of a system, such as a converter that converts a color image to a grayscale image. In step 61, a digital full color image, such as a full color photograph, is introduced into an input function 61 of the system. Alternatively, in step 62, a pixel property or grayscale image can be introduced into the input function of the system. In step 63, a cropper 63 in the system can be used to create a crop from the photograph or picture.

[0108] If a color picture is input, a converter 64 in the system can convert it to a grayscale picture before or after cropping in step 64. Optionally, the grayscale picture can be edited in step 75. An editing step can also be performed to create a crop or convert to a grayscale image. Depending on the selection of whether to use the grayscale range setting to divide the grayscale picture, the grayscale picture is divided into N subareas.

[0109] The segmented image may be displayed at step 71 on the system's image display device 71. The user may affect various properties such as contrast, number of sub-areas, the colors he wishes to use, etc. Optionally, the user may also input the desired style, color means, and application means.

[0110] Depending on the input or modified parameters, a set of N projection images is created in step 93. The projection images are projected in sequence starting from the first projection image under the control of the user.

[0111] Figure 8 shows a photograph of a person, and figures 9 to 16 show step by step how this photograph passes through a system according to the invention.

[0112] FIG. 9 shows a digitally edited version of the photo of FIG. 8, i.e. the photo has been divided into three color regions, each representing a part of the grayscale spectrum with the same grayscale value, the three regions being colored in ascending order. These colors include the brightest color group, i.e. white, as the color with a grayscale value between the brightest value and the first threshold, the intermediate colors of the grayscale spectrum, i.e. gray, as the color with a grayscale value between the first and second thresholds, and all the dark color regions, i.e. black, as the color with a grayscale value below the second threshold. These three values ​​are thus a collection of all colors that belong to the same range of values ​​within the given limits. The photo in this example has been subdivided into grayscale ranges. This is the preferred embodiment. The photo can also be divided into pixel value regions. A pixel value usually has four coordinates, for example RGB (or CMY) and a luminance or grayscale value. These four pixel values ​​cover a four-dimensional space. The division can also be based on pixel value regions in this four-dimensional space. Further possible divisions into pixel value groups and corresponding pixel value regions are as follows: the average change in the grayscale and / or color value of a pixel in the region of interest is measured for all pixels of the photo in the region surrounding the pixel, e.g. a 3*3 or 5*5 pixel region with the pixel of interest at its center. Pixels with relatively large changes are located at sharp edges of the photo elements or at the transition from one color to a color that is clearly different from it. Pixels with relatively small changes are located in regions of the same color throughout. Based on the average changes, the pixels can be classified into pixel value groups as follows: sharp edges form one pixel value group, soft edges a further pixel value group, regions where the brightness or color changes relatively gradually to another brightness or color yet another group, regions of the same color throughout yet another group.

[0113] Combinations can also be used to classify pixel value groups. Certain pixel value groups can be designated for the hardest edges, e.g., those that show the greatest change in pixel values ​​around the pixels. The remaining pixels can be split into grayscale values. This produces a paint based on grayscale areas, but potentially accentuating hard edges.

[0114] In the preferred embodiment shown, the segmentation is based solely on the grayscale values ​​of the pixels, which has been shown to give good results.

[0115] FIG. 10 shows a painted object whose surface (22) is shaded with diagonal lines.

[0116] Figure 11 shows a projection according to the invention, where only the lightest of the three areas to be colored are visible as white areas (1), and both the color areas of the middle and darkest color spectrums are black, i.e., when such an image is projected onto a surface to be painted as black areas (2), those areas are not illuminated, do not let light through, and do not show light on the canvas. In this case, when this picture is displayed with a projection lamp, only the white parts (1) on the canvas are visible as light.

[0117] FIG. 12 shows the areas that show the lightest colored paint on the surface to be painted, and also shows which parts show the original surface (22) of the surface to be painted, shown as the shaded area in FIG.

[0118] Figure 13 shows a projection according to the present invention, where only the middle area of ​​the three areas to be colored is visible as a white area (1), and both the lightest and darkest grayscale ranges of the color area are black. When such an image is projected onto a surface to be painted as a black shaded area (2), it does not allow light to pass through and does not show any light on the canvas. In this case, only the white area (1) shows as light on the canvas.

[0119] FIG. 14 shows where the areas remaining visible with the lightest colored paint on the surface being painted, as well as which parts still show the original surface (22) of the surface being painted, shown as the shaded area in FIG. 7, as a result of paint or other medium being painted according to the projection of the intermediate color spectrum, as described in FIG. 13.

[0120] Figure 15 shows a projection according to the present invention, where only the darkest of the three colored regions is visible as a white area (1), and both the lightest and middle grayscale ranges are black, and when such an image is projected onto a surface that is painted with black shaded areas, it will not transmit light and will not show any light on the canvas. In this case, when this picture is displayed with a projection lamp, only the white area (1) will be seen as light on the canvas, which is intended to apply the darkest of the three colors used.

[0121] FIG. 16 illustrates that, according to one embodiment of the present invention, the surfaces to be painted in all three projections of the color image are painted white for colors in the lightest grayscale value group, gray for colors in the middle grayscale value group, and black for colors in the darkest grayscale value group, and that following the coloring steps results in results nearly equivalent to those intended according to the system of the present invention shown in FIG.

[0122] FIG. 17 illustrates an embodiment of the invention where the system does not show a continuous area to be colored, but a collection of roughly arranged round shapes having predetermined dimensions according to the color values ​​they represent, thus contrasting with the background and converting the desired picture into a circle of a predetermined size and, if necessary, a predetermined color.

[0123] FIG. 18 shows a projected image according to the invention, where only the largest circles are illuminated so that it is possible to see where they are located and how color means should be provided.

[0124] FIG. 19 shows a projected image according to the invention, where only small circles are displayed by the light, so that it is possible to see where they are located and what color means should be provided.

[0125] FIG. 20 shows a similar setup of circle positions according to the invention, where the size of the circles is equal in all projections, but the greyscale value determines which belong to the same color.

[0126] FIG. 21 shows a projected image according to the invention, where only the darkest circles are shown by the light, making it possible to see where they are located and what color means should be provided.

[0127] FIG. 22 shows a projected image according to the present invention, where only the brightest colored circles or groups of colored circles are shown by the light, allowing one to see where they are located and what color means should be provided.

[0128] FIG. 23 illustrates an embodiment of the invention in which the system does not show a collection of continuous areas to be colored, but rather a collection of squares arranged roughly in a diamond pattern, which represent predetermined colors in the image depending on the color values ​​represented by them and thus contrast with the shapes of the adjacent squares in which they are arranged, while simultaneously converting the desired picture into a continuous area of ​​squares of a predetermined size and, if necessary, into a predetermined color.

[0129] FIG. 24 shows a projected image according to the invention in which, in a technique contemplated as in FIG. 23, only the darkest square areas of the diamond pattern are shown by light, making it possible to recognize where they are located and where color means should be provided.

[0130] FIG. 25 shows a projected image according to the invention in which, in a technique contemplated as in FIG. 23, only the brightest square areas of the diamond pattern are shown by light, making it possible to recognize where they are located and where color means should be provided.

[0131] Figure 26 shows an overexposed photo and the bar below it shows the gradient balance of the color spectrum in the photo, showing how most of the color balance is in the light spectrum, rising from light to dark.

[0132] Figure 27 shows the photograph of Figure 26 in a well-lit configuration, with the bars below it showing the gradient of the color spectrum in the photograph, rising from light to dark with an even distribution. The grayscale bar below the photograph shows a particularly even gradient from light to dark.

[0133] Figure 26 shows an underexposed photo and the bar below it shows the gradient balance of the color spectrum in the photo, showing how most of the color balance is in the dark spectrum, rising from light to dark.

[0134] Figure 29 shows the underexposed photograph of Figure 28 with the light areas taking up more space. By painting the four areas using a set of four colors that are darker than the mid-tones in the evenly distributed color composition of Figure 30, the underexposed effect of the photograph is corrected by using relatively dark colors when painting.

[0135] Figure 30 shows the properly exposed photograph of Figure 27, with the image divided into four proportionally progressively darker tonal regions to give the correct facial shape. If these regions are painted with relatively light mid-tone paints, the end result will give the impression that the image is overexposed. If these regions are painted with relatively dark mid-tone paints, the end result will give the impression that the image is underexposed.

[0136] Figure 31 shows the overexposed photograph of Figure 26, with the dark areas taking up more space. By painting the four areas using a set of four colors that are lighter than the midtone colors of the evenly distributed color composition of Figure 30, the overexposed effect of the photograph is corrected by using relatively light colors when painting.

[0137] Figure 32 shows the projection of light of the third darkest color from light to dark derived from Figure 29, which shows an underexposed photograph, i.e., defines the area to be painted with the third darkest color in ascending order when the intermediate color of the four-color composition from light to dark is compared with the color used in the darkest area in ascending order of the relatively light color composition of Figure 30.

[0138] Figure 33 shows the projection of light of the third darkest colour from light to dark derived from Figure 30 showing a properly exposed photograph, i.e. defining the area to be painted with the third darkest colour in ascending order where the intermediate colours of the four-colour composition from light to dark correspond well with the dark steps ascending evenly from light to dark.

[0139] Figure 34 shows the projection of light of the third darkest color from light to dark derived from Figure 31 which shows an overexposed photograph, i.e., defines an area to be painted with the third darkest color in ascending order when the intermediate color of the four-color composition from light to dark is compared with the color used in the darkest area in ascending order of the relatively dark color composition of Figure 30.

[0140] Fig. 35 shows the properly exposed photograph of Fig. 27, with the image divided into three tonal areas of proportionally increasing darkening, thus obtaining the correct shape of the face. When these areas are painted with proportionally gradually darkening color means, the end result will give the impression of a naturally shaped face, just as if the image were a properly exposed photograph.

[0141] Figure 36 shows the properly exposed photograph of Figure 27, with the image divided into five tonal areas that are proportionally darker, and thus given the correct shape of a face. If these areas are painted with proportionally darker paint colors, the end result will give the impression of a naturally shaped face, just as if the image were a properly exposed photograph.

[0142] Fig. 37 shows the properly exposed photograph of Fig. 27, with the image divided into seven tonal regions that are proportionally darkened, and thus given the correct shape of the face. If these regions are painted with proportionally darkening paint colors, the end result will give the impression of a naturally shaped face, just as it would be in a properly exposed photograph.

[0143] Figure 38 shows the light projection according to the invention of the brightest color means to be painted from the picture shown in Figure 42 belongs to the color projection area shown as an easy way to make it clear to the painter which color means will be used in the color means applied to the color palette of the light projection showing which colors of the color palette will be used in the light projection setup. The enlargement of the picture above clearly shows that even the smallest lines and areas to be painted with color can be easily distinguished from the parts that should not be painted with that color.

[0144] FIG. 39 shows that the light projection according to the present invention of the second brightest color means to be painted from the picture shown in FIG. 42 belongs to a color projection area shown as a simple way to make it clear to the painter which color means is to be used in the color means applied to the color palette of the light projection showing which color of the color palette is to be used in the light projection setup, which is highlighted on the palette as the second brightest color.

[0145] FIG. 40 shows that the light projection according to the present invention of the second darkest color means to be painted from the picture shown in FIG. 42 belongs to a color projection area shown as a simple way to make it clear to the painter which color means is to be used in the color means applied to the color palette of the light projection showing which color of the color palette is to be used in the light projection setup, which is highlighted on the palette as the second darkest color.

[0146] FIG. 41 shows that the light projection according to the present invention of the darkest color means to be painted from the picture shown in FIG. 42 belongs to a color projection area shown as a simple way to make it clear to the painter which color means is to be used in the color means applied to the color palette of the light projection showing which color of the color palette is to be used in the light projection setup, which is highlighted on the palette as the darkest color.

[0147] FIG. 42 shows the picture of FIG. 45 according to the invention divided into color regions as described in FIGS. 38 to 41, with the background shown in white being left unpainted.

[0148] Figure 43 shows a picture according to the invention, where according to the painting technique to be followed, the lighted image areas indicate areas where two adjacent colours shown in Figures 38 and 39 can be mixed, or colours can be mixed together to soften the harsh transition from one colour means to the next, and the partially illuminated areas indicate where these colour means applied should not be mixed.

[0149] According to the above instructions according to the invention, a palette shows the two colour means involved in this step, the display of which can also show the possible mixing ratios.

[0150] FIG. 44 shows the projection of the brightest area according to the present invention when the picture shown in FIG. 43 is divided into 12 regions based on the grayscale range.

[0151] FIG. 45 shows a picture or photograph being input into the system.

[0152] FIG. 46 shows an implementation of the picture of FIG. 45 according to the present invention where the color regions have been outlined, as known in the prior art, and again shows the enlargement in FIG. 38 in accordance with such known prior art, where the placement of indicia such as color numbers is limited to the outlines within which legible numbers can be placed.

[0153] Figure 47 shows the full color spectrum converted to grayscale values, with the color division into the CMYK color system common in printing technology shown for reference, where white (W), cyan (C), magenta (M), yellow (Y), and black (B) are each within the color spectrum of Figure 47.

[0154] Figure 48 shows that the full color spectrum of Figure 47 is divided into four grayscale value regions in accordance with the systems and methods of the present invention. The lightest region is made up of the colors white and yellow, and the darkest region is made up of the colors C and B.

[0155] FIG. 49 shows the full color spectrum from FIG. 47 divided into seven color regions according to the system of the present invention.

[0156] FIG. 50 illustrates a projection step according to the present invention, showing on the left the area to be painted highlighted with a first light intensity, and on the right the same area identified by highlighting only the area just surrounding the area of ​​the first light intensity, including substantially unilluminated portions of the second light intensity, and including the area to be painted accordingly.

[0157] The left side of FIG. 51 shows an input photo. The dotted line in the photo is the cutout. The system displays the photo on an image display device, such as an iPad, iPhone, or computer screen, while cropping the photo. The user can then modify the crop, for example, shift, scale, change the aspect ratio, rotate, and / or adjust the corner points or the number of corner points. A grayscale histogram of the entire photo is depicted below the photo on the left. Once the final version of the crop is saved or the crop is approved by the user, the system analyzes the pixels in the cutout. The middle photo shows the crop. A grayscale histogram of the cutout is displayed below the middle photo. In an embodiment, the system can edit the grayscale values ​​of the crop to improve contrast. For example, the grayscale values ​​can be extended to the full range of 0 to 255. Then, all pixels in the first quarter of the grayscale range 0-255, where 0 is black and 255 is the highest intensity, are assigned the grayscale value 0 (black), the pixels in the second quarter are assigned the grayscale value 85, the third quarter are assigned the grayscale value 170, and the lightest quarter is assigned the grayscale value 255 (white with the highest light intensity). The pixels assigned these grayscale values ​​are then displayed to the user as a grayscale picture, which is the picture shown on the right side of Figure 51. This picture gives the user an idea of ​​how the painting will look when painted. Generally, the user is not shown a histogram. After this, the user can give his approval. The picture on the right consists of four subareas, and is somewhere between the situation in Figure 35 (three subareas) and Figure 36 (five subareas). In an embodiment, the system shows the user several possible divisions, for example as shown diagrammatically in Figures 35, 36 and 37, i.e. Figure 35 a division into 3, Figure 36 a division into 5 and Figure 37 a division into 7. The system also allows the user to darken or lighten the picture.This allows the user to increase or decrease the size of the different sub-areas relative to each other. If the cutout is brighter, more pixels will appear in the brightest part. If the user is satisfied, approval can be given. The system then establishes the sub-areas and projects the first projected image, for example the brightest pixels of the right picture with white light (light intensity 255) and the remaining pixels with light intensity 0, for example, onto the painting canvas. The user selects a color, or is advised by the system a color with a grayscale value for the brightest segment, and the user colors the part indicated by the white light with that color. When the user indicates that this is finished, the system projects the second brightest pixel. This process is repeated until all projected images are finished. Depending on the dead color used, a situation may arise where the dead color used is the paint that may be used for the darkest pixel and the last projected image, in which case, if the user is satisfied with this, there is no need to apply additional paint to the darkest pixel.

[0158] FIG. 52 shows how the user can control the generation of sub-areas and make their own creative choices about how the image is divided into the projected image.

[0159] In the preferred embodiment, the user can input a picture, which is represented diagrammatically by a 'New Picture' button. The user can then decide to create a crop from the picture. The size and shape of the crop can be set. The crop forms part of the input picture that the user wants to paint or draw on. In this embodiment, the crop is shown below the picture. The figure shows the same crop, but with a darker and a lighter shade to the left and right of the crop. The user can darken or lighten the crop by using the cursor to select the associated darker or lighter picture. The figure is an illustration of an image editing operation to adjust brightness. Other forms of editing are possible in embodiments of the invention, such as changing the contrast, picture sharpness, crop size and shape. In certain embodiments, it is also possible to use Photoshop, add or remove elements. How the crop is divided into sub-areas is shown to the user below the crop. This allows the user to see if the division is too coarse, losing detail, or too fine, making painting difficult. In embodiments where the user can input the means they want to use to apply the paint, the system can give advice on the number of sub-areas.

[0160] If a fairly coarse painting tool such as a palette knife is selected, the optimal number of sub-areas will be less than if a fine brush is used. In an embodiment, the system comprises an input function that allows the user to select a painting style, and the system preferably comprises an output function that shows the image to the user after it has been processed according to the selected painting style. In an embodiment, the display can be by projection or by an image on the user's mobile display device, for example. Examples of styles that can be selected include impressionism, expressionism, cubism, paintings in the style of Picasso or Dali, cartoon style with certain parts of the face such as eyes, lips, ears enlarged, mirror effect distortion, changing the picture to a picture composed of blocks or dots, such as those shown in Figures 14 to 22, etc.

[0161] In a preferred embodiment, the system is configured to select one or more sets of paints for the sub-area after the sub-area has been established, and to present the one or more sets to the user.

[0162] Figures 53 to 56 show one possible method. Grayscale values ​​ranging from 0 for black to 255 for maximum light intensity for white are shown at the left edge of FIG.

[0163] We assign a grayscale value to each paint. This is no different from converting colors to grayscale values. The middle column shows the grayscale values ​​of several paints, paints A through K. The grayscale values ​​can be divided into four equal parts. Paints can be classified into four groups. Figure 52 shows groups 1-4, where group 1 has the highest grayscale value (white or nearly white) and group 4 has the lowest grayscale value (black or dark gray). Figure 53 shows the same division into six groups.

[0164] In figures 53 and 54 the grayscale is divided into four or six equal parts. This is not the only possible division. Figure 55 shows a division where the distribution near the center of the grayscale is finer than at the edges. Any grayscale range may of course be divided differently, resulting in a different distribution of paint between the groups.

[0165] In a preferred embodiment of the present invention, the system is configured to determine a set of one or more suitable color measures and present them to the user as a usable set. When determining a set of color measures that will be useful, the following rules are preferably followed: - A colour means is selected for each sub-area, which has a greyscale value within the greyscale range of the sub-area in question. The difference in the greyscale values ​​of the two selected colour means should be greater than the basic difference, which is preferably determined as follows: Base Difference=(average width of the grayscale range of the selected color) / N, where N is at most 4, preferably 3, and most preferably 2.

[0166] The choice of paint may depend on a user's preference for a given color, such as red, green, or blue.

[0167] The distance in grayscale values ​​between the two selected colors should be greater than one-quarter of the width of the grayscale range, preferably greater than one-third of the width of the grayscale range, and more preferably greater than one-half. If the difference in grayscale values ​​between the two selected paints is small, the optical effect will be small.

[0168] Fig. 56 shows a scheme of 60 paints, each painted in a shade of grey. In Fig. 55 the paints are subdivided into 14 groups. Group 1 is the lightest group and consists of titanium white, while group 14 is the darkest group and consists of very dark colours.

[0169] It is clear that the invention is not limited to the examples given here.

[0170] 57 shows an embodiment in which a subarea 57A is projected and also an attenuated version 57B, for example of the remaining part of the original image not belonging to the projected subarea 57A, at one-quarter or one-third of the original intensity, is projected. This allows the user to better estimate the location of the subarea in the overall original image. The method may, in embodiments, give the user the choice of whether to display the remainder of the image adjacent to the subarea in an attenuated version and / or to adjust the intensity of the remainder of the image.

[0171] Figure 58 shows an embodiment in which an image is displayed to a user through virtual reality glasses 58. A virtually projected sub-area on the canvas is displayed to the user and can be painted on, with the partial area invisible to those around them, only the canvas being painted is visible.

[0172] This gives a mystical aspect to the working method, as to those around, the user has come up with a good-looking picture of the well-known image "from the sky".

[0173] Virtual reality glasses come in a variety of versions aimed at providing users with image information that is projected either directly onto the eyes or onto the inside of the glasses.

[0174] According to the present invention, both types of projection can be used as a system for displaying optical projection images.

[0175] In the image seen by a person wearing the virtual reality glasses, the projected image of the light appears to be projected onto the subject being painted, and thus, visually, to the wearer of the virtual reality glasses, is projected onto the object being painted.

[0176] Briefly, the invention can be summarized as follows: The digital picture is divided into N pixel groups based on a property of the pixels. Based on this division, a set of N projection images is generated. Each projection image shows one of the pixel groups in substantially white light at one light intensity and the other pixels in a different light intensity. Preferably, the pixel property on which the division is based is a grayscale value, and preferably the remaining pixels are also projected in substantially white light.

Claims

1. 1. A system for displaying an optical projection image, comprising: a means for inputting a picture; means for providing image information to a light projection setup for displaying a light image on an object, in order to apply a picture painted or drawn on the object using different colors; means for dividing an input picture or a crop thereof, or an edited version of the input picture or a crop thereof, into three or more sub-areas based on pixel properties, each sub-area having a particular pixel property range; the image information includes information for displaying a set of three or more projected images; each projected image of the set displays one of three or more distinct sub-areas with substantially uncolored light of a first light intensity and a remainder of the picture or a remainder of a picture cutout with light of a second light intensity different from the first light intensity; The system, wherein the sub-areas together at least substantially cover the picture or a cutout of the picture.

2. The system of claim 1 , wherein the pixel property groups are divided based on pixel grayscale values.

3. The system of claim 1 , wherein a quotient of the first light intensity and the second light intensity is at least greater than 2 or at least less than 0.

5.

4. The system of claim 1 , wherein the set of projection images includes 4, 5, 6, or 7 projection images.

5. The system of claim 1 , wherein the system is configured to display three or more of the set of projection images sequentially in ascending or descending order of grayscale value.

6. 10. The system of claim 1, wherein the system comprises means for enabling a user to perform a crop from an input picture.

7. 2. The system according to claim 1, characterized in that it comprises means with an output function for displaying, together with the projected image, the characteristics of one or more color means used for instructional purposes when applying a subarea belonging to the projected image by light projected onto or next to the object.

8. 10. The system for displaying optical projection images of claim 1, wherein said means also includes an input function for inputting a set of three or more projection images from an existing database portfolio.

9. 2. The system for displaying a light projection image of claim 1, wherein said means comprises a function for providing a picture of color values to a converter that converts a color picture into a grayscale picture.

10. The system for displaying optical projection images according to claim 1 , further comprising an input function that allows a user to input a set of three or more projection images.

11. 9. The system for displaying optical projection images of claim 8, comprising an analyzer for analyzing an input color picture or cutout and / or grayscale picture or cutout, and a comparator for comparing the results of the analysis with a database containing data on color averages, and creating and presenting to a user one or more sample sets of color averages that match the analysis.

12. The system for displaying an optical projection image of claim 2 , wherein the projection image includes subareas having grayscale values between a lower grayscale value and an upper grayscale value specific to the projection image.

13. 10. The system for displaying light projection images of claim 1, comprising a projector or digital light screen for displaying a set of three or more projection images.

14. 10. The system for displaying optical projection images according to claim 1, comprising means including an internet site or application that enables the use of a digital service that provides a set of projection images for an input picture.

15. means including an internet site or application; the internet site or application includes an input option that allows a user to input a picture or crop to generate a set of projected images that will be displayed for the input picture or crop; 10. The system for displaying optical projection images of claim 1, comprising means with an output capability for showing a generated projection image to a user for use in an optical projection setup.

16. 10. The system for displaying optical projection images of claim 1, further comprising input functionality that allows a user to change one or more of the following characteristics of an input picture: - Brightness -contrast -Crop size -Cutout shape -Crop focus - Crop detail level

17. means including an input facility that allows a user to specify a desired technique or style; 10. The system for displaying a light projection image of claim 1, further comprising: means including an output function for providing instructions or suggestions in response to a specified desired technique to include the desired technique in the creation of the work.

18. The system of claim 1 , wherein the system comprises a measurement device for measuring color characteristics of applied paint, the measurement device including a camera for observing the color characteristics.

19. A method of producing a picture using a system according to any one of claims 1 to 18, comprising: The object is the painting canvas, a painting canvas provided with a background texture and / or color prior to displaying the projected image; The painting canvas is left unpainted for the lightest or darkest projected image, leaving the background texture and color visible as part of the applied picture. The background of the painted picture is not included as a painted surface, so it remains open and maintains the color of the painted background, A method in which the projected image shows only the object to be displayed from the picture or a crop of the image.

20. 1. A method for processing a digital picture, comprising: The digital picture is converted to a digital grayscale picture, The digital grayscale image is divided into three or more sub-areas based on pixel grayscale values with a specific grayscale range for each sub-area, and a set of three or more digital images is generated from the digital grayscale picture; each digital image of the set includes one of three or more sub-areas, pixels of which are assigned pixel values corresponding to a display having substantially colorless light of a first light intensity; a remainder of the digital picture is assigned pixel values corresponding to light of a second light intensity different from the first light intensity; The combined sub-area at least substantially covers the digital picture.

Images