Image processing device, method, system, computer readable medium and program product

Abstract

An image processing device, method, system and computer-readable medium are provided. The image processing device includes a processor, which obtains the color distribution of a processed image and the color distribution of a plurality of color samples prepared in groups in advance, and performs a process of changing the color of the processed image according to the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples.

Description

Technical Field

[0001] The present invention relates to an image processing device, an image processing method, an image processing system, a computer-readable medium and a program product. Background Art

[0002] The color combination of image content can arouse the desire to buy and influence the sales of goods. Therefore, how to combine colors in flyers or physical products, such as web design and package design, has become an important issue. In recent years, in order to meet such needs, services that analyze and quantify the color combinations used in image content have also increased. By making full use of such services, for example, when analyzing best-selling designs, attempts have been made to analyze the color histogram of images or the distribution of hue / saturation.

[0003] Japanese Patent Publication No. 2011-248641 discloses a color matching simulation system, which includes: a model image database, which stores model image data, multiple color matching area data for the model image data, and each representative color data of each color matching area data; a model image display unit, which displays the model image data; a color three-dimensional display unit, which displays a specified color three-dimensional with each representative color data pasted on it; an instruction unit, which issues an instruction to change each representative color data according to a sensitivity word; and a control unit, which changes the display of the model image display unit according to the change instruction, and changes the display of each representative color data of the color three-dimensional display unit.

[0004] Japanese Patent Gazette No. 2011-86092 discloses a color transformation device, which analyzes the distribution of colors on an acquired image, sets a color characteristic database having information related to the definition of colors, analyzes color differences for the analyzed colors, classifies the analyzed colors according to color types, sets a color difference analysis information database having information for analyzing the color differences, changes the color differences according to the color types obtained by the classification, transforms the colors on the acquired image, sets a transformation rule database having rules related to the changes in the color differences, and outputs a result after the color differences are transformed.

[0005] On the other hand, even if the colors used in the image are not analyzed, there are basic rules for color matching or theories of harmony that people like. Therefore, such human cognitive mechanisms can also be used as references for color matching. For example, similar harmony that combines colors with similar hues, same harmony that uses the same hue, or contrast harmony that uses highly saturated complementary colors to highlight each other's vividness can be achieved.

[0006] However, even if there is a preferred color matching pattern or harmony theory, in order to actually apply it to various images, it is necessary to change or replace the color of each structural element or object in the image. Moreover, when it includes adjustments while considering the overall harmony balance, a lot of work is required before the desired state is achieved. Summary of the invention

[0007] An object of the present invention is to provide an image processing device etc. which can reduce the user's work by reflecting a color matching pattern prepared in advance in the color matching of the processed image, compared with a case where the user adjusts the color of the processed image and the color after the change of each color.

[0008] According to the first scheme of the present invention, there is provided an image processing device, characterized in that it comprises a processor, which calculates the color distribution of a processed image and the color distribution of a plurality of color samples prepared in advance as a group, and performs processing for changing the color of the processed image based on the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples.

[0009] According to the second aspect of the present invention, the processor displays the processed image and the images of the plurality of color samples in parallel on a display device that displays images, and performs the processing according to the plurality of color samples selected by the user.

[0010] According to a third aspect of the present invention, the image of the plurality of color samples is an image showing the plurality of color samples using color bars or color blocks.

[0011] According to the fourth aspect of the present invention, the image of the plurality of color samples expresses the weight when reflecting each color sample when performing the processing, using the area occupied by each color sample.

[0012] According to the fifth aspect of the present invention, the area can be changed by a user.

[0013] According to the sixth aspect of the present invention, the user can further add colors in addition to the above-mentioned color samples.

[0014] According to a seventh aspect of the present invention, the processor receives a term indicating an impression of an image, and acquires the plurality of color samples based on the term.

[0015] According to an eighth aspect of the present invention, the processor acquires the plurality of color samples from a storage unit, and the storage unit stores the term and the plurality of color samples in association with each other based on a preset perception.

[0016] According to a ninth aspect of the present invention, the processor receives a result in which a user designates a region in the processed image on which the processing is to be performed.

[0017] According to a tenth aspect of the present invention, the processor performs processing by weighting each of the plurality of color samples.

[0018] According to the eleventh aspect of the present invention, as the processing, the processor weights the color closest to the color most frequently included in the processed image among the plurality of color samples more heavily than other colors.

[0019] According to a twelfth aspect of the present invention, as the processing, the processor adjusts the feature amount of the processed image to match the feature amounts of the plurality of color samples based on the weighting.

[0020] According to a thirteenth aspect of the present invention, the feature amount is an average value and a dispersion of the processed image and the plurality of color samples.

[0021] According to the 14th scheme of the present invention, there is provided an image processing system comprising: a display device which displays an image; and an image processing device which performs image processing on a processed image displayed on the display device, wherein the image processing device comprises a processor which calculates the color distribution of the processed image and the color distribution of a plurality of color samples which are prepared in advance as a group, and performs processing for changing the color of the processed image based on the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples.

[0022] According to the 15th scheme of the present invention, there is provided a computer-readable medium storing a program for causing a computer to execute processing, wherein the processing comprises the following steps: obtaining the color distribution of a processed image and the color distribution of a plurality of color samples prepared in advance as a group; and performing processing for changing the color of the processed image based on the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples.

[0023] According to the 16th scheme of the present invention, there is provided an image processing method, which has the following steps: calculating the color distribution of a processed image and the color distribution of a plurality of color samples prepared in advance as a group; and performing a process of changing the color of the processed image based on the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples.

[0024] (Effect)

[0025] According to the first aspect, an image processing apparatus can be provided that can reduce the user's work by reflecting a color pattern prepared in advance in the color of the processed image, compared with a case where the user adjusts the color of the processed image and the colors after the respective colors are changed.

[0026] According to the second aspect, the user can perform color adjustment while viewing the screen displaying the processed image and the color samples.

[0027] According to the third aspect, the user can easily understand the combination of color samples.

[0028] According to the fourth aspect, the user can easily understand the weight of each color sample.

[0029] According to the fifth aspect, the user can relatively easily set the weight of each color sample.

[0030] According to the sixth aspect, the user can set the color sample.

[0031] According to the seventh aspect, color adjustment can be performed based on the impression associated with the term.

[0032] According to the eighth aspect, it is easy to obtain terms that correspond to the user's perception as terms.

[0033] According to the ninth aspect, the user can select an area to be color adjusted.

[0034] According to the tenth aspect, weighting can be set in conjunction with the image to be processed.

[0035] According to the eleventh aspect, weighting can be performed in accordance with the color scheme of the processed image.

[0036] According to the twelfth and thirteenth aspects, the color adjustment process can be changed more easily.

[0037] According to the fourteenth scheme, it is possible to provide an image processing system that can reduce the user's work by reflecting a pre-prepared color pattern in the color of the processed image, compared to a case where the user adjusts the color of the processed image and the colors after the changes of each color.

[0038] According to the fifteenth aspect, compared with a case where the user adjusts the color of the processed image and the colors after the respective colors are changed, the user's work can be reduced by reflecting the color of the processed image based on the color pattern prepared in advance.

[0039] According to the sixteenth aspect, compared with a case where the user adjusts the color of the processed image and the colors after the respective colors are changed, the user's work can be reduced by reflecting the color of the processed image based on the color pattern prepared in advance. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 : is a diagram showing a configuration example of an image processing system in this embodiment.

[0041] Figure 2 This is a block diagram showing an example of a functional configuration of the image processing device according to the first embodiment.

[0042] Figure 3 (a) to (c) are diagrams showing examples of color images.

[0043] Figure 4 This is a diagram showing another example of a color image.

[0044] Figure 5 (a) to (b) are diagrams showing a case where the weight of each color sample is displayed as the size of the area.

[0045] Figure 6 This is a diagram showing a first example of a screen displayed on a display screen of a display device when color adjustment is performed.

[0046] Figure 7 This is a diagram showing a second example of a screen displayed on the display screen of the display device when color adjustment is performed.

[0047] Figure 8 This is a block diagram showing an example of a functional configuration of an image processing device according to the second embodiment.

[0048] Fig. 9 (a) to (b) are diagrams showing the relationship between a perceptual term and a color arrangement image composed of a plurality of color samples.

[0049] Fig.10 This is a diagram showing another example of associating a preference model with a color arrangement image.

[0050] Fig.11 1 is a diagram showing a first example of processing performed when a user selects a perception term on a map.

[0051] Fig.12 2 is a diagram showing a second example of processing performed when the user selects a perception term on the map.

[0052] Fig.13 3 is a diagram showing a third example of processing performed when the user selects a perception term on the map.

[0053] Fig.14 4 is a diagram showing a fourth example of processing performed when the user selects a perception term on the map.

[0054] Fig.15 This is a diagram showing a fifth example of the process performed when the user selects a perception term on the map.

[0055] Fig.16 (a) to (b) are diagrams showing examples of generating new color bars.

[0056] Fig.17 This is a block diagram showing an example of a functional configuration of an image processing device according to a third embodiment.

[0057] Fig.18 It is a diagram showing a first example of a shielding surface.

[0058] Fig.19 It is shown that the use Fig.18 A diagram showing the result of color adjustment based on the occluded surface.

[0059] Fig. 20 It is a diagram showing a second example of the shielding surface.

[0060] Fig.21 It is shown that the use Fig.18 and Fig. 20 A diagram showing the result of color adjustment based on the occluded surface.

[0061] Fig. 22 This is a diagram showing a first example of a screen displayed on the display screen of the display device when a graphic image is selected.

[0062] Fig.23 It is a diagram showing a second example of a screen displayed on the display screen of the display device when a graphic image is selected.

[0063] Fig.24 2 is a diagram showing a third example of a screen displayed on the display screen of the display device when the illustration image M is selected.

[0064] Fig.25 This is a flowchart illustrating the operation of the image processing system. DETAILED DESCRIPTION

[0065] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0066] <Description of the Overall Image Processing System>

[0067] Figure 1 1 is a diagram showing a configuration example of an image processing system 1 in the present embodiment.

[0068] As shown in the figure, the image processing system 1 of this embodiment has: an image processing device 10, which performs image processing on image information of an image displayed on a display device 20; a display device 20, which is input with image information generated by the image processing device 10 and displays an image based on the image information; and an input device 30, which is used for a user to input various information into the image processing device 10.

[0069] The image processing device 10 is, for example, a so-called general-purpose personal computer (PC) and generates image information by running various application software under the management of an OS (Operating System).

[0070] The image processing device 10 has a CPU as a computing unit, a main memory as a storage unit, and a memory such as a HDD or SSD (Solid State Drive). Here, the CPU is an example of a processor, and executes various software such as an OS (basic software) or application software. In addition, the main memory is a storage area for storing various software or data used in the execution of the software, and the memory is a storage area for storing input data for various software or output data input from various software.

[0071] Furthermore, the image processing apparatus 10 includes a communication interface (hereinafter referred to as “communication I / F”) for communicating with the outside, and input devices such as a keyboard, a mouse, a touch panel, and a stylus pen.

[0072] The display device 20 displays an image on a display screen 21. The display device 20 is composed of a device having a function of displaying an image by additive color mixing, such as a liquid crystal display for a PC, a liquid crystal television, or a projector. Therefore, the display method of the display device 20 is not limited to the liquid crystal method. Figure 1 In the example shown, the display screen 21 is provided in the display device 20 . However, when a projector is used as the display device 20 , for example, the display screen 21 is a screen or the like provided outside the display device 20 .

[0073] The input device 30 is composed of a mouse or a keyboard, etc. The details of starting and ending the application software for image processing by the input device 30 will be described later. However, when performing image processing, the input device 30 is used by the user to input instructions for performing image processing to the image processing device 10.

[0074] The image processing device 10 and the display device 20 are connected via DVI (Digital Visual Interface). Alternatively, they may be connected via HDMI (registered trademark) (High-Definition Multimedia Interface) or DisplayPort instead of DVI.

[0075] The image processing device 10 and the input device 30 are connected via, for example, a USB (Universal Serial Bus). Alternatively, the image processing device 10 and the input device 30 may be connected via IEEE1394 or RS-232C instead of the USB.

[0076] Although the details will be described later, in this embodiment, image processing is performed to match the color distribution of the processed image with the color distribution of the color sample. Thus, the color scheme of the color sample is reflected in the color scheme of the processed image, and the impression of the processed image becomes close to the impression of the color sample.

[0077] In such an image processing system 1, the image to be processed, that is, the image before image processing is performed, and the color sample are first displayed on the display device 20. Then, when the user inputs an instruction for performing image processing to the image processing device 10 using the input device 30, the image processing device 10 performs image processing on the image information of the image to be processed. The result of the image processing is reflected in the image displayed on the display device 20, and the image of the image to be processed after the image processing is drawn and displayed on the display device 20. In this case, the user can perform image processing while observing the display device 20.

[0078] In addition, the image processing system 1 in this embodiment is not limited to Figure 1 For example, a tablet terminal can be exemplified as the image processing system 1. In this case, the tablet terminal has a touch panel, and the user's instructions are input while the image is displayed through the touch panel. That is, the touch panel functions as a display device 20 and an input device 30. In addition, similarly, a touch display can also be used as a device that combines the display device 20 and the input device 30. This device is a device that uses a touch panel as the display screen 21 of the above-mentioned display device 20. In this case, image information is generated by the image processing device 10, and an image is displayed on the touch display based on the image information. Then, the user inputs instructions for image processing by touching the touch display, etc.

[0079] In the prior art, for example, the distribution of good image features is analyzed and set as quantized data. In this case, even if the user can refer to it as quantized data, it does not mean that the feature can be reflected in another image to reproduce the impression of the image.

[0080] In addition, in the prior art, sometimes a system that enables intuitive operation or a method that efficiently replaces HTML color codes is used. In this case, the following method is used: a plurality of areas as color matching objects are strictly defined locally, the colors of the target areas are changed, and the combination is assisted by a perception and color correspondence database.

[0081] Therefore, in this embodiment, a process is performed in which a plurality of color samples representing the impression of an image are prepared in advance and the image quality of the processed image is reflected in the color samples.

[0082] Hereinafter, the image processing device 10 for realizing this processing will be described.

[0083] <Description of Configuration of Image Processing Device 10>

[0084] [First embodiment]

[0085] First, the first embodiment will be described.

[0086] In the first embodiment, a color pattern is prepared in advance, and when the user selects the color image, the color of the color image is reflected in the color of the processed image.

[0087] Figure 2 This is a block diagram showing a functional configuration example of the image processing device 10 according to the first embodiment.

[0088] As shown in the figure, the image processing device 10 includes: a processed image acquisition unit 11, which acquires a processed image; a color image acquisition unit 12, which acquires a color image; a color distribution analysis unit 13, which analyzes the color distribution of the processed image and the color image; a color adjustment unit 14, which reflects the color of the color image in the color of the processed image; and a display image generation unit 15, which generates a display image displayed on the display device 20.

[0089] The processed image acquisition unit 11 acquires a processed image. In this embodiment, the processed image refers to an image that is subject to color adjustment as an image processing. The user selects an image to be color adjusted to determine the processed image, and the processed image acquisition unit 11 acquires the processed image selected by the user.

[0090] The color image acquisition unit 12 acquires a color image. In the present embodiment, the color image refers to an image composed of a plurality of color samples prepared in advance in groups. In addition, the plurality of color samples is a group of a plurality of colors set in advance. Therefore, it can be said that the color image has a predetermined color pattern.

[0091] The combination of color samples is associated with specific impressions such as "COOL", "WARM", "SOFT", and "HARD". In this combination, for example, a plurality of colors that are easy to use in images having these impressions are selected. In addition, the colors associated with these impressions may be colors selected based on experience.

[0092] The color image acquisition unit 12 is also determined by the user's selection, and the color image acquisition unit 12 acquires the color image selected by the user.

[0093] Figure 3 (a) to (c) are diagrams showing examples of color images.

[0094] Here, a case where a color image M is displayed using a color bar Cba is shown. The color bar Cba displays a plurality of color samples Mc arranged in sequence in one direction, and the illustrated color bar Cba is obtained by arranging three color samples Mc1 to Mc3.

[0095] In this way, by displaying the color image M using the color bar Cba, the user can understand it intuitively and easily.

[0096] The color distribution analysis unit 13 obtains the color distribution of the processed image and the color distribution of the color image M. The color distribution can be considered as a feature of the processed image or the color image M. It can be represented by an average value, a deviation, a histogram, etc. of each color component constituting the image. Here, as the color distribution, an arithmetic mean as an example of an average and a standard deviation as an example of a deviation are used.

[0097] The color distribution analysis unit 13 first performs color conversion on the image information (input image data) used to display the processed image and the color matching image M in the display device 20. In this case, the image information is RGB (red, green, blue) video data (RGB data). Then, the RGB data is converted into, for example, Lαβ data. That is, the chromaticity of the RGB color space is converted into the chromaticity of the Lαβ color space. The Lαβ color space is a color space designed to be statistically orthogonal by performing principal component analysis on the LMS cone responsiveness of natural images, and is a color space designed based on human perception. In this case, L, α, and β correspond to lightness (L), the yellow-blue axis (α), and the red-green axis (β), respectively.

[0098] Here, the pixel value of the processed image is assumed to be (L s , α s , β s ), the pixel value of the color matching image M is (L t , α t , β t ).

[0099] The color distribution analysis unit 13 calculates (L s , α s , β s ) and the arithmetic mean of the pixel values ​​of the color matching image M (L t , α t , β t) is the arithmetic mean. These are expressed by the following formula 1, in which the upper formula is (L s , α s , β s ) is the arithmetic mean, the formula on the lower side is (L t , α t , β t ) is the arithmetic mean of .

[0100]

[0101] In addition, the color distribution analysis unit 13 calculates (L s , α s , β s ) s、L , σ s、α , σ s、β ) and (L t , α t , β t ) t、L , σ t、α , σ t、β ).

[0102] return Figure 2 The color adjustment unit 14 performs color adjustment to reflect the color of the color image M in the color of the processed image. Here, the color adjustment unit 14 performs a process of changing the color of the processed image based on the relationship between the color distribution of the processed image and the color distribution of the color sample Mc.

[0103] Specifically, in order to make the pixel value (L s , α s , β s ) becomes the pixel value after color conversion (L O , α O , β O ), using the above-mentioned arithmetic mean and standard deviation, use the following formula 2 to perform.

[0104]

[0105] The display image generation unit 15 generates and outputs the image information after the color adjustment by the color adjustment unit 14. The image information after the color adjustment is sent to the display device 20. Then, the display device 20 displays an image based on the image information.

[0106] Through the above processing, the color matching of the color matching image M can be reflected in the color matching of the processed image. Thus, it is possible to perform color adjustment to change the impression of the processed image to the impression based on the color matching image M. In the present embodiment, the following case is described: in the color distribution analysis unit 13 and the color adjustment unit 14, the image information expressed by the chromaticity of the RGB color space is converted to the Lαβ color space, and the chromaticity of the Lαβ color space is used for processing, but it is not limited to this, and it can also be configured as a conversion from the RGB color space to the RGB color space, or a process using the chromaticity of the L*a*b* color space.

[0107] In addition, the color image M is not limited to Figure 3 The situation shown.

[0108] Figure 4 2 is a diagram showing another example of the color image M.

[0109] Here, a case where the color image M is displayed using a color patch Cbr is shown. The color patch Cbr is a color patch displayed by combining a plurality of color samples Mc vertically and horizontally, and the illustrated color patch Cbr is a color patch formed by combining four color samples Mc1 to Mc4.

[0110] Furthermore, the color sample Mc may be presented to the user as image information instead of being displayed as the color image M. In this case, image information such as RGB=(0, 50, 100), (50, 50, 200), (200, 100, 0) is displayed on the display screen 21 of the display device 20 .

[0111] Furthermore, when the color scheme of the color scheme image M is reflected in the color scheme of the processed image, the color adjustment can be performed by weighting each of the plurality of color samples Mc constituting the color scheme image M. In this case, for example, the color closest to the color most frequently included in the processed image among the plurality of color samples Mc can be weighted more heavily than other colors. In this case, the image after color adjustment tends to become more natural.

[0112] In addition, the weighting of each color sample Mc can also be predetermined. Moreover, it is also possible to display a color matching image M showing the weight according to the size of the area. The image of multiple color samples Mc uses the area occupied by each color sample Mc to show the weight when reflecting each color sample Mc when performing the above processing. In this case, the user can intuitively grasp the weighting.

[0113] Figure 5 (a) to (b) are diagrams showing a state where the weight of each color sample Mc is displayed according to the size of the area.

[0114] Among them Figure 5(a) shows the case of the color bar Cba. In this case, regarding the color samples Mc1 to Mc3, the weight of the color sample Mc1 is the smallest, the weight of the color sample Mc3 is the largest, and the weight of the color sample Mc2 is in between them (Mc1) (Mc1 <Mc2<Mc3)。

[0115] also, Figure 5 (b) shows the case of the color block Cbr. In this case, the weights of the color samples Mc1 to Mc4 are Mc4. <Mc1<Mc2<Mc3。

[0116] In addition, the user may be able to change these areas and change the weight accordingly. In addition, the user may be able to add a color in addition to the various color samples Mc prepared in advance.

[0117] Figure 6 1 is a diagram showing a first example of a screen displayed on the display screen 21 of the display device 20 when color adjustment is performed.

[0118] In the screen shown in the figure, the processed image H is displayed on the left side of the figure. In addition, Figure 3 The color image M shown in (b) of FIG. 1 is shown. The processed image H and the color image M can be selected by the user. Then, the processed image H' after color adjustment is displayed on the right side of the figure.

[0119] As described above, in the present embodiment, the processed image H and the color image M which is an image of a plurality of color samples Mc are displayed side by side on the display device 20 which displays the image, and color adjustment is performed based on the color image M selected by the user.

[0120] also, Figure 7 1 is a diagram showing a second example of a screen displayed on the display screen 21 of the display device 20 when color adjustment is performed.

[0121] The arrangement of the processed image H, the color image M, and the processed image H' after color adjustment in the screen shown in the figure is Figure 6 However, the color image M is changed to Figure 5 The color image M shown in (a) is subjected to the above-mentioned weighted color adjustment. Figure 6 Different color adjusted, color adjusted processed image H'.

[0122] [Second embodiment]

[0123] Next, a second embodiment will be described.

[0124] In the second embodiment, the user is caused to select a perception term expressing the impression of an image, and a plurality of color samples Mc are acquired based on the term.

[0125] Figure 8 It is a block diagram showing a functional configuration example of the image processing device 10 according to the second embodiment.

[0126] As shown in the figure, the image processing device 10 and Figure 2 The image processing device 10 shown in the figure is different in that a term conversion unit 16 is added. The functions of the other processed image acquisition unit 11, the color image acquisition unit 12, the color distribution analysis unit 13, the color adjustment unit 14, and the display image formation unit 15 are the same. Therefore, the following description will focus on the term conversion unit 16.

[0127] The term conversion unit 16 converts the perception term selected by the user into a plurality of color samples Mc. The perception term is an example of a term and is a language that expresses an impression of an image or the like. In this case, the perception term and the plurality of color samples Mc are associated with each other based on a predetermined perception and stored in a storage unit that stores the relationship. The storage unit may be provided in the image processing device 10 or in an external device such as a cloud server, and the term conversion unit 16 may obtain the information from the storage unit.

[0128] Fig. 9 (a) to (b) are diagrams showing the relationship between the perceptual term Ky and the color image M composed of a plurality of color samples Mc.

[0129] Among them Fig. 9 (a) shows the preference model.

[0130] The so-called preference model is a model obtained by classifying people's preferences or impressions of certain objects. Here, as a preference model, the preference model described in Fuji Xerox Technical Report No. 232014 "Consumer Understanding and Design Assistance Using Preference Models" is exemplified and listed. In this preference model, the impression is expressed by a mapping Mp formed by orthogonal coordinates of two axes WARM←→COOL and SOFT←→HARD, and perceptual terms Ky such as "cute", "romantic", and "charming (cute)" are arranged on the mapping Mp. That is, the position where these perceptual terms Ky are arranged becomes the position where these perceptual terms Ky are consistent with the image represented by the preference model. In addition, the above two axes can be determined by any reference.

[0131] Fig. 9 (b) is a diagram that associates the preference model with the color matching image.

[0132] In this case, the color image M is arranged corresponding to the perceptual term Ky on the map Mp representing the preference model. Fig. 9 (b) can obtain a plurality of color samples Mc corresponding to the perceptual term Ky selected by the user.

[0133] Fig.10 This is a diagram showing another example of associating the preference model with the color image M.

[0134] Here, as the perception term Ky, an example is shown in which "feeling stable" and "impression of ○○" correspond to the color image M. Among them, "feeling stable" corresponds to one color bar Cba1 as the color image. On the other hand, "impression of ○○" corresponds to two color bars Cba2 and Cba3 as the color image M. In this way, one perception term Ky can correspond to multiple color images M. Then, color adjustment is performed using multiple color images M.

[0135] In addition, if Fig. 9 The color image M shown in (b) does not necessarily have to be presented to the user, but may only be presented Fig. 9 (a) Preference model.

[0136] Then, when the user selects any one of these perception terms Ky on the map Mp, the color image M is finalized and color adjustment is performed.

[0137] Fig.11 1 is a diagram showing a first example of processing performed when the user selects a perception term Ky on the map Mp.

[0138] Here, the selection is made by touching the area occupied by the term Ky on the map Mp. Fig.11 In the example shown in the figure, the area is indicated by a dotted line. In addition, the case where the portion "like ○○" on the map Mp is touched without displaying the color image M is shown. In addition, the weights of the plurality of color samples Mc constituting the color image M can be determined based on the position of the perceptual term Ky within the area occupied by the map Mp, and the above-mentioned weighted color adjustment can be performed.

[0139] Fig.12 2 is a diagram showing a second example of processing performed when the user selects a perception term Ky on the map Mp.

[0140] Here, the following situation is shown: Fig.10 When a plurality of color images M are displayed like the two color bars Cba2 and Cba3 shown in FIG. 1 , the user is presented with processed images H1 ′ and H2 ′ that have been color-adjusted using the respective color images M. The user can then select either of the two images.

[0141] Fig.13 3 is a diagram showing a third example of processing performed when the user selects a perception term Ky on the map Mp.

[0142] Here, the case is shown in which the user selects any one of the two color bars Cba4 and Cba5 when the two color bars are displayed as the color image M. The plurality of color images M may be displayed in advance or may be displayed when the user touches them.

[0143] Fig.14 4 is a diagram showing a fourth example of processing performed when the user selects a perception term Ky on the map Mp.

[0144] Here, the following case is shown: the color image M included in the image Mp is not composed of a plurality of color samples Mc, but a color image M composed of a single color sample Mc. That is, the color image M is monochrome, and can be associated with a hue such as brown and black. In this case, when calculating the arithmetic mean and standard deviation, the calculation can be performed by giving the monochrome image some gradient. Alternatively, the chromaticity of the monochrome can be simply applied.

[0145] Fig.15 3 is a diagram showing a fifth example of processing performed when the user selects a perception term Ky on the map Mp.

[0146] Here, the case where two perception terms Ky, “like ○○” and “with the impression of ○○”, are selected is shown.

[0147] In this case, the following example is shown: Fig.16 As shown in (a), for the color bar Cba6 and the color bar Cba7, which are the color images M corresponding to the two perception terms Ky, the average value is calculated between the respective color samples Mc5, Mc6, Mc7 and the color samples Mc8, Mc9, Mc10, and a new color bar Cba8 is generated. Here, the average value of the color sample Mc5 and the color sample Mc8, the average value of the color sample Mc6 and the color sample Mc9, and the average value of the color sample Mc7 and the color sample Mc10 are calculated respectively. As a result, the color samples Mc11, Mc12, and Mc13 are generated. In addition, the average value is calculated without weighting the color samples Mc5, Mc6, Mc7 (and the color samples Mc8, Mc9, Mc10) constituting the color bars Cba6 and Cba7. However, weighting may be performed to calculate a weighted average value.

[0148] In addition, if Fig.16 As shown in (b), the color samples Mc5, Mc6, Mc7, Mc8, Mc9, and Mc10 constituting the color bars Cba6 and Cba7 may be simply connected to generate a new color bar Cba9. In this case, the color bar Cba9 is composed of six color samples Mc.

[0149] (Third embodiment)

[0150] Next, a third embodiment will be described.

[0151] In the third embodiment, the user can designate a region in the processed image H for which color adjustment is desired.

[0152] Fig.17 It is a block diagram showing a functional configuration example of an image processing device 10 according to the third embodiment.

[0153] As shown in the figure, the image processing device 10 and Figure 2 The image processing device 10 shown in the figure is different in that an area designation unit 17 is added. The functions of the other processed image acquisition unit 11, color image acquisition unit 12, color distribution analysis unit 13, color adjustment unit 14, and display image formation unit 15 are the same for both. Therefore, the following description will focus on the area designation unit 17.

[0154] The area designation unit 17 designates an area in the processed image H that is to be color-adjusted or an area that is not to be color-adjusted, according to the user's instruction. That is, when the user designates an area in the processed image H that is to be color-adjusted, the color adjustment is performed on the area, but the color adjustment is not performed on other areas. In addition, when the user designates an area in the processed image H that is not to be color-adjusted, the color adjustment is not performed on the area, but the color adjustment is performed on other areas. Here, the latter is described, and the former is also applicable to the same process, except that the area to be color-adjusted and the area not to be color-adjusted are reversed.

[0155] When the user specifies a region in the processed image H that is not to be color adjusted, the user specifies the region using the input device 30 such as a mouse for example, with respect to the processed image H displayed on the display screen 21. Then, the region specifying unit 17 generates a blocking surface for the region specified by the user.

[0156] Fig.18 is a diagram showing the first example of the shielding surface. Fig.19 It is shown that the use Fig.18 The result of color adjustment based on the occluded surface.

[0157] Fig.18 The occluding surface Ma1 shown is applied to Fig.19 The processed image H on the left side of the figure. In this case, the occlusion surface Ma1 does not perform color adjustment on the background area Bk of the processed image H. And, as a result, in the color-adjusted processed image H' on the right side of the figure, the background area Bk is not color-adjusted, but other areas are color-adjusted.

[0158] Fig. 20 : is a diagram showing a second example of an occluding surface. Fig.21 It is shown that the use Fig.18 and Fig. 20 A diagram showing the result of color adjustment based on the occluded surface.

[0159] Fig. 20 The occluding surface Ma2 shown is applied to Fig.21 In this case, the occlusion surface Ma2 is applied to the text area Mj of the processed image H. Moreover, it is possible to make it so that the color of the text area Mj is not adjusted. Fig. 20 The shielding surface Ma2 shown may also adjust the color of the text area Mj to be different from other areas, such as directly setting the color specified. Fig.21 The color-adjusted processed image H' shown shows that the color adjustment is performed by using the occluding surface Ma1. Fig.19 The same color adjustment is performed and the color of the text area Mj is adjusted differently from that of other areas by using the occlusion surface Ma2.

[0160] [Fourth embodiment]

[0161] Next, a fourth embodiment will be described.

[0162] In the fourth embodiment, a user interface (UI) when color adjustment is actually performed will be described.

[0163] Fig. 22 1 is a diagram showing a first example of a screen displayed on the display screen 21 of the display device 20 when the color image M is selected.

[0164] Here, the processed image H (here, the original image is shown) is displayed on the upper left side of the display screen 21, and the processed image H after color adjustment (here, the reproduced image is shown) is displayed on the upper right side of the display screen 21. Then, a list of perceptual terms Ky is displayed at the lower part of the display screen 21. Then, when the user presses the radio button Rb, any perceptual term Ky can be selected and the color image M corresponding to it can be selected. In addition, the color image M is not displayed here. In addition, a check button may be used instead of the radio button Rb.

[0165] Fig.23 2 is a diagram showing a second example of a screen displayed on the display screen 21 of the display device 20 when the illustration image M is selected.

[0166] Here, with Fig. 22 Compared with the case of FIG. 2 , the difference is that the color bar Cba or the color block Cbr as the color image M is displayed at the lower part of the display screen 21. Then, when the user touches any one of the color bar Cba or the color block Cbr, the color image M is selected.

[0167] Fig.242 is a diagram showing a third example of a screen displayed on the display screen 21 of the display device 20 when the illustration image M is selected.

[0168] Here, with Fig. 22 The difference is that the perceptual terms Ky are displayed on the map Mp representing the preference model at the bottom of the display screen 21. Then, when the user touches the area of ​​any perceptual term Ky, the color image M corresponding to it is selected. In addition, the color image M is not displayed here.

[0169] <Description of Operation of Image Processing System 1>

[0170] Next, the operation of the image processing system 1 will be described.

[0171] Fig.25 : is a flowchart explaining the operation of the image processing system 1 .

[0172] First, the processed image acquisition unit 11 acquires image information of the processed image H (step 101). In this case, the user selects the processed image H, and the processed image acquisition unit 11 acquires the image information. In addition, at this time, as in the third embodiment, the user may specify an area in the processed image H that is to be color-adjusted and an area that is not to be color-adjusted, and the area designation unit 17 may generate an occlusion surface.

[0173] Next, the color image acquisition unit 12 acquires image information of the color image M (step 102). In the first embodiment, this is performed by the user selecting the color bar Cba or the color block Cbr as the color image M. In the second embodiment, this is performed by the user selecting the perceptual term Ky. In this case, the term conversion unit 16 acquires the color image M from the storage unit based on the perceptual term Ky, and transfers the color image M to the color image acquisition unit 12.

[0174] Then, the color distribution analysis unit 13 obtains color distribution for the processed image H and the color image M (step 103 ). In this case, the color distribution analysis unit 13 obtains, for example, the above-mentioned arithmetic mean and standard deviation as the color distribution.

[0175] Then, the color adjustment unit 14 performs color adjustment so that the color of the color image M is reflected in the color of the processed image H (step 104 ).

[0176] Then, the display image generating unit 15 generates and outputs the image information after the color adjustment by the color adjusting unit 14 (step 105 ).

[0177] According to the image processing device 10 described above, in the first embodiment, the user can easily adjust the color of the processed image H by selecting the color image M in which a plurality of color samples are arranged. In the second embodiment, the user can easily adjust the color of the processed image H by selecting the perceptual term Ky.

[0178] This can also be said that, compared with a case where the user adjusts the color of the processed image H and the color after each color change, the color pattern prepared in advance can be reflected in the color of the processed image H, thereby reducing the user's work.

[0179] <Description of the program>

[0180] The processing performed by the image processing device 10 in this embodiment is realized by cooperation between software and hardware resources. That is, a CPU (not shown) provided inside the image processing device 10 executes a program realizing each function of the image processing device 10, thereby realizing each function.

[0181] Therefore, the processing performed by the image processing device 10 can also be understood as a program for enabling a computer to implement the following functions: a function of calculating the color distribution of the processed image H and the color distribution of a plurality of color samples Mc prepared in groups in advance, and a function of changing the color of the processed image H based on the relationship between the color distribution of the processed image H and the color distribution of the plurality of color samples Mc.

[0182] In the above example, the arithmetic mean is used as the average value, but it is not limited to this, and it may be a geometric mean, etc. In the above example, the standard deviation is used as the deviation, but it is not limited to this, and various indicators such as standard deviation and variance may be used.

[0183] Furthermore, in the above example, the color distribution analysis unit 13 transforms the RGB data into Lαβ data, but the present invention is not limited thereto, and any chromaticity data in a color space that can be separated into chromaticity components and brightness components may be used. For example, the Lαβ data may be replaced by CIEL*a*b* data, IPT data, CAMO2 data, HSV data, etc.

[0184] The present embodiment has been described above, but the technical scope of the present invention is not limited to the scope described in the above embodiment. According to the description of the claims, various changes or improvements made to the above embodiment may also be included in the technical scope of the present invention.

Claims

1. An image processing device, wherein: The image processing device comprises a processor. The processor obtains the color distribution of the processed image and the color distribution of a plurality of color samples prepared in groups in advance, and performs a process of changing the color of the processed image according to the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples. The processor causes a display device that displays images to display the processed image and the images of the plurality of color samples side by side. The processor performs the processing according to the plurality of color samples selected by the user, In the image of the plurality of color samples, the weight of each color sample when reflecting the color sample in the processing is represented by the area occupied by the color sample.

2. The image processing device according to claim 1, wherein: In the image of the plurality of color samples, the plurality of color samples are displayed using color bars or color blocks.

3. The image processing device according to claim 1, wherein: The area can be changed by the user.

4. The image processing device according to claim 1, wherein: In addition to the various color samples described above, users can also add colors.

5. The image processing device according to claim 1, wherein: The processor receives a term indicating an impression of an image, and acquires the plurality of color samples based on the term.

6. The image processing device according to claim 5, wherein: The processor obtains the plurality of color samples from a storage unit, and the storage unit stores the term in association with the plurality of color samples according to a predetermined perception.

7. The image processing device according to claim 1, wherein: The processor receives a result of a user designating a region to be processed in the processed image.

8. The image processing device according to claim 1, wherein: The processor performs the processing by weighting each color sample among the plurality of color samples.

9. The image processing apparatus according to claim 8, wherein: As the processing, the processor weights a color, among the plurality of color samples, that is closest to a color most frequently included in the processed image more heavily than other colors.

10. The image processing device according to claim 8, wherein: As the processing, the processor adjusts the feature amount of the processed image to match the feature amounts of the plurality of color samples based on the weighting.

11. The image processing apparatus according to claim 10, wherein: The feature amounts are average values ​​and deviations of the processed image and the plurality of color samples.

12. An image processing system comprising: A display device that displays an image; and an image processing device for performing image processing on an image to be processed displayed on the display device, The image processing device comprises a processor. The processor obtains the color distribution of the processed image and the color distribution of a plurality of color samples prepared in groups in advance, and performs a process of changing the color of the processed image according to the relationship between the color distribution of the processed image and the color distribution of the plurality of color samples. The processor causes the display device for displaying images to display the processed image and the images of the plurality of color samples side by side. The processor performs the processing according to the plurality of color samples selected by the user, In the image of the plurality of color samples, the weight of each color sample when reflecting the color sample in the processing is represented by the area occupied by the color sample.

13. A computer-readable medium storing a program for causing a computer to execute a process, wherein: The process has the following steps: Calculating the color distribution of the processed image and the color distribution of a plurality of color samples prepared in groups in advance; performing a process of changing the color of the processed image according to a relationship between the color distribution of the processed image and the color distributions of the plurality of color samples; causing a display device for displaying images to display the processed image and the images of the plurality of color samples side by side; Performing the processing according to the plurality of color samples selected by the user; as well as In the image of the plurality of color samples, the weight of each color sample when reflecting the color sample in the processing is represented by the area occupied by the color sample.

14. A program product comprising a program for causing a computer to execute a process, the process comprising the following steps: Calculating the color distribution of the processed image and the color distribution of a plurality of color samples prepared in groups in advance; performing a process of changing the color of the processed image according to a relationship between the color distribution of the processed image and the color distributions of the plurality of color samples; causing a display device for displaying images to display the processed image and the images of the plurality of color samples side by side; Performing the processing according to the plurality of color samples selected by the user; and In the image of the plurality of color samples, the weight of each color sample when reflecting the color sample in the processing is represented by the area occupied by the color sample.

15. An image processing method, wherein: It has the following processes: Calculate the color distribution of the processed image and the color distribution of a plurality of color samples prepared in groups in advance; performing a process of changing the color of the processed image according to a relationship between the color distribution of the processed image and the color distributions of the plurality of color samples; causing a display device for displaying images to display the processed image and the images of the plurality of color samples side by side; Performing the processing according to the plurality of color samples selected by the user; as well as In the image of the plurality of color samples, the weight of each color sample when reflecting the color sample in the processing is represented by the area occupied by the color sample.

Images