Information processing system, server, information processing method, and program

Abstract

To enlarge a mask image by a more appropriate method.SOLUTION: There is provided an information processing system. First creation means creates a reduced image obtained by reducing an original image. Display control means displays the reduced image on a display of a predetermined device. Second creation means creates a mask image to be overlapped on the reduced image displayed on the display based on a user's input to the predetermined device. Enlargement means enlarges the mask image by using different interpolation methods between a case where the mask image has a predetermined property and a case where the mask image does not have the predetermined property.SELECTED DRAWING: Figure 11

Description

Technical Field

[0001] The present invention relates to an information processing system, a server, an information processing method, and a program.

Background Art

[0002] In the editing of posters, albums, etc., images may be used. In such a case, an editing operation (hereinafter referred to as "filling") of filling a part of the image with an arbitrary color may be performed for the purpose of partially correcting the color or hiding information that is not desired to be seen. In the document management image editing system described in Patent Document 1, when filling is performed on an arbitrary location of an image within the image editing system, it is possible to select whether to fix mask information when writing out the image data to the outside. Thereby, it is realized to hide an arbitrary part of the image file and distribute it to the outside.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, generally, in image editing by a web application or the like, instead of displaying the original image to be edited as it is, a reduced image (thumbnail) obtained by reducing the original image for display is displayed to improve the operation speed. In such a case, when writing out the filling result, it is necessary to expand the mask image from the size corresponding to the reduced image to the size corresponding to the original image and then synthesize it with the original image. In the expansion of the mask image, for example, a known interpolation method such as the nearest neighbor method, the bilinear method, or the bicubic method may be used, but depending on the nature of the mask image, the expanded mask image may not conform to the user's intention.

[0005] The present invention provides a technique for enlarging a mask image in a more appropriate manner.

Means for Solving the Problems

[0006] According to one aspect of the present invention, first generation means for generating a reduced image obtained by reducing the original image; display control means for displaying the reduced image on a display unit of a predetermined device; second generation means for generating a mask image to be superimposed on the reduced image displayed on the display unit based on an input of a user to the predetermined device; enlarging means for enlarging the mask image using different interpolation methods depending on whether the mask image has a predetermined property or not, Huh, The predetermined property is a property related to the color of the mask image. An information processing system characterized by the above is provided.

Effects of the Invention

[0007] According to the present invention, a mask image can be enlarged in a more appropriate manner.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0010] <First Embodiment> <System Configuration> FIG. 1(a) is a hardware configuration diagram of an information processing system 1 according to the present embodiment. Further, FIG. 1(b) is a software configuration diagram of the information processing system 1. The information processing system 1 is a system for a user to edit an image in order to create a poster, an album, or the like. The information processing system 1 includes an information processing apparatus 2 and an information processing terminal 9. The information processing apparatus 2 and the information processing terminal 9 are configured to be communicable via a network NW such as the Internet.

[0011] The information processing apparatus 2 is a system that executes processing as a server in a web application. The information processing apparatus 2 includes a CPU 21, a ROM 22, a RAM 23, and an HDD 24. The CPU 21 is a central processing unit that controls the entire information processing apparatus 2 by executing programs stored in the ROM 22 or the RAM 23 or the like. The ROM 22 is a read-only memory in which various programs are stored. The RAM 23 is a random access memory that is used as a work memory for the CPU 21, but can also store each program if it is a non-volatile RAM. The HDD 24 is a hard disk drive that stores an operating system, system software, application software, image data, setting data, and the like. Also, other storage devices such as an SDD may be provided.

[0012] In the present embodiment, the CPU 21 functions as a server system including each server shown in FIG. 2(b) by reading out and executing a program stored in the ROM 22 or the HDD 24 into the RAM 23. Here, one information processing apparatus 2 is shown, but the functions of each server may be realized by a plurality of information processing apparatuses. For example, an information processing apparatus constituting the program execution server 3, an information processing apparatus constituting the storage server 4, and an information processing apparatus constituting the print execution server 5 may be provided respectively. Also, for example, one server may be constituted by a plurality of information processing apparatuses.

[0013] The program execution server 3 executes a server program 6 that is a program operating on the information processing apparatus 2. The server program 6 is stored and managed by the program execution server 3. Physically, the server program 6 is stored in the HDD 24 or the like of the information processing apparatus 2 that functions as the program execution server 3.

[0014] The storage server 4 stores and manages various types of data used in web applications. The storage server 4 stores editing data 7 such as image data of images used for editing, and print data 8 for printing the edited product, etc. Physically, these data are stored in the HDD 24, etc. of the information processing device 2 that functions as the storage server 4.

[0015] The print execution server 5 performs processing for printing the edited product. For example, when the print execution server 5 receives a print instruction from the user, it transmits the print data 8 stored in the storage server 4 to a print execution application 18 described later.

[0016] In addition, the information processing device 2 includes a communication interface (not shown) for communicating with an external device (e.g., information processing terminal 9) via a network NW such as the Internet.

[0017] The information processing terminal 9 is an information processing terminal for a user to edit images using a web application. The information processing terminal 9 may be a terminal device such as a general personal computer, a smartphone, or a tablet. The information processing terminal 9 includes a CPU 10, a ROM 11, and a RAM 12. In addition, the information processing terminal 9 is connected to a monitor 13 for displaying various information, a printer 14 for printing the print data 8, an input device 15 for receiving input from the user, and a storage device 16 for storing various data and programs. Note that these input / output devices may be provided as separate devices from the information processing terminal 9, or at least some of the devices may be included in the information processing terminal 9.

[0018] The CPU 10 is a central processing unit that controls the entire information processing terminal 9 by executing an OS (operating system) stored in a storage device 16, a ROM 11, a RAM 12, or the like. Also, the CPU 10 executes a web browser 17, a print execution application 18, or other programs stored in the ROM 11 or the RAM 12 or the like. Then, the CPU 10 performs calculations based on the input data, processes and outputs the data, and controls each hardware to realize each function of the information processing terminal 9. The ROM 11 is a read-only memory in which each program is stored. The RAM 12 is a random access memory and is used as a work memory for the CPU 10. However, if it is a non-volatile RAM, each program can also be stored. In the present embodiment, the CPU 10 functions as each software shown in FIG. 2(b) by reading out the program stored in the ROM 11 and executing it in the RAM 12.

[0019] The web browser 17 is software for browsing a website on the Internet or executing a web application. When the web browser 17 executes a web application, it receives a client program 19 from the information processing device 2 as a server system. Then, the web browser 17 executes the received client program by a program analysis unit 20 that interprets a script language such as HTML or JavaScript. The print execution application 18 acquires print data 8 from the storage server 4 and transmits it to the printer 14 to cause the printer 14 to perform printing. In the present embodiment, it is assumed that the programs of the web browser 17 and the print execution application 18 are stored in the ROM 11. However, as described above, they may be stored in the RAM 12 or the storage device 16.

[0020] In addition, the information processing terminal 9 includes a communication interface (not shown) for communicating with an external device (e.g., the information processing device 2) via a network NW such as the Internet. Further, the information processing terminal 9 includes an interface (not shown) for connecting to a monitor 13, a printer 14, an input device 15, a storage device 16, and the like.

[0021] <Screen example of a web application> FIG. 2 is a diagram showing a screen example of a web application for performing poster editing that operates on the web browser 17. The screen of the web application referred to in this screen and the following description is displayed on the monitor 13 by display control of the monitor 13 (display unit) by, for example, the information processing device 2. The poster 201 shows a preview of the poster that the user is currently editing.

[0022] The area 202 is an area for selecting the type of object to be added to the poster 201. In this example, the "image" of the button 203 is selected.

[0023] The area 204 is an area where the content of the object selected in the area 202 is displayed. In this example, since the image of the button 203 is selected, a list of images added by the user is displayed in the area 204. The image group displayed in the area 204 does not have to be limited to the user's images, and for example, template images held by the web application may be displayed.

[0024] The button 205 is a button for adding an image to the area 204. When the button 205 is selected, the information processing terminal 9 can display a dialog for selecting an image stored in the user terminal and accept the selection of an arbitrary image by the user. Alternatively, when the button 205 is selected, the information processing terminal 9 may acquire an image from the cloud or an image providing service. The image added by the button 205 is added and displayed in thumbnail size to the image group in the area 204 (see FIG. 3).

[0025] Thumbnail 207 is an image placed within poster 201. This is added by a drag operation from thumbnail 206, which is one of the image group within area 204.

[0026] Button 208 is a button for printing poster 201. When button 208 is pressed, information processing terminal 9 installs or launches print execution application 18 and causes printer 14 to execute printing.

[0027] <Thumbnail creation flow> FIG. 3 shows an example of a flow in which, after a user adds an image with button 205, information processing terminal 9 creates and displays a thumbnail like thumbnail 206 on a web browser.

[0028] In step S301 (hereinafter, each step will simply be denoted as S301 etc.), when the user selects button 205 and selects an image (original image) to be used for editing from the opened dialog, web browser 17 accepts the selected original image.

[0029] In S302, web browser 17 generates a thumbnail (reduced image) obtained by reducing the original image accepted in S301 for display by a web application. In S303, web browser 17 displays the thumbnail 204 generated in S302.

[0030] In S304, web browser 17 transmits the original image accepted in S301 to information processing device 2. In S305, web browser 17 transmits the thumbnail generated in S303 to the server.

[0031] <Filling process> Next, an example of an image editing operation executable in a web application, namely the filling process, will be described. FIG. 4 shows a screen displayed on the web browser 17 when the user selects the thumbnail 207 on the screen shown in FIG. 2. In the area 401, a menu for editing the thumbnail 207 is displayed. The button 402 is a button for performing an editing operation of filling a part of the thumbnail 207 with an arbitrary color.

[0032] FIG. 5 shows a screen displayed on the web browser 17 when the user selects the button 402 shown in FIG. 4. The fill dialog 501 is a UI (user interface) for performing filling. The button 502 is a button for reflecting the result of filling on the thumbnail 207. The button 503 is a button for canceling the fill editing operation. The color display button 504 is a button for displaying the color to be filled and for changing the color to be filled.

[0033] The thumbnail 207 is the thumbnail to be edited and was the one selected in FIG. 4. The user can specify the fill range 507 by a drag operation or the like of moving the cursor 506 on the thumbnail 207 using an input device 15 such as a pointing device. The specified fill range 507 is filled with the color displayed on the color display button 504 and is displayed on the thumbnail 207.

[0034] When the user wants to change the fill color, the user selects the color display button 504. When the color display button 504 is selected, a balloon 508 is displayed. The user can change the fill color by selecting any of the colors displayed in the balloon 508. In this example, the state where the display of the color display button 504 has been changed to a special color is shown by the selection of the button 510.

[0035] In this embodiment, as colors that can be selected as the filling color, normal colors and special colors are listed and displayed within the balloon 508. And in this embodiment, it is assumed that the printer 14 is a printing device capable of printing using special ink. The special ink is ink that expresses a special feature (hereinafter also referred to as a "spot color"), for example, ink whose color expressed during printing cannot be displayed in the sRGB color space. That is, the printer 14 is configured to be capable of spot color printing, which is printing using spot color ink (that is, special ink, hereinafter also referred to as "spot color ink") other than normal ink.

[0036] "Normal ink" refers to ink for printing process colors (normal colors), such as cyan (C), magenta (M), yellow (Y), black (K), etc., which are the basis of process colors. Note that process color is a color represented by one of CMYK or a combination of two or more of CMYK. In this embodiment, fluorescent pink ink and fluorescent orange ink are used as spot color inks. That is, spot color is a color different from process color and cannot be represented only by one of CMYK or a combination of two or more of CMYK. However, it is not limited to this form, and the number and color of spot color inks can be arbitrary, and non-fluorescent color inks may be used. For example, violet ink, green ink, orange ink, gold ink, silver ink, etc. may be used as spot color inks. Also, other metallic color inks may be used. Furthermore, ink obtained by blending special ink with other ink (e.g., normal ink) may also be treated as special ink. In this embodiment, information indicating that an object is printed in a special color (referred to as special color information) is associated with the object printed in a special color. And the pixel with special color information added is printed according to the special color corresponding to the RGB value of the pixel. Note that the RGB value of the pixel corresponding to the special color can also be used as the RGB value of the pixel corresponding to the color represented only by normal ink (i.e., normal color). In other words, the same RGB value as the RGB value of the pixel corresponding to the special color may be set for the pixel corresponding to the color represented only by normal ink. In that case, whether to use special ink for printing the pixel with that RGB value is controlled by whether special color information is added.

[0037] Figure 6 shows the relationship between the types of features that can be used for filling and the RGB values when displayed on the screen. When a feature within the callout 508 is selected, filling is performed with the color represented by the corresponding RGB value in the table of Figure 6. For example, when the button 510 is selected in Figure 5, since Feature_3 in Figure 6 corresponds, the color represented by R = 191, G = 192, B = 191 becomes the filling color.

[0038] Figure 7 is a diagram showing an example of the screen of a web application, and shows a state where filling with a feature has been performed. The filling range 701 is the area where the user has performed filling with Feature_3. When the user selects the button 502 in this state, the edited thumbnail is reflected in the poster 201.

[0039] Figure 8 is a flowchart showing an example of the processing executed by the CPU 10. This flowchart starts, for example, when the button 502 shown in Figure 7 is selected and the fill dialog 501 is closed. Each process in this flowchart is realized, for example, when the CPU 10 reads and executes the client program 19.

[0040] In S801, the CPU 10 determines whether filling has been performed. If the CPU 10 determines that filling has been performed, it proceeds to S802, and if not, it ends the flowchart. For example, when the button 502 is selected in the state of Figure 7, since the fill ranges 507, 701 are specified in the fill dialog 501, the CPU 10 determines that filling has been performed and proceeds to S802.

[0041] In S802, the CPU 10 acquires the size of the thumbnail 207 in order to determine the size when creating a mask image. In this embodiment, the mask image is an image to be printed overlaid on the upper part of the original image selected and input by the user. Therefore, the mask image is an area for printing the original image overlaid under the mask image, and includes an area where no color is specified and an area where the mask image is printed without printing the original image overlaid under the mask image and where the color is specified. For the area where no color is specified, for example, as RGB values, R = 0, G = 0, B = 0 are set, and for the area where the color is specified, as RGB values, the values corresponding to the specified color are set. Note that the area where filling described later is performed becomes the area where the color is specified.

[0042] In S803, the CPU 10 determines whether a feature is used for filling. If the CPU 10 determines that a feature is used for filling, it proceeds to S804; otherwise, it proceeds to S805. For example, the CPU 10 acquires the RGB values of the color used for filling and makes a determination by comparing with the display RGB values in FIG. 6. Specifically, the CPU 10 may determine that a feature is used for filling when the RGB values of the color used for filling match any of the RGB values of feature_1 to feature_6. When the button 502 is selected in the state of FIG. 7, since a feature is used for the filling specified by the filling range 701, the CPU 10 proceeds to S804.

[0043] In S804, the CPU 10 creates a filling mask image with only features corresponding to the size of the thumbnail 207 acquired in S802. FIG. 9(a) shows a mask image 901 created based on the filling with features specified by the filling range 701 shown in FIG. 7.

[0044] In S805, the CPU 10 determines whether the normal color is used for filling. If the CPU 10 determines that the normal color is used for filling, it proceeds to S806; otherwise, it proceeds to S807. For example, the CPU 10 obtains the RGB value of the color used for filling and makes a determination by comparing it with the RGB values of the display RGB in FIG. 6. Specifically, when the RGB value of the color used for filling does not match any of the RGB values of Feature_1 to Feature_6, the CPU 10 may determine that the normal color is used for filling. When the button 502 is selected in the state of FIG. 7, since the normal color is used for the filling specified by the filling range 507, the CPU 10 proceeds to S806.

[0045] In S806, the CPU 10 creates a filling mask image with only the normal color corresponding to the size of the thumbnail 207 obtained in S802. FIG. 9(b) shows an image 902 created based on the normal color filling specified by the filling range 507 shown in FIG. 7.

[0046] In S807, the CPU 10 transmits the mask images 901 and 902 created in S804 and S806 and other editing information as editing data 7 to the information processing apparatus 2. The information processing apparatus 2 stores the received information as editing data 7 in the storage server 4.

[0047] In this way, based on the input to the user's information processing apparatus 2, a mask image 901 is generated to be overlaid on the thumbnail 207 displayed on the monitor 13.

[0048] Figure 10 shows the screen after the button 502 is selected in Figure 7. Here, the result of filling the thumbnail 207 is reflected. In this embodiment, the CPU 10 can generate a normal-color filled mask image and a characteristic-filled mask image so that they coexist. When the user selects the button 208 in this state, the program execution server 3 creates the print data 8 of the poster 201 that reflects this filling.

[0049] Figure 11 is a flowchart showing an example of the process executed by the CPU 21 of the information processing apparatus 2. This flowchart mainly shows the process when the program execution server 3 creates a composite image reflecting the filling result for the original image in order to create the print data 8. Note that this flowchart process is realized, for example, when the CPU 21 reads the server program 6 into the RAM 23 and executes it.

[0050] In S1101, the CPU 21 acquires the original image from the edit data 7 saved in S305 of FIG. 3.

[0051] In S1102, the CPU 21 acquires the size of the original image acquired in S1101. In S1103, the CPU 21 acquires the mask image saved in the edit data 7 in S807.

[0052] In S1104, the CPU 21 determines whether the mask image acquired in S1103 includes a characteristic mask image. If the information processing apparatus 2 includes a characteristic mask image, it proceeds to S1105; otherwise, it proceeds to S1106. For example, the information processing apparatus 2 may determine whether a characteristic mask image is included by the same method as the method performed by the CPU 10 in S803 of FIG. 8. Alternatively, when the CPU 10 transmits the edit data 7 to the information processing apparatus 2 in S807, information indicating whether the mask image is characteristic or a normal color may be associated with the mask image and transmitted. Then, the information processing apparatus 2 may determine based on this associated information.

[0053] This conditional branch determines whether the mask image has a predetermined property. In this embodiment, the predetermined property is a property related to the color of the mask image, and it can be said that the CPU 21 determines that the mask image has the predetermined property when the color represented by the spot ink is used in the mask image. Further, in the case of a method similar to the method performed by the CPU 10 in S803 of FIG. 8, it can be said that the CPU 21 determines that the mask image has the predetermined property when the color of the mask image represented by the RGB value cannot be reproduced by the CMYK value.

[0054] In S1105, the CPU 21 enlarges the spot mask image by the nearest neighbor method. Here, the information processing apparatus 2 enlarges the spot mask image to a size corresponding to the size of the original image acquired in S1102. In other words, the information processing apparatus 2 enlarges the spot mask image at the same magnification as the magnification of the original image with respect to the thumbnail.

[0055] Here, the CPU 21 performs interpolation using the nearest neighbor method that interpolates the pixel to be interpolated based on one surrounding pixel value. Interpolation by the bilinear method or bicubic method, etc., which will be described later, is also conceivable. However, when interpolating by these methods in the enlargement of the spot mask image, when interpolating near the boundary of the filled area, the pixel values of the portions that are not the areas painted with the spot may be referred to. As a result, there is a risk that the enlarged mask image will include colors other than the spot color, that is, colors that cannot be reproduced by the spot ink at the time of printing. Therefore, in this embodiment, in the enlargement of the spot mask image, interpolation is performed using the nearest neighbor method that interpolates based on one surrounding pixel value, making it possible for the enlarged mask image to be represented only by the spot color.

[0056] In S1106, the CPU 21 determines whether the mask image obtained in S1103 includes a normal-color mask image. If the information processing apparatus 2 includes a normal-color mask, it proceeds to S1107; otherwise, it proceeds to S1108. For example, the information processing apparatus 2 may determine whether a normal-color mask image is stored in the same manner as the method performed by the CPU 10 in S805 of FIG. 8.

[0057] In S1107, the CPU 21 enlarges the normal-color mask image by the bilinear method. Here, the information processing apparatus 2 enlarges the normal-color mask image to a size corresponding to the size of the original image obtained in S1102. In other words, the information processing apparatus 2 enlarges the normal-color mask image at the same magnification as the magnification of the original image with respect to the thumbnail.

[0058] Here, the CPU 21 interpolates the pixel to be interpolated using the bilinear method that interpolates based on a plurality of surrounding pixel values. For the normal-color mask image, there is no concern about the color of the pixel to be interpolated during enlargement like in the case of a characteristic mask image. Therefore, by using the bilinear method, the enlarged mask image can be finished more neatly compared to the case of using the nearest neighbor method. Note that not only the bilinear method but also other methods such as the bicubic method that interpolate based on a plurality of surrounding pixel values can be adopted.

[0059] In S1108, the CPU 21 generates a composite image by synthesizing the original image and the mask image with a size corresponding to the original image created in S1105 and S1107. That is, the composite image is an image reflecting the filling edit operation shown in FIG. 7 and the like. In S1109, the CPU 21 outputs the print data of the poster 201 including the generated composite image to the information processing terminal 9.

[0060] As described above, in this embodiment, when the mask image has features and when it does not, different interpolations are used to enlarge the mask image (S1105, S1107). By enlarging the mask image in a method that matches the characteristics of the ink of the filling color, it is possible to suppress a decrease in the quality of the filled mask image. That is, in this embodiment, the mask image can be enlarged using an appropriate interpolation method according to the nature of the mask image.

[0061] <Second Embodiment> In the first embodiment, the interpolation method at the time of enlarging the mask image is changed according to the color of the mask image, which is an example of the nature of the mask image. In the second embodiment, the interpolation method at the time of enlarging the mask image is changed according to the object of the mask image, which is an example of the nature of the mask image. Hereinafter, the second embodiment will be described, and the same components as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be omitted.

[0062] FIG. 12 is a diagram showing an example of a screen when the button 402 in FIG. 4 is selected. In this embodiment, in the filling dialog 1208, it is configured to be possible to select filling by text input and filling by range input.

[0063] The button 1201 is a button for inputting text to the thumbnail 1203. For example, when the button 1201 is selected, a text box may be displayed on the thumbnail 1203 and configured to enable text input by an input device 15 such as a keyboard. In FIG. 12, the text 1204 is shown as an input result when the user selects the button 1201 and inputs text.

[0064] The button 1202 is a button for inputting a filling range. For example, when the button 1202 is selected, it becomes possible to select a filling range by a drag operation or the like. In FIG. 12, the filling range 1205 is shown as an input result when the user selects the button 1202 and designates a filling range.

[0065] Button 1206 is a button for reflecting the result of filling in the thumbnail 1203. When button 1206 is selected, the edited thumbnail is reflected in the poster 201.

[0066] Figure 13 is a flowchart showing an example of the process executed by the CPU 10. This flowchart starts, for example, when the button 1206 shown in FIG. 12 is selected and the fill dialog 1208 is closed. Each process in this flowchart is realized, for example, when the CPU 10 reads and executes the client program 19. Note that since S1301, S1302, and S1307 are the same steps as S801, S802, and S807 in FIG. 8, respectively, the description thereof is omitted.

[0067] In S1303, the CPU 10 determines whether text input is used for filling. If text input is used for filling, the CPU 10 proceeds to S1304; otherwise, it proceeds to S1305.

[0068] In S1304, the CPU 10 creates a text mask image corresponding to the size of the thumbnail 1207 acquired in S1302. FIG. 14(a) shows a mask image 1401 created based on the text 1204 shown in FIG. 12.

[0069] In S1305, the CPU 10 determines whether range input is used for filling. If range input is used for filling, the CPU 10 proceeds to S1306; otherwise, it proceeds to S1307.

[0070] In S1306, the CPU 10 creates a mask image for filling by range input corresponding to the size of the thumbnail 1207 acquired in S1302. FIG. 14(b) shows an image 1402 created based on the filling specified by the filling range 1205 shown in FIG. 12.

[0071] Based on the flowchart of FIG. 13, a mask image based on text input and a mask image based on the filling range are created respectively. In other words, a mask image is created for each object to be filled.

[0072] FIG. 15 is a flowchart showing an example of the processing executed by the information processing apparatus 2. Specifically, this flowchart shows the processing when creating a composite image reflecting the filling result for the original image in order for the program execution server 3 to create the print data 8. Note that this flowchart processing is realized, for example, by the CPU of the information processing apparatus constituting the information processing apparatus 2 reading the server program 6 into the RAM of the information processing apparatus and executing it. Also, for S1501 to S1503 and S1508 to S1509, since they are the same steps as S1101 to 1103 and S1108 to S1109 in FIG. 11 respectively, the description is omitted.

[0073] In S1504, the CPU 21 determines whether the mask image obtained in S1503 includes the text mask image. If the information processing apparatus 2 includes the text mask image, it proceeds to S1505; otherwise, it proceeds to S1506.

[0074] This conditional branch determines whether the mask image has a predetermined property. In this embodiment, the predetermined property is a property related to the object of the mask image, and it can be said that the CPU 21 determines that the mask image has a predetermined property when text is used in the mask image.

[0075] In S1505, the CPU 21 enlarges the text mask image by the nearest neighbor method in S1102. Specifically, the information processing apparatus 2 enlarges the text mask image to a size corresponding to the size of the original image obtained in S1502. In other words, the information processing apparatus 2 enlarges the text mask image at the same magnification as the magnification of the original image with respect to the thumbnail.

[0076] Here, the CPU 21 interpolates the pixel to be interpolated using the nearest neighbor method that interpolates based on one pixel value of the surrounding pixels. In the case of the mask image of text, in the case of a method of interpolating based on a plurality of surrounding pixel values such as the bilinear method, the vicinity of the contour may become blurred, and clear text may not be output. Therefore, in the present embodiment, in enlarging the mask image of text, interpolation is performed using the nearest neighbor method, so that the text can be clearly represented even after enlargement.

[0077] In S1506, the CPU 21 determines whether the mask image of the range input is included in the mask image acquired in S1503. If the information processing apparatus 2 includes the mask of the range input, it proceeds to S1507, and if not, it proceeds to S1508.

[0078] In S1507, the CPU 21 enlarges the mask image of the range input by the bilinear method. Specifically, the information processing apparatus 2 enlarges the mask image of the range input to a size corresponding to the size of the original image acquired in S1502. In other words, the information processing apparatus 2 enlarges the mask image of the range input at the same magnification as the magnification of the original image with respect to the thumbnail.

[0079] As described above, in the present embodiment, when the mask image is due to text input and when it is not, different interpolations are used to enlarge the mask image (S1505, S1507). By enlarging the mask image in a method adapted to the object to be filled, it is possible to suppress a decrease in the quality of the filled mask image. That is, in the present embodiment, the mask image can be enlarged using an appropriate interpolation method according to the nature of the mask image.

[0080] <Modification Example> In the description of the above embodiment, the information processing terminal 9 is exemplified by a general personal computer, a terminal device such as a smartphone or a tablet, but the information processing terminal 9 may be an image processing apparatus such as a printer, or an Internet kiosk terminal or the like.

[0081] Further, in the above embodiment, the Web application is an application for creating a poster, but the Web application may be other applications for creating an album, creating a document, or the like. Also, not limited to Web applications, the configuration of the above embodiment is applicable to applications composed of programs directly executable on an operating system (OS) called a native application. That is, the information processing system 1 is not limited to being configured by the information processing device 2 and the information processing terminal 9, and the information processing system 1 may be configured by one or more information processing devices 2.

[0082] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or device via a network or a storage medium, and causing one or more processors in the computer of the system or device to read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0083] The invention is not limited to the above embodiments, and various changes and modifications are possible without departing from the spirit and scope of the invention. Therefore, the claims are attached to disclose the scope of the invention.

Explanation of Reference Numerals

[0084] 1: Information processing system, 2: Information processing device, 21: CPU, 9: Information processing terminal, 10: CPU

Claims

1. A first generation means for generating a reduced image obtained by reducing an original image; A display control means for causing the reduced image to be displayed on a display unit of a predetermined device; A second generation means for generating a mask image to be superimposed on the reduced image displayed on the display unit based on an input of a user to the predetermined device; An enlargement means for enlarging the mask image using different interpolation methods depending on whether the mask image has a predetermined property or not; The predetermined property is a property related to the color of the mask image. An information processing system characterized by the above.

2. The information processing system according to Claim 1, further comprising a composition means for generating a composite image obtained by compositing the original image and the mask image enlarged by the enlargement means. An information processing system characterized by the above.

3. The information processing system according to Claim 2, further comprising an output means for outputting print data including the composite image generated by the composition means. An information processing system characterized by the above.

4. The information processing system according to any one of Claims 1 to 3, further comprising a determination means for determining whether the mask image has a predetermined property or not, wherein the determination means determines that the mask image has the predetermined property when a color represented by using at least a special ink which is not a process color ink is used in the mask image. An information processing system characterized by the above.

5. The information processing system according to Claim 4, wherein the second generation means is capable of generating the mask image such that the special mask image and the normal color mask image coexist. An information processing system characterized by the above.

6. The information processing system according to any one of Claims 1 to 3, further comprising a determination means for determining whether the mask image has a predetermined property or not, wherein the determination means determines that the mask image has the predetermined property when the color of the mask image represented by RGB values cannot be reproduced by CMYK values. An information processing system characterized by the above.

7. The information processing system according to any one of Claims 1 to 3, further comprising a determination means for determining whether the mask image has a predetermined property or not, When the determination means determines that the mask image includes text, it determines that the mask image has the predetermined property. An information processing system characterized by the above.

8. An information processing system according to any one of claims 1 to 7, wherein the enlargement means when the mask image has the predetermined property, interpolates the pixel to be interpolated based on one surrounding pixel value, when the mask image does not have the predetermined property, interpolates the pixel to be interpolated based on a plurality of surrounding pixel values. An information processing system characterized by the above.

9. An information processing system according to any one of claims 1 to 8, wherein the enlargement means, when the mask image has the predetermined property, enlarges the mask image using the nearest neighbor method as the interpolation method. An information processing system characterized by the above.

10. An information processing system according to any one of claims 1 to 8, wherein the enlargement means, when the mask image does not have the predetermined property, enlarges the mask image using at least one of the bilinear method or the bicubic method as the interpolation method. An information processing system characterized by the above.

11. An information processing system according to any one of claims 1 to 9, wherein the enlargement means enlarges the mask image having a size corresponding to the reduced image to a size corresponding to the original image. An information processing system characterized by the above.

12. An information processing system according to any one of claims 1 to 11, wherein the information processing system includes the predetermined device, the predetermined device is an information processing terminal, and the information processing terminal functions as the first generation means, the display control means, the second generation means, and the enlargement means. An information processing system characterized by the above.

13. An information processing system according to any one of claims 1 to 11, wherein the information processing system includes the predetermined device and a server, and the server functions as the enlargement means. An information processing system characterized by the above.

14. An information processing system according to claim 13, comprising acquisition means for acquiring the original image, the reduced image, and the mask image by the server. An information processing system characterized by the above.

15. An information processing system according to any one of Claims 1 to 14, wherein the property related to the color of the mask image corresponds to the property that the mask image is expressed in a color using at least a special ink which is not a process color ink. An information processing system characterized by this.

16. An information processing system according to Claim 15, wherein the special ink is at least one of a fluorescent pink ink, a fluorescent orange ink, a violet ink, a green ink, an orange ink, a gold ink, and a silver ink. An information processing system characterized by this.

17. generating a reduced image obtained by reducing the original image; causing the reduced image to be displayed on a display unit of a predetermined device; generating a mask image to be superimposed on the reduced image displayed on the display unit based on an input of a user to the predetermined device; enlarging the mask image using different interpolation methods depending on whether the mask image has a predetermined property or not, wherein the predetermined property is a property related to the color of the mask image. An information processing method characterized by this.

18. A program for causing a computer to function as each means of the information processing system according to any one of Claims 1 to 16.

Images