Information processing apparatus, method for controlling information processing apparatus, and storage medium

Abstract

To improve usability in a content editing application.SOLUTION: A reception unit configured to receive an instruction to cause a computer to print a plurality of candidate colors including a first color set in a color palette for specifying a color of an object and a second color which is a color obtained by changing a color value of the first color; a registration unit configured to register a third color which is a color selected by a user among the plurality of candidate colors; And outputting an instruction to print the content in which the first color is converted into the third color.SELECTED DRAWING: Figure 29

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a control method for an information processing device, and a program. [Background technology]

[0002] There are content editing applications in which objects such as images or text are placed in an editing area of ​​a screen to design a poster, a photo album, a photo layout, or the like.

[0003] Patent Document 1 discloses a technique for setting a color palette that allows a printing device to select only colors that can be reproduced. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-148832 Summary of the Invention [Problem to be solved by the invention]

[0005] There is a demand for improved usability in content editing applications. [Means for solving the problem]

[0006] A program according to one embodiment of the present disclosure causes a computer to function as: a receiving means for receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of an object and a second color that is a color obtained by changing the color value of the first color; a registration means for registering a third color that is a color selected by a user from among the plurality of candidate colors; and an output means for, when an instruction to print content that includes the object is received, outputting an instruction to print the content with the first color converted to the third color based on the fact that the third color is registered in the registration means. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to improve the usability of content editing applications. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of an overall configuration of an information processing system. [Figure 2] FIG. 1 illustrates an example of a hardware configuration of an information processing system. [Figure 3] FIG. 2 is a diagram illustrating an example of a software configuration used in the information processing system. [Figure 4] FIG. 10 is a diagram illustrating an example of an editing screen of a content editing application. [Figure 5] FIG. 2 illustrates an example of a software configuration of a printing system. [Figure 6] FIG. 10 is a diagram illustrating an example of a screen of a printing application. [Figure 7] FIG. 10 is a diagram illustrating an example of an editing screen of a content editing application. [Figure 8] FIG. 10 is a diagram showing an example of a setting screen for color matching settings. [Figure 9] FIG. 10 is a diagram showing an example of a result of generating a color histogram from image data. [Figure 10] FIG. 10 is a diagram illustrating an example of extracting a main color using an RGB color space. [Figure 11] FIG. 10 is a diagram showing the configuration of software that sets primary colors from an acquired content file. [Figure 12] 10 is a flowchart of a color palette display process. [Figure 13] 10 is a flowchart of a process for setting a primary color. [Figure 14] 10 is a flowchart of a color palette color scheme change process. [Figure 15]FIG. 10 is a diagram showing an example of changing the color scheme of a color palette in a content editing UI. [Figure 16] 10A and 10B are diagrams illustrating an example of changing the color of content to be edited using a color palette. [Figure 17] FIG. 10 is a diagram showing an example of a dialogue screen for color matching settings. [Figure 18] 10 is a flowchart of a color palette display process. [Figure 19] 10 is a flowchart of a process for setting a primary color. [Figure 20] FIG. 10 is a diagram showing an example of changing the color scheme of a color palette in a content editing UI. [Figure 21] 10A and 10B are diagrams illustrating an example of changing the color of content to be edited using a color palette. [Figure 22] 10A and 10B are diagrams illustrating an example of changing the color of content to be edited using a color palette. [Figure 23] FIG. 10 is a diagram showing an example of a dialogue screen for color matching settings. [Figure 24] 10A and 10B are diagrams illustrating a material selection UI before and after color matching settings. [Figure 25] FIG. 10 is a diagram illustrating an example of an editing screen. [Figure 26] 10A and 10B are diagrams illustrating registration and deletion of color matching color scheme settings. [Figure 27] 10 is a flowchart of a color matching color scheme setting registration and deletion process. [Figure 28] 10A and 10B are diagrams illustrating print color settings of a color matching color palette. [Figure 29] 10A and 10B are diagrams illustrating an example in which printing is performed based on print color registration data. [Figure 30] 10 is a flowchart of a color matching color palette color setting printing process. [Figure 31] 10 is a flowchart of a print color registration process. [Figure 32] 10 is a flowchart of a color palette printing process. [Figure 33] 10A and 10B are diagrams for explaining registration and deletion of color matching print color settings; [Figure 34] 10 is a flowchart of a color matching print color setting registration and deletion process. [Figure 35] FIG. 10 illustrates an example of a flowchart of a printing process. [Figure 36] 10A and 10B are conceptual diagrams of the color matching print colors before and after replacement processing; DETAILED DESCRIPTION OF THE INVENTION

[0009] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the present disclosure, and not all combinations of features described in the following embodiments are necessarily essential to the solutions of the present disclosure. Note that the same reference numerals are used to designate the same components.

[0010] <<First Embodiment>> <Summary> A content editing application is an application for designing posters, photo albums, photo layouts, etc. Below, an overview will be given using poster editing as an example. For example, the content editing application accepts the user's selection of a desired template from a variety of poster templates. The content editing application displays a user interface (UI) for accepting editing operations for the poster to be edited.

[0011] A user selects an object (such as text, a rectangle, or a background) placed on the poster to be edited, which is displayed in the editing area, and performs an editing operation. The user may also change the color to match the desired color. Changing the color is one of the editing functions, and is performed using a color palette displayed in the UI. For example, based on receiving a color selection from the color palette from the user, the content editing application changes the color of the object to be edited to the color selected. The user may also select a material that matches the desired color from various materials prepared in advance, and input an instruction to add it as an object to the poster to be edited. Since the impression of content changes significantly depending on the color, there is a great need to edit content to match the desired color.

[0012] Recently, so-called "oshikatsu" (supporting activities)—activities in which people "support" their favorite idols, actors, or characters in various ways—has become popular. The object of support itself is also called "oshi." For example, one form of oshikatsu is attending a live performance or event of a favorite idol, bringing official or homemade merchandise. Another form of oshikatsu involves purchasing official merchandise, wearing homemade merchandise, or matching clothing or accessories to the idol's image color—a so-called "oshikatsu" activity. Another form of oshikatsu involves conveying the appeal of one's idol to those around oneself. When creating homemade merchandise, there is a demand for creating merchandise that matches the color of the idol. The color of the idol is particularly important for users who engage in oshikatsu, and there is a strong desire to create merchandise in the appropriate color for the idol. While it is possible to create merchandise in the color of a favorite idol using a content editing application, there is room for improvement in usability to allow users to appropriately edit content in the color of their favorite idol. In the following explanation, we will assume that a user is creating a poster of their favorite idol, but the content is not limited to posters and can be any deliverable content such as flyers, cards, fans, etc. Also, it is not limited to oshikatsu, but can be applied to any use case to match the desired color.

[0013] For example, as described above, a user can change the color of an object they have selected by using a color palette in a content editing application. However, the number of colors in a preset color palette is often limited, and it may be difficult to find the desired color (e.g., the color of a favorite character). Furthermore, color palettes are generally composed of standard colors. If a user cannot find the desired color, they may visually search for a color that appears to match the desired color in a two-dimensional RGB gradient display and align it with a mouse or other device. In a two-dimensional RGB gradient display, many RGB combinations are represented within a limited display area, making it difficult and time-consuming for the user to find the desired color. Another method is for the user to set a color by inputting RGB values ​​as numerical values. However, for example, if the user wants to match the color of an actual item they own, it is rare for the user to know the RGB values ​​of that color. While it is possible to search for a similar color by adjusting the numerical values, this is still time-consuming.

[0014] Alternatively, when adding a new object to a poster being edited, the color must be changed after the object is added. Therefore, if there are many objects to add, the color must be changed for each added object, which is time-consuming.

[0015] Furthermore, even if the technology described above is used to set a color palette that allows the user to select only colors that the printing device can reproduce, it is not possible to display a color palette that matches the user's desired colors (for example, their favorite colors).

[0016] Another method is to use the eyedropper function in various image editing software, position the eyedropper over each pixel in the image, and acquire the color of the pixel at the eyedropper's location. The acquired color can then be placed on a color palette. For example, if the goal is to match the color of actual merchandise on hand, the user can take a photo of the merchandise and create an image file. The user can then load the image file into the software and use the eyedropper function to select the appropriate color one by one. However, if there are many desired colors, the large number of settings required can be tedious and time-consuming.

[0017] In the embodiment described below, a content editing application uses a color palette to change the color of an object placed in content to be edited (e.g., a poster). This section describes an example of display control of a UI (user interface) that allows a user to easily set a color palette color scheme that suits their purpose without any effort. This improves the usability of the content editing application.

[0018] <Overall system configuration> 1 is a diagram showing an example of the overall configuration of an information processing system 10 according to this embodiment. The information processing system 10 includes a client computer 1000, a display 1100, a router 1200, a mobile terminal 2000, a server computer 3000, a printer 4000, and an information collection server computer 5000.

[0019] The client computer 1000 is connected to a display 1100 via a communication cable, and displays data stored in the client computer 1000 on the display 1100. The client computer 1000 is also connected to a router 1200 via wired or wireless communication, and is connected to other communication devices that can communicate via the Internet 1300 via the router 1200.

[0020] Mobile terminal 2000 is connected to router 1200 by wireless communication, and is connected to other communication devices that can communicate via the Internet 1300 via router 1200. Server computer 3000 is connected to other communication devices that can communicate via the Internet 1300. Server computer 3000 receives data held in client computer 1000 or mobile terminal 2000, stores the data in memory, processes the data, and transmits the data to other devices.

[0021] The printer 4000 receives data stored in the client computer 1000, the mobile terminal 2000, or the server computer 3000, and prints the data on a print medium. The information collection server computer 5000 is connected to other communication devices with which it can communicate via the Internet 1300. The information collection server computer 5000 receives data stored in the client computer 1000 or the mobile terminal 2000, stores the data in memory, aggregates the data, and transmits the data to other devices. Next, the information processing system of this embodiment will be described using the connection configuration in the above information processing system as an example.

[0022] <Configuration explanation> (1) Basic configuration (1-1) Hardware configuration 2 is a diagram showing an example of the hardware configuration of the information processing system 10 in this embodiment. Using FIG. 2, the configurations of the client computer 1000, the display 1100, the router 1200, the mobile terminal 2000, the server computer 3000, the printer 4000, and the information collection server computer 5000 will be described.

[0023] (Client computer 1000) The client computer 1000 includes a CPU 101, a ROM 102, a RAM 103, an external storage device 104, a data communication I / F 105, an input device 107, and a display device control unit 108. The client computer 1000 corresponds to a commonly used PC (Personal Computer) or the like.

[0024] The CPU (Central Processing Unit) 101 is a central processing unit that performs processing according to a specified program. The ROM (Read Only Memory) 102 is a non-volatile storage that can store table data and programs used in each process described below. The RAM (Random Access Memory) 103 is a volatile storage that temporarily stores programs and data. The external storage device (external storage unit) 104 is a non-volatile storage that stores programs and data. The CPU 101 receives programs and image data stored in the ROM 102, RAM 103, or external storage device 104 and performs arithmetic processing.

[0025] A data communication I / F (Data Transfer interface) 105 controls the transmission and reception of data between the server computer 3000, the printer 4000, and the information collection server computer 5000 via the router 1200. The connection method for transmitting and receiving data can be a wired connection such as USB, IEEE1394, or LAN, or a wireless connection such as Bluetooth or WiFi.

[0026] The input device control unit 106 is an I / F that acquires information operated by the user and transmits control information to each processing unit. The input device 107 is a HID (Human Interface Device) such as a keyboard or a mouse. The user can perform input operations via the input device 107. The display device control unit 108 transmits drawing data from the ROM 102, RAM 103, or external storage device 104 to the display 1100. The display 1100 displays the received data on the display device 110.

[0027] (Mobile Terminal 2000) 2, a mobile terminal 2000 includes a CPU 201, a ROM 202, a RAM 203, an external storage device 204, a data communication I / F 205, an input device control unit 206, an input device 207, a display device control unit 208, and a display device 209. The mobile terminal 2000 mainly has the functions of a computer such as a tablet computer or a smartphone, and often has a display with a touch panel.

[0028] The CPU 201 performs the same processing as the CPU 101. The ROM 202 has the same function as the ROM 102. The RAM 203 has the same function as the RAM 103. The external storage device 204 has the same function as the external storage device 104. The data communication I / F 205 performs the same processing as the data communication I / F 105. The input device control unit 206 performs the same processing as the input device control unit 106.

[0029] The input device 207 is a device equivalent to the input device 107. The input device 207 is a device that allows input operations to be performed on a screen, such as a touch panel equipped with display and input functions provided on a tablet computer or smartphone. The display device control unit 208 is an I / F that transmits data from the ROM 202, the RAM 203, or the external storage device 204 to the display device 209 as drawing data. The display device 209 displays the drawing data received from the display device control unit 208. The mobile terminal 2000 often has a built-in display device 209.

[0030] (Server computer 3000) In FIG. 2, the server computer 3000 has a CPU 301, a ROM 302, a RAM 303, an external storage device 304, and a data communication I / F 305. The CPU 301 performs the same processing as the CPU 101. The ROM 302 has the same functions as the ROM 102. The RAM 303 has the same functions as the RAM 101. The external storage device 304 is a device equivalent to the external storage device 104. The data communication I / F 305 controls the transmission and reception of data between the client computer 1000, the printer 4000, or the information collection server computer 5000 via the router 1200. The server computer 3000 is mainly connected to a network environment and has the function of transmitting and receiving data to and from various terminals via the data communication I / F 305. It also has the function of editing or processing received data.

[0031] (Printer 4000) 2, the printer 4000 has a data communication I / F 401, a printer controller 402, and a printer engine 403. The data communication I / F 401 controls the transmission and reception of data between the client computer 1000, the mobile terminal 2000, the server computer 3000, or the information collection server computer 5000 via the router 1200. The printer 4000 receives print data generated by the client computer 1000, the mobile terminal 2000, or the server computer 3000. The print data mainly includes image data to be used for printing and print setting data for issuing print instructions.

[0032] The printer controller 402 controls the printer engine 403 based on the received print data. The printer controller 402 also converts the image data by performing color space conversion processing required for printing and color separation processing into color materials according to the type of paper specified in the print setting data. The printer controller 402 also converts the image data into printable recording data by performing image processing such as output tone correction and halftoning using image processing parameters such as lookup tables.

[0033] The printer engine 403 executes printing processing based on the print data. For example, the printer engine 403 controls the heating and pressure operations of a heater mounted on a print head based on the print data, and ejects ink.

[0034] (Information collection server computer 5000) 2, the information collection server computer 5000 has a CPU 501, a ROM 502, a RAM 503, an external storage device 504, and a data communication I / F 505. The CPU 501 performs the same processing as the CPU 101. The ROM 502 has the same function as the ROM 102. The RAM 503 has the same function as the RAM 101. The external storage device 504 is a device equivalent to the external storage device 104. The data communication I / F 505 controls the transmission and reception of data between the client computer 1000, the mobile terminal 2000, the server computer 3000, or the printer 4000 via the router 1200.

[0035] The information collection server computer 5000 is mainly connected to a network environment and has a function of sending and receiving data to and from various terminals via a data communication I / F 505. It also has a function of aggregating or processing received data.

[0036] 2 is merely an example, and is not limited to this example. Some of the components shown in FIG. 2 may not be included, or other components may be included in addition to the components shown in FIG. 2.

[0037] (1-2) Software configuration FIG. 3 is a diagram illustrating an example of a software configuration used in an information processing system according to this embodiment. The content editing application described in this embodiment is an application for arranging objects such as images or text in an editing area on a screen to design a poster, photo album, or photo layout. The content editing application according to this embodiment is applicable to general layout software, such as a poster editing application, a photo album editing application, or an object layout application. This embodiment uses a poster editing application, which is a Web application, as an example of a specific content editing application. The content editing application may be a native application installed on the client computer 1000 or the mobile terminal 2000. Alternatively, it may be a Web application running on the server computer 3000. In this embodiment, the content editing application is a Web application, and the client computer 1000 or the mobile terminal 2000 sends processing instructions to the Web application running on the server computer. For ease of explanation, the following description will be given assuming that the client computer 1000 accepts editing operations for the content editing application. However, the client computer 1000 in the following description may be replaced with the mobile terminal 2000.

[0038] A brief overview of the form of a Web application will be described. Here, an example using a Web browser on client computer 1000 will be described. To execute a Web application, client computer 1000 first receives a client program, which constitutes part of the Web application, from server computer 3000. Next, the program analyzer of the Web browser interprets and executes the client program (in a scripting language such as HTML or JavaScript), launching the Web application. One method for launching a Web application is to launch it by entering a URL for launching the Web application into the Web browser. More specifically, when a URL is entered into the Web browser, server computer 3000 transmits a client program, which constitutes part of the Web application, to the Web browser. Next, the Web browser receives and executes the client program from server computer 3000, launching the Web application. In other words, a Web application is executed by a server program executed by CPU 301 of server computer 3000, and the Web browser issues an execution instruction to the server program through the client program. More specifically, the Web browser is configured to output an execution command for the server program to server computer 3000 and display the processing results of the server program.

[0039] FIG. 3 shows an example of the configuration of software (content editing application program) in client computer 1000. That is, FIG. 3 shows an example of the configuration of the client program described above. In this embodiment, various functions of the application program will be explained for each functional unit. The functional unit shown in FIG. 3 is referred to as a first functional unit 30. The first functional unit 30 is a functional unit that mainly performs template data editing processing to edit template data using a user interface (UI) screen. Here, an example of editing content using a template will be explained.

[0040] The first functional unit 30 includes an edit screen UI information acquisition unit 31, a template data acquisition unit 32, a data display unit 33, a data editing unit , a data transmission unit 35, and a post-edit UI information transmission unit .

[0041] Editing screen UI information acquisition unit 31 is a processing unit that acquires editing screen UI information D1 to be displayed on the editing screen via data communication I / F 105. Editing screen UI information acquisition unit 31 acquires, for example, editing screen UI information D1 from server computer 3000. Editing screen UI information D1 is information that indicates template layout information for selecting a template, as well as the type and layout information of buttons having editing functions for editing the selected template.

[0042] The template data acquisition unit 32 is a processing unit that acquires template data D2 via the data communication I / F 105. For example, the template data acquisition unit 32 receives the template data D2 from the server computer 3000. The template data D2 is data constituting various templates, such as posters or business cards. The content editing application of this embodiment allows content to be created and edited using various pre-prepared templates. The template data acquisition unit 32 acquires, as the template data D2, data for displaying a predetermined web page, such as HTML (Hyper Text Markup Language). The template data acquisition unit 32 may acquire, as the template data D2, so-called bitmap image data that has been compressed and converted into an image file, such as JPEG (Joint Photographic Experts Group). Alternatively, the template data acquisition unit 32 may acquire, as the template data D2, so-called vector image data, such as an Scalable Vector Graphics (SVG) file. Alternatively, the template data D2 may be any data constituting a template. It should be noted that editing can also be performed without using the template data D2, and in this case, the template data acquisition unit 32 may acquire blank template data that has been set in advance.

[0043] The data display unit 33 displays the content data to be edited based on the edit screen UI information D1 acquired by the edit screen UI information acquisition unit 31 and the template data D2 acquired by the template data acquisition unit 32.

[0044] The data editing unit 34 edits the content data (template data) displayed by the data display unit 33, using the editing screen UI information D1 acquired by the editing screen UI information acquisition unit 31. That is, the data editing unit 34 edits the content data to be edited. For example, the data editing unit 34 accepts a user instruction and edits the content data to be edited based on the accepted user instruction. The data editing unit 34 can also edit the editing screen UI information D1. Furthermore, the data editing unit 34 can also accept a user instruction using a UI based on the edited editing screen UI information D1 and edit the content data to be edited. Editing of the editing screen UI information D1 will be described in detail later.

[0045] The data transmission unit 35 is a processing unit that transmits edited content data D3, which is content data that has been edited by the data editing unit 34. For example, the data transmission unit 35 transmits the edited content data D3 from the client computer 1000 to the server computer 3000 via the data communication I / F 105.

[0046] The post-edit UI information transmission unit 36 ​​is a processing unit that transmits post-edit UI information D4, which is the editing screen UI information D1 after editing has been completed by the data editing unit 34. For example, the post-edit UI information transmission unit 36 ​​transmits the post-edit UI information D4 to the information collecting server computer 5000 via the data communication I / F 105.

[0047] Each unit in the first functional unit 30 is realized by the CPU 101 of the client computer 1000 executing a content editing application program read into the RAM 103. That is, each unit in the first functional unit 30 is realized by the CPU 101 functioning as each unit in the first functional unit 30. As mentioned above, the content editing application program may be stored in the ROM 102, or may be obtained by the web browser from the server computer 3000.

[0048] Fig. 4 is a diagram showing an example of an editing screen of a content editing application. The editing screen 40 in Fig. 4 is a screen displayed on the display device 110. The processing of each unit in the first functional unit 30 will be described below with reference to Fig. 4.

[0049] 4 is a diagram illustrating the configuration of a UI for accepting template selection, displaying the selected template, and editing it in a content editing application. In FIG. 4, for example, an editing screen 40 is displayed on a display device 110 by a web browser running on a client computer 1000. The editing screen 40 has a URL display 41, a template selection UI 42, an editing target UI 43, a layout change UI 44, a content editing UI 45, an object addition UI 46, and a "Proceed to print" button 47.

[0050] The URL display 41 displays a URL (Uniform Resource Locator), which is the address of a web page that stores edit screen UI information D1 used to display the edit screen 40. For example, when a template is selected by the user in a template selection UI 42 (described later), the address corresponding to the selected template is displayed. The edit screen UI information acquisition unit 31 receives the edit screen UI information D1 according to the displayed URL address.

[0051] The template selection UI 42 is a UI that displays the template data D2 received from the server computer 3000 and is capable of accepting the selection of one or more templates from the user. For example, the template selection UI 42 displays thumbnail images and template names of the acquired templates. The template data acquisition unit 32 receives the template data D2 from the server computer 3000.

[0052] The editing target UI 43 is a UI for editing a template selected by the user in the template selection UI 42. The content displayed in the editing target UI 43 is referred to as the editing target content. Here, because editing is performed using a template, the template displayed in the editing target UI 43 is also referred to as the editing target template.

[0053] The content to be edited is composed of various independent objects. For example, a template is also an object. A template may include each of the objects that make up the template. For example, the template to be edited may include various types of objects, such as text objects, background objects, and graphic objects. As will be described later, the user can also add desired objects to the content to be edited (template to be edited) using the object addition UI 46. For example, the user can add clip art as an object to the content to be edited. Clip art includes objects that make up the clip art (e.g., text objects or background objects). Thus, in this embodiment, an object is a general term for components that make up the content to be edited. Furthermore, components that are displayed in the object addition UI 46 and the template selection UI 42 so that the user can select them are referred to as materials. In other words, a material is also a type of object. When a material is added to the editing UI 43, the material is added as an object to the content to be edited.

[0054] The data display unit 33 individually accepts the selection of each object that constitutes the template to be edited, selected by the user, and displays a UI that allows each object to be individually edited using various editing functions on the editing screen 40. Furthermore, when the data display unit 33 accepts the selection of each object that constitutes the template to be edited, it displays a UI that activates editing (content editing UI 45) and highlights the selected object.

[0055] The layout change UI 44 is a UI that can change the overall layout settings of the template to be edited that is displayed in the edit target UI 43. For example, the layout change UI 44 can treat the template to be edited as a single piece of manuscript information and make changes related to the layout, such as the manuscript size, the manuscript aspect ratio, and the manuscript orientation.

[0056] The content editing UI 45 is a UI for editing the edit target template (edit target content) displayed in the edit target UI 43. The content editing UI 45 is not displayed when the editing screen 40 is displayed. When the content editing UI 45 receives a user selection of an object placed in the edit target template or an object added to the edit target template, the content editing UI 45 displays a UI corresponding to the type of the corresponding object. For example, if the type of object for which the selection is received is a text object, a UI for changing the text font and a UI for changing the color and size of the text are displayed. Furthermore, if the type of object for which the selection is received is a figure object, a UI for changing the color and size of the figure is displayed. The content editing UI 45 can use any known UI that allows editing from multiple options, such as radio buttons, check boxes, or drop-down lists. As will be described later, the content editing UI 45 also includes a color palette for changing the color of an object. The data editing unit 34 receives user operations through the content editing UI 45 and edits the edit target content based on the received user instructions. In the above example, the content editing UI 45 is not displayed at the same time as the editing screen 40 is displayed. However, a predetermined content editing UI 45 may be displayed at the same time as the editing screen 40 is displayed or at the same time as the selection of a template is accepted in the template selection UI 42.

[0057] The object addition UI 46 is a UI for adding an object to the edit target content displayed in the edit target UI 43. As described above, components included in the object addition UI 46 are called materials. The materials used in the object addition UI 46 may be, for example, images stored in the client computer 1000 or the mobile terminal 2000. The materials may be clip art images prepared in the server computer 3000 or another server on the cloud. The materials may be graphic objects. The materials may be created by receiving text input such as a URL from a user and automatically encoding the received information to create a two-dimensional code (e.g., a QR code (registered trademark)). The object addition UI 46 may be any type of UI as long as it allows the material to be added as an object to the edit target template. The data editing unit 34 performs a process of adding an object to the edit target template based on a user operation on the object addition UI 46.

[0058] The Proceed to Print button 47 is a print button for printing the data of the edited content displayed in the edit target UI 43. That is, the Proceed to Print button 47 is a print button for transmitting the edited content data D3, after editing, to a processing unit or a print application for printing. For example, the edited content data D3 may include vector data such as HTML or SVG, or raster image data such as JPEG or PNG. The data transmission unit 35 transmits the edited content data D3 to the server computer 3000. Furthermore, the post-edit UI information transmission unit 36 ​​transmits post-edit UI information D4, edited by the data editing unit 34, to the information collecting server computer 5000. For example, as described below, a color palette may be edited and the edited content may be saved as a file. The information collecting server computer 5000 is a representative server that saves various data such as files. The post-edit UI information D4 is sent to the information collecting server computer 5000 based on a user instruction.

[0059] In this embodiment, the content editing application is described as being in the form of a Web application, but as mentioned above, the content editing application may be in the form of a native application installed on the client computer 1000. In the case of a native application, the editing screen 40 shown in Fig. 4 may be changed as appropriate. For example, the URL display 41 may not be displayed.

[0060] FIG. 5 is a diagram showing an example of the software configuration of a printing system for performing printing in this embodiment. The printing system software may be integrated with a content editing application, or may be provided separately from the content editing application. In this embodiment, an example will be described in which the printing system software is provided separately from the content editing application. Also, an example will be described in which the printing system software uses both the functional unit of the client computer 1000 (or mobile terminal 2000) and the functional unit of the server computer 3000. FIG. 5 illustrates an example in which the server computer 3000 executes the second functional unit 50a, and the client computer 1000 executes the third functional unit 50b. The printing system software transmits print data D5 to the printer 4000, and the printer 4000 executes the print data D5. The printing process is executed by the second functional unit 50a and the third functional unit 50b. Although the description here is based on an example in which the second functional unit 50a and the third functional unit 50b are realized by separate devices, both functional units may be realized by the same device.

[0061] The second functional unit 50a has an edited content data receiving unit 52 and a rendering processing unit 55. The third functional unit 50b has a print setting screen UI information acquiring unit 51, a print setting screen UI information display unit 53, a print setting data setting unit 54, a print data transmitting unit 56, and a print setting UI information transmitting unit 57.

[0062] The post-edit content data receiving unit 52 in the second functional unit 50a is a processing unit that acquires, from the client computer 1000, post-edit content data D3 for which editing has been completed.

[0063] The print setting screen UI information acquisition unit 51 in the third functional unit 50b is a processing unit that acquires print setting UI information D6 to be displayed on the print setting screen from the server computer 3000. The print setting screen UI information display unit 53 in the third functional unit 50b receives and displays edited content data D3 from the edited content data receiving unit 52. The print setting screen UI information display unit 53 is also a processing unit that switches the display of print settings in accordance with the print setting UI information D6 to be displayed on the print setting screen acquired by the print setting screen UI information acquisition unit 51.

[0064] The print setting data setting unit 54 in the third functional unit 50b performs print settings based on operations on the UIs of various print settings displayed on the print setting screen UI information display unit 53. The print setting data setting unit 54 transmits print setting information D7 containing the performed print settings to the rendering processing unit 55. The print setting information D7 is also transmitted to the print data transmission unit 56. The print setting data setting unit 54 transmits print setting UI information D6 including the setting information containing the performed print settings to the print setting UI information transmission unit 57.

[0065] The rendering processing unit 55 in the second functional unit 50a acquires edited content data D3 from the edited content data receiving unit 52. The rendering processing unit 55 also acquires print setting information D7 from the print setting data setting unit 54. The rendering processing unit 55 is a processing unit that performs rendering processing to convert the edited content data D3 into print image data D8 based on the edited content data D3 and the print setting information D7. The rendering processing unit 55 converts the print image data D8 into an image file in a compressed format such as JPEG or PNG, and transmits the image file to the print data transmitting unit 56.

[0066] The print data transmission unit 56 in the third functional unit 50b acquires print image data D8 from the rendering processing unit 55. The print data transmission unit 56 converts the received print image data D8 into a transmission format for the printer 4000 selected for printing, and generates print data D5. The print data transmission unit 56 transmits the print data D5 to the printer 4000, causing it to perform printing processing.

[0067] The print setting UI information transmission unit 57 in the third functional unit 50b acquires the print setting UI information D6 from the print setting data setting unit 54. The print setting UI information transmission unit 57 transmits the print setting UI information D6 to the information collecting server computer 5000.

[0068] Each unit in the second functional unit 50a is realized by the CPU 301 of the server computer 3000 executing the printing system program read into RAM 303, causing the CPU 301 to function as each unit in the second functional unit 50a. Each unit in the third functional unit 50b is realized by the CPU 101 of the client computer 1000 executing the printing system program read into RAM 103, causing the CPU 101 to function as each unit in the third functional unit 50b.

[0069] Fig. 6 is a diagram showing an example of a screen of a print application in this embodiment. In this example, the third function unit 50b is a print application executed on the client computer 1000. That is, Fig. 6 shows an example of the screen of the print application executed on the client computer 1000. Fig. 6 shows an example of a print setting screen 60 that displays edited content data D3 and includes a UI that can accept print settings from the user and can also accept print instructions.

[0070] The print application is installed on the client computer 1000. The print setting screen 60 displays a content display area 61, a printer setting UI 62, a paper size setting UI 63, a paper type setting UI 64, a print quality setting UI 65, a border setting UI 66, and a fluorescent setting UI 67. The print setting screen 60 also has a print execution button 68 and an end print application button 69.

[0071] The following image is displayed in the content display area 61. First, the post-edited content data receiving unit 52 of the server computer 3000 acquires the post-edited content data D3. The post-edited content data receiving unit 52 converts the acquired post-edited content data D3 into print application display data D9 that can be displayed in a print application. For example, the post-edited content data receiving unit 52 performs a rendering process on the acquired post-edited content data D3 to create an image such as JPEG or PNG. The post-edited content data receiving unit 52 transmits the print application display data D9 to the print setting screen UI information display unit 53 of the client computer 1000. The print setting screen UI information display unit 53 displays the print application display data D9 in the content display area 61. Note that if the post-edited content data D3 is already imaged data, the post-edited content data D3 is displayed in the content display area 61.

[0072] Print setting UIs include a printer setting UI 62, a paper size setting UI 63, a paper type setting UI 64, a print quality setting UI 65, a border setting UI 66, and a fluorescent setting UI 67. The print setting information D7 set in the various print setting UIs may include, for example, printer model information, paper feed method, paper size, paper type, print quality, border setting information, double-sided printing, binding direction, and paper orientation related to the creation of print image data.

[0073] The print setting screen UI information display unit 53 receives print setting UI information D6 to be displayed on the print setting screen from the server computer 3000, and the UI for each print setting is displayed by the print application based on the print setting UI information D6. The UI for each print setting is selected by the print setting data setting unit 54. The print setting data setting unit 54 selects the UI for each print setting based on an operation from the user. Note that the UI for each print setting may be automatically changed depending on the printer selected as the printing target.

[0074] The printer setting UI 62 is a UI for selecting a printer from the printer name corresponding to a printer driver pre-installed in the client computer 1000 or the printer name of a printer connected via the communication I / F of the terminal.

[0075] The paper size setting UI 63 is a UI for selecting a paper size available on the connected printer. For example, paper sizes include A4, Letter, L size, and business card size. The paper type setting UI 64 is a UI for selecting a paper type available on the connected printer. For example, paper types include plain paper, glossy paper, and matte paper. Print settings are made to match the selected paper type, and printing is performed.

[0076] The print quality setting UI 65 is a UI for selecting the print quality available on the connected printer. For example, print quality can be standard or fine. Standard results in a standard quality finish, while fine results in a higher quality finish. The border setting UI 66 is a UI for selecting the border setting available on the connected printer. For example, the border setting can be selected as bordered or borderless. If bordered is selected, printing is performed to fit within the inner area of ​​the paper size. If borderless is selected, printing is performed to the outer area of ​​the paper size. The fluorescent setting UI 67 is a UI for selecting printing using fluorescent ink available on the connected printer. For example, if the selected printer supports fluorescent ink, the fluorescent setting UI 67 is displayed, and if it does not support fluorescent ink, the fluorescent setting UI 67 is not displayed.

[0077] The print execution button 68 is a button that instructs the printer driver or the printer to execute printing. For example, when it is accepted that the print execution button 68 has been pressed by the user, print setting information D7, such as printer model information and various print settings related to the creation of print image data, is sent to the rendering processing unit 55 of the server computer 3000. The rendering processing unit 55 generates print image data D8 using the edited content data D3 received by the edited content data receiving unit 52 and the print setting information D7.

[0078] The rendering processing unit 55 first calculates the print area image size P1 using the edited content data D3 and the print setting information D7. For example, assume that the width and height of the edited content data D3 are 3000 pixels and 4000 pixels, respectively. Furthermore, assume that the width and height of the printable area P2 when a bordered A4 paper size is set in the print setting information D7 are 4500 pixels and 6800 pixels, respectively. The width and height of the printable area P2 may be stored in advance in combination with the settings, or the size received from the printer 4000 may be used.

[0079] Next, the rendering processing unit 55 calculates an enlarged or reduced size so that the edited content data D3 fits within the printable area P2. For example, the rendering processing unit 55 calculates a size that fits within the width and height of the printable area P2 without changing the ratio (aspect ratio) of the width and height of the edited content data D3.

[0080] To explain using the above specific example, the width and height of the edited content data D3 are 3000 pixels and 4000 pixels, and the width and height of the printable area P2 are 4500 pixels and 6800 pixels. Therefore, the print area image size P1 that fits within the width and height of the printable area P2 has width and height dimensions of 4500 pixels and 6000 pixels. The rendering processing unit 55 generates print image data D8 that includes image data obtained by enlarging or reducing the edited content data D3 so that it fits the print area image size P1 calculated above.

[0081] The print application end button 69 is a button for ending the running print application when the button is pressed. For example, the execution of the end can be accepted in the form of a button like the print application end button 69, but an end menu may be prepared in the menu column, and the print application may be ended by accepting the press of the end menu.

[0082] The print data transmission unit 56 converts the print image data D8 generated in this manner into a transmission format for the selected printer, generates print data D5, and sends it to the printer 4000 to execute printing. The print data D5 can be generated so that the print setting information D7 set by the print setting data setting unit 54 and the print image data D8 form a single print specification description file. The print specification description file is primarily in a format that can be received by a printer driver. The printer driver converts the print image data D8 into a data format that can be printed by the printer in accordance with the received print specification description file. Any known method can be used to create a print specification description file and execute printing on the printer. After receiving the press of the print button, the print setting UI information transmission unit 57 transmits the received print setting UI information D6 to the information collection server computer 5000.

[0083] (2) Typical configuration In this embodiment, a representative configuration is included in a content editing application that can run on the client computer 1000 (or the mobile terminal 2000) or the server computer 3000. A representative configuration of this embodiment will be described with reference to FIGS. 7 and 8.

[0084] FIG. 7, like FIG. 4, is a diagram illustrating an example of an editing screen of a content editing application according to this embodiment. The editing screen 70 includes a URL display 71, an editing target UI 73, a layout change UI 74, a content editing UI 75, an object addition UI 76, and a "Proceed to Print" button 77. These components are similar to the URL display 41, the editing target UI 43, the layout change UI 44, the content editing UI 45, the object addition UI 46, and the "Proceed to Print" button 47 in the editing screen 40 shown in FIG. 4. Therefore, a description thereof will be omitted. Like the editing screen 40, the editing screen 70 is also a screen displayed, for example, in a web browser of the client computer 1000. The editing screen 70 illustrates a state in which a material selection UI 72 is displayed as a result of a UI for selecting a clip art material image as an object being selected in the object addition UI 46. The content editing UI 75 also includes a color palette 79 for changing the color of the object.

[0085] The material selection UI 72 is a UI that can receive clip art data D10 from the server computer 3000 and select one or more of the received clip arts. For example, the material selection UI 72 is a UI that can arrange the received clip art materials so that they fit within a frame and accept clip art selections from the user. The user places the selected clip art in the editing object UI 73 by dragging and dropping. Through this placement operation, the clip art (material) selected by the user is added and placed as an object in the editing object UI 73.

[0086] The various data elements of clip art are made up of multiple SVG (Scalable Vector Graphics) parts. Each SVG part has a color assigned to it, and the parts are combined to create a single clip art piece.

[0087] The editing screen 70 in Fig. 7 is provided with a new color matching setting button 78 compared to the editing screen 40 in Fig. 4. The color matching setting button 78 is a button that can be one of the triggers for performing a process to replace the UI so that the user can easily change to a desired color when editing content. For example, this button is used to make it easier for the user to change to a favorite color when editing content.

[0088] Fig. 8 is a diagram showing an example of a setting screen for color matching settings in a content editing application. Each setting screen shown in Fig. 8 is displayed as a dialog on the screen of Fig. 7, for example. Note that the display format is not limited to a dialog display, and any display format may be used. Each setting screen shown in Fig. 7 is displayed based on a user operation via the editing screen 70.

[0089] When the content editing application receives a notification that the color matching setting button 78 in FIG. 7 has been pressed by the user, it displays a color matching setting dialog 80 in FIG. 8(a).

[0090] The content editing application accepts the selection of the color matching setting method in a color matching setting dialog 80 of Fig. 8(a). When a cancel button 801 is pressed, the color matching setting is canceled. When a color extraction file setting button 802 is pressed, the content editing application displays a file selection dialog 81 of Fig. 8(b). When a manual setting button 803 is pressed, the content editing application displays a main color selection dialog 82 of Fig. 8(c).

[0091] First, an example of the file selection dialog 81 in FIG. 8(b) will be described. The file selection dialog 81 displays a message instructing the user to load an image and automatically change the palette color to match the color or brightness of the image, as well as a message prompting the user to select an image. The file selection dialog 81 includes a file selection button 811 that can accept a file selection. The file selection button 811 is a button that can accept a selection of a file stored in the client computer 1000, the mobile terminal 2000, or the like. The content editing application accepts a user's press of the file selection button 811 in the file selection dialog 81 in FIG. 8(b). For example, if the color extraction file F1 is selected, the selected color extraction file F1 is displayed in the file name display area 812. The color extraction file F1 is, for example, an image data file such as a JPEG or PNG. When the content editing application accepts that the file selection cancel button 813 has been pressed, it closes the file selection dialog 81. That is, the content editing application returns to displaying the editing screen 70 in FIG. 7. When a file is displayed in the file name display area 812 and the file selection OK button 814 is pressed, the content editing application displays the main color selection dialog 82 shown in FIG. 8(c).

[0092] Next, the main color selection dialog 82 of Fig. 8(c) will be described. When the manual setting button 803 in Fig. 8(a) is pressed, pre-prepared colors are arranged as candidate colors in the pre-prepared order in the color display area 821 (palette) of the main color selection dialog 82 of Fig. 8(c). Although Fig. 8(c) shows seven color display areas 821, the number is not limited to this.

[0093] On the other hand, when the file selection OK button 814 is pressed in the file selection dialog 81 of FIG. 8(b), the color display area 821 of the main color selection dialog 82 of FIG. 8(c) is colored with the main colors extracted from the selected color extraction file F1. That is, when the content editing application accepts the selection of the color extraction file F1, it automatically extracts the main colors from the color extraction file F1 based on an extraction method described below, rather than a user selection. The main colors are the main colors that make up the image. For example, the main colors can be colors that have a relatively large number of pixels in the image. Alternatively, the main colors can be the colors of the main objects (e.g., text objects) that make up the image. The main color extraction method will be described later. The content editing application uses colors based on the main color candidate data D11 extracted from the selected color extraction file F1 as candidate colors and colors them in one or more color display areas 821.

[0094] The main color selection dialog 82 includes a message prompting the user to select the color they want to use. The main color selection checkbox 822 is a checkbox for accepting checks (selections) for one or more candidate colors from the candidate colors arranged in the color display area 821. When accepting a press of the main color selection cancel button 823, the content editing application closes the main color selection dialog 82. When accepting a press of the main color selection OK button 824, the content editing application determines the selected main color as the main color selection data D12 that configures the color settings of the various UIs in FIG. 7. The main color selection data is stored in a memory such as the ROM 102, RAM 103, or external storage device 104 of the client computer 1000 (or mobile terminal 2000).

[0095] Next, we will explain how to extract the dominant color. There are various methods for extracting the dominant color. Here, we will explain an example of extracting the dominant color using a histogram. The content editing application extracts the RGB values ​​(red, green, and blue color information) of each pixel of the image data contained in the selected color extraction file F1. The R, G, and B values ​​are each composed of a combination of values ​​from 0 to 255, for example. The content editing application scans the image and generates a histogram that calculates the total number of pixels in the image data for each combination of R, G, and B values.

[0096] 9 is a diagram showing an example of the results of generating a color histogram from image data. From the calculated histogram, for example, the colors with the highest values ​​among the most frequently occurring combinations of R, G, and B values ​​are extracted as the primary colors.

[0097] Another example will be described. The content editing application may extract the dominant color using the well-known k-means method. The k-means method is a method of classifying data into a given number of clusters using a non-hierarchical clustering algorithm. For example, assume that R, G, and B are values ​​in a three-axis color space, each with a value between 0 and 255. Then, the image is scanned and the RGB values ​​of the pixels in the image data are arranged in the color space.

[0098] FIG. 10 is a diagram illustrating an example of extracting a primary color using an RGB color space. FIG. 10(a) is an illustration of pixels in image data arranged in the RGB color space. Black circles 1001 represent pixel values ​​in the image data, and the diagram illustrates the state in which each pixel value is arranged in the color space. The content editing application randomly defines multiple clusters 1003 within the defined color space. FIG. 10(b) is an illustration of pixels in image data arranged in the RGB color space and multiple clusters arranged therein. Diamonds 1002 correspond to the arranged clusters. The content editing application calculates the distance in the color space between each arranged pixel value and each pixel in each cluster, and calculates the closest cluster for each pixel. The content editing application calculates the centroid value of the pixels gathered in that cluster. The content editing application extracts the centroid value as the primary color. FIG. 10(c) is an illustration of pixels in image data arranged in the RGB color space and then rearranges the clusters to the positions of the centroid values ​​of the pixels gathered in the clusters. In the k-means method, the number of clusters is further changed, and the method of calculating the center of gravity is repeated to determine the center of gravity values ​​for the clusters in the color space, and the process of extracting the dominant colors is performed. In this way, any method can be used to extract the dominant colors from the color extraction file.

[0099] The colors extracted in this way are displayed as candidate colors in a color display area 821. The user checks the main color selection checkbox 822 of the color they want to use from the candidate colors displayed, and presses the main color selection OK button 824. In this case, the color whose main color selection checkbox 822 is checked will be used as main color selection data D12 in the processing described below.

[0100] In this embodiment, the user selects a primary color from the extracted primary colors (candidate colors) in the primary color selection dialog 82 of Fig. 8(c), but the present invention is not limited to this example. For example, after pressing the file selection OK button 814 in the file selection dialog 81 of Fig. 8(b), the content editing application may automatically extract primary colors from the selected content file, and use the extracted data as primary color selection data D12.

[0101] Although the color extraction file F1 has been described as an example of an image data file such as a JPEG or PNG file, it may also be so-called vector image data such as an SVG file. An SVG file is a text-based file, and colors can be defined for each piece of information, such as points or lines, written in the text. When extracting colors from such vector image data, color information for frequently used colors may be extracted from the defined colors. Alternatively, the content editing application may convert the SVG into a bitmap image and then extract colors, similar to the image data file described above. Furthermore, the color extraction file F1 may be data for display on a web page, such as HTML or CSS. For example, the file selection dialog 81 in FIG. 8(b) illustrates an example of selecting a file in the device, but it may also be formatted as a URL. For example, the content editing application may accept input of the address of the page to be retrieved. The content editing application may then receive data, such as HTML, from the input address. HTML or CSS files are also text-based files, and colors may be defined in the information set within the text. The color extraction file F1 may be, for example, an image data file obtained by capturing an image of an object with a camera, or an image data file obtained by reading an object with a scanner.

[0102] The following describes an example of an HTML file in which the color extraction file F1 is an HTML file.

[0103] <!DOCTYPE html> <meta charset="UTF-8"> <title> Hello< / title> Hello! <h1> <font color="red"> red< / font> < / h1> <h2 style="color:blue"> blue< / h2> green tea blue When extracting colors, it is possible to extract color information that is frequently used among colors defined in HTML color tags. It is also possible to extract colors in the same way as with an image data file by capturing data displayed in a browser using HTML or CSS and generating image data. In this way, the color extraction file F1 can contain any data, as long as it is a file that can extract the main color information configured in the file from the acquired file.

[0104] When the main color selection checkbox 822 is checked in the main color selection dialog 82 of Figure 8(c) and the main color selection OK button 824 is pressed, the content editing application displays the color scheme setting change dialog 83 of Figure 8(d).

[0105] In the color scheme setting change dialog 83 of Figure 8(d), a message is displayed suggesting that you press Change Color Scheme if you want to apply the selected color to the palette, and a message is displayed suggesting that you press Save if you want to save the selected color as a file.

[0106] When the content editing application receives a press of the cancel button 831 in the color scheme setting change dialog 83 of Fig. 8(d), it closes the color scheme setting change dialog 83. When the content editing application receives a press of the color scheme change button 832, it changes the color settings of the various UIs of Fig. 7 based on the main color selection data D12 selected in the main color selection dialog 82 of Fig. 8(c).

[0107] Specifically, when the color scheme change button 832 is pressed, the content editing application of this embodiment changes the color settings of the display colors of the color palette 79 of the content editing UI 75 among the various UIs in FIG. 7. For example, if the color palette 79 has three display colors and three pieces of primary color selection data D12, the content editing application replaces the display colors of the color palette 79 with the three primary colors. Also, if the color palette has three display colors and one piece of primary color selection data D12, the content editing application replaces the display color of the color palette 79 with one primary color. In this case, the display of the remaining two colors may be hidden, or only the first color may be replaced. Alternatively, the display of the remaining two color palettes 79 may be replaced with colors close to the primary color. Alternatively, these settings may be configured to be switchable. Furthermore, if the number of colors in the color palette 79 is three and the number of colors in the main color selection data D12 is five, for example, the main color selection data D12 may be rearranged in descending order of priority. For example, when extracting colors from the color extraction file F1, the priority may be set to the colors with the highest number of colors. The content editing application may set the priority based on a user operation using the main color selection dialog 82 shown in FIG. 8(c). Alternatively, if the number of colors in the main color selection data D12 is greater than the number of colors in the color palette 79, the number of colors in the color palette 79 may be increased. Any embodiment may be used as long as the color scheme settings of various UI elements can be changed based on the main color selection data D12. An example of changing the color of an object using the changed color palette 79 will be described later.

[0108] When the Save button 833 is pressed in the color scheme settings change dialog 83 of FIG. 8(d), the content editing application saves the main color selection data D12 as a color scheme settings save file F2. The color scheme settings save file F2 may be saved in the client computer 1000 or in the information collection server computer 5000. The color scheme settings save file F2 is, for example, a text file or a JSON (JavaScript Object Notation) file. The color scheme settings save file F2 is saved as a file in a form in which the main color selection data D12 is associated with an arbitrarily created registration number. The color scheme settings save file F2 may be saved in any form as long as it is saved in a state in which the main color selection data D12 can be reused in the color scheme settings registration process described below.

[0109] In this embodiment, the data included in the color scheme setting file F2 is the main color selection data D12 and an arbitrarily created registration number, but this is not limiting. For example, the registration number may be changed to a name that can be easily recognized by the user and registered as the registration number.

[0110] 11 is a diagram showing the software configuration of a fourth function unit 115 that sets primary colors from an acquired content file in a content editing application according to this embodiment. In this embodiment, an example is described in which the fourth function unit 115 is implemented by the server computer 3000, but the fourth function unit 115 may also be implemented by the client computer 1000 (or the mobile terminal 2000). The fourth function unit 115 includes a color extraction file acquisition unit 111, a primary color candidate data extraction unit 112, and a primary color setting unit 113.

[0111] Each unit in the fourth functional unit 115 is realized by the CPU 301 of the server computer 3000 executing a content editing application program read into the RAM 303. That is, each unit in the fourth functional unit 115 is realized by the CPU 301 functioning as the unit.

[0112] The color extraction file acquisition unit 111 is a processing unit that acquires the color extraction file F1. The main color candidate data extraction unit 112 is a processing unit that extracts main color candidate data D11 from the color extraction file F1 acquired by the color extraction file acquisition unit 111. The main color setting unit 113 is a processing unit that determines one or more main colors from the main color candidate data D11 extracted by the main color candidate data extraction unit 112 and sets them as main color selection data D12.

[0113] (2-1) Flowchart of this embodiment 12, 13, and 14 are flowcharts showing an example of a color matching setting process in this embodiment. FIG. 12 is a flowchart of a color palette display process. FIG. 13 is a flowchart of a process for setting primary colors. FIG. 14 is a flowchart of a process for changing the color palette color scheme. The processes shown in FIGS. 12 to 14 are realized by the CPU 101 reading a client program stored in the ROM 102 or the like of the client computer 1000 into the RAM 103 and executing it. More specifically, the processes of the flowcharts shown in FIGS. 12 to 14 are executed by the CPU 101 of the client computer 1000 having a Web browser. That is, the CPU 101 of the client computer 1000 reads the client program received from the server computer 3000 into the RAM 103 and executes it, thereby executing it by the CPU 101 operating the Web browser. Execution of the client program by the Web browser results in the Web application provided by the server computer 3000 being executed through the Web browser. 12 to 14 may be implemented by hardware such as an ASIC or electronic circuit. The symbol "S" in the description of each process indicates a step in the sequence diagram (the same applies to flowcharts in the following specification).

[0114] 12 to 14 will be described using an example in which the processes are executed on the client computer 1000, but these processes may also be executed on the server computer 3000. Furthermore, the processes may be executed according to a program installed on the client computer 1000 as a native application, rather than in the form of a Web application.

[0115] 7 is displayed on the client computer 1000, and a UI for editing a poster as the content to be edited is displayed. It is also assumed that a color extraction file F1 for matching colors has been prepared by the user. The processing of the flowchart shown in FIG. 12 is initiated when the content editing application accepts pressing of the color matching setting button 78 in FIG. 7.

[0116] In S1201, the CPU 101 accepts pressing of the color matching setting button 78 in Fig. 7. That is, S1201 is the start trigger process of the flowchart shown in Fig. 12. Next, in S1202, the CPU 101 displays the color matching setting dialog 80 of Fig. 8(a). As described above, the color matching setting dialog 80 of Fig. 8(a) is displayed with the color matching setting cancel button 801, color extraction file setting button 802, and manual setting button 803 arranged.

[0117] Next, in step S1203, the CPU 101 performs a main color setting process to change the color scheme of various UI elements. The main color setting process will be described in detail later. When the main color setting process is completed, the color scheme setting change dialog 83 shown in FIG. 8(d) is displayed.

[0118] Next, in S1204, CPU 101 determines the user's instruction to the color scheme setting change dialog 83. If the user's instruction is to cancel, CPU 101 ends the processing of the flowchart shown in Fig. 12. If the user's instruction is to change the color scheme, CPU 101 proceeds to S1205.

[0119] In S1205, CPU 101 changes the color scheme of various UIs based on the primary color selection data set in S1203. For example, CPU 101 functioning as a content editing application executes processing to change the display colors of color palette 79 (color palette color scheme change processing). CPU 101 then ends the processing of the flowchart shown in Fig. 12. The color palette color scheme change processing will be described in detail later.

[0120] If the user's instruction in S1204 is a save instruction, CPU 101 proceeds to S1206. In S1206, CPU 101 associates the primary color selection data set in S1203 with an arbitrary registration number and saves it in a file. Then, CPU 101 ends the processing of the flowchart shown in FIG.

[0121] Next, the main color setting process of S1203 will be described in detail with reference to Fig. 13. In S1301, CPU 101 determines whether or not the cancel button 801 for color matching settings displayed in the color matching setting dialog 80 of Fig. 8(a) has been pressed. If it is determined that the cancel button 801 for color matching settings has been pressed, CPU 101 ends the processing of the flowcharts shown in Fig. 13 and Fig. 12. In other words, CPU 101 interrupts the color matching setting process, ends the display of the color matching setting dialog 80, and executes processing to return to the editing screen of Fig. 7.

[0122] If it is determined that the cancel button 801 for color matching settings displayed in the color matching setting dialog 80 has not been pressed, that is, if it is determined that the color extraction file setting button 802 or the manual setting button 803 has been pressed, the CPU 101 proceeds to S1302.

[0123] In S1302, the CPU 101 determines what color matching setting has been selected. That is, the CPU 101 determines whether the color extraction file setting button 802 or the manual setting button 803 displayed in the color matching setting dialog of FIG. 8A has been selected. If it is determined in S1302 that the color extraction file setting button 802 has been selected, the CPU 101 proceeds to S1303. On the other hand, if it is determined that the manual setting button 803 has been selected, the CPU 101 proceeds to S1309.

[0124] In S1303, the CPU 101 displays the file selection dialog 81 shown in Fig. 8(b). As described above, the file selection dialog 81 shown in Fig. 8(b) is displayed with a file selection button 811, a file name display area 812, a file selection OK button 814, and a file selection cancel button 813 arranged therein.

[0125] Next, in S1304, the CPU 101 determines whether the file selection cancel button 813 has been pressed. If it is determined that the file selection cancel button 813 has been pressed, the CPU 101 returns to S1301. That is, the CPU 101 interrupts the file selection, terminates the display of the file selection dialog 81, and returns to the display of the color matching setting dialog 80 of FIG. 8(a). If it is determined that the file selection cancel button 813 has not been pressed, the CPU 101 proceeds to S1305. That is, if the file selection button 811 has been pressed in the file selection dialog 81 of FIG. 8(b) and a file has been selected, the CPU 101 proceeds to S1305.

[0126] In S1305, the CPU 101 selects the color extraction file F1 specified by the user in the file selection dialog 81. The CPU 101 displays the selected color extraction file F1 in the file name display area 812. Then, if the file selection OK button 814 is pressed, the process proceeds to S1306.

[0127] At S1306, the CPU 101 displays the main color selection dialog 82 of FIG. 8(c). Next, at S1307, the CPU 101 performs processing to extract main color candidate data D11 from the selected color extraction file F1 using the method for extracting main colors described above. More specifically, the CPU 101 sends the color extraction file F1 and an instruction to extract main colors to the fourth function unit 115 of the server computer 3000. The CPU 101 then assigns the main color candidate data D11 extracted by the main color candidate data extraction unit 112 to the color display area 821 of the main color selection dialog 82 of FIG. 8(c).

[0128] Next, in S1308, the CPU 101 determines whether the main color selection cancel button 823 has been pressed. If it is determined that the main color selection cancel button 823 has been pressed, the CPU 101 cancels the main color selection process. That is, the CPU 101 interrupts the main color selection process, terminates the display of the main color selection dialog 82, and returns to the display of the color matching setting dialog 80 in FIG. 8(a). If it is determined that the main color selection cancel button 823 has not been pressed, the CPU 101 proceeds to S1310.

[0129] The process of S1309 when the manual setting button 803 is selected in S1302 will be described. In S1309, the CPU 101 sets a preset color (existing color) as main color candidate data D11, and displays the color in the color display area 821 of the main color selection dialog 82 in Fig. 8(c). Then, the process proceeds to S1310.

[0130] In S1310, the CPU 101 accepts a user's selection of a candidate color displayed in the color display area 821 of the main color selection dialog 82 of FIG. 8(c) using the main color selection checkbox 822. When the CPU 101 accepts a press of the main color selection OK button 824 in the main color selection dialog 82 of FIG. 8(c), the CPU 101 determines the candidate color for which the main color selection checkbox 822 is checked as the main color. More specifically, the CPU 101 sends an instruction to the main color setting unit 113 of the server computer 3000 to set the determined main color. The CPU 101 then ends the processing of the flowchart shown in FIG. 13 and returns to the flowchart of FIG. 12. Note that when the main color selection cancel button 823 is pressed in the main color selection dialog 82 of FIG. 8(c), the CPU 101 ends the display of the color matching setting dialog and executes processing to return to the editing screen of FIG. 7.

[0131] Next, the color palette color scheme change process in Fig. 14 will be described. In S1401, CPU 101 acquires the number of display colors to be displayed in color palette 79 in content editing UI 75 among the various UIs in Fig. 7. In S1402, CPU 101 acquires main color selection data D12 set in the main color setting process in S1203 in Fig. 12. Main color selection data D12 is data in which one or more main colors are selected.

[0132] In S1403, CPU 101 determines whether or not processing has been completed for the number of display colors in the acquired color palette. If processing has been completed for the number of display colors in the color palette, CPU 101 ends the processing of the flowchart shown in FIG. 14. If processing has not been completed for the number of display colors in the color palette, CPU 101 proceeds to S1404. In S1404, CPU 101 determines whether or not processing has been completed for the number of selections in the acquired main color selection data. If processing has been completed for the number of selections in the main color selection data, the color palette color scheme change processing ends. If processing has not been completed for the number of selections in the main color selection data, proceeds to S1405.

[0133] In S1405, CPU 101 performs color scheme change processing to change the display colors of color palette 79 in content editing UI 75 of Fig. 7 to the primary color selection data. Next, in S1406, CPU 101 displays color palette 79, the color scheme of which has been changed to the primary color selection data, in content editing UI 75 of Fig. 7. Then, CPU 101 returns to the processing of S1403.

[0134] Note that Figure 14 describes an example of a process for changing the main colors by the number of colors in the color palette, but this process is just one example, and as mentioned above, there are various ways to change the color scheme of a color palette, and the color scheme may be changed by a process other than the process shown in Figure 14.

[0135] FIG. 15 is a diagram showing an example of changing the color scheme of the color palette 79 in the content editing UI 75 of FIG. 7. FIG. 15(a) shows the content editing UI 75 before changing the color scheme of the color palette display. In FIG. 15(a), before changing the color scheme of the color palette display, the color palette 79 is set to three display colors: blue, red, and green. Also, assume that two colors, purple and yellow, are selected as the main color selection data D12. Note that, for the sake of convenience, FIG. 15 shows the names of the colors, but in reality, the palette is displayed as being filled with those colors (the same applies hereinafter to color palettes in this specification).

[0136] 15(b), 15(c), and 15(d) show the content editing UI 75 after the color palette display color scheme has been changed. In FIG. 15(b), the color palette 79 of the content editing UI 75 displays two colors, purple and yellow, which are the main color selection data D12, as display colors. In FIG. 15(c), the color palette of the content editing UI 75 is capable of displaying up to three display colors. In this case, FIG. 15(c) shows an example in which, in addition to the two colors, purple and yellow, which are the main color selection data D12, the first color of the originally prepared color palette is displayed as a display color. In this example, since the first color of the originally prepared color palette is blue, purple, yellow, and blue are displayed on the color palette as shown in FIG. 15(c). If the main color selection data D12 were only purple, two colors would be added to the first color of the originally prepared color palette, and purple, blue, and red would be displayed on the color palette 79.

[0137] 15(d) shows an example in which the color palette 79 of the content editing UI 75 displays all of the colors in the original color palette in addition to the two colors, purple and yellow, of the primary color selection data D12. The colors in the original color palette are blue, red, and green. In the color palette 79 of FIG. 15(d), purple and yellow, which are the primary color selection data D12, are displayed in the first row, and blue, red, and green are displayed in the second row.

[0138] In this way, the color palette 79 may be configured to display only the primary color selection data D12 ( FIG. 15( b)). That is, instead of the colors of a pre-prepared color palette, only the primary color selection data D12 may be displayed. The color palette 79 may also be configured to display the primary color selection data D12 and default colors ( FIG. 15( c)). That is, the colors of a pre-prepared color palette may be treated as part of the primary color selection data D12 and displayed on the color palette 79. The color palette 79 may also be configured to display the primary color selection data D12 and default colors, with the difference between them being recognizable ( FIG. 15( d)). That is, in addition to the pre-prepared color palette, a color palette colored according to the primary color selection data D12 may be displayed. Note that in FIG. 15( c), text may be displayed around the color palette 79 to clearly indicate the difference between the primary color selection data D12 and the default colors. 15(d), the text "Preferred Color" may be displayed above a palette of purple and yellow, and the text "Normal Color" may be displayed above a palette of blue, red, and green. In this way, the main color selection data D12 and the default colors may be displayed in different ways.

[0139] 15(e) is a diagram showing an example in which the display colors of the color palette 79 of the content editing UI 75 are set by reading the color scheme setting save file F2. When the content editing application receives a user's press of the color scheme setting button 1501, it reads the color scheme setting save file F2 based on the user's operation. A registration number is associated with the color scheme setting save file F2, and the content editing application displays the registration number in the registration number display area 1502. The user can identify the color scheme setting save file F2 by the registration number.

[0140] Furthermore, for example, multiple color scheme setting save files F2 can be registered as color scheme setting save files F2 that can be registered using the color scheme setting button 1501. In this case, when the content editing application receives a press of the switch button 1503, it can replace the color scheme setting in the order of the registered color scheme setting save files F2 and switch the display colors of each color palette. That is, the content editing application is configured to be able to set first and second color settings using the color scheme setting save files F2, and displays a switch button 1503 that switches the colors applied to the color palette 79 between the first and second color settings. The content editing application can then switch the color settings in response to a press of the switch button 1503. In addition, in this embodiment, an example will be described in which one color scheme setting save file F2 stores one set of data, namely, main color selection data D12 and a registration number. However, multiple sets of main color selection data D12 and registration numbers may be stored in one color scheme setting save file F2. Even in this case, the display color of the color palette and the display of the registration number in the registration number display area 1502 may be switched in response to the reception of the press of the switching button 1503 .

[0141] The display modes described in FIGS. 15(b) to 15(e) can be adapted as appropriate. For example, a user can preselect a desired display mode on a setting screen (not shown). Alternatively, the content editing UI 75 may be provided with a display change button (not shown), and the display mode of the color palette 79 may be changed as shown in the examples of FIGS. 15(a) to 15(e) in response to a pressing operation of the display change button. That is, a button may be provided that can switch between a mode that displays a normal color palette and a mode (opportunity mode) that displays a color palette of a desired color (opportunity color). A button may also be provided that can switch the display mode within the opportunity mode. Alternatively, a single switch button may be provided to switch between normal mode, opportunity mode 1, and opportunity mode 2 as appropriate.

[0142] FIG. 16 is a diagram illustrating an example of changing the color of content to be edited using a color palette. FIG. 16(a) is a diagram again showing the editing screen 70 shown in FIG. 7. Note that some components are omitted. The content to be edited is arranged in the editing UI 73. FIG. 16(b) shows an example in which the user clicks on an object 1602 with a cursor 1601. When the content editing application accepts a pressing operation on the object 1602, it displays a content editing UI 75 on the editing screen 70. FIG. 16(b) is a diagram illustrating a comparative example in which a primary color is not set. The color of the object 1602 is black, and the color of the object, black, is displayed in the palette 791. When the user specifies a desired color from the color palette 79, the color of the object 1602 and the color of the palette 791 are changed to the specified color (e.g., blue). FIG. 16(c) shows an example in which the user clicks on the object 1602 with the cursor 1601, with the primary color set by the color matching setting described above. The color palette 79 is replaced with the primary color. When the user specifies a desired color (e.g., purple) from the color palette 79, the color of the object 1602 and the color of the palette 791 are changed to the specified color (e.g., purple). Note that although Fig. 16(c) shows an example in which the color palette 79 of the content editing UI 75 shown in Fig. 15(b) is displayed, another content editing UI 75 described in Fig. 15 may also be displayed.

[0143] (2-2) Effects of this embodiment As described above, this embodiment can improve the usability of a content editing application. In this embodiment, when changing the color of each object in a template using a UI, the user can change it using a color desired by the user. That is, the content editing application reads an image corresponding to the color desired by the user and extracts a primary color from the image. The content editing application uses the extracted primary color to change the display color of the color palette of the content editing UI.

[0144] As described above, one of the requests a user makes to match the color of content to be edited to a desired color is to match the color of an object or merchandise that the user actually owns. For example, a user may want to unify the color of the content to be edited with the color of merchandise of a favorite idol that the user owns. When changing a color in a content editing application, a color change process is performed using a color palette. However, the color of the favorite idol's merchandise may not be displayed in the color palette. This requires the user to search for the desired color from the many colors that are not displayed, which is time-consuming. Furthermore, if the desired color is not a bright color such as red or blue, but a subtle shade such as light purple or light blue, it takes additional time to find the desired color.

[0145] In this embodiment, the content editing application reads an image with a color desired by the user and changes the color in the color palette. This allows the user to easily select a color that suits their purpose when changing the color of an object placed in the content to be edited. In this way, by providing a UI that makes it easy for the user to match the color of the content to be edited to the desired color, the usability of the content editing application can be improved.

[0146] <<Second embodiment>> In the first embodiment, an example was described in which a content editing application reads an image corresponding to a color desired by a user, extracts a primary color from the image, and uses the extracted primary color to change the display color of the color palette of the content editing UI. Here, for example, the color desired by the user may differ for each object. As a specific example, the goods held by the user may be a cheering fan with yellow or pink text, a black background, and rectangular objects in light purple, light blue, and pink. In this case, the desired color differs for each object. Furthermore, because there are many desired colors, it may not be possible to display all of them on the color palette. Furthermore, if there are a large number of color palettes, searching through them may be time-consuming.

[0147] In this embodiment, an example of changing the display color of a color palette in a content editing UI, which is suitable when the target color differs for each object, will be described. Descriptions of the same configurations and processes as those in the above-described embodiment will be omitted.

[0148] (3) Basic configuration (3-1) Hardware configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0149] (3-2) Software configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0150] (4) Typical configuration FIG. 17 is a diagram showing an example of a dialog screen for color matching settings in this embodiment. The basic configuration in FIG. 17 is similar to the example described in FIG. 8, so the following description will focus on the differences. The difference between FIG. 17 and FIG. 8 is the main color selection dialog 82 in FIG. 17(c). The main color selection dialog 82 in FIG. 17(c) displays a message prompting the user to select the color they want to use for each object. Also, in FIG. 17(c), an object name 1701 is added to the configuration in FIG. 8(c). In this embodiment, the main color selection dialog 82 in FIG. 17(c) selects a main color for each category of objects extracted from the color extraction file. Note that, as will be described later, objects can be classified into multiple categories. Furthermore, there are multiple types of objects. A single object category may contain one type of object or multiple types of objects.

[0151] In this embodiment, when the file selection OK button 814 is pressed in the file selection dialog 81 of FIG. 17(b), the content editing application extracts object information D13 from the selected color extraction file F1. The object information D13 refers to information about objects included in the color extraction file F1. For example, information about each object, such as the object's type, placement area, size (number of pixels), and color information, is extracted for each object. The content editing application associates each piece of extracted object information D13 with object category information D14, which is a predefined category. The content editing application then performs a process of extracting a primary color from the object information D13 associated with each piece of object category information D14. The object category information D14 from which the primary color has been extracted is registered as selectable in the object name 1701 of FIG. 17(c). For example, the object category information D14 corresponding to the object from which the primary color has been extracted is registered as list information and can be selected by the user. That is, when the object name 1701 is pressed by the user, a list corresponding to the object category is displayed. Then, when one of the object categories displayed in the list is selected, the main color for the selected object category is set. Since candidate display colors are set for each object category information D14, the main color selection dialog 82 in FIG. 17(c) is displayed for each object category. Then, the main color candidate data D11 linked to the object category information D14 is arranged in one or more color display areas 821.

[0152] For example, the main color candidate data D11 for the first object category is displayed in the color display area 821. The user selects a desired color from the candidate colors displayed in the color display area 821 and checks the main color selection checkbox 822. When the content editing application receives a press of the main color selection OK button 824, it stores the selected main color as the main color selection data D12 for the first object category. Then, when the content editing application receives a press of the object name 1701 by the user, it displays a list and accepts the user's selection of an object category. When a second object category is selected, the content editing application displays the main color candidate data D11 associated with the object category information D14 for the second object category in the color display area 821. Then, it accepts the user's selection. The content editing application repeats this main color selection process for each categorized object category, and associates and stores the object category information D14 with the main color selection data D12. When the linking process with the main color selection data D12 for all object category information D14 is completed, the color scheme setting change dialog 83 shown in Fig. 17(d) is displayed. Although not shown, a button indicating that the user should proceed to color scheme setting may be provided in the main color selection dialog 82, and the main color selection dialog 82 may be displayed upon receipt of a press of that button.

[0153] A specific example of the object category information D14 will be described. For example, one piece of object category information D14 is the character category. There are various methods by which the content editing application can determine that an object belongs to the character category. One example is a method of extracting a character object. A known method for extracting a character object is, for example, OCR (Optical Character Recognition). OCR is a technology that reads an image, analyzes the layout of the image, extracts lines and characters, and recognizes the extracted characters. The content editing application extracts the color of the area of ​​the object recognized as a character, and sets the color as main color candidate data D11 for the character category.

[0154] One of the object category information D14 is the background category. The content editing application may determine that an object belongs to the background category by extracting a region other than the foreground region of the image as the background region. For example, a well-known background extraction method may be used to extract the background. Deep learning is a type of so-called machine learning technology that learns rules and patterns about data within an image, enabling image analysis to distinguish between foreground and background regions. The content editing application extracts the color of the region determined to be the background and sets it as main color candidate data D11 for the background category. Alternatively, objects other than the background may be treated as a single category, and the extracted color of the object other than the background may be set as main color candidate data D11 for the "object other than the background."

[0155] Although the method for extracting objects to be categorized is described above by treating the color extraction file F1 as raster image data and extracting the data, the present invention is not limited to this example. For example, the color extraction file F1 may be data for display on a web page, such as the HTML or CSS described above. The HTML file structure may include tag information for identifying each object. For example, various tag information, such as fonts, tables, images, or frames, may be included. Colors can often be assigned to each piece of tag information. Tag information for which colors can be assigned may be used as object category information D14, and colors frequently used for the same tag may be used as main color candidate data D11.

[0156] (4-1) Flowchart of this embodiment 17 and 18 are flowcharts for explaining the process of changing the display color of the color palette in the content editing UI for each object category in this embodiment. FIG. 18 is a flowchart of the color palette display process. FIG. 19 is a flowchart of the process of setting the main color. The prerequisites and operating subjects of the process in this flowchart are the same as those in the example explained in the first embodiment. Furthermore, explanations of processes equivalent to those explained in the first embodiment will be omitted.

[0157] The processes of S1801 and S1802 are the same as those of S1201 and S1202. Details of the main color setting process of S1803 will be described later. The processes of S1804 and S1807 are the same as those of S1204 and S1206. If the user's instruction in S1804 is to change the color scheme, CPU 101 proceeds to S1805.

[0158] In S1805, the CPU 101 determines whether processing for all object categories has been completed. In this embodiment, the object category information D14 is assumed to be an object item whose color can be changed using the content editing UI 75. Object categories indicated by the object category information D14 include, for example, text, background, and rectangle. In this example, there are three types, so in S1805, the CPU 101 determines whether the color palette color scheme change processing in S1806, which will be described later, for all three types has been completed. If it is determined that processing for all object categories has been completed, the CPU 101 ends the processing of the flowchart shown in FIG. 18. If it is determined that processing for all object categories has not been completed, the CPU 101 proceeds to S1806.

[0159] In S1806, CPU 101 performs color palette color scheme change processing to change the color palette color scheme for the object category being processed. CPU 101 then returns to S1805. The color palette color scheme change processing can be similar to the example of S1205 (and FIG. 14), so a description thereof will be omitted.

[0160] Fig. 19 is a flowchart showing details of the main color setting process in S1803. Explanation of the same steps as in Fig. 13 will be omitted. The processes from S1901 to S1905 are the same as the processes from S1301 to S1305.

[0161] In S1906, the CPU 101 extracts one or more pieces of object information D13 from the color extraction file F1 using the object extraction method described above. For example, the extracted object information may be a character, a background, an image, a rectangle, an ellipse, a two-dimensional code, or other objects.

[0162] In S1907, the CPU 101 performs an object category setting process, which associates each piece of extracted object information D13 with preset object category information D14.

[0163] For example, suppose that the object category information D14 includes three types of object categories: a character category whose color can be changed, a background category, and a rectangle / oval category. The CPU 101 determines to which object category each piece of extracted object information D13 belongs. A specific example will be used. Suppose that the extracted object information D13 includes three types of character objects, one type of background object, and two types of image objects. Suppose also that there are five types of rectangular objects, two types of oval objects, one type of two-dimensional code object, and ten types of other objects. In this case, three types of character objects are associated with the character category, which is the object category information D14. One type of background object is associated with the background category, which is the object category information D14. Five types of rectangular objects and two types of oval objects are associated with the rectangle category, which is the object category information D14.

[0164] The following is a specific example of linking.

[0165] [Table 1]

[0166] In S1908, CPU 101 determines whether or not the processing has been performed for the number of object categories. For example, if object category information D14 includes three categories, namely, a character category, a background category, and a rectangle / oval category, the processing is repeated until the three types of primary color extraction processing and primary color selection processing are completed. When the processing for the number of object categories has been completed, CPU 101 ends the processing of the flowchart shown in FIG.

[0167] At S1909, the CPU 101 displays the main color selection dialog 82 of FIG. 17(c). At S1910, the CPU 101 extracts main color candidate data D11 from the object information D13 associated with the object category information D14 of the processing target in the selected color extraction file F1. The process of extracting the main color candidate data D11 is the same as the process described at S1307. Here, the difference is that the extraction target is an object indicated by the object information D13. The CPU 101 assigns the extracted main color candidate data D11 to the color display area 821 of the main color selection dialog 82 of FIG. 17(c). S1911 is the same process as S1308. The main color selection process at S1912 is also the same process as S1310. After S1912, the CPU 101 returns to S1908.

[0168] The process of S1913 when CPU 101 determines in S1902 that manual setting button 803 has been selected will be described. In S1913, CPU 101 performs a process of acquiring object category information D14. As in the example described in S1907, object category information D14 is assumed to be of three types: a character category, a background category, and a rectangle category, each of which can change color.

[0169] At S1914, CPU 101 determines whether or not processing has been performed for the number of object categories. For example, if object category information D14 includes three categories: a character category, a background category, and a rectangle / oval category, processing is repeated until three types of main color selection processing are completed. When processing has been completed for the number of object categories, CPU 101 ends the processing of the flowchart shown in FIG. 19. At S1915, CPU 101 sets a preset color (existing color) as main color candidate data D11 and displays it in color display area 821 of main color selection dialog 82 of FIG. 17(c). The main color selection processing at S1916 is the same as that at S1310. When processing at S1916 ends, CPU 101 returns to S1914.

[0170] In the above-described flowchart, an example has been shown in which the process of extracting colors from the color extraction file F1 is performed for all object categories, or manual setting is performed for all object categories, but this is not limiting. A configuration may be made in which it is possible to switch between extracting colors from the color extraction file F1 and manually setting colors for each object category. Furthermore, it is not necessary to set primary colors for all object categories, and a configuration may be made in which primary colors are set only for object categories desired by the user.

[0171] FIG. 20 is a diagram illustrating an example of changing the color scheme of the color palette 79 in the content editing UI 75 of FIG. 7 in this embodiment. FIG. 20(a) shows the content editing UI 75 before changing the color scheme of the color palette display. In FIG. 20(a), before changing the color scheme of the color palette display, the color palette 79 is set to three display colors: blue, red, and green. Also, assume that two colors, purple and yellow, are selected as the main color selection data D12 for the character category, and two colors, gold and vermilion, are selected as the main color selection data D12 for the background category. Unlike the example described in FIG. 15, this embodiment provides a palette for each object category. Here, the character category and the background category are displayed as object categories. A first color palette 79a is provided for the character category, and a second color palette 79b is provided for the background category. This example is not limiting, and other categories may be displayed, or the content editing UI 75 may be configured to be able to display other categories by scrolling, etc. Alternatively, only the palette for the object category whose color scheme has been changed in the color scheme change process may be displayed. The display order of the palettes may also be configured so that the user can specify or change it as desired, or the order may be determined based on the number of types of objects extracted during the main color selection process or the area they occupy in the image, and the display order may be determined according to the determined priority.

[0172] 20(b), 20(c), and 20(d) show the content editing UI 75 after the color palette display color scheme has been changed. In Fig. 20(b), the first color palette 79a for text color in the content editing UI 75 displays two colors, purple and yellow, which are the main color selection data D12, as display colors. The second color palette 79b for background displays two colors, gold and vermilion, which are the main color selection data D12, as display colors.

[0173] 20(c), the first color palette 79a for the text color and the second color palette 79b for the background of the content editing UI 75 are capable of displaying up to three display colors. In this case, in addition to the two colors of the primary color selection data D12, the first color of the originally prepared color palette is displayed as the display color on each color palette. In this example, since the first color of the originally prepared color palette is blue, the first color palette 79a displays purple, yellow, and blue. The second color palette 79b displays gold, vermilion, and blue. If the primary color selection data D12 for the text only contains purple, two colors are added from the first color of the originally prepared color palette, so purple, blue, and red are displayed on the first color palette 79a. If the primary color selection data D12 for the background only contains gold, two colors are added from the first color of the originally prepared color palette, so gold, blue, and red are displayed on the second color palette 79b.

[0174] 20(d) shows an example in which the first color palette 79a for text and the second color palette 79b for background of the content editing UI 75 display all of the color palettes that were originally prepared in addition to the two colors of the respective primary color selection data D12. Specifically, the first color palette 79a for text has purple and yellow, which are the primary color selection data D12, arranged in the first row, and the originally prepared blue, red, and green, arranged in the second row. The second color palette 79b for background has gold and vermilion, which are the primary color selection data D12, arranged in the first row, and the originally prepared blue, red, and green, arranged in the second row.

[0175] FIG. 20(e) is a diagram showing an example in which the display colors of each color palette of the content editing UI 75 are set by loading a color scheme setting save file F2. In FIG. 20(e), a configuration is provided in which a file can be loaded for each object category to set the color scheme. Upon receiving a user's press of the text color scheme setting button 2004, the content editing application loads the color scheme setting save file F2 based on the user's operation. A registration number is associated with the color scheme setting save file F2, and the content editing application displays the registration number in the registration number display area 2002. The user can identify the color scheme setting save file F2 by the registration number. Similarly, upon receiving a user's press of the background color scheme setting button 2006, the content editing application loads the color scheme setting save file F2 based on the user's operation. A registration number is associated with the color scheme setting save file F2, and the content editing application displays the registration number in the registration number display area 2007. The user can identify the color scheme setting save file F2 by the registration number.

[0176] In Fig. 20(e), the color scheme setting save file F2 is loaded for each object category, but this is not limiting. If the color scheme setting save file F2 holds color scheme settings for each object category, there may be only one color scheme setting button, as shown in Fig. 15(e). Also, as shown in Fig. 15(e), a switching button may be included in Fig. 20, and the color scheme may be switched in response to the operation of the switching button.

[0177] In addition, similar to the example described in FIG. 15 of the first embodiment, various display modes can be used as the display mode of the content editing UI 75.

[0178] FIG. 21 is a diagram illustrating an example of changing the color of content to be edited using a color palette. In this example, as described in FIG. 20, purple and yellow are set as the color scheme for the first color palette 79a for text, and gold and vermilion are set as the color scheme for the second color palette 79b for background. FIG. 21(a) is a diagram illustrating the editing screen 70 of FIG. 7. Note that some components are omitted. The content to be edited is arranged in the editing object UI 73. FIG. 21(b) illustrates an example in which the user moves a cursor 2101 over a character object 2102 and clicks it. When the content editing application accepts a pressing operation on the character object 2102, it displays a content editing UI 75 including the first color palette 79a on the editing screen 70. The initial color of the character object 2102 is black, and the palette 791 displays the current color of the character object 2102, black. When the user specifies a desired color from the first color palette 79a, the color of the character object 2102 and the color of the palette 791 are changed to the specified color (for example, purple).

[0179] FIG. 21(c) shows an example in which the user places cursor 2101 on background object 2103 and clicks. Note that because background object 2103 does not have text, text-related buttons such as font and text size are not displayed, unlike FIG. 21(b). When the content editing application accepts a pressing operation on background object 2103, it displays content editing UI 75 including second color palette 79b on editing screen 70. The initial color of background object 2103 is red, and palette 791 displays the current color of background object 2103, which is red. When the user specifies a desired color from second color palette 79b, the color of background object 2103 and the color of palette 791 are changed to the specified color (e.g., gold).

[0180] 21(b) and (c) show a form in which a color palette for an object category corresponding to the type of object specified is displayed, but this is not limiting. As explained in FIG. 20, a form in which all color palettes for each object category are displayed may also be used. That is, in FIGS. 21(b) and (c), both the first color palette 79a and the second color palette 79b may be displayed.

[0181] FIG. 22 illustrates an example of changing the color of content to be edited using a color palette. The situations in FIGS. 22(a) to 22(c) are the same as those in FIGS. 21(a) to 21(c), respectively. As described above, FIGS. 22(b) and 22(c) illustrate an example in which both the first color palette 79a and the second color palette 79b are displayed in the content editing UI 5. Furthermore, FIG. 22 illustrates an example in which, when an object to be edited is selected in the content to be edited in the editing UI 73, the selected object and the color palette of the object category corresponding to the type of object are highlighted. While an example of highlighting is shown here with a thick dotted frame 2200, the highlighting method is not limited to this example. The frame may flash, or the object and color palette themselves may flash without displaying a frame. Any method may be used so that the user can recognize the object.

[0182] In this embodiment, an example of displaying a color palette for each object category has been described. However, as described in the first embodiment, a pre-prepared color palette may be displayed together with the color palette for each object category. Furthermore, the colors of the pre-prepared color palette may be displayed so as to constitute part of the color palette for each object category. In other words, part of the color palette of the main color selection data D12 may be the colors of the pre-prepared color palette.

[0183] (4-2) Effects of this embodiment As described above, this embodiment can improve the usability of a content editing application. In this embodiment, similar to the first embodiment, when changing the color of each object in content to be edited using a UI, the user can change the color using a color desired by the user. Furthermore, in this embodiment, the content editing application reads an image corresponding to a color desired by the user and extracts a primary color from the image for each object category. The primary color extracted for each object category is used to change the display color of a color palette in the content editing UI. This makes it easy to change the color of a desired object in content to be edited. Furthermore, when an object to be edited is selected, the color palette of the object category corresponding to the type of the object can be displayed on the UI in a distinguishable manner, allowing the user to easily distinguish colors and improving operability.

[0184] <<Third Embodiment>> In the first and second embodiments, an example was described in which a content editing application reads an image corresponding to a color desired by a user, extracts a primary color from the image, and uses the extracted primary color to change the display color of the color palette of the content editing UI.

[0185] In this embodiment, an example will be described in which the colors of various materials that can be added as objects, rather than the display colors of the color palette, can be changed to colors that match the desired color and added as objects.

[0186] For example, as described above, consider a situation in which a user wants to edit a poster to match the color of merchandise for a favorite idol that the user owns. When creating a poster using a template, the user adds pre-prepared materials (e.g., clip art) to the poster as objects and wants to match the color of the added objects to a desired color (the color of the favorite idol). In this case, the user cannot determine whether the materials are suitable for the poster without adding them and changing their color, making it very difficult for the user to determine this when selecting materials. Therefore, in this embodiment, an example is described in which a UI is provided that allows the user to select materials to be added to content as objects while pre-matching the desired color. Descriptions of configurations and processes similar to those of the above-described embodiment are omitted.

[0187] (5) Basic configuration (5-1) Hardware configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0188] (5-2) Software configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0189] (6) Typical configuration FIG. 23 is a diagram showing an example of a dialog screen for color matching settings in this embodiment. The basic configuration in FIG. 23 is the same as the example described in FIG. 8, so differences will be mainly described. In this embodiment, when the color matching setting button 78 is pressed on the editing screen 70, the content editing application displays a color matching setting dialog screen similar to that described in the first embodiment, etc. The configuration for extracting primary colors and accepting selection of primary colors by the user is also similar to the example described in the first embodiment, etc. The difference is that the target to be changed using primary colors is a color palette or a material.

[0190] 23 and 8, the messages displayed in the file selection dialog 81 of FIG. 23(b) and the color scheme setting change dialog 83 of FIG. 23(d) are different. In the file selection dialog 81 of FIG. 23(b), a message is displayed informing the user that the color of the selected material will be automatically changed. In the color scheme setting change dialog 83 of FIG. 23(d), a message is displayed informing the user to press "Change Color Scheme" if the selected color is to be applied to the material. In this embodiment, when the color scheme change button 832 is pressed, the material selection UI 72, not the content editing UI 75, is changed based on the main color selection data D12.

[0191] Fig. 24 is a diagram illustrating the material selection UI 72 before and after color matching setting in this embodiment. In this embodiment, when the color scheme change button 832 in Fig. 23(d) is pressed, the object whose color scheme is changed is the material (object) of the addition candidate displayed in the material selection UI 72 in Fig. 7. Fig. 24 is an image diagram extracting the material of the addition candidate displayed in the material selection UI 72 on the editing screen 70 in Fig. 7.

[0192] The candidate materials for addition are, for example, illustrations or clip art, and are assumed to be vector-format image data such as SVG files. Because they are vector-format, the materials used to display images or text are digitized and recorded as two-dimensional information. Furthermore, because they are digitized as two-dimensional information, even when the SVG data is enlarged or reduced, the digitized and arranged color information can be displayed with the same color information maintained in the enlarged or reduced area. Various materials, such as illustrations or clip art, are composed of various combinations of two-dimensional information, each with its own assigned color.

[0193] In the first embodiment, it is possible to add and place a material as an object in the content to be edited, and then specify one or more pieces of two-dimensional information in the SVG data of that material and change its color using a color palette, etc. However, if the colors of various materials in the SVG data are replaced with the above-mentioned main color selection data D12, they will all be the same color, and the borders of each material will also be the same color, hiding the combined structure of the materials.

[0194] In this embodiment, when changing the color scheme of the material of the additional candidate, a method is described in which the color balance of the entire material of the additional candidate is changed based on the main color selection data D12 described in the first embodiment, etc. For example, color balance adjustment is performed as a method for changing the color balance of the entire material.

[0195] 24(a) shows a material 2401 that is a candidate for addition before the color scheme is changed and is displayed in the material selection UI 72. For example, the material 2401 that is a candidate for addition before the color scheme is changed is SVG data that is composed of various colors.

[0196] 24(b), 24(c), and 24(d) show candidate materials for addition after the color scheme has been changed, as displayed in the material selection UI 72. In FIG. 23(b), the candidate material for addition 2402 after the color scheme change displayed in the material selection UI 72 is a material whose color scheme has been changed based on the main color selection data D12 described above, for the candidate material for addition 2401 in FIG. 24(a) before the color scheme change. For example, FIG. 24(b) shows an example in which the color scheme of the candidate material for addition has been changed when the main color selection data D12 is purple.

[0197] In Figure 24(c), the candidate material 2403 to be added after the color scheme change displayed in the material selection UI 72 is a material in which the color scheme of the candidate material 2401 to be added in Figure 24(a) before the color scheme change has been changed based on the main color selection data D12 described above. For example, Figure 24(c) shows an example in which the color scheme of the candidate material to be added has been changed when the main color selection data D12 is yellow. That is, Figures 24(b) and 24(c) show examples in which the main color selection data D12 to be changed is different from each other.

[0198] FIG. 24(d) shows an example in which, when there are multiple pieces of main color selection data D12 to change the color scheme, examples of materials with each color changed are displayed alternately. For example, assume that two main color selection data D12 are set: purple and yellow. In FIG. 24(d), the material 2402 to be added as a candidate after the color scheme change displayed in the material selection UI 72 is the same as the material 2402 in FIG. 24(b). In FIG. 24(d), the material 2403 to be added as a candidate after the color scheme change displayed in the material selection UI 72 is the same as the material 2403 in FIG. 24(c). In this way, the material 2402 to be added as a candidate after the color scheme change where the main color selection data D12 is purple and the material 2403 to be added as a candidate after the color scheme change where the main color selection data D12 is yellow are displayed alternately in the material selection UI 72.

[0199] 24(e) shows candidate materials to be added after the color scheme change, displayed in the material selection UI 72. In FIG. 24(e), the display color of candidate materials to be added after the color scheme change, displayed in the material selection UI 72, can be set by loading the color scheme setting save file F2, as described in the first embodiment, etc. When the user presses the color scheme setting button 2404, the content editing application loads the color scheme setting save file F2. Since a registration number is associated with the color scheme setting save file F2, the content editing application displays the registration number in the registration number display area 2405.

[0200] It is also possible to register a plurality of color scheme setting save files F2 as color scheme setting save files F2 that can be registered using color scheme setting button 2404. In this case, when the content editing application receives a press of switch button 2406, it is possible to replace the color scheme settings in the order of the registered color scheme setting save files F2 and switch the display colors of each color palette.

[0201] 24(f) shows an example in which the display color of candidate materials to be added after changing the color scheme displayed in the material selection UI 72 is changed to multiple display colors and displayed together. For example, the user can set the display colors using the first color scheme setting button 2407 and the second color scheme setting button 2407.

[0202] First, when the color scheme setting button 2407 is pressed, the content editing application loads the first color scheme setting save file F2. Since a registration number is associated with the color scheme setting save file F2, the content editing application displays the registration number in the registration number display area 2409. If the main color selection data D12 of the first color scheme setting save file F2 is purple, candidate materials 2402 to be added after the color scheme change are displayed.

[0203] Next, when the color scheme setting button 2408 is pressed, the content editing application loads the second color scheme setting save file F2. Since the color scheme setting save file F2 is associated with a registration number, the content editing application displays the registration number in the registration number display area 2410. If the main color selection data D12 of the second color scheme setting save file F2 is yellow, candidate materials 2403 to be added after the color scheme change are displayed.

[0204] As shown in Figure 24(f), an example is shown in which two color scheme setting files F2 are loaded and the color scheme of the candidate materials to be added is changed and displayed, but the display method is not limited to this. As long as it is possible to change the color scheme of the candidate materials to be added and display the materials after the color scheme change, the method of changing the color scheme is not limited to the example described above. Furthermore, the number of materials displayed may vary depending on the number of main color selection data D12.

[0205] Furthermore, if the candidate materials to be added displayed in the material selection UI 72 can be divided into object categories as described in the second embodiment, the color scheme change setting may be performed on an object-by-object or object category-by-object basis.

[0206] 24(b) to 24(f) can be applied as appropriate. For example, the user can select a desired display mode in advance on a setting screen (not shown). Alternatively, the material selection UI 72 may be provided with a display change button, and the display mode of the color palette 79 may be changed in response to pressing the display change button.

[0207] FIG. 24(g) is a diagram showing another example of the editing screen 70. In the editing screen 70 of FIG. 24(g), a switching button 2420 is provided in the material selection UI 72 in the editing screen 70 shown in FIG. 7. The switching button 2420 is a button for switching the display mode described in FIGS. 24(b) to 24(f). In a case where the main color selection data D12 is of the two types described above, when the user presses the switching button 2320, the display is sequentially switched to, for example, the material selection UI 72 described in FIGS. 24(b) to 24(f). The user can select a material suitable for the desired color from the material selection UI 72 and add it to the content to be edited displayed in the editing object UI 73, for example, as an object with its color changed.

[0208] Next, a method for changing the color scheme of the additional candidate material 2401 based on the main color selection data D12 will be described. As an example, a case where color balance adjustment is used will be described. There are various well-known methods for color balance adjustment processing. One example is a process of performing color conversion according to a predetermined method.

[0209] For example, the pre-color change candidate material 2401 is SVG data that combines five pieces of vector information. Each of the five pieces of vector information has a color set, specifically, the following colors:

[0210] The color of the first vector information is (R, G, B) = (100, 225, 100) The color of the second vector information is (R, G, B) = (100, 90, 200) The color of the third vector information is (R, G, B) = (75, 50, 80) The color of the fourth vector information is (R, G, B) = (200, 50, 200) The color of the fifth vector information is (R, G, B) = (200, 100, 75) There are various known techniques for color balance adjustment. Any method can be used, but here we will explain an example that uses data obtained by converting RGB values ​​into HSV values, which are hue data. HSV values ​​are values ​​for hue H, saturation S, and brightness V. The content editing application performs color conversion processing based on the hue data.

[0211] The method for converting RGB values ​​to HSV values ​​is as follows: Calculate the maximum (MAX) and minimum (MIN) values ​​of R, G, and B.

[0212] When R is at its maximum value Hue H = 60 × ((GB)÷(MAX-MIN)) When G is at its maximum value Hue H = 60 × ((BR)÷(MAX-MIN))+120 When B is the maximum value Hue H = 60 × ((RG)÷(MAX-MIN))+240 Saturation S = (MAX-MIN))÷MAX×256 Brightness V = MAX÷256×256 When R=G=B, hue H is 0. Hue H ranges from 0 to 359. Saturation S ranges from 0 to 255. Lightness V ranges from 0 to 255. If the calculation result of hue H is a negative value, 360 is added.

[0213] For example, assume that the RGB values ​​of purple in the primary color selection data D12 are as follows:

[0214] Primary color selection data D12 (R, G, B) = (250, 128, 250) When the RGB values ​​of the above primary color selection data D12 are converted to HSV values, the results are as follows: Note that errors have been omitted.

[0215] Primary color selection data D12 (H, S, V) = (300, 124, 250) Similarly, the HSV of the five vector information of the SVG data is as follows:

[0216] The color of the first vector information is (H, S, V) = (120, 142, 225) The color of the second vector information is (H, S, V) = (245, 140, 200) The color of the third vector information is (H, S, V) = (290, 96, 80) The color of the fourth vector information is (H, S, V) = (300, 192, 200). The color of the fifth vector information is (H, S, V) = (12, 160, 200) When the five vector information pieces of SVG data are changed based on the primary color selection data D12, the result is as follows when adjusted to the hue H=300 of the primary color selection data D12: In other words, when the five vector information pieces of SVG data are changed to the hue H while maintaining the brightness information (lightness V), the result is as follows:

[0217] The color of the first vector information is (H, S, V) = (300, 142, 225) The color of the second vector information is (H, S, V) = (300, 140, 200) The color of the third vector information is (H, S, V) = (300, 96, 80) The color of the fourth vector information is (H, S, V) = (300, 192, 200). The color of the fifth vector information is (H, S, V) = (300, 160, 200). The method for converting HSV values ​​to RGB values ​​is as follows:

[0218] Maximum value MAX=V Minimum value MIN=MAX-((S÷255)×MAX) When H is in the range of 0 to 60, the formula is as follows:

[0219] R=MAX G = (H÷60) × (MAX-MIN) + MIN B=MIN When H is in the range of 60 to 120, the formula is as follows:

[0220] R=((120-H)÷60)×(MAX-MIN)+MIN G=MAX B=MIN When H is in the range of 120 to 180, the formula is as follows:

[0221] R=MIN G=MAX B=((H-120)÷60)×(MAX-MIN)+MIN When H is in the range of 180 to 240, the formula is as follows:

[0222] R=MIN G=((240-H)÷60)×(MAX-MIN)+MIN B=MAX When H is in the range of 240 to 300, the formula is as follows:

[0223] R=((H-240)÷60)×(MAX-MIN)+MIN G=MIN B=MAX When H is in the range of 300 to 360, the formula is as follows:

[0224] R=MAX G=MIN B=((360-H)÷60)×(MAX-MIN)+MIN The five vector information pieces of the SVG data are changed based on the primary color selection data D12, and the resulting HSV data is converted back into RGB values ​​as shown below.

[0225] The color of the first vector information is (R, G, B) = (225, 99, 225) The color of the second vector information is (R, G, B) = (200, 90, 200) The color of the third vector information is (R, G, B) = (80, 49, 80) The color of the fourth vector information is (R, G, B) = (200, 49, 200) The color of the fifth vector information is (R, G, B) = (200, 74, 200) The content editing application displays the SVG data converted in this way as candidate materials for addition 2402 in FIG. 24(b).

[0226] Next, in FIG. 24(c), an example will be described in which the main color selection data D12 is yellow and the color scheme of the additional candidate material 2401 is changed to create an additional candidate material 2403.

[0227] For example, assume that the RGB values ​​of yellow in the primary color selection data D12 are as follows:

[0228] Primary color selection data D12 (R, G, B) = (240, 240, 38) When the RGB values ​​of this primary color selection data D12 are converted to HSV values, the results are as follows: Note that errors have been omitted.

[0229] Primary color selection data D12 (H, S, V) = (60, 0.84, 0.94) When changing the five vector information of the SVG data based on the primary color selection data D12, the result is as follows when adjusted to the hue H=60 of the primary color selection data D12.

[0230] The color of the first vector information is (H, S, V) = (60, 142, 225) The color of the second vector information is (H, S, V) = (60, 140, 200) The color of the third vector information is (H, S, V) = (60, 96, 80) The color of the fourth vector information is (H, S, V) = (60, 192, 200) The color of the fifth vector information is (H, S, V) = (60, 160, 200) The five vector information pieces of the SVG data are changed based on the primary color selection data D12, and the resulting HSV data is converted back to RGB as shown below.

[0231] The color of the first vector information is (R, G, B) = (225, 225, 99) The color of the second vector information is (R, G, B) = (200, 200, 90) The color of the third vector information is (R, G, B) = (80, 80, 49) The color of the fourth vector information is (R, G, B) = (200, 200, 49) The color of the fifth vector information is (R, G, B) = (200, 200, 74) The content editing application displays the SVG data converted in this way as candidate materials for addition 2403 in FIG. 24(c).

[0232] In the present embodiment, color balance adjustment is described as an example in which the H value of the HSV values ​​is used to modify the SVG data based on the primary color selection data D12, but this example is not limiting. By performing color balance adjustment, colors are converted to harmonize with the primary color data, rather than matching all colors in a single material to the primary color data. In this way, any color balance adjustment method may be used as long as it brings the colors of the material closer to the colors of the primary color selection data D12.

[0233] Another example of color balance adjustment will be described. For example, color balance adjustment may be performed by multiplying each R, G, and B value by a gain value based on the primary color selection data D12. A specific example will be described below.

[0234] The gain value is determined so that 0 is 0.5 times and 255 is 2.0 times, with the median value of 128 as the center.

[0235] If the value is 128 or greater, use the following formula:

[0236] R gain value = 2.0 x (R value - 128) / (255 - 128) G gain value = 2.0 x (G value - 128) / (255 - 128) B gain value = 2.0 x (B value - 128) / (255 - 128) If the value is less than 128, use the following formula:

[0237] R gain value = 1.0 - 0.5 × (128 - R value) / (128) G gain value = 1.0 - 0.5 x (128 - G value) / (128) B gain value = 1.0 - 0.5 x (128 - B value) / (128) If the value is 128, the formula is:

[0238] R, G, B gain value = 1.0 The calculated gain value is multiplied by the original RGB value to create the color-converted data. In this case, if the RGB value exceeds 255, it is set to 255.

[0239] Primary color selection data D12 (R, G, B) = (250, 128, 50) in the case of, R gain value = 2.0 × (250 - 128) / (255 - 128) = 1.92 G gain value = 1.0 Gain value of B = 1.0 - 0.5 × (128 - 50) / (128) = 0.69 This becomes:

[0240] The color of the vector information is (R, G, B) = (100, 200, 100) in the case of, The values ​​after color conversion are as follows:

[0241] R value of vector information = 100 x 1.92 = 192 R value of vector information = 200 x 1.0 = 200 R value of vector information = 100×0.69=69 In this embodiment, an example has been described in which SVG data such as illustrations or clip art is used as a candidate material for addition, but the materials whose colors are adjusted are not limited to these. For example, the fill color of a two-dimensional code or the line color of a figure may be adjusted to match the primary color when added as an object. That is, the candidate material for addition may be a two-dimensional code or a figure. Furthermore, the material whose color is adjusted may be image data, text data, rectangle data, background data, or a two-dimensional code.

[0242] (6-2) Flowchart of this embodiment The flowchart of this embodiment is basically the same as the flowchart described in the first embodiment. Specifically, the color palette coloration change process of S1205 in FIG. 12 is replaced with a material selection UI coloration change process. The material selection UI coloration change process is equivalent to the color palette coloration change process described in FIG. 14, where the color palette is replaced with a material selection UI. In this case, the color balance adjustment process described above is performed in the material selection UI coloration change process, which corresponds to S1405 in FIG. 14.

[0243] (6-3) Effects of this embodiment As described above, this embodiment can improve the usability of a content editing application. This embodiment provides a UI that allows a user to select a material to be added to content as an object by pre-setting the material to a desired color. This allows a user to add a material of a desired color as an object with fewer steps than if the user had to change the color after first placing the material in an editing object.

[0244] (7) Variations Furthermore, although this embodiment has been described as being a different form from the forms described in the first and second embodiments, it may also be a form combined with the forms described in the first and second embodiments.

[0245] Fig. 25 is a diagram showing an example of an editing screen 70. The editing screen 70 of Fig. 25 is an example in which a palette color matching setting button 2501 and a material color matching setting button 2502 are arranged instead of the color matching setting button 78 on the editing screen 70 of Fig. 7. When the content editing application receives a press of the palette color matching setting button 2501, it performs the processing described in the first or second embodiment. On the other hand, when the content editing application receives a press of the material color matching setting button 2502, it performs the processing described in the third embodiment. In this way, the first to third embodiments may be combined as appropriate.

[0246] Furthermore, the material selection UI 72 may be changed based on the main color selection data D12, and the changed object may be added to the content to be edited, and then the color palette 79 of the content editing UI 75 may be changed based on the main color selection data D12. In other words, a configuration in which the first to third embodiments are mixed may be used.

[0247] <<Fourth Embodiment>> In this embodiment, a detailed example using the color scheme setting save file F2 described in the first to third embodiments will be described. That is, in each of the above-described embodiments, the main color selection data D12 is saved in the color scheme setting save file F2, and the color scheme can be changed again. In this embodiment, a method for registering and deleting color scheme settings will be described.

[0248] (8) Basic configuration (8-1) Hardware configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0249] (8-2) Software configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0250] (9) Typical configuration In the above-described embodiment, an example of a configuration was shown in which the main color selection data D12 was saved in the color scheme setting save file F2 and the color scheme was changed again, but below, using Figures 26 and 27, a method for registering and deleting color scheme settings will be explained.

[0251] Fig. 26 is a diagram for explaining registration and deletion of color matching color scheme settings in this embodiment. Fig. 26(a) and (b) respectively show a color scheme setting registration / deletion dialog 2600. The color scheme setting registration / deletion dialog 2600 is displayed when, for example, the color scheme setting button 1501 in Fig. 15, the text color scheme setting button 2004 or the background color scheme setting button 2006 in Fig. 20, or the color scheme setting buttons 2404, 2407, or 2408 in Fig. 24 is pressed. The color scheme setting registration / deletion dialog 2600 is a dialog screen displayed on, for example, the editing screen 70 in Fig. 7.

[0252] When the color scheme setting registration / deletion dialog 2600 is displayed, the content editing application determines whether any color scheme settings have already been registered. If any color scheme settings have already been registered, the content editing application displays the registered registration number in the color scheme setting registration list 2601. The color scheme setting registration list 2601 associates the main color selection data D12 included in the color scheme setting save file F2 with an arbitrarily created registration number. Here, the registration number is displayed. If multiple color scheme settings are registered, for example, the most recently registered registration number is displayed in the color scheme setting registration list 2601. The color scheme setting registration list 2601 is in list format. If multiple color scheme settings are registered, the content editing application can open the list based on a user instruction and accept a user instruction from among the multiple registration numbers. Using the color scheme settings registered in the color scheme setting registration list 2601, the color scheme processing using the color scheme setting save file F2 described in the first to third embodiments is performed. When a plurality of color scheme settings are registered in the color scheme setting registration list 2601, a process of switching the color scheme setting is carried out as described in the first to third embodiments.

[0253] Next, an example of registering a color scheme setting in the color scheme setting registration list 2601 will be described. The color scheme setting is registered using an already saved color scheme setting save file F2. When a user wishes to register a color scheme setting, the user presses the file selection button 2602 and selects a color scheme setting save file F2 saved on a PC, smartphone, tablet PC, or the like. When the content editing application accepts the pressing of the file selection button 2602 and the selection of the color scheme setting save file F2, it displays the file name of the selected color scheme setting save file F2 in the file name area 2603. The content editing application also displays the registration number associated with the main color selection data D12 saved in the selected color scheme setting save file F2 in the color scheme setting registration number area 2604.

[0254] When the content editing application accepts a press of the register button 2605 while the registration number is displayed in the color scheme setting registration number area 2604, it registers the contents of the file in the color scheme setting. If the registration is successful, the registered registration number is added to the list displayed in the color scheme setting registration list 2601.

[0255] Next, we will explain the process when the user wants to delete a registration from the registered color scheme setting registration list 2601. The content editing application accepts the selection of the registration number to be deleted from the color scheme setting registration list 2601. When the content editing application accepts the selection and accepts the press of the delete button 2606, it deletes the main color selection data D12 linked to the selected registration number and the data of the registration number from the color scheme setting registration list 2601.

[0256] The content editing application can also collectively delete all registered data registered in the color scheme setting registration list 2601. Specifically, when the content editing application receives a press of the Delete All button 2607, it deletes all main color selection data D12 and the data of the registration numbers from the color scheme setting registration list 2601.

[0257] In this way, it is possible to register or delete color scheme settings using the color scheme setting registration / deletion dialog 2600. When the color scheme setting is complete, the user presses the finish button 2608. When the content editing application accepts the pressing of the finish button 2608, it closes the color scheme setting registration / deletion dialog 2600.

[0258] When the color scheme setting registration is completed, one or more main color selection data D12 included in the color scheme setting save file F2 registered in the color scheme setting registration list 2601 will be used as the selected main color selection data D12.

[0259] FIG. 27 is a flowchart of the color matching color scheme setting registration and deletion process in this embodiment. The process shown in FIG. 27 is realized by the CPU 101 reading a client program stored in the ROM 102 or the like of the client computer 1000 into the RAM 103 and executing it. More specifically, the process of the flowchart shown in FIG. 27 is executed by the CPU 101 of the client computer 1000 having a web browser. That is, the CPU 101 of the client computer 1000 reads the client program received from the server computer 3000 into the RAM 103 and executes it, thereby executing it by the CPU 101 operating the web browser. By executing the client program through the web browser, a web application provided by the server computer 3000 is executed through the web browser. Note that the process of the flowchart shown in FIG. 27 is described here using an example in which the process is executed on the client computer 1000. However, as described in the first embodiment, these processes may also be executed on the server computer 3000. Furthermore, instead of the web application, the process may be executed according to a program installed on the client computer 1000 as a native app, as described in the first embodiment.

[0260] The processing of the flowchart in Figure 27 is started when, for example, the color scheme setting button 1501 in Figure 15, the text color scheme setting button 2004, the background color scheme setting button 2006 in Figure 20, or the color scheme setting buttons 2404, 2407, and 2408 in Figure 24 is pressed.

[0261] In S2701, the CPU 101 displays the color scheme setting registration / deletion dialog 2600. In S2702, the CPU 101 determines whether or not there is a registered color scheme setting. If there is a registered color scheme setting, the CPU 101 proceeds to S2703. If there is no registered color scheme setting, the CPU 101 proceeds to S2705.

[0262] In S2703, the CPU 101 displays the registration numbers of the registered items in the color scheme registration list. Then, in S2704, the CPU 101 enables the delete button and the delete all button. Then, the CPU 101 proceeds to S2707.

[0263] In S2705, the CPU 101 displays an empty color scheme setting registration list. Then, in S2706, the CPU 101 disables the Delete button and the Delete All button. Then, the CPU 101 proceeds to S2707.

[0264] At S2707, CPU 101 determines whether the Delete All button has been pressed. If the Delete All button has been pressed, CPU 101 proceeds to S2708. At S2708, CPU 101 deletes all color scheme setting registration information from the color scheme setting registration list. Then, CPU 101 proceeds to S2712. If the Delete All button has not been pressed at S2707, CPU 101 proceeds to S2709.

[0265] In S2709, CPU 101 determines whether or not a selection of a registration number has been accepted from the color scheme setting registration list. If a selection of a registration number has been accepted, CPU 101 proceeds to S2710, and if a selection of a registration number has not been accepted, CPU 101 proceeds to S2712.

[0266] At S2710, CPU 101 determines whether pressing of the Delete button has been accepted. If pressing of the Delete button has been accepted, CPU 101 proceeds to S2711. At S2711, CPU 101 deletes the selected color scheme setting registration information from the color scheme setting registration list. Then, CPU 101 proceeds to S2712. As explained above, color scheme setting registration information is information that includes main color selection data D12 and the color scheme setting registration number associated with that data. If it is determined at S2710 that pressing of the Delete button has not been accepted, CPU 101 proceeds to S2712.

[0267] In S2712, CPU 101 determines whether a color scheme setting registration file has been selected. For example, when the user is registering a color matching color scheme setting, the user presses file selection button 2602 and selects color scheme setting save file F2. If a color scheme setting registration file has been selected, CPU 101 proceeds to S2713; if a color scheme setting registration file has not been selected, CPU 101 proceeds to S2714. In S2713, CPU 101 obtains and displays the color scheme setting registration number from the selected color scheme setting registration file. Note that if the selected file is not a predefined color scheme setting save file F2, for example, if it is a file with a different extension, the color scheme setting registration number cannot be obtained or displayed. After S2713, CPU 101 proceeds to S2714.

[0268] At S2714, CPU 101 determines whether the registration button has been pressed. If the registration button has been pressed, CPU 101 proceeds to S2715; if the registration button has not been pressed, CPU 101 terminates the processing of the flowchart shown in FIG. 27. At S2715, CPU 101 determines whether a color scheme setting registration number is displayed. If a color scheme setting registration number is displayed, CPU 101 proceeds to S2716. At S2716, CPU 101 registers color scheme setting registration information corresponding to the displayed color scheme setting registration number in the color scheme setting registration list. In other words, it registers the main color selection data D12 linked to the color scheme setting registration number. Then, CPU 101 terminates the processing of the flowchart shown in FIG. 27. On the other hand, if a color scheme setting registration number is not displayed, CPU 101 proceeds to S2717. At S2717, CPU 101 terminates the processing of the flowchart shown in FIG. 27 without registering information in the color scheme setting registration list. If the color scheme setting registration number is not displayed, it means, for example, that no color scheme setting registration file has been selected, or that a color scheme setting registration file has been selected but is not the appropriate color scheme setting save file F2.

[0269] The color scheme setting registration information registered in the color scheme setting registration list includes information linking the main color selection data D12 with a color scheme setting registration number, but the information included in the color scheme setting registration information is not limited to this information. For example, as described in the second embodiment, there may be a form in which color scheme settings can be set on an object category basis. Therefore, information in which the main color selection data D12 is set on an object category basis may be used as the color scheme setting registration information.

[0270] Fig. 26(b) shows an example of a color scheme setting registration / deletion dialog 2600 that uses object categories. As shown in Fig. 26(b), an object category list 2609 may be prepared in advance. The object category list 2609 displays a list of the object category information D14 described in the second embodiment, and is configured so that an object category can be selected from the list.

[0271] When registering in the color scheme setting registration list, the user may select object category information D14 from the object category list 2609 and register the object category information D14 and the main color selection data D12 in association with each other. That is, the content editing application may register the object category information D14 and the main color selection data D12 in association with each other. By registering the main color selection data D12 for each object category information D14, it is possible to change the color scheme for each object category, as described in the second embodiment.

[0272] As described above, according to this embodiment, the user can register or delete the main color selection data D12 as a color scheme setting as needed. This allows the user to use main color selection data D12 that they have used previously, or to edit content using main color selection data D12 received from another user. This improves the usability of the content editing application.

[0273] <<Fifth Embodiment>> In the first embodiment, an example was described in which a content editing application reads an image corresponding to a color desired by a user, extracts a primary color from the image, and changes the display color of a color palette of a content editing UI using the extracted primary color. In the second embodiment, an example was described in which the color of a color palette is changed depending on an object category.

[0274] In this embodiment, when printing with colors from a changed color palette, a form will be described in which printing is achieved with colors that match the user's desired colors (preferred colors). The following provides a supplementary explanation of the background of this embodiment.

[0275] In a content editing application, when editing a background, text, or the like to a color that suits the purpose, the user specifies the color that suits the purpose from the displayed color palette, as described above. This sets the color that suits the purpose for the content to be edited. However, when the content to be edited is actually printed, it may be printed in a color different from the color intended by the user. For example, consider a situation in which objects such as text, background, or clip art are added to a photo object that makes up the content to be edited, and then printing is performed. The printed matter output from the printer is printed after undergoing color processing that is optimal for the printer. Therefore, each object is generally printed in an appropriate color.

[0276] As described in the above embodiment, assume that the color of a specific object is to be matched to a desired color (e.g., the color of a product currently in hand). In this case, the printed color may be slightly different from the color intended by the user. For example, extracting a color from an image of an actual product in hand makes it easier for the user to select the desired color. However, depending on the performance of the imaging device, it may not be possible to perfectly reproduce the color of the product, and some imaging devices may involve color processing. For this reason, although it is possible to set a color close to the desired color of the product, there is room for further improvement in order to make the color even closer so that it is printed in a color suitable for printed matter.

[0277] There are also techniques that use well-known color management systems to match the colors displayed on a monitor with the colors printed in the printout. However, these require equipment and a system that can accurately measure the colors displayed on a monitor and the colors printed in the printout. Many users do not have such equipment and systems.

[0278] In this embodiment, a process is described in which, when changing and printing the color of an object included in content to be edited using a color selected from a color palette, the result printed by a printer becomes closer to the color of an actual item or item at hand. This embodiment provides a UI that makes the color of an object closer to a color that suits the purpose without changing the color of the overall printed result. Descriptions of the same configuration and process as in the above-mentioned embodiment will be omitted.

[0279] (10) Basic configuration (10-1) Hardware configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0280] (10-2) Software configuration Since this is the same as the first embodiment, the explanation will be omitted.

[0281] (11) Typical configuration (11-1) Configuration example of color matching color palette print color setting of this embodiment FIG. 28 is a diagram illustrating print color settings for a color matching color palette in the content editing application of this embodiment. FIG. 28(a) shows an example of a content editing UI 75 in this embodiment. The content editing UI 75 includes a color matching color palette print button 2811 and a color matching color palette registration button 2812. Note that, as described in the second embodiment, an example is shown in which a color palette 79 is prepared for each object type (each object category), but this example is not limiting. As described in the first embodiment, a color palette 79 may be prepared regardless of object category. When the color matching color palette print button 2811 is pressed, the content editing application displays a color palette print color setting dialog 2802 in FIG. 28(b).

[0282] 28(b) has a print color selection candidate color display area 2821, a print color selection check box 2822, a cancel button 2823, and an OK button 2824. The color palette print color setting dialog 2802 also displays a message that you can test print the selected color to match the color of the print result, and that you should select the color you want to print.

[0283] Print color selection candidate color data D15 is displayed in the print color selection candidate color display area 2821. The print color selection candidate color data D15 is the display color of the color palette 79 in the content editing UI 75 of Fig. 28(a). The print color selection candidate color data D15 may be all or some of the colors of the color palette 79.

[0284] The print color selection check box 2822 is a check box for accepting checks (selections) for one or more candidate colors from the candidate colors displayed in the print color selection candidate color display area 2821. Below, we will first explain an example where a selection for one candidate color is accepted, and then explain an example where a selection for multiple candidate colors is accepted.

[0285] The cancel button 2823 is an acceptance button for accepting cancellation of the color palette print color selection process. When the content editing application accepts pressing of the cancel button 2823, it closes the color matching color palette print color setting dialog 2802 and ends the color palette print color selection process.

[0286] The OK button 2824 is an acceptance button for accepting an OK button press in the color palette print color selection process. When the OK button 2824 is pressed, the content editing application confirms the candidate colors selected in the print color selection check boxes 2822 as the print color selection data D16, and ends the color palette print color selection process. When the OK button 2824 is pressed, the content editing application displays the print color registration dialog 2803 of FIG. 28(c). The print color selection data D16 is stored in a memory such as the ROM 102, RAM 103, or external storage device 104 of the client computer 1000 (or mobile terminal 2000).

[0287] The print color registration dialog 2803 in FIG. 28(c) has a print color registration number display area 2831, a print color display area 2832, and a selection candidate number display area 2833. The print color registration dialog 2803 also has a cancel button 2834 and a proceed to printing button 2835. The print color registration dialog 2803 is a registration dialog corresponding to one print color selection data D16. If multiple print color selection data D16 are selected, a print color registration dialog 2803 will be displayed for each print color selection data D16. Details will be described later. First, an example will be described in which one print color selection data D16 is selected.

[0288] The print color registration number display area 2831 displays a print color registration number name D17. The displayed print color registration number name D17 is a registration number (also referred to as first identification information) associated with the information displayed in the print color display area 2832 and the selection candidate number display area 2833. The content editing application generates the print color registration number name D17 displayed in the print color registration number display area 2831 as a multi-digit number, such as "0000001." The print color registration number name D17 is stored in a memory such as the ROM 102, RAM 103, or external storage device 104 of the client computer 1000. The generated print color registration number name D17 is generated after checking whether it is a registration number that has already been used, so that the numerical value of the generated print color registration number name D17 is not the same as that of an already generated registration number name. Note that if a print color registration number name D17 is registered in excess of the number of registrations provided in advance, the content editing application may display an error and prompt the user to delete the registered data, or may overwrite the data registered initially. Although numbers are used as an example here, any character string may be used. Even if any character string is used, appropriate checks will be carried out to prevent duplicate registrations.

[0289] A plurality of color-matching candidate colors D18 are displayed in the print color display area 2832. After the OK button 2824 in FIG. 28(b) is pressed, the content editing application generates a plurality of color-matching candidate colors D18 based on the print color selection data D16. That is, the content editing application generates the color-matching candidate colors D18 as a second color, which is a color obtained by changing the color value of the first color, based on the print color selection data D16 as a first color. Note that the print color selection data D16 used for generation also constitutes one of the candidate colors for color-matching D18. The content editing application then displays a plurality of color-matching candidate colors D18, including the print color selection data D16 used for generation, in the print color display area 2832.

[0290] The selection candidate color number name D19 is displayed in the selection candidate number display area 2833. The displayed selection candidate color number name D19 is displayed as the color-matching selection candidate color number name D19 (second identification information) associated with a plurality of color-matching candidate colors D18. For example, the selection candidate color number name D19 is a consecutive number starting from No. 1. In the example of FIG. 28(c), five color-matching candidate colors D18 are prepared, and therefore the selection candidate color number names D19 are also assigned from No. 1 to No. 5.

[0291] The print color display area 2832 and selection candidate number display area 2833 in Fig. 28(c) will be described. The content editing application displays the print color selection data D16 selected in the color palette print color setting dialog 2802 in Fig. 28(b) as the color matching candidate color D18 at position No. 3 in Fig. 28(c). For example, the candidate color placed at position No. 3 is (R, G, B) = (100, 150, 200).

[0292] When the OK button 2824 in Figure 28(b) is pressed, the content editing application generates multiple color matching candidate colors D18 based on the candidate color placed at position No. 3 in the print color selection data D16. The multiple color matching candidate colors D18 are color data that are close to the print color selection data D16. For example, the multiple color matching candidate colors D18 are as follows:

[0293] Color matching candidate color No. 1 is (R, G, B) = (98, 148, 198) Color matching candidate color No. 2 is (R, G, B) = (99, 149, 199) Color matching candidate color No. 3 is (R, G, B) = (100, 150, 200) Color matching candidate color No. 4 is (R, G, B) = (101, 151, 201) Color matching candidate color No. 5 is (R, G, B) = (102, 152, 202) In the above example, with the R, G, and B values ​​of No. 3 at the center, No. 1 is set to -2, No. 2 to -1, No. 4 to +1, and No. 5 to +2 for each RGB value, but this is not limited to this.

[0294] For example, with the R, G, and B values ​​of No. 3 as the center, No. 1 may be set to -4, No. 2 to -2, No. 4 to +2, and No. 5 to +4 for each RGB value. Also, only the R value may be changed as follows. That is, Color matching candidate color No. 1 is (R, G, B) = (98, 150, 200) Color matching candidate color No. 2 is (R, G, B) = (99, 150, 200) Color matching candidate color No. 3 is (R, G, B) = (100, 150, 200) Color matching candidate color No. 4 is (R, G, B) = (101, 150, 200) Color matching candidate color No. 5 is (R, G, B) = (102, 150, 200) In this way, only the R value may be changed. Alternatively, only the G value or the B value may be changed. Alternatively, a combination of these may be used. The system may be configured to accept changes to the amount or rate of change of the R value, G value, and B value from the user. In any case, it is sufficient that the color-matching candidate color D18 is generated by changing the candidate color whose selection has been accepted using a predetermined value.

[0295] Although the example in FIG. 28(c) illustrates the case where the number of color-matching candidate colors D18 is five, this is not limiting. For example, the number of values ​​to be changed for each RGB value, focusing on the R, G, and B values, may be 10 or 20. When changing the three values ​​of R, G, and B, for example, a pattern may be prepared in which the R value is fixed and the G and B values ​​are changed. Alternatively, a pattern may be prepared in which the G value is fixed and the R and B values ​​are changed. Alternatively, a pattern may be prepared in which the B value is fixed and the R and G values ​​are changed. The content editing application may use patterns prepared in this way. The content editing application may also determine the number of patterns based on the paper size to be printed. For example, the content editing application may assume that the paper to be printed is A4 size, determine the size of one color-matching candidate color D18, and automatically calculate and arrange the number of color-matching candidate colors D18 that will fit on the A4 paper size. Note that the paper size is not limited to A4. In this way, any colors can be used as the plurality of color matching candidate colors D18 as long as they are colors generated based on the print color selection data D16.

[0296] The cancel button 2834 is a button for canceling the registration process of the print colors of the color matching color palette. When the content editing application accepts the pressing of the cancel button 2834, it closes the print color registration dialog 2803 and ends the color matching color palette print color registration process.

[0297] The Proceed to Print button 2835 is a button that the content editing application uses to end the color matching color palette print color registration process and launch the print application. When the Proceed to Print button 2835 is pressed, the content editing application retains print color registration data D20. The print color registration data D20 is data that combines print color selection data D16, print color registration number name D17, multiple color matching candidate colors D18, and selection candidate color number name D19.

[0298] The print color registration data D20 is held in a memory such as the ROM 102, RAM 103, or external storage device 104 of the client computer 1000. The print color registration data D20 may also be held in a memory such as the ROM 302, RAM 303, or external storage device 304 of the server computer 3000. The content editing application saves the print color registration data D20 as a print color registration file F3. The content editing application then closes the print color registration dialog 2803 of FIG. 28(c) and ends the color matching color palette print color registration process. Next, the content editing application launches the print application.

[0299] Note that in the above example, the color matching color palette print color registration process has been described based on an example in which one print color selection data D16 is selected in Fig. 28(b), but the number of selectable print color selection data D16 is not limited to one. Fig. 28(b) describes an example in which the content editing application accepts the selection of two print color selection data D16. In Fig. 28(b), when the content editing application accepts the selection of two print color selection data D16 and accepts the pressing of the OK button 2824, it performs the following processing.

[0300] When OK button 2824 is pressed, the content editing application displays print color registration dialog 2803, as described above. At that time, the "Proceed to Print" button 2835 in Fig. 28(c) is changed to "Next Registration." In other words, if multiple print color selection data D16 are to be processed, registration processing is performed for each print color selection data D16.

[0301] The content editing application first displays the print color registration dialog 2803 of FIG. 28(c) with the first print color selection data D16 as the processing target. Then, upon receiving a press of the "Register Next" button 2835, which has a different notation, the content editing application registers the first print color selection data D16 currently being processed. Next, the print color registration dialog 2803 of FIG. 28(c) is displayed again with the second print color selection data D16 set as the print color selection data D16 to be processed. Note that when processing the second (last in this example) print color selection data D16, the content editing application changes the notation back to the "Proceed to Print" button 2835. Thereafter, upon receiving a press of the "Proceed to Print" button 2835, the content editing application registers the second print color registration data D20 and launches the print application.

[0302] FIG. 29 is a diagram outlining an example of printing on a printing medium using print data based on print color registration data D20. FIG. 29 shows the print result using print color registration print data D21 after color matching color palette print color registration processing has been performed. FIG. 29(a) shows a first printing medium 2901 printed using print color registration print data D21 when one print color registration data D20 has been registered. In FIG. 29(a), the print color registration number name D17 associated with the print color registration data D20 is printed in the registration number printing area 2911 as color matching color palette print color registration number.XXXXXX1. Furthermore, multiple color matching candidate colors D18 associated with the print color registration data D20 are printed as print colors 2912. Furthermore, multiple selection candidate color number names D19 associated with the print color registration data D20 are printed as numbers 2913.

[0303] Figure 29(b) shows a second print medium 2902 printed using print color registration print data D21 when two print color registration data D20 are registered. In Figure 29(b), the print color registration number name D17 associated with the first print color registration data D20 is printed in a registration number printing area 2921 as color matching color palette print color registration number.XXXXXX1. In addition, multiple color matching candidate colors D18 associated with the print color registration data D20 are printed in print colors 2922. In addition, multiple selection candidate color number names D19 associated with the print color registration data D20 are printed as numbers 2923. In addition, in Figure 29(b), the print color registration number name D17 associated with the second print color registration data D20 is printed in a registration number printing area 2924 as color matching color palette print color registration number.XXXXXX2. Additionally, a plurality of color matching candidate colors D18 linked to the print color registration data D20 are printed in the print color 2925. Additionally, a plurality of selection candidate color number names D19 linked to the print color registration data D20 are printed as numbers 2926.

[0304] Like the edited content data D3, the print data D21 for print color registration is data that can undergo rendering processing to be converted into print image data D8 in accordance with the print setting information D7. For example, the print data D21 for print color registration is set with information included in the print color registration data D20. Specifically, this is the registration number name included in the print color registration number display area 2831, the print color included in the print color display area 2832, and the selection candidate number name included in the selection candidate number display area 2833, as displayed in the print color registration dialog 2803 of FIG. 28(c).

[0305] Like the edited content data D3, the print color registration print data D21 may be configured using HTML, CSS, etc. The print color registration print data D21 may be any data that can be rendered by the rendering processing unit 55 described above.

[0306] The print application receives the print color registration print data D21 and the various print settings described above. The print application is started when the content editing application accepts the pressing of the print execution button 68 in FIG. 6, and performs rendering processing and printing.

[0307] (11-2) Flowchart of color matching color palette color setting printing process 30, 31, and 32 are flowcharts for explaining the color matching color palette color setting printing process in this embodiment. FIG. 30 is a flowchart of the color matching color palette color setting printing process. FIG. 31 is a flowchart of the print color registration process. FIG. 32 is a flowchart of the color palette printing process. The processes shown in FIGS. 30 to 32 are realized by the CPU 101 reading a client program stored in the ROM 102 or the like of the client computer 1000 into the RAM 103 and executing it. More specifically, the processes of the flowcharts shown in FIGS. 30 to 32 are executed by the CPU 101 of the client computer 1000 having a web browser. That is, the CPU 101 of the client computer 1000 reads the client program received from the server computer 3000 into the RAM 103 and executes it, thereby executing it by the CPU 101 operating the web browser. Execution of the client program by the web browser results in the execution of a web application provided by the server computer 3000 through the web browser. 30 to 32 may be implemented by hardware such as an ASIC or electronic circuit. The symbol "S" in the description of each process indicates a step in the sequence diagram (the same applies to flowcharts in this specification). The processes in FIGS. 30 to 32 are executed by a content editing application. As in the first embodiment, this embodiment will be described based on an example in which the content editing application and the print application are different applications, but they may also be executed by the same application.

[0308] 30 to 32 will be described using an example in which the processes are executed on the client computer 1000, but these processes may also be executed on the server computer 3000. Furthermore, the processes may be executed according to a program installed on the client computer 1000 as a native application, rather than in the form of a Web application.

[0309] 7 is displayed on the client computer 1000, and a UI for editing a poster as the content to be edited is displayed. Also, as described in the first or second embodiment, it is assumed that colors have been set in the color palette based on the color extraction file F1. The processing of the flowchart shown in FIG. 30 is initiated when the content editing application accepts pressing of the color matching color palette print button 2811 in FIG. 28(a).

[0310] In S3001, the content editing application accepts pressing of the color matching color palette print button 2811. That is, S3001 is the start trigger process of the flowchart in FIG.

[0311] In S3002, the content editing application displays the color palette print color setting dialog 2802 in Fig. 28(b). In S3002, the content editing application arranges the print color selection candidate color data D15 in one or more print color selection candidate color display areas 2821 based on the display colors of the color palette of the content editing UI 75 in Fig. 28(a) described above.

[0312] In S3003, the content editing application determines whether the cancel button 2823 has been pressed. If it is determined that the cancel button 2823 has been pressed, the content editing application cancels the color palette printing process and terminates the processing of the flowchart shown in Fig. 30. In other words, it interrupts the color palette printing process and terminates the display of the color palette print color setting dialog 2802 of Fig. 28(b). On the other hand, if the content editing application determines that the cancel button 2823 has not been pressed (i.e., if it determines that the OK button 2824 has been pressed), it proceeds to S3004.

[0313] In S3004, the content editing application accepts the selection of a print color from the candidate colors arranged in the color palette print color setting dialog 2802 of Fig. 28(b). The selection of a color matching color palette print color is accepted by checking one or more candidate colors in the print color selection checkboxes 2822 linked to the print color selection candidate color display area 2821. In S3005, the content editing application accepts pressing of the color matching color palette print color selection OK button 2824 of Fig. 28(b).

[0314] Next, in S3006, the content editing application displays the print color registration dialog 2803 of Fig. 28(c) based on the acceptance of the press of the color matching color palette print color selection OK button (OK button 2824) of Fig. 28(b). The content editing application also closes the color palette print color setting dialog 2802 of Fig. 28(b).

[0315] In S3007, the content editing application executes a print color registration process, the details of which will be described later with reference to FIG.

[0316] In S3008, the content editing application starts color matching color palette printing execution based on the acceptance of the press of the Proceed to Print button 2835 in Fig. 28(c). In detail, the content editing application starts the print application and executes the color palette printing process shown in Fig. 32, which will be described later. Then, the content editing application ends the processing of the flowchart shown in Fig. 30.

[0317] (11-3) Flowchart of print color registration process Fig. 31 is a flowchart for explaining the print color registration process. In S3101, the content editing application determines whether or not processing has been completed for the number of print color selection data D16. If the content editing application determines that processing has been completed for the number of print color selection data D16, it ends the processing of the flowchart shown in Fig. 31. On the other hand, if the content editing application determines that processing has not been completed for the number of print color selection data D16 set, it proceeds to S3102.

[0318] In S3102, the content editing application sets the print color registration number name D17, which is information constituting the print color registration data D20, in the print color registration number display area 2831.

[0319] In S3103, the content editing application determines whether or not processing has been completed for the number of color-matching candidate colors D18. If the content editing application determines that processing has been completed for the number of color-matching candidate colors D18, the process proceeds to S3106. On the other hand, if the content editing application determines that processing has not been completed for the number of color-matching candidate colors D18, the process proceeds to S3104.

[0320] In S3104, the content editing application sets, in the print color display area 2832, a plurality of color matching candidate colors D18, which are information that constitutes the print color registration data D20.

[0321] In S3105, the content editing application sets a plurality of selection candidate color number names D19, which are information that constitutes the print color registration data D20, in the selection candidate number display area 2833. After S3105, the content editing application returns to S3103.

[0322] In S3106, the content editing application updates the display of the print color registration dialog 2803 in Fig. 28(c). The updated display contents include a print color registration number display area 2831 that displays the print color registration number name D17, a print color display area 2832 that displays multiple color-matching candidate colors D18, and a selection candidate number display area 2833 that displays multiple selection candidate color number names D19.

[0323] In S3107, the content editing application determines whether the cancel button 2834 has been pressed in the print color registration dialog 2803 of Fig. 28(c). If the content editing application determines that the cancel button 2834 has been pressed, it cancels the color matching color palette print color registration process and terminates the processing of the flowchart shown in Fig. 31. In other words, it interrupts the color matching color palette print color registration process and terminates the display of the print color registration dialog 2803 of Fig. 28(c). On the other hand, if it determines that the cancel button 2834 has not been pressed (in other words, the proceed to printing button 2835 (or "Next Registration") has been pressed), the process proceeds to S3108.

[0324] In S3108, the content editing application creates print color registration data D20 based on the set data and stores it in memory such as ROM 102, RAM 103, or external storage device 104 of the client computer 1000. In S3109, the content editing application saves the print color registration data D20 as a print color settings save file F3. The process then proceeds to S3101. In this manner, in S3101 to S3109, the content editing application repeats the process for the number of print color selection data D16 settings, and then terminates the process of the flowchart shown in FIG. 31. The content editing application also closes the print color registration dialog 2803 of FIG. 28(c). While this embodiment will be described based on an example in which one piece of print color registration data D20 is saved in the print color settings save file F3, multiple pieces of print color registration data D20 may be saved.

[0325] (11-4) Flowchart of color palette printing Fig. 32 is a flowchart for explaining the color palette print execution process in this embodiment. Fig. 32 starts when the content editing application starts the print application in response to the pressing of the Proceed to Print button 2835 in Fig. 28(b).

[0326] In S3201, the content editing application acquires print setting information D7 set by the print application. In S3202, the content editing application determines whether or not processing has been completed for the number of print color registration data D20. If it is determined that processing has been completed for the number of print color registration data D20, the process proceeds to S3204. On the other hand, if the content editing application determines that processing has not been completed for the number of print color registration data D20, the process proceeds to S3203.

[0327] In S3203, the content editing application acquires the print color registration data D20. In S3204, the content editing application creates the above-mentioned print color registration print data D21 based on the acquired print color registration data D20 and the print setting information D7. Note that when creating the print color registration print data D21, depending on the number of registrations in the print color registration data D20, it may not fit on the paper size set in the print setting information D7 in the print application. In that case, multiple copies may be printed. The content editing application then ends the processing of the flowchart in FIG. 32.

[0328] The print application prints based on the print color registration print data D21 created in this way. The user then visually checks the printed print color registration print data D21 and inputs the selection candidate color number name D19 of the print color that is printed appropriately. Details will be described later.

[0329] (11-5) Example of color matching color palette print color registration and deletion In the above-described embodiment, an example was shown in which the created print color registration data D20 was saved in the print color setting save file F3. Below, a method for registering and deleting print color settings will be described with reference to Figures 33 and 34.

[0330] Fig. 33 is a diagram for explaining color matching print color setting registration and deletion. Fig. 33(a) shows a print color setting registration / deletion dialog 3300. The print color setting registration / deletion dialog 3300 is a dialog screen that the content editing application displays on the screen of Fig. 7 when it accepts pressing of the color matching color palette registration button 2812 in the content editing UI 75 of Fig. 28(a). In other words, as described above, this is a screen on which the user confirms and registers the results after printing is performed by the printing application based on the print color registration print data D21.

[0331] When displaying the print color setting registration / deletion dialog 3300, the content editing application determines whether any print color settings have already been registered. Registered print color settings are print color settings for which the selection candidate color number name D19 (second identification information) used for printing has been registered. If any print color settings have already been registered, the content editing application displays the registered registration numbers in the print color setting registration list 3301. The print color setting registration list 3301 includes the print color registration number name D17 that constitutes the print color registration data D20 included in the print color setting save file F3, so the print color registration number name D17 is displayed. If multiple print color registration data D20 are registered, for example, the print color registration number name D17 included in the print color registration data D20 that was most recently registered is displayed in the print color setting registration list 3301. Furthermore, because the print color setting registration list 3301 is in list format, the user can open the list, and if multiple settings are registered, the registered multiple print color registration number names D17 are displayed and can be selected from the list.

[0332] When registering new color matching print color settings, the user presses file selection button 3302. The content editing application accepts the pressing of file selection button 3302 and accepts from the user the selection of a print color settings save file F3 saved in client computer 1000 or the like. The content editing application displays the file name of the print color settings save file F3 whose selection has been accepted in file name 3303. In addition, the print color registration number name D17 constituting the print color registration data D20 saved in the selected print color settings save file F3 is displayed in registered color palette No. name 3304 from registered print color palette No. name 3304. For example, the color matching color palette print color registration number printed in registration number print area 2911 in FIG. 29(a) is displayed in registered color palette No. name 3304.

[0333] Furthermore, the content editing application displays a list of multiple selection candidate color number names D19 that make up the print color registration data D20 so that they can be selected in a selection candidate color list 3310. For example, the multiple selection candidate color number names D19 associated with the print color registration data D20, as displayed at number 2913 in FIG. 29(a), are displayed in a list. The user visually checks the printout of the color palette and selects the desired selection candidate color number name D19 from the selection candidate color list 3310. The user then presses the register button 3305. The color selected by the user from the selection candidate color list 3310 is also referred to as the third color.

[0334] 33, the content editing application performs a registration process for the print color registration data D20. That is, a process is performed to register the selection candidate color number name D19 (third color) selected in the selection candidate color list 3310 together with the color matching candidate color D18 that constitutes the print color registration data D20. If the registration is successful, the print color registration number name D17 displayed in the registered color palette No. name 3304 is added to the list displayed in the print color setting registration list 3301.

[0335] Next, we will explain the process for deleting a registration from registered print color setting registration list 3301. The user selects the registration number they wish to delete from print color setting registration list 3301. Then, the user presses delete button 3306. When the content editing application receives the press of delete button 3306, it deletes the print color registration data D20 linked to the selected registration number and the data of the registration number from print color setting registration list 3301.

[0336] Furthermore, if the user wishes to delete all registered data registered in print color setting registration list 3301, the user presses delete all button 3307. When the content editing application accepts the pressing of delete all button 3307, it deletes all print color registration data D20 and the data of the registration numbers from print color setting registration list 3301. When the content editing application accepts the pressing of end button 3308, it closes print color setting registration / deletion dialog 3300.

[0337] When the print color setting registration is completed, the print color setting registration information registered in the print color setting registration list 3301 is used as the selected color matching print color data of this embodiment. The print color setting registration information is information that includes the print color registration data D20.

[0338] (11-6) Flowchart for registering and deleting color settings for color matching printing FIG. 34 is a flowchart of the color matching print color setting registration and deletion process in this embodiment. The process shown in FIG. 34 is realized by the CPU 101 reading a client program stored in the ROM 102 or the like of the client computer 1000 into the RAM 103 and executing it. More specifically, the process of the flowchart shown in FIG. 34 is executed by the CPU 101 of the client computer 1000 having a web browser. That is, the CPU 101 of the client computer 1000 reads the client program received from the server computer 3000 into the RAM 103 and executes it, thereby executing it by the CPU 101 operating the web browser. By executing the client program through the web browser, a web application provided by the server computer 3000 is executed through the web browser. Note that the process of the flowchart shown in FIG. 34 is described here using an example in which it is executed on the client computer 1000. However, as described in the first embodiment, these processes may also be executed on the server computer 3000. Furthermore, instead of the form of a web application, as described in the first embodiment, the process may be executed according to a program installed on the client computer 1000 as a native app.

[0339] The processing of the flowchart in Fig. 34 is started, for example, when the color matching color palette registration button 2812 in the content editing UI 75 in Fig. 28(a) is pressed. Note that when attempting to register new print color settings, it is assumed that the color palette printing process has been performed in advance.

[0340] In S3401, the CPU 101 displays the print color setting registration / deletion dialog 3300. In S3402, the CPU 101 determines whether or not there are any registered print color settings. If there are any registered print color settings, the CPU 101 proceeds to S3403. If there are no registered print color settings, the CPU 101 proceeds to S3405.

[0341] In S3403, the CPU 101 displays the registration numbers of the registered items in the print color setting registration list. Then, in S3404, the CPU 101 enables the Delete button and the Delete All button. Then, the CPU 101 proceeds to S3407.

[0342] In S3405, the CPU 101 displays an empty print color setting registration list. Then, in S3406, the CPU 101 disables the Delete button and the Delete All button. Then, the CPU 101 proceeds to S3407.

[0343] In S3407, CPU 101 determines whether the Delete All button has been pressed. If the Delete All button has been pressed, CPU 101 proceeds to S3408. In S3408, CPU 101 deletes all print color setting registration information from the print color setting registration list. Then, CPU 101 proceeds to S3412. If the Delete All button has not been pressed in S3407, CPU 101 proceeds to S3409.

[0344] In S3409, CPU 101 determines whether a registration number has been selected from the print color setting registration list. If a registration number has been selected, CPU 101 proceeds to S3410, and if a registration number has not been selected, CPU 101 proceeds to S3412.

[0345] At S3410, CPU 101 determines whether pressing of the Delete button has been accepted. If pressing of the Delete button has been accepted, CPU 101 proceeds to S3411. At S3411, CPU 101 deletes the selected print color setting registration information from the print color setting registration list. Then, CPU 101 proceeds to S3412. As explained above, print color setting registration information is information including print color registration data D20 and the print color registration number name D17 that constitutes the print color registration data D20. If it is determined at S3410 that pressing of the Delete button has not been accepted, CPU 101 proceeds to S3412.

[0346] In S3412, CPU 101 determines whether print color registration file F3 has been selected. For example, when the user is registering color-matching print color settings, the user presses file selection button 3302 to select print color registration file F3. If print color registration file F3 has been selected, CPU 101 proceeds to S3413. If print color registration file F3 has not been selected, CPU 101 proceeds to S3414. In S3413, CPU 101 acquires and displays print color registration number name D17 from the selected print color registration file F3. CPU 101 also acquires and displays selection candidate color number name D19 from the selected print color registration file F3. That is, CPU 101 displays a list of multiple selection candidate color number names D19 in selection candidate color list 3310. The multiple selection candidate color number names D19 are information linked to the print color registration number name D17 whose selection was accepted in S3409. If the selected file is not a predefined print color registration file F3, for example, if the file has a different extension, the print color registration number name D17 and the selection candidate color number name D19 cannot be obtained or displayed. After S3413, CPU 101 proceeds to S3414.

[0347] At S3414, CPU 101 determines whether the registration button has been pressed. If the registration button has been pressed, CPU 101 proceeds to S3415. If the registration button has not been pressed, CPU 101 terminates the processing of the flowchart shown in FIG. 34. At S3415, CPU 101 determines whether the print color registration number name D17 and the selection candidate color number name D19 are displayed. If the print color registration number name D17 and the selection candidate color number name D19 are displayed, CPU 101 proceeds to S3416. At S3416, CPU 101 registers the print color setting registration information corresponding to the displayed print color registration number name D17 in the print color setting registration list. That is, the selected selection candidate color number name D19 is registered in association with the print color registration number name D17. Then, CPU 101 terminates the processing of the flowchart shown in FIG. 34. On the other hand, if the print color registration number name D17 or the selection candidate color number name D19 is not displayed, CPU 101 proceeds to S3417. In S3417, CPU 101 does not register the print color setting registration information in the print color setting registration list, and ends the processing of the flowchart shown in FIG. 34. If the print color registration number name D17 is not displayed, for example, this means that the print color registration file F3 has not been selected, or that the print color registration file F3 has been selected but is not an appropriate print color registration file F3. If the selection candidate color number name D19 is not displayed, for example, this means that there is no selection candidate color list 3410 linked to the print color registration number name D17, or that no selection has been made in the selection candidate color list 3410.

[0348] When print color setting registration information is registered in the print color setting registration list, the print color of all objects arranged in the content to be edited may be replaced with the registered color. That is, all objects containing the color of the print color selection data D16 included in the print color setting registration information are replaced with the print color of the selection candidate color number name D19 included in the print color setting registration information. However, this is not limited to this. As described in the second embodiment, the print color registration data D20 may be set on an object-by-object basis. For example, as described in the second embodiment, there may be a form in which print colors can be set on an object category-by-object basis. Therefore, information in which the print color registration data D20 is set on an object category-by-object basis may be used as the print color setting registration information. That is, the print color setting registration information registered in the print color setting registration list may be information in which the print color registration number name D17 and the selection candidate color number name D19 constituting the print color registration data D20 are linked on an object category-by-object basis.

[0349] Fig. 33(b) shows an example of a print color setting registration / deletion dialog 3300 that uses object categories. As shown in Fig. 33(b), an object category list 3309 may be prepared in advance. The object category list 3309 displays a list of the object category information D14 described in the second embodiment, and is configured so that an object category can be selected from the list.

[0350] When registering in the print color setting registration list, the user may select object category information D14 from the object category list 3309 and register the object category information D14 in association with the print color registration data D20. That is, the content editing application may register the object category information D14 in association with the print color registration data D20. By registering the print color registration data D20 for each object category information D14, it is possible to change the print color for each object category, as described in the second embodiment.

[0351] (11-7) Flowchart of printing process when changing print color Fig. 35 is a diagram showing an example of a flowchart of printing processing performed using the print color settings registered above. The processing of the flowchart shown in Fig. 35 can be executed in the form of software for a printing system that uses both the functional units of the client computer 1000 and the functional units of the server computer, as described in Fig. 5. Alternatively, the processing shown in Fig. 35 may be performed using a printing application installed on the client computer 1000. The processing of the flowchart shown in Fig. 35 is started when CPU 101 accepts pressing of Proceed to Print button 77 on edit screen 70 of Fig. 7.

[0352] In S3501, CPU 101 accepts pressing of the Proceed to Print button. S3501 is the start trigger process of the flowchart in FIG. 35. Next, in S3502, CPU 101 acquires edited content data D3. Next, in S3503, CPU 101 displays print setting screen 60 shown in FIG. 6. For example, CPU 101 displays edited content data D3 acquired in S3502 in content display area 61.

[0353] In S3504, CPU 101 determines whether printing is to be performed. If it is determined that printing is not to be performed, CPU 101 ends the printing process using the matching printing colors. For example, if print application end button 69 is pressed, CPU 101 ends the activation of the print application without performing printing. Furthermore, CPU 101 determines that printing is to be performed based on the acceptance of pressing of print execution button 68 in FIG. 6. If it is determined that printing is to be performed, CPU 101 proceeds to S3505.

[0354] In S3505, CPU 101 acquires print setting information D7 set in the UI for various print settings on print setting screen 60 of FIG. 6. Next, in S3506, CPU 101 determines whether or not to execute print processing using color-matching print colors. If it is determined that color-matching print colors will not be used, CPU 101 does not replace color-matching print colors and proceeds to S3511. If it is determined that color-matching print colors will be used, CPU 101 proceeds to S3507. The determination of whether or not to execute print processing using color-matching print colors is made based on, for example, print color setting registration list 3301. That is, if any print color setting registration information is registered in print color setting registration list 3301, it is determined that print processing using color-matching print colors will be executed. Alternatively, for example, the print setting screen 60 may include a checkbox for determining whether or not to execute print processing using color-matching print colors, and if the checkbox is checked, CPU 101 may determine that color-matching print colors will be used.

[0355] In S3507, the CPU 101 acquires the registered print color setting registration list 3301. The acquired registered print color setting registration list 3301 is one or more print color registration data D20. The print color registration data D20 includes the print color selection data D16 and the selection candidate color number name D19. This information is used to convert the RGB values ​​of the print color selection data D16 into the RGB values ​​of the print color identified by the selection candidate color number name D19. While the present embodiment describes an example in which the print color registration data D20 includes the print color selection data D16, this is not limited to this. For example, as described above, one of the color-matching candidate colors D18 is a color whose color value has not been changed, i.e., the same color as the print color selection data D16. If a color whose color value has not been changed can be identified from the color-matching candidate colors D18 according to a predetermined rule, the print color registration data D20 does not need to include the print color selection data D16. Furthermore, as described above, the print color registration data D20 may contain a combination of the color matching candidate color D18 and the selection candidate color number name D19 set for each object. In this way, when print color setting registration information (i.e., information including a third color) is registered in the print color setting registration list 3301, a process is performed to convert the first color set in the color palette to the third color.

[0356] In S3508, the CPU 101 determines whether or not the number of objects set in the print color registration data D20 has been processed. For example, a specific example will be described with reference to FIG.

[0357] Fig. 36 is an image diagram of the state before and after the replacement process of the color-matching printing color. The edited content data D3 in Fig. 36 is content data 3600 made up of three objects 3601 to 3603. In this case, in the process of S3508, the process is repeated for the number of three objects.

[0358] In S3509, CPU 101 determines whether the object to be processed in edited content data D3 is a target of color-matching candidate colors D18. If it is determined that the object is not a target, the process returns to S3508. If it is determined that the object is a target, the process proceeds to S3510. Whether the object is a target of color-matching candidate colors D18 is determined based on whether the color set for the object to be processed is in print color selection data D16.

[0359] In S3510, the CPU 101 performs print color replacement processing. This will be described with reference to FIG. 36. FIG. 36(a) shows the content data before the print color is changed. FIG. 36(b) shows the content data after the print color is changed. In this case, it is assumed that the print color replacement is performed for three objects in FIG. 36(a), and the print color of object 3602, which is the target of print color replacement, is replaced. Object 3602 in FIG. 36(b) is an illustration of the state after the print color replacement. The colors of the other objects 3601 and 3603 remain unchanged, but only the color of object 3602 has been changed. Objects 3601 to 3603 can be any type of object. Note that photo objects generally do not have their colors changed using a color palette. For this reason, for example, if the content data contains a mixture of photo objects and text objects, the print color replacement processing is not performed on the photo objects. In other words, even if a part of a photo object uses the same color as the print color selection data D16, the print color replacement process is not performed on the photo object. This makes it possible to adjust the print color of the text object while maintaining the color reproducibility of the photo object.

[0360] In S3511, CPU 101 uses the acquired print setting information D7 to send the edited content data D3 with the print colors replaced to rendering processing unit 55. Rendering processing unit 55 receives print setting information D7 and edited content data D3 with the print colors replaced, and generates print image data D8. Then, print data sending unit 56 converts print image data D8 into the transmission format of the selected printer, generates print data D5, and sends print data D5 to printer 4000 via the communication I / F of each terminal, where printing is performed.

[0361] As described above, according to this embodiment, it is possible to use a color palette to change the color of an object placed in content to be edited and then print it. Furthermore, when printing, it is possible to provide a UI that enables the color of the printed result of the placed object to be closer to a desired color. In this embodiment, even if the color displayed on the color palette is a color registered in the print color setting registration information, the displayed color is not changed, and when printing is performed, the color is converted based on the print color setting registration information.

[0362] <<Other embodiments>> In the above-described embodiment, examples were given of changing the color scheme of a color palette in the content editing UI 75 and changing the color scheme when adding an object from a material. Also, an example was given of reusing color scheme settings using a color scheme setting save file. Here, for example, when reusing color scheme settings, the reuse scenario is not limited to changing the color scheme of a color palette or a material. For example, before a user selects a template, a color scheme setting save file may be applied to change the color scheme of the template's selection candidates. Furthermore, when a template is composed of a combination of objects, the color scheme may be changed by applying corresponding main color selection data D12 to each object constituting the template according to the object category, as described in the second embodiment and the like.

[0363] In the above-described embodiment, the content editing application acquires one file as the color extraction file F1 for extracting primary colors. However, this is not limiting. For example, multiple color extraction files F1 may be acquired. The content editing application may then use each color extraction file F1 to perform a primary color extraction process and combine the primary colors obtained from the multiple files to set the color palette. The primary colors may simply be added together, or, if the primary colors obtained from the multiple files are within a predetermined color range, the color obtained by averaging the color values ​​of those primary colors may be used as the primary color.

[0364] Although the color extraction file F1 has been described using examples such as bitmap image data (raster image data), vector image data such as SVG data, or an HTML file, the present invention is not limited to these examples. Any data format may be used as long as the desired color can be extracted. For example, if the color name is known, the color name may be entered. In the third embodiment, the color in the color extraction file F1 may be extracted by specifying a color palette whose color scheme was changed in the first embodiment. Furthermore, a predetermined search may be performed and an image obtained as a result of the search may be used. For example, a user may not own the goods recommended by an acquaintance, and when gifting goods to an acquaintance, the image may not be available. Even if the image is not available, the processing of the above-described embodiment can be performed using an image available on the web, etc.

[0365] The above-described embodiments are configuration examples for achieving the effects of the present disclosure, and cases in which similar effects can be achieved using other similar methods or different parameters are included in the scope of the present disclosure. Furthermore, the present disclosure can be applied to a system consisting of multiple devices (e.g., a host computer, an interface device, a reader, a printer, etc.) and to an apparatus consisting of a single device (e.g., a printer, a copier, a facsimile machine, etc.).

[0366] The present disclosure can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0367] The disclosure of the present embodiment includes configurations typified by the following information processing device example, information processing device control method example, and program example.

[0368] <Configuration 1> Computer, a receiving means for receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of the object and a second color that is a color obtained by changing the color value of the first color; a registration means for registering a third color selected by a user from among the plurality of candidate colors; an output means for, when receiving an instruction to print content including the object, outputting an instruction to print the content in which the first color has been converted into the third color based on the fact that the third color has been registered in the registration means; A program to function as a

[0369] <Configuration 2> The program described in configuration 1 is characterized in that, when the receiving means receives an instruction to print the plurality of candidate colors, the output means outputs an instruction to print a printed material including first identification information used to register colors, the plurality of candidate colors, and second identification information corresponding to each of the plurality of candidate colors.

[0370] <Configuration 3> 3. The program according to configuration 2, wherein the output means also outputs information including the first identification information, the plurality of candidate colors, and the second identification information to a file.

[0371] <Configuration 4> The program according to configuration 3, wherein the registration means is configured to read out the file and accept from the user a selection of the second identification information corresponding to the first identification information.

[0372] <Configuration 5> The program described in any one of configurations 2 to 4, characterized in that the registration means registers the third color identified by the second identification information based on receiving a selection of the second identification information corresponding to the first identification information from a user.

[0373] <Configuration 6> 6. The program according to any one of configurations 1 to 5, wherein the object is a first object whose color can be changed using the color palette.

[0374] <Configuration 7> the content includes the first object and a second object whose color cannot be changed using the color palette; 7. The program according to configuration 6, wherein the output means converts the first color of the first object to the third color, and does not convert the color of the second object.

[0375] <Configuration 8> The program described in configuration 7, wherein the output means does not convert the first color of the second object to the third color even if the first color is included in the second object.

[0376] <Configuration 9> the first object is a character object, a graphic object, or a background object; 9. The program according to claim 7 or 8, wherein the second object is a photo object.

[0377] <Configuration 10> 10. The program according to any one of configurations 1 to 9, wherein the first color is displayed on the color palette even when the third color is registered in the registration means.

[0378] <Configuration 11> the registration means registers the third color for each object category to which the object belongs; The program described in any one of configurations 1 to 10, characterized in that when the output means receives an instruction to print content including the object, it outputs an instruction to print the content in which the first color has been converted to the third color, based on the fact that the third color is registered in the object category to which the object belongs in the registration means.

[0379] <Configuration 12> The computer an acquisition means for acquiring image data; a setting means for setting a color included in an image represented by the image data acquired by the acquisition means; a display control means for displaying a first color palette including the colors included in the image on an editing screen for editing content, based on the colors included in the image being set by the setting means; It further functions as 12. The program according to any one of configurations 1 to 11, wherein the first color is a color contained in the image.

[0380] <Configuration 13> a receiving means for receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of the object and a second color that is a color obtained by changing the color value of the first color; a registration means for registering a third color selected by a user from among the plurality of candidate colors; an output means for, when receiving an instruction to print content including the object, outputting an instruction to print the content in which the first color has been converted into the third color based on the fact that the third color has been registered in the registration means; An information processing device comprising:

[0381] <Configuration 14> receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of the object and a second color that is a color obtained by changing the color value of the first color; registering a third color selected by a user from the plurality of candidate colors; When an instruction to print content including the object is received, outputting an instruction to print the content in which the first color has been converted into the third color based on the fact that the third color has been registered; 1. A method for controlling an image processing apparatus, comprising: [Explanation of symbols]

[0382] 1000 client computers 101 CPU 110 Display Devices

Claims

1. Computer, a receiving means for receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of the object and a second color that is a color obtained by changing the color value of the first color; a registration means for registering a third color selected by a user from among the plurality of candidate colors; an output means for outputting, when receiving an instruction to print content including the object, an instruction to print the content in which the first color has been converted into the third color, based on the fact that the third color has been registered in the registration means; A program to function as a

2. The program according to claim 1, characterized in that when the receiving means receives an instruction to print the plurality of candidate colors, the output means outputs an instruction to print a printed material including first identification information used to register colors, the plurality of candidate colors, and second identification information corresponding to each of the plurality of candidate colors.

3. 3. The program according to claim 2, wherein the output means also outputs information including the first identification information, the plurality of candidate colors, and the second identification information to a file.

4. 4. The program according to claim 3, wherein the registration means is configured to read the file and accept, from a user, a selection of the second identification information corresponding to the first identification information.

5. The program according to claim 2, characterized in that the registration means registers the third color identified by the second identification information based on receiving a selection of the second identification information corresponding to the first identification information from a user.

6. 6. The program according to claim 1, wherein the object is a first object whose color can be changed using the color palette.

7. the content includes the first object and a second object whose color cannot be changed using the color palette; 7. The program according to claim 6, wherein the output means converts the first color of the first object to the third color, and does not convert the color of the second object.

8. 8. The program according to claim 7, wherein the output means does not convert the first color of the second object to the third color even if the first color is included in the second object.

9. the first object is a character object, a graphic object, or a background object; 8. The program according to claim 7, wherein the second object is a photo object.

10. 6. The program according to claim 1, wherein the first color is displayed on the color palette even when the third color is registered in the registration means.

11. the registration means registers the third color for each object category to which the object belongs; The program described in any one of claims 1 to 5, characterized in that when the output means receives an instruction to print content including the object, it outputs an instruction to print the content with the first color converted to the third color based on the fact that the third color is registered in the object category to which the object belongs in the registration means.

12. The computer an acquisition means for acquiring image data; a setting means for setting a color included in an image represented by the image data acquired by the acquisition means; a display control means for displaying a first color palette including the colors included in the image on an editing screen for editing content, based on the colors included in the image being set by the setting means; It further functions as 6. The program according to claim 1, wherein the first color is a color contained in the image.

13. a receiving means for receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of the object and a second color that is a color obtained by changing the color value of the first color; a registration means for registering a third color selected by a user from among the plurality of candidate colors; an output means for outputting, when receiving an instruction to print content including the object, an instruction to print the content in which the first color has been converted into the third color, based on the fact that the third color has been registered in the registration means; An information processing device comprising:

14. receiving an instruction to print a plurality of candidate colors including a first color set in a color palette that specifies the color of the object and a second color that is a color obtained by changing the color value of the first color; registering a third color selected by a user from the plurality of candidate colors; when receiving an instruction to print content including the object, outputting an instruction to print the content in which the first color has been converted into the third color based on the fact that the third color has been registered; 1. A method for controlling an image processing apparatus, comprising:

Images