Information processing apparatus, method, and program

Abstract

To provide an information processing apparatus capable of printing a commercial material that appropriately gives an impression intended by a user.SOLUTION: An information processing apparatus is configured to: generate multiple pieces of commercial material data on the basis of content of a commercial material, a designation of impression, and conditions of the commercial material; and display a commercial material image based on the generated multiple pieces of commercial material data. The commercial material image is an image represented by data specified based on the designation of the impression from a multiple pieces of data generated from the multiple pieces of commercial material data based on information of a color gamut reproducible by printing means that prints the commercial material.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, method, and program. [Background technology]

[0002] It has been known in the past to prepare a template that stores information such as the shape and arrangement of images, characters, graphics, etc. that constitute a poster, and to generate a poster by automatically arranging the images, characters, graphics, etc. according to the template. Patent Document 1 proposes generating a poster by selecting templates in ascending order of difference between the impression evaluation value of the template and the impression evaluation value of the image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-59123 A Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, a template is selected in which the difference between the impression evaluation value of the template and the impression evaluation value of the image is small, but no consideration is given to generating a commercial product that expresses the user's intended impression, including color changes during printing.

[0005] An object of the present invention is to provide an information processing device, method, and program that are capable of printing a commercial material that appropriately expresses the impression intended by a user. [Means for solving the problem]

[0006] In order to solve the above problem, the information processing device of the present invention comprises a first reception means for receiving content of a commercial material, a second reception means for receiving a specification of the impression that the commercial material gives to a user, a third reception means for receiving conditions of the commercial material, an acquisition means for acquiring information on the color gamut reproducible by a printing means for printing the commercial material, a generation means for generating multiple commercial material data based on the content accepted by the first reception means, the specification of the impression accepted by the second reception means, and the conditions of the commercial material accepted by the third reception means, and a display means for displaying a commercial material image based on the multiple commercial material data generated by the generation means, wherein the commercial material image is an image represented by data identified based on the specification of the impression accepted by the second reception means from multiple data generated from the multiple commercial material data based on the information on the color gamut acquired by the acquisition means. Effect of the Invention

[0007] According to the present invention, it is possible to print a commercial material that appropriately expresses the impression intended by the user. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a block diagram showing a hardware configuration of the poster generation device. [Diagram 2] FIG. 2 is a software block diagram of a poster creation application. [Diagram 3] FIG. 2 is a diagram showing a skeleton. [Figure 4] FIG. 13 is a diagram showing a table of color scheme patterns. [Diagram 5] FIG. 13 illustrates an application start screen. [Figure 6] FIG. 13 illustrates a poster preview screen. [Figure 7] 13 is a flowchart showing an impression quantification process. [Figure 8] FIG. 13 is a diagram illustrating a subjective evaluation method for impressions. [Figure 9] 13 is a flowchart showing a poster generation process. [Figure 10] FIG. 13 is a diagram illustrating skeleton selection. [Figure 11] FIG. 13 is a diagram showing a color scheme pattern impression table. [Figure 12] FIG. 2 is a software block diagram of a layout unit. [Figure 13] 13 is a flowchart showing the process of S910. [Figure 14] FIG. 4 is a diagram for explaining information input to a layout unit. [Figure 15] FIG. 13 is a diagram for explaining the process of processing by a layout unit. [Figure 16] FIG. 13 shows a UI for setting a target impression. [Figure 17] FIG. 2 is a software block diagram of a poster creation application. [Figure 18] 13 is a flowchart showing a poster generation process. [Figure 19] 13 is a diagram for explaining a table used by the combination generation unit. FIG. [Figure 20] FIG. 18 is a diagram for explaining the operation of S1801 from the second loop onward. [Figure 21] FIG. 2 is a software block diagram of a poster creation application. [Figure 22] 13 is a flowchart showing a poster generation process. [Figure 23] FIG. 2 is a diagram illustrating a recording head. [Figure 24] 13 is a flowchart showing the process of S912. [Diagram 25] FIG. 2 is a diagram illustrating gamut mapping. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] [First embodiment] The terms used in this embodiment are defined as follows.

[0011] <Color reproduction range> The "color reproduction range" is also called the color reproduction range, color gamut, or gamut. Generally, the "color reproduction range" refers to the range of colors that can be reproduced in an arbitrary color space. In addition, the color gamut volume is an index that indicates the width of the color reproduction range. The color gamut volume is a three-dimensional volume in an arbitrary color space. The chromaticity points that constitute the color reproduction range may be discrete. For example, a specific color reproduction range may be represented by 729 points on the CIE-L*a*b*, and the points between them may be calculated using known interpolation calculations such as tetrahedral interpolation and cubic interpolation. In such a case, the corresponding color gamut volume can be calculated and accumulated by calculating the volume of the tetrahedron or cube that constitutes the color reproduction range on the CIE-L*a*b* in accordance with the interpolation calculation method. The color reproduction range and color gamut in this embodiment are not limited to a specific color space, but in this embodiment, the color reproduction range in the CIE-L*a*b* space is described as an example. Furthermore, the numerical values ​​of the color reproduction gamut in this embodiment indicate volumes obtained by cumulative calculation in the CIE-L*a*b* space on the premise of tetrahedral interpolation.

[0012] <Gamut mapping> "Gamut mapping" refers to a process of converting between different color gamuts, for example, mapping an input color gamut to the output color gamut of a device such as a printer. Common examples include Perceptual, Saturation, and Colorimetric in ICC profiles. The mapping process may be realized by, for example, conversion using a three-dimensional lookup table (3DLUT). Also, the mapping process may be performed after color space conversion to a standard color space. For example, if the input color space is sRGB, it is converted to the CIE-L*a*b* color space, and then mapping process is performed to the output color gamut on the CIE-L*a*b* color space. The mapping process may be conversion using a 3DLUT or a conversion formula. Also, conversion of the color space at the time of input and the color space at the time of output may be performed simultaneously. For example, the color space at the time of input may be sRGB color space, and at the time of output, it may be converted to the printer-specific RGB value or CMYK value.

[0013] In this embodiment, a method of automatically generating a poster by running an application (hereinafter, also referred to as "app") for creating a poster in a poster generating device will be described as an example. In the following description, "image" includes still images and frame images extracted from videos, unless otherwise specified.

[0014] 1 is a block diagram showing a hardware configuration of a poster generation device 100. The poster generation device 100 is an information processing device, such as a personal computer (hereinafter referred to as a PC) or a smartphone. In this embodiment, the poster generation device will be described as a PC. The poster generation device 100 has a CPU 101, a ROM 102, a RAM 103, a HDD 104, a display 105, a keyboard 106, a pointing device 107, a data communication unit 108, and a GPU 109.

[0015] A CPU (Central Processing Unit / Processor) 101 comprehensively controls the poster generating device 100, and for example, reads out a program stored in a ROM 102 into a RAM 103 and executes it to realize the operation of this embodiment. Although there is one CPU in FIG. 1, the system may be configured with multiple CPUs. The ROM 102 is a general-purpose ROM, and for example, stores a program to be executed by the CPU 101. The RAM 103 is a general-purpose RAM, and is used as a working memory for temporarily storing various pieces of information when the CPU 101 executes a program.

[0016] The HDD (hard disk drive) 104 is a storage medium (storage unit) for storing image files, a database for holding processing results such as image analysis, and skeletons used by a poster creation application. The skeletons will be described later. The display 105 is a display unit that displays to the user an electronic poster as a layout result of the user interface (UI) of this embodiment and image data (hereinafter also referred to as "image"). The keyboard 106 and pointing device 107 accept instruction operations from the user. The display 105 may be equipped with a touch sensor function.

[0017] The keyboard 106 is used, for example, when the user inputs the number of double-page spreads of the poster he or she wishes to create on a user interface (UI) displayed on the display 105. The pointing device 107 is used, for example, when the user clicks a button on the UI displayed on the display 105.

[0018] The data communication unit 108 communicates with an external device via a wired or wireless network. For example, the data communication unit 108 transmits data laid out by an automatic layout function to a printer or a server that can communicate with the poster generating device 100. The GPU 109 is a graphics processing unit, and can perform efficient calculations by processing more data in parallel. For example, the GPU 109 is used when learning is performed multiple times using a learning model such as deep learning. The data bus 109 connects the blocks in FIG. 1 to each other so that they can communicate with each other. Note that the configuration shown in FIG. 1 is merely an example, and is not limited to this. For example, the poster generating device 100 may display a UI on an external display.

[0019] The poster creation application in this embodiment is stored in HDD 104. The poster creation application is started when the user executes an operation such as clicking or double-clicking the application icon displayed on display 105 with pointing device 107.

[0020] Next, the recording device 120 includes an image processing accelerator 121 , a data communication unit 122 , a CPU 123 , a RAM 124 , a storage medium 125 , a recording head controller 126 , and a recording head 127 .

[0021] The CPU 123 controls the recording device 120 overall by reading out a program stored in the storage medium 125 into the RAM 124 as a work area and executing the program. The image processing accelerator 121 is hardware capable of executing image processing faster than the CPU 123. The image processing accelerator 121 is started by the CPU 123 writing parameters and data required for image processing to a predetermined address in the RAM 124. After reading the parameters and data, the image processing accelerator 121 executes image processing on the data. However, the image processing accelerator 121 is not an essential element, and equivalent processing may be executed by the CPU 123. The parameters may be stored in the storage medium 125, or may be stored in a storage (not shown) such as a flash memory or a HDD.

[0022] Here, we will explain the image processing performed by the CPU 123 or the image processing accelerator 121. The image processing is, for example, processing that generates data indicating the ink dot formation positions in each scan by the print head 127 based on the acquired print data. The CPU 123 or the image processing accelerator 121 performs color conversion processing and quantization processing on the acquired print data.

[0023] The color conversion process is a process for separating colors into ink densities that can be handled by the recording device 120. For example, the acquired recording data includes image data that represents an image. If the image data is data that represents an image in color space coordinates such as sRGB, which is the representation color of a monitor, the data that represents the image in the sRGB color coordinates (R, G, B) is converted into ink data (CMYK) that can be handled by the recording device 120. The color conversion method is realized by a matrix calculation process or a process using a 3DLUT or 4DLUT.

[0024] In this embodiment, the recording device 120 uses black (K), cyan (C), magenta (M), and yellow (Y) inks for recording, as an example. Therefore, image data of RGB signals is converted into image data consisting of 8-bit color signals for each of K, C, M, and Y. The color signals of each color correspond to the amount of each ink applied. Although the number of ink colors is exemplified as four colors, K, C, M, and Y, other ink colors, such as fluorescent ink (F), light-density light cyan (Lc), light magenta (Lm), and gray (Gy) inks, may be used to improve image quality. In that case, color signals corresponding to those inks are generated.

[0025] After the color conversion process, a quantization process is performed on the ink data. The quantization process is a process for reducing the number of gradation levels of the ink data. In this embodiment, quantization is performed using a dither matrix in which threshold values ​​for comparison with the ink data value for each pixel are arranged. After the quantization process, binary data is ultimately generated that indicates whether or not a dot will be formed at each dot formation position.

[0026] After image processing, the binary data is transferred to the printhead 127 by the printhead controller 126. At the same time, the CPU 123 performs printing control via the printhead controller 126 to operate a carriage motor (not shown) that drives the printhead 127, and further to operate a transport motor that transports the print medium. The printhead 127 scans over the print medium, and at the same time, ink droplets are ejected onto the print medium by the printhead 127 to form an image.

[0027] The image processing device 100 and the recording device 120 are connected via a communication line 110. In this embodiment, a local area network (LAN) is described as an example of the communication line 110, but it may be a USB hub, a wireless communication network using a wireless access point, a connection using a WiFi direct communication function, or the like.

[0028] In the following description, it is assumed that the recording head 127 has nozzle rows for four color inks: cyan (C), magenta (M), yellow (Y), and black (K).

[0029] FIG. 23 is a diagram for explaining the recording head 127 in this embodiment. In this embodiment, an image is recorded in a unit area of ​​one nozzle row by multiple scans N times. The recording head 127 has a carriage 128, nozzle rows 127k, 127c, 127m, and 127y, and an optical sensor 130. The carriage 128 carrying the five nozzle rows 127k, 127c, 127m, and 127y and the optical sensor 130 can be moved back and forth along the X direction (main scanning direction) in the figure by the driving force of a carriage motor transmitted via a belt 129. As the carriage 128 moves in the X direction relative to the recording medium, ink droplets are ejected in the gravity direction (-z direction in the figure) from each nozzle of the nozzle row based on the recording data. As a result, an image of 1 / N main scanning times is recorded on the recording medium placed on the platen 131. When one main scan is completed, the recording medium is transported along a transport direction intersecting the main scan direction (-y direction in the figure) by a distance corresponding to the width of 1 / Nth of a main scan. Through these operations, an image with a width equivalent to one nozzle row is recorded over N multiple scans. By alternately repeating such main scans and transport operations, an image is gradually formed on the recording medium. In this manner, control is performed to complete image recording on a specified area.

[0030] 2 is a software block diagram of a poster creation application. The poster creation application includes a poster creation condition specification unit 201, a text specification unit 202, an image specification unit 203, a target impression specification unit 204, a poster display unit 205, a printer specification unit 206, a gamut mapping specification unit 207, a printing unit 208, and a poster generation unit 210. Furthermore, the poster generation unit 210 includes an image acquisition unit 211, an image analysis unit 212, a skeleton acquisition unit 213, a skeleton selection unit 214, a color scheme pattern selection unit 215, a font selection unit 216, a layout unit 217, a device color gamut acquisition unit 220, a gamut mapping unit 221, an impression estimation unit 218, and a poster selection unit 219.

[0031] When the poster creation application is installed in poster generation device 100, a start-up icon is displayed on the top screen (desktop) of the OS (operating system) running on poster generation device 100. When the user operates (e.g. double-clicks) the start-up icon displayed on display 105 with pointing device 107, the program of the poster creation application stored in HDD 104 is loaded into RAM 103 and executed by CPU 101. This starts up the poster creation application.

[0032] The poster creation application described above includes program modules corresponding to the components shown in Fig. 2. CPU 101 executes each program module, causing CPU 101 to function as each component shown in Fig. 2. Hereinafter, each component shown in Fig. 2 will be described as executing various processes. Fig. 2 also shows a software block diagram particularly relating to poster generation unit 210 that executes the automatic poster creation function.

[0033] The poster creation condition designation unit 201 designates poster creation conditions to the poster generation unit 210 in response to UI operations using the pointing device 107. In this embodiment, the poster creation conditions are designated as the poster size, the number of posters to be created, and a usage category. The poster size may be designated by specifying actual values ​​of width and height, or may be designated by specifying a paper size such as A1 or A2. The usage category is a category that indicates the purpose for which the poster will be used, such as restaurants, school events, sales, etc.

[0034] The text designation unit 202 designates character information to be placed on the poster by UI operations using the keyboard 106. The character information to be placed on the poster represents, for example, a character string representing a title, date and time, location, etc. Furthermore, the text designation unit 202 outputs each piece of character information to the skeleton acquisition unit 213 and the layout unit 217 after linking it to determine whether it is a title, date and time, location, or other type of information.

[0035] The image designation unit 203 designates one or more image data to be arranged on a poster, which are stored in the HDD 104. The image data may be designated based on the structure of a file system including the image data, such as a device and a directory, or may be designated by associated information for identifying the image, such as the shooting date and time, or attribute information. The image designation unit 203 outputs the file path of the designated image to the image acquisition unit 211.

[0036] The target impression designation unit 204 designates a target impression of the poster to be created. The target impression is an impression that the poster to be created is ultimately required to maintain. In this embodiment, the strength indicating the degree to which the impression is to be given to a word expressing an impression is designated by a UI operation using the pointing device 107. Information indicating the target impression designated by the target impression designation unit 204 is shared by the skeleton selection unit 214, the color scheme selection unit 215, the font selection unit 216, and the poster selection unit 219. Details of impressions will be described later.

[0037] The gamut mapping designation unit 205 designates one or more gamut mapping methods to be used by the gamut mapping unit 221. In this embodiment, the gamut mapping method to be used, such as Perceptual, Saturation, or Colorimetric, is designated by a UI operation using the pointing device 107.

[0038] Next, the configuration of the poster generating unit 210 will be described in detail. The image acquiring unit 211 acquires one or more image data specified by the image specifying unit 203 from the HDD 104. The image acquiring unit 211 outputs the acquired image data to the image analyzing unit 212. The image acquiring unit 211 also outputs the number of acquired images to the skeleton acquiring unit 213. The images stored in the HDD 104 include still images and frame images cut out from a video. The still images and frame images are acquired from an imaging device such as a digital camera or a smart device. The imaging device may be included in the poster generating device 100 or may be included in an external device. In addition, when the imaging device is an external device, the image is acquired via the data communication unit 108. As another example, the still image may be an illustrated image created by image editing software or a CG image created by Computer Graphics (CG) production software. The still image and the cut-out image may be an image acquired from a network or a server via the data communication unit 108. An example of the image acquired from a network or a server is a social networking service image (hereinafter, referred to as an "SNS image"). In addition, the program executed by the CPU 101 analyzes data attached to each image to determine the storage source. For example, the SNS image may be acquired from the SNS via an application, and the acquisition destination may be managed within the application. Note that the image is not limited to the above-mentioned images, and may be other types of images.

[0039] The image analysis unit 212 executes an analysis process of the image data acquired from the image acquisition unit 211 by a method described later, and acquires information indicating an image feature amount described later. Specifically, for example, the image analysis unit 212 executes an object recognition process described later, and acquires information indicating an image feature amount of the image data. The image analysis unit 212 also links the acquired information indicating the image feature amount to the image data and outputs the image data to the layout unit 217.

[0040] Skeleton acquisition unit 213 acquires one or more skeletons that meet the conditions specified by poster creation condition specification unit 201, text specification unit 202, and image acquisition unit 211 from HDD 104. In this embodiment, a skeleton is information that indicates the arrangement of character strings, images, figures, etc. to be arranged on a poster. In this embodiment, a skeleton is one of the commercial material components that make up a commercial material, along with a color scheme pattern and a font.

[0041] FIG. 3 is a diagram showing an example of a skeleton. On a skeleton 301 in FIG. 3(a), three graphic objects 302, 303, and 304, one image object 305, and four character objects 306, 307, 308, and 309, which are objects on which characters are arranged, are arranged. In addition to the position, size, and angle of each object, metadata required for generating a poster is also recorded. FIG. 3(b) is a diagram showing an example of metadata. For example, character objects 306 to 309 hold, as metadata attributes, what type of character information is arranged. Here, character object 306 represents a title, character object 307 represents a subtitle, and character objects 307 and 308 represent main text. In addition, graphic objects 302 to 304 hold, as metadata attributes, color scheme numbers (color scheme IDs) indicating the shape of the graphic and the color scheme pattern. Here, the attributes of graphic objects 302 and 303 represent a rectangle, and the attribute of graphic object 304 represents an ellipse. Also, assume that color scheme number 1 is assigned to graphic object 302, and color scheme number 2 is assigned to graphic objects 303 and 304. Here, the color scheme number is information referenced when assigning colors, which will be described later, and indicates that different colors are assigned to different color scheme numbers. Note that the types of objects and metadata are not limited to the above. For example, there may be a map object for placing a map, or a barcode object for placing a QR code (registered trademark) or a barcode. Furthermore, metadata for a character object may include metadata that indicates the width between lines or the width between characters. The metadata may include the purpose of the skeleton and be used to control whether or not the skeleton can be used depending on the purpose.

[0042] The skeletons may be stored in HDD 104 in, for example, a CSV format, or in a DB format such as SQL. Skeleton acquisition unit 213 outputs one or more skeletons acquired from HDD 104 to skeleton selection unit 214.

[0043] A skeleton selection unit 214 selects one or more skeletons that match the target impression specified by the target impression specification unit 204 from among the skeletons acquired from the skeleton acquisition unit 213, and outputs them to a layout unit 217. Since the layout of the entire poster is determined by the skeleton, the variety of posters after generation can be increased by preparing various types of skeletons in advance.

[0044] The color scheme selection unit 215 obtains from the HDD 104 one or more color schemes that match the desired impression specified by the desired impression specification unit 204, and outputs them to the layout unit 217. A color scheme is a combination of colors to be used in a poster.

[0045] FIG. 4 is a diagram showing an example of a color scheme table. In this embodiment, a color scheme pattern is expressed as a combination of four colors. The color scheme ID column in FIG. 4 is an ID for uniquely identifying a color scheme pattern. The color 1 to color 4 columns express colors in RGB order, with each RGB color value ranging from 0 to 255 ((R, G, B)=(0 to 255, 0 to 255, 0 to 255)). Note that, although this embodiment uses a color scheme pattern consisting of a combination of four colors, other numbers of colors may be used, or a mixture of multiple colors may be used.

[0046] The font selection unit 216 selects one or more font patterns that match the desired impression specified by the desired impression specification unit 204, obtains them from the HDD 104, and outputs them to the layout unit 217. A font pattern is a combination of at least one of a title font, a subtitle font, and a body font.

[0047] The layout unit 217 generates one or more poster data pieces equal to or greater than the specified number of posters to be created, by laying out various data for each of the one or more skeletons obtained from the skeleton selection unit 214. The layout unit 217 arranges the text obtained from the text designation unit 202 and the image data obtained from the image analysis unit 212 for each skeleton, applies a color pattern obtained from the color pattern selection unit 215, and applies a font pattern obtained from the font selection unit. The layout unit 217 outputs the generated multiple poster data pieces to the gamut mapping unit 221.

[0048] The device color gamut acquisition unit 220 acquires the color gamut that the printer can reproduce (device color gamut) from the printer information acquired from the printer designation unit 206. The device color gamut is defined by, for example, 729 points on the CIE-L*a*b* scale, and is stored in the storage medium 125 of the recording device 120. The image processing device 100 acquires the device color gamut of the recording device 120 through the data communication unit 108, and stores it in the RAM 103. Note that the method of acquiring the device color gamut is not limited to this. For example, the device color gamut corresponding to the printer may be stored in advance on the HDD 104 or a server (not shown), and the device color gamut acquisition unit 220 may acquire the device color gamut through the HDD 104 or the data communication unit 108. Also, instead of designating the printer with the printer designation unit 206, an ICC profile may be designated. Since the ICC profile defines the color space that the device can express, the device color gamut acquisition unit 220 may acquire the device color gamut by analyzing the ICC profile. The acquired device color gamut is output to the gamut mapping unit 221.

[0049] The gamut mapping unit 221 acquires the gamut mapping method to be used from the gamut mapping specification unit 207, and acquires the device gamut from the device gamut acquisition unit 220. The gamut mapping unit 221 performs gamut mapping processing using one or more specified gamut mapping methods on the multiple poster data acquired from the layout unit 217. The gamut mapping unit 221 outputs the poster data after gamut mapping to the impression estimation unit 218.

[0050] The impression estimation unit 218 estimates an impression of each piece of poster data acquired from the gamut mapping unit 221, and links the estimated impression (estimated impression) to each piece of poster data. Then, the impression estimation unit 218 outputs the multiple poster data linked with the estimated impressions to the poster selection unit 219.

[0051] The poster selection unit 219 compares the target impression specified by the target impression specification unit 204 with each estimated impression of the multiple poster data associated with an estimated impression acquired from the impression estimation unit 218, and selects the poster data associated with the estimated impression that is closest to the target impression. The selection result is stored in the HDD 104. The poster selection unit 219 outputs the selected poster data to the poster display unit 205.

[0052] The poster display unit 205 outputs a poster image to be displayed on the display 105 according to the poster data acquired from the poster selection unit 219. The poster image is, for example, bitmap data. The poster display unit 205 displays the poster image on the display 105. Note that the poster creation application may be provided with a function for editing the layout, color, shape, etc. of images, text, and graphics through additional operations by the user after the generated result is displayed on the poster display unit 205, and further changing it to a design desired by the user. The printing unit 208 prints the poster data stored in the HDD 104 by the printer designated by the printer designation unit 206.

[0053] <Example of display screen> 5 is a diagram showing an example of an application start-up screen 501 provided by a poster creation application. The application start-up screen 501 is displayed on the display 105. A user sets poster creation conditions, text and images as contents, which will be described later, via the application start-up screen 501, and the poster creation condition designation unit 201, the image designation unit 202, and the text designation unit 203 acquire the settings from the user via this UI screen.

[0054] A title box 502, a subtitle box 503, and a main text box 504 accept the specification of text information to be arranged on the poster. In this embodiment, three types of text information are accepted as an example, but this is not limited to this. For example, additional text information such as location and date and time may be accepted. Also, it is not necessary to specify all of the items, and some boxes may be left blank.

[0055] Image designation area 505 is an area for displaying an image to be placed on a poster. Image 506 represents a thumbnail of the designated image. Add image button 507 is a button for adding an image to be placed on the poster. When the user presses add image button 507, image designation unit 202 displays a dialog screen for selecting a file saved in HDD 104 and accepts the user's selection of an image file. Then, a thumbnail of the selected image is added to image designation area 505.

[0056] Impression sliders (impression slider bars, or impression setting sliders) 508 to 511 are objects for setting factors of the target impression of the poster to be created. For example, slider 508 is a slider for setting factors of the target impression related to luxury, and the target impression is set such that the more to the right the slider is slid, the more luxurious the poster will be, and the more to the left the poster is slid, the less luxurious (cheaper). In addition, by combining factors of the target impression set by each slider, a target impression is set that reflects not only the factor of the target impression set by one slider, but also the factor of the target impression set by the other sliders. For example, when a user operates on the screen of the poster generation application, and the impression slider 508 is set to the right of the center of the slider and the impression slider 511 is set to the left of the center of the slider, a poster with a refined impression, such as a high sense of luxury and a low sense of solidity, is generated. Also, for example, when the user operates the impression slider 508 to the right of the center of the slider and the impression slider 511 to the right of the center of the slider, a poster with a gorgeous impression, such as a high sense of luxury and dignity, is generated. In this way, by combining factors of the target impression indicated by a plurality of impression sliders, it is possible to set target impressions with different directions, such as a target impression of "elegant" and a target impression of "gorgeous", even if a common target impression factor of "luxury" is set. In other words, the target impression is composed and determined by a plurality of factors indicating an impression, but may be determined by one factor indicating an impression. In this embodiment, the state in which the slider is set to the leftmost position is set to -2, and the state in which the slider is set to the rightmost position is set to +2, and the value is corrected to an integer value between -2 and +2. These numerical values ​​indicate that the impression is low, -1 is slightly low, 0 is neither, +1 is slightly high, and +2 is high, with -2 being low, -1 being slightly low, 0 being neutral, +1 being slightly high, and +2 being high. The purpose of correcting to -2 to +2 is to match the scale with the estimated impression to facilitate distance calculation, which will be described later, but is not limited to this and normalization using values ​​from 0 to 1 may also be used.

[0057] The radio button 512 is a button that can execute control of enabling or disabling the setting of each target impression. The user can set each target impression setting to be enabled or disabled by pressing the radio button 512 to set on / off. For example, when the radio button 512 is selected as off, the impression is excluded from the impression control. For example, a user who wants to create a calm poster with low dynamism but has no particular designation for other impressions can generate a poster specialized in low dynamism by turning off the radio buttons 512 other than dynamism. Note that FIG. 5 shows a state in which the sense of luxury and the sense of familiarity are selected as on, and the sense of dynamism and the sense of solidity are selected as off. This enables highly flexible control, such as using all the target impressions for poster generation, or using only some of the target impressions for poster generation. Note that the configuration may be such that the radio button 512 is not required when each slider is set to the leftmost position, which is the same as when each target impression is not set (for example, when the slider 508 is set to the leftmost position, the sense of luxury is 0). In this case, when the user wishes to disable the setting of each target impression, the user can disable the setting of each target impression by setting each slider to the leftmost position.

[0058] The size list box 513 is a list box for setting the size of the poster to be created. A list of poster sizes that can be created is displayed and can be selected by the user clicking with the pointing device 107. The number to create box 514 allows the number of posters to be created to be set. The category list box 515 allows the purpose category of the poster to be created to be set. The printer designation box 516 allows the printer to be set for printing the created poster. Note that although the printer is designated in this embodiment, a configuration in which the print mode can also be designated is also possible. In this case, an appropriate device gamut can be obtained even if the color gamut that can be expressed by the printer changes depending on the print mode (printing method or paper type).

[0059] The gamut mapping designation area 517 is made up of a number of check boxes that determine the type of gamut mapping method to be used. The user can enable or disable the check box for the gamut mapping method they wish to use by clicking with the pointing device 107.

[0060] Reset button 518 is a button for resetting each setting information on application startup screen 501. When the user presses OK button 519, poster creation condition designation unit 201, text designation unit 202, image designation unit 203 and target impression designation unit 204 output the contents set on application startup screen 501 to poster generation unit 210. At that time, poster creation condition designation unit 201 obtains the size of the poster to be created from size list box 513, the number of posters to be created from number to be created box 514, and the purpose category of the poster to be created from category list box 515.

[0061] The text designation unit 202 acquires character information to be placed on the poster from the title box 503, the subtitle box 503, and the body box 504. The image designation unit 203 acquires the file path of the image to be placed on the poster from the image designation area 505. The target impression designation unit 204 acquires the target impression of the poster to be created from the impression sliders 508 to 511 and the radio button 512. The poster creation condition designation unit 201, the text designation unit 202, the image designation unit 203, and the target impression designation unit 204 may process the value set on the application start screen 501. For example, the text designation unit 202 may remove unnecessary blank characters at the beginning or end of the input character information. The target impression designation unit 204 may also correct the value of the target impression designated by the impression sliders 508 to 511.

[0062] 6 is a diagram showing an example of a poster preview screen in which a poster image generated by the poster display unit 205 is displayed on the display 105. When the OK button 519 on the application start-up screen 501 is pressed and the poster generation is completed, the screen displayed on the display 105 transitions to a poster preview screen 601.

[0063] Poster image 602 is a poster image output by poster display unit 205. Since poster generation unit 210 generates posters in the number of posters to be created specified by poster creation condition specification unit 201 or more, the generated posters are displayed as a list as poster images 602 on poster preview screen 601. For example, when a poster is clicked on by the user with pointing device 107, the poster is placed in a selected state.

[0064] The edit button 603 allows the selected poster to be edited through a UI that provides an editing function (not shown). The print button 604 allows the selected poster to be printed on the recording device 120.

[0065] <Quantifying the impression of posters> Here, a method of quantifying the impression of a poster, which is a pre-processing required for the poster generation processing to execute the impression estimation processing described later in S913 of Fig. 9(a), will be described. The process of quantifying the impression of a poster is performed in the development stage of the poster creation application by a vendor or the like who develops the poster creation application. The process of quantifying the impression of a poster may be executed by the poster generation device 100, or may be executed by an information processing device different from the poster generation device 100. When the process is executed by an information processing device different from the poster generation device 100, it is executed by the CPU of that information processing device.

[0066] In the process of quantifying the impression of a poster, the impression that a person has of various posters is quantified. At the same time, a correspondence between the poster image and the impression of the poster is derived. This makes it possible to estimate the impression of the poster from the generated poster image. If the impression can be estimated, it becomes possible to control the impression of the poster by modifying the poster image, or to search for a poster image that has a certain target impression. The process of quantifying the impression of a poster is executed, for example, in a poster generation device by running an impression learning application for learning the impression of the poster image in advance before the poster generation process.

[0067] Fig. 7 is a flowchart showing the poster impression quantification process. The flowchart shown in Fig. 7 is realized, for example, by CPU 101 reading a program stored in HDD 104 into RAM 103 and executing it. The poster impression quantification process will be described with reference to Fig. 7. The process in Fig. 7 is executed. Note that the symbol "S" in the description of each process indicates a step in the flowchart (the same applies below).

[0068] In S701, the CPU 101 executes acquisition of a subjective evaluation of the impression of the poster. FIG. 8 is a diagram for explaining an example of a subjective evaluation method of the impression of the poster. The CPU 101 presents a poster to a subject, and acquires a subjective evaluation of the impression of the poster from the subject. In this case, a measurement method such as the Semantic Differential (SD) method or the Likert scale method can be used. FIG. 8 shows an example of a questionnaire using the SD method, in which adjective pairs expressing impressions are presented to a plurality of evaluators, and the adjective pairs that are recalled from the target poster are scored. After acquiring subjective evaluation results from a plurality of subjects for a plurality of posters, the CPU 101 calculates an average value of the responses to each adjective pair, and sets the average value as a representative score value for the corresponding adjective pair. Note that the subjective evaluation method of the impression may be other than the SD method, as long as words expressing impressions and corresponding scores are determined.

[0069] In S702, the CPU 101 executes a factor analysis of the acquired subjective evaluation results. If the subjective evaluation results are used as is, the number of adjective pairs will be the number of dimensions, which will complicate the control, so it is desirable to reduce the number of dimensions to an efficient number by an analysis method such as principal component analysis or factor analysis. In this embodiment, the description will be given assuming that the dimensions are reduced to four factors by factor analysis. Naturally, this number varies depending on the selection of adjective pairs in the subjective evaluation and the factor analysis method. In addition, the output of the factor analysis is assumed to be standardized. That is, each factor is scaled so that the average is 0 and the variance is 1 in the poster used in the analysis. As a result, the impressions of -2, -1, 0, +1, and +2 specified by the target impression specification unit 204 can be directly corresponding to -2σ, -1σ, the average value, +1σ, and +2σ in each impression, which makes it easier to calculate the distance between the target impression and the estimated impression, which will be described later. In this embodiment, the four factors are luxury, familiarity, dynamism, and solidity as shown in FIG. 5. However, these are names given for the sake of convenience in order to convey impressions to the user through the user interface, and each factor is composed of multiple adjective pairs that influence each other.

[0070] In S703, the CPU 101 associates the poster image with the impression. Although it is possible to quantify the poster that has been subjectively evaluated by the above-mentioned method, it is necessary to estimate the impression of the poster to be created without subjective evaluation. The association between the poster image and the impression can be realized by learning a model that estimates the impression from the poster image, for example, using a deep learning method using a Convolution Neural Network (CNN) or a machine learning method using a decision tree. In this embodiment, in the impression learning, a poster image is input, and four factors are output, and supervised deep learning using CNN is performed. That is, the subjectively evaluated poster image and the corresponding impression are learned as the correct answer to create a deep learning model, and an unknown poster image is input to the learning model to estimate the impression.

[0071] The deep learning model created above is stored in, for example, HDD 104, and the impression estimation unit 218 loads the deep learning model stored in HDD 104 in RAM 103 and executes it. The impression estimation unit 218 images the poster data acquired from the layout unit 217, and estimates the impression of the poster by operating the deep learning model loaded in RAM 103 with the CPU 101 or the GPU 109. Note that, although the deep learning method is used in this embodiment, the present invention is not limited to this. For example, when using a machine learning method such as a decision tree, a machine learning model may be created that extracts feature amounts such as the average brightness value and edge amount of the poster image by image analysis, and estimates the impression based on the feature amounts.

[0072] Fig. 9 is a flowchart showing the poster generation process by poster generation unit 210 of the poster creation application. As described above, the flowchart shown in Fig. 9 starts when the user sets various setting items on the poster creation application and presses OK button 519.

[0073] The flowchart shown in Fig. 9(a) is realized, for example, by CPU 101 reading a program stored in HDD 104 into RAM 103 and executing it. In this embodiment, the components shown in Fig. 2 that function by CPU 101 executing the poster creation application are described as executing the processes. The poster generation process will be described with reference to Fig. 9. Note that the symbol "S" in the description of each process indicates a step in the flowchart (the same applies below).

[0074] In S901, the poster creation application displays the application start screen 501 on the display 105. The user inputs each setting via the UI screen of the application start screen 501 using the keyboard 106 or the pointing device 107.

[0075] In S902 , the poster creation condition designation unit 201 , the text designation unit 202 , the image designation unit 203 and the target impression designation unit 204 acquire the corresponding settings from the application start-up screen 501 .

[0076] In S903, skeleton selection unit 214, color scheme pattern selection unit 215, and font selection unit 216 each determine the number of skeletons, the number of color scheme patterns, and the number of fonts to be selected according to the number of creations specified by poster creation condition specification unit 201. In this embodiment, layout unit 217 generates poster data of the number of skeletons x the number of color scheme patterns x the number of fonts using a method to be described later. At this time, the number of skeletons, the number of color scheme patterns, and the number of fonts to be selected are determined so that the number of posters generated exceeds the number of creations. In this embodiment, for example, the number of skeletons, the number of color scheme patterns, and the number of fonts are each determined according to the following formula (1).

[0077] TIFF2025054514000002.tif2366...(1) For example, if the number of creations is 6, the number of selections is 3, the amount of poster data generated by the layout unit 217 is 3×3×3=27, and the poster selection unit 219 selects 6 poster data from that amount. This allows the poster selection unit 219 to select posters whose overall impression better matches the target impression from among the poster data generated in excess of the number of creations.

[0078] In S904, the image acquisition unit 211 acquires image data. Specifically, the image acquisition unit 211 reads out the image file in the HDD 104 that is specified by the image specification unit 203 into the RAM 103.

[0079] In S905, the image analysis unit 212 executes an analysis process on the image data acquired in S904, and acquires information indicating a feature amount. Examples of the information indicating the feature amount include meta information stored in the image, and information indicating an image feature amount that can be acquired by analyzing the image. These pieces of information are used in an object recognition process, which is an analysis process. Note that in this embodiment, an object recognition process is executed as the analysis process, but the present invention is not limited to this, and other analysis processes may be executed. Furthermore, the process of S905 may be omitted. Details of the process performed by the image analysis unit 212 in S905 will be described below.

[0080] The image analysis unit 212 executes object recognition processing on the image acquired in S904. Here, a known method can be used for the object recognition processing. In this embodiment, an object is recognized by a classifier created by Deep Learning. The classifier outputs the likelihood of a pixel constituting an image being a pixel constituting each object as 0 to 1, and recognizes that an object exceeding a certain threshold is present in the image. By recognizing the object image, the image analysis unit 212 can acquire the type and position of an object such as a face, a pet such as a dog or a cat, a flower, food, a building, an ornament, and a landmark.

[0081] In S906, skeleton acquisition unit 213 acquires skeletons that meet the various set conditions. In this embodiment, it is assumed that each skeleton is described in one file and stored in HDD 104. Skeleton acquisition unit 213 sequentially reads skeleton files from HDD 104 to RAM 103, leaves skeletons that meet the set conditions on RAM 103, and deletes skeletons that do not meet the conditions from RAM 103.

[0082] Here, Fig. 9(b) is a flowchart of the condition determination process performed by the skeleton acquisition unit 213. The condition determination process performed by the skeleton acquisition unit 213 will be described with reference to Fig. 9(b).

[0083] In S921, skeleton acquisition unit 213 determines whether the size of the skeleton read into RAM 103 matches poster size 513 specified by poster creation condition specification unit 201. Note that although it is confirmed that the sizes match here, it is also sufficient that the aspect ratios match. In this case, skeleton acquisition unit 213 acquires a skeleton that matches the poster size specified by poster creation condition specification unit 201 by enlarging or reducing the coordinate system of the read skeleton.

[0084] In S922, skeleton acquisition unit 213 determines whether or not the category of the skeleton matches purpose category 515 specified by poster creation condition specification unit 201. For skeletons to be used only for a specific purpose, the purpose category is written in the skeleton file, and the skeleton is not acquired unless the relevant purpose category is selected. This prevents a skeleton designed specifically for a specific purpose, such as a graphic pattern that evokes a school or a pattern of sporting goods, from being used in other purpose categories. Note that if a purpose category is not set in application startup screen 501, S922 is skipped.

[0085] In S923, the skeleton acquisition unit 213 determines whether the number of image objects of the loaded skeleton matches the number of images acquired by the image acquisition unit 211.

[0086] In S924, skeleton acquisition unit 213 determines whether the character object of the loaded skeleton matches the character information specified by text designation unit 202. More specifically, it determines whether the type of character information specified by text designation unit 202 is in the skeleton. For example, assume that character strings are designated in title box 502 and body box 504 on application startup screen 501, and a blank is designated in subtitle box 503. In this case, all character objects in the skeleton are searched, and it is determined that there is a match if both a character object with "title" set as the type of character information in metadata and a character object with "body" designated are found, and otherwise it is determined that there is no match.

[0087] As described above, skeleton acquisition unit 213 stores in RAM 103 a skeleton whose skeleton size, usage category, number of image objects, and type of text object all match the set conditions. In this embodiment, skeleton acquisition unit 213 judges all skeleton files on HDD 104, but this is not limited to the above. For example, the poster creation application may store in HDD 104 a database that associates file paths of skeleton files with search conditions (skeleton size, number of image objects, and type of text object). In this case, skeleton acquisition unit 213 can quickly acquire skeleton files by reading only the skeleton files that match the results of searching the database from HDD 104 to RAM 103. Return to FIG. 9(a).

[0088] In S907, the skeleton selection unit 214 selects a skeleton that matches the target impression specified by the target impression specification unit 204 from among the skeletons acquired in S906. Here, FIG. 10 is a diagram for explaining a method for the skeleton selection unit 214 to select a skeleton. FIG. 10(a) is a diagram showing an example of a table that links a skeleton to an impression. The skeleton name column in FIG. 10(a) lists the file name of the skeleton, and the columns of luxury, familiarity, dynamism, and solidity show numbers (numerical values) that indicate the degree to which each skeleton affects each impression. These numerical values ​​are values ​​that indicate, for that impression, -2 is low, -1 is slightly low, 0 is neither, +1 is slightly high, and +2 is high, respectively. First, the skeleton selection unit 214 calculates the distance between the target impression acquired from the target impression specification unit 204 and the impression of each skeleton shown in the skeleton impression table in FIG. 10(a). For example, if the target impression is "luxury +1, familiarity -1, dynamism -2, solidity +2," the distance calculated by the skeleton selection unit 214 is as shown in FIG. 10(b). In this embodiment, Euclidean distance is used as the distance (hereinafter, simple distance will be referred to as Euclidean distance). The smaller the value indicated by the Euclidean distance, the closer the target impression is to the impression of the skeleton. Next, the skeleton selection unit 214 selects the top N skeletons with the smallest distance values ​​in FIG. 10(b). In this embodiment, the skeleton selection unit 214 selects the top two skeletons. In this example, the skeleton selection unit 214 selects skeleton 1 and skeleton 4.

[0089] Here, N may be set to a fixed value, or may be variable depending on the conditions specified by the poster creation condition specification unit 201. For example, when the number of posters to be created is specified as 6 in the number of posters to be created box 514 on the application start screen 501, the poster generation unit 210 generates six posters. The layout unit 217 described later generates a poster by combining skeletons, color patterns, and fonts selected by the skeleton selection unit 214, color pattern selection unit 215, and font selection unit 216. Therefore, for example, by selecting two skeletons, two color patterns, and two fonts, 2×2×2=8 posters can be generated, so that the condition of the number of posters to be created of 6 can be satisfied. In this way, the number N of skeletons to be selected may be determined depending on the conditions specified by the poster creation condition specification unit 201.

[0090] Also, the value range of each impression in the skeleton impression table in FIG. 10(a) does not need to be the same as the value range of the impression specified by the target impression designation unit 204. In this embodiment, the value range of the impression specified by the target impression designation unit 204 is -2 to +2, but the value range of the impression in the skeleton impression table may be different from this. In that case, the value range of the skeleton impression table is scaled to match the value range of the target impression, and then the distance calculation is performed. Also, the distance calculated by the skeleton selection unit 214 is not limited to the Euclidean distance, and any distance between vectors can be calculated, such as Manhattan distance or cosine similarity. Also, impressions for which the target impression is set to off by the radio button 512 are excluded from the distance calculation.

[0091] The skeleton impression table is created in advance by fixing, for example, the color scheme, font, and the image and character data to be arranged on the skeleton, generating a poster image based on each skeleton, and estimating the impression, and is stored in the HDD 104. That is, the impression of poster images that have the same color and image used but different arrangements of characters and images is estimated, and the relative characteristics with other skeletons are tabulated. In this case, it is desirable to cancel the impression due to the color scheme pattern and image used, such as standardizing the entire estimated impression, or averaging the impressions of multiple poster images generated from one skeleton using multiple color scheme patterns and images. This makes it possible to tabulate the influence of the arrangement on the impression, such as the impression of a skeleton with a small image being determined by elements such as graphics and characters regardless of the image, or the impression of a tilted image or character being stronger. FIG. 10(c) is an example of a skeleton corresponding to skeletons 1 to 4 in FIG. 10(a). For example, in skeleton 1, image objects and character objects are regularly arranged and the image area is small, so the sense of dynamism is low. In skeleton 2, the graphic objects and image objects are circular, so the sense of familiarity is high and the sense of solidity is low. In skeleton 3, in addition to arranging image objects large, tilted graphic objects are arranged overlapping the image objects, so the sense of dynamism is high. In skeleton 4, images are arranged over the entire skeleton, and the number of character objects is kept to a minimum, so the sense of solidity is high and the sense of dynamism is low. In this way, when a poster image includes characters or images, poster images with different target impressions are generated depending on the arrangement method of the characters or images. Note that the method of creating the skeleton impression table is not limited to this, and it may be estimated from the characteristics of the arrangement information itself, such as the area and coordinates of the image or title character string, or it may be adjusted manually. The skeleton impression table is stored in HDD 104, and skeleton selection unit 214 reads the skeleton impression table from HDD 104 to RAM 103 and refers to it.

[0092] In S908, the color scheme pattern selection unit 215 selects a color scheme pattern that matches the target impression specified by the target impression specification unit 204. The color scheme pattern selection unit 215 refers to an impression table corresponding to the color scheme pattern in the same manner as in S906, and selects a color scheme pattern according to the target impression. FIG. 11(a) shows an example of a color scheme pattern impression table that links color scheme patterns to impressions. The color scheme pattern selection unit 215 calculates the distance value of the impression indicated by the column of luxury to column of solidity in FIG. 11(a) and the distance value between the target impression, and selects the top N color scheme patterns with the smallest distance value. In this embodiment, the top two color scheme patterns are selected. Note that, like the skeleton impression table, the color scheme pattern impression table can tabulate the tendency of the impression of the color scheme pattern by creating and estimating the impression after fixing the skeleton, font, and image other than the color scheme pattern.

[0093] In S909, the font selection unit 216 selects a font combination that matches the target impression specified by the target impression specification unit 204. The font selection unit 216 refers to an impression table corresponding to the font in the same manner as in S906, and selects a font according to the target impression. FIG. 11(b) shows an example of a font impression table that links fonts to impressions. The font selection unit 216 calculates the distance value between the impression indicated by the column of luxury to column of solidity in FIG. 11(b) and the target impression, and selects the top N fonts with the smallest distance value. Note that, like the skeleton impression table, the font impression table can tabulate the tendency of font impressions by creating and estimating impressions of posters with different fonts after fixing skeletons, color patterns, and images other than the font.

[0094] In S910, the layout unit 217 sets character information, images, color schemes, and fonts for the skeletons selected by the skeleton selection unit 214, and generates a poster.

[0095] Next, S910 and the processing of the layout unit 217 will be described in detail with reference to Figs. 12, 13, 14, and 15. Fig. 12 is an example of a software block diagram for explaining the layout unit 217 in detail. The layout unit 217 is configured to include a color allocation unit 1201, an image arrangement unit 1202, an image correction unit 1203, a font setting unit 1204, a text arrangement unit 1205, and a text decoration unit 1206. Fig. 13 is a flowchart for explaining S910 in detail. Fig. 14 is a diagram for explaining information input to the layout unit 217. Fig. 14(a) is a table summarizing character information specified by the text designation unit 202 and images specified by the image designation unit 203. Fig. 14(b) is an example of a table showing color patterns acquired from the color pattern selection unit 215, and Fig. 14(c) is an example of a table showing fonts acquired from the font selection unit 216. Fig. 15 is a diagram for explaining the process of the processing of the layout unit 217.

[0096] First, step S910 will be described in detail with reference to FIG.

[0097] In S1301, the layout unit 217 lists all combinations of skeletons acquired from the skeleton selection unit 214, color patterns acquired from the color scheme selection unit 215, and fonts acquired from the font selection unit 216. The layout unit 217 generates poster data for each combination in order by the following layout process. For example, if the number of skeletons acquired from the skeleton selection unit 214 is 3, the number of color patterns acquired from the color scheme selection unit 215 is 2, and the number of fonts acquired from the font selection unit 216 is 2, the layout unit 217 generates 3×2×2=12 poster data. Next, in S1301, the layout unit 217 selects one of the listed combinations, and executes the processes of S1302 to S1307.

[0098] In S1302, the color scheme allocation unit 1201 allocates the color scheme pattern acquired from the color scheme pattern selection unit 215 to the skeleton acquired from the skeleton selection unit 214. FIG. 15(a) is a diagram showing an example of a skeleton. In this embodiment, an example of allocating a color scheme pattern in the case where the color scheme ID in FIG. 14(b) is 1 to the skeleton 1501 in FIG. 15(a) will be described. The skeleton 1501 in FIG. 15(a) is composed of two graphic objects 1502 and 1503, one image object 1504, and three character objects 1505, 1506, and 1507. First, the color scheme allocation unit 1201 allocates colors to the graphic objects 1502 and 1503. Specifically, based on the color scheme number, which is metadata described in the graphic object, the corresponding color is allocated from the color scheme pattern. Next, the color allocation unit 1201 allocates, for example, the last color of the color scheme pattern to the character object whose metadata is "type" and whose attribute is "title" among the character objects. That is, in this embodiment, color 4 is allocated to the character arranged in the character object 1505. Next, for the character arranged in the character object whose metadata is "type" and whose attribute is other than "title" among the character objects, the character color is set based on the brightness of the background of the character object. In this embodiment, if the brightness of the background of the character object is equal to or lower than a threshold, the character color is set to white, and if not, the character color is set to black. FIG. 15(b) is a diagram showing the state of the skeleton 1508 after the above color allocation process is performed. The color allocation unit 1201 outputs the skeleton data with the color allocation to the image arrangement unit 1202.

[0099] In S1303, the image arrangement unit 1202 arranges the image data acquired from the image analysis unit 212 on the skeleton data acquired from the color allocation unit 1201 based on the associated analysis information. In this embodiment, the image arrangement unit 1202 allocates the image data 1401 to the image object 1504 in the skeleton. Furthermore, when the aspect ratios of the image object 1504 and the image data 1401 are different, the image arrangement unit 1202 performs trimming so that the aspect ratio of the image data 1401 matches the aspect ratio of the image object 1504. More specifically, based on the position of the object obtained by the image analysis unit 212 analyzing the image data 1401, trimming is performed so that the object area reduced by trimming is minimized. Note that the trimming method is not limited to this, and other trimming methods may be used, such as trimming the center of the image or devising a composition so that the face position is in a triangular composition. The image arrangement unit 1202 outputs the skeleton data to which the images have been assigned to the image correction unit 1203 .

[0100] In S1304, the image correction unit 1203 obtains skeleton data to which images have been assigned from the image arrangement unit 1202, and performs correction on the images arranged on the skeleton. In this embodiment, if the resolution of the image is insufficient, upsampling processing is performed using super-resolution processing. First, the image correction unit 1203 determines whether the image arranged on the skeleton meets a certain resolution. For example, assume that an image of 1600px x 1200px is assigned to an area of ​​200mm x 150mm on the skeleton. In this case, the print resolution of the image can be calculated using formula (2).

[0101] 1600 / (200 / 25.4)≒203[dpi]...(2) Next, the image correction unit 1203 increases the resolution by super-resolution processing if it is determined that the print resolution of the image is less than the threshold. On the other hand, if it is determined that the print resolution of the image is equal to or greater than the threshold and has sufficient resolution, no image correction is performed. In this embodiment, the super-resolution processing is performed if the print resolution of the image is less than 300 dpi.

[0102] In S1305, the font setting unit 1204 sets the font acquired from the font selection unit 216 to the skeleton data after image correction acquired from the image correction unit 1203. FIG. 14C shows an example of a combination of fonts selected by the font selection unit 216. In this embodiment, an example of font assignment will be described in which the font ID "2" in FIG. 14C is assigned to the skeleton data after image correction. In this embodiment, fonts are set to the character objects 1505, 1506, and 1507 of the skeleton 1508. Note that in posters, a font that is easy to see is often set for the title from the viewpoint of eye-catchingness, and a font that is easy to read from the viewpoint of visibility is often set for the other characters. Therefore, in this embodiment, the font selection unit 216 selects two types of fonts, a title font and a body font. The font setting unit 1204 sets the title font to the character object 1505 whose attribute is "title", and sets the body font to the other character objects 1506 and 1507. The font setting unit 1204 outputs the skeleton data with the font set to the text arrangement unit 1205. In this embodiment, the font selection unit 216 selects two types of fonts, but this is not limited to the above, and for example, only the title font may be selected. In this case, the font setting unit 1204 uses a font corresponding to the title font as the body font. In other words, if the title is a Gothic font, a typical Gothic font with high readability is selected for the rest, and if the title is a Mincho font, a typical Mincho font is selected for the rest, and so on. It is sufficient to set a body font that matches the type of the title font. Of course, the title font and the body font may be the same. Also, different fonts may be used depending on the degree of prominence, such as using a title font for the character objects of the title and subtitle and a body font for the other character objects, or using a title font for a certain font size or larger.

[0103] In S1306, the text arrangement unit 1205 arranges the text specified by the text designation unit 202 in the skeleton data with font set obtained from the font setting unit 1204. In this embodiment, each text shown in FIG. 14(a) is assigned by referring to the metadata attributes of the skeleton character objects. That is, "Summer Big Appreciation Sale" with the attribute of title is assigned to the character object 1505, and "Blow Away the Midsummer Heat" with the attribute of subtitle is assigned to the character object 1506. Since the main text is not set, nothing is assigned to the character object 1507. FIG. 15(c) shows a skeleton 1509 which is an example of skeleton data after processing by the text arrangement unit 1205. The text arrangement unit 1205 outputs the skeleton data with text arrangement to the text decoration unit 1206.

[0104] In S1307, the text decoration unit 1206 decorates the character objects in the skeleton with text layout obtained from the text layout unit 1205. In this embodiment, if the color difference between the title character and its background area is equal to or less than a threshold, a process of adding a border to the title character is performed. This improves the readability of the title. The text decoration unit 1206 outputs the skeleton data with the decoration, that is, the poster data with all layout completed, to the impression estimation unit 218.

[0105] In S1308, the layout unit 217 determines whether all poster data has been generated. If the layout unit 217 determines that poster data has been generated for all combinations of skeletons, color patterns, and fonts, it ends the layout process and transitions to S913. If it determines that all poster data has not been generated, it returns to S1301 and generates poster data for combinations that have not yet been generated.

[0106] This concludes the explanation of S910. Return to FIG.

[0107] In S911 , the device gamut acquisition unit 220 acquires the device gamut associated with the printer specified by the printer specification unit 206 , and outputs the device gamut to the gamut mapping unit 221 .

[0108] In S912, the gamut mapping unit 221 performs gamut mapping on the image data obtained by rendering each poster data acquired from the layout unit 217 so that all colors fall within the device gamut acquired from the device gamut acquisition unit 220.

[0109] 24 is a flowchart for explaining S912 in detail. In S2401, the gamut mapping unit 221 executes a rendering process for each poster data generated in S910. The rendering process is a process for converting the poster data into image data.

[0110] In S2402, the gamut mapping unit 221 performs gamut mapping on the image data rendered in S2401. FIG. 25 is a diagram for explaining gamut mapping. FIG. 25 shows the L*-a* plane in the CIE-L*a*b* color space. A color gamut 2501 is the color gamut of the input image data. A color gamut 2502 is the device color gamut acquired in S911, and is the color gamut after gamut mapping. A color 2503 is a color included in the input image data. A color 2504 and a color 2505 are colors when different gamut mapping methods are applied to the color 2503. For example, the color 2504 has a small color difference from the color 2503, so there is little overall color change, but the gamut mapping is such that the luminance value changes. On the other hand, the color 2505 has a gamut mapping in which the luminance value does not change much from the color 2503, but the saturation is reduced. As shown in the example of FIG. 25, in gamut mapping, colors change depending on the gamut mapping method, the printer model, the paper used for printing, and the like.

[0111] In S2403, the gamut mapping unit 221 determines whether all gamut mapping methods specified by the gamut mapping specification unit 207 have been performed on the image data rendered in S2401. If the gamut mapping unit 221 determines that all gamut mapping methods have been performed, it proceeds to S2404, and otherwise returns to S2402.

[0112] In S2404, the gamut mapping unit 221 determines whether the processes from S2401 to S2403 have been performed on all of the poster data generated in S910, and if all of the processes have been performed, ends the process, otherwise returns to S2401.

[0113] Returning to the explanation of FIG. 9(a), in S913, the impression estimation unit 218 estimates the impression of the poster image data acquired from the gamut mapping unit 221 and links it to the poster image data. For example, even if the color scheme is the same, if the skeleton is different, the layout will change, so which color is actually used in what area will differ. Therefore, it is necessary to evaluate not only the tendency of the individual impressions of the color scheme pattern and skeleton, but also the impression of the final poster. In addition, color changes due to gamut mapping also affect the impression. Therefore, this impression estimation process is performed on the image data that has been rendered and gamut mapped in S912 for the poster data generated in S910. This makes it possible to evaluate not only the impression of each element of the poster, such as the color scheme and layout, but also the impression of the printed poster that has been laid out including images and characters.

[0114] In S914, the poster selection unit 219 selects poster image data to be output to the display 105 (to be presented to the user) from the poster image data and the estimated impression linked to the poster image data acquired from the impression estimation unit 218. In this embodiment, the poster selection unit 219 selects a poster for which the distance between the target impression and the estimated impression of the poster is equal to or less than a predetermined threshold value.

[0115] In this embodiment, the Euclidean distance is used as the distance. The smaller the value of the Euclidean distance, the closer the target impression and the estimated impression are. The distance calculated by the poster selection unit 219 is not limited to the Euclidean distance, and any distance between vectors can be calculated, such as Manhattan distance or cosine similarity.

[0116] Also, if the number of selected posters is less than the number of posters to be created specified by the poster creation condition specification unit 201, the poster selection unit 219 selects the insufficient posters in ascending order of the distance between the target impression and the estimated impression of the poster. In this embodiment, the poster selection unit 219 also selects the insufficient posters, but this is not limited to this. For example, if the number of posters selected by the poster selection unit 219 is less than the number of posters to be created, the preview screen 601 may display a message indicating that there is a shortage. Alternatively, the poster selection unit 219 may select the insufficient posters and then display them on the preview screen 601 so that posters whose distance between the target impression and the estimated impression is equal to or less than a threshold value and posters whose distance is equal to or more than the threshold value can be distinguished. Also, for example, if the selected posters are insufficient, the process may return to S903 and the number of skeletons, color patterns, and fonts to be selected may be increased.

[0117] In S915, the poster display unit 205 renders the poster data selected by the poster selection unit 219, and outputs the poster image to the display 105. That is, the preview screen 601 in Fig. 6 is displayed. When the print button 604 is pressed, the poster display unit 205 outputs the selected poster image data to the print unit 208.

[0118] In S916, the printing unit 208 prints the poster image data acquired from the poster display unit 205 through the recording device 120. Note that in this embodiment, the poster image data to be printed has been gamut mapped in S912 and is contained within the colors of the device color gamut. Therefore, there is no need to perform gamut mapping again in the recording device 120, and it is possible to print the colors intended when the poster was generated as is by printing in Colorimetric mode. Note that, although one recording device is used in this embodiment, if there are multiple recording devices, printing can be performed using the recording device specified in the printer specification box 516.

[0119] The above is an explanation of the flow of the poster generation process for generating a poster by the user specifying an impression.

[0120] As described above, according to this embodiment, a poster expressing the impression desired by the user can be generated. More specifically, in this embodiment, by combining each element constituting a poster, such as a skeleton, a color scheme pattern, and a font, based on a target impression, a plurality of variations of poster candidates according to the target impression can be generated. Furthermore, after applying one or more gamut mappings to the poster candidates, the impression of the entire poster is estimated, and a poster close to the target impression is selected from the poster candidates. This makes it possible to generate a poster whose overall impression after printing, not just the individual elements, is in line with the user's intention.

[0121] When printing image data, the digital color and the printed color usually do not match due to the printer model, the type of media to be printed, and the gamut mapping method. Therefore, even if a poster image is created so that the impression matches the image data, the color changes due to printing, changing the impression. In this embodiment, by selecting an impression estimation and a poster image for the poster image data after gamut mapping, a poster image close to the target impression can be generated according to the printer and media. More specifically, for example, in this embodiment, the target impression on the application startup screen 501 is specified as luxury -1, familiarity +1, and dynamism and solidity are each set to off. At that time, for example, the poster image 602 on the preview screen 601 is generated with an estimated impression close to the target impression, such as luxury -1.2, familiarity +0.9, dynamism +0.2, and solidity -1.3. Furthermore, since the poster image 602 is composed of a color gamut that can be reproduced even when printed, the same impression can be maintained after printing.

[0122] <Modification of the first embodiment> In the first embodiment, the impression sliders 508 to 511 on the application startup screen 501 are used as objects operated to set the target impression, but the method for setting the target impression is not limited to this.

[0123] FIG. 16 is a diagram showing an example of a UI for setting a target impression. FIG. 16(a) shows an example of setting a target impression with a UI on a radar chart. By operating a handle 1601 on the radar chart of FIG. 16(a), a target impression for each axis can be set. The target impression designation unit 204 acquires a target impression such that, for example, when the handle 1601 is at the center in the UI, it is -2, and when it is at the outermost edge, it is +2. In FIG. 16(a), the target impressions are luxury +0.8, familiarity +1.1, dynamism -0.1, and solidity -0.7. In this way, the target impressions may be decimals. Also, the radar chart of FIG. 16(b) shows an example of turning off some of the target impressions. For example, the user can double-click the handle 1601 with the pointing device 107 to turn off the target impression of the axis corresponding to the handle 1601, and hide it. The user can turn on the target impression and redisplay it by clicking the axis 1602 on the radar chart again with the pointing device 107. FIG. 16(b) has the same target impression as FIG. 16(a) except for the sense of dynamism, but the sense of dynamism is turned off.

[0124] 16(c) shows an example of a UI for setting the target impression from an image instead of words. Poster images 1604 to 1607, which have been subjected to impression estimation in advance and have a large impression, are lined up in a sample poster display area 1603. Also, a check box 1608 is displayed on each poster image. The user can turn on the check box 1608 and select a poster that the user thinks is close to the poster they want to create by clicking with the pointing device 107. The target impression designation unit 204 determines the target impression by referring to the impression corresponding to the selected poster image.

[0125] FIG. 16(d) is a table showing impressions corresponding to poster images 1604 to 1607 in FIG. 16(c) and the final target impression. The columns of luxury, familiarity, dynamism, and solidity represent numbers indicating the degree to which each poster image affects each impression. For example, assume that poster images 1604 and 1607 are selected as shown in FIG. 16(c). In this case, the target impression designation unit 204 determines the impression obtained by combining the impressions of poster images 1604 and 1607 as the target impression. In this example, the value of the numerical value of each factor of the target impression is set to the maximum absolute value among the numerical values ​​of the impressions of each factor corresponding to the selected poster image. Note that, although an example in which a poster image with a maximum impression is presented has been shown, this is not limiting. Multiple poster images that increase the impression may be used, or poster images greater than the number of impressions may be presented. This allows the user to intuitively designate the target impression from the actual poster, not from words.

[0126] In addition, in the present embodiment, poster data has been described as an example of product data. However, the operation of the present embodiment is applicable not only to posters but also to other types of products. For example, a banner may be used instead of a poster. In that case, a banner image is displayed as a product image instead of the poster preview in FIG. 6.

[0127] [Second embodiment] The second embodiment will be described below with respect to the differences from the first embodiment. In the first embodiment, the process of selecting the poster components, namely the skeleton, color scheme pattern, and font, based on the target impression and generating a poster was described. In the second embodiment, the combination generation unit searches for a combination of the poster components that will bring the overall impression of the poster closer to the target impression, based on a genetic algorithm. This makes it possible to more flexibly select the components of the poster that are most suitable for the target impression, without the need for pre-calculation of a skeleton impression table, a color scheme pattern impression table, or a font impression table.

[0128] Fig. 17 is a software block diagram of a poster creation application in the second embodiment. In the configuration of the block diagram shown in Fig. 17, a combination generation unit 1701 is configured instead of the skeleton selection unit 214, the color scheme pattern selection unit 215, and the font selection unit 216 in Fig. 2. Note that components with the same numbers as those in Fig. 2 perform the same processes as those described in the first embodiment, and therefore their description will be omitted here.

[0129] The combination generation unit 1701 acquires one or more skeletons from the skeleton acquisition unit 213, poster data and an estimated poster impression from the impression estimation unit 218, and a target impression from the target impression designation unit 204. The combination generation unit 1701 also acquires a list of color scheme patterns and fonts from the HDD 104. The combination generation unit 1701 also acquires a list of gamut mapping methods from the HDD 104. The combination generation unit 1701 generates a combination of poster components (skeleton, color scheme pattern, font) and gamut mapping methods to be used for poster generation. The combination generation unit 1701 outputs the generated combination of poster components to the layout unit 217. The combination generation unit 1701 also outputs the generated gamut mapping method to the gamut mapping unit 221.

[0130] The poster selection unit 1702 selects, from the poster data acquired from the impression estimation unit 218, posters for which the distance between the estimated impression of the poster and the target impression specified by the target impression specification unit 204 is equal to or less than a threshold value, and stores these in the RAM 103. The poster selection unit 1702 also determines whether the number of selected and stored posters has reached the number specified in the number of posters to be created box 514.

[0131] Fig. 18 is a flowchart showing the process of the poster generation unit 210 of the poster creation application in this embodiment. Note that, among the processes in this flowchart, the processes with the same numbers as those in the flowchart in Fig. 9 are the same as those described in the first embodiment, so their explanation will be omitted here. Note that, in the process of this flowchart, S903 and S907 to S909 shown in Fig. 9 are omitted.

[0132] In the description of S1801 after S906, the operation at the first execution and the operation after the second loop will be described separately. First, at the first execution of S1801, the combination generation unit 1701 acquires each table of skeleton, color scheme, and font used for poster generation. FIG. 19 is a diagram for explaining the tables used by the combination generation unit 1701. FIG. 19(a) shows a list of skeletons acquired by the combination generation unit 1701 from the skeleton acquisition unit 213. FIG. 19(b), FIG. 19(c), and FIG. 19(d) respectively show a list of fonts, a list of color schemes, and a list of gamut mapping methods acquired by the combination generation unit 1701 from the HDD 104. The combination generation unit 1701 generates random combinations from the above three tables. In this example, 100 combinations are generated. FIG. 19(e) shows a combination table generated in this embodiment.

[0133] After that, the combination generating unit 1701 executes the processes of S910 to S1802 for all the generated combinations.

[0134] Next, in the second loop and thereafter of S1801, the combination generation unit 1701 calculates the distance value between the poster estimated impression acquired from the impression estimation unit 218 and the target impression, and links it to the combination table. FIG. 20 is a diagram for explaining the operation of S1801 in the second loop and thereafter. FIG. 20(a) is a table in which the distance value between the poster estimated impression and the target impression is linked to FIG. 19(e). More specifically, the layout unit 217 generates a poster based on FIG. 19(e), the gamut mapping unit 221 performs gamut mapping on each of the generated posters, and the impression estimation unit 218 estimates an impression for each of the generated poster images. The distance column in FIG. 20(a) indicates the distance value between the estimated impression and the target impression of the poster generated by the combination of the corresponding row. The combination generation unit 1701 generates a new combination table from FIG. 20(a). FIG. 20(b) is the newly generated combination table. In this embodiment, new combinations are generated using tournament selection and uniform crossover in a genetic algorithm. First, N combinations are randomly selected from the table in Figure 20(a). Here, for example, N=3. Next, from the selected combinations, the top two combinations with the smallest distance (=closest to the target impression) are selected. Finally, for the two selected combinations, each element of the combination (skeleton ID, color scheme ID, font ID) is randomly swapped to generate a new combination. For example, combinations IDs 1 and 2 in Figure 20(b) show the results generated from combinations IDs 1 and 3 in Figure 20(a), where the color scheme IDs have been swapped. The above procedure is repeated to generate 100 new combinations, as shown in Figure 20(b).

[0135] This allows efficient combination search based on the distance value between the target impression and the estimated impression. In this embodiment, 100 combinations are generated, but this is not limited to this. In addition, tournament selection and uniform crossover are used, but this is not limited to this, and other methods such as ranking selection, roulette selection, and one-point crossover may be used. In addition, mutation may be incorporated to make it difficult to fall into a local optimum solution. In addition, although a skeleton (layout), a color scheme pattern, and a font are used as components of the poster to be searched, other components may be used. For example, multiple patterns to be inserted into the background of the poster may be prepared, and which pattern to use or not to use may be determined by search. By increasing the number of components to be searched, a poster with more variations can be generated, and the range of impression expression can be increased. In addition, all the gamut mapping methods stored in the HDD 104 are used, but the search may be performed using only the specified gamut mapping method, as in the gamut mapping designation area 517 of FIG. 5.

[0136] After S913, in S1802, the poster selection unit 1702 calculates the distance value between the poster estimated impression and the target impression in the same manner as in S1801, and creates the same table as in Fig. 20(a). The poster selection unit 1702 stores in the RAM 103 poster images whose distance value from the target impression is equal to or smaller than a threshold value.

[0137] In S1803, the poster selection unit 1702 judges whether the number of poster images stored in the RAM 103 in S1802 reaches the number of poster images designated in the number of poster images box 514. If the poster selection unit 1702 judges that the number of poster images has been reached, it ends the poster generation process. If the poster selection unit 1702 judges that the number of poster images has not been reached, it returns to S1801. That is, the process of S1801 in the second loop described above is executed, and the processes of S1801 to S1802 are repeatedly executed until the number of poster images stored in the RAM 103 whose distance value from the target impression is equal to or less than the threshold value reaches the designated number of poster images. Note that if the number of poster images whose distance value from the target impression is equal to or less than the threshold value is stored in the number of poster images equal to or more than the designated number of poster images, the poster selection unit 1702 may compare the distance values ​​of the respective stored poster images, and ultimately store only the poster image whose value is smaller in the RAM 103. Then, the poster image whose value is determined to be larger based on the comparison result may be deleted from the RAM 103.

[0138] In this embodiment, a combination of poster components is searched for using a genetic algorithm, but the search method is not limited to this, and other search methods such as a local search method or a Tabu search method may also be used.

[0139] As described above, according to this embodiment, by searching for a combination of components to be used in a poster, it is possible to generate a poster whose overall impression is close to the target impression. This is particularly effective when generating a poster according to an image or text information input by a user. For example, consider a case where an image has a dynamic impression, but a poster whose overall impression is a subdued impression is to be generated. In this embodiment, it is possible to evaluate the overall impression of the poster and search for a combination of a skeleton, a color scheme pattern, and a font that will bring the poster closer to the target impression. Therefore, in order to suppress the impression of the image, it is possible to control the components of the poster according to the image, such as using a skeleton with a small image area or using a font or color scheme that is more subdued. Furthermore, in this embodiment, even if the user does not understand the characteristics of the gamut mapping method, it is possible to automatically select a gamut mapping method that is likely to match the impression by searching. According to this embodiment, it is possible to flexibly find a combination of components and gamut mapping methods that are optimal for the overall impression of the poster, and create posters that are close to the target impression in various variations.

[0140] [Third embodiment] The third embodiment will be described below with respect to the differences from the first and second embodiments. In the first and second embodiments, an example is described in which a poster is generated by controlling the components of the poster based on the target impression. In the third embodiment, an example is described in which a template combining a skeleton, a color scheme pattern, and a font is prepared in advance, and a poster is generated by the layout unit simply setting image and text information. This makes it possible to generate a poster that matches the target impression with simpler processing.

[0141] Fig. 21 is a software block diagram of a poster creation application in the third embodiment. In the configuration of the block diagram shown in Fig. 21, a template acquisition unit 2101 is configured instead of the skeleton acquisition unit 213, the skeleton selection unit 214, the color scheme pattern selection unit 215, and the font selection unit 216 in Fig. 2. The components with the same numbers as in Fig. 2 perform the same processes as those described in the first embodiment, and therefore will not be described here.

[0142] The template acquisition unit 2101 acquires from the HDD 104 a group of templates that meet the conditions specified by the poster creation condition specification unit 201, the text specification unit 202, and the image acquisition unit 211. In this embodiment, a template refers to a skeleton in which a color scheme and a font are set in advance. The template acquisition unit 2101 outputs the acquired group of templates to the layout unit 2102.

[0143] The layout unit 2102 generates poster data by laying out the images acquired from the image acquisition unit 211 and the text acquired from the text designation unit 202 for each template acquired from the template acquisition unit 2101. The layout unit 2102 outputs the generated poster data group to the impression estimation unit 218.

[0144] Fig. 22 is a flowchart showing the processing of the poster generation unit 210 of the poster creation application in this embodiment. Note that the processing with the same numbers as in Fig. 9 is the same as the processing explained in the first embodiment, so the explanation will be omitted here. Note that in the processing of this flowchart, S906 to S909 shown in Fig. 9 are omitted.

[0145] After S905, in S2201, the template acquisition unit 2101 acquires one or more templates that meet the conditions specified by the poster creation condition specification unit 201, the text specification unit 202, and the image acquisition unit 211 from the HDD 104. In this embodiment, a template refers to a skeleton in which a color scheme and a font are set in advance. Also, it is assumed that the templates are described in one file per template and stored in the HDD 104.

[0146] Similar to the skeleton acquisition unit 213, the template acquisition unit 2101 sequentially reads template files from the HDD 104 into the RAM 103, leaves templates that meet the set conditions on the RAM 103, and deletes templates that do not meet the conditions from the RAM 103. The template acquisition unit 2101 then outputs the acquired one or more templates to the layout unit 2102.

[0147] In S2202, the layout unit 2102 generates poster data by laying out the images acquired from the image acquisition unit 211 and the text acquired from the text designation unit 202 for each template acquired from the template acquisition unit 2101. The layout unit 2102 then outputs the generated poster data or multiple poster data to the impression estimation unit 218. Note that the image setting is similar to that of the image arrangement unit 1202, and the character information setting is similar to that of the text arrangement unit 1205, so a description thereof will be omitted.

[0148] As described above, according to this embodiment, by preparing templates in which various color schemes and fonts are set in advance, a poster close to a target impression can be generated by simple processing.

[0149] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0150] The disclosure of the present embodiment includes the following information processing device, method, and program. (Item 1) A first reception means for receiving content of a commodity; A second reception means for receiving a designation of an impression that the product gives to the user; A third reception means for receiving conditions of the product; An acquisition means for acquiring information on a color gamut that can be reproduced by a printing means for printing the commercial material; a generating means for generating a plurality of pieces of product data based on the content received by the first receiving means, the impression designation received by the second receiving means, and the product conditions received by the third receiving means; a display means for displaying a commercial material image based on the plurality of commercial material data generated by the generating means; Equipped with The commercial material image is an image represented by data specified based on the designation of the impression accepted by the second accepting means from a plurality of data generated from the plurality of commercial material data based on the information of the color gamut acquired by the acquiring means. 23. An information processing apparatus comprising: (Item 2) 2. The information processing device according to item 1, wherein the plurality of data are data generated by converting the color gamut of the plurality of commercial material data based on the color gamut information acquired by the acquisition means. (Item 3) 3. The information processing device according to item 2, wherein the color gamut information includes a color gamut conversion method. (Item 4) An estimation means for estimating an impression of data obtained by converting a color gamut of each of the plurality of product data; A specifying means for specifying data for displaying the commercial material image from the data estimated by the estimating means based on the designation of the impression received by the second receiving means; 4. The information processing device according to item 2 or 3, comprising: (Item 5) 5. The information processing device according to any one of items 1 to 4, further comprising a second acquisition means for acquiring a plurality of product components based on the impression designation accepted by the second acceptance means. (Item 6) 6. The information processing device according to item 5, wherein the generating means generates the plurality of pieces of product data corresponding to the plurality of product components acquired by the second acquiring means. (Item 7) The product further includes a storage means for storing a table in which a plurality of the product components are defined, 7. The information processing device according to item 6, wherein in the table, each of the plurality of product components is associated with an impression. (Item 8) 8. The information processing device according to item 7, wherein the acquiring means acquires from the table a plurality of product components that are close to the designated impression accepted by the second accepting means. (Item 9) 6. The information processing device according to item 5, wherein the acquisition of the plurality of product components by the second acquisition means is performed by a genetic algorithm. (Item 10) 10. The information processing device according to any one of items 5 to 9, wherein the product components include a skeleton for determining an arrangement of the content. (Item 11) 11. The information processing device according to any one of items 5 to 10, wherein the product component includes a color pattern. (Item 12) 12. The information processing device according to item 11, wherein the color scheme pattern is a combination of a plurality of colors. (Item 13) 13. The information processing device according to any one of items 5 to 12, wherein the product components include a font pattern. (Item 14) Item 14. The information processing device according to item 13, wherein the font pattern is a combination of a title font and a body font. (Item 15) 15. The information processing device according to any one of items 1 to 14, wherein the commercial material images are displayed in a manner that allows a user to select them. (Item 16) 16. The information processing device according to any one of items 1 to 15, wherein the second accepting means accepts a value set by a slider bar as the designation of the impression. (Item 17) 16. The information processing device according to any one of items 1 to 15, wherein the second accepting means accepts the designation of the impression by accepting a selection of an image to be a sample. (Item 18) 18. The information processing device according to any one of items 1 to 17, wherein the commercial material includes a poster. (Item 19) A method executed in an information processing device, comprising: a first reception step for receiving content for a commodity; a second reception step of receiving a designation of an impression that the product gives to the user; A third reception step of receiving conditions of the product; An acquisition step of acquiring information on a color gamut that can be reproduced by a printing means that prints the commercial material; a generating step of generating a plurality of pieces of product data based on the content received in the first receiving step, the impression designation received in the second receiving step, and the product conditions received in the third receiving step; a display step of displaying a commercial material image based on the plurality of commercial material data generated in the generating step; having The commercial material image is an image represented by data identified based on the designation of the impression accepted in the second accepting step from a plurality of data generated from the plurality of commercial material data based on the information of the color gamut acquired in the acquiring step. 23. An information processing apparatus comprising: (Item 20) 19. A program for causing a computer to function as each of the means of the information processing device according to any one of items 1 to 18.

[0151] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0152] 100 Information processing device: 101 CPU: 102 ROM: 103 RAM

Claims

1. A first reception means for receiving content of a product; A second reception means for receiving a designation of an impression that the product gives to a user; A third reception means for receiving conditions of the product; An acquisition means for acquiring information on a color gamut that can be reproduced by a printing means for printing the commercial material; a generating means for generating a plurality of pieces of product data based on the content received by the first receiving means, the designation of the impression received by the second receiving means, and conditions of the product received by the third receiving means; a display means for displaying a commercial material image based on the plurality of commercial material data generated by the generating means; Equipped with The commercial material image is an image represented by data specified based on the designation of the impression accepted by the second accepting means, from a plurality of data generated from the plurality of commercial material data based on the information of the color gamut acquired by the acquiring means.

23. An information processing apparatus comprising:

2. 2 . The information processing apparatus according to claim 1 , wherein the plurality of data are data generated by converting the color gamut of the plurality of commercial material data on the basis of the information on the color gamut acquired by the acquisition means.

3. 3. The information processing apparatus according to claim 2, wherein the information on the color gamut includes a method for converting the color gamut.

4. An estimation means for estimating an impression of data obtained by converting a color gamut of each of the plurality of product data; A specifying means for specifying data for displaying the commercial material image from the data estimated by the estimating means based on the designation of the impression received by the second receiving means; 3. The information processing apparatus according to claim 2, further comprising:

5. 2 . The information processing apparatus according to claim 1 , further comprising: a second acquisition unit configured to acquire a plurality of product components based on the designation of the impression accepted by the second acceptance unit.

6. The information processing apparatus according to claim 5 , wherein the generating means generates the plurality of pieces of product data corresponding to the plurality of product components acquired by the second acquiring means.

7. The product further includes a storage means for storing a table in which a plurality of the product components are defined, The information processing apparatus according to claim 6 , wherein in the table, each of the plurality of product components is associated with an impression.

8. 8. The information processing apparatus according to claim 7, wherein the acquiring means acquires from the table a plurality of product components that are close to the designated impression accepted by the second accepting means.

9. 6. The information processing apparatus according to claim 5, wherein the second acquisition means acquires the plurality of product components using a genetic algorithm.

10. The information processing apparatus according to claim 5 , wherein the product components include a skeleton for determining a layout of the content.

11. The information processing apparatus according to claim 5 , wherein the commercial material components include a color pattern.

12. 12. The information processing apparatus according to claim 11, wherein the color scheme pattern is a combination of a plurality of colors.

13. The information processing apparatus according to claim 5 , wherein the commercial material components include a font pattern.

14. 14. The information processing apparatus according to claim 13, wherein the font pattern is a combination of a title font and a body font.

15. The information processing apparatus according to claim 1 , wherein the commercial material images are displayed in a manner that allows a user to select one of the commercial material images.

16. 2 . The information processing apparatus according to claim 1 , wherein the second reception means receives a value set by a slider bar as the designation of the impression.

17. The information processing apparatus according to claim 1 , wherein the second accepting means accepts the designation of the impression by accepting a selection of an image to be a sample.

18. The information processing apparatus according to claim 1 , wherein the commercial material includes a poster.

19. A method executed in an information processing device, comprising: A first reception step of receiving content of a commodity; A second reception step of receiving a designation of an impression that the product gives to the user; A third reception step of receiving conditions of the product; An acquisition step of acquiring information on a color gamut that can be reproduced by a printing means that prints the commercial material; a generating step of generating a plurality of pieces of product data based on the content received in the first receiving step, the designation of the impression received in the second receiving step, and the conditions of the product received in the third receiving step; a display step of displaying a commercial material image based on the plurality of commercial material data generated in the generating step; having The commercial material image is an image represented by data identified based on the designation of the impression accepted in the second accepting step from a plurality of data generated from the plurality of commercial material data based on the information of the color gamut acquired in the acquiring step.

23. An information processing apparatus comprising:

20. A program for causing a computer to function as each of the means of the information processing apparatus according to any one of claims 1 to 18.

Images