Information processing apparatus, information processing method, and program

Abstract

To improve usability when designating a target impression in an information processing apparatus for generating data of a product such as a poster.SOLUTION: According to an embodiment of the present disclosure, there is provided an information processing apparatus that generates data of a product, the information processing apparatus including a reception unit configured to receive, from a user, designation of a content to be arranged in the product and designation of a desired impression that is an impression that the product is required to finally hold, and a control unit configured to perform control such that a range of the desired impression that can be designated by the user when the reception unit receives designation of a first content is different from a range of the desired impression that can be designated by the user when the reception unit receives designation of a second content different from the first content.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] One method for creating poster design data using an information processing device such as a PC or smartphone is to use a template in which the shapes and arrangements of images, text, graphics, etc. to be placed on the poster are predetermined. Patent Document 1 also discloses an application program that automatically generates poster data in which images, text, graphics, etc. are arranged when a user specifies the impression (target impression) of the poster they want to create.

[0003] In Patent Document 1, the user can freely specify the target impression of the poster as well as the images and text to be used in the poster (hereinafter, both of which are also referred to as "contents"), so that the user can obtain a poster with the desired impression using the desired images. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2024-004399 Summary of the Invention [Problem to be solved by the invention]

[0005] However, for users with limited design skills, even if they had decided on the content they wanted to use in their poster, it was difficult to determine what target impression they should specify to create a design that would give the right impression for that content. As a result, users had to search for ways to specify the target impression.

[0006] The present disclosure aims to improve usability when a user specifies a target impression in an information processing device that generates data for a product such as a poster. [Means for solving the problem]

[0007] The present disclosure provides an information processing device that generates data for a production, comprising: a receiving means that receives from a user a specification of content to be placed in the production and a specification of a target impression, which is the impression that the production is ultimately required to retain; and a control means that controls so that the range of the target impression that the user can specify when the receiving means receives a specification of a first content is different from the range of the target impression that the user can specify when the receiving means receives a specification of a second content that is different from the first content. [Effects of the Invention]

[0008] According to the present disclosure, usability when a user specifies a target impression is improved. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 2 is a block diagram showing the hardware configuration of the poster generation device. [Figure 2] FIG. 1 is a software block diagram of a poster creation application. [Figure 3] FIG. 10 is a software block diagram of a target impression setting control unit. [Figure 4] FIG. 1 is a diagram illustrating a skeleton. [Figure 5] FIG. 10 is a diagram illustrating a color scheme pattern. [Figure 6] FIG. 10 is a diagram showing a mode selection screen provided by a poster creation application. [Figure 7] FIG. 10 is a diagram showing a content setting screen provided by a poster creation application. [Figure 8] FIG. 10 is a diagram showing a generation condition setting screen provided by a poster creation application. [Figure 9] FIG. 10 is a diagram showing a preview screen provided by a poster creation application. [Figure 10] 10 is a flowchart showing a process for quantifying a poster impression. [Figure 11] FIG. 10 is a diagram illustrating a subjective evaluation of a poster. [Figure 12] 10 is a flowchart showing a content impression quantification process. [Figure 13] 10A and 10B are diagrams comparing differences in poster generation results depending on operation modes. [Figure 14] 10 is a flowchart showing an operation mode switching process. [Figure 15] 10 is a flowchart showing a poster generation process in a content priority mode. [Figure 16] 10 is a flowchart showing a process for changing the setting range of a desired impression. [Figure 17] FIG. 10 is a diagram illustrating a method for determining a setting range of a desired impression. [Figure 18] 10A and 10B are diagrams illustrating a method for changing the UI for setting a target impression. [Figure 19] FIG. 10 is a diagram illustrating a skeleton selection method. [Figure 20] 10A and 10B are diagrams illustrating a method for selecting a color scheme pattern and a font. [Figure 21] FIG. 2 is a software block diagram illustrating the layout unit in detail. [Figure 22] 10 is a flowchart showing a layout process. [Figure 23] FIG. 10 is a diagram for explaining input to a layout section. [Figure 24] FIG. 10 is a diagram illustrating the operation of a layout unit. [Figure 25] 10 is a flowchart showing a poster generation process in impression-priority mode. [Figure 26] FIG. 10 is a diagram showing a modified example of a UI for setting a target impression. [Figure 27] FIG. 10 is a diagram showing a modified example of a UI for setting a target impression. [Figure 28]FIG. 10 is a software block diagram of a poster creation application according to a second embodiment. [Figure 29] 10 is a flowchart showing a template generation process in a content priority mode. [Figure 30] FIG. 11 is a software block diagram illustrating in detail a target impression setting control unit according to a third embodiment. [Figure 31] 10 is a flowchart showing a process for changing the setting range of a desired impression. [Figure 32] FIG. 10 is a diagram illustrating the impression range of a use category. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the claims, and not all of the combinations of features described in the embodiments are necessarily essential to the present disclosure. Note that the same components are given the same reference numerals and descriptions thereof will be omitted.

[0011] <<First Embodiment>> In the following embodiments, a method for automatically generating designed poster data by running a poster creation application (hereinafter also referred to as "app") on a poster creation device will be described as an example. Conventional poster creation applications allow users to freely specify the target impression of a poster and the content to be placed on the poster. Therefore, if a target impression that does not match the content specified by the user is set, the poster generated by the poster creation application also ends up being output as a mismatch with the content. This requires the user to repeatedly search for a target impression until they obtain a poster with the desired design. Therefore, the poster creation application of the first embodiment changes the range of target impressions that can be specified according to the content specified by the user, making it easier to specify a target impression that is appropriate for the content.

[0012] In the following description, unless otherwise specified, the term "image" includes still images and frame images extracted from videos. In the following embodiments, posters are described as examples of creative works, but the creative works are not limited to posters. The image can be used for any creative work that includes at least one of image content and text content, such as flyers, menus, banners, calendars, photo collages, certificates, business cards, shop cards, postcards, invitations, membership cards, and more. These creative works can be used not only in print but also as electronic content on websites, social networking sites, virtual spaces, and the like.

[0013] <System configuration> 1 is a block diagram showing the hardware configuration of a poster generation device. The poster generation device 100 is an information processing device, such as a personal computer (hereinafter referred to as a PC) or a smartphone. In this embodiment, the poster generation device is described as a PC. The poster generation device 100 includes a CPU 101, a ROM 102, a RAM 103, a HDD 104, a display 105, a keyboard 106, a pointing device 107, a data communication unit 108, and a GPU 109.

[0014] A CPU (Central Processing Unit / Processor) 101 comprehensively controls the poster generation device 100, and realizes the operation of this embodiment by, for example, reading a program stored in a ROM 102 into a RAM 103 and executing it. Although FIG. 1 shows one CPU, the device may be configured with multiple CPUs.

[0015] The ROM 102 is a general-purpose ROM and stores, for example, a program executed by the CPU 101. The RAM 103 is a general-purpose RAM and is used, for example, as a working memory for temporarily storing various pieces of information when the CPU 101 executes a program.

[0016] The HDD (hard disk) 104 is a storage medium (storage unit) for storing image files, a database for holding processing results such as image analysis, and skeletons and the like used by the poster creation application.

[0017] The display 105 is a display unit that displays the user interface (UI) of this embodiment and an electronic poster as a layout result of image data (hereinafter also referred to as "image") to the user. The keyboard 106 and pointing device 107 accept instructions and operations from the user. The display 105 may also have a touch sensor function.

[0018] The keyboard 106 is used, for example, when the user inputs the number of double-page spreads of the poster that he or she wants to create on the UI displayed on the display 105 .

[0019] The pointing device 107 is used, for example, when the user clicks a button on the UI displayed on the display 105 .

[0020] The data communication unit 108 communicates with external devices via a wired or wireless network, etc. For example, the data communication unit 108 transmits data laid out by the automatic layout function to a printer or server that can communicate with the poster generation device 100.

[0021] The GPU 109 is a processor that performs image processing in response to instructions from the CPU 101. The GPU 109 performs, for example, analysis of the image to be placed on the poster, estimation of the impression of the image or text, estimation of the impression of the poster, layout and color arrangement of the image, text, etc. for the skeleton, and generates a poster image.

[0022] The data bus 110 connects the blocks in FIG. 1 so that they can communicate with each other. Note that the configuration shown in FIG. 1 is merely an example and is not limited to this. For example, the poster generation device 100 may not have the display 105 and may display the UI on an external display.

[0023] The poster creation application in this embodiment is stored in HDD 104. The poster creation application is started by the user performing an operation such as clicking or double-clicking the application icon displayed on display 105 with pointing device 107.

[0024] <Software block diagram> FIG. 2 is an example software block diagram of a poster creation application. The poster creation application includes a poster creation condition specification unit 201, a text specification unit 202, an image specification unit 203, a target impression specification unit 204, a poster display unit 205, a poster generation unit 210, and an operation mode specification unit 230. The poster generation unit 210 includes an image acquisition unit 211, an image analysis unit 212, a skeleton acquisition unit 213, a skeleton selection unit 214, a color scheme selection unit 215, a font selection unit 216, a layout unit 217, a poster impression estimation unit 218, a poster selection unit 219, a target impression setting control unit 220, an image impression estimation unit 221, and an image selection unit 222. FIG. 2 also shows a software block diagram particularly relating to the poster generation unit 210, which executes the automatic poster creation function.

[0025] When the poster creation application is installed in poster generation device 100, a startup icon is displayed on display 105 on the top screen (desktop) of the OS (operating system) running on poster generation device 100. When the startup icon is operated (e.g., double-clicked) with pointing device 107, the program of the poster creation application stored in HDD 104 is loaded into RAM 103 and executed by CPU 101. This starts the poster creation application.

[0026] The poster creation application described above includes program modules corresponding to the components shown in Fig. 2. CPU 101 executes each program module, causing CPU 101 to function as each component shown in Fig. 2. Hereinafter, each component shown in Fig. 2 will be described as executing various processes.

[0027] The operation mode designation unit 230 designates an operation mode in response to a UI operation performed by the pointing device 107. In this embodiment, there are two operation modes: a content-priority mode and an impression-priority mode. Details of each operation mode will be described later. The operation mode designation unit 230 outputs the designated operation mode to the poster generation unit 210.

[0028] The poster creation condition specification unit 201 specifies poster creation conditions to the poster generation unit 210 in response to UI operations using the pointing device 107. In this embodiment, the poster creation conditions include the poster size, the number of posters to be created, and a usage category. The poster size may be specified as actual dimensions of width and height, or a paper size such as A1 or A2. The usage category indicates the purpose of the poster, such as restaurant, school event, sale, or awareness campaign. The creation conditions specified by the poster creation condition specification unit 201 are input to the skeleton acquisition unit 213, skeleton selection unit 214, color scheme pattern selection unit 215, font selection unit 216, poster selection unit 219, and target impression setting control unit 220.

[0029] The text designation unit 202 accepts designation of character information to be placed on the poster by the user through UI operation using the keyboard 106. The character information to be placed on the poster represents, for example, character strings representing a title, date and time, location, etc. The text designation unit 202 also links each piece of character information with information (tag or attribute information) indicating the type of character information, such as whether it is a title, or information indicating a date and time or location, and outputs the information to the desired impression setting control unit 220, skeleton acquisition unit 213, and layout unit 217.

[0030] The image designation unit 203 accepts user designation of one or more image data to be arranged on a poster. The image data can be designated, for example, from image data stored in the HDD 104 based on the structure of a file system containing the image data, such as a device and a directory. The image data may also be designated based on associated information for identifying the image, such as the shooting date and time, or attribute information. The image designation unit 203 may also designate image data included in the poster creation application and provided as material (hereinafter also referred to as "application material image"). The image designation unit 203 may also designate image data held by an external image providing service linked to the poster creation application (hereinafter also referred to as "linked material image"). The image designation unit 203 may also designate image data generated by an image generation AI. A generation AI is a machine learning model that generates new data based on learned data, and an image generation AI is a generation AI that generates an image. Specifically, an image generation AI is an AI that can generate an image from an image or text using a diffusion model, a GAN model, or the like. The image designation unit 203 outputs the file path of the designated image to the image acquisition unit 211 .

[0031] The target impression specification unit 204 accepts a user's specification of a target impression for a poster to be created. The target impression is an impression that the poster to be created is ultimately required to retain, and is set so as to be given to people who view the created poster (production). In this embodiment, the intensity indicating the degree of impression to be given to a word expressing an impression is specified by a UI operation using the pointing device 107. Furthermore, in a content-priority mode described below, the range of target impressions that the user can specify using the target impression specification unit 204 is determined by the target impression setting control unit 220. Note that, before processing by the target impression setting control unit 220 is performed, a preset default range (reference range) is applied as the range of target impressions that can be specified. Information indicating the target impression specified by the target impression specification unit 204 is shared by the skeleton selection unit 214, the color scheme selection unit 215, the font selection unit 216, the image selection unit 222, and the poster selection unit 219. Details of impressions will be described later.

[0032] Poster generation unit 210 executes a poster generation process according to the operation mode designated by operation mode designation unit 230. The operation mode will be described later.

[0033] Next, the software configuration of the poster generator 210 will be described in detail.

[0034] The image acquisition unit 211 acquires one or more image data specified by the user in the image designation unit 203 from a specified acquisition source. The image acquisition unit 211 outputs the acquired image data to the image analysis unit 212 and the target impression setting control unit 220. The image acquisition unit 211 also outputs the number of acquired images to the skeleton acquisition unit 213. Image acquisition sources include the HDD 104, storage areas on a network, etc. Examples of acquired images include still images, frame images cut out from videos, stock images created in advance for this application or stock images provided by an image provision service, and images generated by a generation AI. The still images and frame images are acquired from an imaging device such as a digital camera or a smart device. The imaging device may be included in the poster generation device 100 or an external device. If the imaging device is an external device, the images are acquired via the data communication unit 108. As another example, the still images may be illustration images created using image editing software or CG images created using CG production software. The still images and cropped images may be images acquired from a network or a server via the data communication unit 108. Examples of images acquired from a network or a server include social networking service images (hereinafter referred to as "SNS images"), stock images, externally provided images, and images generated using generation AI. The program executed by the CPU 101 analyzes data attached to each image to determine the storage source. For example, SNS images may be acquired from an SNS via an application, and the acquisition source may be managed within the application. Note that the images are not limited to the above-described images, and other types of images may also be used.

[0035] The desired impression setting control unit 220 acquires range change setting information specified by the poster creation condition designation unit 201, character information specified by the text designation unit 202, and image data acquired by the image acquisition unit 211. The range change setting information is a parameter indicating how to control the designable range of the desired impression, and is set by the user in the poster creation condition designation unit 201. Setting of the range change setting information will be described later (FIG. 7).

[0036] 3 is a software block diagram of the desired impression setting control unit 220. As shown in FIG. 3, the desired impression setting control unit 220 includes a determination unit 301, a content impression estimation unit 302, a setting range determination unit 303, and a UI change unit 304.

[0037] The determination unit 301 determines whether to change the setting range of the target impression based on the range change setting information specified in the poster creation condition specification unit 201. If the determination unit 301 determines that the setting range of the target impression is to be changed, the setting range determination unit 303 determines the setting range, which is the range of the target impression that can be specified by the user, based on at least one of the acquired character information and image data.

[0038] In the process of determining the setting range of the desired impression, the set range determination unit 303 determines the setting range of the desired impression based on the impression of the image data acquired by the image acquisition unit 211 or the text designated by the text designation unit 202. The content impression estimation unit 302 estimates the impression of these contents (character information and image data) and outputs the estimation result to the set range determination unit 303. The content impression can be estimated using a trained model. The trained model for estimating the content impression is generated in the content impression quantification process described below.

[0039] If the determining unit 301 determines that the setting range of the desired impression should not be changed, the setting range determining unit 303 determines a predetermined reference range as the setting range of the desired impression.

[0040] The UI modification unit 304 changes or maintains the display form of the UI (operation object) that allows the user to set the desired impression so that the setting range of the desired impression coincides with the range determined by the setting range determination unit 303. In this embodiment, a slider is used as the operation object. The slider is an object that allows the user to specify a value by sliding a point on a bar that corresponds to a predetermined numerical range. If the desired impression includes multiple impression factors, a slider is displayed on the display for each of the multiple impression factors. Specific examples of UI display will be described later. The UI modification unit 304 outputs the changed UI to the desired impression specification unit 204.

[0041] Returning to the explanation of Fig. 2, the image analysis unit 212 performs an analysis process on the image data acquired from the image acquisition unit 211, and acquires information indicating image feature amounts. Specifically, the image analysis unit 212 performs an object recognition process, which will be described later, and acquires information indicating image feature amounts of the image data. The image analysis unit 212 also links the acquired information indicating the image feature amounts to the image data, and outputs the information to the layout unit 217 and the image impression estimation unit 221.

[0042] The skeleton acquisition unit 213 acquires, from the HDD 104, one or more skeletons that meet the conditions specified by the poster creation condition specification unit 201, the text specification unit 202, and the image acquisition unit 211. In this embodiment, a skeleton is information that indicates the arrangement of content (character strings and images) and figures, etc., to be arranged on a poster.

[0043] FIG. 4 is a diagram illustrating an example of a skeleton. Three graphic objects 402, 403, and 404, one image object 405, and four text objects 406, 407, 408, and 409, in which text is arranged, are arranged on a skeleton 401 in FIG. 4(a). Each object is recorded with metadata necessary for generating a poster, in addition to the position, size, and angle indicating the placement location. FIG. 4(b) is a diagram illustrating an example of metadata. For example, text objects 406 to 409 hold, as metadata attributes, the type of text information to be arranged. Here, text object 406 indicates that a title will be arranged, text object 407 indicates that a subtitle will be arranged, and text objects 407 and 408 indicate that the main text will be arranged. Furthermore, graphic objects 402 to 404 hold, as metadata attributes, color scheme numbers (color scheme IDs) indicating the shape and color scheme pattern of the graphic. Here, the attributes of graphic objects 402 and 403 indicate that they are rectangular, and the attribute of graphic object 404 indicates that they are elliptical. Also, assume that color scheme number 1 is assigned to graphic object 402, and color scheme number 2 is assigned to graphic objects 403 and 404. Here, the color scheme number is information referenced when assigning colors, which will be described later, and indicates that different colors are assigned to different color scheme numbers. Note that the types of objects and metadata are not limited to these. For example, there may be a map object for placing a map, or a barcode object for placing a QR code (registered trademark) or barcode. Furthermore, metadata for character objects may include metadata indicating the line spacing and character spacing. The metadata may include the purpose of the skeleton and be used to control whether or not to use the skeleton depending on the purpose.

[0044] The skeletons may be stored in HDD 104 in, for example, CSV format, or in a DB format such as SQL. Skeleton acquisition unit 213 outputs one or more skeletons acquired from HDD 104 to skeleton selection unit 214.

[0045] The skeleton selection unit 214 selects one or more skeletons that match the desired impression specified by the desired impression specification unit 204 from the skeletons acquired from the skeleton acquisition unit 213, and outputs them to the layout unit 217. Since the layout of the entire poster is determined by the skeleton, preparing various types of skeletons in advance can increase the variety of posters that can be generated.

[0046] Color scheme selection unit 215 obtains from HDD 104 one or more color schemes that match the desired impression specified by desired impression specification unit 204, and outputs them to layout unit 217. A color scheme is a combination of colors to be used in a poster.

[0047] FIG. 5 is a diagram showing an example of a color scheme table. In this embodiment, a color scheme pattern is expressed as a combination of four colors. The color scheme ID column in FIG. 5 is an ID for uniquely identifying a color scheme pattern. The color 1 to color 4 columns represent colors in RGB order, with each RGB color value ranging from 0 to 255 ((R, G, B) = (0 to 255, 0 to 255, 0 to 255)). Note that, although this embodiment uses a color scheme pattern consisting of a combination of four colors, other numbers of colors may be used, or multiple numbers of colors may be mixed.

[0048] Font selection unit 216 selects one or more font patterns that match the desired impression specified by desired impression specification unit 204, obtains them from HDD 104, and outputs them to layout unit 217. A font pattern is a combination of at least one of a title font, a subtitle font, and a body font.

[0049] The layout unit 217 generates one or more poster data items equal to or greater than the specified number of posters to be created by laying out various data items for each of the one or more skeletons obtained from the skeleton selection unit 214. The layout unit 217 arranges, for each skeleton, the text obtained from the text specification unit 202 and the image data obtained from the image analysis unit 212 or the image selection unit 222. The layout unit 217 also applies the color pattern obtained from the color pattern selection unit 215 and the font pattern obtained from the font selection unit. The layout unit 217 outputs the generated one or more poster data items to the poster impression estimation unit 218.

[0050] The poster impression estimation unit 218 estimates the impression of each piece of poster data among the multiple poster data acquired from the layout unit 217, and links the estimated impression (estimated impression) to each piece of poster data. Then, the poster impression estimation unit 218 outputs one or more pieces of poster data linked with the estimated impression to the poster selection unit 219.

[0051] The poster selection unit 219 compares the target impression specified by the target impression specification unit 204 with each estimated impression of the multiple poster data associated with an estimated impression obtained from the poster impression estimation unit 218, and selects poster data associated with an estimated impression that is close to the target impression. The poster selection unit 219 selects the number of posters to be created specified by the poster creation condition specification unit 201 or more. At this time, the poster selection unit 219 selects the number of posters to be created or more in ascending order of the value indicating the difference between the target impression and the estimated impression. The closeness between the target impression and the estimated impression is determined based on the difference in impression value for each impression factor. The selection result is saved in the HDD 104. The poster selection unit 219 outputs the selected poster data to the poster display unit 205.

[0052] The poster display unit 205 displays a poster image based on the poster data acquired from the poster selection unit 219 on the display 105. The poster image is, for example, bitmap data. Note that the poster generation unit 210 generates poster data for the number of posters specified by the poster creation condition specification unit 201 or more, and therefore, a list of previews of the poster images is displayed on the display 105. When the user clicks on a poster image with the pointing device 107, the poster image is selected.

[0053] The poster creation application may be provided with a function (not shown) that allows the user to edit the layout, color, shape, etc. of images, text, and graphics through additional operations after the generated result is displayed on the poster display unit 205, and further change the design to suit the user's needs. Also, if the application is provided with a function that prints the poster data stored in the HDD 104 using a printer according to the conditions specified in the poster creation condition specification unit 201, the user will be able to obtain a printed copy of the poster they have created.

[0054] The image impression estimation unit 221 and the image selection unit 222 are software blocks used in the impression priority mode, which will be described later. The image impression estimation unit 221 estimates the impression of one or more image data items acquired from the image analysis unit 212, and outputs the image data and the estimated impression to the image selection unit 222.

[0055] The image selection unit 222 is a software block used in the impression-priority mode, which will be described later. From one or more pieces of image data acquired from the image impression estimation unit 221, the image selection unit 222 selects one piece of image data in which the estimated impression associated with the image data is closest to the desired impression acquired from the desired impression designation unit 204, and outputs the selected piece to the layout unit 217. Note that the image selection unit 222 executes processing in the impression-priority mode, which is an operating mode intended to simplify user operations more than the content-priority mode. Therefore, limiting the number of images selected by the image selection unit 222 to one simplifies subsequent processing. However, multiple images may be selected depending on the creation conditions, such as when the user specifies multiple images to be used in a poster.

[0056] <Example of display screen> 6 is a diagram showing an example of a mode selection screen 601 provided by the poster creation application. The mode selection screen 601 is displayed on the display 105. The user sets an operation mode, which will be described later, via the mode selection screen 601.

[0057] The content-priority mode button 602 on the mode selection screen 601 is a button for setting the operating mode in the poster creation application to the content-priority mode. When the content-priority mode button 602 is pressed, a content setting screen 701 shown in FIG.

[0058] The impression-priority mode button 603 on the mode selection screen 601 is a button for setting the operating mode in the poster creation application to the impression-priority mode. When the impression-priority mode button 603 is pressed, a content setting screen for the impression-priority mode is displayed on the display 105. Note that the content setting screen for the impression-priority mode is displayed with the target impression range setting area 725 in FIG. 7 hidden or grayed out.

[0059] Fig. 7 shows an example of a content setting screen 701 provided by the poster creation application, and Fig. 8 shows an example of a creation condition setting screen 801. The content setting screen 701 and the creation condition setting screen 801 are displayed on the display 105. The user specifies the text and images, which are the content to be placed on the poster, the desired impression of the poster to be created, and the creation conditions of the poster (size, number to be created, and use category), via the content setting screen 701 and the creation condition setting screen 801. The poster creation condition specification unit 201, image specification unit 203, and text specification unit 202 acquire the contents specified by the user via these UI screens.

[0060] The content setting screen 701 is provided with a content input area 724 and a target impression range setting area 725 .

[0061] The title box 702, subtitle box 703, and main text box 704 in the content input area 724 accept user specification of text information to be placed on the poster. In this embodiment, three types of text information are accepted, but this is not limited to this. For example, additional text information such as location, date and time may also be accepted. Also, text information does not need to be entered in all boxes, and some boxes may be left blank.

[0062] The image designation area 705 in the content input area 724 is an area for designating an image to be placed on the poster. Image 706 represents a thumbnail of the designated image. The add image button 707 is a button for adding an image to be placed on the poster. When the add image button 707 is pressed by the user, the image designation unit 203 displays a dialog screen for selecting an image file and accepts the image file selection by the user. A thumbnail of the selected image is then added to the image designation area 705.

[0063] The target impression range setting area 725 is provided with check boxes 718 and 719 for the user to set range change setting information. As described above, the range change setting information is information that specifies how to determine the target impression setting range. In this embodiment, the user can specify either a "range suitable for the image," a "range suitable for the title," a range suitable for both the image and the title, or a default range.

[0064] Check box 718 is a box that can execute control to enable or disable the process of changing the setting range of the target impression to a range suitable for the image specified in image specification area 705. By pressing check box 718 to set on / off, the user can set whether to enable (on) or disable (off) the change to the setting range of the target impression suitable for the image.

[0065] Check box 719 is a box that can execute control to enable or disable the process of changing the target impression setting range to a range appropriate for the title specified in the title box 702. The user can enable (on) or disable (off) the change to the target impression setting range appropriate for the title by pressing check box 719 to set it on / off. In this embodiment, the change is made to suit the title among the text information, but this is not limited to this, and the change may also be made to suit the subtitle or main text. Furthermore, when both check box 718 and check box 719 are set to on, the change to the target impression setting range based on both the image and the title is enabled. On the other hand, when both check box 718 and check box 719 are set to off, the target impression setting range is not changed, and the default setting range is applied. In impression-priority mode, check boxes 718 and 719 are either unselectable or hidden, and the default setting range is always applied.

[0066] The reset button 720 is a button for resetting each setting information on the content setting screen 701 .

[0067] When the user presses the Next button 721, the displayed screen switches to the generation condition setting screen 801 of FIG. 8. Furthermore, the poster creation condition specification unit 201, the text specification unit 202, and the image specification unit 203 output the contents set on the content setting screen 701 to the poster generation unit 210. At that time, the poster creation condition specification unit 201 acquires range change setting information from the check boxes 718 and 719. The range change setting information is information indicating one of four states: "No change (default range)," "Image," "Text," and "Image and Text." The image specification unit 203 acquires the file path of the image to be placed on the poster from the image specification area 705. The text specification unit 202 acquires character information to be placed on the poster from the title box 702, subtitle box 703, and body box 704.

[0068] The impression sliders 808 to 811 on the generation condition setting screen 801 are operation objects that allow the user to set values ​​indicating the degree of each factor (hereinafter referred to as impression factor) of the target impression of the poster to be created. For example, the impression slider 808 is a slider that sets a value indicating the degree of the target impression related to the impression factor "luxury," and the target impression is set so that the more it is slid to the right, the more luxurious the poster will be, and the more it is slid to the left, the less luxurious (cheaper) the poster will be. Furthermore, by combining the target impression factors set by each slider, an overall target impression is set that reflects not only the impression factor set by one slider, but also the impression factors set by other sliders.

[0069] For example, if the impression slider 808 corresponding to the impression factor "luxury" is set to the right of the center, and the impression slider 811 corresponding to the impression factor "profoundness" is set to the left of the center, a poster with a high sense of luxury but low sense of profoundness, and an elegant impression, is generated. Alternatively, if the impression slider 808 corresponding to the impression factor "luxury" is set to the right of the center, and the impression slider 811 corresponding to the impression factor "profoundness" is set to the right of the center, a poster with a high sense of luxury and profoundness, and an elegant impression, is generated. In this way, by combining target impression factors indicated by multiple impression sliders, it is possible to set target impressions with different directionalities, such as a "refined" target impression and a "gorgeous" target impression, even if the common target impression factor of "luxury" is set.

[0070] In other words, the target impression is composed of and determined by multiple factors that indicate the impression, but it may also be determined by a single factor that indicates the impression. In this embodiment, the state in which the slider is set to the far left is set to -2, and the state in which it is set to the far right is set to +2, and the value indicating the impression is corrected to a value between -2 and +2. These numerical values ​​indicate that the impression is low (-2), slightly low (-1), neutral (0), slightly high (+1), and high (+2). Note that the purpose of correcting to -2 to +2 is to align the scale with the estimated impression to facilitate distance calculation, which will be described later, but this is not limiting and normalization using values ​​between 0 and 1 may also be used.

[0071] In this embodiment, the ranges that the user can operate with the impression sliders 808 to 811 are changed to the ranges determined by the target impression setting control unit 220 when at least one of the check boxes 718 and 719 is set to on. That is, the setting ranges for each impression factor of the target impression are changed so as to become setting ranges suitable for the images and text information used in the poster. In other words, the setting ranges of the impression sliders 808 to 811 are controlled to be different when a first content is specified and when a second content different from the first content is specified. The method by which the target impression setting control unit 220 determines the ranges of the target impression will be described later.

[0072] Radio buttons 812 are buttons that can control whether the settings of each impression factor are enabled or disabled. The user can enable or disable the setting of each impression factor by pressing the radio button 812 to set it to on / off. For example, if the user selects off using the radio button 812, that impression factor is excluded from impression control. For example, if the user wants to create a subdued poster with low dynamism but has no particular specifications for other impressions, the user can generate a poster that is specialized for low dynamism by turning off the radio buttons 812 other than dynamism. Note that FIG. 8 shows a state in which luxury and familiarity are set to on, and dynamism and profoundness are set to off. This enables highly flexible control, such as whether all impression factors or only some impression factors are used to generate a poster. Note that if the state in which each slider is set to the leftmost position is equivalent to a state in which the corresponding impression factor is not set, the radio button 812 may be omitted. In this case, the user can disable the setting of each target impression by setting each slider to the leftmost position.

[0073] The size list box 813 is a list box for setting the size of the poster to be created. By clicking with the pointing device 107, the user can display a list of poster sizes that can be created and select one. The number to create box 814 can set the number of posters to be created. The category list box 815 can set the purpose category of the poster to be created.

[0074] The back button 802 is a button for returning to the content setting screen 701. The reset button 816 is a button for resetting each setting information on the generation condition setting screen 801.

[0075] When the user presses the OK button 817, the poster creation condition specification unit 201 and the target impression specification unit 204 output the information set on the generation condition setting screen 801 to the poster creation unit 210. At this time, the poster creation condition specification unit 201 acquires the size of the poster to be created from the size list box 813, the number of posters to be created from the number of creations box 814, and the purpose category of the poster to be created from the category list box 815. The target impression specification unit 204 acquires the target impression of the poster to be created from the impression sliders 808 to 811 and the radio button 812. The poster creation condition specification unit 201, the text specification unit 202, the image specification unit 203, and the target impression specification unit 204 may process the values ​​set on the content setting screen 701. For example, the text specification unit 202 may remove unnecessary blank characters at the beginning or end of the input character information. The target impression specification unit 204 may also correct the target impression values ​​specified by the impression sliders 808 to 811.

[0076] 9 is a diagram showing an example of a poster preview screen 901 on which a poster image 902 generated by the poster display unit 205 is displayed on the display 105. When the OK button 817 on the generation condition setting screen 801 is pressed and poster generation is completed, the screen displayed on the display 105 transitions to the poster preview screen 901.

[0077] Poster image 902 is a poster image output by poster display unit 205. Poster generation unit 210 generates poster data in the number of pieces specified by poster creation condition specification unit 201 or more, and therefore displays a list of poster images 902 in the number corresponding to the generated poster data. When the user clicks on any of the poster images 902 with pointing device 107, the poster data corresponding to that poster image 902 is selected.

[0078] An edit button 903 is a button for transitioning to a function for editing the selected poster data. With the edit function, the poster data can be edited through a UI (not shown).

[0079] A print button 904 is a button for transitioning to a function for printing the selected poster data. With the print function, the poster data can be printed via a control UI of a printer (not shown).

[0080] <Quantifying the impression of posters> Here, the process of quantifying the impression of a poster (hereinafter referred to as the poster impression quantification process) will be described. The poster impression quantification process is a pre-processing required for executing the poster impression estimation process (S1512 in FIG. 15) described later. The poster impression estimation process is executed in the poster generation process (FIG. 15) described later.

[0081] The poster impression quantification process is performed by a vendor or the like who develops the poster creation application during the development stage of the poster creation application. The poster impression quantification process may be executed by the poster generation device 100, or may be executed by an information processing device different from the poster generation device 100. When executed by an information processing device different from the poster generation device 100, the process is executed by the CPU of that information processing device.

[0082] The poster impression quantification process quantifies the impressions people have of various posters. At the same time, a correspondence between the poster image and the poster impression is derived. This makes it possible to estimate the impression of the poster from the generated poster image. If the impression can be estimated, it becomes possible to control the impression of the poster by modifying the poster image, or to search for a poster image that has a certain target impression. The poster impression quantification process is performed, for example, by running an impression learning application in a poster generation device to learn the impression of the poster image in advance of the poster generation process.

[0083] Fig. 10 is a flowchart showing the poster impression quantification process. The flowchart shown in Fig. 10 is realized, for example, by CPU 101 reading a program stored in HDD 104 into RAM 103 and executing it. The poster impression quantification process will be described with reference to Fig. 10. Note that the symbol "S" in the description of each process indicates a step in the flowchart (the same applies hereinafter in this specification).

[0084] In S1001, CPU 101 acquires subjective evaluations of impressions of a poster. FIG. 11 illustrates an example of a method for subjectively evaluating impressions of a poster. CPU 101 presents a poster to a subject and acquires subjective evaluations of the impressions of the poster from the subject. Measurement methods such as the Semantic Differential (SD) method and the Likert scale can be used for this. FIG. 11 illustrates an example of a questionnaire using the SD method, in which adjective pairs expressing impressions are presented to multiple evaluators and scores are assigned to the adjective pairs evoked by the target poster. After acquiring subjective evaluation results for multiple posters from multiple subjects, CPU 101 calculates the average of the responses to each adjective pair and sets the average as a representative score for the corresponding adjective pair. Note that a subjective evaluation method other than the SD method may be used as long as words expressing impressions and corresponding scores are determined.

[0085] In S1002, CPU 101 performs a factor analysis of the subjective evaluation results acquired in S1001. If the subjective evaluation results are left as they are, the number of adjective pairs will increase the number of dimensions, making control complex. Therefore, it is desirable to reduce the number of dimensions to an efficient level using an analytical method such as principal component analysis or factor analysis. In this embodiment, the description will be given assuming that the dimensions have been reduced to four factors using factor analysis. Naturally, this number varies depending on the adjective pairs selected for the subjective evaluation and the factor analysis method. Furthermore, the output of the factor analysis is assumed to be standardized. That is, each factor is scaled so that the mean and variance of the poster used in the analysis are 0 and 1, respectively. This allows the impressions of -2, -1, 0, +1, and +2 specified by target impression specification unit 204 to directly correspond to -2σ, -1σ, the mean value, +1σ, and +2σ for each impression, facilitating the calculation of the distance between the target impression and the estimated impression, as described below. In this embodiment, the four factors shown in Fig. 8 are luxury, familiarity, dynamism, and stateliness, but these are names given for convenience in order to convey impressions to the user through the user interface, and each factor is composed of the interaction of multiple adjective pairs. CPU 101 also stores in HDD 104 a conversion formula (hereinafter referred to as "impression conversion formula") that converts the subjective evaluation results of each adjective pair into the value of each impression, obtained by factor analysis.

[0086] In S1003, the CPU 101 associates poster images with impressions. While it is possible to quantify posters that have been subjectively evaluated using the method described above, it is also necessary to estimate impressions for posters to be created in the future without subjective evaluation. The association between poster images and impressions can be achieved by learning a model that estimates impressions from poster images. Specifically, for example, deep learning methods such as Convolution Neural Network (CNN) or Visual Transformer (ViT), or machine learning methods using decision trees can be used. In this embodiment, the CPU 101 inputs a poster image and outputs four factors to perform supervised deep learning using CNN. That is, a deep learning model is created by learning the subjectively evaluated poster images and the corresponding impressions as correct answers, and an impression is estimated by inputting an unknown poster image into the learning model.

[0087] In S1004, the CPU 101 stores in the HDD 104 the model configuration and learned parameters of the deep learning model for impression estimation created in S1003.

[0088] The poster impression estimation unit 218 loads the deep learning model stored in the HDD 104 into the RAM 103 and executes it. The poster impression estimation unit 218 converts the poster data acquired from the layout unit 217 into an image, and estimates the impression of the poster by running the deep learning model loaded in the RAM 103 on the CPU 101 or the GPU 109. Note that, although a deep learning method is used in this embodiment, this is not limiting. For example, when using a machine learning method such as a decision tree, it is possible to extract feature amounts such as the average brightness value and edge amount of the poster image by image analysis, and create a machine learning model that estimates the impression based on the feature amounts.

[0089] <Quantifying content impressions> Next, with reference to FIG. 12, a process for quantifying the impression of content (hereinafter referred to as content impression quantification process) will be described. The content impression quantification process is a pre-processing for executing the content impression estimation process (S1602 in FIG. 16). The content impression estimation process is executed in the process for changing the setting range of the target impression in the poster generation process described below (S1503 in FIG. 15). The content impression quantification process is performed by a vendor or the like who develops the poster creation application at the development stage of the poster creation application. Note that the content impression quantification process may be executed by the poster generation device 100, or may be executed by an information processing device different from the poster generation device 100. Note that when executed by an information processing device different from the poster generation device 100, it is executed by the CPU of that information processing device.

[0090] The content impression quantification process derives a correspondence between the content itself and the impression of the content in a space where the impression of the poster is quantified. This makes it possible to find content that suits the impression of the poster you want to generate. The content impression quantification process is executed, for example, in a poster generation device by running an impression learning application to learn the impression of the content in advance of the poster generation process. Furthermore, the content impression quantification process must be executed after the poster impression quantification process because it uses the impression transformation formula acquired in the poster impression quantification process shown in Figure 10.

[0091] Fig. 12 is a flowchart showing the content impression quantification process. The flowchart shown in Fig. 12 is implemented, for example, by the CPU 101 reading a program stored in the HDD 104 into the RAM 103 and executing it. First, the image impression quantification process will be described with reference to Fig. 12(a).

[0092] In S1201, CPU 101 executes acquisition of subjective evaluations of impressions of images. The subjective evaluation may be performed using the same method as the subjective evaluation performed in quantifying impressions of posters. After acquiring subjective evaluation results from multiple subjects for multiple images, CPU 101 calculates the average value of the responses to each adjective pair and sets this average value as the representative score value for the corresponding adjective pair. Note that the subjective evaluation method for impressions may be other than the SD method, as long as words expressing impressions and corresponding scores are determined.

[0093] In S1202, the CPU 101 acquires from the HDD 104 the impression conversion formula obtained by the factor analysis performed in the poster impression quantification process, and applies it to the subjective evaluation results acquired in S1201 to acquire an impression value for each image. By applying the impression conversion formula obtained in the poster impression quantification, the impression of the image can be quantified on a dimension that has the same meaning as the impression of the poster.

[0094] In S1203, the CPU 101 associates images with impressions. While the above-described method can quantify images that have been subjectively evaluated, the poster generation process of this embodiment requires that impressions be estimated for unknown images without subjective evaluation. The association between images and impressions can be achieved by learning a model that estimates impressions from images. Specifically, for example, deep learning methods using Convolution Neural Network (CNN) or Visual Transformer (ViT), or machine learning methods using decision trees, can be used. In this embodiment, the CPU 101 performs supervised deep learning using CNN, taking images as input and four factors as output. That is, a deep learning model is created by learning the subjectively evaluated images and the corresponding impressions as correct answers, and an impression is estimated by inputting an unknown image into the learning model.

[0095] In S1204, the CPU 101 stores in the HDD 104 the model configuration and learned parameters of the deep learning model for impression estimation created in S1203.

[0096] Next, the text impression quantification process will be described with reference to FIG.

[0097] In S1211, CPU 101 acquires subjective evaluations of impressions of the text. The subjective evaluations may be performed using the same method as the subjective evaluations performed in quantifying impressions of the posters. After acquiring subjective evaluation results from multiple subjects for multiple texts, CPU 101 calculates the average of the responses to each adjective pair and sets the average as the representative score value for the corresponding adjective pair. Note that the subjective evaluation method for impressions may be other than the SD method, as long as words expressing impressions and their corresponding scores are determined.

[0098] In S1212, the CPU 101 obtains from the HDD 104 the impression conversion formula obtained by the factor analysis performed in the poster impression quantification, and applies it to the subjective evaluation results obtained in S1211 to obtain an impression value for each piece of text. By applying the impression conversion formula obtained in the poster impression quantification, the impression of the text can be quantified on a dimension that has the same meaning as the impression of the poster.

[0099] In S1213, CPU 101 associates text with impressions. While it is possible to quantify images that have been subjectively evaluated using the method described above, it is also necessary to estimate impressions for unknown text without subjective evaluation. Association between text and impressions can be achieved by training a model that estimates impressions from text, using, for example, a deep learning method using Transformer or a machine learning method using a decision tree. In this embodiment, CPU 101 inputs an image and performs supervised deep learning using Transformer, with four factors as output. That is, a deep learning model is created by learning the subjectively evaluated image and the corresponding impression as the correct answer, and an impression is estimated by inputting unknown text into the learning model.

[0100] In S1214, the CPU 101 stores in the HDD 104 the model configuration and learned parameters of the deep learning model for impression estimation created in S1213.

[0101] <Operation mode explanation> The differences in the process flow and the posters output in the content-first mode and impression-first mode, which are operating modes of the poster creation application, will be outlined with reference to Fig. 13. Note that Fig. 13 illustrates an example in which the content used in the poster is an image, but in this embodiment, text information such as a title can also be treated as content.

[0102] The content priority mode is a mode in which the UI for setting a target impression is changed so that a target impression appropriate for the content used in the poster is prioritized. As a processing flow, first, the poster creation application accepts designation of content 1301 to be used in the poster from the user. Next, the poster creation application determines a target impression setting range 1302 appropriate for the designated content 1301. After that, the poster creation application accepts a designation of a target impression by the user within the determined target impression setting range 1302. The designated target impression is indicated by reference numeral 1303 in the figure. The poster creation application uses the designated content 1301 to generate posters 1304 and 1305 having impressions close to the designated target impression 1303. Even when multiple patterns of posters are generated, the designated content 1301 is used for all of the posters.

[0103] The impression-priority mode is a mode in which content appropriate for a target impression specified by the user is automatically selected. In the processing flow, the poster creation application first accepts the user's specification of a target impression 1311. Next, the poster creation application accepts the user's specification of content candidates 1312 to be used in the poster. When specifying content candidates, the user inputs title candidates. For image candidates, the user may specify specific images, or may specify directories, tags, or application stock images themselves to specify images associated with them all at once. The poster creation application selects content 1313 appropriate for the specified target impression 1311 from the content candidates 1312. The poster creation application uses the selected content 1313 to generate posters 1314 and 1315 that have impressions similar to the target impression. When multiple patterns of posters are generated, different patterns of content may be used for each poster.

[0104] As described above, in the content-first mode, the process starts when the user specifies content, whereas in the impression-first mode, the process starts when the user specifies a target impression. Furthermore, in the content-first mode, the content specified by the user is reliably used in the poster generated, whereas in the impression-first mode, different content may be used in the poster generated depending on the target impression specified by the user. By selecting one of these operating modes, the user can execute the poster generation process in a production flow consistent with their intention.

[0105] <Operation mode switching process> 14 is a flowchart showing the operation mode switching process of the poster creation application, which starts when the poster creation application is started by a user operation.

[0106] The flowchart shown in Fig. 14 is realized, for example, by CPU 101 reading a program stored in HDD 104 into RAM 103 and executing it. In this embodiment, the components shown in Fig. 2 that function when CPU 101 executes the poster creation application will be described as executing the processes. The operation mode switching process will be described with reference to Fig. 14. Note that the symbol "S" in the description of each process indicates a step in the flowchart (the same applies hereinafter in this specification).

[0107] In S1401, the poster creation application displays the mode selection screen 601 on the display 105. The user uses the pointing device 107 to specify one of the operation modes displayed on the mode selection screen 601.

[0108] In S1402, the operation mode designation unit 230 acquires the operation mode designated on the mode selection screen 601.

[0109] In S1403, the operation mode designation unit 230 determines whether the operation mode acquired in S1402 is the content-priority mode or the impression-priority mode. If the operation mode is the content-priority mode, the process proceeds to S1404, and if the operation mode is the impression-priority mode, the process proceeds to S1405.

[0110] In S1404, the poster generation unit 210 executes the poster generation process in the content priority mode.

[0111] In S1405, the poster generation unit 210 executes the poster generation process in the impression-priority mode.

[0112] The above is the processing flow of the poster creation application. The poster generation process in the content-first mode executed in S1404 and the poster generation process in the impression-first mode executed in S1405 will be described in detail below.

[0113] <Poster generation process in content-first mode> FIG. 15 is a flowchart showing the poster generation process in the content-priority mode. The flowchart shown in FIG. 15 is started when the content-priority mode is selected in the operation mode switching process described above. The flowchart shown in FIG. 15 is realized, for example, by the CPU 101 reading a program stored in the HDD 104 into the RAM 103 and executing it. In this embodiment, the components shown in FIG. 2 that function when the CPU 101 executes the poster creation application will be described as executing the processes. Note that in the content-priority mode, the image impression estimation unit 221 and the image selection unit 222 in FIG. 2 are not used. The poster generation process in the content-priority mode will be described with reference to FIG. 15.

[0114] In S1501, the poster creation application displays the content setting screen 701 shown in FIG.

[0115] In S1502, the text designation unit 202 and the image designation unit 203 accept the user's designation of text and image for each setting item displayed on the content setting screen 701. The user inputs setting values ​​for each setting item using the keyboard 106 or the pointing device 107. The image acquisition unit 211 acquires image data. Specifically, the image acquisition unit 211 reads an image file from the acquisition destination (e.g., HDD 104) designated by the image designation unit 203 into the RAM 103. The CPU 101 also acquires the character information entered in the title box 702, subtitle box 703, and main text box 704.

[0116] In S1503, the desired impression setting control unit 220 executes processing to change the setting range of the desired impression that can be specified by the user based on the content (image, character information) acquired in S1502. In the processing to change the setting range of the desired impression, the desired impression setting control unit 220 determines the setting range of the desired impression according to the content (image, character information), and displays on the display 105 the generation condition setting screen 801 including a UI changed to the determined setting range.

[0117] <Processing to change the setting range of the target impression> Here, the process of changing the setting range of the desired impression executed in S1503 will be described in detail with reference to Fig. 16. Fig. 16 is a flowchart for explaining the process of S1503 in detail, and is executed by the determination unit 301, content impression estimation unit 302, setting range determination unit 303, and UI change unit 304 of the desired impression setting control unit 220 shown in Fig. 3.

[0118] In S1601, the determination unit 301 determines whether or not to change the setting range of the target impression based on the range change setting information acquired from the poster creation condition designation unit 201. The range change setting information is designated by the user via the check boxes 718, 719 in the target impression range setting area 725 on the content setting screen 701. If the range change setting information is "no change" (S1601; NO), the determination unit 301 transitions to S1605 with the setting range of the target impression maintained at the default setting range (reference range). In this embodiment, the default setting range (reference range) is a range of -2 or more and +2 or less for each impression. If the range change setting information is other than "no change" (S1601; YES), the process transitions to S1602.

[0119] In S1602, the content impression estimation unit 302 estimates the impression of the content using the trained model generated by the content impression quantification process shown in Fig. 12. At this time, if the range change setting information is "image" or "image and text", the content impression estimation unit 302 estimates the impression of the image data acquired by the image acquisition unit 211. Also, if the range change setting information is "text" or "image and text", the content impression estimation unit 302 estimates the impression of the title acquired by the text designation unit 202.

[0120] In S1603, the setting range determination unit 303 determines the setting range of the desired impression based on the impression of the content acquired in S1602. The setting range determination unit 303 determines the setting range of the desired impression so that the changed setting range is narrower than the default setting range (reference range) described above. The setting range determination unit 303 also determines the setting range of the desired impression so that the changed setting range is a range that includes the impression value estimated from the content. A setting range of the desired impression suitable for the content designated by the user is determined. As a result, the setting range (first range) determined when the designation of a first content is accepted differs from the setting range (second range) determined when the designation of a second content different from the first content is accepted.

[0121] In S1604, the UI change unit 304 changes the range that can be set by the impression sliders 808 to 811, which are UIs (operation objects) on the generation condition setting screen 801, based on the setting range of the desired impression determined in S1603.

[0122] Thereafter, in S1605, the desired impression setting control unit 220 displays the generation condition setting screen 801 including a UI (operation object) in which the setting range of the desired impression has been changed to the setting range determined in S1601 to S1604. When the processing of S1605 ends, this flowchart ends and the process proceeds to S1504 in FIG.

[0123] <Determining the range of the target impression> A method for determining the setting range of a desired impression will be described with reference to FIG. 17. FIG. 17 is a diagram showing the impression value of a content estimated in the content impression estimation process of S1602 and the setting range determined in S1603. FIG. 17 also shows the impression values ​​and setting ranges for the impression factors of luxury, familiarity, dynamism, and profoundness. Stars 1701 in FIG. 17 represent the impression value of a content estimated in the content impression estimation process of S1602, and dashed-line ranges 1702 represent the setting ranges. In this embodiment, the setting range determination unit 303 of the desired impression setting control unit 220 determines the setting range for each impression factor to be within a range of ±1, with the impression value of the content at the center. However, if the value obtained by adding +1 or −1 to the impression value exceeds the default setting range (reference range), the value is clipped to the default setting range (reference range). For example, in the example shown in FIG. 17(a), the impression values ​​of the content are −1.0 for luxury, +0.9 for familiarity, +1.2 for dynamism, and −1.5 for profoundness. In this case, the setting range obtained by S1603 is -2.0 to 0.0 for luxury, -0.1 to +1.9 for familiarity, +0.2 to +2.0 for dynamism (clipped at the upper limit), and -2.0 to -0.5 for solidity (clipped at the lower limit). Note that the default setting range is -2.0 to +2.0.

[0124] Note that the method for determining the setting range is not limited to this. For example, CPU 101 may perform clustering on the impression values ​​acquired in the content impression quantification process, save the value range of each cluster, and setting range determination unit 303 may set the value range of the cluster including the impression value acquired in S1602 as the setting range. Alternatively, CPU 101 may acquire the results of a subjective evaluation experiment that identifies a range in which a plurality of pieces of content appear to have the same impression, and setting range determination unit 303 may determine the setting range based on the acquired results of the subjective evaluation experiment. In any case, the method for determining the setting range is arbitrary as long as the changed setting range is narrower than the setting range (reference range) of the target impression when the range change setting information is "no change" and is determined to be a range that includes the impression value estimated from the content.

[0125] In the example of FIG. 17(a), the setting range for each impression factor is set to a range of "impression value ±1" centered on the impression value of the content. However, it is not necessary to set new setting ranges for all impression factors. For example, the setting range for a characteristic impression factor in the impression of the content may be fixed to one point, and a default setting range (reference range) may be used for other impression factors. A characteristic impression factor may be determined, for example, by an impression factor whose absolute value of the impression value is equal to or greater than a predetermined threshold. An example of this is shown in FIG. 17(b). If the impression values ​​of the content are -1.0 for luxury, +0.9 for familiarity, +1.2 for dynamism, and -1.5 for profoundness, and the predetermined threshold is 1.2, in S1603, the setting range determination unit 303 determines dynamism and profoundness as characteristic impression factors. Furthermore, the setting range for dynamism is fixed at +1.2, the setting range for profoundness is fixed at -1.5, and the setting range for luxury and familiarity is set to the normal setting range of -2.0 or more and +2.0 or less, thereby determining the target impression setting range.

[0126] Alternatively, the characteristic impression factor may be determined by the impression factor with the largest absolute value among the impression factors of the content. An example of this is shown in FIG. 17(c). Assume that the impression values ​​of the content are luxury -1.0, familiarity +0.9, dynamism +1.2, and profoundness -1.5. In this case, in S1603, the setting range determination unit 303 determines profoundness, which is the impression factor with the largest absolute value, as the characteristic impression factor. Then, the setting range for dynamism is fixed at -1.5, and the setting ranges for luxury, familiarity, and dynamism are determined to be the normal setting ranges of -2.0 or more and +2.0 or less, respectively.

[0127] Alternatively, the setting range of the characteristic impression factor may be fixed to one point, and the setting range for the other impression factors may be set within a range of ±1 around the impression value of the content.

[0128] In this way, it is possible to determine the setting range of the target impression that is appropriate for the impression of the content by fixing the setting range of the target impression to one point for the characteristic impression factor determined based on the impression estimated from the content.

[0129] Furthermore, if impressions for multiple images or impressions for both images and text are estimated in the content impression estimation process of S1602, impression values ​​are acquired for each of these multiple pieces of content, as shown in FIG. 17(d). When impression values ​​for multiple pieces of content are acquired, the setting range determination unit 303 calculates the average value of the impression values ​​for all pieces of content for each impression factor and sets this average value as the representative impression value for all pieces of content. The setting range can then be determined using the methods shown in FIGS. 17(a) to 17(c). Note that in the example of FIG. 17(d), the representative impression value is the average value of the impression values ​​for all pieces of content, but this is not limiting. For example, as shown in FIG. 17(e), the setting range determination unit 303 determines a setting range for each impression factor for the impression values ​​of each piece of content acquired in the content impression estimation process of S1602 using the methods shown in FIGS. 17(a) to 17(c). The setting range determination unit 303 may then determine the union range of all pieces of content within the determined setting range as the setting range. In this case, it is possible to determine a setting range within which a target impression suited to the impression of at least one of the contents can be set.

[0130] 17(f), the setting range determination unit 303 determines a setting range for each impression factor for the impression value of each piece of content acquired in the content impression estimation process of S1602 using the methods of FIGS. 17(a) to 17(c). The setting range determination unit 303 may then set the intersection range of all pieces of content for the determined setting range as the setting range. In this case, the range of impressions common to all pieces of content can be set as the setting range. In this case, a situation may arise in which no intersection range exists, resulting in an output of "no setting range" in S1603. How to handle a case in which no setting range exists will be described later. Furthermore, when multiple images are specified, the first image specified initially may be set as a representative image, and the setting range may be determined using only the impression of the representative image using the methods of FIGS. 17(a) to 17(c).

[0131] <UI changes according to the target impression setting range> Next, a description will be given of UI changes (S1604) according to the setting range of the target impression, with reference to Fig. 18. Fig. 18 is a diagram showing an example of changes to the impression sliders 808 to 811 displayed on the generation condition setting screen 801 of Fig. 8. As shown in Fig. 18(a), an impression slider 1800 is provided with a handle 1802 that can be moved along a bar 1801. Also, a scale 1803 is displayed on the bar 1801, and the upper and lower limit values ​​of the scale 1803 are set according to the setting range.

[0132] The impression slider 1800 having the normal (default) setting range (reference range) shown in Figure 18(a) indicates that when the handle 1802 is set to the far left, the lower limit is -2, and when it is set to the far right, the upper limit is +2.

[0133] In the examples shown in FIGS. 18(a) and 18(b), the UI modification unit 304 sets the target impression value when the handle 1802 is set to the leftmost position to the lower limit of the setting range, and sets the target impression value when the handle 1802 is set to the rightmost position to the upper limit of the setting range. For example, FIG. 18(b) shows the impression slider 1804 when the impression value of dynamism estimated from the content is +1.2 and the setting range of dynamism is +0.2 or more and +2.0 or less. The UI modification unit 304 sets the target impression value when the handle 1802 is set to the leftmost position to +0.2, and sets the target impression value when the handle 1802 is set to the rightmost position to +2.0. The target impression value specified by the scale 1805 of the impression slider 1804 and the handle 1802 is determined by calculating the ratio between the values ​​set at the left and right ends. In this case, the UI modification unit 304 may set the initial position of the handle 1802 to a position corresponding to the impression value of the content.

[0134] Note that the method of changing the UI according to the setting range is not limited to this. As shown in Fig. 18(c), the UI changing unit 304 may leave the scale 1803 of the impression slider 1806 in the default range (reference range) and limit the movable range of the handle 1802 to the setting range determined by the setting range determining unit 303. In this case, the UI changing unit 304 may clearly indicate on the impression slider an area outside the setting range, such as a gray area 1807 shown in Fig. 18(c), and may control so that the handle 1802 cannot be moved into an area outside the setting range. Furthermore, the UI changing unit 304 may set the initial position of the slider to a position corresponding to the impression value of the content.

[0135] Furthermore, as another example, if there is an impression factor that is fixed to one point in the setting range determined by the setting range determination unit 303, the UI changing unit 304 may make the impression slider 1808 corresponding to the fixed impression factor inoperable, as shown in Fig. 18(d). In the example of Fig. 18(d), the position of the handle 1802 is fixed to a position that corresponds to the impression value of the content, and positions other than that are indicated by a gray area 1809.

[0136] Furthermore, the desired impression setting control unit 220 may display a warning screen (not shown) when the user specifies a value outside the setting range determined by the setting range determination unit 303. The warning screen may display a message that the desired impression value specified by the user is not suitable for the content, and may prompt the user to re-specify the desired impression.

[0137] As described above, in the example of Figures 18(a) to (d) of this embodiment, the setting range of the desired impression is displayed on the generation condition setting screen 801, so that the user can recognize the range of the desired impression that can be specified (set). Furthermore, the UI change unit 304 may set radio buttons 812 provided near the slider to on / off according to the setting range determined by the setting range determination unit 303, without changing the operable range of the slider from the default range (reference range). For example, if the setting range of a certain impression factor in the setting range of the target impression determined by the setting range determination unit 303 is wider than a predetermined range, the radio button 812 for that impression factor may be set to off, and the radio buttons 812 for the other impression factors may be set to on. This is because if the setting range of the target impression is too wide, there may be suitable content no matter what target impression value the user specifies, which may result in a problem in which content cannot be selected in the poster generation process. Note that a setting range wider than the predetermined range means, in other words, that the difference between the upper and lower limit values ​​of the setting range is equal to or greater than a predetermined threshold.

[0138] 17(f) , when the intersection range of the set ranges of multiple contents is determined as the set range of the desired impression, if the intersection range does not exist, the result is output as "no set range" in S1603. In this case, the UI change unit 304 may display a warning screen (not shown) to notify the user that there is no appropriate range of desired impression common to the multiple specified contents. It is also preferable that this warning screen prompts the user to specify another content on the content setting screen 701.

[0139] The above is a description of the process for changing the setting range of the desired impression. Returning to the description of FIG.

[0140] By the processes of S1501 to S1503 described above, the setting range of the desired impression suited to the content designated by the user is determined, and the generation condition setting screen 801 is displayed with the operable range of the UI (operable object) changed.

[0141] In S1504, the poster creation condition specification unit 201 and the target impression specification unit 204 acquire the corresponding settings from the creation condition setting screen 801. That is, the poster creation condition specification unit 201 acquires the poster size, number of posters to be created, and usage category designated by the user. The target impression specification unit 204 acquires the target impression designated by the user.

[0142] In S1505, the number of selections is determined so that posters can be generated according to the number of creations specified in the poster creation condition specification unit 201. That is, the skeleton selection unit 214 determines the number of skeletons to select, the color scheme pattern selection unit 215 determines the number of color scheme patterns to select, and the font selection unit 216 determines the number of fonts to select. In this embodiment, the layout unit 217 generates poster data equal to the number of skeletons x the number of color scheme patterns x the number of fonts. The skeleton selection unit 214, the color scheme pattern selection unit 215, and the font selection unit 216 determine the number of skeletons, the number of color scheme patterns, and the number of fonts to select so that the number of posters to be generated is equal to or greater than the number of creations specified in the poster creation condition specification unit 201. For example, the number of skeletons, the number of color scheme patterns, and the number of fonts can each be determined according to the following equation 1.

[0143]

number

[0144] For example, if the number of creations is 6, the number of selections is 3, and the layout unit 217 generates 27 pieces of poster data, of which the poster selection unit 219 selects 6 pieces of poster data. This allows the poster selection unit 219 to select posters whose overall impression more closely matches the target impression from among the poster data generated in excess of the number of creations. Note that the method for determining the number of selections is not limited to this, and other methods may also be used. The number of selections may also be a fixed value.

[0145] In S1506, the image analysis unit 212 performs an analysis process on the image data acquired in S1502 to acquire information indicating feature amounts related to the image. Examples of information indicating feature amounts include meta information stored in the image and information indicating image feature amounts that can be acquired by analyzing the image. This information is used in object recognition processing, which is an analysis process. Note that in this embodiment, object recognition processing is executed as the analysis process, but this is not limited to this, and other analysis processes may also be executed. Furthermore, the process of S1506 may be omitted. Below, details of the process performed by the image analysis unit 212 in S1506 will be described.

[0146] The image analysis unit 212 executes object (material) recognition processing on the image acquired in S1502. Here, a known method can be used for the object recognition processing. In this embodiment, objects are recognized by a classifier created by Deep Learning. The classifier outputs the likelihood of a pixel constituting the image being a pixel constituting each object as a value between 0 and 1, and recognizes that an object exceeding a certain threshold is present in the image. By recognizing the object image, the image analysis unit 212 can acquire the type and position of objects such as faces, pets such as dogs or cats, flowers, food, buildings, ornaments, and landmarks.

[0147] In S1507, the skeleton acquisition unit 213 acquires skeletons that meet the various set conditions. In this embodiment, it is assumed that each skeleton is described in one file and stored in the HDD 104. The skeleton acquisition unit 213 sequentially reads skeleton files from the HDD 104 to the RAM 103, leaves skeletons that meet the set conditions on the RAM 103, and deletes skeletons that do not meet the conditions from the RAM 103. Figure 15(b) is a flowchart of the condition determination process performed by the skeleton acquisition unit 213 in S1507. The condition determination process performed by the skeleton acquisition unit 213 will be described with reference to Figure 15(b).

[0148] In S1521, skeleton acquisition unit 213 determines whether the skeleton size matches the poster size specified by poster creation condition specification unit 201 for the skeleton read into RAM 103. Note that although it is confirmed that the sizes match here, it is also sufficient that the aspect ratios match. In this case, skeleton acquisition unit 213 acquires a skeleton that matches the poster size specified by poster creation condition specification unit 201 by enlarging or reducing the coordinate system of the read skeleton.

[0149] In S1522, the skeleton acquisition unit 213 determines whether the use category specified in the poster creation condition specification unit 201 matches the skeleton category. For skeletons that are used only for specific purposes, the use category is written in the skeleton file, and the skeleton is not acquired unless the corresponding use category is selected. This prevents a skeleton that is designed specifically for a specific purpose, such as one that uses graphics to evoke a school or a sporting goods pattern, from being used in other use categories. Note that if no use category is set on the generation condition setting screen 801, S1522 is skipped.

[0150] In S1523, skeleton acquisition unit 213 determines whether the number of image objects of the loaded skeleton matches the number of images acquired by image acquisition unit 211. If the number of image objects of the loaded skeleton matches the number of images acquired by image acquisition unit 211, the skeleton is left in RAM 103;

[0151] In S1524, the skeleton acquisition unit 213 determines whether the character object of the loaded skeleton matches the character information specified in the text designation unit 202. More specifically, it determines whether the type of character information specified in the text designation unit 202 is present in the skeleton. For example, assume that character strings are specified in the title box 702 and the body box 704 on the content setting screen 701, and that a blank is specified in the subtitle box 703. In this case, all character objects in the skeleton are searched, and if both a character object with "title" set as the type of character information in the metadata and a character object with "body" specified are found, the skeleton is deemed to be suitable; otherwise, it is deemed to be unsuitable. If the character object of the loaded skeleton matches the character information specified in the text designation unit 202, the skeleton acquisition unit 213 leaves the skeleton in RAM 103; if they do not match, the skeleton is deleted from RAM 103.

[0152] As described above, the skeleton acquisition unit 213 stores in RAM 103 skeletons whose skeleton size, usage category, number of image objects, and type of text object all match the conditions set on the generation condition setting screen 801. In this embodiment, the skeleton acquisition unit 213 examines all skeleton files on HDD 104, but this is not limiting. For example, the poster creation application may store in advance in HDD 104 a database that associates the file paths of skeleton files with search conditions (skeleton size, number of image objects, and type of text object). In this case, the skeleton acquisition unit 213 can quickly acquire skeleton files by reading only those skeleton files that match the results of a search in the database from HDD 104 into RAM 103. Return to FIG. 15(a).

[0153] In S1508, the skeleton selection unit 214 selects a skeleton from the skeletons acquired in S1507 that matches the target impression specified by the target impression designation unit 204. FIG. 19 is a diagram illustrating a method for the skeleton selection unit 214 to select a skeleton. FIG. 19(a) is a diagram illustrating an example of a table linking skeletons to impressions. The skeleton name column in FIG. 19(a) lists the skeleton file names, and the luxury, familiarity, dynamism, and profoundness columns represent numbers (numeric values) indicating the degree to which each skeleton influences each impression factor. These numerical values ​​indicate the impression, with -2 indicating low, -1 indicating slightly low, 0 indicating neither, +1 indicating slightly high, and +2 indicating high, respectively. First, the skeleton selection unit 214 calculates the distance between the target impression acquired from the target impression designation unit 204 and the impression of each skeleton shown in the skeleton impression table in FIG. 19(a). For example, if the target impression is "luxury +1, familiarity -1, dynamism -2, and profoundness +2," the distance calculated by the skeleton selection unit 214 will be as shown in FIG. 19(b). In this embodiment, Euclidean distance is used as the distance (hereinafter, simple distance will be referred to as Euclidean distance). The smaller the value indicated by the Euclidean distance, the closer the target impression and the impression of the skeleton are. Next, the skeleton selection unit 214 selects the top N selection number of skeletons with the smallest distance values ​​in FIG. 19(b). In this embodiment, the skeleton selection unit 214 selects the top two skeletons. That is, the skeleton selection unit 214 selects skeleton 1 and skeleton 4.

[0154] The value of N is determined by the conditions specified in the poster creation condition specification unit 201. When it is a variable value, the selection number N may be determined using the above-mentioned formula 1, or may be determined by some other method. For example, if the number of creations is specified as 6 in the creation number box 814 on the creation condition setting screen 801, the poster generation unit 210 generates six posters. The layout unit 217, which will be described later, generates a poster by combining skeletons, color patterns, and fonts selected in the skeleton selection unit 214, color pattern selection unit 215, and font selection unit 216. Therefore, for example, by selecting two skeletons, two color patterns, and two fonts, 2 × 2 × 2 = 8 posters can be generated, thereby satisfying the condition of 6 posters.

[0155] Furthermore, the value range of each impression in the skeleton impression table of FIG. 19(a) does not need to be the same as the value range of the impression specified by the target impression specifying unit 204. In this embodiment, the value range of the impression specified by the target impression specifying unit 204 is -2 to +2, but the value range of the impression in the skeleton impression table may be different from this. In this case, the value range of the skeleton impression table is scaled to match the value range of the target impression before the distance calculation is performed. Furthermore, the distance calculated by the skeleton selecting unit 214 is not limited to Euclidean distance, and any method that can calculate the distance between vectors, such as Manhattan distance or cosine similarity, may be used. Furthermore, impression factors set to off using the radio button 812 are excluded from the distance calculation.

[0156] The skeleton impression table is created in advance by estimating the impression of a poster image generated based on each skeleton, for example, by fixing the color scheme, font, and image and text data to be placed on the skeleton, and then saving it on HDD 104. That is, by estimating the impression of each poster image that uses the same text color and image, but has a different text and image arrangement, the relative characteristics compared to other skeletons are tabulated. In this process, it is desirable to cancel the impression due to the color scheme, image, etc. used, by standardizing the overall estimated impression or averaging the impressions of multiple poster images generated from a single skeleton using multiple color schemes and images. This allows the table to show, for example, how the impression of a skeleton with a small image is determined by elements such as graphics and text, regardless of the image, or how tilted image or text arrangement creates a stronger sense of dynamism.

[0157] FIG. 19(c) is an example of a skeleton corresponding to Skeleton 1 to Skeleton 4 in FIG. 19(a). For example, Skeleton 1 has image objects and text objects arranged in a regular pattern and a small image area, resulting in a low sense of dynamism. Skeleton 2 has circular graphic objects and image objects, resulting in a high sense of familiarity and a low sense of solidity. Skeleton 3 has large image objects and tilted graphic objects placed on top of the image objects, resulting in a high sense of dynamism. Skeleton 4 has images placed across the entire skeleton and minimizes text objects, resulting in a high sense of solidity and a low sense of dynamism. In this way, when a poster image includes text or images, poster images with different target impressions are generated depending on how the text or images are arranged. Note that the method of creating a skeleton impression table is not limited to this; it may be estimated from the characteristics of the arrangement information itself, such as the area and coordinates of the image and title string, or it may be adjusted manually. The skeleton impression table is stored in the HDD 104, and the skeleton selection unit 214 reads the skeleton impression table from the HDD 104 into the RAM 103 and refers to it.

[0158] In S1509, color scheme selection unit 215 selects a color scheme that matches the target impression specified by target impression specification unit 204. Using the same method as in S1507, color scheme selection unit 215 references the impression table corresponding to the color scheme and selects a color scheme according to the target impression. FIG. 20(a) shows an example of a color scheme impression table that links color scheme patterns with impressions. Color scheme selection unit 215 calculates the distance between the impressions indicated by the columns for luxury to dignity in FIG. 20(a) and the target impression, and selects the top N color scheme patterns with the smallest distance values. In this embodiment, the top two color scheme patterns are selected. Note that, like the skeleton impression table, the color scheme impression table can tabulate the impression trends of color scheme patterns by creating and estimating impressions of posters with different color scheme patterns while fixing the skeleton, font, and images other than the color scheme pattern.

[0159] In S1510, the font selection unit 216 selects a font combination that matches the target impression specified by the target impression specification unit 204. The font selection unit 216 references the impression table corresponding to the font and selects a font according to the target impression in the same manner as in S1507. FIG. 20(b) shows an example of a font impression table that links fonts with impressions. The font selection unit 216 calculates the distance value between the impression indicated by the columns for luxury to dignity in FIG. 20(b) and the target impression, and selects the top N fonts with the smallest distance values, as many as the number of selections. Note that, like the skeleton impression table, the font impression table can tabulate the tendency of font impressions by creating and estimating impressions of posters with different fonts after fixing the skeleton, color pattern, and image other than the font.

[0160] In S1511, the layout unit 217 sets character information, images, color schemes, and fonts for the skeleton selected by the skeleton selection unit 214, and generates a poster.

[0161] Next, the processing of S1511 and the software configuration of the layout unit 217 will be described in detail with reference to FIGS. 21, 22, 23 and 24. FIG.

[0162] 21 is an example of a software block diagram illustrating in detail the layout unit 217. The layout unit 217 includes a color allocation unit 2101, an image layout unit 2102, an image correction unit 2103, a font setting unit 2104, a text layout unit 2105, and a text decoration unit 2106.

[0163] Fig. 22 is a flowchart for explaining the layout processing of S1511 in detail. Fig. 23 is a diagram for explaining the information input to the layout unit 217. Fig. 23(a) is a table summarizing the character information specified in the text specification unit 202 and the image 2301 specified in the image specification unit 203. Fig. 23(b) is an example of a table showing the color scheme patterns acquired from the color scheme pattern selection unit 215, and Fig. 23(c) is an example of a table showing the fonts acquired from the font selection unit 216. Fig. 24 is a diagram for explaining the processing steps of the layout unit 217.

[0164] First, the layout process in S1511 will be described in detail with reference to FIG.

[0165] In S2201, the layout unit 217 lists all combinations of skeletons obtained from the skeleton selection unit 214, color patterns obtained from the color pattern selection unit 215, and fonts obtained from the font selection unit 216. The layout unit 217 generates poster data for each combination in turn by performing layout processing from S2202 onwards. For example, if the number of skeletons obtained from the skeleton selection unit 214 is 3, the number of color patterns obtained from the color pattern selection unit 215 is 2, and the number of fonts obtained from the font selection unit 216 is 2, the layout unit 217 generates 3 x 2 x 2 = 12 pieces of poster data. Next, in S2201, the layout unit 217 selects one of the listed combinations and executes the processes of S2202 to S2207.

[0166] In S2202, the color scheme assignment unit 2101 assigns the color scheme pattern acquired from the color scheme pattern selection unit 215 to the skeleton acquired from the skeleton selection unit 214. Fig. 24(a) is a diagram showing an example of a skeleton. In this embodiment, an example will be described in which a color scheme pattern when the color scheme ID in Fig. 23(b) is 1 is assigned to the skeleton 2401 in Fig. 24(a). The skeleton 2401 in Fig. 24(a) is made up of two graphic objects 2402 and 2403, one image object 2404, and three text objects 2405, 2406, and 2407. First, the color scheme assignment unit 2101 assigns colors to the graphic objects 2402 and 2403. Specifically, based on the color scheme number, which is metadata written in the graphic object, the color scheme assignment unit 2101 assigns a corresponding color from the color scheme pattern. Next, the color scheme assignment unit 2101 selects a character object (Text<type=Title> ), for example, the last color in the color scheme pattern is assigned to the character placed in character object 2405. That is, in this embodiment, color 4 is assigned to the character placed in character object 2405. Next, for the character placed in character objects 2406 and 2407 whose metadata is type and whose attribute is other than "title", the character color is set based on the brightness of the background of the character object. In this embodiment, if the brightness of the background of the character object is equal to or lower than a threshold, the character color is set to white, and if not, the character color is set to black. Figure 24(b) is a diagram showing the state of a skeleton 2408 after the above color scheme assignment process has been performed. The color scheme assignment unit 2101 outputs the colored skeleton data 2408 to the image arrangement unit 2102.

[0167] In S2203, the image arrangement unit 2102 arranges the image data acquired from the image analysis unit 212 in the skeleton data 2408 acquired from the color scheme assignment unit 2101 based on the accompanying analysis information. In this embodiment, the image arrangement unit 2102 assigns the image data 2301 to the image object 2404 in the skeleton. Furthermore, if the aspect ratios of the image object 2404 and the image data 2301 differ, the image arrangement unit 2102 performs trimming so that the aspect ratio of the image data 2301 matches the aspect ratio of the image object 2404. More specifically, based on the object position obtained by the image analysis unit 212 analyzing the image data 2301, trimming is performed so that the object area reduced by trimming is minimized. Note that the trimming method is not limited to this, and other trimming methods may be used, such as trimming the center of the image or devising a composition so that the face position forms a triangular composition. The image placement unit 2102 outputs the skeleton data to which the images have been assigned to the image correction unit 2103 .

[0168] In S2204, the image correction unit 2103 obtains skeleton data with images assigned from the image placement unit 2102 and corrects the images placed on the skeleton. In this embodiment, if the image resolution is insufficient, upsampling processing is performed using super-resolution processing. First, the image correction unit 2103 determines whether the image placed on the skeleton meets a certain resolution. For example, assume that an image of 1600px x 1200px is assigned to a 200mm x 150mm area on the skeleton. In this case, the print resolution of the image can be calculated using Equation 2.

[0169]

number

[0170] Next, if the image print resolution is determined to be less than the threshold, the image correction unit 2103 increases the resolution through super-resolution processing. On the other hand, if the image print resolution is determined to be equal to or greater than the threshold and has sufficient resolution, no image correction is performed. In this embodiment, super-resolution processing is performed when the image print resolution is less than 300 dpi.

[0171] In S2205, the font setting unit 2104 sets the font acquired from the font selection unit 216 to the image-corrected skeleton data acquired from the image correction unit 2103. FIG. 23C shows an example of a font combination selected by the font selection unit 216. In this embodiment, an example of font assignment will be described in which the font ID "2" in FIG. 23C is assigned to the image-corrected skeleton data. In this embodiment, fonts are set for character objects 2405, 2406, and 2407 of the skeleton 2408. Note that in posters, a font that is easy to see is often set for the title from the perspective of eye-catchingness, and a font that is easy to read from the perspective of visibility is set for other characters. Therefore, in this embodiment, the font selection unit 216 selects two types of fonts: a title font and a body font. The font setting unit 2104 sets the title font to the character object 2405 whose attribute is "title," and sets the body font to the other character objects 2406 and 2407. The font setting unit 2104 outputs the skeleton data with the font set to the text layout unit 2105. While the font selection unit 216 selected two types of fonts in this embodiment, this is not limiting and, for example, only the title font may be selected. In this case, the font setting unit 2104 uses a font corresponding to the title font as the body font. That is, if the title is a Gothic font, a typical Gothic font with high readability should be selected for the rest of the text, and if the title is a Mincho font, a typical Mincho font should be selected for the rest of the text. Naturally, the title font and the body font may be the same. Alternatively, different fonts may be used depending on the degree of prominence desired, such as using a title font for the title and subtitle character objects and a body font for other character objects, or using a title font for a certain font size or larger.

[0172] In S2206, the text layout unit 2105 lays out the text specified by the text designation unit 202 in the skeleton data with font settings obtained from the font setting unit 2104. In this embodiment, each piece of text shown in FIG. 23(a) is assigned by referring to the metadata attributes of the character objects of the skeleton. That is, "Summer Big Thank You Sale," whose attribute is the title, is assigned to character object 2405, and "Blow Away the Midsummer Heat," whose attribute is the subtitle, is assigned to character object 2406. Since no text is set, nothing is assigned to character object 2407. FIG. 24(c) shows skeleton 2409, which is an example of skeleton data after processing by the text layout unit 2105. The text layout unit 2105 outputs the skeleton data 2409 with text layout to the text decoration unit 2106.

[0173] In S2207, the text decoration unit 2106 decorates the character objects in the skeleton with text already placed, obtained from the text placement unit 2105. In this embodiment, if the color difference between the title character and its background area is equal to or less than a threshold, a process of bordering the title character is performed. This improves the readability of the title. The text decoration unit 2106 outputs the decorated skeleton data, i.e., the poster data for which the layout has been completed, to the poster impression estimation unit 218.

[0174] In S2208, the layout unit 217 determines whether poster data has been generated for all combinations. If the layout unit 217 determines that poster data has been generated for all combinations of skeletons, color patterns, and fonts, it ends the layout process and proceeds to S1512. If it determines that not all poster data has been generated, it returns to S2201 and generates poster data for combinations that have not yet been generated.

[0175] The layout process in step S1511 has been described above. Returning to the description of FIG.

[0176] In S1512, the poster impression estimation unit 218 performs rendering processing on each poster data acquired from the layout unit 217, estimates the impression of the rendered poster image, and associates the estimated impression with the poster data. The rendering processing is a process of converting poster data into image data. For example, even if the color scheme is the same, the layout will change if the skeleton is different, and the actual area in which each color is used will differ. Therefore, this processing is performed at this timing because it is necessary to evaluate the impression of the final poster, not just the individual impression trends of the color scheme and skeleton. This makes it possible to evaluate the impression of the final poster, including images and text, in addition to the impression of individual elements of the poster, such as the color scheme and layout.

[0177] In S1513, the poster selection unit 219 selects a poster to be output to the display 105 (to be presented to the user) from the poster data and the estimated impression linked to the poster data acquired from the poster impression estimation unit 218. In this embodiment, the poster selection unit 219 selects a poster for which the distance between the target impression and the estimated impression of the poster is equal to or less than a predetermined threshold.

[0178] In this embodiment, Euclidean distance is used as the distance. The smaller the Euclidean distance, the closer the target impression and the estimated impression are. Furthermore, the distance calculated by the poster selection unit 219 is not limited to Euclidean distance; it can be calculated using any method that can calculate the distance between vectors, such as Manhattan distance or cosine similarity.

[0179] Furthermore, if the number of selected posters is less than the number of posters to be created specified by the poster creation condition specification unit 201, the poster selection unit 219 selects the missing posters in ascending order of the distance between the target impression and the estimated impression of the poster. In this embodiment, the poster selection unit 219 also selects the missing posters, but this is not limited to this. For example, if the number of posters selected by the poster selection unit 219 is less than the number of posters to be created, the poster preview screen 901 (FIG. 9) may display a message indicating that there are not enough posters. Alternatively, the poster selection unit 219 may select the missing posters and then display them on the poster preview screen 901 so that posters whose distance between the target impression and the estimated impression is equal to or less than a threshold value can be distinguished from posters whose distance is equal to or greater than the threshold value. For example, if there are not enough selected posters, the process may return to S1505 and increase the number of skeletons, color patterns, and fonts to be selected.

[0180] In S1514, the poster display unit 205 renders the poster data selected by the poster selection unit 219 and outputs the poster image to the display 105. That is, the poster preview screen 901 in FIG.

[0181] The above is a description of the poster generation process (S1404) in the content-first mode. As described above, in the poster generation process in the content-first mode, the poster creation application determines the range of target impressions that the user can specify based on the estimated impressions of the content specified by the user, and presents this to the user. In other words, the range of target impressions that the user can specify when the specification of a first content is accepted is controlled so as to be different from the range of target impressions that the user can specify when the specification of a second content different from the first content is accepted. Furthermore, the poster creation application generates a poster based on the target impressions specified by the user within the range of target impressions.

[0182] Therefore, when the content-first mode is set, the range of target impressions that can be specified is limited to a range appropriate for the content specified by the user, making it easier for the user to specify the target impression and improving usability when specifying the target impression. More specifically, if a target impression that is inappropriate for the content used in a poster is set, the poster generated by a poster creation application would also be output as an inappropriate result for the content. As a result, the user had to repeatedly specify the target impression to obtain a poster with a desired design. However, in this embodiment, the target impression can be specified from a setting range that is more appropriate for the content than the normal target impression setting range (reference range), more specifically, a setting range that is closer to the impression of the content. This makes it easier for even users with poor design skills to specify a target impression appropriate for the input content. The user can quickly obtain a poster with a design appropriate for the specified content with fewer attempts.

[0183] <Poster generation process in impression-priority mode> Next, the poster generation process in the impression-first mode will be described.

[0184] FIG. 25 is a flowchart for explaining the poster generation processing in impression-priority mode in detail. This flowchart is executed in S1405, to which the process transitions when the impression-priority mode is set in the mode switching process shown in FIG. 14. Note that steps in FIG. 25 that are given the same reference numerals as those in FIG. 15 (poster generation processing in content-priority mode) execute the same processing, and therefore their explanations are omitted. In the poster generation processing in impression-priority mode, S1503 (changing the setting range of the target impression) in the poster generation processing in content-priority mode is omitted. In addition, image impression estimation (S2501) and image selection (S2502) are added between S1510 (font selection) and S1511 (layout processing).

[0185] Furthermore, the processing details of the condition determination process performed by skeleton acquisition unit 213 in S1507 differ from those in the content-priority mode. Specifically, as shown in the flowchart in Fig. 25(b), the image count determination in S2503 is executed instead of S1523 (image count match determination). Furthermore, in the impression-priority mode, the target impression setting control unit 220 shown in Fig. 2 is not used. Below, the differences from the content-priority mode will be explained.

[0186] 25(b) (condition determination process performed by skeleton acquisition unit 213), skeleton acquisition unit 213 determines whether the number of image objects in the loaded skeleton is 1. If the number of image objects is 1, the skeleton is left in RAM 103, and if there is no match, the skeleton is deleted from RAM 103.

[0187] In S2501 of the poster generation process in impression-priority mode shown in FIG. 25(a), the image impression estimation unit 221 estimates the impression of one or more image data acquired in S1506, and associates the estimated impression value with each image data.

[0188] In S2502, the image selection unit 222 selects one image data from the one or more image data acquired in S2501 based on the estimated impression associated with the image data and the target impression set in S1504. In this embodiment, the image data with the smallest distance between the estimated impression and the target impression is selected. With this one image data selected, the layout process of S1511 is executed.

[0189] As described above, in the poster generation process in impression-priority mode, one piece of content (an image in the above example) that is suitable for the target impression set by the user is selected from the content specified by the user and used to generate the poster.

[0190] <<Modification of the First Embodiment>> In the first embodiment, the impression sliders 808 to 811 on the content setting screen 701 are used as objects to be operated to set the target impression, but the method for setting the target impression is not limited to this.

[0191] FIG. 26 shows an example of a UI for setting a target impression. FIG. 26(a) shows an example of setting a target impression using a UI on a radar chart 2600. By operating a handle 2601 on the radar chart 2600 in FIG. 26(a), a target impression value can be set for each impression factor set on each axis. The target impression specification unit 204 acquires a target impression value for each axis, for example, such that when the handle 2601 is at the center of the UI, the value is -2, and when it is at the outermost position, the value is +2. In FIG. 26(a), the target impressions are +0.8 for luxury, +1.1 for familiarity, -0.1 for dynamism, and -0.7 for profoundness. As such, the target impressions may be decimals. Also, the radar chart 2603 in FIG. 26(b) shows a state in which some impression factors are set to off. For example, the user can double-click a handle with the pointing device 107 to turn off the target impression for the axis corresponding to that handle and hide it. The user can turn on the target impression and redisplay the radar chart 2603 by clicking the axis 2602 on the radar chart 2603 again with the pointing device 107. In Figure 26(b), the target impression is the same as in Figure 26(a) except for the dynamism, but the dynamism is set to off.

[0192] In the content-priority mode, when a target impression is set using a radar chart UI, the UI change unit 304 changes the operable range according to the setting range determined by the setting range determination unit 303, similar to the slider-based UI described in the first embodiment. Specifically, the setting range indicated by each axis is changed so that when the handle 2601 is at the center of the radar chart 2600 in the UI, the lower limit of the changed setting range determined by the setting range determination unit 303 can be obtained, and when the handle 2601 is at the outermost edge, the upper limit of the changed setting range can be obtained. Alternatively, the setting range indicated by each axis of the radar chart 2600 in the UI may be the same as the normal setting range, and the operable range of the handle 2601 may be limited to the changed setting range determined by the setting range determination unit 303. In this case, the initial position of the handle 2601 may be set to a position indicating the estimated impression value of the content. Furthermore, the non-operable range may be displayed in a different display form from the operable range, for example, by displaying it in gray.

[0193] FIG. 26(c) shows an example of a UI for setting the target impression not from words such as "luxury" or "closeness" but from a poster image sample (hereinafter referred to as a sample poster image). Sample poster images 2604 to 2607 that enhance one of the impressions are lined up in a sample poster display area 2609. A check box 2608 is also displayed for each sample poster image. The user can select a sample poster image that the user thinks is closest to the impression of the poster they want to create by clicking the check box 2608 with the pointing device 107. The target impression designation unit 204 determines the target impression by referring to the impression value corresponding to the selected sample poster image.

[0194] FIG. 26(d) is a table showing the impression values ​​corresponding to sample poster images 2604 to 2607 in FIG. 26(c) and the final target impression value. The columns for luxury, familiarity, dynamism, and stateliness represent numbers indicating the degree to which each sample poster image influences each impression factor. For example, assume that sample poster images 2604 and 2607 are selected as shown in FIG. 26(c). In this case, the target impression designation unit 204 determines the final target impression value as a composite impression value of the sample poster images 2604 and 2607. In this example, the value with the largest absolute value among the values ​​of each impression factor corresponding to the selected sample poster images 2604 and 2607 is set as the value of each impression factor for the final target impression. Note that while an example in which a poster image with the highest impression is presented has been shown, this is not limiting. Sample poster images with high impression values ​​for multiple impression factors may be used, or sample poster images with more than the number of impression factors may be presented. This allows the user to intuitively designate the target impression from the actual poster image rather than using words.

[0195] In the content-priority mode, the UI changing unit 304 also changes the operable range of the UI ( FIG. 26( c) ) for setting a target impression from a sample poster image in accordance with the setting range determined by the setting range determining unit 303. Specifically, the UI changing unit 304 limits the sample poster images displayed in the sample poster display area 2609 to those having impression values ​​within the setting range determined by the setting range determining unit 303. Alternatively, a predetermined number of sample poster images having impression values ​​close to the setting range determined by the setting range determining unit 303 may be selected and displayed in order of the smallest distance between the impression value of the sample poster image and the setting range. In this case, the sample poster display area 2609 may be initially displayed in a state where the sample poster image having the impression value with the smallest distance from the estimated impression value of the content designated by the user is selected.

[0196] FIG. 27(a) shows an example of a UI for setting a target impression from abstract words that express impressions (hereinafter referred to as "impression words"). A plurality of impression words 2712 are displayed in an impression word display area 2711. A check box 2713 is displayed for each of the plurality of impression words 2712. The user can turn on the check box 2713 and select it by clicking with the pointing device 107 on an impression word that the user thinks is closest to the impression of the poster they want to create. The target impression designation unit 204 determines the target impression by referring to the impression corresponding to the selected impression word.

[0197] Figure 27(b) is a table showing the values ​​of impression factors corresponding to each of the multiple impression words 2712 displayed in Figure 27(a) and the final target impression. The columns for "luxury," "intimacy," "dynamism," and "solidity" (the columns for impression factors) represent numbers indicating the degree to which each impression word 2712 affects each impression factor. For example, assume that "cute" and "casual" are selected as shown in Figure 27(a). In this case, the target impression designation unit 204 determines the final target impression as a value obtained by combining the values ​​of each impression factor for each impression word. In this example, the value with the largest absolute value among the values ​​of each impression factor corresponding to the selected impression words "cute" and "casual" is set as the value of each impression factor for the final target impression. This allows the user to intuitively designate the target impression from the impression words without having to set the values ​​of multiple impression factors. The values ​​of each impression factor corresponding to impression words are determined in advance using a method similar to the text impression quantification process described in Figure 12(b). Specifically, the information processing device can derive the value of each impression factor for each impression word by performing the processes from S1211 to S1214. In addition, the value of each impression factor for an impression word can also be derived (estimated) by applying the impression estimation model saved in S1214 to the impression word.

[0198] In the content-priority mode, in the case of the UI for setting a target impression from impression words ( FIG. 27( a) ), the UI changing unit 304 changes the UI in accordance with the setting range determined by the setting range determining unit 303, just as with the slider-type UI described in the first embodiment. Specifically, the UI changing unit 304 limits the impression words 2712 displayed in the impression word display area 2711 to impression words having impression values ​​within the setting range determined by the setting range determining unit 303. Alternatively, impression words having impression values ​​outside the setting range determined by the setting range determining unit 303 may be made unselectable. In this case, the UI 2710 may be initially displayed in a state in which the impression word having the impression value that is the smallest distance from the designated impression value of the content designated by the user is selected.

[0199] <<Second embodiment>> In the second embodiment, an example will be described in which a poster creation application presents a template instead of generating a poster. A template is data that combines a skeleton, a color scheme pattern, a font, an image, and character information, and in the second embodiment, a plurality of templates are prepared in advance and stored in the HDD 104 of the poster generation device 100.

[0200] In the content-first mode, the poster creation application of the second embodiment, like the first embodiment, displays a UI (operation object) in which the setting range of the target impression that the user can specify has been changed based on the impression of the content specified by the user. Then, based on the target impression specified by the user using the operation object with the setting range of the target impression changed, the poster creation application of the second embodiment selects a template from pre-prepared templates that is closest to the impression of the content and suggests it to the user. This allows the user to present a template that is suitable for the content specified by the user, even when editing a template to generate a poster, reducing the effort and time required for the user to find a template and making it easier to create a poster with the intended design.

[0201] 28 is a software block diagram of the poster creation application of the second embodiment when the content priority mode is set. As shown in FIG. 28, the poster creation application has a poster creation condition specification unit 201, a text specification unit 202, an image specification unit 203, a desired impression specification unit 204, a poster display unit 205, and a poster generation unit 2800 of the second embodiment. The poster generation unit 2800 of the second embodiment has a desired impression setting control unit 220, an image acquisition unit 211, a template acquisition unit 2801, a template impression estimation unit 2802, and a template selection unit 2803.

[0202] The difference from the poster generation unit 210 of the first embodiment is that a template acquisition unit 2801 is provided. Also, the skeleton acquisition unit 213, skeleton selection unit 214, color scheme pattern selection unit 215, font selection unit 216, image analysis unit 212, image impression estimation unit 221, image selection unit 222, and layout unit 217 of FIG. 2 have been deleted. Also, a template impression estimation unit 2802 is provided in place of the poster impression estimation unit 218, and a template selection unit 2803 is provided in place of the poster selection unit 219. In FIG. 28, components denoted by the same reference numerals as in FIG. 2 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0203] The template acquisition unit 2801 acquires, from the HDD 104, a group of templates that meet the conditions specified by the poster creation condition specification unit 201, the text specification unit 202, and the image acquisition unit 211. The template acquisition unit 2801 outputs the acquired group of templates to the template impression estimation unit 2802.

[0204] The template impression estimation unit 2802 estimates an estimated impression for each template included in the group of templates acquired by the template acquisition unit 2801. Then, the template impression estimation unit 2802 outputs a plurality of templates, each associated with its estimated impression, to the template selection unit 2803.

[0205] The template selection unit 2803 compares the desired impression specified by the user in the desired impression specification unit 204 with each estimated impression of the multiple templates associated with the estimated impressions acquired from the template impression estimation unit 2802. Then, it selects one or more templates associated with estimated impressions that are close to the desired impression. The template selection unit 2803 outputs the selected templates to the poster display unit 205.

[0206] The poster display unit 205 displays the template acquired from the template selection unit 2803 on the display 105 .

[0207] <Template selection process> Fig. 29 is a flowchart showing the template selection process in content-priority mode in the second embodiment. The process shown in this flowchart is executed in S1404, to which the process proceeds when content-priority mode is selected in the mode switching process (Fig. 14). Note that processes denoted with the same reference numerals as in Fig. 15 (poster generation process in content-priority mode in the first embodiment) are the same as in the first embodiment, and therefore description thereof will be omitted. In the template selection process in content-priority mode of the second embodiment (Fig. 29), S2901 to S2904 are executed instead of S1505 to S1514 shown in Fig. 15.

[0208] In S1501 to S1503, the poster creation application displays the content setting screen 701 shown in FIG. 7 on the display 105, as in the first embodiment. The text designation unit 202 and the image designation unit 203 accept the user's designation of text and image, and acquire image data and character information. The target impression setting control unit 220 executes processing to change the setting range of the target impression that the user can designate based on the acquired content (image data, character information). The processing to change the setting range of the target impression is the same as in the first embodiment. The target impression setting control unit 220 determines the setting range of the target impression according to the content (image, character information), and displays on the display 105 a generation condition setting screen 801 including a UI changed to the determined setting range.

[0209] In S1504, the poster creation condition specification unit 201 and the target impression specification unit 204 acquire the corresponding settings from the creation condition setting screen 801 in Fig. 8. That is, the poster creation condition specification unit 201 acquires the poster size, number of posters to be created, and usage category designated by the user. The target impression specification unit 204 acquires the target impression designated by the user.

[0210] Thereafter, in S2901, the template acquisition unit 2801 acquires from the HDD 104 one or more templates that meet the conditions specified in the poster creation condition specification unit 201, the text specification unit 202, and the image acquisition unit 211. In the second embodiment, it is assumed that the templates are written in one file per template and stored in the HDD 104.

[0211] The template acquisition unit 2801 sequentially reads template files from the HDD 104 into the RAM 103, leaves templates that meet the set conditions in the RAM 103, and deletes templates that do not meet the conditions from the RAM 103. The template acquisition unit 2801 then outputs one or more templates that meet the set conditions to the template impression estimation unit 2802.

[0212] In S2902, the template impression estimation unit 2802 estimates the impression of each of the one or more templates acquired in S2901. In this embodiment, for example, it is assumed that an impression value is estimated in advance for each template stored in HDD 104, and a table linking the template with the estimated impression is created and stored in HDD 104. The template impression estimation unit 2802 acquires the table stored in HDD 104 to acquire an estimated impression of each acquired template. Note that, in estimating the impression of a template, the impression estimation model used in estimating the impression of a poster may be used.

[0213] In S2903, the template selection unit 2803 selects a template to be output to the display 105 (to be presented to the user) from the templates acquired from the template impression estimation unit 2802 and the estimated impressions linked to the templates. In this embodiment, the template selection unit 2803 selects templates for which the distance between the desired impression specified by the user and the estimated impression of the template is equal to or less than a predetermined threshold. The number to be selected is, for example, the number of creations specified by the user on the generation condition setting screen 801, or a number greater than this. At this time, the template selection unit 2803 selects templates equal to or greater than the number of creations in ascending order of the value indicating the difference between the desired impression and the estimated impression. The closeness between the desired impression and the estimated impression is determined based on the difference in impression value for each impression factor.

[0214] In S2904, the poster display unit 205 displays the template selected in S2903 on the display.

[0215] As described above, according to the second embodiment, templates with various color schemes, fonts, images, and text information can be prepared in advance. When the operating mode is set to the content-first mode, the poster creation application displays a UI (operation object) in which the setting range of the target impression that the user can specify is changed based on the impression of the content specified by the user. Based on the target impression specified by the user using the operation object, the poster creation application selects a template from the pre-prepared templates that is closest to the impression of the content and proposes it to the user. This makes it easier for the user to specify a target impression appropriate for the content specified by the user using a UI (operation object) that is appropriate for the content. This reduces the number of attempts required to present a template that is close to the target impression specified by the user, thereby reducing the effort required for the user to find a template and making it easier to create the intended design.

[0216] <<Third Embodiment>> In the poster creation application of the first and second embodiments, an example has been described in which the target impression setting control unit 220 changes the range of target impressions that the user can specify in accordance with the impression of the content specified by the user. In the third embodiment, the target impression setting control unit 220 changes the range of target impressions that the user can specify based on the usage category specified by the user in addition to the impression of the content specified by the user. This allows the target impression setting control unit 220 to determine a setting range of target impressions that more accurately reflects the user's intentions.

[0217] The basic process of the poster generation process of the third embodiment is similar to the example described in the first embodiment, so the following description will focus on the differences.

[0218] Fig. 30 is a software block diagram illustrating in detail the desired impression setting control unit 3000 in the content-priority mode of the third embodiment. As shown in Fig. 30, the desired impression setting control unit 3000 in the content-priority mode of the third embodiment includes a determination unit 301, a content impression estimation unit 302, a setting range determination unit 303, a UI change unit 304, and a usage impression acquisition unit 3001. The difference from the poster generation unit 210 of the first embodiment is that the usage impression acquisition unit 3001 has been added. In Fig. 30, the components denoted with the same reference numerals as in Fig. 3 are the same as those in the first embodiment, and therefore will not be described here.

[0219] The use impression acquisition unit 3001 acquires the use category of the poster to be created from the poster creation condition designation unit 201. The use category of the poster to be created is selected by the user from the category list box 815 on the creation condition setting screen 801 shown in Fig. 8. The use impression acquisition unit 3001 acquires the range of impressions suitable for the acquired use category from the HDD 104 and outputs it to the setting range determination unit 303. Note that the poster creation application stores in advance in the HDD 104 a database that associates use categories with the range of impressions suitable for the use categories.

[0220] The setting range determination unit 303 determines a setting range of a target impression based on the estimated impression of the content acquired from the content impression estimation unit 302 and the range of impressions of the usage category acquired from the usage impression acquisition unit 3001, and outputs the determined setting range to the UI change unit 304.

[0221] FIG. 31 is a flowchart showing the process of changing the setting range of the desired impression in the third embodiment. FIG. 31 shows the process executed in S1503 of the poster generation process (FIG. 15) in the content-priority mode. This process is executed by the determination unit 301, content impression estimation unit 302, usage impression acquisition unit 3001, setting range determination unit 303, and UI change unit 304 shown in the desired impression setting control unit 3000. Note that the processes in FIG. 31 denoted by the same reference numerals as those in FIG. 16 (the process of changing the setting range of the desired impression in the first embodiment) are the same as those described in the first embodiment, and therefore their description will be omitted. The difference from the flowchart shown in FIG. 16 is that usage impression acquisition (S3101) is added after the content impression estimation process in S1602. Furthermore, the process of determining the setting range of the desired impression in S3102 differs in content from that of S1603.

[0222] In S3101, the usage impression acquisition unit 3001 acquires an impression range suitable for the usage category acquired from the poster creation condition designation unit 201. Specifically, the usage impression acquisition unit 3001 acquires the usage category of the poster to be created, which is specified by the user in the category list box 815 of FIG. 8. Then, the usage impression acquisition unit 3001 acquires the impression range associated with the acquired usage category from the HDD 104. As described above, a database that associates usage categories with impression ranges suitable for the usage categories is stored in advance in the HDD 104. The usage impression acquisition unit 3001 outputs the acquired impression range to the setting range determination unit 303.

[0223] A database 3200 in which ranges of impressions suitable for use categories are recorded will be described with reference to Fig. 32. The use category column shown in Fig. 32 indicates the types of use categories that can be specified by the user in the category list box 815 of Fig. 8, and here, examples include restaurants, school events, sales, and educational activities. In the columns of luxury, familiarity, dynamism, and stateliness, ranges of impressions suitable for each use category are set for each impression factor. Note that the types and number of use categories are not limited to this example, and other use categories may be included.

[0224] Taking affinity as an example, when creating a poster for a restaurant, a poster with a negative affinity, i.e., a poster that gives an impression of lack of affinity, is not appropriate. Therefore, when the use category is a restaurant, the impression range for affinity is set to 0 or greater. On the other hand, when creating a poster for educational purposes, some posters may have a positive affinity to make people feel more at ease, while others may have a negative affinity to make people feel a sense of crisis. In other words, there is no particular appropriate range for affinity in educational posters, and the target value for affinity can be any value. Therefore, in database 3200, the affinity range for the educational use category is not set, and is represented by "-" in Figure 32.

[0225] Taking luxury as an example, when creating a poster for a school event, luxury is rarely required, but a negative luxury impression, i.e., a casual impression, is appropriate. Therefore, the luxury range for the school event use category is set to 0 or less. On the other hand, when creating a poster for a sale, a luxury impression may be required depending on the product being sold, or a casual impression may be required. Therefore, in database 3200, a luxury range is not set for the sale use category.

[0226] The impression range suitable for a usage category can be determined using the poster for each usage defined as the usage category and the impression estimation model saved in the poster impression quantification process described in Fig. 10. In this embodiment, the impression range suitable for the usage category is determined for each impression factor and usage category according to the following Equations 3 and 4.

[0227]

number

[0228] where c is the index of the usage category, μ c is the average impression value of the poster group corresponding to the usage category c, and σ c indicates the standard deviation of the impression values ​​of the poster group corresponding to the usage category c. Note that the method of determining the impression range suitable for the usage category is not limited to this. For example, σ in Equation 3 and Equation 4 c may be replaced with a predetermined fixed value. c If is 0 or more, the impression range is 0 or more, and μ c If is less than 0, the impression range may be less than 0. As long as an impression range suitable for each use category can be determined, any method for determining the range may be used.

[0229] In S3102, the setting range determination unit 303 determines the setting range of the target impression based on the impression of the content acquired in S1602 and the impression range suitable for the usage category acquired in S3101. In this embodiment, the setting range determination unit 303 determines and outputs the intersection range of the setting range of the target impression determined from the impression of the content using the same method as described in S1603 of the first embodiment and the impression range suitable for the usage category acquired in S3101. Note that a situation may arise in which the intersection range does not exist, but in that case, the same handling as in the first embodiment may be used.

[0230] As described above, according to the third embodiment, the range of target impressions that the user can specify is determined based on the impression of the content specified by the user as well as the usage category specified by the user, and the UI (operation object) is changed. This makes it easier to specify a target impression that is appropriate not only for the content to be placed on the poster but also for the usage of the poster. Therefore, usability is improved because the setting range of target impressions can be determined that more accurately reflects the user's intentions in poster production. Users can obtain a poster with the intended design with fewer attempts.

[0231] Although preferred embodiments of the present disclosure have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. For example, in the third embodiment, instead of generating a poster, a template may be selected and presented as described in the second embodiment. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the disclosed technical ideas, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0232] <<Other embodiments>> The above-described embodiments can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and a computer (CPU, MPU, etc.) of the system or device reads and executes the programs. The programs may be executed by a single computer or by multiple computers in cooperation with each other. Furthermore, all of the above-described processes do not need to be implemented by software; some or all of the processes may be implemented by hardware such as an ASIC. Furthermore, the CPU is not limited to a single CPU that performs all processes; multiple CPUs may perform processes in cooperation with each other as appropriate. The functions of the above-described embodiments are not necessarily realized by a computer reading and executing program code. This also includes cases where an operating system or the like running on a computer performs some or all of the actual processes based on the instructions of the program code, thereby realizing the functions of the above-described embodiments.

[0233] The disclosure of the above-described embodiment includes the following configurations.

[0234] (Configuration 1) An information processing device that generates data of a production, a receiving means for receiving from a user a designation of content to be arranged in the work and a designation of a target impression that is an impression that the work is ultimately required to retain; a control means for controlling so that a first range, which is a range of the desired impression that the user can specify when the receiving means receives the designation of a first content, differs from a second range, which is a range of the desired impression that the user can specify when the receiving means receives the designation of a second content that is different from the first content; An information processing device comprising:

[0235] (Configuration 2) 2. The information processing device according to configuration 1, wherein the first range and the second range are limited to a range narrower than a preset reference range.

[0236] (Configuration 3) The apparatus further includes a display means for displaying a screen for receiving the designation of the target impression from the user, 3. The information processing device according to configuration 1 or 2, wherein the screen is configured to allow the user to recognize the first range or the second range.

[0237] (Configuration 4) The control means determining the first range based on an impression estimated from the first content; 4. The information processing device according to any one of configurations 1 to 3, wherein the second range is determined based on an impression estimated from the second content.

[0238] (Configuration 5) The control means determining the first range to be a range including the impression value estimated from the first content; 5. The information processing device according to configuration 4, wherein the second range is determined to be a range including the impression value estimated from the second content.

[0239] (Configuration 6) 6. The information processing device according to any one of configurations 1 to 5, wherein the target impression is specified by a value indicating the degree of each of a plurality of impression factors.

[0240] (Configuration 7) 7. The information processing device according to configuration 6, wherein the control means controls the first range and the second range so that the impression factors that the user can specify are different.

[0241] (Configuration 8) 7. The information processing device according to configuration 6, wherein the control means controls the first range and the second range so that the ranges of values ​​that can be designated by the user are different.

[0242] (Configuration 9) the display means displays an operation object on the screen for the user to specify the desired impression; 4. The information processing device according to configuration 3, wherein the control means reflects the first range or the second range on the operation object.

[0243] (Configuration 10) 10. The information processing device according to configuration 9, wherein the control means makes some of the displayed operation objects inoperable based on the first range or the second range. (Configuration 11) 10. The information processing device according to configuration 9, wherein the control means restricts the movable range of the operation object based on the first range or the second range so that the movable range is narrower than a reference movable range.

[0244] (Configuration 12) The information processing device according to configuration 9, wherein the control means changes at least one of an upper limit value and a lower limit value indicated on the operation object based on the first range or the second range.

[0245] (Configuration 13) 13. The information processing device according to any one of configurations 9 to 12, wherein an impression value of the content accepted by the accepting means is designated in an initial display state of the operation object.

[0246] (Configuration 14) 14. The information processing device according to any one of configurations 1 to 13, further comprising a notification means for issuing a warning when a range exceeding the first range or the second range is specified in the accepting means.

[0247] (Configuration 15) The information processing device according to any one of configurations 1 to 14, further comprising a first generation means for generating data of the production including the content received by the reception means based on the target impression received by the reception means.

[0248] (Configuration 16) The information processing device described in configuration 15, characterized in that a value indicating the difference between the impression estimated from the data of the work generated by the first generation means and the target impression accepted by the acceptance means is smaller than a predetermined threshold value.

[0249] (Configuration 17) The information processing device according to any one of configurations 1 to 14, further comprising a second generation means for generating template data of the production including the content received by the reception means based on the target impression received by the reception means.

[0250] (Configuration 18) 14. The information processing device according to any one of configurations 9 to 13, wherein the operation object is a slider.

[0251] (Configuration 19) 14. The information processing device according to any one of configurations 9 to 13, wherein the operation object is a radar chart.

[0252] (Configuration 20) 14. The information processing device according to any one of configurations 9 to 13, wherein sample images of the product that represent a plurality of different impressions are displayed in a selectable manner as the operation object.

[0253] (Configuration 21) 14. The information processing device according to any one of configurations 9 to 13, wherein a plurality of words expressing different impressions are displayed as the operation objects in a selectable manner.

[0254] (Configuration 22) The receiving means further receives a designation of the use of the production; The information processing device according to any one of configurations 1 to 21, wherein the control means further controls so that a range of the target impression that the user can specify when the receiving means receives a designation of a first use is different from a range of the target impression that the user can specify when the receiving means receives a designation of a second use that is different from the first use.

[0255] (Configuration 23) 23. The information processing device according to any one of configurations 1 to 22, wherein the accepting means accepts at least one of image data and text data as the content.

[0256] (Configuration 24) The accepting means further accepts designation of whether the range of the desired impression that can be designated by the user is a range suitable for the image data, a range suitable for the text data, or a range suitable for both the image data and the text data, 24. The information processing apparatus according to configuration 23, wherein the control means controls the range of the desired impression based on data corresponding to the designation received by the receiving means.

[0257] (Configuration 25) 25. The information processing device according to any one of configurations 1 to 24, wherein the product is a poster.

[0258] (Configuration 26) An information processing method for generating data of a production, comprising: a receiving step of receiving from a user a designation of content to be arranged in the work and a designation of a target impression that is an impression that the work is ultimately required to retain; a control step of controlling so that a first range, which is a range of the desired impression that the user can specify when a designation of a first content is accepted in the accepting step, and a second range, which is a range of the desired impression that the user can specify when a designation of a second content different from the first content is accepted in the accepting step, are different from each other; An information processing method comprising:

[0259] (Configuration 27) A program for causing a computer to execute an information processing method for generating data of a production, The information processing method includes: a receiving step of receiving from a user a designation of content to be arranged in the work and a designation of a target impression that is an impression that the work is ultimately required to retain; a control step of controlling so that a first range, which is a range of the desired impression that the user can specify when a designation of a first content is accepted in the accepting step, and a second range, which is a range of the desired impression that the user can specify when a designation of a second content different from the first content is accepted in the accepting step, are different from each other; Programs including.

Claims

1. An information processing device that generates data of a production, a receiving means for receiving from a user a designation of content to be arranged in the work and a designation of a target impression that is an impression that the work is ultimately required to retain; a control means for controlling a first range, which is a range of the target impression that the user can specify when the receiving means receives the specification of a first content, to be different from a second range, which is a range of the target impression that the user can specify when the receiving means receives the specification of a second content that is different from the first content; An information processing device comprising:

2. 2. The information processing apparatus according to claim 1, wherein the first range and the second range are limited to a range narrower than a preset reference range.

3. The apparatus further includes a display means for displaying a screen for receiving the designation of the target impression from the user, The information processing apparatus according to claim 1 , wherein the screen is configured so that the user can recognize the first range or the second range.

4. The control means determining the first range based on an impression estimated from the first content; The information processing device according to claim 1 , wherein the second range is determined based on an impression estimated from the second content.

5. The control means determining the first range to be a range including an impression value estimated from the first content; 5. The information processing apparatus according to claim 4, wherein the second range is determined to be a range including an impression value estimated from the second content.

6. 2. The information processing apparatus according to claim 1, wherein the target impression is specified by a value indicating a degree of each of a plurality of impression factors.

7. 7. The information processing apparatus according to claim 6, wherein the control means controls the first range and the second range so that the impression factors that the user can specify are different from each other.

8. 7. The information processing apparatus according to claim 6, wherein the control means controls the first range and the second range so that the range of values ​​that the user can specify differs from each other.

9. the display means displays an operation object on the screen for the user to specify the desired impression; 4. The information processing apparatus according to claim 3, wherein the control means reflects the first range or the second range on the operation object.

10. 10. The information processing apparatus according to claim 9, wherein the control means makes some of the displayed operation objects inoperable based on the first range or the second range.

11. 10. The information processing apparatus according to claim 9, wherein the control means restricts the movable range of the manipulation object based on the first range or the second range so as to be narrower than a reference movable range.

12. 10. The information processing apparatus according to claim 9, wherein the control means changes at least one of an upper limit value and a lower limit value indicated on the operation object based on the first range or the second range.

13. 10. The information processing apparatus according to claim 9, wherein an impression value of the content accepted by the accepting means is specified in an initial display state of the operation object.

14. 2. The information processing apparatus according to claim 1, further comprising a notification unit that issues a warning when the acceptance unit specifies a range that exceeds the first range or the second range.

15. 2. The information processing apparatus according to claim 1, further comprising a first generating means for generating data of the product including the content received by the receiving means based on the target impression received by the receiving means.

16. 16. The information processing device according to claim 15, wherein a value indicating a difference between the impression estimated from the data of the product generated by the first generation means and the target impression received by the reception means is smaller than a predetermined threshold value.

17. 2. The information processing apparatus according to claim 1, further comprising: a second generating means for generating template data of the production including the content received by the receiving means based on the target impression received by the receiving means.

18. 10. The information processing apparatus according to claim 9, wherein the operation object is a slider.

19. 10. The information processing apparatus according to claim 9, wherein the operation object is a radar chart.

20. 10. The information processing apparatus according to claim 9, wherein sample images of the product that show a plurality of different impressions are displayed as the operation objects in a selectable manner.

21. 10. The information processing apparatus according to claim 9, wherein a plurality of words expressing different impressions are displayed as the operation objects in a selectable manner.

22. The receiving means further receives a designation of the use of the production; 2. The information processing device according to claim 1, wherein the control means further controls so that the range of the target impression that the user can specify when the accepting means accepts the specification of a first use is different from the range of the target impression that the user can specify when the accepting means accepts the specification of a second use that is different from the first use.

23. 2. The information processing apparatus according to claim 1, wherein the accepting unit accepts at least one of image data and text data as the content.

24. The receiving means further receives a designation of whether the range of the desired impression that can be designated by the user is a range suitable for the image data, a range suitable for the text data, or a range suitable for both the image data and the text data; 24. The information processing apparatus according to claim 23, wherein said control means controls the range of the desired impression based on data corresponding to the designation received by said receiving means.

25. 2. The information processing apparatus according to claim 1, wherein the work is a poster.

26. An information processing method for generating data of a production, comprising: a receiving step of receiving from a user a designation of content to be arranged in the work and a designation of a target impression that is an impression that the work is ultimately required to retain; a control step of controlling so that a first range, which is a range of the desired impression that the user can specify when a designation of a first content is accepted in the accepting step, and a second range, which is a range of the desired impression that the user can specify when a designation of a second content different from the first content is accepted in the accepting step, are different from each other; An information processing method comprising:

27. A program for causing a computer to execute an information processing method for generating data of a production, The information processing method includes: a receiving step of receiving from a user a designation of content to be arranged in the work and a designation of a target impression that is an impression that the work is ultimately required to retain; a control step of controlling so that a first range, which is a range of the desired impression that the user can specify when a designation of a first content is accepted in the accepting step, and a second range, which is a range of the desired impression that the user can specify when a designation of a second content different from the first content is accepted in the accepting step, are different from each other; Programs including.

Images