Design change system, information processing device, control method for information processing device, and program

Abstract

This improves the usability of creating text-related objects when creating design data. [Solution] A design modification system is provided, comprising: a receiving means for receiving modification instructions to change the layout of design data including text; a control means that, upon receiving a modification instruction, controls the system to identify elements to be emphasized from among the elements included in the text based on the design data; and a modification means for changing the character typesetting of the elements identified by the control means.

Description

Technical Field

[0001] The present disclosure relates to a design change system, an information processing apparatus, a control method of the information processing apparatus, and a program.

Background Art

[0002] There is a system that supports the creation of design data such as posters or flyers (hereinafter referred to as design data). Some of such systems have a function of uniformly changing and displaying the character sets of the elements constituting the text for each area (hereinafter referred to as the text area) that an object representing the text included in the design data has. The character set indicates elements such as the size of characters, the color of elements, the type of font of elements, bold decoration for elements, italic decoration for elements, or underline decoration for elements that constitute the text that an object representing the text has.

[0003] Patent Document 1 discloses a technique of receiving a selection from a user as to whether the importance of a character string input in an input area is high or not, and displaying the character string having a high importance so as to be larger than the character string having a low importance.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When creating design data, it is required to improve the usability of creating an object related to text.

Means for Solving the Problems

[0006] A design modification system according to one aspect of the present disclosure is characterized by comprising: a receiving means for receiving modification instructions for changing the layout of design data including text; a control means that, upon receiving the modification instructions, performs control to identify elements to be emphasized from among the elements included in the text based on the design data; and a modification means for changing the character set of the elements identified by the control means. [Effects of the Invention]

[0007] According to this disclosure, the usability of creating text-related objects during the creation of design data can be improved. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram shows an example of the overall configuration of this system. [Figure 2] This figure shows an example of the hardware configuration of a host PC and a service server. [Figure 3] This figure shows an example of the software configuration of this system. [Figure 4] This figure shows an example of a data table for design data. [Figure 5] This figure shows an example of the processing that a multimodal large-scale language model can perform. [Figure 6] This figure shows an example of the editing screen of a poster creation application. [Figure 7] This is a sequence diagram showing an example of the processes executed on the host PC and service server. [Figure 8] This figure shows an example of the editing screen before and after executing a process that changes the typesetting of text elements in a text object included in the design data being edited. [Figure 9] This flowchart shows an example of a process performed by the host PC. [Figure 10] This flowchart shows an example of the process performed by the service server. [Figure 11]It is a diagram showing an example of an editing screen of a poster creation application in a state where a character group change setting area is displayed. [Figure 12] It is a flowchart showing an example of a process executed by a service server. [Figure 13] It is a diagram showing an example of an editing screen of a poster creation application for explaining a flow for re-executing a character group change process. [Figure 14] It is a flowchart showing an example of a process executed by a service server. [Figure 15] It is a diagram showing an example of a prompt for causing a multimodal large language model to perform re-estimation of emphasized elements and an example of the re-estimation result of the emphasized elements. [Figure 16] It is a diagram showing an example of an editing screen of a poster creation application for explaining a flow for executing a character group change process involving text translation. [Figure 17] It is a flowchart showing an example of a reception process for receiving a character group change instruction executed by a poster creation application and a process for updating the display of design data. [Figure 18] It is a flowchart showing an example of a process executed by a service server. [Figure 19] It is a sequence diagram showing an example of a process executed by a host PC and a service server. [Figure 20] It is a flowchart showing an example of a reception process for receiving a character group change instruction executed by a poster creation application and a process for updating the display of design data. [Figure 21] It is a diagram showing an example of an editing screen of a poster creation application. [Figure 22] It is a flowchart showing an example of a process executed by a service server.

Mode for Carrying Out the Invention

[0009] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the present disclosure, and not all combinations of features described in the following embodiments are essential for the solution of the present disclosure. For the same configuration, the same reference numerals will be used for description.

[0010] Among systems that assist in creating design data such as posters or flyers, there are some that have a function of uniformly changing and displaying the character sets of the elements constituting the text for each region (text region) of an object representing the text included in the design data. Here, an element (hereinafter referred to as a text element) constituting the text (included in the text) refers to an element of the text composed of characters, numbers, symbols, or a combination thereof.

[0011] However, in the above-described system, when the character sets of the text elements are uniformly changed and displayed for each text region, the visibility of the elements (hereinafter referred to as emphasized elements) to be emphasized among the text elements may decrease.

[0012] Therefore, from the perspective of ensuring the visibility of the emphasized elements, a method of relatively enlarging the emphasized elements with respect to other elements in the text by accepting from the user the selection of the elements to be emphasized among the text elements can be considered. However, in this method, it is necessary to accept from the user the selection of whether an element is an emphasized element, and there may be cases where the emphasized elements cannot be automatically identified and the character sets of the identified emphasized elements cannot be changed.

[0013] Hereinafter, a method for improving the usability of object creation related to text during the creation of design data will be described. Specifically, a method that can automatically identify emphasized elements among text elements and change the character sets of the identified emphasized elements will be described.

[0014] <<First Embodiment>> <Overall Configuration of the System> Figure 1 shows an example of the configuration of the design change system in this embodiment. The design change system includes a host PC 101 and a service server 102. The host PC 101 and the service server 102 are connected to each other so that they can communicate with one another via a network 100. Examples of this network 100 include the internet, a wired LAN (Local Area Network), or a wireless LAN.

[0015] The explanation will use the example that the host PC 101 is a terminal device that runs an application capable of generating and editing design data such as posters or flyers (hereinafter referred to as the poster creation application).

[0016] The host PC 101 can be any type of information processing device capable of running a poster creation application. For example, the host PC 101 may be a desktop PC, a notebook PC, a tablet device, or a smartphone.

[0017] The host PC 101 can send requests to the service server 102 for some editing, data processing, and rendering processes related to the design data via the poster creation application.

[0018] The service server 102 will be explained using the example of a server that performs editing, data processing, and rendering processes related to design data. Note that the service server 102 can be any type of information processing device capable of performing the aforementioned processes related to design data. For example, the service server 102 may be a desktop PC or a notebook PC.

[0019] The design change system of this embodiment includes, but is not limited to, a host PC 101 and a service server 102. For example, the host PC 101 may also perform the role of the service server 102. Alternatively, there may be two or more host PCs 101 and service servers 102.

[0020] <Host PC Hardware Configuration> Figure 2(A) shows an example of the hardware configuration of the host PC 101. The control unit 200 includes a CPU 201, ROM 202, RAM 203, HDD 204, network interface (I / F) 205, and display / operation I / F 206. These are connected to each other via a system bus 207. The control unit 200 controls the operation of the entire host PC 101.

[0021] The CPU 201 reads various programs, such as control programs, system programs, and application programs, stored in storage devices such as the ROM 202 and the HDD (Hard Disk Drive) 204, into the RAM 203. Then, by executing the read programs, the CPU 201 can realize the various functions of the host PC 101.

[0022] The memory device stores and holds various programs, image data, and other data. Examples of memory devices include ROM202, which is non-volatile memory; RAM203, which is volatile memory; and HDD204, which is a large-capacity storage area. ROM202 is non-volatile memory that holds various programs and other data. The CPU201 can read various programs from ROM202. RAM203 is the main memory of the CPU201 and is volatile memory used as a temporary storage area such as the work area.

[0023] HDD204 is a non-volatile memory used as a large-capacity storage area for saving data such as images and programs such as applications. HDD204 may also be an SSD (Solid State Drive), flash memory, or cloud storage.

[0024] The network interface 205 connects the control unit 200 of the host PC 101 to the network 100. The control unit 200 can transmit various data and information to external devices on the network 100 via the network interface 205, and can also receive various data and information from external devices on the network 100.

[0025] The display / operation interface 206 connects the control unit 200 of the host PC 101 to an output device such as a display (not shown) and an input device such as a keyboard and mouse (not shown). In this embodiment, the input device and output device are described as being configured separately, but the configuration of the input device and output device is not limited to this. For example, the output device and input device may be configured as an integrated unit, such as a display with a touch panel function. In this case, the control unit 200 can detect the operator's operation on the display via the display / operation interface 206.

[0026] <Service Server Hardware Configuration> Figure 2(B) shows an example of the hardware configuration of the service server 102. The control unit 210 includes a CPU 211, ROM 212, RAM 213, HDD 214, and network I / F 215. These are connected to each other via a system bus 216. The functions of each component included in the control unit 210 are the same as those of the CPU 201, ROM 202, RAM 203, HDD 204, and network I / F 205 described above, so a detailed explanation is omitted.

[0027] The control unit 210, including the CPU 211, controls the operation of the entire service server 102. The CPU 211 reads various programs, such as control programs, system programs, and application programs, stored in storage devices such as the ROM 212 and HDD 214, into the RAM 213. Then, by executing the read programs, the CPU 211 can realize the various functions of the service server 102.

[0028] ROM212 is a non-volatile memory that holds various programs and other data. RAM213 is the main memory of the CPU211 and is used as a temporary storage area such as the work area. HDD214 stores document data and various programs and other data. HDD214 may be an SSD, flash memory, or cloud storage.

[0029] The network interface 215 connects the control unit 210 of the service server 102 to the network 100. The service server 102 can receive processing requests from other devices such as the host PC 101 via the network interface 215. The service server 102 can also send various data and information to the sender of the processing request via the network interface 215 in response to the received processing request. A processing request is a request instructing the service server 102 to perform a predetermined process.

[0030] <Software configuration of this system> Figure 3 shows an example of the software configuration of this system. The software configuration of the host PC 101 and the service server 102 will be explained with reference to Figure 3.

[0031] The host PC 101 has a poster creation application 300. In this embodiment, the poster creation application 300 will be described as an application that is a program capable of performing editing processing of design data such as posters or flyers.

[0032] The program for the poster creation application 300 is stored in a storage device such as ROM202 or HDD204. The CPU201 can read the program for the poster creation application 300 into RAM203 and execute the program for the poster creation application 300 that it has read.

[0033] The poster creation application 300 also includes a display control unit 301, an operation unit 302, a data transmission unit 303, and a data reception unit 304. The display control unit 301 displays the editing screen of the poster creation application 300 on the display via the display / operation interface 206. The operation unit 302 functions as a reception means that receives user input from an input device or the like via the display / operation interface 206. The data transmission unit 303 sends a design data processing request to the service server 102 via the network interface 205 based on instructions from the operation unit 302. The data reception unit 304 receives the design data processing results from the service server 102 via the network interface 205.

[0034] The service server 102 includes a design data editing unit 310, a data transmission unit 311, a data reception unit 312, a text translation unit 313, an emphasis element identification unit 314, and a character typesetting modification unit 315. The service server 102 also includes a design database 321, a multimodal large-scale language model 322, and a conversion database 323.

[0035] The design data editing unit 310 edits design data such as posters or flyers based on instructions from the poster creation application 300 on the host PC 101. For example, the design data editing unit 310 adds and deletes objects such as text, images, or shapes to the design data, or changes the coordinates, size, and color of each object. The design data is saved in the design database 321 for each poster creation application 300 on the host PC 101 (or for each user account if there are multiple user accounts).

[0036] Here, Figure 4(A) shows an example of a data table for design data stored in the design database 321 and managed by the service server 102. The data table shown in Figure 4(A) includes parameters that uniquely identify the objects contained in the design data: ID 401, object 402, type 403, coordinates 404, area size 405, color 406, and metadata 407.

[0037] Object 402 contains the content of each object included in the design data, such as text, images, or shapes. For example, object 402 associated with ID 401 of ID-B contains an image representing a vehicle. Similarly, object 402 associated with ID 401 of ID-D contains the text from an object representing text.

[0038] The Type 403 contains information indicating the type of each object. The Coordinate 404 contains a value indicating the position of each object on the layout of the design data. The Area Size 405 contains a value indicating the size of the text area of ​​each object. In this embodiment, for example, if the Type 403 is text, the Coordinate 404 and Area Size 405 represent the coordinates and size of the text area where the text area prepared for text is located, respectively.

[0039] Color 406 contains values ​​representing the color of each object, set as RGB values. However, for text objects and image objects, it is not necessary to set a color value for these objects in Color 406. Furthermore, Color 406 may be set using HSV values ​​instead of RGB values.

[0040] Metadata 407 contains metadata for each object. In this embodiment, for example, if type 403 is an image or text, a description of the image or text, or the attributes of the object can be set as metadata. For example, metadata 407 can contain an image description, as in item 408, or text attributes, as in item 409. Also, if type 403 is a background, the size of the background document can be set as metadata. For example, "A2 size" can be set as metadata, as in item 410. In addition, metadata may not be set for some objects.

[0041] In this embodiment, the data table shown in Figure 4(A) is stored in the design database 321 for each design data. The data table shown in Figure 4(A) may also be stored in the design database 321 for each object type, and may include parameters other than those described above.

[0042] In this embodiment, when type 403 is text, parameters such as the color of the text elements of the text object (hereinafter referred to as text object) are stored in the design database 321 as a data table for text objects. The data table for text objects is stored in the design database 321 linked to ID 401.

[0043] Figure 4(B) shows an example of a data table for the "ID-A" text object in Figure 4(A). In the data table for text objects, parameter values ​​are set sequentially for each element of the text that the text object possesses. For example, as shown in Figure 4(B), an element of the text that a text object possesses means a single character that makes up the text that the text object possesses. It goes without saying that if the text contains numbers or symbols, an element of the text that a text object possesses means a single number or a single symbol. However, the elements of the text that a text object possesses are not limited to these.

[0044] For example, the text elements of a text object may represent a single word or a single sentence. These elements may be managed individually by the service server 102, either word by word or sentence by sentence. Furthermore, these words may be classified and managed by part of speech.

[0045] The data table for the text object shown in Figure 4(B) includes parameters for character 411, font color 412, font type 413, font size 414, bold formatting 415, italic formatting 416, and underline formatting 417.

[0046] The value for character 411 indicates the character that makes up the text of the text object associated with ID 401 of ID-A. The value for font color 412 indicates the color of the character set in character 411 and is set as an RGB value. Note that the value for font color 412 may be set as an HSV value instead of an RGB value. The value for font type 413 indicates the type of font of the character set in character 411. The value for font size 414 indicates the size of the character set in character 411.

[0047] The bold formatting 415 has a value that indicates whether or not to make the character set in character 411 bold. The italic formatting 416 has a value that indicates whether or not to make the character set in character 411 italic. The underline formatting 417 has a value that indicates whether or not to underline the character set in character 411. In this embodiment, the parameters from font color 412 to underline formatting 417 will be explained using the example of the character set in character 411. Character setting refers to the size of elements such as characters that make up the text of an object representing text, the color of the elements, the font type of the elements, bold formatting, italic formatting, or underline formatting of the elements.

[0048] Referring to the data table for text objects shown in Figure 4(B), it can be seen that the three characters "ABC" in the string "ABC PRESENTS" are set to "font size 14pt" and "bold formatting." In this embodiment, the data table for text objects shown in Figure 4(B) is stored in the design database 321 for each text object. Note that the data table for text objects shown in Figure 4(B) may include parameters other than those described above. That is, parameters other than the font color 412 to the underline formatting 417 may be used as the character typesetting for the characters set in character 411.

[0049] Returning to Figure 3, the data transmission unit 311 transmits the design data processing results to the poster creation application 300 on the host PC 101 via the network interface 215. The data reception unit 312 receives a design data processing request from the poster creation application 300 on the host PC 101 via the network interface 215.

[0050] The text translation unit 313 machine-translates the text contained in text objects within the design data from a first language to a second language. For example, if the text in a text object is expressed in English, and the design data processing request includes a translation instruction to translate from English to Japanese, the text translation unit 313 will translate the text from English to Japanese. Note that the languages ​​that the text translation unit 313 can translate into are not limited to Japanese; they may also be English or other languages.

[0051] The conversion database 323 holds configuration information for text translation. This configuration information includes translatable languages, locales representing countries or regions, and information relating each locale to a translatable language. The emphasis element identification unit 314 uses the multimodal large-scale language model 322 to identify elements of the text object that should be emphasized. The character typesetting change unit 315 can change the parameter values ​​of the text object data table corresponding to the elements identified by the emphasis element identification unit 314, that is, it can change the character typesetting of those elements.

[0052] Figure 5 shows an example of the processing performed by the multimodal large-scale language model 322. Before describing the multimodal large-scale language model 322, we will first explain large-scale language models.

[0053] A large-scale language model (LLP) is a pre-trained model consisting of multiple neural network layers, trained on a large amount of text. The parameters of each neural network layer are adjusted by training it on the task of predicting the most likely element (character, word, or sentence) to follow any given element (character, word, or sentence). This allows the LLP model to generate text that has a high probability of matching the input text. For example, given the prompt "What day of the week comes after Friday?", the LLP model can generate the text "Saturday." which has a high probability of matching the prompt.

[0054] Specifically, a large-scale language model divides the input text into tokens, which are the basic processing units, and then converts each token into an embedding representation that numerically represents the meaning of a word or sentence. One example of converting tokens into embedding representations is converting tokens into high-dimensional numerical vectors. By converting tokens into embedding representations, the large-scale language model can numerically represent the meaning of the input text. Based on the converted embedding representations, the large-scale language model can generate text that has a high probability of matching these embedding representations.

[0055] The multimodal large-scale language model 322 is a large-scale language model trained to handle different types of information, including not only text and other strings, but also images, audio, and video. A multimodal large-scale language model capable of accepting image input can derive image features from the input image using an image encoder. The multimodal large-scale language model then maps these derived image features to an embedding representation (e.g., a numerical vector). This allows the multimodal large-scale language model to generate text with a high probability of matching the input text and image. Furthermore, the multimodal large-scale language model can output the input text and image as an embedding representation.

[0056] Furthermore, the multimodal large-scale language model 322 can handle a variety of tasks that are not present in the training data, depending on the input text and images. For example, the multimodal large-scale language model 322 can translate text as shown in Figure 5(A) and describe images as shown in Figure 5(B).

[0057] Figure 5 shows an example of processing that the multimodal large-scale language model 322 can perform. As shown in Figure 5(A), when the multimodal large-scale language model 322 receives a prompt 501 indicating the content of the instruction to the model, it outputs text that has a high probability of matching the prompt 501 as product 502. In the specific example in Figure 5(A), when prompt 503 is input to the multimodal large-scale language model 322, product 504 is output.

[0058] Furthermore, as shown in Figure 5(B), the multimodal large-scale language model 322 can also output text with a high probability of matching image 505 and prompt 506 as product 507 when image 505 and prompt 506 are input. In the specific example in Figure 5(B), product 510 is output when image 508 and prompt 509 are input to the multimodal large-scale language model 322. Specific examples of the multimodal large-scale language model 322 include ChatGPT (https: / / chat.openai.com) or Gemini (https: / / gemini.google.com). In this embodiment, any multimodal large-scale language model can be used.

[0059] Furthermore, the multimodal large-scale language model 322 can output one or more products based on a prompt containing multiple instructions and multiple images, not limited to the examples described above.

[0060] Figure 6 shows an example of the editing screen of the poster creation application 300. The poster creation application 300 performs some editing processes related to the design data in response to operations performed by the operator (hereinafter referred to as the user) via the editing screen.

[0061] The editing screen shown in Figure 6 is displayed on the host PC 101's display via the poster creation application 300 by the display control unit 301. The editing screen shown in Figure 6 displays the design editing area 600. The editing screen shown in Figure 6 is also provided with a translate button 601, a save button 602, an output button 603, an image add button 604, a text add button 605, and a text layout change button 606.

[0062] The design editing area 600 displays the design data being edited. The design data editing unit 310 performs changes to the position of objects and the size of the areas occupied by objects, etc., included in the design data displayed in the design editing area 600, based on the user's editing operations and various inputs received by the operation unit 302.

[0063] Additionally, to add an image object or text object to the design data being edited in the design editing area 600, the user presses the image add button 604 or the text add button 605.

[0064] If the image addition button 604 is pressed, the poster creation application 300 will, for example, call a file dialog (not shown), specify the file path, and perform the import process. If the text addition button 605 is pressed, the poster creation application 300 will, for example, create a new text object and display the created text object within the design editing area 600.

[0065] In addition to the image addition button 604 and the text addition button 605, buttons for adding other types of objects to the design data being edited may also be provided on the editing screen shown in Figure 6.

[0066] Furthermore, the import source for the import process triggered by pressing the image addition button 604 is not limited to files on the host PC 101, but may also be a folder on an external cloud or a social networking service that allows image uploads. In addition, the poster creation application 300 may accept content additions via drag-and-drop to the design editing area 600 through the editing screen.

[0067] To translate the text in a text object included in the design data being edited, the user presses the translate button 601. To save the design data being edited, the user presses the save button 602. The design data at the time the save button 602 is pressed is then saved to the design database 321. By pressing the output button 603, the poster creation application 300 can also output the design data being edited in PDF or JPEG format. To change the typesetting of the text elements in a text object included in the design data being edited, the user presses the typesetting change button 606.

[0068] Figure 3 illustrates an example of a configuration in which the service server 102 includes a design data editing unit 310, a text translation unit 313, an emphasis element identification unit 314, and a character typesetting modification unit 315. The configuration of the service server 102 in this embodiment is not limited to this configuration. The poster creation application 300 on the host PC 101 may include the functions of the design data editing unit 310, the text translation unit 313, the emphasis element identification unit 314, and the character typesetting modification unit 315. That is, the poster creation application 300 on the host PC 101 may be configured to execute the character typesetting modification process described later, which is performed on the service server 102.

[0069] <Processing Sequence> Figure 7 is a sequence diagram showing an example of processing performed on the host PC 101 and the service server 102. Referring to Figure 7, the flow of processing between the host PC 101 and the service server 102 will be explained. Specifically, the process of updating the display of design data in the poster creation application 300 based on the results of the character typesetting change processing performed on the service server 102 in response to a character typesetting change instruction will be explained.

[0070] The design data generated in response to user editing operations via the poster creation application 300 is stored in the design database 321 of the service server 102 and is managed by the service server 102. In this embodiment, the design data is stored in the design database 321 of the service server 102, but the storage location of the design data is not limited to this. The design data may be stored, for example, in an external storage device or cloud storage managed by the service server 102. The above-mentioned information on typesetting change instructions is managed by the host PC 101.

[0071] In S701, the operation unit 302 of the poster creation application 300 receives text layout change instructions from the user via the display / operation I / F 206. The text layout change instructions include information indicating whether or not to unify the font size of the text elements in a text object (hereinafter referred to as font size unification instruction information). The text layout change instructions also include information indicating whether or not to vary the font size between the text elements in a text object (hereinafter referred to as font size variation instruction information). In this embodiment, the example given is changing the font size as a text layout, but the text layout may also be changed to change the font color, font type, bold formatting, italic formatting, or underline formatting.

[0072] Figure 8 shows an example of the editing screen of the poster creation application 300 before and after the execution of a process that changes the character layout of the text elements of a text object included in the design data being edited. Referring to Figure 8, an example of changing the character layout of the text elements of a text object included in the design data being edited will be explained.

[0073] Figure 8(A) is a diagram showing an example of the editing screen that appears when the text layout change button 606 is pressed in the editing screen shown in Figure 6. As shown in Figure 8(A), when the text layout change button 606 is pressed, the text layout change setting area 801 is displayed on the editing screen. The text layout change setting area 801 is provided with a setting item 802 that can accept an instruction to unify the font size of the text elements within a text object (hereinafter referred to as a font size unification instruction). The text layout change setting area 801 is also provided with a setting item 803 that can accept an instruction to add emphasis to the font size between the text elements within a text object (hereinafter referred to as a font size emphasis instruction).

[0074] Furthermore, the character typesetting change setting area 801 is provided with an execution button 804 that accepts a character typesetting change instruction along with the setting value corresponding to each setting item provided in the character typesetting change setting area 801. The character typesetting change setting area 801 is also provided with a close button 805 that accepts an instruction to close the character typesetting change setting area 801. Figure 8(A) shows the state where the font size and weight instruction is set in setting item 803.

[0075] In S702, upon pressing the execute button 804, the data transmission unit 303 of the poster creation application 300 transmits information including a text layout change instruction (hereinafter referred to as text layout change instruction information) to the service server 102. The text layout change instruction information includes a font size unification instruction and a font size emphasis instruction. The text layout change instruction information also includes an identification ID for identifying the design data being edited.

[0076] In S703, the service server 102 executes a character typesetting modification process (hereinafter referred to as the character typesetting modification process) of the text elements of the text objects included in the design data, based on the character typesetting modification instruction information received in S702. Details of the character typesetting modification process executed by the service server 102 are explained in Figure 10.

[0077] In S704, the data transmission unit 311 of the service server 102 sends the result of the character typesetting change process performed in S703 to the poster creation application 300 on the host PC 101.

[0078] In S705, the display control unit 301 of the poster creation application 300 updates the design data being edited displayed on the editing screen based on the result of the character typesetting change process received in S704. For example, as shown in Figure 8(B), the display control unit 301 updates the display of the design data being edited. Specifically, as shown in Figure 8(B), the font size of the word "Sale" among the text elements of the text object 812 is larger than the font sizes of the other words, "Year-End" and "Clearance".

[0079] As shown in the above processing sequence, the host PC 101 poster creation application 300 can send information including the received text typesetting change instruction to the service server 102 and update the display of the design data based on the result corresponding to the instruction.

[0080] <Processing flow of host PC 101> Figure 9 is a flowchart showing an example of the process by which the poster creation application 300 on the host PC 101 in this embodiment receives a text typesetting change instruction and updates the display of design data. The process shown in Figure 9 is realized when the CPU 201 of the host PC 101 reads the program of the poster creation application 300 stored in ROM 202 or HDD 204 into RAM 203, and the CPU 201 executes it. Note that some or all of the functions of the steps in Figure 9 may be realized by hardware such as an ASIC or electronic circuit. The symbol "S" in the description of each process means that it is a step in the flowchart (the same applies to flowcharts in this specification hereafter).

[0081] Furthermore, the process shown in Figure 9 is initiated when the text layout change button 606, located on the editing screen of the poster creation application 300, is pressed. The flow shown in Figure 9 includes S702 and S705 shown in Figure 7. The processes S901 to S908 shown in Figure 9 are included in the process S701 shown in Figure 7.

[0082] In S901, the CPU 201, via the display control unit 301, displays a text layout change setting area on the editing screen of the poster creation application 300.

[0083] In S902, the CPU 201 determines whether the close button, which accepts the instruction to close the character typesetting change setting area, has been pressed by the operation unit 302. If the CPU 201 determines that the close button has been pressed (Yes) by the operation unit 302, it proceeds to S903. If the CPU 201 determines that the close button has not been pressed (No) by the operation unit 302, it proceeds to S904.

[0084] In S903, the CPU 201, via the display control unit 301, closes the character typesetting setting area displayed on the editing screen of the poster creation application 300, and terminates this flow.

[0085] In S904, the CPU 201 determines, via the operation unit 302, whether or not the execution button in the character typesetting change setting area, which accepts the transmission of character typesetting change instruction information, has been pressed. If the CPU 201 determines, via the operation unit 302, that the execution button in the character typesetting change setting area has been pressed (Yes), it proceeds to S905. If the CPU 201 determines, via the operation unit 302, that the execution button in the character typesetting change setting area has not been pressed (No), it returns to S901.

[0086] In S905, the CPU 201 obtains setting information indicating the settings of the character typesetting change setting area via the operation unit 302, and proceeds to S906. The setting information obtained in S905 includes font size unification instruction information and font size strength instruction information.

[0087] In S906, the CPU 201 uses the operation unit 302 to detect errors in the configuration information acquired in S905, and then proceeds to S907.

[0088] In S907, the CPU 201, using the operation unit 302, determines whether or not there is an error in the configuration information acquired in S905, based on the result of error detection performed in S906. Specifically, if the configuration information acquired in S905 does not have a font size unification instruction set in the font size unification instruction information, and does not have a font size strength instruction set in the font size strength instruction information, then the CPU 201, using the operation unit 302, determines that there is an error in the configuration information acquired in S905.

[0089] If the configuration information acquired by S905 indicates that the font size unification instruction is set, or that the font size strength instruction is set, then the CPU 201, using the operation unit 302, determines that there are no errors in the configuration information acquired by S905.

[0090] In S907, the CPU 201, via the operation unit 302, determines that there is an error in the configuration information obtained in S905 (Yes), and proceeds to S908. If it determines that there is no error in the configuration information obtained in S905 (No), it proceeds to S702.

[0091] In S908, the CPU201, via the display control unit 301, displays the error details on the character typesetting change setting area and returns to S901. For example, in S908, the CPU201, via the display control unit 301, displays a dialog box containing an error message such as "No setting item has been selected."

[0092] In S702, the CPU 201 transmits the character typesetting change instruction information to the service server 102 via the data transmission unit 303, and proceeds to S909. The character typesetting change instruction information in this embodiment includes font size unification instruction information and font size strength instruction information. The character typesetting change instruction information also includes an identification ID in the design database 321 for identifying the design data being edited in the poster creation application 300 on the host PC 101.

[0093] In S909, the CPU 201 receives the result of the character typesetting change processing corresponding to the character typesetting change instruction information transmitted by the data transmission unit 303 in S702 from the service server 102 via the data reception unit 304, and proceeds to S705. In other words, the processing in S909 corresponds to the processing in S704.

[0094] In S705, the CPU 201, via the display control unit 301, updates the design data being edited displayed on the editing screen of the poster creation application based on the result of the text layout change processing received by the data receiving unit 304 in S909, and returns to S901. Specifically, in S705, the CPU 201, via the display control unit 301, replaces the design data being edited with the design data after the text layout change processing. The CPU 201 can also retain the design data being edited and read the design data after the text layout change processing. The CPU 201, via the display control unit 301, may display both the design data being edited and the design data after the text layout change processing on the editing screen of the poster creation application. Alternatively, the CPU 201 may not display the design data after the text layout change processing on the editing screen of the poster creation application, but instead send it directly to a printer (not shown) for printing.

[0095] <Processing flow of service server 102> Figure 10 is a flowchart showing an example of the character typesetting change process performed by the service server 102 in this embodiment. The flow shown in Figure 10 includes S704 shown in Figure 7. S1001 to S1009 shown in Figure 10 are included in S703 shown in Figure 7.

[0096] The process shown in Figure 10 is achieved when the CPU 211 reads the control program stored in the ROM 212 and HDD 214 into the RAM 213, and then the CPU 211 executes it. The process shown in Figure 10 is also initiated when the data receiving unit 312 of the service server 102 receives text typesetting change instruction information from the poster creation application 300 on the host PC 101.

[0097] In S1001, the CPU 211 uses the emphasis element identification unit 314 to identify the design purpose of the design data corresponding to the character typesetting change instruction information received by the data receiving unit 312. The design purpose refers to the purpose for which the design data is created, such as event promotion, sales promotion, or awareness campaigns. In S1001, the emphasis element identification unit 314 uses the multimodal large-scale language model 322 to identify the design purpose. In S1001, the emphasis element identification unit 314 generates a prompt to cause the multimodal large-scale language model 322 to perform design purpose estimation. Specifically, the emphasis element identification unit 314 generates a prompt as follows:

[0098] "Please estimate the intended use of this design and output it in 20 characters or less." Furthermore, the emphasis element identification unit 314 acquires a rendered image obtained by rendering the design data. The emphasis element identification unit 314 acquires the design usage estimation result (usage information) by inputting the rendered image of the design data and the prompt described above into the multimodal large-scale language model 322. For example, by inputting the rendered image of the design data shown in Figure 8(A) and the prompt described above into the multimodal large-scale language model 322, the emphasis element identification unit 314 can obtain the following text as the design usage estimation result.

[0099] "Advertisement for year-end inventory clearance sale" The emphasis element identification unit 314 can identify the design use of the design data based on the estimated design use results obtained by inputting the generated prompt and the rendered image of the design data into the multimodal large-scale language model 322.

[0100] The method for estimating design use is not limited to the method described above. For example, the emphasis element identification unit 314 generates a second prompt by adding text included in the design data to the first prompt, which is a prompt for performing the design use estimation described above. The emphasis element identification unit 314 may then obtain the design use estimation result by inputting the image included in the design data and the second prompt to the multimodal large-scale language model 322 instead of the rendered image of the design data.

[0101] In S1002, the emphasis element identification unit 314 obtains the text object included in the design data and proceeds to S1003.

[0102] In S1003, the CPU 211, using the character typesetting unit 315, changes the font size of all elements of the text in the text object acquired in S1002 to the initial font size. The initial font size is the maximum font size required to fit all elements within the area of ​​the text object when setting the font size of all elements of the text in the text object to a uniform value within that text object.

[0103] The initial font size can be derived using Equation 1 below. Note that in the following equation, " / " means dividing the value before " / " by the value after " / ".

[0104] Formula 1: Initial font size = √(Area of ​​the text object's area / Number of characters in the text object's text) For example, if the size of the area occupied by a text object is (500, 60) and all the characters of the text contained within that text object are "ABC PRESENTS", then the initial font size can be derived as √(500 × 60 / 12) = 50.

[0105] Furthermore, if the unit of the text area size is px (pixels), it is possible to convert the initial font size unit to pt (points) using the following formula 2.

[0106] Formula 2: pt (points) = px × 72 / DPI (Dots Per Inch) DPI is a numerical value indicating image resolution, and a value of 96 or 300 is used. Then, in the data table for the acquired text object, the font size of all characters is changed to the derived initial font size. Note that the method for deriving the initial font size is not limited to the method described above. For example, assuming that the text contained in the text object will have line breaks (line spacing) between each word in the text area, the following equation 3 may be used.

[0107] Equation 3: Initial font size = √((Area of ​​text area) / (Number of characters in the text object × Number of words in the text)) In S1004, the CPU 211 uses the emphasis element identification unit 314 to determine whether the character typesetting change instruction information includes font size emphasis instructions. If the CPU 211 determines in S1003 that the character typesetting change instruction information includes font size emphasis instructions (Yes), the process proceeds to S1005. If the CPU 211 determines in S1003 that the character typesetting change instruction information does not include font size emphasis instructions (No), the process proceeds to S1009.

[0108] In S1005, the CPU 211 uses the emphasis element identification unit 314 to identify the element to be emphasized among the text elements of the text object obtained in S1002.

[0109] The method for identifying elements to be emphasized (hereinafter referred to as emphasis elements or emphasis words) utilizes a multimodal large-scale language model 322. Specifically, the emphasis element identification unit 314 generates prompts to cause the multimodal large-scale language model 322 to estimate emphasis elements based on the prompt indicating the design use obtained in S1001 and the text contained in the text object. For example, if the emphasis element identification unit 314 obtains the text object 812 shown in Figure 8(A) from the design data in S1002, it generates prompts as follows. In this embodiment, the emphasis element identification unit 314 will be explained using the example of identifying emphasis elements word by word in the text elements contained in the text object.

[0110] "I'm creating a design for an advertisement for a year-end clearance sale. Which words in the following text should be emphasized? Please categorize each word as high or low in emphasis." "Year-End Clearance Sale" By inputting the above prompt into the multimodal large-scale language model 322, the following emphasis element estimation results (emphasis element information) can be obtained.

[0111] "High: Year-End, Clearance", "Low: Sale" Furthermore, if the emphasis element identification unit 314 obtains the text object 811 shown in Figure 8(A) from the design data in S1002, it generates the following prompt.

[0112] "We're creating a design for an advertisement for a year-end clearance sale. Which words in the following text should be emphasized? Please categorize each word into high and low emphasis levels." "ABC PRESENTS" By inputting the above prompts into the multimodal large-scale language model 322, the following estimation results for emphasis elements can be obtained.

[0113] "High: None", "Low: ABC, PRESENTS" Thus, if there are no words that can be classified as "high" or "low" in terms of the degree to which they should be emphasized, the emphasis element identification unit 314 determines that there are no emphasis words in the text.

[0114] Here, we will describe another example of the result of estimating the emphasis element. For example, the emphasis element identification unit 314 generates the following prompt corresponding to the text "All items in the store 30% OFF".

[0115] "I'm creating a design for an advertisement for an end-of-year clearance sale. Which words in the following text should be emphasized? Please categorize each word as high or low in emphasis." "All items in the store 30% OFF" By inputting the above prompts into the multimodal large-scale language model 322, the following estimation results for emphasis elements can be obtained.

[0116] "High: 30%, OFF", "Low: All, items, in, the, store" Furthermore, if the design purpose is "to raise awareness of traffic safety," the emphasis element identification unit 314 can generate a prompt corresponding to the text "Pedestrians have priority at crosswalks," such as the following:

[0117] "We will create a design aimed at raising awareness of traffic safety. Which words in the following text should be emphasized? Please classify the degree of emphasis for each word as high or low." "Pedestrians have priority at crosswalks." By inputting the above prompts into the multimodal large-scale language model 322, the following estimation results for emphasis elements can be obtained.

[0118] "High: Pedestrian priority," "Low: Crosswalks are..." In this way, the emphasis element identification unit 314 generates a prompt based on the design purpose identified in S1001 and the text acquired in S1002. The emphasis element identification unit 314 can then identify the emphasis elements from the text based on the emphasis element estimation results obtained by inputting the generated prompt into the multimodal large-scale language model 322.

[0119] The method for identifying emphasis elements is not limited to the method described above. For example, an administrator managing the service server 102 may store design purposes and the emphasis elements associated with those design purposes in the design database 321 in advance. The emphasis element identification unit 314 may then identify the emphasis elements by determining whether the emphasis elements associated with the design purposes identified in S1001 are included in the text obtained in S1002.

[0120] In S1006, the CPU 211, using the character typesetting unit 315, changes the font size of all elements of the text in the text object acquired in S1002 based on the emphasis elements identified in S1005. Specifically, the character typesetting unit 315 obtains the font size of the characters corresponding to words other than the emphasis word in the text object data table of the text object acquired in S1002. Then, the character typesetting unit 315 reduces the font size of the characters corresponding to words other than the emphasis word by 1pt (reduced font size). Next, the character typesetting unit 315 changes the font size of the characters corresponding to the emphasis word to a font size that is 1.5 times the reduced font size (emphasized font size).

[0121] For example, in the text object 812 shown in Figure 8(A), the character typesetting unit 315 changes the font size of "Sale" to 21pt if the reduced font size of "Year-End" and "Clearance" is 14pt. Note that the font size reduction amount does not have to be 1pt. For example, the font size reduction amount may be 2pt or 0.5pt. Also, the emphasized font size does not have to be 1.5 times the reduced font size, as long as it is larger than the reduced font size. For example, the emphasized font size may be twice the reduced font size, or 4pt larger than the reduced font size.

[0122] In S1007, the CPU 211 uses the character layout modification unit 315 to arrange all elements whose font size was changed in S1006 within the area of ​​the text object. Specifically, the character layout modification unit 315 arranges words with the reduced font size and words with the emphasized font size in order within the area of ​​the text object.

[0123] In S1008, the CPU 211 uses the character layout modification unit 315 to determine whether all elements placed in S1007 fit within the area of ​​the text object obtained in S1002. For example, in S1008, the character layout modification unit 315 determines that not all elements fit within the text area if, when all elements are placed within the text area in S1007, some or all of the elements are placed outside the text area. On the other hand, in S1008, the character layout modification unit 315 determines that all elements fit within the text area if all elements are placed within the text area.

[0124] The method for determining whether all elements fit within the text area is not limited to those described above. For example, the character typesetting unit 315 derives the area required for the text composed of elements with reduced font size and elements with emphasized font size. The character typesetting unit 315 may then determine that all elements do not fit within the text area if the derived area is larger than the area of ​​the text object obtained in S1002.

[0125] As a concrete example, the area required for the text mentioned above can be derived as (reduced font size^2 × number of characters in words other than the emphasized word) + (emphasized font size^2 × number of characters in the emphasized word).

[0126] If, in S1008, the CPU 211 determines that all elements fit within the text area (Yes) based on the character formatting change unit 315, the process proceeds to S1009. If, in S1008, the CPU 211 determines that all elements do not fit within the text area (No) based on the character formatting change unit 315, the process returns to S1006.

[0127] In S1009, the CPU 211 determines, using the character typesetting unit 315, whether all text objects in the design data have been processed. If the CPU 211 determines in S1009 that all text objects have been processed (Yes), the process proceeds to S704. If the CPU 211 determines in S1009 that there are unprocessed text objects in the design data (No), the process returns to S1002.

[0128] In S704, the CPU 211, via the data transmission unit 311, sends the result of the character typesetting change process to the poster creation application 300 on the host PC 101, and this flow ends.

[0129] In the example shown in Figure 8, text objects 812 and 813 shown in Figure 8(A) are changed to text objects 822 and 823 shown in Figure 8(B), respectively. In this case, the emphasis elements in the text of each text object are displayed with a larger font size than the font size of the other elements. Also, as can be seen from text object 811 shown in Figure 8(A) and text object 821 shown in Figure 8(B), if it is determined that there are no emphasis elements in the text, all elements of that text are displayed with a uniform font size.

[0130] According to this embodiment, the service server automatically identifies emphasis elements from among the text elements of text objects included in the design data, and changes the character set of the emphasis elements word by word based on the identified emphasis elements. As a result, when the design data is displayed on the editing screen of the poster creation application, emphasis elements are automatically identified and displayed from among the text elements of text objects included in the design data. Therefore, when displaying the design data, the visibility of emphasis elements in the text can be improved without accepting input from the user for elements to be emphasized.

[0131] In this embodiment, to improve the visibility of emphasis elements in text, an example was given of changing the typesetting of text elements so that the emphasis elements are larger than the non-emphasized elements. Specifically, in the font size change process in S1006 described above, an example was given of changing the font size of the emphasized word to a larger font size than the font size of the non-emphasized words, but the typesetting change process is not limited to this. For example, the font size change process in S1006 described above may be replaced with a process that changes another type of typesetting so that the emphasis elements are emphasized relatively to the non-emphasized elements. Specifically, the process of changing the font size may be replaced with a process that changes the font color, font type, bold formatting, italic formatting, or underline formatting. This creates options for how to emphasize emphasis elements relatively to the non-emphasized elements in text, making it possible to effectively emphasize text elements depending on the type of design data or design purpose.

[0132] <<Second Embodiment>> In the first embodiment, an example was given in which emphasis elements were automatically identified from among the text elements of a text object included in the design data, and the character typesetting of those elements was changed word by word based on the identified emphasis elements. In other words, in the first embodiment, the character typesetting of the text elements of all text objects included in the design data is changed. However, there are users who wish to change the character typesetting of the text elements of selected text objects from among the text objects included in the design data. Therefore, in this embodiment, an example of changing the character typesetting of the text elements of selected text objects from among the text objects included in the design data will be described. Note that the basic configuration of the host PC and service server in this embodiment is the same as the configurations in the first embodiment, so a detailed explanation will be omitted. The differences from the first embodiment will be described below.

[0133] <Processing Sequence> In this embodiment, at S701 in Figure 7, the operation unit 302 of the poster creation application 300 receives a text typesetting change instruction from the user via the display / operation I / F 206. The text typesetting change instruction information in this embodiment further includes information indicating whether or not the selected text object should be subject to the text typesetting change process (hereinafter referred to as processing target instruction information). Furthermore, if the processing target instruction information indicates that the selected text object should be subject to the text typesetting change process, the text typesetting change instruction information includes information indicating the selected text object.

[0134] Figure 11 shows an example of the editing screen of the poster creation application 300 with the character typesetting change setting area 1101 displayed in this embodiment. As shown in Figure 11(A), the character typesetting change setting area 1101 is provided with a setting item 1102 that can receive instructions to make the text object selected via the editing screen the target of the character typesetting change process. Figure 11(A) shows the state in which the setting item 1102 provided in the character typesetting change setting area 1101 is selected and the text object 1111 is selected as the target of the character typesetting change process. Also, Figure 11(A) shows the state in which the setting item 802 is not selected and the setting item 803 is selected.

[0135] If setting item 1102 is selected, in S701 of Figure 7, the operation unit 302 of the poster creation application 300 accepts the selection of one or more objects from among the objects included in the design data displayed in the design editing area 1100. In this embodiment, when setting item 1102 is selected, the operation unit 302 will be explained using text as an example of the type of object that can be accepted by the operation unit 302. That is, when setting item 1102 is selected, the operation unit 302 can accept the selection of text objects from among the objects included in the design data, but it will not accept the selection of objects of any type other than text.

[0136] Furthermore, if setting item 1102 is selected, the operation unit 302 may accept objects of a type other than text, such as images or graphics. In this case, if the operation unit 302 accepts the selection of an object of a type other than text, the display control unit 301 may display a warning message in a dialog box to warn the user to select an object whose type is text.

[0137] <Processing flow of host PC 101> In this embodiment, at S905 in Figure 9, the CPU 201 obtains setting information indicating the settings of the character typesetting change setting area 1101 via the operation unit 302. The setting information in this embodiment includes processing target instruction information. Alternatively, the setting information in this embodiment further includes information indicating the selected text object. In addition, the setting information in this embodiment also includes font size unification instruction information and font size strength instruction information.

[0138] In this embodiment, in S906, the CPU 201 uses the operation unit 302 to detect errors in the setting information acquired in S905. Specifically, if the setting information acquired in S905 does not include either a font size unification instruction or a font size strength instruction, the CPU 201 uses the operation unit 302 in S906 to determine that there is an error in the setting information acquired in S905.

[0139] Furthermore, if the configuration information obtained in S905 includes an instruction to make the text object selected via the editing screen the target of the character typesetting change process, but does not include information indicating the text object that is the target of the character typesetting change process, then in S906, the CPU 201 determines via the operation unit 302 that there is an error in the configuration information obtained in S905.

[0140] In this embodiment, at S908 in Figure 9, the CPU 201 displays the setting value error details on the character typesetting change setting area via the display control unit 301. For example, if the setting information acquired in S905 includes an instruction to make the text object selected via the editing screen the target of the character typesetting change process, but does not include information indicating the text object that is the target of the character typesetting change process, then at S908, the CPU 201 displays an error message such as "No target for character typesetting change has been selected" in a dialog box via the display control unit 301.

[0141] <Processing flow of service server 102> Figure 12 is a flowchart illustrating the process performed by the service server 102 in this embodiment. Steps S1001 to S1009 and S1201 shown in Figure 12 are included in S703 shown in Figure 7. The process shown in Figure 12 is initiated when the data receiving unit 312 of the service server 102 receives text typesetting change instruction information from the poster creation application 300 on the host PC 101. The differences between the flowchart in this embodiment (Figure 12) and the flowchart in the first embodiment (Figure 10) are described below. Compared to the flowchart in Figure 10, the flowchart in Figure 12 includes the addition of step S1201.

[0142] In S1201, the CPU 211 uses the emphasis element identification unit 314 to determine whether the text object acquired in S1002 is designated as a target for character typesetting change processing in the character typesetting change instruction information.

[0143] In S1201, the CPU 211, using the emphasis element identification unit 314, determines that the text object obtained in S1002 is designated as a target for character typesetting change processing (Yes), and proceeds to S1003. In S1201, the CPU 211, using the emphasis element identification unit 314, determines that the text object obtained in S1002 is not designated as a target for character typesetting change processing (No), and proceeds to S1009. In other words, for text objects that are not designated as targets for character typesetting change processing, the service server 102 does not execute the processes from S1003 to S1008. That is, for text objects that are not designated as targets for character typesetting change processing, the process of changing to the initial font size in S1003, the process of identifying emphasis elements in S1005, and the process of changing the character typesetting of emphasis elements in S1006 are not executed.

[0144] In the example shown in Figure 11, a text formatting change process is performed on the text object 1111 shown in Figure 11(A). After the text formatting change process is performed, the text object 1111 shown in Figure 11(A) is converted to the text object 1121 shown in Figure 11(B). On the other hand, the text object 1112, which is not subject to the text formatting change process, does not undergo the process.

[0145] According to this embodiment, the typesetting of the text elements of selected text objects within the design data can be changed. In other words, the typesetting change process is performed on the text objects selected by the user, and the typesetting change process is not performed on text objects not selected by the user. This improves the usability of the poster creation application.

[0146] <<Third Embodiment>> In the first embodiment, we described an example in which emphasis elements are automatically identified from the text elements of a text object included in the design data, and the character typesetting of those elements is changed word by word based on the identified emphasis elements. However, the result of the character typesetting change process may not be what the user expects. Therefore, in this embodiment, we will describe an example in which the character typesetting change process is re-executed by re-identifying the emphasis elements using the design data after the character typesetting change process. Note that the basic configuration of the host PC and service server in this embodiment is the same as the configurations in the first embodiment, so a detailed explanation will be omitted. The differences from the first embodiment will be described below.

[0147] <Processing flow of host PC 101> Figure 13 shows an example of the editing screen of the poster creation application 300 to illustrate the process of re-executing the text layout change process. Figure 13(A) shows the editing screen of the poster creation application 300 with the design data displayed as a result of the text layout change process.

[0148] The processing flow of the host PC 101 in this embodiment is the same as the flow shown in Figure 9 (first embodiment). In this embodiment, at S904 in Figure 9, the CPU 201 determines whether or not the execution button provided in the character typesetting change setting area has been pressed by the operation unit 302.

[0149] If, in S904, the CPU 201 determines via the operation unit 302 that the execute button in the character typesetting change setting area has been pressed (Yes), the process proceeds to S905. If, in S904, the CPU 201 determines via the operation unit 302 that the execute button in the character typesetting change setting area has not been pressed (No), the process returns to S901.

[0150] In this embodiment, a process to display a redo button in the character typesetting setting area may be added after S705 shown in Figure 9. The redo button in this embodiment is a button for receiving a command to redo the character typesetting process. The redo of the character typesetting process will be explained later.

[0151] In this case, in S904 after the display of the redo button, the CPU 201 may further determine, via the operation unit 302, whether or not the redo button provided in the character typesetting change setting area has been pressed. Specifically, in S904 after the display of the redo button, if the CPU 201 determines via the operation unit 302 that the redo button provided in the character typesetting change setting area has been pressed (Yes), the process proceeds to S905. In S904 after the display of the redo button, if the CPU 201 determines via the operation unit 302 that the redo button provided in the character typesetting change setting area has not been pressed (No), the process returns to S901. Figure 13(B) shows the editing screen of the poster creation application 300 with the redo button 1300 displayed in the character typesetting change setting area. Note that if the redo button is pressed, the character typesetting change instruction information transmitted by the data transmission unit 303 may include information indicating an instruction to redo the character typesetting change process.

[0152] <Processing flow of service server 102> Figure 14 is a flowchart showing an example of the processing performed by the service server 102 in this embodiment. Referring to Figure 14, the flow of the re-execution of the character typesetting change processing by the service server 102 will be explained.

[0153] The steps S1001 to S1004, S1006 to S1009, S1401, and S1402 shown in Figure 14 are included in S703 shown in Figure 7. The process shown in Figure 14 is started when the data receiving unit 312 of the service server 102 receives text typesetting change instruction information from the poster creation application 300 on the host PC 101. The differences between the flowchart in this embodiment (Figure 14) and the flowchart in the first embodiment (Figure 10) will be explained below.

[0154] The flowchart shown in Figure 14, compared to the flowchart shown in Figure 10, has the process at S1005 removed and processes at S1401 and S1402 added.

[0155] In S1401, the CPU 211 uses the emphasis element identification unit 314 to obtain emphasized elements (hereinafter referred to as emphasized elements or emphasized words) in all text objects included in the design data. Specifically, in S1401, the CPU 211 uses the emphasis element identification unit 314 to obtain the word containing the character with the largest font size as the emphasized word in the text object data table for each text object included in the design data.

[0156] Note that the method for obtaining highlighted elements is not limited to the method described above. For example, the highlighted element identification unit 314 may store highlighted elements in the design database 321 for each text object. Then, the highlighted element identification unit 314 may retrieve highlighted elements from the design database 321. Alternatively, the highlighted element identification unit 314 may obtain highlighted elements not by their size, but by their color, font type, bold formatting, italic formatting, or underline formatting, which differ from other elements.

[0157] In S1402, the CPU 211 uses the emphasis element identification unit 314 to re-identify the emphasis elements of the text. The multimodal large-scale language model 322 is used for the re-identification of emphasis elements. In S1402, the CPU 211 uses the emphasis element identification unit 314 to generate a prompt for the multimodal large-scale language model 322 to perform re-estimation of emphasis elements, based on the design purpose identified in S1001, the emphasized elements obtained in S1402, etc.

[0158] Figure 15 shows an example of prompts and results of re-estimating emphasis elements for the multimodal large-scale language model 322. Figure 15(A) shows prompt 1501 for re-estimating emphasis elements for the results of the character typesetting process shown in Figure 13(A). Prompt 1501 includes instruction 1502, input text 1503, and output format 1504. Output format 1504 reflects the emphasized words obtained from the results of the character typesetting process shown in Figure 13(A). Instruction 1502 in Figure 15(A) instructs the model to output an output result other than that shown in output format 1504.

[0159] Figure 15(B) shows the re-estimation results of emphasis elements output by the multimodal large-scale language model 322 when the prompt 1501 shown in Figure 15(A) is input. In the re-estimation result of emphasis elements 1505, the output result of emphasis words is different from the emphasis words shown in the output format 1504 of Figure 15(A). In this way, the emphasis element identification unit 314 can re-identify emphasis elements from among the elements of the text based on the results of the re-estimation by causing the multimodal large-scale language model 322 to re-estimate the emphasis elements.

[0160] Note that the method for reestimating the emphasis element is not limited to the method described above. For example, in the method described above, it is sufficient that a different emphasis element is estimated for at least one of the text objects. Alternatively, by reestimating the emphasis element for each text object, a different emphasis element may be estimated for all text objects.

[0161] In the example shown in Figure 13, text objects 1301 and 1303 shown in Figure 13(A) are changed to text objects 1311 and 1313 shown in Figure 13(D) respectively when the character typesetting change process is re-executed. On the other hand, the character typesetting change process is not re-executed for text object 1302 shown in Figure 13(A).

[0162] Specifically, in the example shown in Figure 13(D), "Year-End," which was identified as a highlighted word in S1402, is displayed larger than "Clearance" and "Sale," which were not identified as highlighted words in S1402. That is, the font size of "Sale," which was identified as a highlighted word in S1401 but not identified as a highlighted word in S1402, is changed to the reduced font size by the character typesetting unit 315 in S1006. Also, the font size of "Year-End," which was not identified as a highlighted word in S1401 but was identified as a highlighted word in S1402, is changed to the highlighted font size by the character typesetting unit 315 in S1006.

[0163] In other words, in the example shown in Figure 13(D), at S1006, the character typesetting unit 315 changes the font size of "Year-End" to emphasize "Year-End" in relation to other words in the text, including "Sale". Also, in the example shown in Figure 13(D), at S1006, the character typesetting unit 315 changes the typesetting of "Clearance" and "Sale", which are words in the text other than "Year-End", so that they are not emphasized in relation to "Year-End". Specifically, as described above, at S1006, the character typesetting unit 315 changes the font size of "Year-End" to the emphasized font size, and changes the font size of "Clearance" and "Sale" to the reduced font size.

[0164] According to this embodiment, the emphasis elements are re-identified in such a way that the text objects included in the design data displayed on the editing screen of the poster creation application as a result of the text typesetting change process are excluded, and the text typesetting change process is executed. This makes it possible to obtain design data that matches the user's expectations, thereby improving the usability of the poster creation application.

[0165] In this embodiment, an example was described in which the text layout modification process is re-executed based on information indicating the emphasis elements of all text objects included in the design data, which is displayed on the editing screen of the poster creation application as a result of the text layout modification process. Note that, as shown in Figure 13(C), the text layout modification process may also be re-executed targeting selected text objects among the text objects included in the design data.

[0166] <<Fourth Embodiment>> In the first embodiment, an example was given of automatically identifying emphasis elements from the text elements of a text object included in design data, and changing the character typesetting of those elements word by word based on the identified emphasis elements. In this embodiment, an example is given of performing a character typesetting change process on the result of a translation of the text of a text object included in design data by a service server. Note that the basic configuration of the host PC and service server in this embodiment is the same as the configurations in the first embodiment, so a detailed explanation is omitted. The differences from the first embodiment will be described below.

[0167] <Processing flow of host PC 101> Figure 16 shows an example of the editing screen of a poster creation application to illustrate the flow of performing a text typesetting change process with text translation in this embodiment. Figure 16(A) shows an example of the editing screen of a poster creation application with the translation setting area 1601 displayed. The translation setting area 1601 is displayed in response to pressing the translation button 1600 in this embodiment. The translation setting area 1601 is provided with a setting item 1602 for setting the source language and a setting item 1603 for setting the destination language. The translation setting area 1601 is also provided with setting items 1604 and 1605. Note that the functions of setting items 1604 and 1605 are the same as the functions of setting items 802 and 803 shown in Figure 8, respectively, so their explanation is omitted.

[0168] The translation settings area 1601 is provided with an execute button 1606 and a close button 1607. When the execute button 1606 is pressed, the operation unit 302 of the poster creation application 300 receives a text formatting change instruction along with the setting values ​​corresponding to each setting item provided in the translation settings area 1601. In other words, when the execute button 1606 is pressed, the data transmission unit 303 of the poster creation application 300 transmits text formatting change instruction information including the settings in the translation settings area 1601.

[0169] When the close button 1607 is pressed, the display control unit 301 of the poster creation application 300 closes the translation setting area 1601. Figure 16(A) shows the state where "Japanese" is set in setting item 1602 and "English" is set in setting item 1603. Also, Figure 16(A) shows the state where setting item 1605 is selected.

[0170] Figure 17 is a flowchart showing an example of the process by which the poster creation application 300 on the host PC 101 in this embodiment receives a text typesetting change instruction and updates the display of the design data. In this embodiment, the flow of processing performed between the host PC 101 and the service server 102 is the same as the flow of processing shown in Figure 7. Steps S1701 to S1708 in Figure 17 are included in S701 in Figure 7. The processing shown in Figure 17 is started, for example, when the translation button 1600 shown in Figure 16(A) is pressed.

[0171] In S1701, the CPU 201, using the display control unit 301, displays the translation setting area 1601 on the editing screen of the poster creation application 300, and then proceeds to S1702.

[0172] In S1702, the CPU 201 determines whether the close button 1607 provided in the translation setting area 1601 has been pressed by the operation unit 302. If the CPU 201 determines in S1702 that the close button 1607 provided in the translation setting area 1601 has been pressed (Yes) by the operation unit 302, the process proceeds to S1703. If the CPU 201 determines in S1702 that the close button 1607 provided in the translation setting area 1601 has not been pressed (No) by the operation unit 302, the process proceeds to S1704.

[0173] In S1703, the CPU 201, via the display control unit 301, closes the translation settings area 1601 displayed on the editing screen of the poster creation application 300, and terminates this flow.

[0174] In S1704, the CPU 201 determines, via the operation unit 302, whether or not the execution button 1606 located in the translation setting area 1601 has been pressed. If the CPU 201 determines, via the operation unit 302, that the execution button 1606 located in the translation setting area 1601 has been pressed (Yes), the process proceeds to S1705. If the CPU 201 determines, via the operation unit 302, that the execution button 1606 located in the translation setting area 1601 has not been pressed (No), the process returns to S1701.

[0175] In S1705, the CPU 201 obtains setting information indicating the settings of the translation setting area 1601 via the operation unit 302 and proceeds to S1706. The setting information obtained in S1705 includes text translation instructions. Text translation instructions are instructions to translate the text contained in the text objects included in the design data from the first language to the second language. For example, if a language is set in either setting item 1602 or setting item 1603, the setting information may include text translation instructions. Also, if a language is not set in either setting item 1602 or setting item 1603, the setting information does not need to include text translation instructions.

[0176] Furthermore, the configuration information obtained in S1705 includes information indicating the source language and information indicating the target language. In addition, the configuration information obtained in S1705 includes font size uniformity instruction information and font size strength instruction information.

[0177] In S1706, the CPU 201 uses the operation unit 302 to detect errors in the configuration information acquired in S1705, and then proceeds to S1707.

[0178] In S1707, the CPU 201, using the operation unit 302, determines whether or not there is an error in the configuration information obtained in S1705, based on the result of the error detection performed in S1706. If the CPU 201, using the operation unit 302, determines in S1707 that there is an error in the configuration information obtained in S1705 (Yes), the process proceeds to S1708. For example, if the configuration information obtained in S1705 includes information indicating that the source language or target language is "not selected", the CPU 201, using the operation unit 302, determines in S1707 that there is an error in the configuration information. If the CPU 201, using the operation unit 302, determines in S1707 that there is no error in the configuration information obtained in S1705 (No), the process proceeds to S702.

[0179] In S1708, the CPU 201 displays the error details on the translation setting area 1601 via the display control unit 301 and returns to S1701. For example, the display control unit 301 displays a dialog box containing an error message such as "The target language for translation has not been selected."

[0180] In this embodiment, at S702, the CPU 201 transmits text layout change instruction information to the service server 102 via the data transmission unit 303, and proceeds to S909. The text layout change instruction information in this embodiment includes font size unification instruction information and font size emphasis instruction information. Furthermore, the text layout change instruction information in this embodiment includes an identification ID for identifying the design data being edited in the poster creation application 300 on the host PC 101 in the design database 321. In addition, the text layout change instruction information in this embodiment may include text translation instructions, information indicating the source language, and information indicating the destination language.

[0181] In this embodiment, at S909, the CPU 201 receives the result of the character typesetting change processing corresponding to the character typesetting change instruction information transmitted by the data transmission unit 303 in S702 from the service server 102 via the data reception unit 304, and proceeds to S705. The processing at S909 corresponds to the processing at S704.

[0182] In this embodiment, at S705, the CPU 201 updates the design data being edited, which is displayed on the editing screen of the poster creation application, based on the result of the character typesetting change process received by the display control unit 301 and the data receiving unit 304 at S909. Then, the CPU 201 returns to S1701 via the display control unit 301. At S705, the CPU 201 replaces the design data being edited with the design data after the character typesetting change process via the display control unit 301. The CPU 201 can retain the design data being edited and read the design data after the character typesetting change process, which includes text translation. The CPU 201 may then display both the design data being edited and the design data after the character typesetting change process, which includes text translation, on the editing screen of the poster creation application via the display control unit 301. Alternatively, the CPU 201 may send the design data after the character typesetting change process, which includes text translation, directly to the printer for printing without displaying it on the editing screen of the poster creation application.

[0183] <Processing flow of service server 102> Figure 18 is a flowchart showing an example of the character typesetting change process executed by the service server 102 in this embodiment. The flow shown in Figure 18 includes S704 shown in Figure 7. S1001 to S1009, S1601, and S1602 shown in Figure 18 are included in S703 shown in Figure 7. The process shown in Figure 18 is started when the data receiving unit 312 of the service server 102 receives character typesetting change instruction information from the poster creation application 300 on the host PC 101. The differences between the flowchart in this embodiment (Figure 18) and the flowchart in the first embodiment (Figure 10) will be explained below. Compared to the flowchart in Figure 10, the flowchart in Figure 18 includes the processes S1801 and S1802.

[0184] In S1801, the CPU 211 uses the text translation unit 313 to determine whether the character typesetting instruction information includes a text translation instruction. If the CPU 211 determines in S1801 that the character typesetting instruction information includes a text translation instruction (Yes), the process proceeds to S1802. If the CPU 211 determines in S1801 that the character typesetting instruction information does not include a text translation instruction (No), the process proceeds to S1003.

[0185] In S1802, the CPU 211 uses the text translation unit 313 to translate the text contained in the text object acquired in S1002, and proceeds to S1003. The multimodal large-scale language model 322 is used for text translation. The text translation unit 313 generates a prompt to cause the multimodal large-scale language model 322 to perform the translation. For example, if the text object 1611 shown in Figure 16(A) is acquired, the following prompt is generated.

[0186] Please translate the following text. "Grand Clearance Sale" By inputting the above prompt into the multimodal large-scale language model 322, the following text is obtained as a translation result.

[0187] "Year-End Clearance Sale" In S1802, the CPU 211, using the text translation unit 313, replaces the text contained in the text object acquired in S1002 with the text output as a translation result from the multimodal large-scale language model 322. Note that the method of text translation is not limited to the method described above.

[0188] For example, the text translation unit 313 may maintain a machine translation model that has been trained on a large number of pairs of pre-translation text and post-translation text, and use this machine translation model to translate the text contained in a text object. Alternatively, pairs of pre-translation text and post-translation text may be registered in the conversion database 323. Then, if the text contained in a text object is registered in the conversion database 323 as pre-translation text, the text translation unit 313 may replace that text with the post-translation text that is paired with the pre-translation text.

[0189] In the example shown in Figure 16, when the text formatting change process shown in Figure 18 is executed, the text object 1611 shown in Figure 16(A) is changed to the text object 1621 shown in Figure 16(B). Specifically, the text contained in the text object is translated from Japanese to English. Furthermore, the font size of the emphasized words in the text is displayed larger than the font size of the other words.

[0190] According to this embodiment, when translating the text contained in a text object within design data into any language, a character typesetting modification process is performed on the translation result. This makes it possible to improve the visibility of emphasis elements in the text even when translating the text contained in a text object.

[0191] In this embodiment, we have described, as an example, that when translating the text contained in a text object in design data into an arbitrary language, a character typesetting process is performed on the translation result. Alternatively, the service server 102 may obtain emphasis elements in the design data before text translation and identify the elements in the translated text that correspond to those obtained emphasis elements as emphasis elements.

[0192] Specifically, the service server 102 retrieves highlighted words from the design data before text translation, similar to S1401. Then, the service server 102 identifies the elements in the translated text that correspond to the highlighted words retrieved before translation as highlighted words. In this way, the service server 102 can identify the elements in the translated text that correspond to the highlighted elements in the design data before text translation as highlighted words.

[0193] <<Fifth Embodiment>> In the first embodiment, an example was given of automatically identifying emphasis elements from among the text elements of a text object included in design data, and changing the character setting of those elements word by word based on the identified emphasis elements. In this embodiment, an example is described of changing the character setting of the text elements when a part of the text of a text object included in design data being edited extends beyond the text area of ​​that text object. Note that the basic configuration of the host PC and service server in this embodiment is the same as the configurations in the first embodiment, so a detailed explanation is omitted. The differences from the first embodiment will be described below.

[0194] <Processing Sequence> Figure 19 is a sequence diagram showing an example of processing performed on the host PC 101 and the service server 102. The processing sequence of this system in this embodiment will be explained with reference to Figure 19. Compared to the processing sequence shown in Figure 7, the processing from S1901 to S1903 is added to the processing sequence shown in Figure 19.

[0195] In S1901, if the text of a text object included in the design data being edited is changed, the data transmission unit 303 sends a text out-of-bounds determination request to the service server 102. A text out-of-bounds determination request is a request to determine whether all elements of the text of a text object included in the design data fit within the text area of ​​that text object. In other words, a text out-of-bounds determination request is a request to determine whether some or all of the text elements are placed (displayed) outside the text area.

[0196] In S1902, the service server 102, in response to the text out-of-bounds determination request received in S1901, determines whether all elements of the text are contained within the text area. The processing in S1902 is the same as the processing in S1008.

[0197] In S1903, the data transmission unit 311 transmits the determination result corresponding to the text out-of-bounds determination request to the poster creation application 300.

[0198] <Processing flow of host PC 101> Figure 20 is a flowchart showing an example of the reception process for receiving text typesetting change instructions and the process for updating the display of design data, which are performed by the poster creation application 300 on the host PC 101 in this embodiment. Steps S901 to S909 and S2001 to S2004 shown in Figure 20 are included in S701 shown in Figure 19. Furthermore, the process shown in Figure 20 is started when the text of a text object included in the design data is changed on the editing screen of the poster creation application 300.

[0199] The differences between the flowchart shown in Figure 20 and the flowchart of the first embodiment shown in Figure 9 will be explained below. Compared to the flowchart of the first embodiment shown in Figure 9, the flowchart in Figure 20 includes additional processing steps from S2001 to S2004.

[0200] In S1901, the CPU 201 sends a request to the service server 102 via the data transmission unit 303 to determine if the text is out of bounds.

[0201] In S2001, the CPU 201 receives the determination result from the service server 102 via the data receiving unit 304, which corresponds to the out-of-bounds determination request for the text transmitted by the data transmission unit 303 in S1901, and proceeds to S2002. The processing in S2001 corresponds to the processing shown in S1903.

[0202] In S2002, the CPU 201, based on the determination result received by the data receiving unit 304 in S2002, determines whether all elements of the text fit within the text area. If the CPU 201 determines in S2002 that all elements of the text fit within the text area (Yes), the flow ends. If the CPU 201 determines in S2002 that all elements of the text do not fit within the text area (No), the process proceeds to S2003.

[0203] Specifically, a case where not all elements of the text fit within the text area is as shown in Figure 21. Figure 21 is a diagram showing an example of the editing screen of the poster creation application 300 in this embodiment. Figure 21(A) is a diagram showing an example of the editing screen of the poster creation application 300 when the text area out of bounds notification, which will be described later, is displayed.

[0204] As shown in Figure 21, a portion of the text of a text object is displayed extending beyond the outer frame 2111 of the text area of ​​the text object, indicated by the dashed line. Specifically, the elements "Year-" and "ce Sale" of the text object are displayed extending beyond the text area of ​​the text object. In such cases, the display control unit 301 determines that not all elements of the text fit within the text area.

[0205] In S2003, the CPU 201, via the display control unit 301, provides a text out-of-bounds notification. A text out-of-bounds notification is a notification that informs the user that all elements of the text of a text object included in the design data do not fit within the text area of ​​that text object. For example, in S2003, the display control unit 301 displays the text out-of-bounds notification as a dialog box on the editing screen of the poster creation application 300, as shown in Figure 21.

[0206] The out-of-bounds text notification 2112 shown in Figure 21(A) displays a message indicating that not all elements of the text fit within the text area. The out-of-bounds text notification 2112 also includes a "Yes button" 2113 that accepts a command to display the character typesetting setting area 2101, and a "No button" 2114 that accepts a command not to display the character typesetting setting area 2101.

[0207] In S2004, the CPU 201 determines whether or not to display the character typesetting change setting area 2101 using the display control unit 301. Specifically, in S2004, the display control unit 301 determines that if it detects that the "Yes button" 2113 of the out-of-bounds notification 2112 of the text displayed in S2003 has been pressed, it will display the character typesetting change setting area 2101 (Yes) and proceed to S901. Then, in S2004, the display control unit 301 closes the out-of-bounds notification 2112 of the text.

[0208] In S2004, the display control unit 301 detects that the "No button" 2114 of the out-of-bounds notification 2112 for the text displayed in S2003 has been pressed, and determines that it will not display the character typesetting change setting area 2101 (No), and terminates this flow. Then, in S2004, the display control unit 301 closes the out-of-bounds notification 2112 for the text.

[0209] Figure 21(B) shows an example of the editing screen of the poster creation application 300 with the text layout change settings area displayed. Figure 21(B) shows the editing screen after the "Yes button" 2113 shown in Figure 21(A) has been pressed.

[0210] According to this embodiment, if all elements of the text in a text object included in the design data being edited do not fit within the text area of ​​the text object, it becomes possible to change the character layout of the text elements. This makes it possible to improve the visibility of emphasis elements in the text, even when it is desired to fit the text within the text area.

[0211] <<Sixth Embodiment>> In this embodiment, an example of identifying emphasis elements based on the results of morphological analysis is described. Morphological analysis is, for example, an analysis that divides the elements of text into parts of speech to show the structure of the text.

[0212] Since the basic configuration of the host PC and service server in this embodiment is the same as that of the first embodiment, a detailed explanation will be omitted. The differences from the first embodiment will be described below.

[0213] <Processing flow of service server 102> Figure 22 is a flowchart showing an example of the character typesetting change process executed by the service server 102 in this embodiment. The flow shown in Figure 22 includes S704 shown in Figure 7. S1002 to S1004, S1006 to S1009, and S2201 shown in Figure 22 are included in S703 shown in Figure 7. The process shown in Figure 22 is started when the data receiving unit 312 of the service server 102 receives character typesetting change instruction information from the poster creation application 300 on the host PC 101. The differences between the flowchart in this embodiment (Figure 22) and the flowchart in the first embodiment (Figure 10) will be explained below.

[0214] The flowchart shown in Figure 22 has steps S1001 and S1005 removed and step S2201 added compared to the flowchart shown in Figure 10.

[0215] In S2201, the CPU 211 uses the emphasis element identification unit 314 to identify emphasis elements from the text elements based on the morphological analysis results. The multimodal large-scale language model 322 is used for morphological analysis. The emphasis element identification unit 314 generates a prompt to cause the multimodal large-scale language model 322 to perform morphological analysis using the text contained in the text object included in the design data. For example, if the emphasis element identification unit 314 obtains the text object 813 shown in Figure 8(A), it generates a prompt like the following.

[0216] "Please perform morphological analysis on the following text: Nov. 28 (Fri) - 30 (Sun)" By inputting the above prompt into the multimodal large-scale language model 322, the following morphological analysis results can be obtained.

[0217] "Noun: Nov., (Fri), (Sun)" Numerals: 28, 30 "symbol:-" The emphasis element identification unit 314 determines emphasis elements based on the analysis results of morphological analysis and emphasis element determination rules for each morpheme. The emphasis element determination rules for each morpheme are stored in the conversion database 323. For example, emphasis element determination rules for each morpheme include rules such as "nouns and numerals are determined to be emphasis elements" and "verbs, adjectives, adverbs, particles, auxiliary verbs, and conjunctions, as well as symbols, are determined to be non-emphasis elements." The emphasis element identification unit 314 can identify emphasis elements based on the above rules and the analysis results of morphological analysis. Note that the method of identifying emphasis elements by morphological analysis is not limited to the method described above. For example, other morphological analysis algorithms may be applied to the text for morphological analysis in this embodiment. Also, the emphasis element determination rules are not limited to the above rules, as long as they determine emphasis elements based on morphemes.

[0218] According to this embodiment, based on the morphological analysis results and the emphasis element determination rules for each morpheme, it is possible to identify emphasis elements among the text elements of a text object included in the design data. Furthermore, since emphasis elements can be identified automatically, the same effects as those described in the first embodiment can be obtained.

[0219] <<Other Embodiments>> This disclosure can also be implemented by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be implemented by a circuit (e.g., an ASIC) that implements one or more functions.

[0220] The disclosure of this embodiment includes configurations represented by the following system example, information processing device example, information processing device control method example, and program example.

[0221] <Configuration 1> A means for receiving change instructions to modify the layout of design data containing text, When the aforementioned change instruction is received, a control means is provided to perform control to identify elements to be emphasized from among the elements included in the text based on the design data. A modification means for changing the character arrangement of the element identified by the control means, A design change system characterized by having the following features.

[0222] <Configuration 2> The design modification system according to configuration 1, characterized in that the character set is at least one of the following: the size of the element, the color of the element, the type of font of the element, bold formatting for the element, underline formatting for the element, and italic formatting for the element.

[0223] <Structure 3> The control means is Further control is performed to identify the use of the design data based on the design data, A design modification system according to configuration 1 or 2, characterized in that it identifies the elements to be emphasized based on the identified use of the design data and the text.

[0224] <Structure 4> The control means uses a trained model capable of outputting usage information indicating the use of the design data and emphasis element information indicating the elements to be emphasized, By inputting a prompt to the trained model to cause it to output the aforementioned usage information, the usage information is obtained from the trained model. The design modification system according to configuration 3, further characterized by performing control to acquire the emphasis element information from the trained model by inputting prompts to the trained model for outputting the acquired usage information, the text, and the emphasis element information.

[0225] <Composition 5> The design modification system according to configuration 4, characterized in that the emphasis element information is information indicating which elements should be emphasized and which should be emphasized from among the elements contained in the text.

[0226] <Composition 6> The design modification system according to configuration 1 or 2, characterized in that the control means performs control to identify the element to be emphasized based on the type of element contained in the text and a predetermined rule.

[0227] <Composition 7> The types of elements include nouns, numerals, verbs, adjectives, adverbs, particles, auxiliary verbs, and conjunctions. The design modification system according to configuration 6, characterized in that the predetermined rules indicate that nouns and numerals are identified as elements to be emphasized, and that verbs, adjectives, adverbs, particles, auxiliary verbs, and conjunctions are not identified as elements to be emphasized.

[0228] <Structure 8> The design data includes multiple texts, The change instruction includes target instruction information that indicates which of the plurality of texts is the text to be controlled by the control means, The design modification system according to configuration 1 or 2, characterized in that the control means performs control to identify the element to be emphasized with respect to the text indicated by the target instruction information.

[0229] <Composition 9> The design modification system according to configuration 8, characterized in that the control means does not perform control to identify the element to be emphasized with respect to text other than the text indicated by the target instruction information among the plurality of texts.

[0230] <Composition 10> If the receiving means, after receiving the change instruction, receives an instruction to further identify the element to be emphasized in the design data shown by the layout after the character typesetting of the element has been changed based on the change instruction, the control means identifies a second element to be emphasized among the elements included in the text, which is different from the first element identified in response to the change instruction, The design modification system according to any one of configurations 1 to 9, characterized in that the modification means modifies the character set of the second element to emphasize the second element with respect to the elements other than the second element, including the first element among the elements contained in the text.

[0231] <Composition 11> The aforementioned modification instruction includes a translation instruction that instructs the text to be translated from the first language to the second language. The control means is If the element contained in the text is expressed in the first language, further control is performed to translate the element from the first language to the second language. A design modification system according to any one of configurations 1 to 10, characterized by performing control to identify the element to be emphasized among the elements contained in the translated text.

[0232] <Composition 12> The design change system according to any one of configurations 1 to 11, characterized in that, if the receiving means receives a determination request for determining whether the text fits within the area of ​​the text in the layout before receiving the change instruction, the control means further performs control to determine whether the text fits within the area of ​​the text in the layout.

[0233] <Composition 13> If the receiving means receives the determination request before receiving the change instruction, the change means will The design modification system according to configuration 12, characterized in that, if the text does not fit within the area of ​​the text in the layout, the character set of the elements included in the text is changed so that the text fits within the area of ​​the text in the layout.

[0234] <Composition 14> A display control means that controls the display of the layout of the design data by an application that generates the design data, When the display control means detects a change in the layout, it outputs the determination request. The design change system according to configuration 13, further comprising

[0235] <Composition 15> The design change system according to configuration 14, characterized in that the output means further outputs the change instruction in response to user operations on the first screen, which is the editing screen of the application.

[0236] <Composition 16> The design change system according to configuration 15, characterized in that, in response to a determination result corresponding to the determination request, indicating that the text in the layout does not fit within the area, the display control means further performs control to display a second screen that can accept whether or not to output the change instruction using the output means.

[0237] <Composition 17> The design change system according to configuration 16, characterized in that, upon receiving an instruction to output the change instruction on the second screen, the output means outputs the change instruction.

[0238] <Composition 18> An information processing device that is communicatively connected to a terminal device, A receiving means for receiving change instructions from the terminal device to change the layout of design data including text, When the aforementioned change instruction is received, a control means is provided to perform control to identify elements to be emphasized from among the elements included in the text based on the design data. A modification means for changing the character arrangement of the element identified by the control means, An information processing device characterized by having the following features.

[0239] <Composition 19> A control method for an information processing device that is communicatively connected to a terminal device, A receiving process for receiving change instructions from the terminal device to change the layout of design data including text, When the aforementioned change instruction is received, a control step is performed to identify elements to be emphasized from among the elements included in the text based on the design data. A modification step to change the character arrangement of the elements identified in the control step, and A control method for an information processing device, characterized by including the following:

[0240] <Composition 20> An information processing device that is connected to a terminal device in a communicative manner, A receiving means for receiving change instructions from the terminal device to change the layout of design data including text, When the aforementioned change instruction is received, a control means is provided to perform control to identify elements to be emphasized from among the elements included in the text based on the design data. A modification means for changing the character arrangement of the element identified by the control means, A program characterized by its ability to function in a certain way. [Explanation of Symbols]

[0241] 101 Host PC 102 Service Server 300 Poster Creation Applications

Claims

1. A means for receiving change instructions to modify the layout of design data containing text, When the aforementioned change instruction is received, a control means is provided to perform control to identify elements to be emphasized from among the elements included in the text based on the design data. A modification means for changing the character arrangement of the element identified by the control means, A design change system characterized by having the following features.

2. The design modification system according to claim 1, characterized in that the character set is at least one of the following: the size of the element, the color of the element, the type of font of the element, bold formatting for the element, underline formatting for the element, and italic formatting for the element.

3. The control means is Further control is performed to identify the use of the design data based on the design data, The design modification system according to claim 1, characterized in that it identifies the elements to be emphasized based on the intended use of the identified design data and the text.

4. The control means uses a trained model capable of outputting usage information indicating the use of the design data and emphasis element information indicating the elements to be emphasized, By inputting a prompt to the trained model to cause it to output the aforementioned usage information, the usage information is obtained from the trained model. The design modification system according to claim 3, further characterized in that it controls the acquisition of the emphasis element information from the trained model by inputting prompts to the trained model for outputting the acquired usage information, the text, and the emphasis element information.

5. The design modification system according to claim 4, characterized in that the emphasis element information is information indicating which elements should be emphasized to a high degree and which elements should be emphasized to a low degree from among the elements contained in the text.

6. The design modification system according to claim 1, characterized in that the control means performs control to identify the element to be emphasized based on the type of element contained in the text and a predetermined rule.

7. The types of elements include nouns, numerals, verbs, adjectives, adverbs, particles, auxiliary verbs, and conjunctions. The design modification system according to claim 6, characterized in that the predetermined rules indicate that nouns and numerals are identified as elements to be emphasized, and that verbs, adjectives, adverbs, particles, auxiliary verbs, and conjunctions are not identified as elements to be emphasized.

8. The design data includes multiple texts, The change instruction includes target instruction information that indicates which of the plurality of texts is the text to be controlled by the control means, The design modification system according to claim 1, characterized in that the control means performs control to identify the element to be emphasized with respect to the text indicated by the target instruction information.

9. The design modification system according to claim 8, characterized in that the control means does not perform control to identify the element to be emphasized with respect to text other than the text indicated by the target instruction information among the plurality of texts.

10. If the receiving means, after receiving the change instruction, receives an instruction to further identify the element to be emphasized in the design data shown by the layout after the character typesetting of the element has been changed based on the change instruction, the control means identifies a second element to be emphasized among the elements included in the text, which is different from the first element identified in response to the change instruction, The design modification system according to claim 1, characterized in that the modification means modifies the character set of the second element to emphasize the second element with respect to the elements other than the second element, including the first element among the elements contained in the text.

11. The aforementioned modification instruction includes a translation instruction that instructs the text to be translated from the first language to the second language. The control means is If the element contained in the text is expressed in the first language, further control is performed to translate the element from the first language to the second language. The design modification system according to claim 1, characterized by performing control to identify the element to be emphasized among the elements contained in the translated text.

12. The design change system according to claim 1, characterized in that, if the receiving means receives a request for determination to determine whether the text fits within the area of ​​the text in the layout before receiving the change instruction, the control means further performs control to determine whether the text fits within the area of ​​the text in the layout.

13. If the receiving means receives the determination request before receiving the change instruction, the change means will The design modification system according to claim 12, characterized in that, if the text does not fit within the area of ​​the text in the layout, the character arrangement of the elements included in the text is changed so that the text fits within the area of ​​the text in the layout.

14. A display control means that controls the display of the layout of the design data by an application that generates the design data, When the display control means detects a change in the layout, it outputs the determination request. The design change system according to claim 13, further comprising the above.

15. The design change system according to claim 14, characterized in that the output means further outputs the change instruction in response to user operations on the first screen, which is the editing screen of the application.

16. The design change system according to claim 15, characterized in that, in response to a determination result corresponding to the determination request, indicating that the text in the layout does not fit within the area, the display control means further performs control to display a second screen capable of accepting whether or not to output the change instruction with the output means.

17. The design change system according to claim 16, characterized in that, upon receiving an instruction to output the change instruction on the second screen, the output means outputs the change instruction.

18. An information processing device that is communicatively connected to a terminal device, A receiving means for receiving change instructions from the terminal device to change the layout of design data including text, When the aforementioned change instruction is received, a control means is provided to perform control to identify elements to be emphasized from among the elements included in the text based on the design data. A modification means for changing the character arrangement of the element identified by the control means, An information processing device characterized by having the following features.

19. A control method for an information processing device that is communicatively connected to a terminal device, A receiving process for receiving change instructions from the terminal device to change the layout of design data including text, When the aforementioned change instruction is received, a control step is performed to identify the element to be emphasized from among the elements included in the text based on the design data, A modification step to change the character arrangement of the elements identified in the control step, and A control method for an information processing device, characterized by including the following:

20. An information processing device that is connected to a terminal device in a communicative manner, A receiving means for receiving change instructions from the terminal device to change the layout of design data including text, When the aforementioned change instruction is received, a control means is provided to perform control to identify elements to be emphasized from among the elements included in the text based on the design data. A modification means for changing the character arrangement of the element identified by the control means, A program characterized by its ability to function in a certain way.

Images