Control method for information processing device, information processing device, and program

The control method adjusts text in layout data by calculating character count and using a learning model to generate processed text, addressing the challenge of accommodating size changes while preserving design consistency.

JP7858615B2Active Publication Date: 2026-05-14CANON KK
View PDF 11 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
CANON KK
Filing Date
2023-12-15
Publication Date
2026-05-14

AI Technical Summary

Technical Problem

Existing methods for adjusting text in layout data, such as using language generation AI, face challenges in accommodating significant changes in character count without disrupting design consistency or making the text appear unnatural.

Method used

A control method that calculates the number of characters in a text area and uses a learning model to generate processed text, adjusting the text to fit the changed area size while maintaining content and design consistency.

Benefits of technology

Enables text adjustment in text areas to fit changed sizes effectively, preventing overflow or extra space and maintaining design consistency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007858615000001
    Figure 0007858615000001
  • Figure 0007858615000002
    Figure 0007858615000002
  • Figure 0007858615000003
    Figure 0007858615000003
Patent Text Reader

Abstract

To make it possible to adjust text to be displayed in a text region in a more desirable mode even under a situation where the size of the text region can be changed.SOLUTION: A text data processing necessity determination unit 402 calculates the number of characters displayable in a text region based on size attribute of the designated text region. A prompt generation unit 413 generates a prompt including an instruction related to text processing in which a text input to the text region and the calculated number of characters are designated. A language generation unit 415 inputs the generated prompt to a large language model 416 to cause the large language model 416 to generate a processed text by processing the designated text included in the prompt. The text input into the text region is updated with the processed text generated by the large language model 416.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a method for controlling an information processing apparatus, an information processing apparatus, and a program.

Background Art

[0002] As an example of a method for editing layout data with a layout such as a poster or a flyer, for example, a method using template materials can be cited. In this case, for example, after selecting a template material closer to the completed image, contents such as text and images are added to or deleted from the template, and the overall layout is adjusted by changing the position and size of each content. Further, when there is text content, one or more text areas for inputting text are prepared in the template, and text is input into the area. In recent years, it has also become possible to use so-called language generation AI technology when inputting text content in the above-described editing of layout data. Examples of such language generation AI technologies include ChatGPT (registered trademark) and Bard (registered trademark).

[0003] When editing layout data, after text is input, the size of the text area may be changed to adjust the layout. At this time, design problems may occur, such as extra white space being generated when the size of the text area is enlarged, or the text overflowing the area when the size of the text area is reduced. The same problem may also occur when the number of characters of the text that can be displayed in the text area changes due to a change in the font size, line pitch, etc. As a countermeasure against such problems, Patent Document 1 discloses a technique for adjusting the font size according to the size of the area. However, in this case, there is a possibility that the consistency with the surrounding design may be lost due to the font size becoming too small or, conversely, the font becoming too large. In contrast, Patent Document 2 discloses a technique for adjusting the number of characters in text by preparing a word substitution dictionary and replacing words in the text with other words of a different length. In this technique, the process of replacing words in the text described above is repeatedly executed until the number of characters is suitable for the size of the area after resizing. With this method, since the number of characters in the text is adjusted, there is no need to change the font size, and it is possible to maintain consistency with the surrounding design. [Prior art documents] [Patent Documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 9-231207 [Patent Document 2] Japanese Patent Publication No. 2013-109408 [Overview of the project] [Problems that the invention aims to solve]

[0005] However, the technology described in Patent Document 2 involves word-level substitution, which can make it difficult to accommodate significant changes in the number of characters. Furthermore, because word substitution is performed locally, it is conceivable that the resulting text may appear unnatural when viewed as a whole.

[0006] In view of the above problems, the present invention aims to enable the text displayed in a text area to be adjusted in a more suitable manner, even when the size of the text area can be changed. [Means for solving the problem]

[0007] The control method for an information processing apparatus according to the present invention includes a calculation step of calculating the number of characters that can be displayed in a specified text area based on the size attribute of the text area, If the number of characters calculated in the above calculation step is greater than or equal to a predetermined value than the number of characters in the text entered in the text area, The text entered in the text area and the number of characters calculated in the calculation step Based on The text Expand The method includes a generation step of generating a prompt containing at least instructions related to processing, and a processing step of inputting the prompt generated in the generation step into a learning model, thereby causing the learning model to generate processed text in which the text contained in the prompt has been processed, wherein the text entered into the text area is updated with the processed text generated in the processing step. [Effects of the Invention]

[0008] According to the present invention, even in situations where the size of the text area may be changed, it becomes possible to adjust the text to be displayed in the text area in a more suitable manner. [Brief explanation of the drawing]

[0009] [Figure 1] This diagram shows an example of the system configuration of an information processing system. [Figure 2] This diagram shows an example of the hardware configuration of an image output device. [Figure 3] This diagram shows an example of the hardware configuration of an information processing device. [Figure 4] This diagram shows an example of the functional configuration of an information processing system. [Figure 5] This is a diagram showing an example of layout data. [Figure 6] This is a diagram showing an example of a layout data editing screen. [Figure 7] This diagram illustrates the overview of language generation AI technology. [Figure 8] This is a flowchart illustrating an example of the processing performed by an information processing system. [Figure 9] This is a flowchart illustrating an example of the processing performed by an information processing system. [Figure 10] This is a diagram showing an example of a layout data editing screen. [Figure 11] This is a diagram showing an example of a layout data editing screen. [Figure 12]This is a diagram showing an example of a layout data editing screen. [Figure 13] This is a diagram showing an example of a layout data editing screen. [Figure 14] This is a diagram showing an example of the UI of an information processing system. [Figure 15] This is a diagram showing an example of the functional configuration of an information processing system. [Figure 16] This is a flowchart showing an example of the processing of an information processing system. [Figure 17] This is a flowchart showing an example of the processing of an information processing system.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0011] <Overview of Language Generation AI Technology> First, in order to make the features of the information processing system according to an embodiment of the present disclosure easier to understand, an overview of language generation AI technologies such as ChatGPT (registered trademark) and Bard (registered trademark) will be described below. For example, Figure 7 is a diagram illustrating the overview of language generation AI technology. In language generation AI technology, a large-scale language model (LLM) 701 is used as input, taking a prompt 700 representing instructions about the text to be generated as input, and outputting a generated text 702 that has a high probability of matching the prompt 700. The relationship between the input values ​​and the "context" is acquired when the LLM 701 learns using a large amount of text. Furthermore, the LLM 701 can change the generated product 702 by changing the initial values ​​that are mainly generated from random numbers when generating the generated product 702. In addition, by providing text and appropriate instructions to the prompt 700, it is possible to perform various processing such as summarizing, expanding on the content, or translating the text.

[0012] <First Embodiment> An example of an information processing system according to the first embodiment of this disclosure is described below. Figure 1 shows an example of the system configuration of the information processing system according to this embodiment, and illustrates an example of a printing system configured with layout data editing for an image output device. In the printing system shown in Figure 1, layout data editing and transmission of print jobs to the image output device are performed on an externally connected client (for example, a terminal device such as a PC). The image output device is a device that generates and outputs printed materials by forming images on a recording medium such as paper. In addition, when creating a print job, tasks such as editing print settings may be performed on the screen of the client. The system configuration of the printing system exemplified in Figure 1 will be described in more detail below.

[0013] As shown in Figure 1, client 102 is connected to server 104, image output device 100, and image output device 101 via network 103. Client 102 is used, for example, to edit layout data for posters, flyers, etc., and requests server 104 to perform some editing, data processing, and rendering processing on the layout data. Server 104 is schematically represented as a server that performs various processing such as editing, data processing, and rendering on various types of data, such as layout data. Client 102 also generates a print job by adding print settings to the edited layout data and sends the print job to the desired image output device (for example, a specified image output device among image output devices 100 and 101). Note that while Figure 1 shows an example where client 102 can access two image output devices via network 103, the number of image output devices is not limited; there may be one, three, or more. Similarly, while Figure 1 shows one client and one server, there may be two or more.

[0014] As an example of the printing process, we will describe an example in which a print job is sent from a printing application installed on client 102 to the image output device 100 via a printer driver. It is assumed that the above-mentioned printing application and printer driver were previously installed on client 102. The printing application obtains device information of the associated image output device 100 from the printer driver, as well as print parameters such as paper type, paper size, and print quality, and edits the print settings within the range of the obtained set of parameters. Based on the above print settings and the layout data image rendered by the server 104, the printing application generates a print job and sends the print job to the image output device 100 via the printer driver's spooler. The image output device 100 executes printing based on the print settings of the print job received from the printing application. Furthermore, the image output device 100 stores configuration information regarding the ink and paper it handles, idle status, and status information such as print errors as device information. In addition, if the image output device 100 is unable to perform printing normally due to abnormal conditions such as insufficient paper or running out of ink, or due to factors such as incorrect print settings, it may display a warning message on the main panel to inform the user of the reason why printing cannot be performed normally.

[0015] Referring to Figure 2, an example of the hardware configuration of the image output device 100 will be described. Note that the image output device 101 can be implemented with substantially the same configuration as the image output device 100, so a detailed explanation will be omitted. The operation of the image output device 100 is controlled by the CPU (Central Processing Unit) 200. The CPU 200 operates based on control programs stored in the program area of ​​the ROM (Read Only Memory) 201, or control programs stored in storage areas such as external memory 208. The CPU 200 outputs an image signal as output information to the printing unit (printer engine) 207, which is connected to the printing unit I / F 205 via the system bus 203. The CPU 200 may also communicate with the client 102 via the input unit 204 and notify the client 102 of the information within the image output device 100 through this communication. The CPU 200 can also receive output data to be output to the printing unit 207 via the input unit 204. RAM (Random Access Memory) 202 is a temporary storage area that functions as the main memory of the CPU 200, a work area, etc. RAM 202 may be configured to allow expansion of its memory capacity by connecting optional RAM to an expansion port (not shown). RAM 202 is used, for example, as an output information expansion area, an environmental data storage area, non-volatile memory, etc. External memory 208 is implemented using a hard disk drive (HDD) or IC card, and access is controlled by the memory controller 206. External memory 208 can be connected as an option and can store font data, emulation programs, form data, information about ink usage, information about paper type and size, and main unit status information. Furthermore, the operation unit 209 includes a panel realized by a display device such as a liquid crystal display, and is configured to display various information on the panel.

[0016] Referring to Figure 3, an example of a hardware configuration for an information processing device applicable as client 102 shown in Figure 1 will be described. Note that since server 104 can be implemented with substantially the same configuration as client 102, a detailed explanation will be omitted. The computer's main body 307 contains a CPU 300, ROM 301, RAM 302, keyboard controller 304, display controller 305, and disk controller 306. The CPU 300 reads various programs, such as control programs, system programs, and application programs, from the external memory 311 via the disk controller 306 into the RAM 302. The CPU 300 executes the various programs read into the RAM 302 to perform various data processing and display control of the display 310. The CPU 300 may also read control programs, etc., from the ROM 301. Furthermore, the CPU 300 may be implemented as a dedicated circuit such as an ASIC. The CPU 300 and the dedicated circuit are examples of hardware circuits and hardware processors. The disk controller 306 controls access to external memory 311 such as HDD, CD-ROM, DVD-ROM, and USB. RAM302 may be configured to allow its capacity to be expanded by optional RAM or the like (not shown in the diagram), and is primarily used as a work area for CPU300. The keyboard controller 304 controls key input from input devices such as the keyboard 308 and the pointing device 309. The display controller 305 controls the display on the display screen 310. In each embodiment of this disclosure, unless otherwise specified, the CPU 300 controls the components connected to the main bus 303 via the main bus 303. Of course, in the server 104, components that are not necessarily essential, such as the display 310, do not need to be included in the configuration.

[0017] Referring to Figure 4, an example of the functional configuration of the information processing system according to this embodiment will be described, with particular attention to the configurations of the image output device 100, client 102, and server 104, which were described with reference to Figures 1 to 3. Note that the image output device 101 is substantially the same as the image output device 100, so a detailed explanation will be omitted.

[0018] First, we will describe an example of the functional configuration of client 102 and server 104. The layout data editing department 401 adds and deletes content such as text and images to be placed on printed materials such as posters and flyers, and adjusts the layout of each content. When processing such as cropping and filling is to be applied to each content, the layout data editing department 401 requests the processing to the data content editing department 411 on the server 104. The layout data is either stored as a cache in the layout data DB 400 of the client 102, or stored in the layout data DB 410 of the server 104 for each client 102 (or for each user account if user accounts exist).

[0019] The text data processing necessity determination unit 402 determines whether or not it is necessary to process the text within the text area in the layout data. The text replacement unit 403, when it determines that text processing is necessary, processes the target text and replaces the original text with the processed text. The text display update unit 404 updates the display of the target text when text replacement occurs. Details of the processing of the text data processing necessity determination unit 402, the text replacement unit 403, and the text display update unit 404 will be described separately in conjunction with the explanation of the series of processes of the information processing system.

[0020] The print job transmission unit 405 creates a print job and sends the created print job to the image output device 100. When a print job is created, the print job transmission unit 405 requests the preview image generation unit 417 or the print image generation unit 418 of the server 104 to perform a preview of the layout data or generate a print image.

[0021] The text processing unit 412 of server 104 receives instructions from the text replacement unit 403 and requests the language generation unit 415 to generate text. At this time, the prompt generation unit 413 generates prompt information to be used for text generation, and the text processing unit 412 uses this prompt information to request text generation. When generating prompt information, the prompt generation unit 413 may use metadata related to the target text obtained by the metadata acquisition unit 414. The language generation unit 415 generates text using the large-scale language model 416 based on the prompt generated by the prompt generation unit 413. The generated text is sent to the client 102 by the text processing unit 412.

[0022] Next, an example of the functional configuration of the image output device 100 will be described. The ROM 201 contains a device information storage unit 421, a print job receiving unit 422, and a print execution unit 423. The print job receiving unit 422 receives print jobs sent from the client 102. The print execution unit 423 executes the print process based on the received print job. The device information storage unit 421 stores information such as the type and remaining amount of ink installed in the image output device 100, information such as the type and size of registered paper and paper feed paper, the main unit status information of the image output device 100, and the status information of print jobs. When the image output device 100 to be used has been determined in advance, the information stored in the device information storage unit 421 may be used to create layout data suitable for that image output device 100. In this case, the relevant information may be obtained from the device information storage unit 421 and stored on the client 102 or server 104 side in association with the layout data DB 400 or 410.

[0023] Referring to Figure 5, an example of layout data stored in layout data DBs 400 and 410 will be described. The data table shown in Figure 5 is maintained for each piece of layout data, for example. The data table shown in Figure 5 has areas such as ID 500, content 501, content type 502, layout coordinates 503, setting information 504, and metadata 505, and information about the content can be set in each area for each piece of content.

[0024] The ID500 area is where identification information (ID) is set to uniquely identify the content on the layout data. The content 501 area is where the values ​​of each piece of content, such as text and images, laid out on the layout data are set. The area for content type 502 contains information indicating the type of content set in the area for content 501. The area at layout coordinate 503 is set to a value that indicates the position of the content on the layout data. The area for configuration information 504 contains attribute values ​​that indicate the characteristics of each piece of content, such as its color and size. In this embodiment, when the content type is text, the coordinates and size represent the coordinates and size of the text area prepared for text. Furthermore, when the target content is text, the configuration information may include attribute values ​​specific to text, such as font type, font size, and line pitch.

[0025] The metadata area 505 may hold metadata for each piece of content. In this embodiment, if the content type 502 is text, the type and purpose of the text to be described may be set as metadata. For example, in the example shown as Sample 508, information indicating the purpose of the target text is set in the metadata area 505. Also, in the example shown as Sample 506, the ID of the image related to the target text is set in the metadata area 505. Furthermore, if the content type 502 is an image, a description of the image may be set in the metadata 505 area. For example, in the example shown as sample 507, the description "Description: Image of cherry blossom viewing" is set in the metadata 505 area for the target image. Furthermore, as shown in Figure 5, metadata may not be set for some content.

[0026] Furthermore, settings related to the entire layout data, such as the original size and data for variable printing, may also be retained. In this case, for example, the value "entire" may be retained in the content 501 area, the setting type in the content type 502 area, and the setting value in the setting information 504 area. Of course, the above is just one example. For instance, each parameter type could be managed in a separate file, or other types of parameters not exemplified above could be included in the layout data.

[0027] Referring to Figure 6, an example of a layout data editing screen 600 for the image output device 100, displayed on the display screen 310 of the client 102, will be described. The layout data editing screen 600 includes a template list 601 as an area where candidate layout templates are displayed as a list. The user can view and select the template that is closest to the completed layout data via the template list 601. The template selected via the template list 601 is displayed in the layout editing area 604. The template information displayed in the template list 601 may be obtained, for example, as layout data from the layout data DB 400 or 410, or from an external network service such as a cloud service or SNS service.

[0028] The layout data editing unit 401 or the data content editing unit 411 performs edits such as position adjustment, color correction, cropping, and filling on each piece of content displayed on the layout editing area 604. If the target content is text, for example, based on instructions received via the keyboard 308, input of the target text or editing of the specified text can be performed. As a specific example, the user can use the keyboard 308 to input desired text into the text area 608. Furthermore, adding content such as images and text to the layout editing area 604 is done based on instructions via the image addition button 602 and the text addition button 603. As a specific example, when the image addition button 602 or the text addition button 603 is pressed, a file dialog may be displayed, and the content may be imported by importing the file corresponding to the path specified via the file dialog. Of course, other types of content may be selected as targets, not limited to text and images, and in that case, a button to accept instructions for adding such content may be displayed. Also, there are no particular limitations on the source of content import; the target content may be obtained from external network services such as cloud services or SNS services. As another example, when a drag-and-drop operation of content is accepted for the layout editing area 604, the content may be imported.

[0029] Instructions for executing a print job are received, for example, via the print execution button 605. When the print execution button 605 is pressed, the print job transmission unit 405 creates a print job of the layout data displayed in the layout editing area 604 and sends the print job to the designated image output device (for example, image output device 100 or 101). Furthermore, instructions to save the layout data being edited may be received via the save button 606. If the save button 606 is pressed, the layout data being edited may be saved to a predetermined storage area (for example, layout data DB 400 or 410).

[0030] As described above, the information processing system according to this embodiment is configured to allow adjustment of the position and size of each content within the layout editing area 604. For example, Figure 10 shows an example of the layout data editing screen 600. In the example shown in Figure 10, a text area 1001 is displayed, and the size of this text area 1001 can be enlarged or reduced. The enlargement or reduction of the text area 1001 is performed, for example, based on instructions received via the pointing device 309.

[0031] On the one hand, when the size of the text area is enlarged, the size of the text area may become larger than the area occupied by the entered text, resulting in extra blank space as illustrated in Figure 10. On the other hand, when the size of the text area is reduced, the size of the text area may become smaller than the area occupied by the entered text, and the text may not fit within the text area. In consideration of these situations, the information processing system according to this embodiment is provided with a function that processes the entered text to fit the changed size of the text area when the size of the text area is changed. Therefore, the function of the information processing system according to this embodiment will be described in more detail below.

[0032] Referring to Figure 8, an example of the processing of the information processing system according to this embodiment will be explained, with particular attention to the processing related to the modification of text entered in the text area when the size of the text area in the layout data editing screen 600 is changed. The series of processes shown in Figure 8 are realized, for example, by the CPU 300 reading a program stored in the ROM 301 into the RAM 302 and executing it.

[0033] The series of processes shown in Figure 8 are initiated by the text replacement unit 403 when, for example, the print execution button 605 on the layout data editing screen 600 is pressed by client 102, or when the save button 606 is pressed. However, the above is merely an example, and the triggers for initiating the series of processes shown in Figure 8 are not limited to processes related to printing or saving content. As a specific example, the series of processes shown in Figure 8 may be initiated at the timing of a break in the editing work of the target content. As another example, the series of processes shown in Figure 8 may be initiated when a change in the size of the target text area is detected.

[0034] In S2001, the text data processing necessity determination unit 402 calculates the number of characters that can be displayed in the target text area based on information such as the size of the target text area, the type of character font, the font size, and the line pitch. In this case, there are no particular limitations on the method for calculating the number of characters that can be displayed in the target text area, and it is possible to apply, for example, methods commonly used in typesetting.

[0035] In S2002, the text data processing necessity determination unit 402 determines whether or not processing of the text displayed in the target text area is necessary, based on the calculation result of the number of characters of text that can be displayed in the target text area in S2001. If the text data processing necessity determination unit 402 determines in S2002 that processing of the target text is unnecessary, it terminates the series of processes shown in Figure 8. On the other hand, if the text data processing necessity determination unit 402 determines in S2002 that processing of the target text is necessary, it proceeds to S2003. For example, the text data processing necessity determination unit 402 may determine that text processing is necessary if the number of characters in the input text is excessively large or excessively small compared to the number of characters that can be displayed in the text area (for example, if the difference exceeds a threshold). Thus, the text data processing necessity determination unit 402 may determine that text processing is necessary if the difference between the number of characters that can be displayed in the text area and the number of characters in the input text, and the difference between this difference and a pre-set threshold, satisfies a predetermined condition.

[0036] For example, the example shown in Figure 10 shows the state in which the size of the text area 608 has been enlarged in the layout data editing screen 600 illustrated in Figure 6. The text area 1001 shown in Figure 10 corresponds to the result of enlarging the size of the text area 608 shown in Figure 6. As the size of the text area 1001 is enlarged, the number of characters that can be displayed is excessively greater than the number of characters that have actually been entered (for example, the difference exceeds a threshold), resulting in whitespace. Therefore, in this case, the text data processing necessity determination unit 402 will determine that processing of the text entered in the text area 1001 is necessary. While the above examples describe cases where the size of the text area is changed, situations where the difference between the number of characters that can be displayed in the text area and the number of characters in the entered text becomes excessively large (exceeds the threshold) are not limited to the examples described above. For example, a situation where the difference between the number of characters that can be displayed in the text area and the number of characters in the entered text becomes excessively large may be conceivable if the font type, font size, line pitch, etc., of the text area is changed. Another example is a situation where a change is made to increase or decrease the number of characters in the text entered in the text area, which may also result in an excessively large difference between the number of characters that can be displayed in the text area and the number of characters in the entered text. In such cases as well, the text data processing necessity determination unit 402 may determine that processing of the text displayed in the target text area is necessary. In this embodiment, for convenience, the size of the text area, font type, font size, line pitch, and number of characters in the text may be collectively referred to as the size attribute of the text area. In other words, changing the size attribute of the target text area may result in a situation where the text displayed in that text area needs to be modified. Note that the size, font type, font size, line pitch, etc. of each text area may be set or changed by the layout data editing unit 401.

[0037] Whether or not processing is necessary for the text displayed in the target text area can be determined, for example, by checking whether the absolute value of the difference between the number of characters that can be displayed in the text area and the number of characters displayed in the text area exceeds a threshold. In this case, the text data processing necessity determination unit 402 determines that processing is necessary for the target text if the absolute value of the difference in the number of characters exceeds the threshold, and determines that processing is unnecessary for the target text if the absolute value of the difference in the number of characters is less than or equal to the threshold. Of course, the above is merely an example, and the criteria for judgment may be changed as appropriate. As a specific example, separate thresholds may be set for determining whether the number of characters in the target text is greater than or less than the number of characters that can be displayed in the text area. Alternatively, the ratio of the number of characters in the target text to the number of characters that can be displayed in the text area may be used as the comparison target for the threshold. Of course, even in this case, separate thresholds may be set for determining whether the ratio exceeds the threshold and whether it is less than or equal to the threshold. In this way, the method of determination is not particularly limited, as long as it is possible to determine whether the number of characters in the text displayed in the text area is excessively large or excessively small compared to the number of characters that can be displayed in the text area.

[0038] In S2003, the text data processing necessity determination unit 402 confirms with the user whether or not to process the text displayed in the target text area. For example, Figure 11 shows an example of the state of the layout data editing screen 600, illustrating an example of an input interface for receiving instructions from the user regarding whether or not to process the text displayed in the target text area. Specifically, in the example shown in Figure 11, a popup window 1101 is displayed, and instructions from the user regarding whether or not to process the target text are received through this popup window 1101. For example, the text data processing necessity determination unit 402 recognizes that it has received an instruction from the user not to process the text displayed in the target text area if the "No" button displayed in the pop-up window 1101 is pressed. If the text data processing necessity determination unit 402 determines in S2003 that it has received an instruction from the user not to process the text displayed in the target text area, it terminates the series of processes shown in Figure 8. On the other hand, the text data processing necessity determination unit 402 recognizes that it has received an instruction from the user to process the text displayed in the target text area if the "Yes" button displayed in the pop-up window 1101 is pressed. If the text data processing necessity determination unit 402 determines in S2003 that it has received an instruction from the user to process the text displayed in the target text area, it proceeds to S2004. The process of receiving user instructions in S2003 is an example of the first reception process.

[0039] In S2004, the text replacement unit 403 requests the text processing unit 412 of the server 104 to process the text entered in the target text area. Here, the text replacement unit 403 requests the text processing unit 412 to process the text so as to change the number of characters without changing the content of the text currently entered in the target text area. In S2005, the prompt generation unit 413 generates a prompt to cause the language generation AI (language generation unit 415 and large-scale language model 416) to execute the processing requested by the client 102 in S2004. For example, if the number of characters that can be displayed in the target text area is 400, and the number of characters displayed in the text area is less than 400, the prompt generation unit 413 generates a prompt as exemplified below.

[0040] Please expand the following text to 400 characters without changing its content. We will be holding a Spring Festival. ································ Please feel free to participate.

[0041] A specific example of the process involved in prompt generation will be described separately later. Furthermore, the prompt generated in S2005 is output to the language generation unit 415.

[0042] In S2006, the language generation unit 415 uses the large-scale language model 416 to process the target text according to the instructions written in the prompt generated in S2005. Text processing can be achieved, for example, by language generation AI technology that utilizes a large-scale language model (LLM) such as ChatGPT® or Bard®. In this embodiment, the language generation AI to be applied is not particularly limited as long as it utilizes a large-scale language model. For example, the language generation unit 415, following the prompt exemplified in the explanation of the processing in S2005, generates text with an expanded number of characters while maintaining the content of the target text, as shown below.

[0043] We will be holding a Spring Festival. The weather is getting warmer day by day. ································ How about deepening your friendships while enjoying cherry blossoms? Everyone, please feel free to participate.

[0044] The text generated by S2006 is sent to the text replacement unit 403 of client 102 by the text processing unit 412.

[0045] In S2007, the text replacement unit 403 replaces the original text in the layout data DB 400 with the processed text received from the server 104. In S2008, the text display update unit 404 updates the display of the target text area according to the update result of the layout data DB400 in S2007, and then terminates the series of processes shown in Figure 8. For example, Figure 12 shows an example of the layout data editing screen 600, illustrating an example of how the display of the target text area is updated by the series of processes shown in Figure 8. The text area 1201 shown in Figure 12 corresponds to the text area 1001 in the example shown in Figure 10, and the text is displayed with the number of characters adjusted to fit the size by the series of processes explained with reference to Figure 8.

[0046] Next, with reference to Figure 9, we will explain in more detail an example of the process related to prompt generation shown as the process of S2005 in Figure 8. In S3001, the prompt generation unit 413 retrieves the text within the target text area, which is stored in at least one of the layout data DBs 400 and 410. In S3002, the prompt generation unit 413 calculates the number of characters that can be displayed in the current text area.

[0047] In S3003, the metadata acquisition unit 414 acquires the metadata of the text that is currently under attention (in other words, the metadata set in the target text area). In S3004, the metadata acquisition unit 414 determines whether or not the metadata for the text that was of interest in S3003 has been acquired. If the metadata acquisition unit 414 determines that it has been able to acquire the metadata of the text of interest in S3004, it proceeds to S3008. On the other hand, if the metadata acquisition unit 414 determines in S3004 that it was unable to acquire metadata for the text of interest, it proceeds to S3005. For example, if no metadata is set for the text of interest (in other words, the target text area), metadata will not be acquired from that text.

[0048] In S3005, the metadata acquisition unit 414 acquires metadata for the associated image of the text of interest (the text in the target text area). Specifically, the metadata acquisition unit 414 acquires the ID set in the associated image metadata among the metadata of the target text area, and acquires the metadata of the image to which that ID is assigned. In S3006, the metadata acquisition unit 414 determines whether or not metadata for the image associated with the text that was of interest in S3005 was acquired. If the metadata acquisition unit 414 determines that it has been able to acquire metadata for the image associated with the text of interest in S3006, it proceeds to S3008. On the other hand, if the metadata acquisition unit 414 determines in S3006 that it was unable to acquire the metadata for the associated image of the text of interest, it proceeds to S3007. For example, if no associated image is set for the text of interest, or if an associated image is set but metadata is not set for that associated image, the metadata for the associated image of that text will not be acquired.

[0049] The S3007 process is executed when metadata cannot be obtained for either the text of interest (in other words, the target text area) or the associated image of that text. In this case, the prompt generation unit 413 generates a prompt based on the text in the target text area and information on the number of characters that can be displayed in that text area. In this case, for example, a prompt like the one shown below is generated.

[0050] Please expand the following text to 400 characters without changing its content. We will be holding a Spring Festival. ································ Please feel free to participate.

[0051] The S3008 process is executed when metadata is acquired for at least one of the text of interest (in other words, the target text area) and the associated image of that text. In this case, the prompt generation unit 413 generates a prompt using the text in the target text area, information on the number of characters that can be displayed in that text area, and the acquired metadata information. As a specific example, if the metadata for the text area is set to "Purpose: A message inviting participation in an event," the following prompt will be generated.

[0052] The following text is an invitation to participate in an event. Please expand this text to 400 characters without changing its content. We will be holding a Spring Festival. ································ Please feel free to participate.

[0053] Regardless of whether process S3007 or S3008 is executed, after the series of processes shown in Figure 9 are completed, the process transitions to process S2006 shown in Figure 8.

[0054] As described above, the information processing system according to this embodiment processes the text in a text area of ​​a poster or flyer, etc., when the size, font, line spacing, etc., are changed, in order to match the number of characters that can be displayed in the text area while maintaining the content. By applying such control, it is possible to prevent situations such as text overflowing from the text area or extra white space appearing within the text area, and to display text in the text area while maintaining the original content. Furthermore, by applying such control, it is possible to prevent situations that would result in inconsistencies with the overall design, unlike, for example, when adjusting the font size to prevent text overflow or extra white space.

[0055] It should be noted that the configuration of the information processing system according to this embodiment described above is merely an example, and the configuration of the information processing system is not limited as long as the contents shown for the processing of client 102 and server 104 are substantially realized. For example, the assignment of processing to be performed by client 102 and server 104 may be changed as appropriate. As a specific example, the assignment of components (in other words, the assignment of processing) to client 102 and server 104, as explained with reference to Figure 4, may be changed as appropriate. Furthermore, the components of client 102 and server 104 may be provided in a single information processing device. In addition, at least some of the components of client 102 and server 104 may be realized by a network service such as a so-called cloud service.

[0056] <Variation> Modifications of the information processing system according to one embodiment of this disclosure are described below as Modifications 1 to 6.

[0057] (Variation 1) In the first embodiment described above, an example was explained in which processing related to the processing of the target text is executed with an operation such as printing or saving as the trigger for starting the process. On the other hand, the system may also be configured to start processing related to the processing of the target text based on an explicit instruction from the user. As a specific example, a button for receiving instructions from the user regarding text processing may be provided within the layout data editing screen 600, and when this button is pressed, processing related to text processing in the selected text area may be executed. In this case, since it is not necessary to determine whether or not text processing is required, for example, the judgment processes shown as S2002 and S2003 in the series of processes shown in Figure 8 may be omitted, and control may be applied that directly transitions from S2001 to S2004. Of course, this is not limited to cases where there is an explicit instruction from the user; as in the first embodiment, operations such as printing and saving may also be used as triggers for starting text processing. As described above, this modification makes it possible to have the information processing system execute the processing related to the modification of the target text at the timing desired by the user.

[0058] (Modification 2) In the first embodiment described above, an example was explained in which metadata of at least one of the text of interest (in other words, the target text region) and the associated image of the text is used to generate the prompt in the prompt generation process described with reference to Figure 9. On the other hand, as shown in the S3007 process where a prompt is generated without using metadata, it is also possible to process the target text without using metadata. As a concrete example, if the target text is to be processed to make it shorter, this is a summarization process, and therefore the text can be processed without using metadata. Another example is when the target text is to be processed to make it longer; in some cases, this can be done without metadata by utilizing information from the original text. If it is assumed that metadata will not be used when processing the target text, then the metadata acquisition unit 414 among the series of components shown in Figure 4 does not need to be provided. Also, among the series of processes shown in Figure 9, processes S3003 to S3006 and S3008 may be omitted, and control may be applied to directly transition from S3002 to S3007. As described above, this modified version eliminates the need to retain metadata, and therefore is expected to reduce the amount of memory and storage used when performing a series of processes related to text processing.

[0059] (Variation 3) In the first embodiment described above, an example was given in which the source text, character count, and metadata information are used when generating a prompt. In this modification, an example is given in which, in addition to this information, the content indicated by explicit instructions from the user is reflected when generating the prompt.

[0060] As a specific example, a control mechanism may be applied that protects a portion of the text to be processed by receiving a user instruction that it should not be changed. In the embodiment described above, the text displayed in the target text area was passed as part of the prompt, and the text was processed. In this case, although the content of the target text is maintained, the expression of the text is not necessarily maintained as is. In contrast, it is conceivable that the user may want to maintain the expression applied to at least a portion of the target text.

[0061] For example, Figure 16 is a flowchart showing an example of the process related to prompt generation, illustrating another example of the process of S2004 shown in Figure 8. In S4001, the prompt generation unit 413 asks the user whether there are any additional instructions regarding the processing of the target text. This inquiry to the user regarding the presence of additional instructions can be implemented, for example, by displaying a message in a window and then displaying a yes / no button, allowing the user to select instructions via this button. In S4002, the prompt generation unit 413 determines whether or not an additional instruction from the user, namely an instruction to add conditions related to text processing, was received in S4001. If the prompt generation unit 413 determines in S4002 that an additional instruction from the user has been received, it proceeds to S4003. On the other hand, if the prompt generation unit 413 determines in S4002 that no additional instructions have been received from the user, it proceeds to S4006.

[0062] In S4003, the prompt generation unit 413 determines whether the additional instruction received in S4001 is an instruction related to string protection. If the prompt generation unit 413 determines in S4003 that the target additional instruction is an instruction related to string protection, it proceeds to S4004. On the other hand, if the prompt generation unit 413 determines in S4003 that the target additional instruction is not an instruction related to string protection, it proceeds to S4005.

[0063] In S4004, the prompt generation unit 413 receives a specification from the user regarding the range of strings to be protected from the text to be processed.

[0064] In S4005, the prompt generation unit 413 accepts additional instructions from the user. As a specific example, the prompt generation unit 413 may accept additional instructions from the user via the keyboard 308.

[0065] In S4006, the text replacement unit 403 sends a text processing request to the server 104. At this time, if the text replacement unit 403 has received additional instructions from the user in S4004 or S4005, it may include information indicating those additional instructions in the text processing request. Furthermore, the process of receiving additional instructions from the user, as shown in the S4001-S4005 processes, corresponds to an example of the second reception process.

[0066] After the series of processes shown in Figure 16 are executed, the series of processes shown in Figure 9 are executed next. If additional instructions are received from the user during the series of processes shown in Figure 16, a prompt is generated in S3007 or S3008 shown in Figure 9 to reflect the content of those additional instructions.

[0067] For example, Figure 13 shows an example of the layout data editing screen 600, illustrating an example of how the user can specify the range of string protection. Specifically, in the example shown in Figure 13, a pop-up window 1301 is displayed to receive instructions from the user regarding the specification of the string protection range. Then, when instructions are received from the user via the pop-up window 1301, the user specifies the range of strings to be protected within the text displayed in the target text area. By specifying at least a portion of the strings in the target text in this way, those strings are set as targets for protection.

[0068] Furthermore, in the series of processes shown in Figure 9, when a prompt is generated in S3007 or S3008, an instruction to "do not process this part" is added to the previously specified string. In this case, for example, a prompt like the one shown below is generated.

[0069] The following text is an invitation to participate in an event. Please expand this text to 400 characters without changing its content. However, do not alter the string between ### and ***. ### We will be holding a Spring Festival. *** ································ Please feel free to participate.

[0070] As described above, this modification makes it possible to reflect user requests when processing text. As a specific example, when processing text, if the user instructs to keep at least some strings unchanged, it becomes possible to control the processing so that the target text is processed while maintaining those strings.

[0071] (Modification 4) In the first embodiment described above, an example was explained in which the original text is automatically replaced with the processed text in the S2007 process shown in Figure 8. Alternatively, the processed text may be presented to the user before the replacement is performed, and instructions regarding the text replacement may be received from the user, after which the original text may be replaced with the processed text based on those instructions. Furthermore, in anticipation of a situation where the processed text differs from the user's intention, instructions regarding the re-execution of the text processing may be received from the user.

[0072] Generally, a language generation AI does not necessarily produce the same output even when the same prompt is input. Therefore, when text processing is re-executed by the language generation unit 415, it can be expected that the output will be a result of processing the target text differently than in the previous execution. Furthermore, considering the above characteristics, by providing multiple language generation units 415, when re-executing text processing, the text processing may be performed by a different language generation unit 415 than the one used in the previous processing. In this case, the multiple language generation units 415 may be provided on the same server, or they may be provided individually on different servers.

[0073] Referring to Figure 17, another example of the processing of S2007 in Figure 8 will be described as an example of the processing of the information processing system related to this modified example. In S5001, the text replacement unit 403 displays the processed text in a predetermined display area, and in S5002, it asks the user whether or not to approve the replacement of the original text with the processed text. As a specific example, the text replacement unit 403 may display the processed text in a window and also display a button for selecting yes / no in the same window, thereby receiving instructions from the user through the window. Then, in S5001, the text replacement unit 403 determines whether or not the user has approved the text replacement in response to the inquiry presented to the user. If the text replacement unit 403 determines in S5002 that it has received approval from the user to replace the text, it proceeds to S5005. In S5005, the text replacement unit 403 replaces the original text with the processed text, then completes the series of processes shown in Figure 17, and then proceeds to S2008 in Figure 8. On the other hand, if the text replacement unit 403 determines in S5002 that the user has not approved the text replacement (it has been rejected), it proceeds to S5003. Furthermore, the process of receiving instructions from the user regarding whether or not to approve the replacement of text in S5001 corresponds to an example of the third type of acceptance process.

[0074] In S5003, the text replacement unit 403 asks the user whether or not to re-execute the text processing. As a specific example, the text replacement unit 403 may display a message in a window asking whether or not to re-execute, and also display a button in the window for selecting yes / no, thereby receiving instructions from the user through the window. Then, the text replacement unit 403 determines whether or not it has received instructions from the user to re-execute the text processing. If the text replacement unit 403 determines in S5003 that an instruction to re-execute text processing has been received, it terminates the series of processes shown in Figure 17, and then proceeds to S2005 in Figure 8. On the other hand, if the text replacement unit 403 determines in S5003 that the instruction to re-execute the text processing was not accepted (the re-execution was rejected), it terminates the series of processes shown in Figure 17 and then proceeds to S2008 in Figure 8. Furthermore, the process of receiving instructions from the user regarding whether or not to re-execute the text processing in S5003 corresponds to an example of the fourth reception process.

[0075] By applying the above controls, the processing of the target text will result in a outcome that more closely matches the user's intent.

[0076] (Variation 5) In the first embodiment described above, an example was given in which layout data is ultimately output to an image output device, that is, an example in which the information processing system according to this embodiment is implemented as a printing system. On the other hand, the application of the technology according to this embodiment is not necessarily limited to printing systems. For example, even when layout data is edited assuming content to be mainly displayed via a display, the technology according to this embodiment can be applied in the same way. Specifically, even when content is displayed on a display, situations may be envisioned in which the number of characters that can be displayed in a text area or the number of characters that can be entered in a text area are limited depending on the constraints of the display size or the system side. The technology according to this disclosure may be applied in such situations.

[0077] Regarding the system configuration of the information processing system according to this modified example, the image output devices 100 and 101 are not required to be provided in the system and configuration exemplified in Figure 1. For the hardware configurations of the server 104 and client 102, the configuration shown in Figure 3 can be applied, similar to the first embodiment. Furthermore, regarding the functional configuration, the print job transmission unit 405 and the print image generation unit 418 are not required to be provided in the series of components of the server 104 and client 102 exemplified in Figure 4. Also, as mentioned above with reference to Figure 1, the image output device 100 is not required to be provided in the system configuration; therefore, the component corresponding to the image output device 100 in the example shown in Figure 4 is also not required. Of course, if the goal is not only to display the edited layout data on the screen but also to enable printing of the layout data, this can be achieved by providing components related to printing the layout data, similar to the first embodiment. The processing of the information processing system according to this modified example can be performed using the series of processes shown in Figures 8 and 9, similar to the first embodiment described above.

[0078] As described above, the information processing system according to one embodiment of this disclosure makes it possible to display text in an appropriate amount for the text area, even when layout data is edited with content mainly intended to be displayed via a display.

[0079] (Experimental variation 6) In the first embodiment described above, as shown in Figures 11 and 13, an example of a User Interface (UI) that realizes interaction between the system and the user was described, such as the application of message display in a window or menu selection. However, these UIs are merely examples and do not necessarily limit the UI of the information processing system according to one embodiment of this disclosure. Therefore, in this modification, an example of a case in which interaction between the system and the user is realized interactively through a dialogue screen, such as a chat, will be described. The system shall be equipped with a dialogue learning model for interactively responding to instructions from the user and proposing processing to the user. This dialogue learning model may be realized by the language generation unit 415 and the large-scale language model 416, or it may utilize a different model.

[0080] Figure 14 shows an example of the UI of an information processing system according to this modified example. Window 1400 is a window that enables interaction between the system and the user, and displays the content of the dialogue between the system and the user. For example, output information 1401 and 1402 show an example of information indicating the exchange between the system and the user. Output information 1401 shows the content of the user's output information entered by the user, which may be entered, for example, via the keyboard 308. In the example shown in Figure 14, output information 1401 indicates that the user has instructed the system to look up the date and time of the SPRING FESTIVAL and enter it into the text area. Output information 1402 shows the content of the response from the system. In the example shown in Figure 14, output information 1402 indicates that the system has responded that the date and time have been entered. As a result of this exchange, the date and time text has been entered into the text area located near the center of the layout editing area in Figure 14. Furthermore, let's assume that the text "We will be holding a Spring Festival. Please join us!" is entered into another text area located at the bottom of the layout editing area in Figure 14. This text may be generated (not shown) through interactive communication between the user and the system in window 1400, or it may be text directly entered by the user. However, in this case, let's assume that there is a large amount of white space remaining in this text area. An example of the system detecting this large amount of white space and suggesting processing the entered text will be explained using output information 1403 and 1404. Output information 1403 shows the content of the suggestion made by the system to the user. In the example shown in Figure 14, output information 1403 indicates that the system is suggesting to the user that they process the text because there is white space in the text area. If the user accepts this suggestion from the system, they will input that into window 1400. Output information 1404 shows the content of the instruction entered by the user in response to the suggestion from the system. In the example shown in Figure 14, output information 1404 indicates that the system's proposal is to be accepted. Upon receiving this instruction from the user, the system performs the same processing as S2005-S2006 in Figure 8 to process the text. Furthermore, the method for receiving user input is not limited to using the keyboard 308; various other methods can be applied. For example, user input may be received using technologies such as voice input.

[0081] The information processing system relating to this modified example can be configured in the same way as the first embodiment in terms of system configuration and hardware configuration. The functional configuration of the information processing system in this modified example will be described below with reference to Figure 15. In this modified example, the explanation will mainly focus on the parts that differ from the first embodiment, and detailed explanations of parts that are substantially the same as those in the first embodiment will be omitted. The client 102 according to this embodiment differs from the example shown in Figure 4 in that it is provided with an interactive input / output unit 1501. The interactive input / output unit 1501 is a component on the client 102 side for realizing dialogue between the system and the user, and it receives input from the user and outputs information to be presented from the system to the user. Furthermore, the server 104 according to this embodiment differs from the example shown in Figure 4 in that it is equipped with a dialogue control unit 1502. The dialogue control unit 1502 uses a language generation unit 415 based on a large-scale language model 416 to perform various processes for realizing dialogue between the system and the user. The dialogue control unit 1502 may also perform processes to solve problems presented by the user, such as information retrieval. Dialogue between the system and the user can be realized, for example, by using general language generation AI technologies such as ChatGPT or Bard. In addition, other AI technologies may be used, not just language generation AI technologies. Furthermore, since the processing of the information processing system related to this modified example is substantially the same as that of the information processing system according to the first embodiment described above, a detailed explanation will be omitted.

[0082] As described above, in the information processing system according to one embodiment of this disclosure, it is also possible to implement an interactive interface for the interaction between the system and the user when processing text to be displayed in a text area. By applying such a UI, it is expected that the usability of the system when editing layout data will be further improved.

[0083] <Other Embodiments> The present invention can also be realized by performing the following process: that is, supplying software (program) that realizes the functions of the above-described embodiment to a system or device via a network or various storage media, and having the computer (or CPU, MPU, etc.) of that system or device read and execute the program. Furthermore, although a layout data creation application was given as an example of an application in the above-described embodiment, the method is not limited to this example and can be implemented and is effective with any application that has similar image layout functionality. Furthermore, in the embodiments described above, a personal computer was assumed as the information processing device. However, the invention is not limited to this example and can be implemented and is effective for any information processing device (terminal) that can be used in a similar manner. Examples of information processing devices (terminals) include mobile phones, personal digital assistants, digital still cameras, digital video cameras, portable music players, games, set-top boxes, internet-connected home appliances, etc. Furthermore, although Ethernet was used as an example of network configuration in the above-described embodiment, the system is not limited to this example, and other arbitrary network configurations such as wireless LAN, IEEE1394, Bluetooth, etc. may also be used. Although preferred embodiments of the present invention have been described in detail above, the present invention is not limited to these specific embodiments, and various modifications and changes are possible within the scope of the gist of the invention as described in the claims.

[0084] Furthermore, the disclosure of this embodiment includes the following methods, configurations, and programs. (Method 1) A method for controlling an information processing device, comprising: a calculation step of calculating the number of characters that can be displayed in a specified text area based on the size attribute of the specified text area; a generation step of generating a prompt that includes at least the text entered into the text area and the number of characters calculated in the calculation step, and an instruction for processing the specified text; and a processing step of inputting the prompt generated in the generation step to a model that has been trained to process the text specified in the prompt based on the input prompt, thereby causing the model to generate a processed text in which the text specified in the prompt has been processed, wherein the text entered into the text area is updated by the processed text generated in the processing step. (Method 2) A control method for an information processing device according to Method 1, characterized in that the processing step involves inputting the prompt to the model when the difference or ratio between the number of characters in the text entered in the text area and the number of characters that can be displayed in the text area calculated in the calculation step, and a pre-set threshold, satisfies a pre-set condition, thereby causing the model to generate the processed text. (Method 3) A control method for an information processing device according to Method 1, comprising a first receiving step of receiving instructions from a user regarding the processing of text, wherein the processing step is characterized in that, when the first receiving step receives instructions regarding the processing of text, the prompt is input to the model, causing the model to generate the processed text. (Method 4) A control method for an information processing device according to any one of Methods 1 to 3, characterized in that the generation step generates the prompt using at least one of the metadata set in the text area and the metadata set in the content associated with the text area. (Method 5) A control method for an information processing device according to any one of Methods 1 to 4, comprising a second receiving step for receiving instructions relating to the addition of conditions relating to the processing of text, wherein the generation step generates a prompt such that, when generating the processed text in the processing step, the processed text is generated that satisfies the conditions indicated by the instructions received by the second receiving step. (Method 6) A control method for an information processing device according to Method 5, characterized in that the second reception step receives a designation of at least a range of text entered in the text area and an instruction relating to restricting changes to said range, and the generation step generates a prompt based on the instruction received by the second reception step such that changes to the range specified in the second reception step in the text entered in the text area are restricted when generating the processed text in the processing step. (Method 7) A control method for an information processing apparatus according to any one of Methods 1 to 6, comprising: a display control step that controls the processed text generated in the processing step to be displayed in a predetermined display area; and a third reception step that receives an instruction to update the processed text to text entered in the text area, wherein when the third reception step receives an instruction to update the processed text, the text entered in the text area is updated with the processed text. (Method 8) A control method for an information processing device according to Method 7, comprising a fourth receiving step for receiving an instruction to re-execute text processing, wherein the processing step generates the processed text again when the text previously entered in the text area has not been updated by the processed text and the fourth receiving step receives an instruction to re-execute text processing. (Method 9) A control method for an information processing device according to any one of Methods 1 to 8, comprising an output control step which controls the interactive learning model, which has been trained to generate a response to an input instruction, to generate a response to the instruction by inputting an instruction received from a user, and to present the response interactively to the user, wherein in the output control step, the processed text in the processing step is generated based on a first instruction received from the user, and the text entered in the text area is updated with the processed text. (Method 10) A control method for an information processing device according to Method 9, characterized in that in the output control step, text to be entered into the text area is generated based on a second instruction received from the user. (Configuration 1) An information processing apparatus comprising: a calculation means for calculating the number of characters that can be displayed in a designated text area based on the size attributes relating to the text area; a generation means for generating a prompt that includes at least the text entered into the text area and the number of characters calculated by the calculation means, and instructions for processing the designated text; and a processing means for inputting the prompt generated by the generation means to a model that has been trained to process the text specified in the prompt based on the input prompt, thereby causing the model to generate a processed text in which the text specified in the prompt has been processed, wherein the text entered into the text area is updated with the processed text generated by the processing means. (Program 1) A program that causes a computer to function as an information processing device, comprising: a calculation means for calculating the number of characters that can be displayed in a specified text area based on the size attributes of the specified text area; a generation means for generating a prompt that includes at least the text entered into the text area and the number of characters calculated by the calculation means, and instructions for processing the specified text; and a processing means for causing a model, which has been trained to process the text specified in the prompt based on the input prompt, to generate a processed text in which the text specified in the prompt has been processed, by inputting the prompt generated by the generation means, wherein the text entered into the text area is updated with the processed text generated by the processing means. [Explanation of Symbols]

[0085] 102 clients 104 Servers 402 Text data processing necessity determination unit 413 Prompt generation unit 415 Language generation section 416 Large-scale language models

Claims

1. A method for controlling an information processing device, A calculation step that calculates the number of characters that can be displayed in a specified text area based on the size attributes of that text area, If the number of characters calculated in the calculation step is greater than or equal to a predetermined value than the number of characters in the text entered in the text area, a generation step is made to generate a prompt that contains at least instructions for processing the text to expand it based on the text entered in the text area and the number of characters calculated in the calculation step. A processing step in which the prompt generated in the generation step is input to a learning model, causing the learning model to generate processed text in which the text contained in the prompt has been processed, Includes, The text entered in the text area is updated with the processed text generated in the processing step. A control method for an information processing device, characterized by the features described herein.

2. In the processing step, if the difference or ratio between the number of characters in the text entered in the text area and the number of characters that can be displayed in the text area calculated in the calculation step, and a pre-set threshold, satisfies the pre-set conditions, the prompt is input to the learning model, causing the learning model to generate the processed text. A control method for an information processing device according to claim 1, characterized in that

3. This includes a first receiving step in which instructions regarding text processing are received from the user, In the processing step, when an instruction for processing the text is received in the first reception step, the prompt is input to the learning model, causing the learning model to generate the processed text. A control method for an information processing device according to claim 1, characterized in that

4. The control method for an information processing apparatus according to claim 1, characterized in that the generation step generates the prompt using at least one of the metadata set in the text area and the metadata set in the content associated with the text area.

5. This includes a second receiving step for receiving a second instruction regarding the addition of conditions for processing the text, The prompt generated in the generation step is a prompt for instructing the generation of the processed text in the processing step to generate a processed text that satisfies the conditions indicated by the second instruction received in the second reception step. A control method for an information processing device according to claim 1, characterized in that

6. The second instruction received in the second reception step includes specifying a range of at least a portion of the text entered in the text area, and an instruction relating to restrictions on changing said range. The prompt generated in the generation step is a prompt written to restrict changes to the range in the text entered in the text area when generating the processed text in the processing step, based on the second instruction received in the second reception step. A control method for an information processing device according to claim 5, characterized in that it is a control method for an information processing device according to claim 5.

7. A display control step that controls the display of the processed text generated in the processing step so that it is displayed in a predetermined display area, A third reception step that receives instructions for updating the processed text, targeting the text entered in the text area, It further includes, If an instruction to update the processed text is received in the third reception step, the text entered in the text area is updated with the processed text. A control method for an information processing device according to claim 1, characterized in that

8. It further includes a fourth reception step for receiving instructions regarding the re-execution of text processing, In the processing step, if the text previously entered in the text area has not been updated by the processed text, and an instruction to re-execute the text processing is received in the fourth reception step, the processed text is generated again. A control method for an information processing device according to claim 7, characterized in that it is a control method for an information processing device according to claim 7.

9. The output control step includes inputting an instruction received from a user to an interactive learning model that has been trained to generate a response to an input instruction, thereby causing the interactive learning model to generate a response to the instruction, and controlling the presentation of the response to the user interactively. In the output control step, based on the first instruction received from the user, the post-processed text in the processing step is generated, and the text entered in the text area is updated with the post-processed text. A control method for an information processing device according to claim 1, characterized in that

10. The control method for an information processing apparatus according to claim 9, characterized in that, in the output control step, text to be input into the text area is generated based on a second instruction received from the user.

11. The control method for an information processing device according to claim 1, characterized in that the learning model is a model that has been trained to perform processing on the text specified by the input prompt in a manner corresponding to a specified number of characters.

12. A calculation means for calculating the number of characters that can be displayed in a specified text area based on the size attributes of that text area, If the number of characters calculated by the calculation means is greater than or equal to a predetermined value than the number of characters in the text entered in the text area, a generation means generates a prompt that contains at least instructions for processing the text to expand it based on the text entered in the text area and the number of characters calculated by the calculation means. A processing means that, by inputting the prompt generated by the generation means into a learning model, causes the learning model to generate processed text in which the text contained in the prompt has been processed, It has, The text entered in the text area is updated with the processed text generated by the processing means. An information processing device characterized by the following features.

13. Computers, A calculation means for calculating the number of characters that can be displayed in a specified text area based on the size attributes of that text area, If the number of characters calculated by the calculation means is greater than or equal to a predetermined value than the number of characters in the text entered in the text area, a generation means generates a prompt that contains at least instructions for processing the text to expand it based on the text entered in the text area and the number of characters calculated by the calculation means. By inputting the prompt generated by the generation means into the learning model, the learning model is instructed to generate processed text in which the text contained in the prompt has been processed. It is a program designed to function as such. The text entered in the text area is updated with the processed text generated by the processing means. A program characterized by the following features.