Information processing apparatus, method and program

The information processing device improves template editing convenience by allowing users to edit text and automatically replace images with related images, addressing the challenge of image change inefficiency in layout data creation.

JP2024165081AInactive Publication Date: 2024-11-28CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023080922
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-16
Publication Date
2024-11-28
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Users face inconvenience when editing templates to create layout data that suits their tastes and purposes, particularly in changing images within the templates.

Method used

An information processing device that includes a template acquisition unit, a text editing unit, a key phrase acquisition unit, and an image acquisition unit, which allows users to edit text and automatically replace pre-arranged images with images related to the edited text's key phrase, using a key phrase extraction algorithm or external server service.

Benefits of technology

Enhances user convenience by enabling easy creation of personalized layout data by automatically updating images based on edited text, reducing the need for users to manually select or prepare images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165081000001_ABST
    Figure 2024165081000001_ABST
Patent Text Reader

Abstract

To improve convenience for a user creating layout data by editing a template.SOLUTION: An information processing apparatus according to the present invention has template acquiring means for a first template including a first text and a first image, reception means for accepting edition of the first text, key phrase acquiring means for acquiring a key phrase from the text whose edition has been accepted by the reception means, image acquiring means for acquiring a second image associated with the key phrase acquired by the key phrase acquiring means, and generating means for generating a second template by using the text whose edition has been accepted and the second image acquired by the image acquiring means.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, method, and program. [Background technology]

[0002] In recent years, layout data creation applications have been released that arrange a plurality of images and texts on a sheet of paper to create layout data for photo albums, posters, and the like. In layout data creation applications, templates of layout data in which text and images are arranged in advance may be provided to enable users to create layout data more easily. Templates are prepared according to the purpose of creating layout data, and text and images suited to each purpose are arranged in advance. In addition, layout data creation applications have a function for changing the text and images arranged in advance in the template. This function enables users to easily create layout data that suits their preferences and purposes.

[0003] Meanwhile, there is a known technique for selecting an image that is suitable for the impression of a text. Patent Document 1 describes a technique for selecting an image based on impression words of a sentence input by a user. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-008874 A Summary of the Invention [Problem to be solved by the invention]

[0005] When a user edits a template to create layout data that matches his or her own preferences or purposes, it is desirable to improve user convenience.

[0006] An object of the present invention is to improve the convenience when a user creates layout data by editing a template. [Means for solving the problem]

[0007] In order to solve the above problem, the information processing device of the present invention is characterized by comprising: a template acquisition means for acquiring a first template including a first text and a first image; a reception means for accepting edits to the first text; a key phrase acquisition means for acquiring a key phrase from the text after the edits have been accepted by the reception means; an image acquisition means for acquiring a second image related to the key phrase acquired by the key phrase acquisition means; and a generation means for generating a second template using the text after the edits have been accepted and the second image acquired by the image acquisition means. Effect of the Invention

[0008] According to the present invention, it is possible to improve the convenience when a user creates layout data by editing a template. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates a configuration of a printing system. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of each device. [Diagram 3] FIG. 2 is a diagram showing the software configuration of a PC 100. [Figure 4] FIG. 2 is a diagram showing information relating to an image. [Diagram 5] 13A and 13B are diagrams showing information relating to text. [Figure 6] FIG. 13 is a diagram showing an editing screen. [Figure 7] FIG. 13 is a diagram showing an editing screen. [Figure 8] 11 is a flowchart showing a process executed based on editing of text. [Figure 9]13 is a flowchart showing a key phrase acquisition process. [Figure 10] 13A and 13B are sequences showing communication processing executed between an information processing device and an external server. [Figure 11] FIG. 2 is a diagram showing information relating to an image. [Figure 12] 13 is a flowchart showing a key phrase acquisition process. [Figure 13] FIG. 13 is a diagram showing an editing screen. [Figure 14] 11 is a flowchart showing a process executed based on editing of text. [Figure 15] FIG. 2 is a diagram showing information relating to an image. [Figure 16] 13A and 13B are diagrams showing an editing screen. [Figure 17] 13 is a flowchart showing a process for changing information related to an image. [Figure 18] 11 is a flowchart showing a process executed based on editing of text. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0011] First Embodiment FIG. 1 is a diagram showing an example of the configuration of a printing system in this embodiment. This printing system includes a client computer (hereinafter, PC) 100, a display (display device) 110, a router 120, a mobile terminal 200, a server computer (hereinafter, external server) 300, a printer 400, and an external printer 500. The PC 100 is connected to the display 110 by a communication cable, and displays various user interface screens on the display 110 for a user of the PC 100. In some cases, not only the PC 100 itself but also the PC 100 and the display 110 are collectively referred to as an information processing device. The PC 100 is connected to the router 120 by wired communication or wireless communication, and can communicate with other communication devices via the router 120 and the Internet 130. The mobile terminal 200 can communicate with other communication devices via the router 120 and the Internet 130 by wireless communication. The external server 300 is, for example, a Web server that provides a Web application that allows a user to create / edit content data to be printed. The external server 300 can communicate with other communication devices via the Internet 130. The external server 300 can receive data stored in the PC 100 or the mobile terminal 200, store the data in memory, and process the data or transmit the data to other devices such as the PC 100. The printer 400 or the external printer 500 receives data stored in the PC 100, the mobile terminal 200, or the external server 300, and prints the data on a recording medium such as printing paper.

[0012] In the printing system of FIG. 1, a user of the PC 100 can print content created using a Web application of the external server 300 with a printer 400. Also, the user of the PC 100 can print content to be printed with a native application pre-installed in the PC 100 without using the Web application of the external server 300 with the printer 400. The user of the PC 100 can associate the Web application and the native application in advance so that they can be linked, and can print content created with the Web application with the printer 400 via the native application. Alternatively, the user of the PC 100 can send content created with a Web application or a native application to the external server 300, and print the content received by the external server 300 with an external printer 500.

[0013] In this embodiment, regardless of the above-mentioned configurations, an application for a user to print content on the PC 100 is simply called an "application." The hardware configuration of each device in FIG.

[0014] FIG. 2 is a diagram showing an example of the hardware configuration of each device in the printing system of FIG. 1. First, the hardware configuration of the PC 100 will be described. The CPU 101 is a central processing unit and controls the PC 100, which is an information processing device, in an overall manner. The ROM 102 is a non-volatile storage and holds various data, programs, and tables. For example, the ROM 102 stores a basic program and various application programs. The application programs include, for example, a print application program downloaded from an external server and installed, and a front-end program in a Web application of the external server 300. The RAM 103 is a volatile storage and temporarily holds programs and data. The external storage device 104 is a non-volatile storage such as a hard disk drive (HDD) or a solid state drive (SSD), and holds programs and data. The CPU 101 executes various processes based on the programs and data stored in the ROM 102, the RAM 103, and the external storage device 104. For example, the operation of the PC 100 in this embodiment is realized by the CPU 101 reading the programs stored in the ROM 102 into the RAM 103 and executing them.

[0015] The data communication interface (I / F) 105 executes data communication with an external device. For example, the data communication I / F 105 controls transmission and reception of data between the external server 300 and the printer 400 via the router 120. For example, a wired connection method such as USB, IEEE1394, or LAN, or a wireless connection method such as Bluetooth (registered trademark) or WiFi (registered trademark) is used as the data communication method. The input device control unit 106 acquires information on a user operation accepted via the input device 107, and transmits the information to the CPU 101. The input device 107 is a HID (Human Interface Device) such as a keyboard or a mouse. The display device control unit 108 converts screen data such as a user interface screen into drawing data, and transmits the drawing data to the display 110 to display it. The blocks in the PC 100 are connected to each other via an internal bus 109. The configuration of the PC 100 is not limited to the configuration shown in FIG. 2, and may have a configuration according to the functions that the device applied as the PC 100 can execute.

[0016] Next, the hardware configuration of the mobile terminal 200 will be described. The mobile terminal 200 mainly has the functions of an information processing device such as a tablet computer or a smartphone, and has a touch panel that serves as a display and an input I / F. The CPU 201 is a central processing unit and controls the mobile terminal 200 in an overall manner. The ROM 202 is a non-volatile storage and holds various data and programs. For example, a basic program and various application programs are stored in the ROM 202. The RAM 203 is a volatile storage and temporarily holds programs and data. The external storage device 204 is a non-volatile storage such as a hard disk drive (HDD) or a solid state drive (SSD), and holds programs and data. The external storage device 204 may be configured as an external device. The CPU 201 executes various processes based on the programs and data stored in the ROM 202, the RAM 203, and the external storage device 204. For example, the operation of the mobile terminal 200 in this embodiment is realized by the CPU 201 reading out the program stored in the ROM 202 into the RAM 203 and executing it.

[0017] The data communication I / F 205 executes data communication with an external device. For example, a wired connection method such as USB, IEEE1394, or LAN, or a wireless connection method such as Bluetooth or WiFi is used as a data communication method. The input device control unit 206 acquires information about a user operation received via the input device 207, and transmits the information to the CPU 201. The input device 207 is a device capable of receiving an input operation on a screen such as a touch panel equipped with a display and input function provided in a tablet computer or a smartphone. The display device control unit 208 converts screen data such as a user interface screen into drawing data, and displays the drawing data on the display device 209. The blocks in the mobile terminal 200 are connected to each other via an internal bus 210. The configuration of the mobile terminal 200 is not limited to the configuration shown in FIG. 2, and may have a configuration according to a function that the device applied as the mobile terminal 200 can execute.

[0018] Next, the hardware configuration of the external server 300 will be described. The CPU 301 is a central processing unit and controls the external server 300. The ROM 302 is a non-volatile storage and holds various table data and programs. For example, a basic program and various application programs are stored in the ROM 302. The application programs include, for example, a print application that can be downloaded by the user. The RAM 303 is a volatile storage and temporarily holds programs and data. The external storage device 304 is a non-volatile storage such as a hard disk drive (HDD) or a solid state drive (SSD) and holds programs and data. For example, the operation of the external server 300 in this embodiment is realized by the CPU 301 reading out the program stored in the ROM 302 into the RAM 303 and executing it.

[0019] The data communication I / F 305 executes data communication with an external device. For example, the data communication I / F 305 controls transmission and reception of data between the PC 100 and the printer 400 via the router 120. For example, a wired connection method such as USB, IEEE1394, or LAN, or a wireless connection method such as Bluetooth or WiFi is used as the data communication method. The blocks in the external server 300 are connected to each other via an internal bus 306. The configuration of the external server 300 is not limited to the configuration shown in FIG. 2, and may have a configuration according to the functions executable by a device applied as the external server 300.

[0020] Next, a hardware configuration of the printer 400 will be described. The data communication I / F 401 executes data communication with external devices. For example, the data communication I / F 401 controls transmission and reception of data between the PC 100 and the external server 300 via the router 120. As a data communication method, for example, a wired connection method such as USB, IEEE1394, or LAN, or a wireless connection method such as Bluetooth or WiFi is used.

[0021] The printer 400 can receive print data generated by the PC 100, the mobile terminal 200, or the external server 300 and print the data on a recording medium. The print data includes image data to be printed and print setting data that specifies print settings. The printer controller 402 controls the printer engine 403 based on the print data received from an external device.

[0022] The printer controller 402 performs, for example, color space conversion and color separation processing into color materials according to the type of paper specified in the print setting data on the image data, and generates print data that can be processed by the printer engine 403. The printer controller 402 also performs image processing such as output tone correction and halftoning using image processing parameters such as lookup tables.

[0023] The printer engine 403 converts the image data of the print data into ink color data for each ink used in the printer 400, and executes the print process. The printer engine 403 has a configuration corresponding to the recording method of the printer 400. For example, in this embodiment, the printer 400 is assumed to be an inkjet printer that records on a recording medium by an inkjet recording method. In this case, the printer engine 403 is configured to include ink tanks that store each ink, and a print head provided with a nozzle array that ejects ink droplets. In the print process, the printer engine 403 controls the heating operation of a heater mounted on the print head based on the print data, and controls the ejection of ink droplets from the nozzles.

[0024] The configuration of printer 400 is not limited to the configuration shown in Fig. 2, but may have a configuration appropriate to the functions executable by a device applied as printer 400. Furthermore, printer 400 is not limited to a printer using an inkjet recording method, but may be a printer using another recording method such as an electrophotographic method. Furthermore, printer 400 may be a multifunctional peripheral (MFP) in which functions such as a scanner and a facsimile are integrated. Furthermore, external printer 500 may have the same configuration as printer 400 described above.

[0025] The external server 300 is, for example, a Web server that provides a Web application that enables a user to create and edit content data (e.g., poster image data) to be printed. In this case, the software of the external server 300 includes a front end that controls the display of a Web browser of the PC 100 or the like, and a back end. The front end manages / holds a program (JavaScript) that is executed on the Web browser, and by sending (downloading) it to the PC 100, for example, the corresponding display is performed in the Web browser of the PC 100. The front end includes, for example, a program for performing user authentication and a program for processing the creation / editing of content. Note that when a front end program is downloaded to the PC 100, the program becomes part of the software configuration of the PC 100.

[0026] In this embodiment, a native application pre-installed in the PC 100 is assumed as an example of an application capable of creating and editing content data. A printer driver corresponding to the printer 400 is installed in the PC 100. However, a configuration may be adopted in which a user creates / edits content such as a poster by a front end on the PC 100 side, and a rendering process is executed by a back end on the external server 300 side. In this case, when the front end receives a print instruction from the user, it instructs the back end to print based on the print settings for the printer driver, and transmits the content data created / edited by the user to the back end. The back end performs rendering processing on the transmitted content data and transmits it to the PC 100. The content data that has undergone rendering processing is printed by a printer corresponding to the printer driver.

[0027] 3 is a diagram showing an example of the software configuration of the PC 100. The PC 100 includes an application 2, an operating system 3, a monitor driver 4, and a printer driver 5 as its software configuration.

[0028] In this embodiment, the application 2 is, for example, an application for creating a poster, and can edit the layout data of the poster. The application 2 is assumed to be a native application pre-installed in the PC 100, but may be a front-end program of a Web application. The application 2 issues various drawing process commands (image drawing commands, text drawing commands, graphics drawing commands, etc.) for outputting the execution results of processes such as creation and editing. The drawing command group issued by the application 2 is input to the monitor driver 4 via the operating system 3. In addition, when the drawing process command group is related to printing, the drawing command group issued by the application 2 is input to the printer driver 5 via the operating system 3. The printer driver 5 is software for processing the input drawing process command group to create print data and for causing the printer 400 to print. In addition, the monitor driver 4 is software for processing the input drawing process command group to create display data and for displaying the data on the display 110.

[0029] The application 2 creates output image data using text data classified as text such as characters, graphics data classified as graphics such as figures, and image data classified as images. The output image data can be displayed on the display 110. For example, the application 2 displays a poster image of the output image data to be created and edited by the user on the user interface screen of the application 2. When the application 2 accepts a user instruction on the user interface screen to print an image based on the output image data, it requests the operating system 3 to print it out. In such cases, a group of drawing process commands in which the text data portion is composed of text drawing commands, the graphics data portion is composed of graphics drawing commands, and the image data portion is composed of image drawing commands is issued to the operating system 3.

[0030] In general, the application 2 provides layout data templates to facilitate the user's creation of layout data. Templates are prepared according to the purpose of creating layout data, and text and images suitable for each purpose are arranged in advance. For example, if the purpose is a "zoo" template, layout data is provided in which text containing a tentative zoo name, animal images, text of animal names, etc. are arranged.

[0031] If a user likes the layout and design of the text and images of a template, the user can edit the template to create the user's own layout data. When the user edits a template to create layout data, it is easy to change the text that is pre-placed in the template. On the other hand, when the user wants to change an image that is pre-placed in the template, the user must edit the image himself. Alternatively, the user must prepare the image himself, which can make creating layout data a hassle.

[0032] In this embodiment, a configuration is described that improves user convenience when a user edits a template to create layout data by acquiring an image based on the text edited by the user and changing a pre-placed image to the acquired image.

[0033] Information relating to an image placed on a template of layout data provided by application 2 will be described with reference to FIG. 4. FIG. 4 shows an example of information relating to an image stored in external storage device 104. An image is placed on a template, which will be described later. In this embodiment, information relating to an image placed on a template includes an image ID, image coordinates, and a file path. Information relating to an image is not limited to this, and may include other information. Also, it is not limited to the values ​​shown in the figure, and may be other values.

[0034] The image ID is, for example, an ID for identifying an image placed on a template. In Fig. 4, x, y, width, and height are image coordinates, and indicate the x coordinate, y coordinate, width, and height of the image placed on the template. For example, when x is set to 0 and y is set to 0, the coordinate position (x, y) indicates the origin position. The origin position is, for example, the upper left corner of the template.

[0035] The file path is, for example, a path for accessing a file in which an image is saved. The format of the saved image is, for example, *.jpg, which is a general image such as a photograph taken by a digital still camera or the like and saved. Note that the format of the saved image is not limited to this. The format of the saved image may be, for example, *.png or other formats.

[0036] Next, information about text placed in a template provided by application 2 will be described with reference to FIG. 5. FIG. 5(a) shows information about text placed in advance in a template. FIG. 5(b) shows information about text edited by a user. Text is placed in a template, which will be described later. In this embodiment, information about text placed in a template includes a text ID, text coordinates, text, font, font size, font color, and image ID to be changed. Information about text is not limited to this and may include other information. Also, it is not limited to the values ​​shown in the figure and may be other values.

[0037] The text ID is, for example, an ID for identifying the text arranged in the layout data.

[0038] x, y, width, and height are text coordinates, and indicate the x coordinate, y coordinate, width, and height of the text placed on the template, similar to the image coordinates described above.

[0039] The text is the text to be placed in the template. In Fig. 5(a), the text with the text ID T0001 is stored as "XXX Zoo". When the text of T0001 is changed to "Cat Introduction" by the user as described later, the text of T0001 is changed to "Cat Introduction" as shown in Fig. 5(b).

[0040] The font is the font of the text. The font is set to, for example, MSP Gothic. The font size is the font size of the text. The font color is the font color of the text, and is stored and managed, for example, in hexadecimal. The font, font size, and font color of the text are not limited to these and can be changed as appropriate.

[0041] The image ID to be changed is the image ID of the image to be changed when the text is edited. For example, when the text with the text ID T0001 is changed from "XXX Zoo" in Fig. 5(a) to "Introduction to Cats" in Fig. 5(b), the images with the image IDs I0001 and I0002 are changed.

[0042] 6 shows an example of the configuration of an editing screen displayed for creating layout data, which is realized by the above-mentioned application 2. On an editing screen 601, for example, a layout data display section 602, a template display button 611, an add text button 612, an add image button 613, and a template list display section 614 are displayed.

[0043] Layout data display section 602 displays layout data 603. Images 604 to 605 and text 606 to 610 are arranged in layout data 603. Information about images 604 to 605 is stored in external storage device 104 as described above, and is shown in FIG. 4. Image 604 is an image with an image ID of I0001, and image 605 is an image with an image ID of I0002. Information about text 606 to 610 is stored in external storage device 104 as described above, and is shown in FIG. 5(a). Text 606 is text with a text ID of T0001, text 607 is text with a text ID of T0002, text 608 is text with a text ID of T0003, text 609 is text with a text ID of T0004, and text 610 is text with a text ID of T0005.

[0044] The template display button 611 is a button that displays a list of templates that can be used to create layout data. For example, when the template display button 611 is pressed by the user, a template list display section 614 is displayed on the editing screen 601.

[0045] In the template list display section 614, for example, a list of category names and templates is displayed. The category name indicates the purpose of the template. The category name 615 indicates that the templates 618-619 are for sales, the category name 616 indicates that the templates 620-621 are for information, and the category name 617 indicates that the templates 622-623 are for restaurant menus. The templates 618-623 are templates that can be used for editing to create the layout data 603. When the user presses any template displayed in the template list display section 614, the CPU 101 performs a template acquisition process to acquire the template pressed by the user, and the template is displayed in the layout data display section 602.

[0046] The add text button 612 is a button for adding text to the layout data 603. For example, when the add text button 612 is pressed by the user, text is added to the layout data 603 (not shown).

[0047] The add image button 613 is a button for adding an image to the layout data. For example, when the user presses the add image button 613, a file designation dialog (not shown) by the OS is displayed on the edit screen 601. The user can select an image file from the file designation dialog. The image file selected by the user is added to the layout data 603 (not shown).

[0048] Next, a case where a user edits the layout data 603 displayed in the layout data display section 602 will be described with reference to Fig. 7. In this example, a case will be described where a user likes the layout and design of template 620 intended for "zoo guide" among templates 620-621 prepared for the purpose of guide 616 on the editing screen 601 in Fig. 6, and the user creates layout data 603 intended for "introducing cats" based on template 620 to put up a poster in a cafe where cats live.

[0049] Fig. 7(a) shows layout data 603 before editing by the user. The layout data 603 reflects the template 620 intended for the "zoo guide" shown in Fig. 6. The user selects text to be edited from among the texts arranged in advance in the layout data 603. For example, if the user wishes to edit text 606, the user can select it by pressing it.

[0050] 7(b) shows layout data 603 in a state in which text 606 that the user wishes to edit has been selected. When text 606 is selected by the user, a selection frame 624 is displayed to surround text 606. Selection frame 624 is displayed to indicate the selected text 606. In addition, a text cursor 625 is displayed to edit the selected text 606. When text cursor 625 is displayed, the user can edit the text to any desired text.

[0051] FIG. 7C shows the layout data 603 in which the text 606 "XXX Zoo" selected in FIG. 7B has been edited by the user to become the text 626 "Introduction to Cats."

[0052] Fig. 7(d) shows the layout data 603 when editing of the text 626 is accepted. For example, in the layout data 603 shown in Fig. 7(C), when the user presses any area outside the selection frame 624, the edited text 626 is confirmed and the editing of the text 626 is accepted. When the editing of the text 626 is accepted, the information about the text stored in the external storage device 104 is changed. In this example, as described above, the text is changed from the text "XXX Zoo" with a text ID of T0001 in Fig. 5(a) to the text "Introduction to Cats" with a text ID of T0001 in Fig. 5(b).

[0053] FIG. 7(e) shows layout data 603 after images 604-605, which were pre-arranged in layout data 603, have been changed to images 627-628 related to key phrases in edited text 626 through processing described below, based on the acceptance of an edit of text 626.

[0054] A key phrase is a key phrase extracted by a so-called key phrase extraction algorithm, and is, for example, a phrase in a text that expresses the meaning of the text well. In this example, the key phrase of the changed text "Introduction to a cat" 626 is "cat", and it is changed to images 627-628 related to "cat".

[0055] Next, the process executed when the user's request to edit text is accepted will be described with reference to Fig. 8. The process in Fig. 8 is realized, for example, by CPU 101 reading a program stored in ROM 102 into RAM 103 and executing it. The process in Fig. 8 starts, for example, when the user edits text that has been placed in advance on layout data and CPU 101 accepts the request to edit the text. The following process will be described using the example of the user's request to edit layout data shown in Fig. 7.

[0056] In S101, the CPU 101, upon receiving an instruction to edit text, refers to information about the text stored in the external storage device 104 and acquires information about the image to be changed.

[0057] The information of the image to be changed is, for example, an image ID, and CPU 101 acquires the image ID of the image to be changed based on the text ID of the text accepted for editing. In this example, the text ID of text 626 "Introducing a cat" accepted for editing in Fig. 7(d) is T0001 as shown in Fig. 5. The image IDs of the images to be changed acquired in S101 are I0001 and I0002.

[0058] In S102, CPU 101 determines whether there is one or more images to be changed obtained in S101. If it is determined that there is one or more images to be changed, the process proceeds to S103. On the other hand, if it is determined that there is no image to be changed, the process of FIG. 8 ends. If there is one or more images to be changed in S102, the following processes from S103 to S106 are repeatedly executed according to the number of images to be changed. In this example, since there are two image IDs of the images to be changed, I0001 and I0002, the following processes from S103 to S106 are executed twice.

[0059] In S103, the CPU 101 performs a key phrase acquisition process, which will be described later. In this example, the CPU 101 acquires a key phrase from the text 626 "Introduction to a cat" having the text ID T0001 shown in FIG.

[0060] In S104, CPU 101 acquires an image related to the key phrase acquired in S103 by an image acquisition process described below. When CPU 101 acquires an image related to the key phrase, it stores the acquired image in external storage device 104. CPU 101 also stores a file path indicating the storage destination of the acquired image in a storage area such as RAM 103. In this example, CPU 101 acquires an image related to the key phrase "cat" acquired for text 626 "Introduction to a cat", stores the image related to the key phrase "cat" in external storage device 104, and memorizes the file path indicating the storage destination.

[0061] In S105, CPU 101 determines whether an image related to the key phrase was obtained in S104. If it is determined that an image was obtained in S104, the process proceeds to S106. On the other hand, if an image was not obtained in S104, the process of Fig. 8 is ended, or the process of S103 is repeated. In this example, it is determined that an image related to the key phrase "cat" was found, and the process proceeds to S106.

[0062] In S106, the CPU 101 updates the image previously arranged in the template to an image related to the key phrase acquired in S104. In the process of S106, the information on the image stored in the external storage device 104 is referred to, and the file path indicated by the image ID of the image to be changed is changed to the file path of the image related to the key phrase stored in S104. In other words, the process of S106 is also a process of generating a new template using the edited text and the image related to the key phrase acquired in S104. After the process of S106 is executed, the process of FIG. 8 is ended, or the process of S103 is repeated. In this example, the file path is updated to the image related to the key phrase "cat" acquired from the text 626 "Introduction to a cat" stored in S104. As a result, the image is updated to cat images 627 to 628 as shown in FIG. 7(e).

[0063] Next, the key phrase acquisition process of S103 will be described with reference to Fig. 9. Note that, if it is determined in S102 that there is one or more images to be changed, the following processes from S201 to S2002 may be repeatedly executed according to the number of images to be changed.

[0064] In S201, CPU 101 refers to information related to text stored in external storage device 104 and acquires text from the text ID for which editing has been accepted. In this example, the text for which editing by the user has been accepted in Fig. 7(d) is text 626 "Introduction to a cat". Therefore, in the information related to text shown in Fig. 5, text "Introduction to a cat" with text ID T0001 is acquired.

[0065] In S202, the CPU 101 acquires a key phrase from the text acquired in S201.

[0066] The process of S202 will now be described with reference to Fig. 10(a). Fig. 10(a) is a sequence diagram showing an example of the communication process executed between the information processing device 100 and the external server 300 in S202 of Fig. 9.

[0067] S301 is executed based on the CPU 101 acquiring text for which editing has been accepted. In S301, the information processing device 100 requests a key phrase from the external server 300. For example, in order to use a key phrase acquisition service provided in the external server 300, the information processing device 100 may request a key phrase using the text acquired in S201 of FIG. 9 using an Application Programming Interface (hereinafter, API) to use the key phrase acquisition service. The key phrase acquisition service is, for example, a service that, when receiving text from a requester via an API from which a key phrase is to be acquired, acquires a key phrase from the received text and provides the key phrase to the requester. In this embodiment, the external server 300 is described as providing the key phrase acquisition service, but a server other than the external server 300 may provide the key phrase acquisition service, and the information processing device 100 may request the key phrase from that server.

[0068] In S302, the information processing device 100 acquires a key phrase provided by the external server 300. The key phrase acquired by the information processing device 100 from the external server 300 in S302 is, for example, a key phrase extracted from the text acquired by the external server 300 from the information processing device 100 in S301. In this example, the text accepted for editing is "Introduction to a cat." Therefore, the information processing device 100 acquires "cat" as a key phrase, for example, by providing "Introduction to a cat" to a key phrase acquisition service.

[0069] 9 has been described as using a keyphrase acquisition service as an example, but is not limited thereto. The information processing device 100 may be provided with a graphics processing unit (GPU) capable of parallel processing of a larger amount of data, and the keyphrase extraction in this embodiment may be performed by natural language processing. In this case, for example, python keyphrase extraction may be used as the natural language processing.

[0070] In the present embodiment, the information processing device 100 requests a key phrase from the external server 300 and acquires the key phrase from the external server 300. However, the server from which the information processing device 100 requests a key phrase is not limited to this. For example, the server may be a server other than the external server 300.

[0071] Next, an example of image acquisition processing when the CPU 101 acquires an image in S104 of Fig. 8 will be described with reference to Fig. 10(b). Fig. 10(b) is a sequence showing an example of communication processing executed between the information processing device 100 and the external server 300 in S104 of Fig. 8.

[0072] S401 is executed based on the acquisition of a key phrase by the CPU 101. In S401, the information processing device 100 requests images from the external server 300. In this embodiment, the external server 300 has a database that stores images classified in advance into key phrases (e.g., "cat") using a learning model, and returns a list of images associated with the key phrase transmitted from the information processing device 100.

[0073] In S402, the information processing device 100 receives a list of images provided by the external server 300. The list of images may be, for example, a file including a plurality of images.

[0074] In the present embodiment, an example has been described in which an image is acquired from a database held by the external server 300, but the present invention is not limited to this. For example, the information processing device 100 may acquire an image from a server other than the external server 300 described above.

[0075] When acquiring images from a server other than the external server 300, for example, a service may be used that accepts a key phrase from a requester via an API, searches for images related to the accepted key phrase, and provides the image to the requester if an image is found. The above service may be, for example, a stock photo service provided by the server. A stock photo service is a service that, for example, stocks multiple images such as photographs and illustrations according to purposes, and provides images related to the key phrase searched by the requester.

[0076] In this way, according to the present embodiment, when the user edits the text, the image that is pre-placed in the template of the layout data is changed to an image related to the key phrase of the text edited by the user. Therefore, even if the user does not have the image, the user can easily create his / her own layout data by using a template whose image and text layout or design he / she likes, thereby improving the user's convenience.

[0077] <Second embodiment> The second embodiment will be described below with respect to the differences from the first embodiment. In the first embodiment, a configuration for acquiring an image based on text edited by a user has been described. In this embodiment, a form for acquiring an image based on the text edited by a user and additional information of an image placed in a template will be described.

[0078] Fig. 11 shows an example of information about an image stored in the external storage device 104 in this embodiment. The information about an image in this embodiment includes an image ID, image coordinates (x, y, width, height), file path, and additional information. The information about an image is not limited to this, and may include other information. Furthermore, it is not limited to the values ​​shown in the figure, and may be other values.

[0079] The image ID, image coordinates (x, y, width, height), and file path are the same as the information about the image in FIG. 4 described above, and therefore a description of these will be omitted.

[0080] The additional information is information on the characteristics of the image to be placed on the template. The image characteristics may be, for example, the style of the image. The image style is, for example, "illustration" in the case of an image that is an illustration. The image style may be, for example, painting, oil painting, etc. The image characteristics may be, for example, the color tone of the image. The image color tone is, for example, "monochrome" if the image is based on black and white. The image color tone may be, for example, a sepia tone. In this example, images 604 to 605 with image IDs I0001 and I0002 are illustration-like images shown in FIG. 6, and "illustration" is stored in the additional information.

[0081] Next, a process for generating a key phrase based on additional information of text and images edited by a user will be described with reference to Fig. 12. Since S501 to S502 in Fig. 12 are similar to S201 to S202 in Fig. 9, a description thereof will be omitted.

[0082] In S503, CPU 101 performs additional information acquisition processing to acquire additional information of the image to be changed by referring to information related to the image stored in external storage device 104. In this example, CPU 101 acquires additional information "illustration" of images 604-605 to be changed, as shown in FIG.

[0083] In S504, CPU 101 generates a key phrase by combining the key phrase acquired in S502 with the additional information of the image to be changed acquired in S503. In this example, CPU 101 generates a key phrase "cat illustration" by combining the key phrase "cat" acquired in S502 with the additional information "illustration" of images 604-605 to be changed acquired in S503. By using a key phrase consisting of multiple words separated by spaces, such as "cat illustration," and acquiring images by the process of Fig. 10(b) described above, it is possible to acquire images related to all of the multiple words separated by spaces.

[0084] As described above, according to this embodiment, an image is acquired based on the key phrase of the text edited by the user and the additional information of the image placed in the template. This makes it easier to change the image to one that is closer to the image desired by the user. This improves the convenience when a user likes the design or layout of a template and creates their own layout data based on that template.

[0085] <Third embodiment> The third embodiment will be described below with respect to the differences from the first and second embodiments. In this embodiment, a mode will be described in which, when an image cannot be acquired based on a key phrase, the user is notified of the image acquisition result.

[0086] 13 shows an example of a notification screen when an image cannot be acquired based on the key phrase. A notification screen 701 is displayed as a pop-up screen on the edit screen 601 shown in FIG.

[0087] A message 702, a search word 703, and a button 704 are displayed on the notification screen 701. Note that the contents displayed on the notification screen 701 are not limited to these, and other contents may be included.

[0088] Message 702 represents the retrieval of images related to key phrases in the user-edited text.

[0089] A search word 703 is a key phrase that the CPU 101 uses to acquire an image based on text edited by the user.

[0090] In this example, the key phrase "cat" is obtained from the text "Introduction to cats" edited by the user, and an image acquisition process is performed based on the key phrase "cat." As a result, it is shown that no images related to the key phrase "cat" could be obtained.

[0091] The button 704 is a button for closing the display of the notification screen 701. For example, when the user presses the button 704, the notification screen 701 can be closed.

[0092] Next, the process executed when a user's request to edit text is accepted in this embodiment will be described with reference to Fig. 14. The process in Fig. 14 is realized, for example, by CPU 101 reading a program stored in ROM 102 into RAM 103 and executing it. The process in Fig. 14 starts, for example, when a user edits text arranged in advance on layout data and CPU 101 accepts the request to edit the text. S601 to S606 in Fig. 14 are the same as S101 to S106 in Fig. 8, and therefore description thereof will be omitted.

[0093] In S605, CPU 101 determines whether an image related to the key phrase was acquired in S604. If it is determined that an image related to the key phrase was not acquired, the process proceeds to S607. On the other hand, if it is determined that an image related to the key phrase was acquired, the process proceeds to S606, where the image is updated to an image related to the key phrase.

[0094] In S607, CPU 101 generates a message based on the key phrase used to obtain an image related to the key phrase in S604.

[0095] In S608, the CPU 101 displays the notification screen 701 on the editing screen 601, and ends the processing in FIG. 14, or, if it is determined in S602 that there are a plurality of images to be changed, repeats the processing in S603.

[0096] As described above, according to this embodiment, when an image cannot be acquired based on the key phrase, the user is notified of the image acquisition result together with the key phrase. With this configuration, the user can know the key phrase used when acquiring the image, and can re-edit the text based on the key phrase. Alternatively, the user can search for images by himself / herself by referring to the key phrase displayed on the notification screen. Therefore, it is possible to improve convenience when the user likes the design or layout of a template and creates his / her own layout data based on the template.

[0097] <Fourth embodiment> The fourth embodiment will be described below with respect to the differences from the first to third embodiments. In this embodiment, when a user changes an image arranged on a template and then accepts editing of the text by the user, the image changed by the user continues to be arranged even if an image is acquired based on the edited text.

[0098] Fig. 15 shows an example of information related to an image stored in the external storage device 104 in this embodiment. As shown in Figs. 15(a) and (b), the information related to an image in this embodiment includes an image ID, image coordinates (x, y, width, height), a file path, and changed information.

[0099] The image ID, image coordinates, and file path are the same as those in FIG. 4, so their explanation will be omitted. The information about the image is not limited to this, and may include other information. Also, it is not limited to each value shown in the figure, and may be other values.

[0100] The changed information is information regarding whether or not an image placed on a template has been changed by a user. For example, if an image placed on a template has been changed by a user, it is stored as "Yes", and if it has not been changed by a user, it is stored as "No". In other words, if the changed information is stored as "No", the image is an image that was placed on the template in advance. In this example, in FIG. 15(a), images with image IDs I0001 and I0002 are not changed by a user, and the changed information is stored as "No". On the other hand, in FIG. 15(b), an image with image ID I0001 is changed by a user, and the changed information is stored as "Yes".

[0101] Next, a case where the user changes an image placed on a template will be described with reference to FIG.

[0102] 16(a) shows an example of the layout data display section 602 when the user changes the image placed on the template. When the user changes the image placed on the template, an image selection dialog 629 is displayed on the layout data display section 602. Images 630 to 633 saved in a specified file path are displayed on the image selection dialog 629.

[0103] The image selection dialog 629 is displayed, for example, when the user selects an arbitrary image arranged in the layout data. The user can change the image 630 to image 630 as shown in FIG. 16(b) by dragging and dropping a desired image 630 from images 630-633 displayed in the image selection dialog 629 onto image 604 to be changed among images 604-605 displayed in the layout data 603 being edited.

[0104] Next, the process executed when the user changes an image will be described with reference to Fig. 17. The process in Fig. 17 is realized, for example, by CPU 101 reading a program stored in ROM 102 into RAM 103 and executing it. The process in Fig. 17 starts, for example, when it is accepted that an image to be changed has been dragged and dropped onto an image that has been arranged in advance on layout data by the user.

[0105] In S701, the CPU 101 refers to information about an image stored in the external storage device 104, and changes the file path of the image ID for which a change to the image has been accepted.

[0106] In S702, the CPU 101 changes the changed information of the image ID for which the change of the image was accepted in S701, among the information related to the image stored in the external storage device 104.

[0107] In this example, the user dragged and dropped image 630 displayed in the image selection dialog onto image 604 arranged in the layout data in Fig. 16(a). As shown in Fig. 15(a) and (b), in S701, CPU 101 refers to information related to image 604 for which changes have been accepted, and changes the file path of the image with image ID I0001 to the file path of image 630. Also, in S702, the changed information is changed from "No" to "Yes."

[0108] Next, the process executed when a request to edit text in this embodiment is accepted will be described with reference to Fig. 18. The process in Fig. 18 is realized, for example, by CPU 101 reading a program stored in ROM 102 into RAM 103 and executing it. The process in Fig. 18 starts, for example, when a user edits text that has been placed in advance on layout data and CPU 101 accepts a request to edit the text.

[0109] S801 to S805 and S808 in Fig. 18 are similar to S101 to S106 in Fig. 8, and therefore description thereof will be omitted. If it is determined in S805 that the image has been acquired, in S806, the CPU 101 refers to information relating to the image stored in the external storage device 104, and acquires changed information about the image.

[0110] In S807, the CPU 101 determines whether the changed information of the image acquired in S806 is "No". If it is determined in S807 that the information is "No", the process proceeds to S808. On the other hand, if it is determined in S807 that the information is not "No", the process of Fig. 18 is terminated, or if it is determined in S802 that there are multiple images to be changed, the process of S803 is repeatedly executed.

[0111] In this example, in S806, CPU 101 acquires that the changed information of image 630 with image ID I0001 is "Yes" as shown in Fig. 15(b). Therefore, in S807, CPU 101 determines that the changed information of the image is not "No". Therefore, image 630 with image ID I0001 is maintained in layout data 603.

[0112] Also, in this example, in S806, CPU 101 acquires that the changed information of the image having the image ID I0002 is "No" as shown in Fig. 15(b). Therefore, in S807, CPU 101 determines that the changed information of the image is "No" and proceeds to S808.

[0113] As described above, according to this embodiment, if a user changes an image placed on a template and then accepts editing of the text by the user, the image changed by the user continues to be placed even if an image is acquired based on the edited text. This improves convenience when a user likes the design or layout of a template and creates their own layout data based on that template.

[0114] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0115] The disclosure of the present embodiment includes the following information processing device, method, and program. (Item 1) A template acquiring means for acquiring a first template including a first text and a first image; A receiving means for receiving an edit of the first text; a key phrase acquisition means for acquiring a key phrase from the text after the edit is accepted by the accepting means; an image acquisition means for acquiring a second image related to the key phrase acquired by the key phrase acquisition means; a generating means for generating a second template using the edited text and the second image acquired by the image acquiring means; An information processing device comprising: (Item 2) 2. The information processing device according to item 1, wherein the key phrase acquisition means acquires the key phrase by requesting the key phrase from an external server together with the text after the edits have been accepted by the acceptance means. (Item 3) 3. The information processing device according to item 1 or 2, characterized in that the key phrase is extracted by natural language processing from the text after the edit is accepted by the accepting means. (Item 4) 4. The information processing device according to any one of items 1 to 3, wherein the image acquisition means acquires the second image by requesting the second image from an external server together with the key phrase acquired by the key phrase acquisition means. (Item 5) 5. The information processing device according to any one of items 1 to 4, wherein the second image is an image associated with a meaning expressed by the key phrase. (Item 6) 6. The information processing device according to any one of items 1 to 5, wherein the generating means uses the second image instead of the first image. (Item 7) 7. The information processing device according to any one of items 1 to 6, wherein the generating means lays out the second image at a position of the first image in the first template. (Item 8) Further comprising an additional information acquisition means for acquiring additional information of the first image, When the additional information of the first image is acquired by the additional information acquisition means, 8. The information processing device according to any one of items 1 to 7, wherein the image acquisition means acquires additional information of the first image and the second image related to the key phrase. (Item 9) 9. The information processing device according to item 8, wherein the additional information of the first image is information on the style and / or color tone of the first image. (Item 10) a determining means for determining changed information of the first image; the changed information is information regarding whether the first image is an image that has been changed by a user; When the determination means determines that the first image is an image that has been modified by a user, 10. The information processing device according to any one of items 1 to 9, wherein the generating means uses the first image that is determined to be an image that has been modified by a user, without using the second image. (Item 11) When the determination means determines that the first image is not an image that has been modified by a user, 11. The information processing device according to item 10, wherein the generating means uses the second image instead of the first image. (Item 12) a notification unit that notifies a user of a result of acquisition of the second image by the image acquisition unit, 12. The information processing device according to any one of items 1 to 11, characterized in that, when the second image cannot be acquired, the notification means notifies the user of the result that the second image cannot be acquired and the key phrase. (Item 13) 13. The information processing device according to any one of items 1 to 12, wherein the first template and the second template are templates used for creating a poster. (Item 14) A method executed in an information processing device, comprising: a template acquisition step of acquiring a first template including a first text and a first image; a receiving step of receiving an edit of the first text; a key phrase acquisition step of acquiring a key phrase from the text after the edit is accepted by the accepting step; an image acquiring step of acquiring a second image related to the key phrase acquired by the key phrase acquiring step; and generating a second template using the text after receiving the edits and the second image acquired by the image acquisition step. (Item 15) 14. A program for causing a computer to function as each of the means of the information processing device according to any one of items 1 to 13.

[0116] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0117] 100 PC: 200 Mobile terminal: 300 External server: 400 Printer: 500 External printer: 101, 201, 301 CPU: 102, 202, 302 ROM: 103, 203, 303 RAM

Claims

1. a template acquisition means for acquiring a first template including a first text and a first image; A receiving means for receiving an edit of the first text; a key phrase acquisition means for acquiring a key phrase from the text after the edit is accepted by the accepting means; an image acquisition means for acquiring a second image related to the key phrase acquired by the key phrase acquisition means; a generating means for generating a second template using the edited text and the second image acquired by the image acquiring means; An information processing device comprising:

2. 2. The information processing apparatus according to claim 1, wherein the key phrase acquisition means acquires the key phrase by requesting the key phrase from an external server together with the text after the edits have been accepted by the acceptance means.

3. 3. The information processing apparatus according to claim 2, wherein the key phrase is extracted by natural language processing from the text after the edit is accepted by the accepting means.

4. 2. The information processing apparatus according to claim 1, wherein the image acquisition means acquires the second image by requesting the second image from an external server together with the key phrase acquired by the key phrase acquisition means.

5. The information processing apparatus according to claim 4 , wherein the second image is an image associated with a meaning expressed by the key phrase.

6. The information processing apparatus according to claim 1 , wherein the generating means uses the second image instead of the first image.

7. 7. The information processing apparatus according to claim 6, wherein the generating means lays out the second image at a position of the first image in the first template.

8. Further comprising additional information acquisition means for acquiring additional information of the first image, When the additional information of the first image is acquired by the additional information acquisition means, 2. The information processing apparatus according to claim 1, wherein the image acquisition means acquires additional information of the first image and the second image related to the key phrase.

9. 9. The information processing apparatus according to claim 8, wherein the additional information of the first image is information on the style and / or color tone of the first image.

10. a determining means for determining modified information of the first image; the modified information is information regarding whether the first image is an image modified by a user; When the determination means determines that the first image is an image that has been modified by a user, 7. The information processing apparatus according to claim 6, wherein the generating means uses the first image determined to be an image that has been modified by a user, without using the second image.

11. When the determination means determines that the first image is not an image that has been modified by a user, 11. The information processing apparatus according to claim 10, wherein the generating means uses the second image instead of the first image.

12. a notification unit that notifies a user of a result of acquisition of the second image by the image acquisition unit, 2 . The information processing apparatus according to claim 1 , wherein, when the second image cannot be acquired, the notification means notifies the user of the result that the second image cannot be acquired and the key phrase.

13. 2 . The information processing apparatus according to claim 1 , wherein the first template and the second template are templates used for creating a poster.

14. A method executed in an information processing device, comprising: a template acquisition step of acquiring a first template including a first text and a first image; a receiving step of receiving an edit of the first text; a key phrase acquisition step of acquiring a key phrase from the text after the edit is accepted by the accepting step; an image acquiring step of acquiring a second image related to the key phrase acquired by the key phrase acquiring step; and generating a second template using the text after receiving the edits and the second image acquired by the image acquisition step.

15. A program for causing a computer to function as each of the means of the information processing apparatus according to any one of claims 1 to 13.

Citation Information

Patent Citations

  • Image processor

    JP1988008874A