Computer program, apparatus, and method for causing print execution unit of printing apparatus to print image
The computer program automates the summarization and printing of image data using an AI server, improving user convenience by eliminating the need for manual summarization.
Patent Information
- Application Number
- JP2024124285
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2026-02-13
AI Technical Summary
Existing technologies lack user-friendly methods for automatically summarizing and printing image data from files, requiring manual user intervention for summarization, which is inconvenient.
A computer program that includes a first reception unit to receive file designation, a summary processing unit to generate summary data, and a print control unit to print the summary image, utilizing an AI server for automated summarization and printing.
Enhances user convenience by allowing automatic summarization and printing of image data without manual user summarization, reducing processing and communication loads.
Smart Images

Figure 2026022765000001_ABST
Abstract
Description
[Technical Field]
[0001] The present specification relates to a technique for causing a print execution unit of a printing device to print an image. [Background technology]
[0002] Patent Document 1 discloses a technique for causing a printer to execute printing using an application installed on a terminal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-085588 Summary of the Invention [Problem to be solved by the invention]
[0004] This specification provides a technique for improving user convenience. [Means for solving the problem]
[0005] This specification discloses a computer program for causing a print execution unit of a printing device to print an image. The computer program may cause a computer to function as the following units: a first reception unit that receives a target file designation from a user; a first supply unit that supplies the target data to a summary processing unit when the designation of the target file is received and an instruction to summarize the target data in the target file is given; a second reception unit that receives, from the summary processing unit, first summary data generated by the summary processing unit summarizing the target data; and a print control unit that causes the print execution unit to print a first summary image represented by the first summary data.
[0006] According to the above configuration, when a target file is specified and a command is issued to summarize target data in the target file, the target data is supplied to the summary processor, first summary data is received from the summary processor, and a first summary image represented by the first summary data is printed, thereby improving user convenience.
[0007] A computer-readable recording medium that stores the above computer program, an apparatus implemented by the above computer program, and a method executed by the apparatus are also novel and useful. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a configuration diagram of a communication system. [Figure 2] FIG. 10 is a sequence diagram of Case A in the first embodiment. [Figure 3] FIG. 1 is a screen transition diagram of the first embodiment. [Figure 4] This is a continuation of the screen transition diagram in Figure 2. [Figure 5] FIG. 10 is a sequence diagram of case B of the first embodiment. [Figure 6] FIG. 10 is a diagram showing screen transitions when performing summary setting. [Figure 7] FIG. 10 is a sequence diagram of a second embodiment. [Figure 8] FIG. 10 is a screen transition diagram of the second embodiment. [Figure 9] FIG. 11 is a sequence diagram of a third embodiment. [Figure 10] FIG. 11 is a screen transition diagram of the third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0009] (First Example) (Communication system configuration; Figure 1) As shown in FIG. 1, the communication system 2 includes a terminal 10, a printer 100, and an artificial intelligence (AI) server 200. The terminal 10 and the printer 100 are connected to a local area network (LAN) 4. The terminal 10 and the printer 100 can communicate with each other via the LAN 4. The LAN 4 may be a wired LAN or a wireless LAN. The AI server 200 is installed on the Internet 6. The devices 10, 100 and the AI server 200 can communicate with each other via the LAN 4 and the Internet 6.
[0010] (Configuration of Terminal 10) The terminal 10 is a portable terminal device such as a mobile phone, smartphone, PDA, or tablet PC. In a modified example, the terminal 10 may be a desktop PC, laptop PC, or the like. The terminal 10 includes an operation unit 12, a display unit 14, a communication interface 16, and a control unit 30. The units 12 to 30 are connected to a bus line. Hereinafter, the interface will be referred to as "I / F."
[0011] The operation unit 12 is a user interface that allows the user to input various information to the terminal 10. The operation unit 12 includes, for example, a touch panel for displaying software keys (operation objects), hardware keys, or both. The hardware keys include, for example, buttons or switches. The display unit 14 is a display or panel for displaying various information. The panel may or may not be a touch panel. The panel is, for example, a liquid crystal panel or an organic EL panel. The communication I / F 16 is connected to the LAN 4.
[0012] The control unit 30 includes a CPU 32 and a memory 34. The memory 34 includes a main storage device and an auxiliary storage device. For example, the main storage device includes a RAM and a cache memory. For example, the auxiliary storage device may be a ROM, a flash memory, a solid-state drive (SSD), a hard disk drive (HDD), or a combination thereof. The auxiliary storage device of the memory 34 stores an OS program 36, an application program 38, and an automatically generated flag 40. Hereinafter, the OS program and the application program will be referred to as "OS" and "app," respectively. The OS 40 controls the basic operation of the terminal 10. For example, the app 38 causes a printer to perform a printing function. The app 38 is downloaded from a server on the Internet 6 and installed on the terminal 10. In other words, the app 38 is a so-called native app. The CPU 32 performs various processes according to the programs loaded from the auxiliary storage device to the main storage device. In the following description, various processes that are implemented by the CPU 32 according to a program may be described as being performed primarily by the OS 36 or the application 38.
[0013] The application 38 can cause the AI server 200 to summarize at least a portion of the data (hereinafter referred to as "target data") in a target file representing an image to be printed. Here, the concept of "summarization" in this specification includes not only summarization in the usual sense of extracting and describing the main points of a sentence (i.e., a string of characters), but also processing that analyzes an image, extracts the features of the image, and describes them (so-called "image summarization"). Furthermore, the above "summarization in the usual sense" refers to summarization of character strings contained in a document file, summarization of character strings contained in an image represented by an image file, summarization of audio (i.e., character strings) represented by an audio file, etc.
[0014] The automatic generation flag 40 indicates either "YES" indicating that when a target file is specified by the user, the AI server 200 should automatically generate a summary of the target data included in the target file, or "NO" indicating that the AI server 200 should not automatically generate a summary of the target data. The user can change the automatic generation flag 40.
[0015] (Configuration of printer 100) The printer 100 is a peripheral device capable of executing a printing function, such as a peripheral device of the terminal 10. In a modified example, the printer 100 may be a multi-function device capable of executing a scanning function, a facsimile function, and the like in addition to a printing function. The printer 100 is assigned a device ID "dv1" that identifies the printer 100. The device ID is, for example, a model name, an IP address, or a combination thereof. In this specification, the device ID is a model name. The model name is model identification information for the device. The model name may be a higher-level model name that encompasses multiple model names. For example, the model name may be "ABC Series," which encompasses the model names ABC1 and ABC2. The printer 100 includes an operation unit 112, a display unit 114, a communication I / F 116, a print execution unit 118, and a control unit 130. Each of the units 112 to 130 is connected to a bus line.
[0016] The operation unit 112 is a user interface that allows a user to input various information to the printer 100. The operation unit 112 includes, for example, a touch panel for displaying software keys, hardware keys, or both. Hardware keys include, for example, buttons or switches. The display unit 114 is a display or panel for displaying various information. The panel may or may not be a touch panel. The panel may also be, for example, a liquid crystal panel or an organic EL panel. The communication I / F 116 is connected to the LAN 4. The print execution unit 118 includes an electrophotographic, inkjet, or thermal print engine. An electrophotographic print engine includes a photosensitive member and an exposure device that emits light to expose the photosensitive member. An inkjet print engine includes a print head that ejects ink droplets. A thermal print engine includes a print head that generates heat using a heater.
[0017] The control unit 130 includes a CPU 132 and a memory 134. The memory 134 includes a main storage device and an auxiliary storage device. As an example, the main storage device includes a RAM and a cache memory. As an example, the auxiliary storage device may be a ROM, a flash memory, an SSD, an HDD, or a combination thereof. A program 136 is stored in the auxiliary storage device of the memory 134. The CPU 132 performs various processes in accordance with the program loaded from the auxiliary storage device to the main storage device.
[0018] (Configuration of AI server 200) The AI server 200 summarizes the target data. The servers described herein (e.g., the AI server 200, the cloud print server (not shown)) are installed on the Internet 6 by the printer 100 vendor (hereinafter simply referred to as the "vendor"). While the AI server 200 will be described in particular below, the same applies to other servers described herein, such as the cloud print server. The AI server 200 may be a physical server, a cloud virtual server, a virtual machine, or the like. The AI server 200 may be a single server or a collection of multiple servers. The AI server 200 may be a server on an intranet or a cloud server on the Internet 6. In a variant, the AI server 200 may be installed on the Internet 6 by a business operator other than the vendor. In another variant, the vendor may not prepare the AI server 200 hardware itself, but may use an environment provided by an external cloud computing service. In this case, the vendor may implement the AI server 200 by preparing the AI server 200 program (i.e., software) and installing it in the above-mentioned environment. In this embodiment, a form in which the AI server 200 is a physical server will be described as an example.
[0019] The AI server 200 includes a communication I / F 216 and a control unit 230. The communication I / F 216 and the control unit 230 are connected to a bus line. The communication I / F 216 is connected to the Internet 6.
[0020] The control unit 230 includes a processor 232 and a memory 234. The processor 232 includes a CPU, a graphics processing unit (GPU), a neural processing unit (NPU), or a combination thereof. The memory 234 includes a main storage device and an auxiliary storage device. For example, the main storage device includes a RAM and a cache memory. For example, the auxiliary storage device may be a ROM, a flash memory, an SSD, an HDD, or a combination thereof. A program 236 is stored in the auxiliary storage device of the memory 234. The processor 232 performs various processes in accordance with the program loaded from the auxiliary storage device to the main storage device.
[0021] A trained model is incorporated into the program 236. The AI server 200 executes functions such as summarization based on the trained model incorporated into the program 236. The trained model includes a program and various parameters. The trained model includes, for example, a language model such as a large-scale language model (LLM) or a small-scale language model (SLM).
[0022] (Specific Case A: Figures 2 to 4) Next, a specific case A will be described with reference to Figures 2 to 4. Note that, in the following, for ease of understanding, the processes executed by the CPU (e.g., 32, 132) or processor (e.g., 232) of each device (e.g., terminal 10, printer 100, AI server 200) will be described as the subject of the processes, rather than each CPU or processor being described as the subject of the processes. Furthermore, communication between each device is carried out via a communication I / F (e.g., 16, 116, 216). Therefore, in the following description, when describing communication, the phrase "via a communication I / F" will be omitted.
[0023] 2, information about one or more printers including the printer 100 (e.g., the printer's device ID, IP address, etc.) has already been registered in the memory 34 (i.e., the application 38) of the terminal 10. Also, in the initial state of FIG. 2, the automatic generation flag 40 of the terminal 10 indicates "OFF."
[0024] When the terminal 10 receives an application activation operation from the user to activate the application 38 at T10, the terminal 10 activates the application 38, and at T12 displays a home screen SC1 on the display unit 14. As shown in Fig. 3, the home screen SC1 includes a setting object OB11, one or more device objects OB12 and OB13, and a plurality of function objects OB14 to OB16.
[0025] The setting object OB11 is an object for displaying a setting screen. The device object OB12 is an object corresponding to the registered printer 100 and includes the device ID "dv1" of the printer 100. As described above, the device ID "dv1" is the model name of the printer 100. Note that the device ID "dv1" may include the IP address of the printer 100 in addition to the model name of the printer 100. Although partially hidden in FIG. 3, the device object OB13 is an object corresponding to another printer registered in the terminal 10 and includes the device ID of the other device. Note that in a situation where only one device (i.e., the printer 100) is registered in the terminal 10, the device object OB13 may be an object for registering a new printer. The function objects OB14 to OB16 are objects corresponding to a document printing function, a photo printing function, and an audio printing function, respectively. The document printing function is a function for printing an image represented by a document file (e.g., a Word file, a PDF file, a Text file, etc.). The photo printing function is a function for printing an image represented by a photo file (e.g., a JPEG file). The audio printing function is a function for printing an image represented by an audio file (e.g., an MP3 file). Here, an image represented by an audio file is an image represented by a document file obtained by transcribing the audio represented by the audio file.
[0026] When the terminal 10 accepts, at T14, selection of a function object OB14 corresponding to a document printing function from the user, at T20 it displays a file selection screen SC2 on the display unit 14. As shown in Fig. 3, the file selection screen SC2 includes a plurality of file objects OB21, OB22 corresponding to a plurality of document files stored in the memory 34, and a cancel object OB23. Each of the file objects OB21, OB22 includes a file name (e.g., F1, F2).
[0027] When the terminal 10 accepts a user's selection of a file object OB21 corresponding to the file name F1 at T22, the terminal 10 displays a print preview screen SC3 on the display unit 14 at T24. In this example, the target file corresponding to the file name F1 contains three pages of document image data representing three pages of document image data. The print preview screen SC3 includes three preview images P1 to P3 corresponding to the three pages of document image data, a display area RPS for displaying a summary preview image corresponding to a summary image obtained by summarizing the target file, and a print object OB33. Each preview image P1 to P3 has a corresponding check box OB32. In the example of FIG. 3, each check box OB32 is located in the upper right corner of the display area where the preview image is displayed. The check box OB32 is an object for specifying pages to be summarized and printed. That is, among the pages corresponding to the preview images P1 to P3, pages with a check mark in the check box OB32 are specified as pages to be summarized and printed. The user can specify pages to be summarized and printed by operating each check box OB32. In the example of FIG. 3, all pages of the target file (that is, pages 1 to 3) are designated as pages to be summarized and printed.
[0028] At this stage, a summary image has not been generated, so a summary preview image corresponding to the summary image is not arranged in the display area RPS. The display area RPS includes a generated object OB31 (i.e., a + button). The generated object OB31 is an object for instructing the AI server 200 to generate a summary for each page specified by a check box OB32. The user can instruct the AI server 200 to generate a summary by selecting the generated object OB31.
[0029] When the terminal 10 receives a user's selection of the generated object OB31 in the display area RPS at T26, it displays a dialog D1 on the display unit 14 at T28, superimposed on the print preview screen SC3. As shown in FIG. 4, the dialog D1 includes a message asking the user whether to generate a summary, a message prompting the user to enter a prompt, a prompt input area R1, an OK button B1, and a Cancel button B2. The prompt is an instruction related to the content of the summary. Examples of prompts include "limit to 100 characters," "iterate in bullet points," and "add a title." The prompt input area R1 may be configured to display a history of previously used prompts, allowing the user to select one prompt from the history.
[0030] In T30, the terminal 10 accepts the input of a prompt from the user in the prompt input area R1, and then accepts selection of the OK button B1. In this case, in T32, the terminal 10 transmits the summarization target data and the input prompt to the AI server 200. The summarization target data is data corresponding to a preview image of the page specified as the summarization target. The summarization target data is, for example, data of the corresponding page of document image data included in the target file before being converted into a preview image. The data of the corresponding page includes sentences as text data (i.e., natural language data). The summarization target data may also be preview image data representing a preview image of the page specified as the summarization target. The preview image data may be in a format including text data, such as PDF, or may be bitmap data. In the case of bitmap data, the terminal 10 may transmit to the AI server 200 an instruction indicating that OCR processing should be performed to convert the bitmap data into text data. In a modified example, the terminal 10 may accept a voice input of the prompt in T30, instead of accepting an input of the prompt in the prompt input area R1.
[0031] When the AI server 200 receives the summary target data and the prompt from the terminal 10 in T32, it generates a data ID that identifies the summary target data in T40 and stores the data ID, the summary target data, and the prompt in association with each other. Then, in T42, the AI server 200 summarizes the natural language data included in the summary target data in accordance with the received prompt to generate summary data. For example, if the sentence included in the summary target data is more than 100 characters and the prompt is "100 characters or less," the AI server 200 summarizes the sentence to 100 characters or less to generate summary data. For example, if the prompt is "bullet points," the AI server 200 summarizes the sentence in bullet points to generate summary data. In this way, the AI server 200 summarizes the natural language data received from the terminal 10. Then, in T44, the AI server 200 transmits the data ID and summary data to the terminal 10.
[0032] When the terminal 10 receives the data ID and summary data from the AI server 200 in T44, it displays a print preview screen SC4 on the display unit 14 in T46. In the print preview screen SC4, the display area RPS does not include a generated object OB31. Furthermore, a summary preview image PS corresponding to the summary image represented by the received summary data is arranged in the display area RPS. The rest is the same as the print preview screen SC3. The user can check the summary generated by the AI server 200 by viewing the summary preview image PS. Furthermore, a check box OB41 is associated with the summary preview image PS. In the example of FIG. 4, the check box OB41 is arranged in the upper right corner of the display area RPS where the summary preview image PS is displayed. The check box OB41 is an object for specifying whether or not to print the summary image.
[0033] When the terminal 10 accepts selection of a summary preview image PS from the user at T48, it displays a summary preview screen SC5 on the display unit 14 at T50. As shown in FIG. 4, the summary preview screen SC5 includes an enlarged summary preview image EPS, an OK button OB51, and a re-summary object OB52. By viewing the enlarged summary preview image EPS, the user can more easily confirm the summary. The re-summary object OB52 is an object that causes the AI server 200 to re-summarize the data to be summarized.
[0034] (Case A-1) First, we will explain case A-1, in which the user is satisfied with the content of the summary generated by the AI server 200. In T60, the terminal 10 accepts the user's selection of the OK button OB51 on the summary preview screen SC5. In this case, in T62, the terminal 10 redisplays the print preview screen SC4 on the display unit 14. Then, in T64, the terminal 10 accepts the user's selection of the print object OB43. The terminal 10 converts image data representing checked pages of the check boxes OB32 and OB41 on the print preview screen SC4 into print data, and in T66, sends the converted print data to the printer 100. The print data has a data format that can be interpreted by the printer 100. In this case, because all check boxes OB32 and OB41 are checked, the print data includes four pages of data representing four pages of images (i.e., one page of summary image and three pages of images included in the target file).
[0035] When the printer 100 receives the print data from the terminal 10 in T66, it causes the print execution unit 118 to print the image represented by the print data in T68. As a result, the printer 100 prints a total of four pages of images, including one page of the summary image and three pages of images included in the target file.
[0036] As described above, when the terminal 10 receives the designation of the target file (T22 in FIG. 2) and the selection of the button OB26 included in the print preview screen SC3 (T26), it transmits the data to be summarized to the AI server 200 (T32) and receives the summary data from the AI server 200 (T44). The terminal 10 then transmits print data representing an image including a summary image to the printer 100 (T66). As a result, the printer 100 prints the image including the summary image (T68). The user can obtain a printout of the summary image obtained by summarizing the target file without the user having to generate a summary of the target file themselves. This improves user convenience.
[0037] (Case A-2) Next, we will explain case A-2, in which the user is not satisfied with the content of the summary generated by the AI server 200. In T70, the terminal 10 accepts from the user selection of a re-summary object OB52 in the summary preview screen SC5. In this case, in T72, the terminal 10 displays a dialog D1 superimposed on the summary preview screen SC5. The dialog D1 is the same as the dialog D1 displayed on the print preview screen SC3. If the user is not satisfied with the content of the summary, the dialog D1 is displayed in a series of steps without re-executing the processes of T14 to T26 described above. This improves user convenience.
[0038] In T80, the terminal 10 accepts input of a new prompt (i.e., a change) from the user, and then accepts selection of the OK button B1 in the dialog D1. In this case, the terminal 10 transmits a re-summarization instruction to the AI server 200 in T82. The re-summarization instruction includes the data ID already received from the AI server 200 (see T44) and the changed prompt. In particular, the re-summarization instruction in this case does not include the data to be summarized. Because the AI server 200 stores the data ID, the data to be summarized, and the prompt in association with each other (see T40), the terminal 10 can have the AI server 200 regenerate the summary by transmitting a re-summarization instruction including the data ID and the changed prompt, without transmitting the data to be summarized to the AI server 200. Therefore, the processing load on the terminal 10 can be reduced, and the communication load between the terminal 10 and the AI server 200 can be reduced.
[0039] When the AI server 200 receives a re-summarization instruction including a data ID and a prompt from the terminal 10 in T82, it updates the prompt associated with the stored data ID in T83. In T84, the AI server 200 identifies the summary target data associated with the data ID included in the re-summarization instruction. Next, the AI server 200 summarizes the natural language data included in the summary target data in accordance with the changed prompt included in the re-summarization instruction, and regenerates the summary data. Then, in T86, the AI server 200 transmits the data ID and the regenerated summary data to the terminal 10.
[0040] In T86, the terminal 10 receives the data ID and summary data from the AI server 200. The processing in T88 is similar to the processing in T46, except that the summary preview image placed in the display area RPS is different. The processing in T90 to T94 is similar to the processing in T64 to T68. As a result, in this case, the printer 100 prints a total of four pages of images: one page of summary image and three pages of images included in the target file. In this way, if the user is not satisfied with the initially generated summary, the user can have the AI server 200 regenerate the summary. Note that, in a modified example, after the processing in T88, processing similar to T48 may be performed to display a summary preview screen including an enlarged summary preview image corresponding to the regenerated summary image data.
[0041] (Case B: Figures 5 and 6) Next, case B will be described with reference to Figures 5 and 6. Case B is a case in which the automatic generation flag 40 is changed to ON. The initial state in Figure 5 is the same as the initial state in Figure 2. The processes of T110 and T112 are the same as the processes of T10 and T12 in Figure 2, respectively.
[0042] When the terminal 10 receives a selection of a setting object OB11 in the home screen SC1 from the user at T114 (see FIG. 3), at T116 the terminal 10 displays the setting screen SC11 on the display unit 14. As shown in FIG. 6, the setting screen SC11 includes a plurality of setting target objects OB111 to OB113 and a cancel object OB114. The setting target objects OB111 to OB113 are objects corresponding to communication settings, security settings, and summary settings, respectively.
[0043] When the terminal 10 accepts the selection of the setting target object OB113 corresponding to the summary setting in the setting screen SC11 at T118, at T118, the terminal 10 displays the summary setting screen SC12 on the display unit 14. As shown in Fig. 6, the summary setting screen SC12 includes a plurality of areas R121 to R127 for making various settings related to the summary, an OK button OB121, and a cancel button OB122.
[0044] Area R121 is an area for setting the automatic generation flag 40. The user can input either ON or OFF in area R121.
[0045] Area R122 is an area for setting the format of the file for which summarization will be performed automatically (e.g., Word file, PDF file, Text file, etc.). When the automatic generation flag 40 indicates ON, a summary is automatically generated when a file having the format described in area R122 is selected and accepted. That is, a summary is not automatically generated even if a file not having the format described in area R122 is selected and accepted. Also, when no format is described in area R122, a summary is automatically generated regardless of the format of the file selected and accepted.
[0046] Area R123 is an area for setting the page count threshold. When the automatic generation flag 40 indicates ON, if a file selection is accepted and the number of pages in the file is equal to or greater than the page count threshold described in area R123, a summary is automatically generated. In other words, if the number of pages in the file is less than the page count threshold described in area R123, a summary is not automatically generated. Also, if a page count threshold is not described in area R123, a summary is automatically generated regardless of the number of pages in the file.
[0047] Area R124 is an area for setting a character count threshold. When the automatic generation flag 40 is ON, a summary is automatically generated if a file is selected and the number of characters in the file is equal to or greater than the character count threshold described in area R124. That is, if the number of characters in the file is less than the character count threshold described in area R124, a summary is not automatically generated. Furthermore, if a character count threshold is not described in area R124, a summary is automatically generated regardless of the number of characters in the file.
[0048] Area R125 is an area for setting a prompt. When the automatic generation flag 40 is ON and the selection of a target file is accepted, the prompt written in area R125 is used. Note that if no prompt is written in area R125, the summary is automatically generated without using a prompt.
[0049] Area R126 is an area for selecting one template from one or more templates available for summarization. By entering a prompt, the user can register the prompt as a template. By selecting an existing template, the user can avoid entering a prompt in area R125. When a template is selected in area R126, the corresponding prompt may be automatically entered in area R125. In addition to or instead of a prompt, the template may also include at least one of information indicating each setting value that can be set on the summary setting screen SC12 (i.e., format, page count threshold, character count threshold, and the "print summary only" value described below). In this case, too, the user can easily specify each setting value on the summary setting screen SC12 by selecting a template.
[0050] Area R127 is an area for setting whether or not to print only the abstract. If printing only the abstract is set (i.e., if ON is written in area R127), only check box OB41 is checked on the print preview screen (see SC4 in FIG. 4) that is displayed after the selection of the target file is accepted, and the check boxes OB32 associated with each of the preview images P1 to P3 are not checked. On the other hand, if printing only the abstract is not set (i.e., if OFF is written in area R127), check box OB41 and check boxes OB32 associated with each of the preview images P1 to P3 are checked on the print preview screen (see SC4 in FIG. 4) that is displayed after the selection of the target file is accepted.
[0051] In T122, the terminal 10 accepts from the user an operation to turn on the summary automatic setting (i.e., an operation to input ON in the area R121), and then accepts selection of the OK button OB121. In this case, in T124, the terminal 10 stores "ON" as the automatic generation flag 40, and in T126, displays the home screen SC1 (see FIG. 3) on the display unit 14. Note that the following description will be given assuming that the information shown in FIG. 6 is written in each of the areas R122 to R127 of the summary setting screen SC12.
[0052] Thereafter, the same processes as those in T14 to T22 of FIG. 2 are executed. In this case, since the automatic generation flag 40 is ON, the terminal 10 determines whether the target file satisfies the conditions for automatically generating a summary. Specifically, the terminal 10 determines whether the format of the target file matches the stored format and whether the number of pages and the number of characters of the target file are equal to or greater than the stored page number threshold and character number threshold, respectively. In this case, the explanation will continue assuming that the target file satisfies the conditions for automatically generating a summary. In this case, the terminal 10 transmits the summary target data and a prompt to the AI server 200 in T132. The prompt used here is the prompt entered on the summary setting screen SC12 (i.e., stored in the memory 34). The processes in T140 to T150 are the same as the processes in T40 to T50 of FIG. 2. The processes in T160 to T168 of Case B-1 are the same as the processes in T60 to T68 of Case A-1. Furthermore, the processing from T170 to T194 in case B-2 is the same as the processing from T70 to T94 in case A-2.
[0053] As described above, in case B where the automatic generation flag 40 is ON, when the selection of the target file is accepted, the terminal 10 displays the print preview screen SC4 without displaying the print preview screen SC3 (see FIGS. 3 and 4). In this way, the terminal 10 can cause the AI server 200 to automatically execute summarization even if the selection of the target file is accepted from the user but an instruction to summarize is not accepted.
[0054] (Correspondence) The printer 100 is an example of a "printing device." The print execution unit 118 of the printer 100 is an example of a "print execution unit." The CPU 32 and the application 38 of the terminal 10 are examples of a "computer" and a "computer program," respectively. The AI server 200 is an example of a "summary processing unit." The display unit 14 of the terminal 10 is an example of a "display device." A file with the file name F1 is an example of a "target file." Three pages of document image data contained in the file with the file name F1 is an example of "target data." The summary data generated in T42 of FIG. 2 and the summary data regenerated in T84 are examples of "first summary data" and "second summary data," respectively. The image represented by the summary data generated in T42 of FIG. 2 and the image represented by the summary data regenerated in T84 are examples of "first summary image" and "second summary image," respectively. The summary preview image PS included in print preview screen SC4 of T46 in Figure 2 and the enlarged summary preview image EPS included in summary preview screen SC5 of T50 are examples of a "first summary preview image." The summary preview image PS included in print preview screen SC4 of T88 is an example of a "second summary preview image."
[0055] The print preview screen SC4 and the summary preview screen SC5 displayed at T46 and T50 in FIG. 2, respectively, are examples of a "first print preview screen." The print preview screen SC4 displayed at T88 in FIG. 2 is an example of a "second print preview screen." The print preview screen SC3 is an example of a "third print preview screen." The re-summary object OB52 included in the summary preview screen SC5 and the generated object OB31 included in the print preview screen SC3 are examples of a "first instruction object" and a "second instruction object," respectively. The three-page preview images P1 to P3 are an example of "M partial preview images." The check boxes OB32 provided corresponding to the preview images P1 to P3 are an example of "M (and N) specified objects." The prompt input at T30 in FIG. 2 and the prompt newly input (i.e., changed) at T80 are examples of a "first summary prompt" and a "second summary prompt," respectively. The dialog D1 is an example of an "input screen." The summary setting screen SC12 is an example of a "setting screen." The automatically generated flag 40 indicating ON is an example of "predetermined information."
[0056] The processes of T22, T44, and T86 in FIG. 2 are examples of processes executed by a "first reception unit," a "second reception unit," and a "third reception unit," respectively. The processes of T32 and T82 are examples of processes executed by a "first supply unit," and a "second supply unit," respectively. The processes of T66 and T92 in FIG. 2 are examples of processes executed by a "print control unit." The processes of T46 and T50 in FIG. 2 are examples of processes executed by a "first display control unit." The process of T72 in FIG. 2 is an example of processes executed by a "second display control unit." The process of T88 in FIG. 2 is an example of processes executed by a "third display control unit." The process of T24 in FIG. 2 is an example of processes executed by a "fourth display control unit." The process of T120 in FIG. 5 is an example of processes executed by a "fifth display control unit." The process of T124 in FIG. 5 is an example of processes executed by a "storage control unit."
[0057] (Second embodiment; Figures 7 and 8) Next, a second embodiment will be described with reference to Figures 7 and 8. The second embodiment differs from the first embodiment in that a summary confirmation screen SC20 is displayed. In the initial state of Figure 7, the automatic generation flag 40 indicates OFF. The processes of T210 to T214 are the same as the processes of T10 to T14 in Figure 2.
[0058] When the terminal 10 accepts, in T214, a selection from the user of the function object OB14 (see the home screen SC1 in FIG. 8 ) corresponding to the document printing function, the terminal 10 displays a summary confirmation screen SC20 on the display unit 14 in T216. As shown in FIG. 8 , the summary confirmation screen SC20 includes a message inquiring the user about whether to generate a summary, three options, and an OK button OB200. The three options are “Print summary only,” “Summary + Document,” and “No summary.” The option “Print summary only” corresponds to causing the printer 100 to print the summary image but not the target file. Specifically, on the print preview screen (see the print preview screen SC4 in FIG. 4 ) displayed after the option “Print summary only” is selected, only the check box OB41 is checked, and the check boxes OB32 corresponding to each page are unchecked. The option “Summary + Document” corresponds to causing the printer 100 to print both the summary image and the target file. Specifically, on the print preview screen (see print preview screen SC4 in FIG. 4) that is displayed after the option "Summary + Document" is selected, check boxes OB41 and each check box OB32 corresponding to each page are checked. The option "Do not summarize" corresponds to not having the printer 100 print a summary image. Specifically, when the option "Do not summarize" is selected, a print preview screen (see print preview screen SC3 in FIG. 3) that does not include a summary preview image is displayed. By default, the option "Do not summarize" is selected on the summary confirmation screen SC20.
[0059] In T218, the terminal 10 accepts an operation from the user to select the option "Summary + Document," and then accepts selection of the OK button OB200. In this case, in T220, the terminal 10 displays a file selection screen SC2 on the display unit 14. Then, in T222, the terminal 10 accepts selection of a file object OB21 corresponding to the file name F1 from the user. The processes of T220 and T222 are the same as the processes of T20 and T22 in FIG. 2. In this case, the terminal 10 transmits the data to be summarized to the AI server 200 in T232 without displaying the print preview screen SC3 and the dialog D1. In this embodiment, because a prompt has not been input by the user, no prompt is transmitted to the AI server 200 in T232.
[0060] The processes of T240 and T242 are similar to the processes of T40 and T42 in FIG. 2, except that no prompts are used. The processes of T244 to T250 are similar to the processes of T44 to T50 in FIG. 2. The processes of T260 to T268 in Case C-1 are similar to the processes of T60 to T68 in Case A-1. The processes of T270 to T294 in Case C-2 are similar to the processes of T70 to T94 in Case A-2. In this embodiment, too, a user can obtain a printout of a summary image obtained by summarizing a target file, even if the user does not generate a summary of the target file themselves. The summary confirmation screen SC20 in T216 in FIG. 7 is an example of an "instruction screen." The process of T216 in FIG. 7 is an example of a process executed by a "sixth display control unit."
[0061] (Third embodiment; Figures 9 and 10) Next, a third embodiment will be described with reference to Figures 9 and 10. In the third embodiment, the timing at which the summary confirmation screen SC20 is displayed differs from that in the second embodiment. In the initial state in Figure 9, the automatic generation flag 40 indicates OFF. The processing from T310 to T322 is the same as the processing from T10 to T22 in Figure 2.
[0062] When the terminal 10 accepts, at T322, selection of the file object OB21 (see file selection screen SC2 in FIG. 10) corresponding to the file name F1 from the user, at T324 it displays the summary confirmation screen SC20 on the display unit 14. The processing of T324 and T326 is the same as the processing of T216 and T218 in FIG. 7.
[0063] In T326, the terminal 10 accepts an operation from the user to select the option "Summary + Document," and then accepts selection of the OK button OB200. In T332, the terminal 10 transmits the data to be summarized to the AI server 200 without displaying the print preview screen SC3 and the dialog D1. The processing in T332 is the same as the processing in T232 in FIG. 7.
[0064] The processes of T340 and T342 are similar to the processes of T40 and T42 in FIG. 2, except that no prompts are used. The processes of T344 to T350 are similar to the processes of T44 to T50 in FIG. 2. The processes of T360 to T368 in Case D-1 are similar to the processes of T60 to T68 in Case A-1. The processes of T370 to T394 in Case D-2 are similar to the processes of T70 to T94 in Case A-2. In this embodiment, too, a user can obtain a printout of a summary image obtained by summarizing a target file, even if the user does not generate a summary of the target file themselves. The summary confirmation screen SC20 in T324 in FIG. 9 is an example of an "instruction screen." The process of T324 in FIG. 9 is an example of a process executed by a "seventh display control unit."
[0065] Although specific examples of the technology disclosed in this specification have been described in detail above, these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and variations of the specific examples exemplified above. Modifications of the above examples are listed below.
[0066] (Variation 1) In the above embodiment, the application 38 is an example of a native application installed on the terminal 10. In a variation, the application 38 may be an application installed on, for example, the printer 100. In this case, the printer 100 may display the various screens of the above embodiment on the display unit 114 of the printer 100. In this variation, the CPU 132 of the printer 100 is an example of a "computer," and the display unit 114 of the printer 100 is an example of a "display device."
[0067] (Variation 2) Instead of app 38, which is a native app installed on terminal 10, for example, a web app may be used, a cloud app may be used, or an app realized by a combination of at least two of a native app, a web app, and a cloud app may be used. Here, "a combination of at least two" means, for example, a combination of a native app and a web app (a so-called hybrid app), a combination of a native app and a cloud app, etc.
[0068] For example, in an example where a web application is used instead of the application 38, the various processes of the above embodiment are realized by a cloud print server (not shown). In this modification, the CPU of the cloud print server is an example of a "computer," and the web application is an example of a "computer program." The display unit 14 of the terminal 10 is an example of a "display device." The cloud print server operates according to the web application on the server. The cloud print server transmits corresponding screen data (e.g., web page data, etc.) to the terminal 10, thereby displaying the various screens (SC1 to SC5, SC11, SC12, SC20, etc.) described in the above embodiment on the display unit 14 of the terminal 10 via a web browser or WebView. The cloud print server receives information (e.g., operation ID) indicating an operation accepted on the various screens, various data for which selections have been accepted, etc. from the terminal 10, and executes processing according to the operation. The operation ID is information indicating that an operation (i.e., selection) of an object, such as object OB31 or OB33, has been accepted. The various data whose selection has been accepted include, for example, the selected device ID "dv1," the target file specified on the file selection screen SC2, the data to be summarized specified on the print preview screen SC3, and data indicating the prompt entered in the input area R1. That is, the cloud print server accepts operations on the various screens through the reception of the above-mentioned operation ID, various data, etc. When the cloud print server receives an operation ID from the terminal 10 indicating that the operation of the print object OB33 has been accepted, it transmits print data to the printer 100 identified by the device ID "dv1." Note that in this modified example, the device ID "dv1" may include, in addition to the model name, a token for the cloud print server to communicate with the printer 100, authentication information, the global IP address to which the printer 100 belongs, and the like.
[0069] Furthermore, if the cloud print server cannot acquire local information such as the device ID from a web browser or the like due to security settings, a hybrid application may be created by combining a web application with a native application installed on the terminal 10. In this case, the native application can acquire local information such as the device ID stored in the memory 34 of the terminal 10 and send that information to the cloud print server. In this case, the cloud print server performs the same process as described above via the native application. The same applies when a cloud application is used instead of a web application.
[0070] (Variant 3) The communication system 2 may not include the AI server 200. In this variant, for example, an AI engine that performs various processes in place of the AI server 200 described above may be provided in the terminal 10. The AI engine includes a trained model. In this variant, the terminal 10 includes a "summary processing unit." In another variant, an AI engine that performs various processes in place of the AI server 200 described above may be provided in the printer 100. The AI engine includes a trained model. In this variant, the printer 100 includes a "summary processing unit."
[0071] (Variation 4) When a function object OB15 corresponding to a photo printing function is selected on the home screen SC1, the terminal 10 may execute a process (e.g., OCR process) to extract character strings from an image represented by a photo file selected to be printed. The terminal 10 may then transmit to the AI server 200 summary target data including natural language data representing the extracted character strings. In this variation, the natural language data representing the extracted character strings is an example of "natural language data." In another variation, when the function object OB15 is selected, the terminal 10 may also transmit to the AI server 200 summary target data including a photo file selected to be printed. In this case, the AI server 200 may execute a process to extract character strings from the photo file and perform a summary using the extracted character strings (i.e., natural language). In this variation, the "target data" does not have to include "natural language data." Furthermore, when a function object OB16 corresponding to the voice printing function is selected on the home screen SC1, the terminal 10 may transmit to the AI server 200 data to be summarized that includes the voice data selected as the print target, or may transmit to the AI server 200 data to be summarized that includes document data obtained by transcribing the voice data. In this modification, the voice data itself or the document data obtained by transcribing the voice data is an example of "natural language data."
[0072] (Variation 5) In the above embodiment, an example was described in which only one file (i.e., a file having the file name F1) was selected as the target file, but the target file does not have to be a single file. The target file may also be a collection of multiple files. For example, when a functional object OB15 corresponding to a photo printing function is selected on the home screen SC1, the terminal 10 may display on the display unit 14 a file selection screen for selecting one or more photo files to be printed. The file selection screen may be configured to allow multiple photo files to be selected as files to be printed. In this case, the print preview screen may include multiple preview images corresponding to the selected multiple photo files, and may be configured to allow the user to specify which of these files to summarize and which to print.
[0073] (Variation 6) When the terminal 10 receives a data ID and summary data at T44 in FIG. 2, it may omit the processes of T46 to T64 and send the print data to the printer 100. Also, when the terminal 10 receives a data ID and summary data at T86 in FIG. 2, it may omit the processes of T88 and T90 and send the print data to the printer 100. In other words, the terminal 10 does not need to display the print preview screen SC4 or the like on the display unit 14. Generally speaking, at least one of the "first display control unit" and the "second display control unit" can be omitted.
[0074] (Variation 7) The summary preview screen SC5 (see FIG. 4) does not need to include the re-summary object OB52. Generally speaking, the "first print preview screen" does not need to include the "first instruction object." Also, the "second supply unit" and the "third reception unit" can be omitted.
[0075] (Variant 8) The dialog D1 may not include the prompt input area R1. Generally speaking, the "second display control unit" can be omitted. Note that even if the same target data is summarized multiple times under the same conditions, each summary generated by the AI server 200 may be different. Therefore, it is also meaningful to have the AI server 200 regenerate the summary without using or changing the prompt.
[0076] (Modification 9) In the above embodiment, the check box OB32 provided for each preview image P1 to P3 was an object for specifying both the summary target and the print target. In a modification, an object for specifying the summary target and an object for specifying the print target may be provided separately.
[0077] (Variant 10) For example, when the page to be summarized is changed on the print preview screen SC4 of FIG. 4 (i.e., when the check box OB32 is operated), the terminal 10 may send a re-summarization instruction to the AI server 200. This is because when the page to be summarized is changed, the summary may also be changed. In this case, the terminal 10 may also display the dialog D1 when the page to be summarized is changed. In another variant, even if the page to be summarized is changed, the terminal 10 may not need to send a re-summarization instruction to the AI server 200.
[0078] (Variant 11) In the above embodiment, the processing of each step in Figure 2, etc. is realized by software (e.g., OS 36, application 38, programs 136, 236), but at least one of these processes may be realized by hardware such as a logic circuit.
[0079] The technical elements described in this specification or drawings may exhibit technical utility either alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. Furthermore, the technologies illustrated in this specification or drawings may achieve multiple objectives simultaneously, and achieving one of those objectives alone is technically useful.
[0080] In the scope of the claims at the time of filing, even if each claim depends on only some of the claims, it is not limited to the fact that each claim can depend on only those some of the claims. To the extent that there is no technical contradiction, each claim can also depend on other claims that were not dependent at the time of filing. In other words, the technology of each claim can be combined in various ways as follows: (Item 1) A computer program for causing a print execution unit of a printing device to print an image, The computer program controls a computer to operate in the following manner: a first reception unit that receives a designation of a target file from a user; a first supply unit that supplies the target data to a summarization processing unit when the designation of the target file is accepted and a summary of the target data in the target file is instructed; a second receiving unit that receives, from the summarization processing unit, first summary data generated by the summarization processing unit summarizing the target data; a print control unit that causes the print execution unit to print a first abstract image represented by the first abstract data; A computer program that functions as a (Item 2) Item 3. The computer program according to item 1, wherein the target data includes natural language data representing natural language. (Item 3) The computer program further causes the computer to: when the first summary data is received from the summary processing unit, functioning as a first display control unit that causes a display device to display a first print preview screen including a first summary preview image corresponding to the first summary image; 3. The computer program according to claim 1, wherein the print control unit causes the print execution unit to print the first summary image when printing of the first summary image is instructed on the first print preview screen. (Item 4) the first print preview screen includes a first instruction object for instructing re-summarization of the target data; The computer program further causes the computer to: a second supply unit that supplies a re-summarization instruction to the summarization processing unit when the first instruction object included in the first print preview screen is selected by the user; a third receiving unit that receives, when the re-summarization instruction is supplied to the summarization processing unit, second summary data generated by the summarization processing unit summarizing the target data from the summarization processing unit; It functions as The print control unit causing the print execution unit to print the first summary image when the first instruction object included in the first print preview screen is not selected by the user; when the first instruction object included in the first print preview screen is selected by the user, causing the print execution unit to print a second summary image represented by the second summary data without causing the print execution unit to print the first summary image; Item 3. The computer program according to item 3. (Item 5) the first supply unit, when the designation of the target file is accepted and a command to summarize the target data in accordance with a first summary prompt is issued, supplies the target data and the first summary prompt to the summary processing unit; the first summary data is data generated by the summary processing unit summarizing the target data in accordance with the first summary prompt; The computer program further causes the computer to: functioning as a second display control unit that causes the display device to display an input screen for inputting a summary prompt when the first instruction object included in the first print preview screen is selected by the user; the second supply unit supplies the re-summarization instruction and the second summary prompt to the summary processing unit when the user inputs a second summary prompt different from the first summary prompt on the input screen; the second summary data is data generated by the summary processing unit summarizing the target data in accordance with the second summary prompt; Item 4. The computer program according to item 4. (Item 6) The computer program further causes the computer to: when the second summary data is received from the summary processing unit, functioning as a third display control unit that causes the display device to display a second print preview screen including a second summary preview image corresponding to the second summary image; 6. The computer program according to item 4 or 5, wherein the print control unit causes the print execution unit to print the second summary image when printing of the second summary image is instructed on the second print preview screen. (Item 7) The computer program further causes the computer to: a fourth display control unit that, when the designation of the target file is accepted, causes a display device to display a third print preview screen including a print preview image corresponding to the target file, the third print preview screen including a second instruction object for instructing a summary of the target data; 7. The computer program according to any one of items 1 to 6, wherein the first supply unit supplies the target data to the summary processing unit when the second instruction object included in the third print preview screen is selected by the user. (Item 8) The third print preview screen is the print preview image including M partial preview images for M pages (M is an integer of 1 or more); M designated objects corresponding to the M partial preview images; Including, Item 7: A computer program according to Item 7, wherein the first supply unit supplies the target data corresponding to the N designated objects to the summary processing unit when the second designated object included in the third print preview screen is selected by the user while N designated objects (N is an integer greater than or equal to 1 and less than or equal to M) of the M designated objects are designated. (Item 9) The computer program further causes the computer to: a fifth display control unit that causes the display device to display a setting screen related to a summary before the designation of the target file is accepted; a storage control unit that stores, in a memory, predetermined information corresponding to the execution of summarization when the execution of summarization is designated by the user on the setting screen; It functions as the fourth display control unit, when the designation of the target file is accepted and the predetermined information is not stored in the memory, causes the display device to display the third print preview screen; when the designation of the target file is accepted and the predetermined information is stored in the memory, the first supply unit supplies the target data to the summarization processing unit without displaying the third print preview screen on the display device. Item 9. The computer program according to item 7 or 8. (Item 10) The computer program further causes the computer to: a sixth display control unit that displays, on a display device, an instruction screen for instructing a summary of the target data before the designation of the target file is accepted; The first supply unit includes: When the user instructs summarization of the target data on the instruction screen and the designation of the target file is accepted, the target data is supplied to the summarization processing unit; 10. The computer program according to any one of items 1 to 9, wherein if the user does not specify a summary of the target data on the instruction screen, the target data is not supplied to the summary processing unit even if the specification of the target file is accepted. (Item 11) The computer program further causes the computer to: a seventh display control unit that, after the designation of the target file is accepted, displays an instruction screen for instructing a summary of the target data on a display device; The first supply unit includes: When the user instructs on the instruction screen to summarize the target data, the target data is supplied to the summarization processing unit; 10. The computer program according to any one of items 1 to 9, wherein the target data is not supplied to the summarization processing unit if the user does not specify a summary of the target data on the instruction screen. [Explanation of symbols]
[0081] 2: Communication system, 4: LAN, 6: Internet, 10: Terminal, 12, 112: Operation unit, 14, 114: Display unit, 16, 116, 216: Communication I / F, 30, 130, 230: Control unit, 32, 132: CPU, 34, 134, 234: Memory, 36: OS program, 38: Application program, 40: Automatic generation flag, 118: Print execution unit, 136, 236: Program, 200: AI server, 232: Processor
Claims
1. A computer program for causing a print execution unit of a printing device to print an image, The computer program controls a computer to operate in the following manner: a first receiving unit that receives a designation of a target file from a user; a first supply unit that supplies the target data to a summarization processing unit when the designation of the target file is accepted and when a summary of the target data in the target file is instructed; a second receiving unit that receives, from the summarization processing unit, first summary data generated by the summarization processing unit summarizing the target data; a print control unit that causes the print execution unit to print a first abstract image represented by the first abstract data; A computer program that functions as a
2. The computer program according to claim 1 , wherein the target data includes natural language data representing natural language.
3. The computer program further causes the computer to: when the first summary data is received from the summary processing unit, functioning as a first display control unit that causes a display device to display a first print preview screen including a first summary preview image corresponding to the first summary image; The computer program product according to claim 1 , wherein the print control unit causes the print execution unit to print the first abstract image when printing of the first abstract image is instructed on the first print preview screen.
4. the first print preview screen includes a first instruction object for instructing re-summarization of the target data; The computer program further causes the computer to: a second supply unit that supplies a re-summarization instruction to the summarization processing unit when the first instruction object included in the first print preview screen is selected by the user; a third receiving unit that receives, when the re-summarization instruction is supplied to the summarization processing unit, second summary data generated by the summarization processing unit summarizing the target data from the summarization processing unit; It functions as The print control unit causing the print execution unit to print the first abstract image when the first instruction object included in the first print preview screen is not selected by the user; when the first instruction object included in the first print preview screen is selected by the user, causing the print execution unit to print a second summary image represented by the second summary data without causing the print execution unit to print the first summary image; 4. A computer program according to claim 3.
5. the first supply unit, when the designation of the target file is accepted and a summary of the target data in accordance with a first summary prompt is instructed, supplies the target data and the first summary prompt to the summary processing unit; the first summary data is data generated by the summary processing unit summarizing the target data in accordance with the first summary prompt; The computer program further causes the computer to: functioning as a second display control unit that, when the first instruction object included in the first print preview screen is selected by the user, causes the display device to display an input screen for inputting a summary prompt; the second supply unit supplies the re-summarization instruction and the second summary prompt to the summary processing unit when the user inputs a second summary prompt different from the first summary prompt on the input screen; the second summary data is data generated by the summary processing unit summarizing the target data in accordance with the second summary prompt; 5. A computer program according to claim 4.
6. The computer program further causes the computer to: when the second summary data is received from the summary processing unit, the display device functions as a third display control unit that displays a second print preview screen including a second summary preview image corresponding to the second summary image on the display device; The computer program product according to claim 4 , wherein the print control unit causes the print execution unit to print the second summary image when printing of the second summary image is instructed on the second print preview screen.
7. The computer program further causes the computer to: a fourth display control unit that, when the designation of the target file is accepted, causes a display device to display a third print preview screen including a print preview image corresponding to the target file, the third print preview screen including a second instruction object for instructing a summary of the target data; The computer program according to claim 1 , wherein the first supply unit supplies the target data to the summarization processing unit when the second instruction object included in the third print preview screen is selected by the user.
8. The third print preview screen includes: the print preview image including M partial preview images for M pages (M is an integer of 1 or more); M designated objects corresponding to the M partial preview images; Including, 8. The computer program of claim 7, wherein when N (where N is an integer greater than or equal to 1 and less than or equal to M) designated objects out of the M designated objects are designated, and the second designated object included in the third print preview screen is selected by the user, the first supply unit supplies the target data corresponding to the N designated objects to the summary processing unit.
9. The computer program further causes the computer to: a fifth display control unit that causes the display device to display a setting screen related to summarization before the designation of the target file is accepted; a storage control unit that stores, in a memory, predetermined information corresponding to the execution of summarization when the execution of summarization is designated by the user on the setting screen; It functions as the fourth display control unit, when the designation of the target file is accepted and the predetermined information is not stored in the memory, causes the display device to display the third print preview screen; the first supply unit supplies the target data to the summarization processing unit without displaying the third print preview screen on the display device when the designation of the target file is accepted and the predetermined information is stored in the memory; 8. A computer program according to claim 7.
10. The computer program further causes the computer to: a sixth display control unit that causes a display device to display an instruction screen for instructing a summary of the target data before the designation of the target file is accepted; The first supply unit includes: When the user instructs summarization of the target data on the instruction screen and the designation of the target file is accepted, the target data is supplied to the summarization processing unit; 2. The computer program according to claim 1, wherein if the user does not specify summarization of the target data on the instruction screen, the target data is not supplied to the summarization processing unit even if the specification of the target file is accepted.
11. The computer program further causes the computer to: a seventh display control unit that, after the designation of the target file is accepted, displays an instruction screen for instructing a summary of the target data on a display device; The first supply unit includes: When the user instructs on the instruction screen to summarize the target data, the target data is supplied to the summarization processing unit; 2. The computer program according to claim 1, wherein the target data is not supplied to the summarization processing unit when the user does not specify summarization of the target data on the command screen.
12. A device for causing a print execution unit of a printing device to print an image, a first receiving unit that receives a designation of a target file from a user; a first supply unit that supplies the target data to a summarization processing unit when the designation of the target file is accepted and when a summary of the target data in the target file is instructed; a second receiving unit that receives, from the summarization processing unit, first summary data generated by the summarization processing unit summarizing the target data; a print control unit that causes the print execution unit to print a first abstract image represented by the first abstract data; An apparatus comprising:
13. 1. A method for causing a print execution unit of a printing device to print an image, comprising: a first receiving step of receiving a designation of a target file from a user; a first supply step of supplying the target data to a summarization processing unit when the designation of the target file is accepted and a summary of the target data in the target file is instructed; a second receiving step of receiving, from the summarization processing unit, first summary data generated by the summarization processing unit summarizing the target data; a print control step of causing the print execution unit to print a first abstract image represented by the first abstract data; A method comprising:
Citation Information
Patent Citations
Computer program for terminal device and method to be executed by terminal device
JP2022085588A