Print control device, print control method, and print system

Abstract

The present application provides a kind of printing control device, printing control method and printing system.Printing control device has: image acquisition unit, it makes terminal device display the image list being stored in the terminal device, and obtains the image being selected in the terminal device as print object from the list;Layout layout acquisition unit, it makes the terminal device display multiple layout layout candidates, and obtains the layout layout being selected from the candidate;Preview display unit, it makes the terminal device display the preview image of the selected image being configured according to the layout layout;Print instruction sending unit, it generates the print data of the selected image being configured according to the layout layout, and sends the print instruction of the print data to printing device, at least any one in the image acquisition unit, the layout layout acquisition unit and the preview display unit is processed via chat server.

Description

Technical Field

[0001] This invention relates to a printing control device, a printing control method, and a printing system. Background Technology

[0002] Previously, for example, as in Patent Document 1, there is a known method of chat printing that allows a designated printing device to print photos submitted to a chat room of a chat application.

[0003] However, in traditional chat printing, typesetting and printing could not be implemented. Furthermore, in chat printing, it was not easy to review the user's instructions during the typesetting and printing process.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2021-33425 Summary of the Invention

[0005] A printing control apparatus for solving the above-mentioned problems includes: an image acquisition unit that causes a terminal device to display a list of images stored in the terminal device and acquires an image selected as a printing object from the list; a layout acquisition unit that causes the terminal device to display a plurality of layout candidates and acquires the layout selected from the candidates; a preview display unit that causes the terminal device to display a preview image configured according to the layout; and a print instruction sending unit that generates print data configured according to the layout and sends a print instruction of the print data to a printing apparatus, wherein at least one of the image acquisition unit, the layout acquisition unit, and the preview display unit is processed via a chat server.

[0006] A printing control method for solving the above-mentioned problems includes the following process: In a printing control device, an image acquisition unit causes a terminal device to display a list of images stored in the terminal device, and acquires an image selected as a printing object from the list; a layout acquisition unit causes the terminal device to display multiple layout candidates, and acquires the layout selected from the candidates; a preview display unit causes the terminal device to display a preview image configured according to the layout; and a print instruction sending unit generates print data configured according to the layout and sends a print instruction of the print data to the printing device. In this printing control method, at least one of the image acquisition unit, the layout acquisition unit, and the preview display unit is processed via a chat server.

[0007] A printing system for solving the above-mentioned problems includes a printing control device and a printing device. The printing control device includes: an image acquisition unit that displays a list of images stored in a terminal device and acquires an image selected as a printing object from the list; a layout acquisition unit that displays a plurality of layout candidates in the terminal device and acquires the layout selected from the candidates; a preview display unit that displays a preview image of the selected image configured according to the layout in the terminal device; and a print instruction sending unit that generates print data configured according to the layout of the selected image and sends a print instruction of the print data to the printing device. The printing device performs printing based on the print data. At least one of the image acquisition unit, the layout acquisition unit, and the preview display unit is processed via a chat server. Attached Figure Description

[0008] Figure 1 This is a block diagram of the printing system.

[0009] Figure 2 A flowchart illustrating an example of the printing process.

[0010] Figure 3 A flowchart illustrating an example of the printing process.

[0011] Figure 4 This is a diagram illustrating an example of a chat room display.

[0012] Figure 5 This is a diagram illustrating an example of a chat room display.

[0013] Figure 6 This is a diagram showing an example of selecting a layout.

[0014] Figure 7 This diagram illustrates an example of selecting an image of a printed object.

[0015] Figure 8 This is a diagram showing an example of a preview image.

[0016] Figure 9 This is a diagram showing an example of selecting a layout.

[0017] Figure 10 This diagram illustrates an example of selecting an image of a printed object.

[0018] Figure 11 This is a diagram showing an example of a preview image.

[0019] Figure 12 A flowchart illustrating an example of the printing process. Detailed Implementation

[0020] Here, embodiments of the present invention will be described in the following order.

[0021] (1) Structure of the printing system: (1-1) Structure of the printing apparatus: (1-2) Structure of the printing control device: (2) Printing process: (3) Other implementation methods: (1) Structure of the printing system: Figure 1 This is a block diagram illustrating the structure of a printing system according to an embodiment of the present invention. The printing system includes a printing control device 100 and a printing device 200. The printing control device 100 and the printing device 200 are capable of communicating with each other via a network N. Furthermore, the printing control device 100 is capable of communicating with a chat server 300 via the network N. The chat server 300 is a server that provides a chat service that allows users to interact with each other in a conversational manner. Users of the chat service install an application (chat application) for utilizing the chat service on their own terminal device 400 and create a user account in the chat service. By executing the chat application, the terminal device 400 communicates with the chat server 300 via the network N.

[0022] Terminal device 400 is a device capable of running chat applications, such as a smartphone, tablet computer, or PC. Terminal device 400 includes a camera (not shown), a communication unit, a touch panel display, and a storage medium. Furthermore, terminal device 400 has a screenshot function, which saves the entire screen displayed on the touch panel display as an image file through a predetermined screenshot operation on the touch panel display.

[0023] When a user of terminal device 400 adds and confirms the account of a chatbot that performs pre-set processing by the developer of printing control device 100 as a chat object in a chat application, they can utilize the chat printing service provided by printing control device 100 through message interaction with the chatbot. In the chat printing service, the user pre-registers the printing device 200 for printing. Through the chat printing service, the user can have the registered printing device 200 print images of the printing object by interacting with the chatbot in the chat application.

[0024] Furthermore, when a file is identified as an image based on its extension, the conventional approach has primarily envisioned printing on photo paper. Therefore, the default printing medium setting for image printing is typically photo paper. However, depending on the image content, there may be applications where printing is done on plain paper instead of photo paper. Specifically, for example, a user might take a screenshot of internet search results or chat history from a chat application on their terminal device 400 as a memo and save it, then print the saved screenshot. In such cases, the user might desire to print the screenshot on plain paper instead of photo paper. However, conventionally, when printing screenshots, it's necessary to change the printing setting from the default photo paper to plain paper each time, thus improving convenience is desired. Additionally, it is desirable to implement layout printing where multiple images are arranged on a single page within a chat printing service. The structure and processing of a printing system for achieving these functions will be described below.

[0025] (1-1) Structure of the printing apparatus: The printing apparatus 200 includes a processor 210, a storage medium 220, a communication unit 230, a user interface (UI) unit 240, and a printing unit 250. The processor 210 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random-Access Memory), etc. (not shown), and controls various parts of the printing apparatus 200 by executing a control program stored in the storage medium 220. Furthermore, the processor 210 can be a single chip or multiple chips, or it can be configured as a System-on-a-Chip (SoC) along with various functional blocks that enable the printing apparatus 200 to operate. Alternatively, an Application-Specific Integrated Circuit (ASIC) can be used instead of a CPU, or a structure can be created where the CPU and ASIC work together. In the case of the apparatus in this embodiment having a processor, the processor can be implemented in various ways, similar to the processor 210.

[0026] Storage medium 220 stores various programs and control data executed by processor 210. Furthermore, during the operation of the printing system, it stores printing data D1 transmitted from terminal device 400. Communication unit 230 includes circuitry for communication with other devices according to various wired or wireless communication protocols. In this embodiment, printing apparatus 200 can communicate with printing control device 100 via communication unit 230 and network N. UI unit 240 includes a touch panel display, buttons, etc., for displaying various information to the user and inputting user operations.

[0027] The printing unit 250 includes actuators, drive components, mechanical components, and various sensors for performing printing by ejecting ink onto a printing medium. Among the sensors used to detect the state of the printing apparatus 200 are sensors for detecting the type of printing medium, such as its size, placed in the paper feed section; sensors for detecting the remaining amount of printing medium; sensors for detecting blockages in the transport path of the printing medium; and sensors for detecting the remaining amount of ink. The processor 210 controls the printing unit 250 based on printing data and performs printing. Furthermore, although this embodiment envisions a printing unit 250 performing printing using an inkjet method, the printing method is not limited to this.

[0028] When the processor 210 receives printing data D1 from the printing control device 100, it controls the printing unit 250 based on the printing data D1 and performs printing. Furthermore, in response to an inquiry from the printing control device 100, the processor 210 sends information indicating the progress or success of the printing task to the printing control device 100. Additionally, in response to an inquiry from the printing control device 100, the processor 210 sends information indicating the printing capability of the printing device 200 to the printing control device 100. The information indicating printing capability is used to determine whether the printing device 200 can perform printing on a printing medium of a given size and type. In this embodiment, the information indicating printing capability includes, for example, information indicating the model of the printing device 200 and information indicating the status of the printing device 200. Depending on the model, there may be cases where printing on A4 plain paper cannot be performed because it is a photo printer. Furthermore, for example, if the remaining amount of A4 plain paper in the A4 plain paper feed tray is 0, it also indicates that printing on A4 plain paper cannot be performed. The processor 210 can, for example, obtain model information stored in the ROM. Furthermore, the processor 210 can obtain the status of the printing apparatus 200 based on the output of the sensors in the printing unit 250.

[0029] (1-2) Structure of the printing control device: In this embodiment, the printing control device 100 is a server for implementing chat printing functions via the chat server 300. The printing control device 100 may also be composed of multiple servers. The printing control device 100 includes a processor 110, a storage medium 120, and a communication unit 130. The processor 110 includes a CPU, ROM, RAM, etc., and can execute various programs stored in the ROM and storage medium 220 via the CPU. The communication unit 130 is a communication interface for communicating with other devices. The printing control device 100 can communicate with other devices connected to the network N via the communication unit 130.

[0030] The storage medium 120 stores printing apparatus information Dp of the printing apparatus 200. The printing apparatus information Dp includes information indicating the printing capabilities of the printing apparatus 200, information indicating printing settings related to printing execution in the printing apparatus 200, etc. The information indicating printing capabilities is obtained from the printing apparatus 200 and stored in the storage medium 120. In this embodiment, the information indicating printing settings includes information indicating the type of printing medium used when printing an image file using the printing apparatus 200. The information indicating the printing medium used when printing an image file using the printing apparatus 200 can be a default value, i.e., an initial value preset by the manufacturer, or a value set by the user. For example, when the printing object is an image file, it is conceivable that the printing setting specifies printing the image shown in the image file on photographic paper.

[0031] The processor 110 functions as an image acquisition unit 111, a layout acquisition unit 112, a preview display unit 113, and a printing instruction sending unit 114 by executing a printing control program (not shown) for implementing the chat printing function.

[0032] The image acquisition unit 111 is designed to acquire images selected as printable objects in the terminal device 400 via the chat server 300. More specifically, through the image acquisition unit 111, the processor 110 displays a list of images stored in the terminal device 400 and acquires images selected by the user from that list as printable objects.

[0033] The layout acquisition unit 112 enables the terminal device 400 to display multiple candidate layouts and acquire the layout selected from them. The preview display unit 113 enables the terminal device 400 to display a preview image of the selected image configured according to the layout.

[0034] The printing instruction sending unit 114 is responsible for sending printing instructions to the printing apparatus 200 for an image acquired as a printing object. More specifically, the processor 110 generates printing data for arranging the image of the printing object according to the layout, based on the function of the printing instruction sending unit 114, and sends instructions to print the printing data to the printing apparatus.

[0035] At least one of the image acquisition unit 111, layout acquisition unit 112, and preview display unit 113 described above is processed by the chat server 300. By being processed by the chat server 300, it can be configured such that the processing content of at least one of the image acquisition unit 111, layout acquisition unit 112, and preview display unit 113 is displayed as a message in the chat room between the chatbot account of the printing control device 100 and the user's account. By configuring it in this way, it is possible to retain historical records in the chat room regarding what image the user selected as the printing object, what layout they chose, or what the print preview content was during chat printing. As a result, according to this structure, the user can easily review the historical layout printing records of past chat printing sessions.

[0036] Furthermore, through the function of the printing instruction sending unit 114, the processor 110 sends a printing instruction to print the image of the object on plain paper when the image of the object to be printed is input into the chat room while the first menu of the chat room is selected in the terminal device 400, and sends a printing instruction to print the image of the object on photo paper when the image of the object to be printed is input into the chat room while the second menu of the chat room is selected in the terminal device 400.

[0037] In this embodiment, a printing menu is displayed in a selectable manner in the chat room between the chatbot account of the printing control device 100 and the user's account. This printing menu includes a first menu and a second menu. The first menu, in this embodiment, is primarily envisioned for printing screenshot images, and is used to print the image of the object to be printed on plain paper regardless of the printing settings of the printing device 200. "Regardless of the printing settings of the printing device 200" means, for example, that this applies regardless of the default printing medium when printing image files in the printing device 200, or the printing medium set by the user. Furthermore, when the user selects the first menu to cause the printing device 200 to perform printing, the preset printing settings of the printing device 200 are not changed but remain unchanged. In this embodiment, the second menu, for example, is envisioned for printing images on photographic paper; by selecting the second menu, the user can have the image of the object to be printed on photographic paper in the printing device 200. Thus, regarding image printing, the chat room presents a first menu allowing users to choose between printing on plain paper and printing on photo paper. Users can select the first menu and choose the image to be printed, allowing the image to be printed on plain paper without needing to change the printing medium settings each time a screenshot is printed. Conversely, users can select the second menu and choose the image to be printed on photo paper.

[0038] (2) Printing process: Figure 2 as well as Figure 3 This is a flowchart illustrating the general processing flow of each device in the case of typesetting and printing a screenshot image. Furthermore, in this embodiment, as... Figure 2 As shown, an example will be described in which the image acquisition unit 111, the layout acquisition unit 112, and the preview display unit 113 are all processed via the chat server 300.

[0039] Figure 4 This diagram illustrates a chat room display example on the terminal device 400 used by the user, representing the chatbot account "XX Printer" of the printing control device 100 and the user's account for the user who wants to use the printing system to enable the printing device 200 to perform printing.

[0040] When a user operates the terminal device 400 to launch the chat application and open a chat room with the chatbot account of the print control device 100, such as Figure 4The chat room shown is displayed on terminal device 400. For example... Figure 4 As shown, the chat room includes a menu section a2 and a chat section a1. In chat section a1, messages in the form of conversations with the account of the printing control device 100 are displayed in chronological order. Newer messages are displayed at the bottom of chat section a1. When a new message is entered, the previous chat history moves upwards in chat section a1 and is displayed. Although older messages that cannot be displayed within the range of chat section a1 are no longer shown, if the user slides chat section a1 from top to bottom, older messages outside the display range can be displayed.

[0041] Menu section a2 is configured to include multiple menu buttons for various functions provided by the printing control device 100 for chat printing. Menu section a2 includes a printing button b1 for performing printing according to the instructions of each of the above-described printing menus. In order to click the printing button b1 to perform printing according to the instructions, the user will register the printing device 200 that the user wants to use for printing in advance.

[0042] Additionally, button b2 is used to toggle the display of menu section a2. Button b3 is used to display the character input section, which is used to input any string into the chat room.

[0043] When the user selects the print button b1, the terminal device 400 sends a notification to the print control device 100 via the chat server 300 that the print button b1 has been selected. Upon receiving the notification, the processor 110 of the print control device 100 sends a display instruction for the print menu to the terminal device 400 via the chat server 300 (steps S100 and S105). Figure 5 This is a diagram illustrating an example of a printed menu that the terminal device 400 will display on its screen to indicate that it has received a display instruction from step S105.

[0044] like Figure 5 As shown, the terminal device 400 displays a message c1 indicating that the user has selected the print button b1 in the chat section a1, and then displays cm1 and cm2, representing the print menu, in the chat section a1. The area displayed in the chat section a1 changes by sliding the screen left or right. Figure 5 The image shows an example of a portion displaying a first menu section cm1 and a second menu section cm2.

[0045] In this embodiment, the first menu is the printed menu used when printing the image on A4 plain paper. The second menu is the printed menu used when printing the image on photographic paper. Although various other menus may be included in addition to the printed menu, illustrations and explanations are omitted.

[0046] The first menu is designed to print screenshots on A4 paper. The first menu section cm1 includes descriptive text about the functions that can be performed by selecting this printed menu, and a button b4 for guiding the printing process according to the instructions. When the user selects button b4, the terminal device 400 sends information indicating that the selected printed menu is the first menu to the printing control device 100 via the chat server 300. Figure 2 Steps S110 and S115).

[0047] When the processor 110 of the printing control device 100 obtains information indicating that the first menu has been selected, it uses the function of the layout acquisition unit 112 to send the layout display instruction to the terminal device 400 via the chat server 300. Figure 2 Steps S120 and S125). Figure 6 This is a diagram illustrating a display example of a message that prompts the terminal device 400 to select from candidates of a layout, as indicated by the display instruction received in step S125.

[0048] For example, based on the layout display instructions, the terminal device 400, as shown in messages c2 and c3, displays a message prompting the selection of a layout, along with an image showing the layout options, in the chat section a1. For instance, message c3 shows images representing six candidate layouts, each labeled a through f. Furthermore, the numbers displayed for each layout indicate the order in which the images are arranged.

[0049] The images representing the six layouts can also be associated with actions triggered by being clicked. For example, the layout associated with the clicked image can be selected by the user. More specifically, for example, if the area of ​​the layout image marked "b" is clicked, the terminal device 400 will consider the layout corresponding to "b" as selected by the user. Figure 7 As shown, as a user's message, message c4 indicating that "b" has been selected is displayed in chat section a1. Alternatively, it could also be configured such that, in... Figure 6 In the state shown, button b3, used to display the character input section (not shown), is selected by the user, and the user operates the character input section to input the character "b" representing their selection. The result is... Figure 7 The message c4 shown will be displayed.

[0050] in addition, Figure 6 The layout options shown are merely examples. The selection of a layout as a candidate is sufficient to display the user's chosen layout as history in the chat room, and can be appropriately designed based on the chat server's specifications. Furthermore, the example layout options are also just examples. Any one of these six layouts, or even layouts other than these six, can be displayed.

[0051] Terminal device 400 sends information indicating the layout selected by the user to printing control device 100 via chat server 300 (steps S130, S135). When the processor 110 of printing control device 100 obtains information indicating the layout in step S135 through the function of layout acquisition unit 112, it sends an image overview display instruction to terminal device 400 via chat server 300 through the function of image acquisition unit 111 (steps S140, S145). The image overview display instruction is an instruction to display an overview of images stored in terminal device 400. The display of the image overview is performed so that the user can select an image of the printing object.

[0052] Displayed in Figure 7 Message c5 in the chat unit a1 represents an example of a message that prompts the terminal device 400 to display an image of a printed object upon receiving the display instruction in step S145. Furthermore, upon receiving the display instruction in step S145, the terminal device 400, as... Figure 7 The image overview display unit a3 is displayed at the bottom of the chat room as shown. Alternatively, the image overview display unit a3 can also be configured to be displayed in response to the user selecting a button (not shown) for displaying the image overview.

[0053] Figure 7 The image overview display unit a3 shown illustrates an example of an overview of thumbnails of images stored in the storage medium of the terminal device 400. Furthermore, the images displayed on the image overview display unit a3 are images of files with the file extension "image," and may include various types of images such as screenshots and images captured using the camera provided with the terminal device 400.

[0054] exist Figure 7In the example shown, the thumbnails arranged in the image overview display section a3 are selected in this order: the thumbnails on the upper left and the upper center. When the send button b5 is clicked while both thumbnails are selected, the terminal device 400 sends the image files corresponding to the selected thumbnails to the print control device 100 via the chat server 150. Figure 2 (Steps S150 and S155). Specifically, for example, when the chat server 300 receives an image file showing the selected image from the terminal device 400 in step S150, the chat server 300 sends a notification to the print control device 100 indicating that the image has been submitted to the chat room. In response to this notification, the print control device 100 sends an image acquisition request to the chat server 300, and in response to the acquisition request, the chat server 300 sends the image file showing the image that has been submitted to the print control device 100. As a result, the processor 110 of the print control device 100 acquires the image file through the function of the image acquisition unit 111.

[0055] Figure 8 The diagrams shown, i1 and i2, illustrate examples of images sent from the terminal device 400. When the user views an image displayed on... Figure 7 When any image is selected from the image list in the image list display unit a3 and the send button b5 is clicked, the selected images i1 and i2 are displayed in the chat unit a1.

[0056] Thus, in this embodiment, the processing of the layout acquisition unit 112 is performed before the processing of the image acquisition unit 111. Therefore, according to this embodiment, the user can select the image that they want to be typed and printed in that layout after deciding on the layout.

[0057] The processor 110 of the printing control device 100 is located in Figure 2 In step S155, when the image of the printing object selected by the user is obtained, a print preview is generated based on the image and the layout obtained in step S135 using the function of the preview display unit 113 (step S160). In this embodiment, in response to the image obtained by the user, the print preview is generated based on the image and the layout obtained in step S135. Figure 7 The order in which images are selected from the image overview shown determines the order in which the images are arranged according to the layout. Specifically, for example, in... Figure 6 As shown by "b" in message c3, this layout is designed for horizontally elongated printing media and includes two vertically elongated typesetting areas. Figure 7When two images are selected from the image list as shown, the first selected image is placed in the first position of the layout, and the second selected image is placed in the second position. The processor 110 generates a preview image of the images arranged in the layout area in this manner. Therefore, the user can see through the print preview that a printed product is obtained, arranged sequentially according to the order in which the images were selected.

[0058] When a print preview is generated in step S160, the processor 110 of the print control device 100 sends a print preview display instruction to the terminal device 400 via the chat server 300 through the function of the preview display unit 113 (steps S165, S170). Upon receiving the display instruction in step S170, the terminal device 400 displays the print preview on its display screen. Figure 8 The c6 shown is an example of a message that prompts confirmation of the implementation of a print preview. Figure 8 The example shown is c7, which is a print preview. Figure 8 The diagram c8 shows buttons b6 and b7 for allowing the user to choose whether to perform the print preview shown. Button b6 is for selecting to print, and button b7 is for selecting not to print. Furthermore, the method shown in c8 is merely an example. The way the user makes the selection to perform the print preview can be appropriately designed based on the chat server specifications, etc.

[0059] Figure 3 express Figure 2 Example of the subsequent process after step S170. When the user clicks button b6 and selects to perform printing, that is, when the user enters a printing instruction, the terminal device 400 sends a printing instruction to the printing control device 100 via the chat server 300 (steps S175, S180). However, when button b7 is clicked, no printing instruction is sent.

[0060] The processor 110 of the printing control device 100 obtains the printing device information Dp of the printing device 200 through the function of the printing instruction sending unit 114 (step S185). Specifically, for example, the processor 110 refers to information indicating the printing capability of the printing device 200 that has been previously obtained and stored in the storage medium 120. Alternatively, the processor 110 may be configured to obtain information indicating the status of the printing device 200 from the information indicating the printing capability by querying the printing device 200 for its status in step S185. Furthermore, the processor 110 refers to information stored in the storage medium 120 that indicates printing settings related to printing execution in the printing device 200.

[0061] When the printing capacity information Dp of the printing apparatus 200 indicates that printing on A4 plain paper is possible, the processor 110 of the printing control device 100 sends a printing instruction to the printing apparatus 200 to perform printing on "A4 plain paper" via the function of the printing instruction sending unit 114 (step S190a). Specifically, the processor 110 generates printing data for the printing apparatus 200 to perform printing on A4 plain paper based on the layout obtained in step S135 and the image obtained in step S155, and sends it to the printing apparatus 200. When the printing apparatus 200 receives the printing instruction in step S190a, it performs printing on A4 plain paper based on the received printing data (step S195a). That is, Figure 2 , Figure 3 The process is as follows: if the user selects the first menu item, and the printing apparatus 200 is capable of printing on A4 plain paper, then the processor 110 performs printing on the A4 plain paper based on the printing data. Therefore, by selecting the first menu item and choosing the image to be printed, the user can ensure that the selected image is printed on A4 plain paper regardless of the printing settings related to the printing medium of the printing apparatus 200. Since the user does not need to change the settings related to the printing medium when the first menu item is selected, this process offers greater convenience compared to existing technologies.

[0062] Furthermore, when the printing control device 100's processor 110 indicates that printing on A4 plain paper cannot be performed due to information indicating that the printing capability of the printing device 200 is not feasible, it sends a printing instruction to the printing device 200 via the function of the printing instruction sending unit 114, indicating that printing will be performed on a printing medium preset in the printing settings associated with the printing device 200, i.e., a printing medium used when printing an image file (step S190b). Specifically, the processor 110 obtains the printing medium preset for the printing device 200 as the printing medium used when printing an image file, by referring to the printing settings information indicating the printing device information Dp. Based on the layout obtained in step S135 and the image obtained in step S155, the processor 110 generates printing data for performing printing on the printing medium preset in the printing settings and sends it to the printing device 200. Upon receiving the printing instruction in step S190b, the printing device 200 performs printing based on the printing data (step S195b). By configuring it in this way, even when printing is indicated in the first menu, printing can be performed on the printing medium set in the printing settings of the printing apparatus 200, even if the printing apparatus 200 cannot perform printing on ordinary paper.

[0063] Furthermore, assuming that an image is input into the chat room while the second menu has been selected in the chat room on the terminal device 400, the processor 110 sends a printing instruction to print the image on photo paper via the function of the printing instruction sending unit 114. Specifically, in Figure 2 If the user selects the second menu after step S105, the processor 110 generates printing data for printing on the photo paper based on the image selected as the printing object, and sends it to the printing apparatus 200. In this case, it is also possible to send a printing instruction to print on the photo paper if it is possible to determine whether printing on the photo paper can be performed based on information indicating the printing capabilities of the printing apparatus 200.

[0064] Furthermore, in this embodiment, since the processing of the image acquisition unit 111, the layout acquisition unit 112, and the preview display unit 113 is processed via the chat server 300, therefore... Figure 6 , Figure 7 , Figure 8 As shown in the example, the chat section a1 can retain a history of the user's choices when executing the typesetting and printing of the screenshot. Therefore, by swiping the chat section a1, the user can easily review the choices made during the typesetting and printing process.

[0065] (3) Other implementation methods: The above-described embodiment is an example for implementing the present invention. Various other embodiments are also possible. For example, the printing control device may be composed of multiple devices. Furthermore, a user may use multiple printing devices in a chat printing service.

[0066] The image selected in the first menu is not limited to screenshots. For example, if a user wants to print an image taken with a camera on plain paper for memo purposes rather than for appreciation, they can also use the first menu to print the image taken with the camera. Furthermore, the first menu is not limited to arranging multiple images of the subject matter on a single page of the printing medium. It can also include a mode that arranges a single image on a single page for printing.

[0067] Although the above embodiment employs a structure where the processing of the image acquisition unit 111, the layout acquisition unit 112, and the preview display unit 113 is all performed via the chat server 300, it is also possible to perform one of these processes by communicating with the terminal device 400 instead of via the chat server 300. The choice between performing the processing via the chat server 300 and not performing the processing via the chat server 300 in the image acquisition unit 111, the layout acquisition unit 112, and the preview display unit 113 can be appropriately designed.

[0068] For example, Figure 9 This is a display example where the layout processing of part 112 is performed without going through chat server 300. Figure 9 The screen g1 shown is, for example, performed using terminal device 400. Figure 5 When button b4 is selected in the displayed state, the screen g1 is overlaid on the chat section a1 and menu section a2. Screen g1 is, for example, the internal browser of the chat application. When button b4 is selected, a display request for screen g1 is sent from the terminal device 400 to the print control device 100. In response to this request, the print control device 100 sends display data for screen g1 to the terminal device 400, and the terminal device 400 displays screen g1 based on this data. When the close button b11 is clicked, the terminal device 400 ends the display of screen g1, resulting in, for example, the terminal device 400's screen returning to... Figure 5The display shown is as follows. In screen g1, images representing multiple layouts are displayed as options. When any of these options is selected by the user and the button b12 for proceeding to the next step is clicked, the terminal device 400 sends information representing the selected layout to the printing control device 100 without going through the chat server 300. Thus, the printing control device 100 can also be configured to perform the processing of the layout acquisition unit 112 without going through the chat server 300.

[0069] Figure 10 This is a display example of a case where the processing of the image acquisition unit 111 is performed without going through the chat server 300. Figure 10 The screen g2 shown is a screen overlaid on the chat section a1 and menu section a2 when an image for printing is selected from the image list stored in the terminal device 400. When the image list is displayed and an image for printing is selected, the terminal device 400 sends a display request for screen g2 to the printing control device 100. In response to the display request, the printing control device 100 sends display data for screen g2 to the terminal device 400, and the terminal device 400 displays screen g2 based on the display data. When the close button b21 is clicked, the terminal device 400 ends the display of screen g2. The image list stored in the terminal device 400 is displayed in screen g2. When any image is selected by the user and the button b22 for proceeding to the next step is clicked, the terminal device 400 sends the image file representing the selected image to the printing control device 100 without going through the chat server 300. Thus, the printing control device 100 can also be configured to perform the processing of the image acquisition unit 111 without going through the chat server 300.

[0070] Figure 11 This is a display example where the processing of the preview display unit 113 is processed without going through the chat server 300. Figure 11The screen g3 shown is a screen overlaid on the area of ​​the chat unit a1 and the menu unit a2 when the terminal device 400 displays a print preview generated by the terminal device 400. When the print preview is displayed, the terminal device 400 sends a display request for screen g3 to the print control device 100. In response to the display request, the print control device 100 sends display data for screen g3 to the terminal device 400, and the terminal device 400 displays screen g3 based on the display data. When the close button b31 is clicked, the terminal device 400 ends the display of screen g3. In screen g3, a print preview is displayed with the image selected by the user arranged according to the layout selected by the user. When the user selects the print button b32, the terminal device 400 sends a print instruction to the print control device 100 without going through the chat server 300. Thus, the print control device 100 can also be configured to perform the processing of the preview display unit 113 without going through the chat server 300.

[0071] Although the above embodiments illustrate an example where the layout acquisition unit's processing is performed before the image acquisition unit's processing, the image acquisition unit's processing can also be configured to be performed before the layout acquisition unit's processing. By configuring it in this way, the user can determine the layout of the image after selecting it for printing.

[0072] In the case where the image acquisition unit's processing is performed before the layout acquisition unit's processing, the layout acquisition unit may also be configured to acquire candidate layouts corresponding to the number of selected images, and to have the preview display unit generate a preview image for each candidate for display on the terminal device, and acquire the layout used in the print preview selected by the user among the displayed preview images. In this case, the print instruction sending unit may also be configured to generate print data containing the selected images according to the acquired layout, and send print instructions for the print data to the printing apparatus. Figure 12 An example of a printing process configured in this way is shown.

[0073] exist Figure 12In steps S100 to S115, the same processing as in the above-described embodiment can be performed. When information indicating that the first menu has been selected is obtained in step S115, the processor 110 sends an image overview display instruction through the function of the image acquisition unit 111. In steps S140 to S155, the same processing as in the above-described embodiment can be performed. When an image is acquired in step S155, the processor 110 generates multiple print previews through the functions of the layout acquisition unit 112 and the preview display unit 113 (step S200), and sends them to the terminal device 400 for display (steps S205, S210).

[0074] In step S200, a layout corresponding to the number of selected images is obtained. The layout corresponding to the number of images is, for example, a layout that does not produce blank spaces. Here, blank space refers to a state where no image is placed in any layout area of ​​the layout. More specifically, for example, when the number of images is two, they are obtained as candidates. Figure 6 The system generates two combined modes, such as a and b, as shown in c3, and generates preview images of the printed objects assigned to each of the two modes, which are then displayed on the terminal device. Furthermore, for example, in the case of three sheets, it obtains... Figure 6 The three-in-one mode shown in c3, c and d, is used, and three images are laid out for these two modes to generate two print previews for display on the terminal device. Furthermore, for example, in the case of four sheets, [the following is a list of options] is obtained as a candidate. Figure 6 The system can generate four print previews for each of the four modes, such as the two-in-one mode (a and b) shown in c3, or the four-in-one mode (e and f), and display them on the terminal device. Additionally, for example, in the case of five prints, combinations such as a and c, b and d (two-in-one and three-in-one combinations) can be obtained as candidates.

[0075] Alternatively, for example, the layouts to be extracted as candidates can be predetermined for each number of sheets. More specifically, for example, in the case of two sheets, the layouts to be extracted as candidates... Figure 6 The system generates two combined modes, a and b, as shown in c3, and produces preview images of the printed object laid out for each of the two modes, which are then displayed on the terminal device. Furthermore, for example, in the case of three sheets, [the system] obtains [something] as a candidate. Figure 6The system generates four print previews: a two-in-one mode like a and b (as shown in c3), or a three-in-one mode like c and d. Three images are laid out for each of these four modes to generate four different print previews, which are then displayed on the terminal device. Furthermore, when three images are laid out for a two-in-one layout like a and b, preview images are generated showing the first image for the first layout area of ​​the first page, the second image for the second layout area of ​​the first page, and the third image for the first layout area of ​​the second page.

[0076] When a user of terminal device 400 selects any print preview displayed on terminal device 400 and selects a print instruction, processor 110 obtains the print instruction under the layout of the selected print preview from terminal device 400 through the function of layout acquisition unit 112 (steps S215, S220). After step S220, [further details about steps can be omitted]. Figure 3 The processing after step S180 is the same. By configuring it in this way, the user can confirm the print preview formed by candidates of layouts automatically obtained based on the number of images of the printable object, and can select a layout from them and perform printing.

[0077] Furthermore, the layout acquisition unit can also be configured to further acquire layout candidates based on whether the selected image is vertically or horizontally elongated. That is, in Figure 12 In step S200, candidate layouts corresponding to whether the image of the printing object is vertical or horizontal can be obtained, and print previews of the images laid out for each candidate can be generated. Furthermore, a vertically elongated image is one where the number of pixels in the vertical direction (image height) is greater than the number of pixels in the horizontal direction (image width), and a horizontally elongated image is one where the number of pixels in the horizontal direction is greater than the number of pixels in the vertical direction. In each layout area of ​​each layout, it is predetermined whether to layout an area of ​​a vertically elongated image or an area of ​​a horizontally elongated image. Specifically, for example, it is determined whether to layout an area of ​​a vertically elongated image or an area of ​​a horizontally elongated image. Figure 6 The first and second layout areas of c3 and a are used to layout a horizontal image, and the first and second layout areas of b are used to layout a vertical image.

[0078] For example, if the processor 110 acquires two images of a printing object through the image acquisition unit 111, and both images are vertical, then the image is acquired as a candidate. Figure 6The layout of b shown in c3. In the layout of b, the two layout areas are vertically elongated. That is, among the candidates a and b for layouts of two images, the candidate is further narrowed down to b. In addition, for example, if the processor 110 has obtained two images of the printed object and both of them are horizontally elongated, it obtains them as candidates. Figure 6 The layout of 'a' is shown in c3. In the layout of 'a', the two layout areas are horizontally elongated.

[0079] Furthermore, for example, it can be configured such that, in the case where multiple images obtained as printing objects contain both vertically elongated and horizontally elongated images, the vertically elongated image adopts a layout with a vertically elongated layout area, and the horizontally elongated image adopts a layout with a horizontally elongated layout area, thereby generating a preview image and displaying it. Specifically, for example, if three images of the printing object are obtained, and one of the three is horizontally elongated and two are vertically elongated, the horizontally elongated image can also be used as one of the candidates to generate a preview image. Figure 6 The processor 110 displays a preview image showing one horizontally elongated image and two vertically elongated images in one layout area of ​​layout a, and two horizontally elongated images in two layout areas of layout b. In addition to this preview image, the processor 110 can also acquire, as a candidate, [the following text is incomplete and requires further context: "...and display..."] Figure 6 The first layout area of ​​layout a shown in c3 is combined with the third and fourth layout areas of layout e on a single page. A preview image is generated, displaying one horizontally elongated image in one of the candidate horizontal layout areas and two vertically elongated images in each of the candidate vertical layout areas. This configuration allows the user to review print previews of candidate layouts automatically derived from the shape of the printed object's image—specifically, whether it is horizontal or vertical—and to select a layout and proceed with printing.

[0080] Furthermore, although the above embodiments show an example of an order in which multiple images are arranged corresponding to the order in which the user selects the images, the arrangement order is not limited to this example. For example, a structure could be adopted in which the order of the images arranged according to the layout is determined based on the date information of the images selected from the list. Date information could include, for example, the creation date and time of a screenshot image, the date and time of an image taken by a camera, etc. The order corresponding to the date information could include, for example, sorting by date from oldest to newest, or sorting by date from newest to oldest. By structuring it in this way, the user can obtain printed materials arranged in an order corresponding to the date information.

[0081] The preview display unit can also be configured to change the arrangement order of the images relative to the layout in response to a configuration change operation on the preview image displayed on the terminal device. For example, in... Figure 11 As shown, when a print preview is displayed for an A4 landscape printing medium with images arranged in two frames, sliding an image from the right frame to the left frame is considered a configuration change operation, swapping the images in the left and right frames. This re-generates the print preview and sends it to the terminal device for display. By configuring the image preview in this way, the user can confirm the image and change the image arrangement order by performing a configuration change operation.

[0082] Although the printing instruction sending unit in the above embodiment adopts a structure that allows printing on the printing medium set in the printing settings when the first menu is selected and printing on plain paper is not possible, it is not limited to this. For example, the printing instruction sending unit may also be configured to determine whether printing on plain paper is possible when the first menu is selected, and if printing on plain paper is not possible, to display information indicating that printing on plain paper is not possible, such as "Printing on A4 plain paper is not supported." By configuring it in this way, the user of the terminal device can understand the information indicating that the image cannot be printed on plain paper.

[0083] Furthermore, the printing instruction sending unit can also be configured to, when the first menu is selected and printing on plain paper is not possible, cause the terminal device to display the printing media selection unit and select the printing media. Specifically, in Figure 3 In the illustrated process, if printing on A4 plain paper cannot be performed after the processing in step S185, the printing control device 100 causes the terminal device 400 to display a printing media selection section, allowing the user to select which printing media to use for printing. By configuring it in this way, if the first menu is selected and printing on plain paper is not possible, the user of the terminal device can be prompted to change the setting to a printing media other than plain paper. Alternatively, it can be configured to obtain a printing media that can be printed by the printing device 200, and display that printing media that can be printed by the printing device 200 as an option in the printing media selection section.

[0084] Alternatively, the printing instruction sending unit can be configured such that, when the first menu is selected, the terminal device 400 displays a printing media selection unit, and, if an operation to change the printing media is performed on the printing media selection unit, the printing media setting is changed from plain paper to the printing media selected by the user, and a printing instruction to perform printing on the changed printing media is sent. That is, it can also be configured such that, even when the first menu is selected, regardless of whether the printing apparatus can perform printing on plain paper, the user can change from plain paper, which is the default printing media in the first menu, to another type of printing media. By configuring it in this way, even when the first menu is selected, the user can give instructions to print images on a printing media other than plain paper.

[0085] Furthermore, the printing instruction sending unit can also be configured such that, when the second menu is selected, the terminal device 400 displays a printing media selection unit, and, if an operation to change the printing media is performed on the printing media selection unit, the printing media setting is changed from photo paper to the printing media selected by the user, and a printing instruction to perform printing on the changed printing media is sent. That is, it can also be configured such that, even when the second menu is selected, regardless of whether the printing device can perform photo paper printing, the user can change from photo paper, which is the default printing media in the second menu, to another type of printing media. By configuring it in this way, even when the second menu is selected, the user can give this instruction if they want to print an image on a printing media other than photo paper.

[0086] Furthermore, although the above embodiment employs a structure where a first menu and a second menu are provided as a printing menu for printing images, and the image is printed on ordinary paper when the first menu is selected, it can also be configured to determine whether the image selected as the printing object is a screenshot image, and if it is a screenshot image, send a printing instruction to the printing device to print the image on ordinary paper, and if it is not a screenshot image, send a printing instruction to the printing device to print it on photographic paper. Image files contain various types of information related to the image. For example, in the case of an image captured using a camera, the image file includes the date and time the image was captured by the camera, the camera manufacturer's name, the camera model name, etc. Additionally, for example, in the case of a camera included with a smartphone, the camera manufacturer's name is sometimes the smartphone manufacturer's name. Furthermore, for example, in the case of a camera included with a smartphone, the camera model name is sometimes the smartphone model name. In the case of a screenshot image rather than an image captured by a camera, the aforementioned labels of the date and time the image was captured by the camera, the camera manufacturer's name, and the camera model name are not included in the image file. Alternatively, even if a tag exists within the image file, it may not contain a valid value. Furthermore, information indicating the creation date of a screenshot may be included in the image file independently of the shooting date captured by the camera. By analyzing the metadata information of these images, it is possible to determine whether an image is a screenshot. Thus, by configuring the analysis of the selected images themselves to determine whether an image selected for printing is a screenshot, images determined to be screenshots can be printed on plain paper, and images determined not to be screenshots can be printed on photographic paper.

[0087] Furthermore, this invention can also be applied as a computer-executed program, a printing control method, or a printing system. Moreover, the aforementioned systems, programs, and methods can be implemented either as standalone devices or using components from multiple devices, encompassing various methods. Furthermore, appropriate modifications can be made, such as making some parts software and others hardware. Moreover, the invention is also established as a recording medium for a program that controls a system. Of course, the recording medium for this program can be a magnetic recording medium or a semiconductor memory, and this can be considered entirely in the same way for any recording medium developed in the future.

[0088] Symbol Explanation 100…Printing control device; 110…Processor; 111…Image acquisition unit; 112…Layout acquisition unit; 113…Preview display unit; 114…Printing instruction transmission unit; 120…Storage medium; 130…Communication unit; 150…Chat server; 200…Printing apparatus; 210…Processor; 220…Storage medium; 230…Communication unit; 240…UI unit; 250…Printing unit; 300…Chat server; 400…Terminal device; D1…Printing data; D p… Printing device information; N… Network; a1… Chat section; a2… Menu section; a3… Image overview display section; b1… Printing button; b11… Button; b12… Button; b2… Button; b21… Button; b22… Button; b3… Button; b31… Button; b32… Printing button; b4… Button; b5… Send button; b6… Button; b7… Button; c1, c2, c3, c4, c5… Messages; g1, g2, g3… Screen; i1, i2… Image.

Claims

1. A printing control device, comprising: The image acquisition unit causes the terminal device to display a list of images stored in the terminal device, and acquires from the list images that are selected as printing objects in the terminal device. The layout acquisition unit causes the terminal device to display a plurality of layout candidates and acquires the layout selected from the candidates. A preview display unit that enables the terminal device to display a preview image in which the selected image is configured according to the layout; The printing instruction sending unit generates printing data that configures the selected image according to the layout, and sends the printing instructions of the printing data to the printing apparatus. At least one of the image acquisition unit, the layout acquisition unit, and the preview display unit is processed via a chat server.

2. The printing control device as described in claim 1, wherein, The processing of the layout acquisition unit is performed before the processing of the image acquisition unit.

3. The printing control device as described in claim 1, wherein, The processing of the image acquisition unit is performed before the processing of the layout acquisition unit.

4. The printing control device as described in claim 3, wherein, The layout acquisition process is performed as follows: The system obtains candidate layouts corresponding to the number of selected images, and causes the preview display unit to generate a preview image for each candidate and causes the terminal device to display it. Obtain the layout used in the preview image selected by the user among the displayed preview images. The printing instruction sending unit generates printing data that configures the selected image according to the obtained layout, and sends the printing instructions of the printing data to the printing apparatus.

5. The printing control device as described in claim 4, wherein, The layout acquisition unit further acquires candidate layouts based on whether the selected image is vertical or horizontal.

6. The printing control device as claimed in claim 1, wherein, The order in which the images are arranged according to the layout is determined based on the order in which they are selected from the overview.

7. The printing control device as claimed in claim 1, wherein, The order of the images arranged according to the layout is determined based on the date information of the images selected from the overview.

8. The printing control device as claimed in claim 1, wherein, The preview display unit changes the configuration order of the images for the layout according to the configuration change operation for the preview images displayed on the terminal device.

9. A printing control method, wherein, This includes the following processes: in the printing control device, The image acquisition unit causes the terminal device to display a list of images stored in the terminal device, and acquires from the list images that are selected as printing objects in the terminal device. The layout acquisition unit causes the terminal device to display multiple layout candidates and acquires the layout selected from the candidates. The preview display unit causes the terminal device to display a preview image in which the selected image is configured according to the layout; The printing instruction sending unit generates printing data that configures the selected image according to the layout, and sends the printing instructions of the printing data to the printing apparatus. In the printing control method, At least one of the image acquisition unit, the layout acquisition unit, and the preview display unit is processed via a chat server.

10. A printing system comprising a printing control device and a printing device, wherein, The printing control device includes: The image acquisition unit causes the terminal device to display a list of images stored in the terminal device, and acquires from the list images that are selected as printing objects in the terminal device. The layout acquisition unit causes the terminal device to display a plurality of layout candidates and acquires the layout selected from the candidates. A preview display unit that enables the terminal device to display a preview image in which the selected image is configured according to the layout; The printing instruction sending unit generates printing data that configures the selected image according to the layout, and sends the printing instructions of the printing data to the printing apparatus. The printing apparatus performs printing based on the printing data. At least one of the image acquisition unit, the layout acquisition unit, and the preview display unit is processed via a chat server.

Images