Image processing device, computer program, and printing system

Abstract

To reduce a user's burden in creating a bulletin object.SOLUTION: An image processing device displays a composite image obtained by combining a target image with a print medium image in a captured image, and outputs a print job for printing a print image including the target image on the print medium. The print job includes print settings according to the position and size of the target image and the print medium image in the composite image. After displaying the composite image, if a change instruction is acquired from the user, the position or size of the target image in the composite image is changed, and the print job is output on the basis of the composite image after the change processing. When the number of target images is one, the size of the print medium image is changed in accordance with a change in the size of the target image. When the number of target images is two or more, the size of the print medium image is not changed in accordance with a change in the size of the target image.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present specification relates to an image processing device, a computer program, and a printing system. [Background technology]

[0002] Patent Document 1 discloses a print processing device for creating printed materials such as banners to be installed in environments such as event venues. The print processing device, for example, acquires image data of the event venue, estimates the dimensions of a banner to be displayed on the stage at the event venue, and generates an image of the banner. The print processing device combines the image of the banner with an image of the event venue and displays it on a display device. The print processing device changes the dimensions, font, and background color of the banner image in response to user operation instructions. The print processing device finally determines the printing conditions for the banner image and outputs print data to a printer. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-56001 Summary of the Invention [Problem to be solved by the invention]

[0004] This specification discloses a new technology that can reduce the burden on users when creating notices by printing images on print media. [Means for solving the problem]

[0005] The techniques disclosed in this specification can be implemented in the following application examples.

[0006] [Application Example 1] An image processing device for creating a notice by printing an image on a print medium, the image processing device comprising: a camera that generates an image using an image sensor; a display unit that displays the image; an operation unit that acquires user instructions; and a control unit, wherein the control unit performs an image determination process that determines one or more target images based on the user's instructions; a capture process that controls the camera to generate a captured image based on the user's instructions; a display process that displays the captured image on the display unit; an area determination process that determines a target area within the captured image displayed on the display unit based on the user's instructions; and a composite display process that displays a composite image obtained by combining the one or more target images and a print medium image with the captured image on the display unit, wherein the one or more target images are arranged in the target area within the captured image, and the print medium image is an image showing the print medium for printing a print image including the one or more target images on the print medium. an output process for outputting a print job of the print job, the print job including print settings according to positions and sizes of the one or more target images and the print medium image in the composite image; wherein the control unit, after displaying the composite image on the display unit in the composite display process and before the output process, if a change instruction is received from the user, executes a change process for changing the positions or sizes of the one or more target images in the composite image displayed on the display unit based on the change instruction, and executes the output process based on the composite image after the change process; and, in the change process, if the number of target images is one, the control unit changes the size of the print medium image from a first size to a second size larger than the first size in response to changing the size of the target image to a size larger than a reference size, and, if the number of target images is two or more, does not change the size of the print medium image in response to changing the size of the target image.

[0007] When creating a notice using one target image, the target image itself is often the image to be printed, so it is likely that the size of the print medium to be used will also need to be changed depending on the size of the target image. When creating a notice using multiple target images, how the multiple target images are arranged in a specified area is important, and even if the size of each target image is changed, it is likely that the overall size of the image to be printed will not change. According to this embodiment, when there is one target image, the size of the print medium image changes in accordance with the change in the size of the target image. When there are two or more target images, the size of the print medium image does not change in accordance with the change in the size of the target image. Therefore, by displaying a composite image according to the type of notice to be created, the burden on the user to print images on the print medium to create a notice can be reduced.

[0008] The technology disclosed in this specification can be realized in various forms, such as an image processing device, an image processing system including a terminal device and a printing device, an image processing method, a computer program for realizing the functions of these devices, systems, and methods, a recording medium on which the computer program is recorded, etc. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of a system 1000. [Figure 2] 1 is a flowchart of image processing. [Figure 3] FIG. 2 is a diagram showing an example of an image selection screen W1. [Figure 4] 10 is a flowchart of a first posting creation process. [Figure 5] FIG. 10 is a first diagram showing an example of a screen displayed in the first posting creation process. [Figure 6] FIG. 10 is a second diagram showing an example of a screen displayed in the first posting creation process. [Figure 7] FIG. 10 is a diagram showing an example of a printed sheet when a first notice creation process is executed. [Figure 8]10 is a flowchart of a second posting creation process. [Figure 9] FIG. 11 is a first diagram showing an example of a screen displayed in the second posting creation process. [Figure 10] FIG. 10 is a second diagram showing an example of a screen displayed in the second posting creation process. [Figure 11] FIG. 10 is a diagram showing an example of a printed sheet when a second notice creation process is executed. DETAILED DESCRIPTION OF THE INVENTION

[0010] A. Working Example: A-1. Image processing device configuration Next, an embodiment will be described based on an example. FIG. 1 is a block diagram showing the configuration of a system 1000 according to the example. The system 1000 includes a terminal device 100 as an image processing device according to the example, and printers 200A and 200B. The printers 200A and 200B are connected to, for example, a wired local area network LN. A wireless access point AP is connected to the local area network LN. The local area network LN is, for example, a wired network established in accordance with the Ethernet (registered trademark) standard. The access point AP is, for example, an access point that uses a communication method in accordance with the Wi-Fi standard, and is connected to the local area network LN.

[0011] The terminal device 100 is communicably connected to the printers 200A and 200B via an access point AP and a local area network LN. Alternatively, communication between the terminal device 100 and the printers 200A and 200B may be performed using various other communication methods, such as a wireless LAN ad hoc mode, Wi-Fi direct, Bluetooth (registered trademark), infrared communication, or wired communication such as a USB connection.

[0012] The terminal device 100 (FIG. 1) is a terminal device used by a user of the printers 200A and 200B, such as a smartphone. The terminal device 100 includes a CPU 110 as a controller of the terminal device 100, a volatile storage device 120 such as a RAM, and a non-volatile storage device 130 such as a hard disk drive or flash memory.

[0013] The terminal device 100 further includes a display unit 140 such as a liquid crystal display, an operation unit 150 such as a touch panel superimposed on the display unit 140, a camera 160, a three-dimensional scanner 170, and a communication IF 180 for communicating with external devices. The terminal device 100 can acquire instructions from a user via the operation unit 150.

[0014] The camera 160 is a device that uses an image sensor including an imaging element such as a CCD or CMOS to capture an image of an object (subject) and thereby generates and acquires captured image data showing the object.

[0015] The three-dimensional scanner 170 is a device that measures the distance to an object, the shape of the object, etc. by irradiating the object with laser light and detecting the reflected light, and in this embodiment is a well-known device called a LiDAR (Light Detection And Ranging) scanner.

[0016] In this embodiment, the communication IF 180 is a wireless interface that complies with the Wi-Fi standard and is used for communication with the access point AP.

[0017] The terminal device 100 also has other components such as a wireless interface that complies with a mobile phone communication method (e.g., a method that complies with communication standards such as 4G or 5G) and audio processing devices such as a microphone and speaker, but these are not shown in the figure.

[0018] The volatile storage device 120 provides a buffer area for temporarily storing various intermediate data generated when the CPU 110 performs processing. The non-volatile storage device 130 stores a control program PGc, an application program PGa, printer information PRI, and an image data group DG.

[0019] The control program PGc is a computer program that causes the CPU 110 to realize basic functions of the terminal device 100, such as functions of the OS (operating system), a telephone function, and a control function of the camera 160. The control program PGc is provided, for example, by the manufacturer of the terminal device 100 in a form that is stored in the nonvolatile storage device 130 when the terminal device 100 is manufactured.

[0020] The application program PGa is a computer program that runs on the OS and causes the CPU 110 to perform image processing for creating a notice, which will be described later. For example, the application program PGa is provided by a company that manufactures the printers 200A and 200B. The application program PGa is provided, for example, in a form that is downloaded from a server connected via the Internet (not shown). Alternatively, the application program PGa may be provided in a form that is pre-installed in the terminal device 100. Hereinafter, the function that the CPU 110 of the terminal device 100 realizes by executing the application program PGa will also be referred to as a "terminal application."

[0021] The printer information PRI is information about printers that can be used by the terminal device 100. In this embodiment, the printer information PRI includes information about two printers 200A and 200B. Specifically, the printer information PRI includes, for example, the model name, access information, and paper information. The model information includes, for example, the model name and model number of the printers 200A and 200B. The access information includes information for accessing the printers 200A and 200B, such as information indicating the destination of print jobs, inquiries, etc., specifically, IP addresses. The paper information includes information indicating the paper that can be used by the printers 200A and 200B. In this embodiment, the paper information for the printer 200A is information indicating cut paper (e.g., B5, A4, A3), and the paper information for the printer 200B is information indicating roll paper (long paper).

[0022] The image data group DG includes, for example, a plurality of image data created by a user of the terminal device 100. The image data group DG may include, for example, image data created using the camera 160. The image data group DG may include image data created using a drawing creation program or a document creation program.

[0023] Printer 200A includes a CPU 210 as a controller for printer 200A, a volatile storage device 220 such as RAM, and a non-volatile storage device 230 such as a hard disk drive or flash memory. Printer 200A also includes a display unit 240 such as a liquid crystal display, an operation unit 250 such as buttons or a touch panel for acquiring user operations, a printing mechanism 270, and a communication IF 280.

[0024] The printing mechanism 270 is an inkjet printing mechanism that ejects multiple types of ink, for example, cyan (C), magenta (M), yellow (Y), and black (K), to print on a print medium such as paper. Alternatively, the printing mechanism 270 may be an electrophotographic printing mechanism that prints on a print medium using multiple types of toner.

[0025] The communication IF 180 is an interface for connecting to a local area network LN, and is, for example, an interface conforming to Ethernet (registered trademark) or a Wi-Fi standard.

[0026] The volatile storage device 220 is provided with a buffer area for temporarily storing various intermediate data generated when the CPU 210 performs processing. The non-volatile storage device 230 stores a computer program PGp for controlling the printer 200A.

[0027] The computer program PGp is, for example, stored in advance in the nonvolatile storage device 230 when the printer 200A is shipped. The computer program PGp can also be provided in a format recorded on a CD-ROM or the like, or in a format downloaded from a server.

[0028] The CPU 210 controls the printer 200A by executing the computer program PGp. For example, the CPU 210 executes a print process in which the print mechanism 270 is controlled to print an image on a print medium such as paper in accordance with a print job transmitted from the terminal device 100.

[0029] Printer 200B, like printer 200A, has components 210-280. Printer 200A and printer 200B can print on different types of paper. Printer 200A prints on cut paper. Cut paper is paper that has been cut to a specific size defined by standards. In this embodiment, printer 200A can print on B5, A4, and A3 paper, for example. Printer 200B prints on roll paper. Roll paper is made by rolling up long paper that is longer in the transport direction than cut paper into a cylindrical shape.

[0030] A-2. Image processing 2 is a flowchart of the image processing of this embodiment. This image processing is a process for creating a notice by printing an image on paper using image data of a user. For example, the image processing is started when the user starts the above-mentioned terminal application on the terminal device 100 and inputs an instruction to start the image processing.

[0031] In S105, the CPU 110 of the terminal device 100 displays an image selection screen W1 on the display unit 140. The image selection screen W1 is a screen for obtaining an image selection instruction from the user. FIG. 3 is a diagram showing an example of the image selection screen W1. The image selection screen W1 of FIG. 3 includes a message MS1 prompting the user to select an image, a plurality of images IM1 to IM10, and a decision button BTa. Each of the plurality of images IM1 to IM10 is an image represented by image data included in the image data group DG stored in the non-volatile storage device 130.

[0032] In S110, the CPU 110 determines one or more target images based on a user instruction. The target images are images to be used in creating a bulletin board. For example, the user can select one or more images by tapping a desired image from among images IM1 to IM10 on the image selection screen W1. A selection frame SF indicating that the image selected by the user has been selected is displayed around the image. When the user taps the confirm button BTa with one or more images selected on the image selection screen W1, the CPU 110 acquires an instruction to select an image. The CPU 110 determines the image currently selected on the image selection screen W1 as the target image. In the example of FIG. 4, two images IM1 and IM4 are selected, so when the confirm button BTa is tapped in the state of FIG. 4, the two images IM1 and IM4 are determined as the target images.

[0033] In S120, CPU 110 determines whether the number of target images determined in S110 is one or more. If the number of target images determined is one (S120: YES), CPU 110 executes a first notice creation process in S130. If the number of target images determined is more than one (S120: NO), CPU 110 executes a second notice creation process in S140.

[0034] The first posting creation process at S130 is a process for determining print images and print settings for creating a posting based on user instructions when there is one target image. The second posting creation process at S140 is a process for determining print images and print settings for creating a posting based on user instructions when there are multiple target images.

[0035] In S150, CPU 110 generates a print job that performs printing using the print image and print settings determined in the first or second message creation process. For example, CPU 110 generates a print job that includes image data representing the print image and setting data representing the print settings. The image data is, for example, an image file saved in JPEG (Joint Photographic Experts Group) format or PDF (Portable Document Format). The setting data includes data representing various print settings, such as the type and size of paper, the size of the print image, and the placement of the print image on the paper (including settings such as margins).

[0036] In S160, CPU 110 sends the generated print job to a printer. The destination printer varies depending on, for example, the type of paper to be used for printing based on the print job. For example, if cut paper is to be used, the print job is sent to printer 200A. If roll paper is to be used, the print job is sent to printer 200B. Upon receiving the print job, the printer prints the print image represented by the image data included in the print job on paper according to the print settings included in the print job. For example, the printer performs rasterization, scaling to adjust the image size, color conversion, and halftone processing as needed to generate print data. The printer then prints using the print data. The user completes the poster by trimming the margins of the printed paper or pasting together multiple printed sheets of paper as needed. In a modified example, all or part of the rasterization, scaling to adjust the image size, color conversion, and halftone processing may be performed by terminal device 100.

[0037] A-3. First posting creation process The first posting creation process of S130 will be described below using as an example a case where one image IM1 is determined to be the target image. FIG. 4 is a flowchart of the first posting creation process. FIGS. 5 and 6 are diagrams showing examples of screens displayed in the first posting creation process. In S205, CPU 110 displays a photographing screen W11 on display unit 140. The photographing screen W11 of FIG. 5(A) includes a message MS2 prompting the user to photograph the posting location where the poster is to be posted, and a photographing button BTb. An image TI represented by an image signal currently output by the image sensor of camera 160 is displayed in real time across the entire photographing screen W11.

[0038] In S210, CPU 110 controls camera 160 based on a user instruction to generate a captured image PI showing the posting location. For example, the user holds terminal device 100 so that the posting location is located near the center of shooting screen W11, and taps shooting button BTb. When shooting button BTb is tapped, CPU 110 generates data of the captured image PI based on the image signal output by the image sensor of camera 160 at that time. The generated data is, for example, RGB image data. RGB image data includes values of a plurality of pixels, and each of the values of the plurality of pixels represents the color of the pixel by a color value (also called an RGB value) in the RGB color system.

[0039] In S215, CPU 110 executes actual dimension measurement processing to measure the actual dimensions of the subject in the captured image PI. Specifically, CPU 110 generates three-dimensional data using three-dimensional scanner 170 at the timing when the capture button BTb is tapped, i.e., approximately the same time as the timing when the data for the captured image PI is generated. CPU 110 uses the three-dimensional data to measure the actual dimensions of a characteristic portion near the center of the captured image PI. For example, in the example of FIG. 6(A), the actual vertical dimension Lr of the bulletin board shown in the captured image PI is measured. The measurement results are used to calculate the dimensional values of the print image to be printed, as described below.

[0040] In S220, the CPU 110 displays the operation screen W12 including the captured image PI on the display unit 140. The operation screen W12 of Fig. 5(B) includes a message MS3 prompting the user to specify a display position, and a display setting button BTc. The captured image PI generated in S210 is displayed across the entire operation screen W12.

[0041] In S225, the CPU 110 determines an image arrangement area CA in the captured image PI based on the user's designated position. For example, as shown in FIG. 5(B), the user taps a desired display position in the captured image PI. When the CPU 110 detects the tap on the display position, it determines an image arrangement area CA in the captured image PI based on the display position. In the example of FIG. 5(B), the image arrangement area CA is determined with the display position tapped by the user as the lower right corner.

[0042] In S230, the CPU 110 composites and displays the target image IM1 in the image arrangement area CA within the captured image PI. For example, the CPU 110 composites the target image IM1 with the captured image PI so as to arrange the target image IM1 in the image arrangement area CA to generate a composite image CI, and displays the composite image CI on the display unit 140.

[0043] In S235, CPU 110 composites and displays paper image MI around target image IM1 in composite image CI. For example, CPU 110 converts the number of pixels in the vertical and horizontal directions of target image IM1 in composite image CI into dimensional values. Here, dimensional values refer to values having units that indicate real-world lengths, such as millimeters or inches. For example, CPU 110 calculates the relationship between the number of pixels on composite image CI and dimensional values (e.g., millimeters) from the actual dimension Lr (FIG. 5(A)) measured by the actual dimension measurement process in S215.

[0044] CPU 110 calculates the dimensional values of target image IM1 based on this relationship. CPU 110 determines the optimum paper size and the optimum number of copies for printing target image IM1 having the calculated dimensional values. The optimum paper size is selected from among paper sizes available for printers 200A and 200B. The paper sizes available for printers 200A and 200B are identified by referencing the paper information included in the printer information PRI described above. In the first notice creation process, the paper size is selected from among available cut sheets.

[0045] For example, the minimum number of prints required to print the entire target image IM1 using available paper is determined as the optimal number of prints. Then, of the paper sizes that can print the target image IM1 with the optimal number of prints, the smallest paper size is selected as the optimal paper size. For example, if the entire target image IM1 can be printed on a single sheet of A4 or A3 paper, but the entire target image IM1 cannot be printed on a single sheet of B5 paper, A4 is selected as the optimal paper size.

[0046] For example, a printable maximum size (also called a reference size) is set for each paper type (e.g., B5, A4, A3), and the paper size on which the target image IM1 can be printed is selected based on this maximum size. The reference size is the maximum length and width. For example, if both the length and width of the target image IM1 in the length direction are equal to or less than the maximum value for B5, it is determined that the target image IM1 can be printed on one sheet of B5 paper. If at least one of the length and width of the target image IM1 in the length direction or width direction is greater than the maximum value for B5, it is determined that the target image IM1 cannot be printed on one sheet of B5 paper.

[0047] The CPU 110 arranges the paper image MI, which indicates the outer edge of a sheet of paper of the optimal size, in the composite image CI so that the center of gravity of the target image IM1 coincides with the center of gravity of the sheet of paper of the optimal size (or the overall center of gravity of the multiple sheets of paper if there are multiple sheets of paper). FIG. 5(B) shows the operation screen W12 in a state in which the composite image CI obtained by combining the target image IM1 and the paper image MI with the captured image PI is displayed. In the example of FIG. 5(B), a paper image MI indicating a single sheet of A4 paper is displayed. The paper image MI includes an outer edge line OL indicating the outer edge of the single sheet of A4 paper. It can be said that the area between the outer edge line OL and the target image IM1 is a margin image WS indicating the margin that will be created when the target image IM1 is printed on the paper.

[0048] In S240, CPU 110 transitions to a state in which it can accept print instructions and change instructions from the user. Specifically, as shown in Fig. 3(C), CPU 110 displays, on operation screen W12, message MS4, in place of message MS3, indicating that the size, position, and orientation of target image IM1 can be changed. Furthermore, CPU 110 displays a print button BTd and a print settings button BTp on operation screen W12.

[0049] In this state, the user can input, by performing predetermined operations, instructions to change the size, position, and orientation of the target image IM1 and instructions to print a print image including the target image IM1. For example, an instruction to enlarge the target image IM1 is input by touching the displayed target image IM1 with two fingers and widening the gap between the two fingertips (a so-called pinch-out operation). An instruction to reduce the size of the target image IM1 is input by touching the displayed target image IM1 with two fingers and narrowing the gap between the two fingertips (a so-called pinch-in operation). An instruction to change the position of the target image IM1 is input by touching the displayed target image IM1 with a finger, moving the finger to a new position without releasing it, and then releasing it (a so-called drag operation). An instruction to change the orientation of the target image IM1, i.e., an instruction to rotate the target image IM1, is input by touching the target image IM1 with one finger, touching the screen with another finger, and moving the other finger in a circular motion around the first finger. A print instruction is input by tapping the print button BTd.

[0050] In S250, the CPU 110 determines whether or not a modification instruction for the target image IM1 has been received from the user. If a modification instruction has been received from the user (S250: YES), the CPU 110 changes any one of the position, size, and orientation of the target image IM1 in the composite image CI based on the modification instruction received in S255. As a result, any one of the position, size, and orientation of the target image IM1 in the composite image CI displayed on the display unit 140 changes in real time in accordance with the modification instruction from the user. For example, if a modification instruction to enlarge the target image IM1 is received, the target image IM1 is enlarged as shown in the operation screen W12 of FIG. 5(C) compared to the operation screen W12 of FIG. 5(B).

[0051] In S260, CPU 110 changes the paper image MI in the composite image CI according to the changed target image IM1. Specifically, when the size of target image IM1 is changed, CPU 110 converts the number of pixels in the vertical and horizontal directions of target image IM1 in the composite image CI into dimension values. CPU 110 again determines the optimal paper size and the optimal number of copies to be printed based on the dimension values of the changed target image IM1. When at least one of the optimal paper size and the optimal number of copies is different from before the change of target image IM1, CPU 110 generates a new paper image MI indicating the optimal paper size and the optimal number of copies and composites it into the composite image CI. Similarly, when the position or orientation of target image IM1 is changed, the position and orientation of the paper image MI in the composite image CI are changed in accordance with the change.

[0052] As a result, the position, size, and orientation of the paper image MI change in real time in accordance with the change in the target image IM1 in the composite image CI displayed on the display unit 140. The operation screen W12 in Fig. 5(B) displays the paper image MI showing one A4 sheet of paper, but the operation screen W12 in Fig. 5(C) displays the paper image MI showing one A3 sheet of paper in accordance with the enlargement of the target image IM1. After S260, the CPU 110 returns to S250 and waits again until a change instruction or a print instruction is input.

[0053] FIG. 5(D) illustrates an example in which a change instruction is input to change the size of the target image IM1 in the composite image CI to a size larger than the size shown in FIG. 5(C). In this example, the target image IM1 was changed significantly in S255, so the changed target image IM1 is now too large to print on a single A4 sheet of paper. Therefore, in S260, for example, the CPU 110 re-determines the optimal paper size and optimal number of copies based on the dimensions of the changed target image IM1. In the example of FIG. 5(D), the optimal paper size is determined to be "A3" and the optimal number of copies is determined to be "two." As shown in FIG. 5(D), the CPU 110 newly generates a paper image MI representing two A3 sheets of paper and combines it with the composite image CI.

[0054] 5(D) shows a sheet image MI showing two A3 sheets of paper. The sheet image MI includes an outer edge line OL showing the outer edge of the area consisting of the two A3 sheets of paper, and a boundary line IL between the two A3 sheets of paper. The boundary line IL can also be said to be a dividing line when the target image IM1 is divided into two and printed on two sheets of paper.

[0055] In this way, in the operation screen W12, as the target image IM1 is enlarged, the size of the paper image MI (the size of the outer edge line OL) is also enlarged. For example, if the target image IM1 is made larger than the maximum size that can be printed on A4 paper and smaller than the maximum size that can be printed on A3 paper, the size of the paper image MI is changed to, for example, a size that indicates A3 paper (FIG. 5(C)). Also, if the target image IM1 is made larger than the maximum size that can be printed on A3 paper, the size of the paper image MI is changed to, for example, a size that corresponds to two sheets of A3 paper (FIG. 5(D)).

[0056] The sheet image MI in Fig. 5(D) further includes a sheet number ON attached to the portion indicating each sheet of paper. In this embodiment, the sheet number ON indicates the printing order when the target image IM1 is divided into n pieces (n=2 in the example of Fig. 5(D)) and printed on n sheets of paper.

[0057] The optimum number of copies to print is not limited to one or two, but can be determined to be three, four, eight, etc. depending on the size of the target image IM1. The division line IL is displayed when the optimum number of copies to print is determined to be n (n is an integer greater than or equal to 2).

[0058] In this way, the position, size, and orientation of the target image IM1 and the paper image MI corresponding to the target image IM1 are changed in real time on the operation screen W12 in response to a change instruction from the user. As a result, the user can easily determine the position and size of the target image IM1 while imagining the printed paper and, ultimately, the notice to be created using the printed paper.

[0059] If no modification instruction for the target image IM1 is received from the user (S250: NO), the CPU 110 determines in S265 whether or not a print instruction has been received from the user. If no print instruction has been received from the user (S265: NO), the CPU 110 returns to S250 and waits again until a modification instruction or a print instruction is input.

[0060] When a print instruction is received from the user (S265: YES), CPU 110 determines the print image and print settings based on composite image CI currently displayed on display unit 140 at S270. Specifically, the dimensions of target image IM1 to be printed are determined based on the number of vertical and horizontal pixels of target image IM1 in composite image CI. In addition, settings such as margins and image division are determined so that the positional relationship between target image IM1 in composite image CI and paper image MI is the same as the positional relationship between target image IM1 and paper that will actually be printed. Furthermore, a print image including auxiliary images (images such as cutting lines and margins) described below and target image IM1 is determined. Once the print image and print settings are determined, the first bulletin board creation process ends.

[0061] Although not shown in the flowchart, the processing when the display setting button BTc (FIGS. 5(B), (C), and (D)) of the operation screen W12 is tapped will now be described. When the display setting button BTc of the operation screen W12 is tapped, the CPU 110 displays the display setting screen W13 (FIG. 6(A)) on the display unit 140 in place of the operation screen W12 or by superimposing it on the operation screen W12. The display setting screen W13 is a screen for inputting instructions to change the settings related to the display of the operation screen W12.

[0062] 6A includes radio buttons RB1 and RB2 for inputting a setting instruction for whether or not to display margins, radio buttons RB3 and RB4 for inputting an instruction for switching between whether or not to display split screen, and an Apply button BTe. The user operates radio buttons RB1 to RB4 to set whether or not to display margins and split screen, and then taps the Apply button BTe. When the Apply button BTe is tapped, CPU 110 acquires a setting instruction for whether or not to display margins and split screen.

[0063] When the CPU 110 acquires the setting instruction, it ends the display of the display setting screen W13. Then, in accordance with the acquired setting instruction, the CPU 110 updates the paper image MI combined with the composite image CI, and displays the operation screen W12 including the updated composite image CI on the display unit 140.

[0064] The operation screen W12 of Fig. 5(D), which has already been explained, is displayed when margin display is "enabled" and split display is "enabled." The operation screen W12 of Fig. 6(B) is displayed when margin display is "disabled" and split display is "enabled." As shown in Fig. 6(B), when margin display is "disabled" and split display is "enabled," the outer edge line OL is not displayed as the paper image MI, and the dividing line IL and paper number ON are displayed.

[0065] The operation screen W12 in Fig. 6(C) is displayed when the margin display is "Yes" and the division display is "No." As shown in Fig. 6(C), when the margin display is "Yes" and the division display is "No," only the outer edge line OL is displayed as the paper image MI, and the division line IL and paper number ON are not displayed.

[0066] Although not shown in the figure, if the margin display is "none" and the division display is "none," the outer edge line OL, the division line IL, and the paper number ON are not displayed on the operation screen W12. In other words, in this case, the entire paper image MI is not displayed.

[0067] As described above, in this embodiment, the presence or absence of margin display and split display on the operation screen W12 can be switched in response to a user instruction. For example, if the user feels that the margin display or split display makes it difficult to view the target image IM1 or that the display is too cluttered, the user can easily turn off the margin display or split display.

[0068] Next, the processing performed when the print settings button BTp (FIGS. 5(C) and 5(D)) on the operation screen W12 is tapped will be described. When the print settings button BTp on the operation screen W12 is tapped, the CPU 110 displays the print settings screen W14 (FIG. 6(D)) on the display unit 140 in place of the operation screen W12 or by superimposing it on the operation screen W12. FIG. 6(A) is a screen for inputting instructions to change settings related to the print image, which will be described later.

[0069] 6(D) includes radio buttons RB5 and RB6 for inputting a setting instruction as to whether or not to print a cutting guide image (described later), radio buttons RB7 and RB8 for inputting a setting instruction as to whether or not to print guide characters (described later), and an Apply button BTe. The user operates the radio buttons RB5 to RB8 to set whether or not to print the cutting guide image and guide characters, and then taps the Apply button BTe. When the Apply button BTe is tapped, the CPU 110 acquires a setting instruction as to whether or not to print the cutting guide image and guide characters.

[0070] In response to the acquired setting instruction, the CPU 110 switches whether or not to include a cutting guide image and guide characters in the print image, as will be described in detail later.

[0071] Next, an example of a print image printed on paper when the first bulletin board creation process is performed will be described. FIG. 7 is a diagram showing an example of a printed paper when the first bulletin board creation process is executed. The example in FIG. 7 shows a printed paper created when the print button BTd is tapped with the operation screen W12 in the state shown in FIG. 6(D). In this case, the target image IM1 is divided into two and printed on two sheets of paper. For this purpose, a first printed paper PPa and a second printed paper PPb are created. The first printed image PTa is printed on the first printed paper PPa, and the second printed image PTb is printed on the second printed paper PPb.

[0072] The first printed image PTa includes a first partial image IM1a, a first border image TAa, a first cutting guide image TMa, and guide characters TX1 to TX3. The first partial image IM1a is the upper of two partial images obtained by dividing the target image IM1 into two. A bottom edge region ST is provided below the first partial image IM1a. The bottom edge region ST is a blank area to be used as an overlapping area. The overlapping area is an area where the first printed sheet PPa and the second printed sheet PPb overlap when the first printed sheet PPa and the second printed sheet PPb are joined together to create a notice. For example, the first printed sheet PPa and the second printed sheet PPb are attached to each other by applying an adhesive to the overlapping area.

[0073] The guide images (first cutting guide image TMa and guide characters TX1 to TX3) are images that show information to be referred to when creating a notice using multiple printed sheets of paper PPa and PPb. For example, the first cutting guide image TMa is a guide image to be referred to when cutting the margins of the first printed sheet of paper PPa when creating a notice. The first cutting guide image TMa includes cutting lines CLa that are provided along the upper and left and right edges of the first partial image IM1a. The cutting lines CLa are images that indicate the edges of the first partial image IM1a.

[0074] The first border image TAa is a band-like region located above and to the left and right of the first partial image IM1a, and is a region located outside the cutting line CLa. The first border image TAa is, for example, a region having the same color as the background color of the first partial image IM1a. The background color of the first partial image IM1a is determined, for example, by the CPU 110 executing a known analysis process on the first partial image IM1a. For example, the average color of the region along the edge of the first partial image IM1a is determined as the background color. The presence of the first border image TAa prevents, for example, a margin remaining at the edge of the first partial image IM1a, which would detract from the appearance, when the first printed paper PPa is cut along the cutting line CLa and the margin is removed.

[0075] The guide characters TX1 to TX3 are guide images to be referred to when creating a notice by pasting together multiple printed sheets (for example, a first printed sheet PPa and a second printed sheet PPb). The guide characters include a guide character TX1 indicating a margin for overlap, a guide character TX2 indicating the sheet number ON, and a guide character TX3 indicating the position where the first printed sheet PPa should be placed on the notice.

[0076] The second print image PTb includes a second partial image IM1b, a second border image TAb, a second cutting guide image TMb, and guide characters TX4 and TX5. The second partial image IM1b is the lower of two partial images obtained by dividing the target image IM1 into two. There is no margin on the upper side of the second partial image IM1b. Margins are provided on the lower, left, and right sides of the second partial image IM1b, similar to the first partial image IM1a. That is, the top edge UT of the second partial image IM1b is printed using what is called borderless printing, and the other three edges of the second partial image IM1b are printed using what is called bordered printing.

[0077] The second cutting guide image TMb is a guide image to be referred to when cutting the margins of the first printed paper PPa when creating a notice. The second cutting guide image TMb includes cutting lines CLb provided along the bottom and left and right edges of the second partial image IM1b.

[0078] The second border image TAb is a band-like region provided below and on the left and right sides of the second partial image IM1b, and is a region provided outside the cutting line CLb. The second border image TAb is, for example, a region having the same color as the background color of the second partial image IM1b. The background color of the second partial image IM1b is determined, for example, by a process similar to the analysis process performed on the first partial image IM1a when determining the color of the first border image TAa described above.

[0079] Like the above-mentioned guide characters TX1 to TX3, the guide characters TX4 and TX5 are guide images to be referred to when creating a notice by pasting together multiple printed sheets of paper. The guide characters include a guide character TX4 indicating the paper number ON and a guide character TX5 indicating the position where the second printed sheet PPb should be placed on the notice.

[0080] The first print image PTa and second print image PTb in Fig. 7 are images that are printed when a setting is made to print a cutting guide image and to print guide characters on the print setting screen W14 of Fig. 6(D) described above. When a setting is made to not print a cutting guide image on the print setting screen W14 of Fig. 6(D), the first cutting guide image TMa and the second cutting guide image TMb and the first edge image TAa and the second edge image TAb are not printed. When a setting is made to not print guide characters on the print setting screen W14 of Fig. 6(D), the guide characters TX1 to TX5 are not printed.

[0081] As described above, in this embodiment, whether or not to print the cutting guide image and guide characters on the print image can be switched according to a user's instruction. For example, if the user does not want to cut out the margins, the user can set the cutting guide image not to be printed. Also, if the user thinks that guide characters are unnecessary, the user can set the guide characters not to be printed.

[0082] A-4. Second posting creation process The second notice creation process in S140 will be described below, taking as an example a case where a plurality of images IM5 to IM10 are determined as target images. FIG. 8 is a flowchart of the second notice creation process. FIGS. 9 and 10 are diagrams showing examples of screens displayed in the second notice creation process. In S305, CPU 110 displays a panoramic shooting screen W21 on display unit 140. The panoramic shooting screen W21 in FIG. 9(A) includes a message MS6 prompting the user to take a panoramic shot of the entire notice location, and a shooting button BTf. An image TIm represented by an image signal currently being output by the image sensor of camera 160 is displayed in real time across the entire panoramic shooting screen W21.

[0083] In S310, the CPU 110 controls the camera 160 based on a user instruction to generate a panoramic image PIm showing the posting location. For example, the user holds the terminal device 100 so that the left edge of the posting location is included in the panoramic shooting screen W21, and taps the shooting button BTf. The user rotates the terminal device 100 horizontally until the right edge of the posting location is included in the panoramic shooting screen W21, and taps the shooting button BTf again. In response to this operation, the CPU 110 generates data for the panoramic image PIm that includes the entire posting location from the left edge to the right edge. The generated data is, for example, RGB image data, similar to the normal shooting image PI.

[0084] In S315, CPU 110 executes actual dimension measurement processing to measure the actual dimensions of the subject in panoramic photographed image PIm. Specifically, CPU 110 generates three-dimensional data of the subject using three-dimensional scanner 170 in parallel with generating panoramic photographed image PIm. CPU 110 uses the three-dimensional data to measure the actual dimensions of a characteristic portion near the center of panoramic photographed image PIm. For example, as shown in FIG. 9(A), the actual vertical dimension Lrm of the bulletin board is measured.

[0085] In S320, the CPU 110 displays a first operation screen W22 including the panoramic photographed image PIm on the display unit 140. The first operation screen W22 of Fig. 9(B) includes a message MS7 prompting the user to specify a posting area in which to post a notice within the panoramic photographed image PIm. The panoramic photographed image PIm generated in S310 is displayed on the first operation screen W22.

[0086] In S325, the CPU 110 determines an image layout area CAm within the panoramic photographed image PIm based on the user's designated position. For example, as shown in FIG. 9(B), the user designates a rectangular area by tapping the positions of the upper right vertex and the lower left vertex in the panoramic photographed image PIm. The CPU 110 determines the designated rectangular area as the image layout area CAm.

[0087] In S330, the CPU 110 displays a second operation screen W23 for image arrangement on the display unit 140, instead of the first operation screen W22. The second operation screen W23 is an operation screen for arranging multiple target images IM5 to IM10 in the image arrangement area CAm. The second operation screen W23 of FIG. 6(C) includes a message MS8 prompting the user to arrange the target images, the image arrangement area CAm, a lower area UA located below the image arrangement area CAm, and a confirmation button BTg. In the initial state, the multiple target images IM5 to IM10 are arranged in the lower area UA, but not in the image arrangement area CAm (FIG. 6(C)).

[0088] In S335, the CPU 110 arranges multiple target images IM5 to IM10 in the image arrangement area CAm in response to a user operation. The user touches a target image arranged in the lower area UA with a finger, moves the finger to a desired position within the image arrangement area CAm without releasing the finger, and then releases the finger (a so-called drag operation). In response to this operation, the CPU 110 moves the display position of the target image on the second operation screen W23 from the lower area UA to the image arrangement area CAm. By performing these operations for each of the target images to be printed, the user can move multiple target images IM5 to IM10 to desired positions within the image arrangement area CAm. In the example of FIG. 6(C), two target images IM5 and IM10 have been moved to the image arrangement area CAm. Finally, all of the target images IM5 to IM10 to be printed are moved to the image arrangement area CAm. Since the entire image arrangement area CAm in which all target images IM5 to IM10 to be printed are arranged is ultimately printed, the entire image arrangement area CAm in which target images IM5 to IM10 are arranged is also referred to as the print image PTm (FIG. 10(A)).

[0089] In S340, CPU 110 changes any one of the positions, sizes, and orientations of target images IM5 to IM10 in image arrangement area CAm based on the user's change instructions. As a result, any one of the positions, sizes, and orientations of target images IM5 to IM10 changes in real time in accordance with the user's change instructions in image arrangement area CAm of second operation screen W23 displayed on display unit 140. The operation of inputting these change instructions is the same as the operation of inputting change instructions for the size, position, and orientation of target image IM1 described in the first bulletin board creation process.

[0090] In S345, the CPU 110 determines whether or not a confirmation instruction for printing images including the target images IM5 to IM10 has been received from the user. When the confirmation button BTg is tapped on the second operation screen W23, the CPU 110 determines that a confirmation instruction has been received. When a confirmation instruction has not been received from the user (S345: NO), the CPU 110 returns to S340.

[0091] If a confirmation instruction is received from the user (S345: YES), the CPU 110 displays a confirmation screen W24 (FIG. 10B) including a composite image CIm on the display unit 140 in S350. For example, the CPU 110 arranges the target images IM5 to IM10 in an image arrangement area CAm (FIG. 9B) specified within the panoramic shot image PIm, and combines a print image PTm including the target images IM5 to IM10 with the panoramic shot image PIm. The print image PTm is a rectangular image of the same size as the image arrangement area CAm. In this way, the composite image CIm is generated. The target images IM5 to IM10 in the print image PTm are arranged at the positions, sizes, and orientations specified on the second operation screen W23 (for example, FIG. 10A).

[0092] The CPU 110 further composites the paper image MI around the print image PTm in the composite image CIm. For example, the CPU 110 converts the number of pixels in the vertical and horizontal directions of the print image PTm in the composite image CIm into dimensional values. For example, the CPU 110 calculates the relationship between the number of pixels on the composite image CIm and the dimensional values from the actual dimension Lrm (FIG. 9A) measured by the actual dimension measurement process of S315.

[0093] Based on this relationship, CPU 110 calculates the dimensions of print image PTm. CPU 110 then determines the optimum paper size and the optimum number of copies for printing print image PTm having the calculated dimensions. As in the first notice creation process, the optimum paper size is selected from among paper sizes available for printers 200A and 200B. In the second notice creation process, if the horizontal length of print image PTm is longer than the longitudinal length of A3 paper, roll paper (long paper) is selected.

[0094] For example, in the example of Figure 10(B), roll paper is selected because the horizontal length of the print image PTm is longer than the longitudinal length of A3 paper. With roll paper, the longitudinal length can be any length, so the number of prints is determined according to the length of the short side of the print image PTm (the vertical direction in Figure 10(B)). In other words, if the short side length of the print image PTm is less than the width of the roll paper, the number of prints is determined to be one, and if the short side length of the print image PTm is longer than the width of the roll paper, the number of prints is determined to be multiple. In the example of Figure 10(B), the number of prints is two.

[0095] The CPU 110 positions the paper image MIm, which indicates the outer edge of the paper, in the composite image CI so that the center of gravity of the print image PTm coincides with the center of gravity of the paper (or the overall center of gravity of the multiple sheets of paper if there are multiple sheets of paper). FIG. 10B shows a confirmation screen W24 displaying a composite image CIm obtained by combining the print image PTm, which includes target images IM5 to IM10, and the paper image MIm with the panoramic shot image PIm. In the example of FIG. 10B, a paper image MIm indicating two sheets of roll paper (long paper) is displayed. The paper image MIm includes an outer edge line OLm indicating the overall outer edge of the two sheets of roll paper, and a dividing line ILm indicating the boundary between the two sheets of roll paper and forming the print image PTm during printing. The paper image MIm also includes a paper number ONm assigned to the portion indicating each sheet of paper, and a margin image WSm indicating the margin that will be created when the print image PTm is printed on the paper.

[0096] The confirmation screen W24 further includes an arrow AR, a print button BTh, a return button BTi, a display settings button BTj, and a print settings button BTk. When the arrow AR is tapped, the screen including the composite image CIm scrolls to the right, and the right portion of the composite image CIm is displayed on the display unit 140. This allows the user to check the entire composite image CIm. The print button BTh is a button that allows the user to input a print instruction. The return button BTi is a button that allows the user to input a return instruction that causes the second operation screen W23 to be displayed again.

[0097] Like the display setting button BTc in the first posting creation process, the display setting button BTj is a button for inputting an instruction to display the display setting screen W13 (FIG. 6(A)) on the display unit 140. By inputting an instruction on the display setting screen W13, the user can switch between displaying margins and split display on the confirmation screen W24, just like in the first posting creation process.

[0098] Like the print setting button BTk in the first posting creation process, the print setting button BTk is a button for inputting an instruction to display the print setting screen W14 (FIG. 6(D)) on the display unit 140. By inputting an instruction on the print setting screen W14, the user can switch whether or not to include cutting guide images TMma and TMmb and guide characters TXm1 to TXm5 (described later) in the print image PTm when printing the print image PTm.

[0099] In S355, the CPU 110 determines whether a print instruction or a return instruction has been acquired. The CPU 110 determines that a print instruction has been acquired if the print button BTh has been tapped, and that a return instruction has been acquired if the return button BTi has been tapped.

[0100] If a return instruction is acquired (S355: YES), the CPU 110, in S360, displays again on the display unit 140 the second operation screen W23 (FIG. 10A) for image arrangement, which includes the composite image CIm. This allows the user to change the position, size, and orientation of the target images IM5 to IM10 in the print image PTm (image arrangement area CAm) by inputting a change instruction via the second operation screen W23. That is, when the user inputs a change instruction, the CPU 110, in S340, changes the position, size, and orientation of the target images IM5 to IM10 in the print image PTm (image arrangement area CAm) on the second operation screen W23 based on the change instruction. Note that even if the position, size, and orientation of the target images IM5 to IM10 in the print image PTm (image arrangement area CAm) are changed, the size and shape of the print image PTm (image arrangement area CAm) remain fixed and are not changed.

[0101] Thereafter, when the user taps the confirmation button BTg (S345: YES), the CPU 110, in S350, displays on the display unit 140 a confirmation screen W24 (FIG. 10B) including a composite image CIm into which the changed print image PTm has been combined. In the confirmation screen W24 that is displayed again, the positions, sizes, and orientations of the target images IM5 to IM10 in the print image PTm have been changed to reflect the changes made in S340. Meanwhile, in the confirmation screen W24 that is displayed again, the paper image MIm has not been changed and is the same as the paper image MIm in the confirmation screen W24 that was previously displayed. In other words, in the composite image CIm in the confirmation screen W24, even if the positions, sizes, and orientations of the target images IM5 to IM10 have been changed based on the user's change instructions, the paper image MIm has not been changed.

[0102] If a print instruction is received in S355 (S355: YES), the CPU 110 determines the print image and print settings based on the composite image CIm currently displayed on the confirmation screen W24 of the display unit 140 in S365. Specifically, the dimensions of the print image PTm to be printed are determined based on the number of pixels in the vertical and horizontal directions of the print image PTm in the composite image CIm. The print image PTm in the composite image CIm, i.e., the image within the image layout area CAm in which the target images IM5 to IM10 are arranged according to the user's instructions, is determined as the print image. Furthermore, settings such as margins and image division are determined so that the positional relationship between the print image PTm and the paper image MIm in the composite image CIm is the same as the positional relationship between the print image PTm and the paper that will actually be printed. Furthermore, auxiliary images (images such as printer's marks and glue margins) described below are added to the print image. Once the print image and print settings are determined, the second bulletin board creation process is terminated.

[0103] Next, an example of a print image printed on paper when the second bulletin board creation process is performed will be described. FIG. 11 is a diagram showing an example of a printed paper when the second bulletin board creation process is executed. The example in FIG. 11 shows a printed paper created when the print button BTh is tapped with the confirmation screen W24 in the state shown in FIG. 10(D). In this case, the print image PTm is divided into two and printed on two sheets of paper. For this reason, an upper printed paper PPma and a lower printed paper PPmb are created. An upper image UP is printed on the upper printed paper PPma, and a lower image DP is printed on the lower printed paper PPmb.

[0104] The upper image UP includes an upper partial image PTma, an upper cutting guide image TMma, and guide characters TXm1 to TXm3. The upper partial image PTma is the upper of two partial images obtained by dividing the print image PTm into two. A bottom edge region STm is provided below the upper partial image PTma. The bottom edge region STm is a blank area to be used as an overlapping margin.

[0105] The upper cutting guide image TMma is a guide image to be referred to when cutting the margins of the upper printed paper PPma when creating a notice. The upper cutting guide image TMma includes cutting lines CLma provided along the upper and left and right edges of the upper partial image PTma.

[0106] Guide characters TXm1 to TXm3 are guide images to be referred to when creating a notice by pasting together multiple printed sheets (for example, upper printed sheet PPma and lower printed sheet PPmb). The guide characters include guide character TXm1 indicating the overlap margin, guide character TXm2 indicating sheet number ONm, and guide character TXm3 indicating the position where upper printed sheet PPma should be placed on the notice.

[0107] The lower image DP includes a lower partial image PTmb, a lower cutting guide image TMmb, and guide characters TXm4 and TXm5. The lower partial image PTmb is the lower of two partial images obtained by dividing the print image PTm into two. No margin is provided above the lower partial image PTmb. Margins are provided below and on the left and right sides of the lower partial image PTmb, similar to those of the upper partial image PTma. In other words, the top edge UTm of the lower partial image PTmb is printed using so-called borderless printing, and the other three edges of the lower partial image PTmb are printed using so-called bordered printing.

[0108] The lower cutting guide image TMmb is a guide image to be referred to when cutting the margins of the upper printed paper PPma when creating a notice. The lower cutting guide image TMmb includes cutting lines CLmb provided along the lower and left and right edges of the lower partial image PTmb.

[0109] Like the above-mentioned guide characters TXm1 to TXm3, the guide characters TXm4 and TXm5 are guide images to be referred to when creating a notice by pasting together multiple printed sheets of paper. The guide characters include a guide character TXm4 indicating the paper number ON and a guide character TXm5 indicating the position where the upper printed sheet PPma should be placed on the notice.

[0110] The upper image UP and lower image DP in Fig. 11 are images that are printed when the print setting screen W14 in Fig. 6(D) is set to print the cutting guide image and the guide characters. When the print setting screen W14 in Fig. 6(D) is set to not print the cutting guide image, the upper cutting guide image TMma and the lower cutting guide image TMmb are not printed. When the print setting screen W14 in Fig. 6(D) is set to not print the guide characters, the guide characters TXm1 to TXm5 are not printed.

[0111] According to the present embodiment described above, the CPU 110 of the terminal device 100 determines one or more target images based on a user instruction (S110 in FIG. 2). The CPU 110 controls the camera 160 based on the user instruction to generate a photographed image PI or a panoramic photographed image PIm (S210 in FIG. 4, S310 in FIG. 8). The CPU 110 displays the photographed image PI or the panoramic photographed image PIm on the display unit 140 (S220 in FIG. 4, S320 in FIG. 8). The CPU 110 determines image arrangement areas CA, CAm within the photographed image PI or the panoramic photographed image PIm based on the user instruction (S225 in FIG. 4, S325 in FIG. 8). The CPU 110 displays composite images CI, CIm obtained by combining one or more target images (e.g., IM1 or IM5 to IM10) with the paper images MI, MIm for the photographed image PI or the panoramic photographed image PIm on the display unit 140 (S230 in FIG. 4, FIGS. 5B-5D, S350 in FIG. 8, and FIG. 10B). The CPU 110 outputs a print job for printing print images PT, PTm, which include one or more target images, on paper (S150, S160 in FIG. 2). This print job includes print settings according to the positions and sizes of the one or more target images in the composite images CI, CIm and the paper images MI, MIm (S270 in FIG. 4, S365 in FIG. 8).

[0112] Then, when CPU 110 receives a modification instruction from the user after displaying composite images CI and CIm on display unit 140 and before the print job is output (in other words, before a print instruction is received), CPU 110 executes modification processing (S255 in FIG. 4, S340 and S350 in FIG. 8) to modify the position or size of one or more target images in composite images CI and CIm based on the modification instruction. CPU 110 then outputs the print job based on composite images CI and CIm after these modification processing (S370 in FIG. 4, S365 in FIG. 8, S150 and S160 in FIG. 2).

[0113] In the change process, if the number of target images is one (YES in S120 of FIG. 2), that is, if the first message creation process is executed, CPU 110 changes the size of paper image MI from a first size (e.g., A4 size) to a second size (e.g., A3 size or the size of two A3 sheets) larger than the first size in response to changing the size of target image IM1 to a size larger than the reference size (e.g., the upper limit size printable on A4 paper) (S255, S260 of FIG. 4, FIGS. 5B, and 5C). If the number of target images is two or more (NO in S120 of FIG. 2), that is, if the second message creation process is executed, CPU 110 does not change the size of paper image MI in response to changing the sizes of target images IM5 to IM10 (S340 of FIG. 8). As a result, composite images CI and CIm corresponding to the type of message to be created are displayed, thereby reducing the burden on the user of printing images on paper to create a message.

[0114] This will be explained in more detail. When creating a notice using one target image (e.g., IM1), the target image itself is often the print image, so it is likely that the size of the paper to be used will need to be changed depending on the size of the target image. For example, since the size of the print image PT is determined by the size of the target image IM1, it is important to appropriately determine the size of the target image depending on the posting location. Therefore, in this case, if the size of the target image IM1 is increased, it is preferable to also increase the overall size of the print image PT and, if necessary, the paper size (e.g., A4 size, A3 size, or the size of two A3 sheets). For this reason, in this embodiment, when creating a notice using one target image (e.g., IM1), the size of the paper image MI is also changed in the operation screen W12 depending on the size of the target image. This makes it easy for the user to create the desired notice based on one target image while imagining what the notice with the target image printed on it will look like when posted in the posting location and how the target image will be printed on paper. Therefore, for example, it is possible to prevent unnecessary work such as having to print again because the size of the printed notice does not match the size of the notice placement.

[0115] On the other hand, when creating a notice using multiple target images (e.g., IM5 to IM10), the notice is likely to be created by arranging the multiple target images within an area of a predetermined size (e.g., the image layout area CAm in FIG. 9B) according to the posting location. In this case, the area of the predetermined size becomes the print image, and it is important to determine the position, size, and orientation of each target image within the area of the predetermined size. Even if the size of each target image is changed, the overall size of the print image is likely to remain unchanged. Therefore, in this case, it is preferable to determine the image layout area CAm in advance according to the posting location, fix the image layout area CAm, and then determine the layout of each target image. For this reason, in this embodiment, when creating a notice using multiple target images (e.g., IM5 to IM10), the size of the image layout area CAm (print image PTm) and the size of the paper image MIm are not changed even if the size of each target image is changed on the second operation screen W23 and the confirmation screen W24. This allows the user to easily create the desired poster based on multiple target images while imagining how the multiple target images will be arranged in the image arrangement area CAm (printed image PTm) corresponding to the posting location, and imagining how they will appear when posted in the posting location.

[0116] Furthermore, according to this embodiment, when the size of the print images PT, PTm containing one or more target images is larger than the size that can be printed on a single sheet of paper, the CPU 110 displays on the display unit 140 on the operation screen W12 or the confirmation screen W24 composite images CI, CIm including division lines IL, ILm that divide the print images PT, PTm into n partial images (n is an integer greater than or equal to 2) (FIGS. 5(D) and 10(B)). The CPU 110 outputs a print job for dividing the print images PT, PTm into n partial images and printing them on n sheets of paper (FIGS. 7 and 11). As a result, even when the size of the print images PT, PTm is larger than the size that can be printed on a single sheet of paper, the print job can be output so that the print images PT, PTm are divided and printed. Furthermore, by viewing the composite images CI, CIm, the user can create a notice while imagining the print images PT, PTm divided and printed. For example, the user can improve the appearance of the notice by arranging important target images so as to avoid the dividing lines IL and ILm.

[0117] Furthermore, according to this embodiment, the composite images CI and CIm further include paper numbers ON and ONm, which indicate the order in which the n partial images will be printed on the n sheets of paper. As a result, the user can easily understand the order in which the n partial images will be printed, and thus the placement position (top, bottom, etc.) of each printed sheet PPa, PPb, PPma, and PPmb on a notice. Therefore, it is easy to create a notice using these printed sheets.

[0118] Furthermore, according to this embodiment, the CPU 110 switches whether or not to display dividing lines IL, ILm in the composite images CI, CIm based on a user instruction (FIGS. 6A to 6C). The dividing lines IL, ILm make it easier to visualize the print images PT, PTm divided and printed, but they can also make the composite images CI, CIm cumbersome and hinder the user from understanding the arrangement of the target images, etc. As such, to make it easier to change the arrangement of the target images in the print images PT, PTm, it may be better to display the dividing lines IL, ILm in the composite images CI, CIm, but it may also be better not to display them. According to this embodiment, whether or not to display the dividing lines IL, ILm can be switched based on a user instruction, which is convenient for the user.

[0119] Furthermore, according to this embodiment, the CPU 110 switches whether or not to display margin images WS, WSm, which indicate the margins of the paper, in the composite image CI based on a user instruction (FIGS. 6B to 6D). The margin images WS, WSm make it easier to visualize the state in which the print images PT, PTm are printed on the paper, but the composite images CI, CIm may become cumbersome and may interfere with the user's understanding of the arrangement of the target image, etc. For this reason, like the division lines IL, ILm, there are cases in which it is better for the margin images WS, WSm to be displayed in the composite images CI, CIm, and cases in which it is better not to display them. According to this embodiment, whether or not to display the margin images WS, WSm can be switched based on a user instruction, which is convenient for the user.

[0120] Furthermore, according to this embodiment, the print job prints guide images (e.g., cutting guide images and guide characters) on the printed sheets PPa, PPb, PPma, and PPmb, allowing the user to easily create notices by referring to these guide images.

[0121] Specifically, the guide image includes cutting lines CLa, CLb, CLma, and CLmb, which are images that indicate the edges of each partial image (e.g., IM1a and IM1b). As a result, the user can easily perform appropriate trimming by referring to the cutting lines. The guide image also includes guide characters TX1 and TXm1 that indicate the area where multiple sheets of printed paper overlap when combining them (so-called overlapping margins). As a result, the user can easily combine multiple printed sheets of paper (e.g., PPa and PPb, or PPma and PPmb) by referring to the guide characters TX1 and TXm1.

[0122] Furthermore, according to this embodiment, the guide image includes guide characters TX3, TX5, TXm3, and TXm5 that indicate the position (e.g., upper side, lower side) where each printed sheet should be placed in a notice obtained by combining multiple sheets of paper. As a result, the user can refer to the guide characters TX3, TX5, TXm3, and TXm5 to appropriately place multiple printed sheets of paper and easily create a notice.

[0123] Furthermore, according to this embodiment, the guide image includes guide characters TX2, TX4, TXm2, and TXm5 indicating the paper numbers ON and ONm. As a result, the user can easily understand the arrangement of multiple printed sheets in a notice by referring to the paper numbers ON and ONm displayed on the operation screen W12 and the confirmation screen W24 and the guide characters TX2, TX4, TXm2, and TXm5 printed on the sheets. As a result, the user can appropriately arrange multiple printed sheets and easily create a notice.

[0124] C. Variations (1) The first notice creation process (FIG. 4) and the second notice creation process (FIG. 8) in the above embodiment are merely examples and may be modified as appropriate. For example, in the actual dimension measurement process of S215 in FIG. 4 and S315 in FIG. 8, the actual dimensions are measured using the three-dimensional scanner 170, but other methods may be used to measure the actual dimensions. For example, a user may attach a piece of paper of a predetermined size (e.g., a standard size such as A4 or a postcard, or a dedicated card for measurement) to a notice location and then capture a photographed image PI or a panoramic photographed image PIm. The CPU 110 may analyze the photographed image PI or the panoramic photographed image PIm to detect the paper of the predetermined size and obtain the relationship between the number of pixels of the photographed image PI or the panoramic photographed image PIm and the actual dimensions.

[0125] (2) Furthermore, the display mode of the paper images MI, MIm in the composite images CI, CIm may be various modes. For example, the paper images MI, MIm may be displayed with the margins as semi-transparent regions, i.e., regions through which the background captured images PI, PIm can be seen. Furthermore, the display of the paper numbers ON, ONm and dividing lines IL, ILm of the paper images MI, MI may be omitted as appropriate. Furthermore, instead of being configured to be switchable between multiple display modes (e.g., modes with and without dividing lines IL, ILm, modes with and without margin images WS, WSm) as in the embodiment, the paper images MI, MIm may be fixed to one of the display modes.

[0126] (3) The first notice creation process of the above embodiment does not have to correspond to the aspect of dividing the target image and printing it on multiple sheets of paper. For example, in the first notice creation process, CPU 110 may select one sheet of paper of any of B5, B4, A4, A3, or long paper, display the paper image MI of that sheet in composite image CI, and always output a print job to print the target image on one sheet of paper.

[0127] (4) In the second notice creation process of the above embodiment, roll paper is selected as the paper, but cut paper may also be selected as the paper in the second notice creation process. In the first notice creation process, cut paper is selected as the paper, but roll paper may also be selected as the paper in the second notice creation process.

[0128] (5) In the second posting creation process of the above embodiment, the target image can be placed on the dividing line ILm (FIG. 10(B)), but the CPU 110 may prohibit the target image from being placed on the dividing line ILm (FIG. 10(B)). Alternatively, the CPU 110 may display a warning when the target image is placed on the dividing line ILm (FIG. 10(B)).

[0129] (6) In the second posting creation process of the above embodiment, the second operation screen W23 for inputting instructions to change the size of the target image, etc., and the confirmation screen W24 for displaying the composite image CIm obtained by combining the print image PTm including the target image with the panoramic captured image PIm are separate screens. Alternatively, the confirmation screen W24 may be configured to allow input of instructions to change the size of the target image, etc.

[0130] (7) In the above embodiment, paper is used as the print medium. Instead, other print media, such as resin film or fabric, may be used.

[0131] (8) Terminal device 100 as the image processing device that executes the image processing of FIG. 2 may be a type of device different from a smartphone, for example, a personal computer connected to a digital camera. In this case, for example, steps S205 to S215 of the first notice creation process (FIG. 4) and steps S305 to S315 of the second notice creation process (FIG. 8) among the image processing are executed by the digital camera, and the captured image PI, the panoramic captured image PIm, and data from the actual dimension measurement process are transmitted to the personal computer. The other steps of the image processing are executed by the personal computer. In this case, the digital camera and the personal computer together are an example of an image processing device.

[0132] (9) Part of the image processing in FIG. 2 may be executed by a server (e.g., a cloud server) connected to terminal device 100 via the Internet. In this case, for example, steps S205 to S215 of the first notice creation process (FIG. 4) and steps S305 to S315 of the second notice creation process (FIG. 8) among the image processing are executed by terminal device 100, and the captured image PI, the panoramic captured image PIm, and data from the actual dimension measurement process are transmitted to the cloud server. The other steps of the image processing are executed by the cloud server. The cloud server may transmit the generated print job to terminal device 100, or may transmit it directly to printers 200A and 200B. In this case, the entirety of terminal device 100 and the cloud server is an example of an image processing device.

[0133] (10) In each of the above embodiments, a part of the configuration realized by hardware may be replaced by software, and conversely, a part or all of the configuration realized by software may be replaced by hardware. For example, a part of the processing executed by CPU 110 of terminal device 100 in FIG. 1 may be realized by a dedicated hardware circuit.

[0134] The present invention has been described above based on examples and modifications, but the above-described embodiments of the invention are intended to facilitate understanding of the present invention and are not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit and scope of the claims, and equivalents thereof are also included in the present invention. [Explanation of symbols]

[0135] 100... terminal device, 1000... system, 110... CPU, 120... volatile storage device, 130... non-volatile storage device, 140... display unit, 150... operation unit, 160... camera, 170... three-dimensional scanner, 180... communication IF, 200A, 200B... printer, 210... CPU, 220... volatile storage device, 230... non-volatile storage device, 240... display unit, 250... operation unit, 270... printing mechanism, 280... communication IF, AP... access point, PGa... application program, PGc... control program, PGp... computer program, PRI... printer information, W1... image selection screen, W11... shooting screen, W12... operation screen, W13... display setting screen, W14... print setting screen, W21... panoramic shooting screen, W22... first operation screen, W23... second operation screen, W24... confirmation screen

Claims

1. An image processing device for printing an image on a print medium to create a notice, a camera that generates an image using an image sensor; a display unit for displaying an image; an operation unit that acquires instructions from a user; A control unit; Equipped with The control unit an image determination process for determining one or more target images based on an instruction from the user; a photographing process for controlling the camera based on an instruction from the user to generate a photographed image; a display process for displaying the captured image on the display unit; an area determination process for determining a target area in the captured image to be displayed on the display unit based on an instruction from the user; a composite display process for displaying a composite image obtained by combining the one or more target images and a print medium image on the display unit with respect to the captured image, wherein the one or more target images are arranged in the target area within the captured image, and the print medium image is an image showing the print medium for printing a print image including the one or more target images; an output process for outputting a print job for printing a print image including the one or more target images on the print medium, the print job including print settings according to positions and sizes of the one or more target images and the print medium image in the composite image; Run The control unit When a change instruction is obtained from the user after the composite image is displayed on the display unit in the composite display process and before the output process, executes a modification process for modifying a position or a size of the one or more target images in the composite image displayed on the display unit based on the modification instruction; performing the output process based on the composite image after the change process; In the change processing, the control unit When the number of the target images is one, the size of the print medium image is changed from a first size to a second size larger than the first size in response to changing the size of the target image to a size larger than a reference size; When the number of the target images is two or more, the image processing device does not change the size of the print medium image in response to changing the size of the target images.

2. 2. The image processing device according to claim 1, The control unit When the size of the print image including the one or more target images is larger than the size that can be printed on one of the printing media, In the composite display process, the composite image including a dividing line dividing the print image into n partial images (n is an integer of 2 or more) is displayed on the display unit; In the output process, the image processing device divides the print image into n partial images and outputs a print job for printing onto the n print media.

3. 3. The image processing device according to claim 2, The image processing apparatus, wherein the composite image further includes an image indicating an order in which the n partial images will be printed on the n printing media.

4. 3. The image processing device according to claim 2, The control unit switches whether or not to display the dividing line in the composite image based on an instruction from the user in the composite display process.

5. 2. The image processing device according to claim 1, The control unit switches whether or not to display the margins of the print medium in the composite display process based on an instruction from the user.

6. 3. The image processing device according to claim 2, The print job causes a guide image to be printed on at least one of the n print media, The guide image is an image showing information that the user should refer to when creating a notice using n pieces of the print-receiving media that have already been printed.

7. 7. The image processing device according to claim 6, An image processing device wherein the guide image includes at least one of an image showing the edge of the partial image and an image showing the area where two or more of the printing media overlap when combining n printed printing media.

8. 7. The image processing device according to claim 6, An image processing device, wherein the guide image includes an image indicating the position at which each of the printed print media is to be placed in a notice obtained by combining n printed print media.

9. A computer program for printing an image on a print medium to create a notice, an image determination function for determining one or more target images based on a user's instruction; a photographing function that controls a camera having an image sensor to generate a photographed image based on an instruction from the user; a display function for displaying the captured image on a display unit; an area determination function that determines a target area in the captured image to be displayed on the display unit based on an instruction from the user; a composite display function for displaying on the display unit a composite image obtained by combining the one or more target images and a print medium image with respect to the captured image, the one or more target images being arranged in the target area within the captured image, and the print medium image being an image showing the print medium for printing a print image including the one or more target images; an output function that outputs a print job for printing a print image including the one or more target images on the print medium, the print job including print settings according to the positions and sizes of the one or more target images and the print medium image in the composite image; This is realized on a computer, When a change instruction is obtained from the user after the composite image is displayed on the display unit and before the print job is output, the composite display function executes a change process to change a position or a size of the one or more target images in the composite image displayed on the display unit based on the change instruction; the output function outputs the print job based on the composite image after the change processing; In the change process, the composite display function When the number of the target images is one, the size of the print medium image is changed from a first size to a second size larger than the first size in response to changing the size of the target image to a size larger than a reference size; When the number of the target images is two or more, the image processing device does not change the size of the print medium image in response to changing the size of the target images.

10. An image processing system for printing an image on a print medium to create a notice, a terminal device including a camera that generates an image using an image sensor, a display unit that displays the image, and an operation unit that acquires instructions from a user; a printing device; Equipped with an image determination process for determining one or more target images based on an instruction from the user; a photographing process for controlling the camera based on an instruction from the user to generate a photographed image; a display process for displaying the captured image on the display unit; an area determination process for determining a target area in the captured image to be displayed on the display unit based on an instruction from the user; a composite display process for displaying a composite image obtained by combining the one or more target images and a print medium image on the display unit with respect to the captured image, wherein the one or more target images are arranged in the target area within the captured image, and the print medium image is an image showing the print medium for printing a print image including the one or more target images; a printing process for printing a print image including the one or more target images onto the print medium using the printing device, the printing process being executed according to print settings according to the positions and sizes of the one or more target images and the print medium image in the composite image; Run When a change instruction is obtained from the user after the composite image is displayed on the display unit in the composite display process and before the printing process, executes a modification process for modifying a position or a size of the one or more target images in the composite image displayed on the display unit based on the modification instruction; execute the printing process in accordance with the print settings based on the composite image after the change process; In the change process, When the number of the target images is one, the size of the print medium image is changed from a first size to a second size larger than the first size in response to changing the size of the target image to a size larger than a reference size; When the number of the target images is two or more, the image processing system does not change the size of the print medium image in response to changing the size of the target images.

Images