Program, information processing apparatus, and image printing system

Abstract

To provide a mechanism capable of adjusting the size of a drawn image to the size of an object to which the drawn image is pasted.SOLUTION: A program through which a CPU 101 of a mobile terminal 100 causes the mobile terminal 100 to create a drawn image on a canvas in response to a user operation, acquire a photographed image in which a fan is photographed, display together with the drawn image a photographed image whose size is multiplied according to the length of the photographed image related to the fan and the size of the canvas, adjust the size of the drawn image displayed together with the photographed image whose size is multiplied in response to a user operation, generate print data containing at least data about the drawn image whose size is adjusted, and transmit the generated print data to a printer 200.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing device, and an image printing system. [Background technology]

[0002] As part of activities such as admiring and supporting one's favorite idols, actors, characters, etc. (hereinafter referred to as "oshikatsu"), people have been printing images at home or elsewhere using printing devices to be pasted onto irregular objects such as fans or masks. As a related technique, for example, Patent Document 1 discloses a technique for printing by combining image data contained in a print job received by an image processing device with image data scanned and read by the image processing device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-033635 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when printing a drawn image intended to be attached to an object, the drawn image needs to be printed to fit the size of the object. However, if the object is atypical, it can be difficult to print the drawn image to fit the size of the object. A conventional example of such a case will be specifically described below using FIG. 8. FIG. 8 is a diagram showing an example of a scene in which a drawn image printed on recording paper is attached to a fan as part of a fan-making activity. As shown in FIG. 8, first, in state ST800, a user creates a drawn image using an image creation application on a mobile terminal 800. Note that a drawn image refers to an image created by drawing characters, lines, shapes, etc., or by compositing images.

[0005] Then, when the drawn image is complete, the user issues a print instruction from the image creation application. As a result, the drawn image created by the image creation application is input as a print job to a printing device (described below). In state ST801, the printing device 801 prints the drawn image on recording paper such as A4 size in accordance with the received print job. In state ST802, the user cuts out the portion of the recording paper that contains the drawn image using scissors or the like to fit the shape of the fan 802, and pastes the cut portion of the recording paper that contains the drawn image onto the fan 802. In this way, the fan 802 is completed, with the drawn image pasted on it that the user likes.

[0006] However, with this procedure, the size of the drawn image created by the image creation application on the mobile terminal 800 does not match the size of the non-standard fan 802, and the finished product often does not turn out as expected by the user. In such cases, the user must adjust the size of the drawn image using the image creation application on the mobile terminal 800 and then reprint it using the printing device 801. In other words, the size of the printed drawn image and the object often do not match, and in such cases the user must check the size by matching the test print of the drawn image with the actual object, then return to the image creation application, adjust the size of the drawn image, and print again. Furthermore, in the case of supporters' activities, expensive recording paper is often used to create beautiful cheering goods, so printing failures such as those described above may result in additional costs for the user.

[0007] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide a mechanism that can adjust the size of a drawn image to the size of an object onto which the drawn image is pasted. [Means for solving the problem]

[0008] In order to achieve the above object, the program of the present invention is characterized in that it causes a computer of an information processing device to create a drawing image on a canvas in response to user operation, cause the information processing device to acquire a photographed image of an object, cause the information processing device to display the photographed image, the size of which has been changed in response to the length of the object in the photographed image and the size of the canvas, together with the drawing image, cause the information processing device to adjust the size of the drawing image displayed together with the photographed image, the size of which has been changed, in response to user operation, cause the information processing device to generate print data including at least data on the drawing image whose size has been adjusted, and cause the information processing device to send the generated print data to a printing device. [Effects of the Invention]

[0009] According to the present invention, the size of a drawn image can be adjusted to the size of an object onto which the drawn image is pasted. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 2 is a block diagram showing an example of a hardware configuration of a mobile terminal that is an information processing device. [Figure 2] FIG. 2 illustrates an example of a hardware configuration of a printing apparatus. [Figure 3] FIG. 10 is a diagram showing an example of a scene in which a drawn image printed on recording paper is pasted onto a fan as part of the "oshikatsu" activity. [Figure 4] 4 is a flowchart showing the flow of operation of an image creation application in the example scene shown in FIG. 3. [Figure 5] 4 is a flowchart showing the flow of operation of a camera application in the example scene shown in FIG. 3. [Figure 6] 10A and 10B are diagrams showing examples of screens displayed on an operation unit of a mobile terminal, including an example of a screen on which a captured image is displayed and an example of a screen for manually inputting length information. [Figure 7]FIG. 10 is a diagram showing an example of a screen on which a setting is made as to whether or not to print a captured image. [Figure 8] FIG. 10 is a diagram showing an example of a conventional example in which a drawn image printed on recording paper is pasted onto a fan as part of a fan activity. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments. Therefore, not all combinations of features described in the embodiments are necessarily essential to the solution of the invention. Furthermore, for example, each component constituting the present invention can be replaced with any configuration that can perform the same function. Furthermore, any component may be added. Furthermore, any two or more configurations (features) of the present embodiments can be combined.

[0012] This embodiment will be described below with reference to FIGS. 1 to 8. FIG. 1 is a block diagram showing an example of the hardware configuration of an information processing device. As shown in FIG. 1, this embodiment takes a mobile terminal 100, such as a smartphone, as an example of the information processing device. The mobile terminal 100 includes a CPU 101, an eMMC 102, a DRAM 103, a camera unit 104, an operation unit 105, a communication unit 106, and a data bus 107. The CPU 101 is a system control unit that controls the entire mobile terminal 100. The eMMC 102 is configured with flash memory and is used to store a control program for the CPU 101. Furthermore, the eMMC 102 stores a plurality of applications that run on the mobile terminal 100. Therefore, an image creation application 108 and a camera application 109 used in this embodiment are stored in the eMMC 102.

[0013] DRAM 103 is a volatile memory that can temporarily store image data processed by CPU 101, parts of programs, and the like. Camera unit 104 is a capture unit used for capturing images using camera application 109. Operation unit 105 is an interface unit with the user, consisting of a touch panel and a display such as an LCD that displays information within mobile terminal 100. Communication unit 106 is an interface unit between mobile terminal 100 and an external communication network. Mobile terminal 100 communicates with a printing device (200 in FIG. 2 ), which will be described later, via communication unit 106. CPU 101, eMMC 102, DRAM 103, camera unit 104, operation unit 105, and communication unit 106 are connected to each other via data bus 107. Note that mobile terminal 100 is not limited to a smartphone and may be, for example, a tablet terminal, a digital camera, a notebook PC, or the like.

[0014] FIG. 2 is a diagram showing an example of the hardware configuration of the printing device 200. The printing device 200 has a CPU 201, an eMMC 202, a DRAM 203, a storage device 204, an operation unit 205, a recording unit 206, an image processing unit 207, a communication unit 208, and a data bus 209. The CPU 201 is a system control unit that controls the entire printing device 200. The eMMC 202 is configured as a flash memory and is used to store the control program for the CPU 201. The DRAM 203 is a volatile memory that can temporarily store image data processed by the CPU 201. Furthermore, the DRAM 203 stores program control variables and the like.

[0015] The storage device 204 is a storage device such as an HDD device, and is a non-volatile memory that stores image data and the like. Data constituting the printed matter is stored in the storage device 204. The operation unit 205 is an interface unit with the user, consisting of a touch panel and a display such as an LCD that displays information from the printing device 200. The recording unit 206 is a device that prints the print data on recording paper. The recording unit 206 applies toner to the recording paper. The recording unit 206 further applies pressure to the recording paper with the toner applied using a heated fixing device, thereby fixing the toner to the recording paper.

[0016] The image processing unit 207 synthesizes and renders image data to be printed, and further performs encoding and decoding of the binary image data. The communication unit 208 is an interface between the printing device 200 and an external communication network. The printing device 200 communicates with the mobile terminal 100 via the communication unit 208. The CPU 201, eMMC 202, DRAM 203, storage device 204, operation unit 205, recording unit 206, image processing unit 207, and communication unit 208 are connected to each other via a data bus 209. Note that the printing device 200 configures an image printing system 210 by connecting to the mobile terminal 100 via the communication unit 208.

[0017] 3 is a diagram showing an example of a scene in this embodiment in which a drawn image printed on recording paper is pasted onto a fan as part of a support activity. First, in state ST300, the user starts up image creation application 108 on mobile terminal 100. Furthermore, in state ST300, image creation application 108 displays on operation unit 105 on mobile terminal 100 a screen for setting the size of a canvas for creating a drawn image. In this embodiment, it is assumed that A4 portrait size is selected by user operation.

[0018] In state ST301, the image creation application 108 accepts a user operation on the operation unit 105 of the mobile terminal 100 for the purpose of creating a drawn image. In response to the accepted user operation, the image creation application 108 displays and creates a drawn image on the canvas of the operation unit 105 of the mobile terminal 100. The image creation application 108 creates a drawn image to the user's liking by cutting and combining images captured by the mobile terminal 100 or downloaded images, drawing text, lines, shapes, and the like, and arranging objects. Furthermore, in state ST301, the image creation application 108 accepts input from the camera button 300 displayed on the operation unit 105 of the mobile terminal 100. When the user taps the camera button 300 upon completion of the drawn image, for example, the image creation application 108 instructs the mobile terminal 100 to switch application operation. As a result, the camera application 109 is launched on the mobile terminal 100.

[0019] In State ST302, the camera application 109 accepts a user operation and captures a photograph of the fan with the camera unit 104, thereby acquiring a photographed image of the fan. At this time, if the camera application 109 has a length measurement function, it accepts two point specifications 301 by the user's operation and measures the length of the fan. The length measurement function will be described in detail later when explaining the flowchart in FIG. 5. Furthermore, in State ST302, when the camera application 109 finishes capturing images with the camera unit 104, it notifies the mobile terminal 100 that capturing has ended. As a result, the operation of the mobile terminal 100 returns from the camera application 109 to the image creation application 108.

[0020] In State ST303, the image creation application 108 displays the captured image of the fan and a print button 302 on the operation unit 105 of the mobile terminal 100. At this time, the image creation application 108 changes the magnification of the captured image of the fan so that the display magnification of the captured image of the fan is the same as the display magnification of the canvas, based on the size of the canvas set in State ST300 and the length of the fan measured in State ST302. Note that a specific explanation of the changed magnification display will be given later when explaining step S408 in FIG. 4. Furthermore, in State ST303, the image creation application 108 accepts a user operation to adjust the size of an object included in the created drawn image.

[0021] Specifically, image creation application 108 accepts user operation 303 of pinching in / out on an object included in the created drawn image on operation unit 105 of mobile terminal 100, and adjusts the size of the object. This allows the user to easily adjust the size of the object included in the drawn image created by image creation application 108 on operation unit 105 of mobile terminal 100 while referring to the size of the fan included in the captured image. Furthermore, on operation unit 105 of mobile terminal 100, the user moves the object of the drawn image whose size has been adjusted by an operation such as dragging, and superimposes it on the fan in the captured image.

[0022] In states ST303 and ST304, the image creation application 108 accepts input from the print button 302 on the operation unit 105 of the mobile terminal 100. When the user taps the print button 302, triggered by, for example, the completion of adjustment / movement, the image creation application 108 instructs the printing device 200 to print. In state ST305, the printing device 200 receives the print instruction and prints in the A4 portrait size set on the operation unit 105 of the mobile terminal 100. In state ST306, the user receives the A4-sized recording paper 304 output by the printing device 200. Note that the recording paper 304 received by the user has printed on it an object of the drawn image that was created by the image creation application 108 and further adjusted in size.

[0023] In state ST307, the user cuts out the object portion of the drawn image on recording paper 304 with scissors or the like to shape it to fit the shape of fan 305. Further in state ST307, the user pastes the object portion of the drawn image on recording paper 304 that has been shaped onto fan 305. In this way, fan 305 is completed, with the object of the drawn image pasted on it that the user likes. In general, by following these steps, the object of the drawn image is printed in the size that the user expected and that matches the size of fan 305.

[0024] Fig. 4 is a flowchart showing the flow of operation of image creation application 108 in the example of the scene shown in Fig. 3. Each step of the flowchart shown in Fig. 4 is realized by CPU 101 (computer) in mobile terminal 100 reading the program of image creation application 108 stored in eMMC 102 into DRAM 103 and executing it. In the flowchart shown in Fig. 4, first, in step S400, CPU 101 accepts a user operation on operation unit 105 and starts up image creation application 108.

[0025] In step S401, CPU 101 causes image creation application 108 to display a screen for setting the size of a canvas for creating a drawn image on operation unit 105, as shown in state ST300, for example. Furthermore, CPU 101 causes image creation application 108 to accept the setting of the canvas size by a user operation on operation unit 105. In this manner, the size of the canvas is set.

[0026] In step S402, CPU 101 accepts a user operation for creating a drawn image on operation unit 105 using image creation application 108. Then, CPU 101 (image creation means) uses image creation application 108 to create a drawn image (hereinafter simply referred to as a "drawn image") including objects synthesized and drawn on a canvas in accordance with the user operation accepted by operation unit 105. As a result, the drawn image is displayed on operation unit 105, for example, as shown in state ST301. Furthermore, in step S402, CPU 101 uses image creation application 108 to display camera button 300 on operation unit 105, for example, as shown in state ST301, and accepts input from camera button 300.

[0027] In step S403, CPU 101 receives an instruction to switch applications from image creation application 108 in response to an input on camera button 300 by a tap operation by the user. As a result, CPU 101 activates camera application 109. In step S404, CPU 101 (image acquisition means) acquires a captured image of an object (specifically, for example, the fan in state ST302) from camera application 109. At this time, if camera application 109 has a length measurement function, CPU 101 also acquires length information from camera application 109. Note that the length measurement function and length information will be described in detail when explaining the flowchart of FIG. 5 below. Furthermore, in step S404, CPU 101 receives an instruction to switch applications from camera application 109. As a result, CPU 101 switches the operation of the application from camera application 109 to image creation application 108.

[0028] In step S405, CPU 101 determines whether or not image creation application 108 has acquired length information from camera application 109. If CPU 101 determines that image creation application 108 has acquired length information from camera application 109, the process proceeds to step S406. On the other hand, if CPU 101 determines that image creation application 108 has not acquired length information from camera application 109, the process proceeds to step S407 via state ST602, which will be described later.

[0029] In step S406, CPU 101 determines whether adjustment is required for the length information acquired from camera application 109 by image creation application 108. At this time, CPU 101 causes image creation application 108 to, for example, display a screen on operation unit 105 that has buttons for the user to select one of two options, accepts input from the button, and determines whether adjustment is required based on the input result. The length information acquired from camera application 109 is adjusted because the length information may contain an error that exceeds the allowable range. If CPU 101 determines that adjustment is required for the length information acquired from camera application 109 by image creation application 108, the process proceeds to step S407. On the other hand, if CPU 101 determines that adjustment is not required for the length information acquired from camera application 109 by image creation application 108, the process proceeds to step S408.

[0030] In step S407, CPU 101 causes image creation application 108 to display the captured image on operation unit 105, and further displays a screen for manually inputting length information to accept input of the length information. In this manner, length information is acquired. In step S408, CPU 101 (display means) causes image creation application 108 to display the captured image acquired in step S404 on operation unit 105 together with the drawn image created in step S402, for example, as shown in state ST303. At this time, CPU 101 causes image creation application 108 to resize the captured image according to the canvas size set in step S401 and the length information acquired in step S404 or step S407, and display the resized image on operation unit 105.

[0031] Furthermore, CPU 101 causes image creation application 108 to resize the captured image so that the display magnification of the object in the captured image is the same as the display magnification of the canvas. Specifically, for example, assume that a canvas of 1240 x 1754 pixels is displayed on operation unit 105. Furthermore, assume that the size of the canvas is set to A4 portrait size in step S401. In this case, since A4 portrait size is 210 mm x 297 mm, one pixel on operation unit 105 displaying the canvas corresponds to a length of approximately 0.17 mm, which is calculated by dividing 210 mm by 1240 pixels. Therefore, if the length included in the length information acquired in step S404 or step S407 is 170 mm, the captured image is resized so that the length of 170 mm becomes 1000 pixels, which is calculated by dividing 170 mm by 0.17 mm, and is displayed on operation unit 105.

[0032] In step S409, CPU 101 (adjustment means) receives an instruction to enlarge or reduce the drawn image via a user operation on operation unit 105 using image creation application 108, and adjusts the size of the drawn image. At this time, the user adjusts the drawn image to a desired size by pinching in or out on the drawn image using operation unit 105 while referring to the size of the object in the captured image (specifically, for example, the fan in state ST303). Furthermore, the user moves the drawn image whose size has been adjusted by an operation such as dragging on operation unit 105, and overlays it on the object in the captured image (specifically, for example, the fan in state ST304). In this way, the print image is temporarily completed. Furthermore, in step S409, CPU 101 causes image creation application 108 to display print button 302 on operation unit 105 as shown in states ST303 and ST304, and accepts input from print button 302.

[0033] In step S410, CPU 101 instructs printing device 200 to print using image creation application 108 in response to input of print button 302 by a user tapping operation. In step S411, CPU 101 causes image creation application 108 to display, on operation unit 105, a screen on which a button is provided for the user to select whether or not to print an object in the captured image, and accepts input from the button. Furthermore, in step S411, CPU 101 (generation means) creates a final print image using image creation application 108 in response to the determination result of the accepted input, and generates print data for the final print image. Note that a detailed description of the final print image will be given later when explaining FIG. 8.

[0034] In step S412, CPU 101 (transmission means) transmits the print data to printing device 200 using image creation application 108. Thereafter, the flowchart shown in FIG. 4 ends. In this manner, the operation of image creation application 108 in the example of the scene shown in FIG. 3 is performed. Note that in printing device 200, CPU 201 causes recording unit 206 (printing means) to print the print data on recording paper 304, for example, as shown in state ST306. However, in the example shown in state ST306, the object in the captured image (specifically, for example, the fan in state ST304) is not printed on recording paper 304.

[0035] Fig. 5 is a flowchart showing the flow of operation of camera application 109 in the example of the scene shown in Fig. 3. Each step of the flowchart shown in Fig. 5 is realized by CPU 101 (computer) reading the program of camera application 109 stored in eMMC 102 into DRAM 103 and executing it in mobile terminal 100. In the flowchart shown in Fig. 5, first, in step S500, CPU 101 starts up camera application 109 in response to an instruction from image creation application 108 in step S403.

[0036] In step S501, CPU 101 receives a user operation on operation unit 105 via camera application 109 and photographs an object with camera unit 104. At this time, the user operates operation unit 105 so that the object onto which the drawn image is to be pasted (specifically, for example, the fan in state ST302) is photographed by camera unit 104. In this manner, the photographed image is acquired. In step S502, CPU 101 determines whether camera application 109 has a length measurement function. If CPU 101 determines that camera application 109 has the length measurement function, the process proceeds to step S503. On the other hand, if CPU 101 determines that camera application 109 does not have the length measurement function, the process proceeds to step S505.

[0037] In step S503, CPU 101 uses the length measurement function of camera application 109 to measure the length between two points on an object in the captured image and acquire length information including the measured value. The length measurement function is a function that, when a user specifies two points on an object detected by analyzing the captured image using operation unit 105, measures the length between the specified two points. Specifically, CPU 101 uses camera application 109 to accept two point specifications 301 entered by the user on operation unit 105, as shown in state ST302, for example. In this way, the user can specify the distance between two points that the length measurement function should measure in the captured image of the object to which the drawn image is to be pasted. Furthermore, CPU 101 uses the length measurement function of camera application 109 to measure the length between the two specified points. The length measurement function can detect an object by estimating the object from the captured image or by irradiating the object with a laser or the like to estimate the object from the distance obtained.

[0038] In step S504, CPU 101 causes camera application 109 to transmit the length information and the captured image to image creation application 108. Thereafter, the flowchart shown in Fig. 5 ends. In step S505, CPU 101 causes camera application 109 to transmit notification information indicating that there is no length information and the captured image to image creation application 108. Thereafter, the flowchart shown in Fig. 5 ends. In this way, the operation of camera application 109 in the example of the scene shown in Fig. 3 is performed.

[0039] 6 shows screens displayed on operation unit 105 of mobile terminal 100, including an example of a screen displaying a captured image and an example of a screen for manually inputting length information. In state ST600, camera application 109, which has a length measurement function, displays the captured image on operation unit 105. Furthermore, camera application 109 uses its length measurement function to display on operation unit 105 the length between two points on a fan, which is an object in the captured image. At this time, the length displayed on operation unit 105 is used as a measurement value included in the length information. The screen shown in state ST600 is the screen displayed on operation unit 105 by CPU 101 in step S501 using camera application 109, which has a length measurement function.

[0040] In contrast, in state ST601, the captured image is displayed on operation unit 105 by camera application 109, which does not have a length measurement function. The screen shown in state ST601 is the screen that CPU 101 displays on operation unit 105 by camera application 109, which does not have a length measurement function, in step S501. In this case, camera application 109 does not have a length measurement function, so it cannot measure the length between two points on the fan in the captured image and cannot acquire length information. Therefore, camera application 109 cannot display information about the length of the fan in the captured image on operation unit 105. Therefore, when the display screen of operation unit 105 returns from the screen by camera application 109 to the screen by image creation application 108, it is necessary for the user to input length information (steps S404 to S407).

[0041] Therefore, in state ST602, when the application operation in mobile terminal 100 is switched to image creation application 108, image creation application 108 displays a screen on operation unit 105 that prompts the user to manually input length information. Furthermore, image creation application 108 accepts input from "Next" button 600 displayed on operation unit 105. When the user taps "Next" button 600, image creation application 108 transitions the display screen of operation unit 105 to a screen for manually inputting length information (the screen of state ST604). Note that the screen shown in state ST602 is a screen that image creation application 108 displays on operation unit 105 in step S405 when CPU 101 is unable to acquire length information in step S404.

[0042] In state ST603, the image creation application 108 displays on the operation unit 105 a screen for the user to select whether or not to adjust the measurement value included in the length information acquired from the camera application 109 having a length measurement function. At this time, the measurement value included in the length information is displayed on the operation unit 105. Furthermore, the image creation application 108 accepts input of a "Yes" button 601 and an "No" button 602 displayed on the operation unit 105. When the user taps the "No" button 602, the image creation application 108 uses the measurement value included in the length information as is. Therefore, if the measurement value displayed on the operation unit 105 is within the user's target range, the user simply taps the "No" button 602.

[0043] In response to this, when the user taps the "Yes" button 601, the image creation application 108 transitions the display screen of the operation unit 105 to a screen for manually inputting the length information (the screen of state ST604). Note that the screen shown in state ST603 is a screen that is displayed on the operation unit 105 by the image creation application 108 in step S406 when the CPU 101 has acquired the length information in step S404.

[0044] In state ST604, the captured image is displayed on operation unit 105 by image creation application 108. At this time, image creation application 108 displays the captured image on operation unit 105 at a size where the display magnification of the fan in the captured image is the same as the display magnification of the canvas. However, image creation application 108 may display the captured image on operation unit 105 at any display magnification. For example, image creation application 108 displays the captured image on operation unit 105 with the number of pixels of the captured image when camera application 109 took a picture with camera unit 104. In other words, image creation application 108 displays the captured image acquired from camera application 109 on operation unit 105 at its original size.

[0045] Furthermore, image creation application 108 accepts two point designations 603 by the user tapping on the fan in the captured image on operation unit 105. If the size of the fan in the captured image displayed on operation unit 105 is not appropriate for designating two points 603, the user enlarges or reduces the display screen of operation unit 105 using a function of the smartphone, etc. Upon accepting two point designations 603, image creation application 108 transitions the display screen of operation unit 105 to a screen (the screen of state ST605) for the user to input actual measurement values.

[0046] In state ST605, the image creation application 108 displays a screen with an input field 604 on the operation unit 105. Furthermore, the image creation application 108 accepts input to the input field 604 on the display screen of the operation unit 105. At this time, the user actually measures the length between the two points of the fan indicated by the two point designations 603 using a ruler or the like, and inputs the actual measurement value into the input field 604 by operating the operation unit 105. Note that the screens shown in states ST604 and ST605 are screens that the CPU 101 displays on the operation unit 105 by the image creation application 108 in step S407. In this way, the image creation application 108 can obtain length information including the measurement value even if the camera application 109 does not have a length measurement function.

[0047] FIG. 7 shows an example of a screen on which a setting for printing a captured image is made. State ST700 is the same as state ST304. Accordingly, in state ST700, the image creation application 108 accepts a user operation on the operation unit 105 of the mobile terminal 100 to adjust the size or move the drawn image, thereby temporarily completing the print image. Furthermore, when the user taps the print button 302, the image creation application 108 transitions the display screen of the operation unit 105 to a screen (the screen of state ST701) that prompts the user to select whether to print the fan, which is an object in the captured image. The reason for printing the fan in the captured image is that although the captured image is not an image that the user wants to attach to the fan, it can serve as a guide or guide when cutting out the portion of the drawn image printed on the recording paper 304 with scissors or the like. The screen shown in state ST700 is a screen that the CPU 101 displays on the operation unit 105 by the image creation application 108 in steps S409 and S410.

[0048] In state ST701, the image creation application 108 displays a print setting screen on the operation unit 105. The print setting screen shown in state ST701 is a screen that the CPU 101 displays on the operation unit 105 by the image creation application 108 in step S411. Furthermore, the image creation application 108 accepts input of a "Yes" button 700 and a "No" button 701 provided on the print setting screen on the operation unit 105. When the user taps the "No" button 701 on the print setting screen being displayed on the operation unit 105, the image creation application 108 generates print data that does not print the captured image.

[0049] In response to this, when the user taps the "Yes" button 700 on the print setting screen displayed on the operation unit 105, the image creation application 108 accepts input into an input field 702 provided on the print setting screen. At this time, the user inputs the transparency for printing the captured image into the input field 702 via an operation on the operation unit 105. As a result, the image creation application 108 generates print data for printing the fan in the captured image with a color density adjusted according to the transparency input into the input field 702.

[0050] The reason for adjusting the color density is that the fan print in the captured image is used only as a guide, and some users may want the fan to be printed lightly in the captured image. In this case, the color density of the drawn image is not adjusted, and only the color density of the fan in the captured image is lightened, so the color density adjustment has almost no effect on the printing of the drawn image. Note that while this embodiment uses an example of adjusting the color density, it is also possible to adjust the print color to a less visible color, such as changing it to yellow. In this way, in step S411, the CPU 101 of the mobile terminal 100 generates print data using the image creation application 108.

[0051] State ST702 shows recording paper 304 on which only a drawn image is printed. To cause printing device 200 to print recording paper 304 shown in state ST702, the user taps "No" button 701 on the print setting screen of operation unit 105 shown in state ST701. As a result, CPU 101 of mobile terminal 100 sends print data including only data about the drawn image to printing device 200 by image creation application 108 in step S412.

[0052] State ST703 shows recording paper 304 on which a drawn image and a captured image of a fan with a transparency of 0% are printed. To cause printing device 200 to print recording paper 304 shown in state ST703, the user taps "Yes" button 700 on the print setting screen of operation unit 105 shown in state ST701. Furthermore, the user performs an input operation in input field 702 to set the transparency for printing the captured image to 0%. As a result, in step S412, CPU 101 of mobile terminal 100 transmits to printing device 200 print data that has been synthesized by image creation application 108 so that the drawn image is superimposed on the captured image of a fan with a color density adjusted to 100%.

[0053] State ST704 shows recording paper 304 on which a drawn image and a captured image of a fan with a transparency of 50% are printed. To cause printing device 200 to print recording paper 304 shown in state ST704, the user taps "Yes" button 700 on the print setting screen of operation unit 105 shown in state ST701. Furthermore, the user performs an input operation in input field 702 to set the transparency for printing the captured image to 50%. As a result, in step S412, CPU 101 of mobile terminal 100 transmits to printing device 200 print data that has been synthesized by image creation application 108 so that the drawn image is superimposed on the captured image of a fan with a light color density of 50%.

[0054] As described above, in the mobile terminal 100, the image creation application 108 and camera application 109 are operated by the CPU 101, so that the size of the drawn image can be adjusted to match the size of the fan 305 on which the drawn image is to be pasted. This allows the user to print the drawn image at the appropriate size without having to repeatedly go back and forth between the mobile terminal 100 and the printing device 200 to adjust and check the size of the drawn image. Furthermore, at this time, the image creation application 108 needs the length of the fan 305 in the captured image, but if the camera application 109 has a length measurement function, it can automatically measure the length of the fan 305 in the captured image using that function. This reduces the input burden on the user.

[0055] Although preferred embodiments of the present invention have been described above, the present invention is not limited to the above embodiments and various modifications and variations are possible within the scope of the present invention. For example, the image creation application 108 and the camera application 109 may be implemented as a single integrated program, or as three or more separate programs. Furthermore, the creation of a drawn image by the image creation application 108 (steps S400 to S402) may be executed after the capture of a photographed image by the camera application 109 (steps S403 to S404). Furthermore, if it is assumed that the camera application 109 has a length measurement function, the processes of steps S405, S502, and S505 may be omitted.

[0056] Furthermore, in state ST303, a user operation 303 of pinching in / out on a drawn image enlarges or reduces the drawn image, but the entire display screen of operation unit 105 may also be enlarged or reduced. In this case, CPU 101 of mobile terminal 100 causes image creation application 108 to display a switching button on operation unit 105 and accepts input of the switching button. Then, when the user taps the switching button, CPU 101 causes image creation application 108 to accept, at operation unit 105, a user operation of pinching in / out that enlarges or reduces the entire display screen of operation unit 105.

[0057] The present invention can also be realized by supplying a program that realizes one or more functions of the present embodiment to a system or device via a network or storage medium, and having one or more processors in the computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0058] The disclosure of this embodiment includes the following configuration, method, and program. (Program 1) In the computer of the information processing device, causing the information processing device to create a drawing image on a canvas in response to a user operation; causing the information processing device to acquire a photographed image of an object; causing the information processing device to display the photographed image, the size of which has been changed in accordance with the length of the object in the photographed image and the size of the canvas, together with the drawn image; causing the information processing device to adjust the size of the drawn image displayed together with the resized captured image in accordance with a user operation; causing the information processing device to generate print data including at least data on the drawn image whose size has been adjusted; A program causing the information processing device to transmit the generated print data to a printing device. (Program 2) Furthermore, the computer of the information processing device: The program described in program 1 is characterized in that it causes the information processing device to change the size of the captured image so that the display magnification of the object in the captured image becomes the same as the display magnification of the canvas. (Program 3) Furthermore, the computer of the information processing device: causing the information processing device to determine whether a length of the object in the photographed image has been acquired; If the length of the object in the photographed image has not been acquired, the information processing device displays the photographed image; causing the information processing device to designate two points on an object in the displayed captured image in response to a user operation; causing the information processing device to input a value in accordance with a user operation; The program described in program 1 or 2 is characterized in that the information processing device is caused to obtain a length related to an object in the photographed image by treating the input value as the length between two points on the object specified in the photographed image. (Program 4) Furthermore, the computer of the information processing device: when the length of the object in the photographed image is acquired, determining whether to adjust the length of the object in the photographed image in response to a user operation; When adjusting a length of an object in the photographed image, the information processing device displays the photographed image; causing the information processing device to designate two points on an object in the displayed captured image in response to a user operation; causing the information processing device to input a value in accordance with a user operation; The program described in program 3 is characterized in that the information processing device adjusts the length of an object in the photographed image by treating the input value as the length between two points on the object in the specified photographed image. (Program 5) Furthermore, the computer of the information processing device causing the information processing device to determine whether to adjust a length of an object in the captured image in response to a user operation; When adjusting a length of an object in the photographed image, the information processing device displays the photographed image; causing the information processing device to designate two points on an object in the displayed captured image in response to a user operation; causing the information processing device to input a value in accordance with a user operation; The program described in program 1 or 2 is characterized in that it causes the information processing device to adjust the length of an object in the photographed image by treating the input value as the length between two points on the object in the specified photographed image. (Program 6) Furthermore, the computer of the information processing device: 6. The program according to program 4 or 5, characterized in that the program causes the information processing device to acquire a length of an object in the captured image by measurement using the captured image. (Program 7) Furthermore, the computer of the information processing device: causing the information processing device to display the captured image; causing the information processing device to designate two points on an object in the displayed captured image in response to a user operation; The program described in program 6 is characterized in that it causes the information processing device to obtain the length between two points on a specified object in the captured image as the length related to the object in the captured image by measurement using the captured image. (Program 8) Furthermore, the computer of the information processing device: 8. The program according to any one of programs 1 to 7, wherein the program causes the information processing device to set the size of the canvas in response to a user operation. (Program 9) Furthermore, the computer of the information processing device: causing the information processing device to determine whether or not to print the object in the photographed image in response to a user operation; A program described in any one of programs 1 to 8, characterized in that when printing an object in the photographed image, the program causes the information processing device to generate print data including data about an image in which the resized drawing image is superimposed on the object in the photographed image. (Program 10) Furthermore, the computer of the information processing device The program described in program 9, characterized in that when printing an object in the captured image, the information processing device is caused to adjust the color density or hue of the object in the captured image in accordance with user operation. (Program 11) The program according to any one of Programs 1 to 10, wherein the information processing device is a mobile terminal. (Program 12) The program according to any one of Programs 1 to 11, wherein the user operation for adjusting the size of the drawn image is pinch-in and pinch-out. (Device 1) Image creation means for creating a drawing image on a canvas in response to user operations; image acquisition means for acquiring a photographed image of an object; a display means for displaying the photographed image, the size of which has been changed in accordance with the length of the object in the photographed image and the size of the canvas, together with the drawn image; an adjusting means for adjusting the size of the drawn image displayed together with the resized photographed image in response to a user operation; a generating means for generating print data including at least data on the drawing image whose size has been adjusted; a transmitting unit that transmits the generated print data to a printing device. (System 1) An image printing system having an information processing device and a printing device, The information processing device includes: an image creation means for creating a drawing image on a canvas in response to a user operation; image acquisition means for acquiring a photographed image of an object; a display means for displaying the photographed image, the size of which has been changed in accordance with the length of the object in the photographed image and the size of the canvas, together with the drawn image; an adjusting means for adjusting the size of the drawn image displayed together with the resized photographed image in response to a user operation; a generating means for generating print data including at least data on the drawing image whose size has been adjusted; a transmitting means for transmitting the generated print data to the printing device; The printing device an image printing system comprising a printing means for printing the print data on recording paper; [Explanation of symbols]

[0059] 100 Mobile terminals (information processing devices) 101 CPU (computer) (image creation means) (image acquisition means) (display means) (adjustment means) (generation means) (transmission means) 200 Printing device 206 Recording unit (printing means) 210 Image Printing System

Claims

1. The computer of the information processing device causing the information processing device to create a drawing image on a canvas in response to a user operation; causing the information processing device to acquire a photographed image of an object; causing the information processing device to display the photographed image, the size of which has been changed in accordance with the length of the object in the photographed image and the size of the canvas, together with the drawn image; causing the information processing device to adjust the size of the drawn image displayed together with the resized captured image in accordance with a user operation; causing the information processing device to generate print data including at least data on the drawn image whose size has been adjusted; a program for causing the information processing device to transmit the generated print data to a printing device;

2. Furthermore, the computer of the information processing device 2. The program according to claim 1, further comprising causing the information processing device to change the size of the photographed image so that a display magnification of the object in the photographed image becomes the same as a display magnification of the canvas.

3. Furthermore, the computer of the information processing device causing the information processing device to determine whether a length of the object in the photographed image has been acquired; If the length of the object in the photographed image has not been acquired, the information processing device displays the photographed image; causing the information processing device to designate two points on an object in the displayed photographed image in response to a user operation; causing the information processing device to input a value in accordance with a user operation; The program described in claim 1, characterized in that the information processing device is caused to obtain a length related to an object in the photographed image by treating the input value as the length between two points on the object specified in the photographed image.

4. Furthermore, the computer of the information processing device when the length of the object in the photographed image is acquired, determining whether to adjust the length of the object in the photographed image in response to a user operation; When adjusting a length of an object in the photographed image, the information processing device displays the photographed image; causing the information processing device to designate two points on an object in the displayed photographed image in response to a user operation; causing the information processing device to input a value in accordance with a user operation; The program described in claim 3, characterized in that the information processing device adjusts the length of the object in the photographed image by treating the input value as the length between two points on the object in the specified photographed image.

5. Furthermore, the computer of the information processing device causing the information processing device to determine whether to adjust a length of an object in the captured image in response to a user operation; When adjusting a length of an object in the photographed image, the information processing device displays the photographed image; causing the information processing device to designate two points on an object in the displayed photographed image in response to a user operation; causing the information processing device to input a value in accordance with a user operation; The program described in claim 1, characterized in that the information processing device adjusts the length of the object in the photographed image by treating the input value as the length between two points on the object in the specified photographed image.

6. Furthermore, the computer of the information processing device 6. The program according to claim 4, wherein the program causes the information processing device to acquire a length of an object in the photographed image by measurement using the photographed image.

7. Furthermore, the computer of the information processing device causing the information processing device to display the captured image; causing the information processing device to designate two points on an object in the displayed photographed image in response to a user operation; The program according to claim 6, characterized in that the information processing device is caused to acquire the length between two points on a specified object in the photographed image as the length related to the object in the photographed image by measurement using the photographed image.

8. Furthermore, the computer of the information processing device 2. The program according to claim 1, wherein the program causes the information processing device to set the size of the canvas in response to a user operation.

9. Furthermore, the computer of the information processing device causing the information processing device to determine whether or not to print the object in the photographed image in response to a user operation; The program according to claim 1, characterized in that, when printing an object in the photographed image, the program causes the information processing device to generate the print data including data about an image in which the resized drawing image is overlaid on the object in the photographed image.

10. Furthermore, the computer of the information processing device 10. The program according to claim 9, wherein when the object in the photographed image is printed, the program causes the information processing device to adjust the color density or color tone of the object in the photographed image in response to a user operation.

11. 2. The program according to claim 1, wherein the information processing device is a mobile terminal.

12. 2. The program according to claim 1, wherein the user operation for adjusting the size of the drawn image is a pinch-in or pinch-out.

13. an image creation means for creating a drawing image on a canvas in response to a user operation; image acquisition means for acquiring a photographed image of an object; a display means for displaying the photographed image, the size of which has been changed in accordance with the length of the object in the photographed image and the size of the canvas, together with the drawn image; an adjusting means for adjusting the size of the drawn image displayed together with the resized photographed image in response to a user operation; a generating means for generating print data including at least data on the drawing image whose size has been adjusted; a transmitting unit that transmits the generated print data to a printing device.

14. An image printing system having an information processing device and a printing device, The information processing device includes: an image creation means for creating a drawing image on a canvas in response to a user operation; image acquisition means for acquiring a photographed image of an object; a display means for displaying the photographed image, the size of which has been changed in accordance with the length of the object in the photographed image and the size of the canvas, together with the drawn image; an adjusting means for adjusting the size of the drawn image displayed together with the resized photographed image in response to a user operation; a generating means for generating print data including at least data on the drawing image whose size has been adjusted; a transmitting means for transmitting the generated print data to the printing device; The printing device an image printing system comprising a printing means for printing the print data on recording paper;

Images