Program, information processing apparatus, and control method

Abstract

To provide a program that eliminates the need of operations to set a "paper size" in printing a photographed image and improves usability.SOLUTION: The present disclosure is a program for causing a computer of an information processing apparatus to execute a control method, and the control method includes: an acquisition step of acquiring the dimensions of an object included in a photographed image; and a setting step of setting the paper size of a paper used for printing of the object on the basis of the dimensions of the object acquired in the acquisition step.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to a program, an information processing device, and a control method. [Background technology]

[0002] There are application programs (hereinafter referred to as printing applications) available for sending images captured by a smartphone or tablet equipped with a photographing function to a printer for printing. This type of printing application provides a function for printing a captured image on a desired size of paper at a desired print size by allowing the user to set "paper size" and "print magnification" in a print setting menu. Regarding paper size setting, Patent Document 1 describes a technology in which, when a scanner reads a print object, the size of the print object is detected and text indicating the ratio of the paper size to the print object is displayed on the printer's display. This technology allows the user to set an appropriate paper size after checking the ratio between the dimensions of the print object and the paper size. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-083382 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when photographing an object using a mobile device such as a smartphone or tablet, it is difficult for a user to determine its actual dimensions simply by looking at the photographed image. This is because, unlike the scanner described in Patent Document 1, there is no standard size information. For example, when photographing an A4 document, a user cannot determine whether the document is A5 or A3 by simply looking at the photographed image. This makes it difficult to set the appropriate paper size when printing the document at its actual size or larger (or smaller) than the actual size. Furthermore, setting the wrong paper size necessitates reprinting, resulting in waste.

[0005] The present disclosure aims to eliminate the need to set the "paper size" when printing a captured image, thereby improving usability. [Means for solving the problem]

[0006] The present disclosure relates to a program that causes a computer of an information processing device to execute a control method, the control method comprising: an acquisition process for acquiring dimensions of an object included in a captured image; and a setting process for setting the paper size of paper to be used for printing the object based on the dimensions of the object acquired in the acquisition process. [Effects of the Invention]

[0007] According to the present disclosure, when printing a captured image, the user does not need to set the paper size, improving usability and preventing printing on the wrong paper size. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing the configuration of a system including an information processing apparatus and a printer. [Figure 2] FIG. 2 is a block diagram illustrating a functional configuration of the information processing device. [Figure 3]FIG. 2 is a diagram showing paper size information stored in the information processing apparatus. [Figure 4] 5 is a flowchart showing the flow of processing of a print application according to the first embodiment. [Figure 5] 1A and 1B are diagrams showing an explanation screen, a photographing screen, and a region of an object surrounded by a frame line connecting feature points, respectively. [Figure 6] FIG. 10 is a diagram illustrating an example of a method for determining a paper size. [Figure 7] FIG. 10 is a diagram illustrating an example of a preview screen. [Figure 8] 1A shows an example of a print screen, FIG. 1B shows an example of a print setting screen, and FIG. 1C shows an example of a paper size setting screen. [Figure 9] 10 is a flowchart illustrating a flow of a print setting process. [Figure 10] FIG. 10 is a diagram illustrating an example of print settings when the aspect ratio is fixed. [Figure 11] 10A and 10B are diagrams illustrating examples of print settings when the aspect ratio is adjusted to match the paper size. [Figure 12] FIG. 10 is a block diagram illustrating the functional configuration of an information processing device according to a second embodiment. [Figure 13] 10A is a diagram showing an example of a preview screen, and FIG. 10B is a diagram showing an example of a size input dialog. [Figure 14] 10 is a flowchart showing the flow of processing of a print application according to the second embodiment. [Figure 15] FIG. 11 is a diagram showing the configuration of a dimension acquisition unit in the third embodiment. [Figure 16] 10 is a flowchart showing the flow of a process for determining the source from which the dimensions of an object are obtained. [Figure 17] FIG. 13 is a diagram illustrating the concept of print settings in a fourth embodiment. [Figure 18] FIG. 10 is a diagram illustrating a functional configuration of an information processing device according to a fourth embodiment. [Figure 19] 10 is a flowchart showing the flow of processing of a print application according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the present disclosure according to the claims, and not all of the combinations of features described in the embodiments are necessarily essential to the solutions of the present disclosure.

[0010] First Embodiment FIG. 1 is a block diagram showing the configuration of an information processing system 1 including an information processing device 101 and a printer 151 according to the first embodiment of the present disclosure.

[0011] The information processing device 101 is a mobile terminal equipped with a photographing function and a communication function, and in this embodiment, a smartphone is used as an example. Note that this embodiment is not limited to smartphones, and can be applied to various types of information processing devices, such as mobile terminals, notebook PCs, tablet terminals, PDAs (Personal Digital Assistants), and digital cameras.

[0012] The printer 151 is a device having a printing function and a communication function with the information processing device 101, and in this embodiment, an inkjet printer will be described as an example. The printing method is not limited to inkjet printing, and the printer can be applied to printers of various printing methods, such as thermal printers (dye-sublimation, thermal transfer, etc.), dot impact printers, LED printers, laser printers, and other electrophotographic printers. The printer can also be applied not only to printers, but also to copiers, facsimile machines, and multifunction peripherals (MFPs) having multiple functions such as copying, faxing, and printing.

[0013] In addition, in this embodiment, the internal configuration of the information processing device 101 and the printer 151 is shown as an example in FIG. 1, but is not limited to this and can be changed as appropriate depending on the functions of the information processing device 101 and the printer 151.

[0014] As shown in FIG. 1, an information processing device 101 includes an input interface 102, a CPU 103, a ROM 104, a RAM 105, a storage device 106, an output interface 107, a touch panel display 108, a communication unit 109, an image capturing device 110, a sensor 111, and the like.

[0015] The input interface 102 is connected to input devices such as a touch panel display 108, a physical keyboard, buttons, etc., and accepts data input and operation instructions from the user via these input devices. The data and instructions accepted by the input interface 102 are input to the CPU 103. Note that the output interface 107 and the input interface 102, which will be described later, may be the same component, and the screen output and the acceptance of operations from the user may be performed by the same component.

[0016] The CPU 103 is a control unit that controls the entire information processing device 101. The CPU 103 executes various processes using the RAM 105 as a work area in accordance with programs stored in the ROM 104 or the storage device 106. The programs executed by the CPU 103 include an operating system and a printing application, which will be described later.

[0017] The ROM 104 stores fixed data such as control programs and data tables executed by the CPU 103, and programs of an operating system (hereinafter referred to as OS). In this embodiment, each control program performs software execution control such as scheduling, task switching, and interrupt processing under the management of the OS.

[0018] The RAM 105 is configured with an SRAM (Static Random Access Memory) or the like that requires a backup power source. Note that the RAM 105 holds data using a primary battery (not shown) for data backup, so that important data such as program control variables can be stored without volatilization. The RAM 105 also has a memory area for storing setting information for the information processing device 101, management data for the information processing device 101, and the like. The RAM 105 is also used as the main memory and work memory for the CPU 103.

[0019] The storage device 106 is a storage device such as a hard disk drive, a solid state drive, or a flash memory. The storage device 106 stores various programs, such as a print information generation program that generates print information that can be interpreted by the printer 151, and an information transmission / reception control program for transmitting and receiving information to and from the printer 151. The storage device 106 also stores various application programs, including a print application 200, which will be described later. The storage device 106 can also store various information used by the above-mentioned programs, data of images captured by the imaging device 110, and image data acquired from other information processing devices connected to the information processing device 101 or via the Internet. The storage device 106 does not necessarily have to be provided inside the information processing device 101, but may also be provided outside the information processing device 101. For example, the storage device 106 may be an external storage device connected via a peripheral device interface (not shown), or may be a cloud storage, which is a storage area connected to and communicated via a network.

[0020] The output interface 107 is connected to the touch panel display 108 and controls the display of data transmitted from the CPU 103 on the touch panel display 108. The output interface 107 causes the touch panel display 108 to display information transmitted from the CPU 103 indicating the state of the information processing device 101 and various screens generated by applications.

[0021] Touch panel display 108 has a touch panel provided on a display configured from an LED (light emitting diode), an LCD (liquid crystal display), or the like. It displays data transmitted from CPU 103 and inputs data input via the touch panel to CPU 103. By displaying a soft keyboard on the display that includes keys such as numeric input keys, a mode setting key, an enter key, a cancel key, and a power key, it is possible to accept input from the user via touch panel display 108. Note that, although the present embodiment shows a device configuration in which the display unit and the input unit are integrally configured, such as touch panel display 108, the display unit and the input unit may be configured as separate devices. Furthermore, input devices and operation buttons other than the touch panel may be provided, and multiple displays may be provided.

[0022] The communication unit 109 has a communication control circuit, a communication port, etc., and is connected to and communicates with external devices such as the printer 151 to transmit and receive data. For example, the communication unit 109 may communicate directly with external devices such as the printer 151 via wireless communication, or may communicate via an external access point 131 that is external to the information processing device 101 or the printer 151. The access point 131 is a device that establishes a network and determines the communication channel used for communication within the established network. In this embodiment, Wi-Fi (registered trademark) is used as the wireless communication method for the communication unit 109, but short-range wireless communication such as Bluetooth (registered trademark) may also be used. An example of an access point is a device such as a wireless LAN router. The communication connection between the communication unit 109 and the printer 151 may also be a wired connection.

[0023] The image capturing device 110 is a device that converts an image captured by an image capturing element into digital data. The digital data is stored in RAM 105, and then converted into a predetermined image format by a program executed by CPU 103, and stored as image data in storage device 106. The information processing device 101 of this embodiment has multiple image capturing devices to obtain three-dimensional position information of an object that is a subject.

[0024] The sensor 111 includes a LiDAR that measures the distance from the information processing device 101 to an object, a gyro sensor, an acceleration sensor, etc. that detect the attitude of the information processing device 101. The CPU 103 acquires the distance (position information in the depth direction) between the object detected by the sensor 111 and the information processing device 101, and position and attitude information of the information processing device 101, and acquires three-dimensional position information of the object imaged by the imaging device 110.

[0025] The printer 151 includes a CPU 154, a ROM 152, a RAM 153, a print engine 155, a communication unit 156, an operation unit 157, and the like.

[0026] The CPU 154 is a control unit that controls the entire printer 151. The CPU 154 executes various processes using the RAM 152 as a work area in accordance with programs stored in the ROM 152. For example, when the CPU 154 receives print job data transmitted from the information processing device 101, the CPU 154 stores the received print job data in the RAM 153 and transmits a print instruction to the print engine 155.

[0027] The print engine 155 forms an image on a recording medium such as paper using a recording agent such as ink based on the information stored in the RAM 153 and the print setting information of the print job received from the information processing device 101, and outputs the image as a printed result. Note that the recording medium is not limited to the paper used in general printers, but also broadly includes materials that can accept ink, such as vinyl, cloth, plastic film, metal plates, glass, ceramics, wood, and leather. Hereinafter, this will be referred to as paper.

[0028] The communication unit 156, ROM 152, and RAM 153 are similar to the communication unit 109, ROM 104, and RAM 105 described above, and therefore their explanation will be omitted.

[0029] Operation unit 157 is composed of, for example, a display, a touch panel, a keyboard, a mouse, buttons, etc., and accepts operations by the user and displays on the display information indicating the status of printer 151 input from CPU 154. CPU 154 generates image data that can be recorded by print engine 155 in accordance with instructions from the user accepted via operation unit 157 and programs stored in ROM 152, and transfers this to print engine 155. CPU 154 also performs predetermined processing on print job data received via communication unit 156 in accordance with programs stored in ROM 152, and displays the results and various information on display 307.

[0030] 2 is a block diagram illustrating the functional configuration of the information processing device 101. The information processing device 101 realizes its basic functions by the CPU 103 executing processes in accordance with a program of the OS 250. Furthermore, the information processing device 101 of this embodiment realizes each function shown in FIG. 2 by the CPU 103 executing processes in accordance with a program related to the print application 200.

[0031] The print application 200 is a processing program configured to be executable on the OS 250 of the information processing device 101. The print application 200 has, as functions (program modules), a captured image acquisition unit 201, a dimension acquisition unit 202, a paper size setting unit 203, a paper size storage unit 204, a print setting unit 205, an image processing unit 206, a print job transmission unit 207, etc. In this embodiment, the OS 250 also has, as functions (program modules), a feature detection unit 251 and a dimension measurement unit 252.

[0032] The feature detection unit 251 has a function of detecting features of an object existing in real space that is included in a captured image. This function is realized by an AR (augmented reality) function of the OS 250. The feature detection unit 251 can detect the three-dimensional structure of the captured real space and the three-dimensional position information of an object existing in the real space, based on a plurality of images captured by a plurality of image capture devices 110 included in the information processing device 101. Furthermore, the information processing device 101 can obtain information on the distance in the depth direction between the object and the information processing device 101 and information on the attitude of the information processing device 101, using sensors 111 such as LiDAR, a gyro sensor, and an acceleration sensor in addition to the image capture devices 110.

[0033] In this embodiment, when the feature detection unit 251 receives information on how many feature points to detect and a feature point detection request from the print application 200, it detects feature points of an object captured on the captured screen. The feature detection unit 251 returns position information on the captured screen of each detected feature point to the print application 200. In this embodiment, as an example, the print application 200 requests that four vertices of an object be detected as feature points from the captured image. In this case, when a document is captured, the four corners of the document are detected as feature points. Note that the object detected by the feature detection unit 251 is not limited to a document and may include other objects. For example, the feature detection unit 251 may be configured to detect an object having a specific shape specified by the print application.

[0034] When the dimension measurement unit 252 receives a dimension acquisition request after a frame line surrounded by multiple feature points has been specified by the print application 200, it measures the dimensions of the specified frame line in real space, i.e., the length of each side of the frame, and returns the measurements to the print application 200. In this embodiment, the frame is a rectangular frame, and an example is shown in which the lengths of the long and short sides of the rectangular frame are measured. For example, when a document is photographed, the dimension measurement unit 252 measures the length of each side of the frame line connecting the feature points at the four corners of the document.

[0035] The captured image acquisition unit 201 of the print application 200 acquires data of an image being captured by the image capturing device 110. Hereinafter, data of an image being captured will be referred to as a captured image.

[0036] The dimension acquisition unit 202 acquires the dimensions of an object included in a captured image. The object is an object existing in the real space captured as the captured image, and is identified based on feature points detected by the feature detection unit 251. For example, an area within a frame line surrounded by four feature points is recognized as the object. In the first embodiment, the dimension acquisition unit 202 requests the OS 250 to acquire the dimensions (lengths of the long and short sides) of the object in the captured image, and acquires information on the dimensions (lengths of the long and short sides) of the object measured by the dimension measurement unit 252.

[0037] A paper size setting unit 203 sets the size of the paper to be used for printing the object based on the dimensions acquired by the dimension acquisition unit 202. The method for setting the paper size will be described later.

[0038] The paper size storage unit 204 stores information on the length of the short side (short side size) and the length of the long side (long side size) for each of a plurality of paper sheets of different sizes. FIG. 3 is a diagram showing paper size information 300 stored in the paper size storage unit 204. This paper size information 300 stores sizes corresponding to the following paper types. Specifically, for example, the size stored is "297mm x 420mm" for "A3," "210mm x 297mm" for "A4," "148mm x 210mm" for "A5," "257mm x 364mm" for "B4," and "182mm x 257mm" for "B5." Note that the types of paper sizes shown in FIG. 3 are merely examples, and the paper size information 300 may include only a portion of these, or may include other paper sizes.

[0039] The print setting unit 205 performs print settings for the image to be printed. For example, it sets setting values ​​for multiple setting items including the number of copies to be printed, print range, paper size, print magnification, and aspect ratio. In the first embodiment, the print setting unit 205 first sets a predetermined default setting value for each setting item. It also accepts setting changes made by the user. Note that with regard to the paper size, it sets the paper size set by the paper size setting unit 203. Even if the paper size is set by the paper size setting unit 203, the print setting unit 205 may accept a paper size reset by the user. Note that the above setting items are merely examples and are not limited to these, and other setting items may be included.

[0040] The image processing unit 206 performs image processing, including image size correction (enlargement and reduction), so that the area of ​​the object in the captured image (image within the frame) is printed according to the set paper size and print settings. For example, if the paper size is B5, the print magnification is set to "fit paper size," and the aspect ratio is set to "fixed," the image processing unit 206 compares the dimensions of the object area with the B5 paper size. Then, it enlarges the object area so that either the long side or the short side matches the paper size. Alternatively, if the paper size is B5, the print magnification is set to "actual size (100%)," and the aspect ratio is set to "fixed," the image processing unit 206 corrects the size of the image within the frame so that the dimensions of the object area are printed at the same size on the B5 paper size. The size correction is calculated to obtain an appropriate print size according to the image resolution. Additionally, the image processing unit 206 performs image processing according to the image quality, color settings, and other settings set in the print setting unit 205.

[0041] The print job sending unit 207 sends print job data including print data and print setting information to the printer 151, which is the communication connection destination. The print data is the image data of the object to be printed described above, or image data of the object to be printed corrected by the image processing unit 206 as necessary. In this embodiment, print data of an image surrounded by a frame line, which is the area of ​​the object, is sent to the printer 151. The print setting information includes the paper size set by the paper size setting unit 203 and print setting information for each setting item set by the print setting unit 205. When the printer 151 receives the print job, it executes printing processing based on the print job. As a result, an image of the area of ​​the object included in the captured image is printed on paper of the paper size set by the print application 200, either at its actual size or at a size that fits the paper.

[0042] The processing flow of the print application 200 executed by the information processing device 101 will be described with reference to FIG. 4. FIG. 4 is a flowchart showing the processing flow of the print application 200 according to the first embodiment. The processing shown in this flowchart is performed by the CPU 103 of the information processing device 101, where the program of the print application 200 stored in the storage device 106 is called by the CPU 103, expanded in the RAM 105, and executed by the CPU 103. The CPU 103 starts this processing when the user launches the print application 200 and instructs the start of this function. In the following description, the symbol "S" denotes a step. Note that each of the following steps is processing executed by the CPU 103 of the information processing device 101, but when describing whether it is processing on the print application side or the OS side, the processing will be described as being performed by the print application or the OS.

[0043] In S401, the print application 200 displays an explanation screen 510 on the touch panel display 108. FIG. 5A is a diagram showing an example of the explanation screen 510. The explanation screen 510 is a screen for explaining how to set the shooting range, and includes a guidance message 509 and an OK button 508. The guidance message 509 may, for example, include a sentence such as "Select the shooting range by surrounding the object with a frame. *If an object is detected, the frame will be automatically drawn." This message includes the following content: On the next transition to the shooting screen 500, if an object is automatically detected, the detected object is displayed surrounded by a frame. If an object is not detected or if the object is erroneously detected, the user selects the shooting range by surrounding the object.

[0044] 5(a) may be displayed in a dialog format on top of the shooting screen 500 shown in Fig. 5(b), or only the explanation screen 510 may be displayed on the touch panel display 108. Furthermore, if there is a history of the explanation screen 510 having been displayed at least once, the display of the explanation screen 510 may be omitted and the process may proceed to S403.

[0045] In S402, when the user operates the OK button 508 on the instruction screen 510, the CPU 103 determines that an instruction to start shooting has been input, closes the instruction screen 510, and proceeds to S403.

[0046] In S403, the print application 200 displays the photographing screen 500 shown in Fig. 5(b). As shown in Fig. 5(b), the photographing screen 500 displays a range indicating a photographable area 501, a photographed object 503, marks indicating multiple feature points 502a, 502b, 502c, and 502d, a photograph button 504, and a cancel button 505. In the initial state (state before feature detection), the marks indicating feature points 502a to 502d are displayed and positioned at each vertex of the photographable area 501.

[0047] In S404, when an image of the object 503 is captured within the captureable area 501, the print application 200 transmits a feature point detection request to the OS 250. At this time, the print application 200 specifies the number of feature points to be detected and transmits the feature point detection request to the OS 250. In this example, the number of feature points is specified as four.

[0048] In S405, when the OS 250 receives a feature point detection request from the print application 200, the feature detection unit 251 detects a specified number of feature points from the image captured on the shooting screen 500. Because a detection request for four feature points has been received, the feature detection unit 251 detects four feature points. The feature points are detected as three-dimensional position information.

[0049] In S406, the OS 250 returns the position information of the detected four feature points 502a, 502b, 502c, and 502d to the print application 200.

[0050] In S407, the print application 200 displays marks indicating feature points 502a, 502b, 502c, and 502d based on the position information of the four feature points received from the OS 250. As shown in FIG. 5(c), the vertices (corners of the object) at the four corners of the object 503 are detected as feature points, and marks are displayed at those positions. Furthermore, the print application 200 displays a frame 506 that connects adjacent feature points 502a, 502b, 502c, and 502d and surrounds the object on the shooting screen 500. In the following description, the area surrounded by the frame 506 connecting the feature points, as shown in FIG. 5(c), is referred to as the area of ​​the object or the image within the frame.

[0051] In the example of Fig. 5(c), the object is detected as a rectangle, but depending on the angle between the information processing device 101 and the object, it may be detected as a distorted shape. In this case, the print application 200 may execute a process to correct the frame line 506 surrounding the object 503 to a rectangle. This process can use a known method such as keystone correction.

[0052] In S408, the print application 200 accepts an instruction from the user to move the position of the feature point. For example, if the position of the feature point displayed by the processes of S404 to S407 differs from the position of the feature point identified by the user's visual recognition, the user moves the position of the feature point. The movement operation is, for example, a slide operation on the touch panel display. Furthermore, even if the feature point cannot be detected by the processes of S404 to S407, the print application 200 accepts the user's movement of the position of the feature point.

[0053] In S409, if the capture button 504 on the capture screen 500 is operated, the print application 200 determines that a capture instruction has been input, and proceeds to S410. If the cancel button 505 on the capture screen 500 is operated, the processing of the print application 200 ends.

[0054] In S410, the print application 200 saves the area of ​​the object, that is, an image within the frame 506 surrounding the object (hereinafter referred to as the frame image), in the RAM 105. The print application 200 also displays the frame image on the touch panel display 108.

[0055] In S411, the print application 200 requests the OS 250 to acquire the dimensions of the long and short sides of the frame 506 surrounding the object.

[0056] In S412, in response to a request from the print application 200, the OS 250 uses the function of the dimension measurement unit 252 of the OS 250 to measure the dimensions of the long and short sides of the area (frame line 506) surrounding the object. Note that a description of how the dimension measurement unit 252 of the OS 250 measures the dimensions of the frame line will be omitted in this specification. This is because dimension measurement is a process on the OS 250 side and not a process of the print application 200 according to the present disclosure. In the present disclosure, the print application 200 specifies the frame line 506 surrounding the target three-dimensional object and requests the OS 250 to obtain the dimensions of the long and short sides of the specified frame line, thereby obtaining the dimensions of the long and short sides of the frame line 506 surrounding the object from the OS 250.

[0057] In S413 , the OS 250 transmits the measured dimensions of the long and short sides to the print application 200 .

[0058] In S414, the print application 200 sets the paper size after acquiring the dimensions of the long and short sides of the frame line 506 from the OS 250. The paper size may be set using any of the four methods shown in Fig. 6. In this embodiment, as an example, the print application 200 sets the paper size using the method shown in Fig. 6(d).

[0059] Fig. 6 shows variations in the method for determining the paper size. In Fig. 6, the area shown in gray is the image within the frame, i.e., the area 600 of the object included in the captured image. Paper sizes 601, 602, and 604 set as the paper size to be used for printing are those of the multiple paper sizes stored as paper size information 300 that satisfy the following conditions:

[0060] Method of FIG. 6(a): Of one or more candidate paper sizes in which the length a of the long side of the object area 600 is equal to or less than the long side size A of the paper, a paper size 601 is selected in which the length b of the short side of the object area 600 is equal to or less than the short side size B of the paper and the length b of the short side of the object area 600 is closest to the short side size B of the paper. In other words, of the paper sizes in which a≦A, the paper size in which b≦B and Bb is the smallest is set as the paper size to be used for printing.

[0061] Method of FIG. 6(b): Of one or more candidate paper sizes for which the length b of the short side of the object area 600 is equal to or less than the short side size B of the paper, a paper size 602 is selected for which the length a of the long side of the object area 600 is equal to or less than the long side size A of the paper and for which the length a of the long side of the object area 600 is closest to the long side size A of the paper. In other words, of the paper sizes for which b≦B, the paper size for which a≦A and (Aa) is the smallest is set as the paper size to be used for printing.

[0062] Method of FIG. 6(c): Of the paper sizes 601 and 602 determined in FIG. 6(a) and FIG. 6(b), the paper size with the shorter total of the long and short sides (A1+B1) and (A2+B2) is used.

[0063] Method in Figure 6(d): Among the paper sizes where the length of the long side of the object area, a, is equal to or less than the long side size A of the paper, and the length of the short side of the object area, b, is equal to or less than the short side size B of the paper, the paper size where the sum of the difference between the long side size A of the paper and the length of the long side of the object, a, and the difference between the short side size B of the paper and the length of the short side of the object, b, is the smallest. In other words, among the paper sizes where a≦A and b≦B, the paper size where (Aa) + (Bb) is the smallest is set as the paper size to use for printing.

[0064] Other methods: The paper size whose long side size A or short side size B is closest to the long side length a or short side length b of the target area is set as the paper size to be used for printing.

[0065] In S415, the print application 200 corrects the image size so that the image within the frame is printed at a predetermined print magnification and aspect ratio on the paper size set in S415. Note that the default settings for the print magnification and aspect ratio are assumed to be determined in advance. The default settings are a print magnification of "fit to paper" and an aspect ratio of "fixed."

[0066] The print magnification setting can be set to either "actual size" or "fit to paper." "Actual size" means printing at actual dimensions. "Fit to paper" can mean "fit to long side" or "fit to short side." "Fit to long side" means enlarging the object so that the long side of the object matches the size of the long side of the paper. "Fit to short side" means enlarging the object so that the short side of the object matches the size of the short side of the paper.

[0067] When the print magnification is set to "fit to paper," the print application 200 compares the dimensions of the object with the paper size and selects the magnification between the long sides and the magnification between the short sides, whichever is closer to 1. That is, of the ratio A / a (hereinafter referred to as the long side magnification) of the long side size A of the paper to the long side length a of the object, and the ratio B / b (hereinafter referred to as the short side magnification) of the short side size B of the paper to the short side length b of the object, if the magnification for the short side is closer to 1, the print application 200 enlarges the image within the frame by the short side magnification B / b. If the magnification for the long side is closer to 1, the print application 200 enlarges the image within the frame by the long side magnification A / a. As a result of the enlargement, any remaining area on the paper becomes blank space.

[0068] The aspect ratio can be set to either "Fixed" or "Fit to Paper Size." "Fixed" means that the aspect ratio cannot be changed. "Fit to Paper Size" means that the aspect ratio of the object is adjusted to match the aspect ratio of the paper.

[0069] In S416, the print application 200 displays a print preview image of the framed image after image size correction on a preview screen 700. FIG. 7 is a diagram showing an example of the preview screen 700. As shown in FIG. 7, a print preview image 701, a next button 702, and a cancel button 703 are displayed on the preview screen 700. The print preview image 701 is an image showing the print result when the framed image is printed at the currently set paper size, print magnification, and aspect ratio. The currently set paper size is the paper size set in S415, and the currently set print magnification is the print magnification set in S416.

[0070] In this embodiment, the paper size is set using the method shown in Fig. 6(d). That is, among the paper sizes where the length a of the long side of the object included in the captured image is equal to or less than the long side size A of the paper, and the length b of the short side of the object is equal to or less than the short side size B of the paper, the paper size where (Aa) + (Bb) is the smallest is set as the paper size to be used for printing.

[0071] In this embodiment, the print magnification is set to "fit paper size" and the aspect ratio is set to "fixed."

[0072] As an example, a case will be described where the dimension (length) b of the short side of an object is 170 mm and the dimension (length) a of the long side is 250 mm. Referring to the paper size information 300 shown in FIG. 3, the paper sizes for which the dimension (length) a of the long side of the object is equal to or less than the long side size A of the paper and the dimension (length) b of the short side of the object is equal to or less than the short side size B of the paper are A3, A4, B4, and B5. Of these paper sizes A3, A4, B4, and B5, the value of (Aa) + (Bb) is 297 mm for A3, 87 mm for A4, 201 mm for B4, and 19 mm for B5. Therefore, the print application 200 sets B5 as the paper size.

[0073] When the paper size is set to B5 (182 mm x 257 mm), of the long and short sides, the side for which the paper size magnification ratio for the target object (170 mm x 250 mm) is closest to 1 is the long side. Therefore, the print application 200 enlarges and corrects the image within the frame to fit the long side while keeping the aspect ratio fixed. In other words, the long side dimension (length) a and short side dimension (length) b of the image within the frame are multiplied by the magnification A / a. The short side becomes a blank space on the paper.

[0074] The print application 200 saves the set paper size, print settings, and the image within the frame after enlargement processing in the RAM 105 of the information processing apparatus 101.

[0075] If an instruction to transition to the print screen 800 is input in S417, that is, if the user operates the Next button 702 on the preview screen 700, the print application 200 proceeds to S418. If the user operates the Cancel button 703 on the preview screen 700, the print application 200 deletes the dimension information and the framed image stored in the RAM 105, returns to S403, and returns to the shooting screen 500 of FIG. 5(b).

[0076] In S418, the print application 200 displays a print screen 800. FIG. 8(a) is a diagram showing an example of the print screen 800. The print screen 800 has a "change settings" button 801, a print settings display area 802, a print button 803, a cancel button 804, and a back button 805. The "change settings" button 801 is a button for accepting an instruction to transition to a print settings screen 810. The print button 803 is a button for accepting an instruction to start printing. The back button 805 is a button for accepting an instruction to close the print settings screen 810 and return to the shooting screen (FIG. 6(a)). The cancel button 804 is a button for accepting an instruction to end this function.

[0077] The print setting display area 802 displays multiple setting items and the setting values ​​corresponding to each setting item. In the example of FIG. 8(a), the setting items displayed are "Number of copies: 1 copy," "Print range: Within borders," "Paper type: Plain paper," "Paper size: B5," "Magnification: Fit to paper," and "Aspect ratio: Fixed." Note that the print settings are not limited to this example and may include some of these setting items or other items. The paper size set and saved in S415 is reflected in the paper size item in the print setting display area 802.

[0078] In S419, if a print instruction is received from the user, that is, if the print button 803 on the print screen 800 is operated, the print application 200 proceeds to S423. If a button other than the print button is operated, the process proceeds to S420.

[0079] In S420, if an instruction to transition to the print setting screen 810 is received from the user, that is, if the operation of the "Change Settings" button 801 on the print screen 800 is received, the print application 200 proceeds to S421. The print setting screen 810 shown in FIG. 8(b) is displayed on the touch panel display 108. If the user inputs an operation other than an instruction to transition to the print setting screen 810, the process proceeds to S422. The processing on the print setting screen 810 (S421) will be described later.

[0080] In S422, if an instruction to transition to the image capture screen 500 is received from the user, that is, if the back button 805 on the print screen 800 is operated, the print application 200 proceeds to S403. In S403, the image capture screen 500 shown in FIG. 5B is displayed on the touch panel display 108. If the cancel button 804 is operated by the user, the print application 200 deletes the dimension information, the image within the frame, the paper settings, and the print settings stored in the RAM 105, and ends this flowchart.

[0081] In S423, the print application 200 transmits print setting information including the currently set paper size and the image (print data) within the frame after image processing to the communicatively connected printer 151. As a result, the printer 151 prints the image of the area within the frame surrounding the object on paper of the set paper size at the set magnification and aspect ratio.

[0082] The process executed on the print setting screen in S421 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of the print setting process. This flowchart starts when operation of the "Change settings" button 801 on the print screen 800 is accepted.

[0083] In S901, the print application 200 displays the print setting screen 810.

[0084] FIG. 8(b) is a diagram showing an example of a print setting screen 810. As shown in FIG. 8(b), the print setting screen 810 displays a print button 807, a cancel button 804, and a print setting list 806. The print setting list 806 displays multiple selectable setting items, and displays the currently set value for each setting item. When a setting item is selected, the screen transitions to a setting screen for the selected setting item. As with FIG. 8(a), the setting items include the number of copies, print range, paper type, paper size, magnification, and aspect ratio. Note that these setting items are only examples. The print button 807 is a button for accepting an instruction to proceed with printing after the setting changes have been completed. The cancel button 804 is a button for canceling the operation and ending the flowchart.

[0085] In S902, the print application 200 accepts an operation by the user. If the print button 807 is operated, the process proceeds to S903, and the print screen 800 is displayed. The print setting display area 802 of the print screen 800 reflects the values ​​set by the operation of the print setting screen 810.

[0086] If the cancel button 804 is operated in S902, the operation on the print setting screen 810 in Fig. 8(b) is canceled and this flowchart ends. After that, the process returns to the shooting screen 500 (S403). If a selection operation is performed on any of the setting items in S902, the process proceeds to S904.

[0087] In S904, the print application 200 displays a setting screen for the setting item selected in S902. For example, if the paper size setting 808 is selected, the print application 200 displays a paper size setting screen 820 on the touch panel display 108 in S904.

[0088] In S905, the print application 200 accepts a setting operation on the displayed setting screen. FIG. 8(c) is a diagram showing an example of a paper size setting screen 820. The paper size setting screen 820 in FIG. 8(c) displays a back button 809, a cancel button 804, and a paper size list 821. The paper size list 821 displays selectable paper sizes. In the example of FIG. 8(c), A3, A4, A5, B4, and B5 are displayed as selectable paper sizes. When one of the paper sizes is selected, the print application 200 changes the paper size information set and saved in RAM 105 to the selected paper size.

[0089] A back button 809 is a button for returning to the print setting screen 810 in FIG. 8(b). A cancel button 804 is a button for canceling the operation and ending the flowchart.

[0090] If the back button is operated in S906, the process proceeds to S901, and the print setting screen 810 of FIG. 8(b) is displayed on the touch panel display 108. The print setting list 806 on the print setting screen 810 is displayed with the paper size selected on the paper size setting screen 820 reflected. If the cancel button 804 is operated in S906, the operation on the paper size setting screen 820 of FIG. 8(b) is canceled, and this flowchart ends. Thereafter, the process returns to the shooting screen 500 (S403).

[0091] As described above, in the first embodiment, the print application 200 acquires the dimensions of an object included in a captured image and determines the paper size to use for printing based on the acquired dimensions. This eliminates the need for the user to set the paper size, improving usability. It also reduces the possibility that the user will print on the wrong paper size. Particularly in the first embodiment, the print application 200 requests the OS 250 to detect objects (features) included in the captured image and measure the dimensions of the detected objects, and acquires the dimensions of the detected and measured objects by the OS 250. This eliminates the need for the print application 200 to have a function for measuring dimensions, allowing the print application 200 to be configured simply.

[0092] In the above embodiment, the print magnification and aspect ratio are set to default values. That is, the print magnification is set to "fit paper size" and the aspect ratio is set to "fixed." However, the present invention is not limited to this example setting, and other settings may be used.

[0093] Specifically, possible setting examples are shown in Figures 10 and 11. In Figure 10, areas 1001 and 1001a shown in gray are areas of the target object (image within the frame), and area 1000 indicates the paper size.

[0094] (Setting example 1) FIG. 10(a) shows a case where the aspect ratio is set to "fixed" and the print magnification is set to "fit paper size." This is the setting example described in the first embodiment. That is, of the long and short sides, the magnification of the paper size (long side A, short side B) relative to the object dimensions (long side length a, short side length b) that is closer to 1 is set as the print magnification. The aspect ratio is fixed. If the long side magnification A / a is closer to 1 than the short side magnification B / b, the long side magnification A / a is set as the print magnification, as shown in FIG. 10(a). Therefore, the length of the long side of the enlarged image 1001a of the object matches the length of the long side of the paper. If the short side magnification B / b is closer to 1 than the long side magnification A / a, the short side magnification B / b is set as the print magnification. In this case, the length of the short side of the enlarged image 1001a of the object matches the length of the short side of the paper. The remaining area on the paper becomes a margin.

[0095] (Example 2) Figure 10(b) shows the case where the aspect ratio is set to "fixed" and the print magnification is set to "actual size." This is a pattern in which the dimensions of the object (length of the long side a, length of the short side b) are printed at actual size (100%), i.e., the actual dimensions, on the set paper size. Any remaining area on the paper becomes blank space.

[0096] (Example 3) FIG. 11(a) shows a case where the aspect ratio "fit to paper size" and the print magnification "fit to paper size" are set. In FIG. 11(a), the area 1101 shown in gray and dashed lines is the area of ​​the object (image within the frame), and the area 1100 shown in solid lines is the area of ​​the paper size. This shows a case where the dimensions of the object (image within the frame 1101) are larger than the paper size. For example, if the user changes the paper size in the print settings, the dimensions of the object (image within the frame) may become larger than the paper size. In the example of FIG. 11(a), the object (image within the frame) is reduced so that its dimensions (long side length a, short side length b) match the paper size (long side size A, short side size B), and is printed at the size of reduced image 1101a.

[0097] (Setting example 4) FIG. 11(b) shows another example of the aspect ratio "fit to paper size" and print magnification "fit to paper size." In FIG. 11(b), the area 1102 shown in gray and dashed lines is the area of ​​the object (image within the frame), and the area 1100 shown in solid lines is the area of ​​the paper size. Unlike FIG. 11(a), this example shows a case where the dimensions of the object (image within the frame 1102) are smaller than the paper size. In the example of FIG. 11(b), the dimensions (length of the long side a, length of the short side b) of the object (image within the frame) are enlarged so that they match the paper size (long side size A, short side size B), and it is printed at the size of the enlarged image 1102a.

[0098] In the description of the first embodiment, the print magnification and aspect ratio are set in advance, but they may also be selectable by the user. In this case, for example, the aspect ratio can be set to either "fixed" or "fit to paper" on the print setting screen 810 in FIG. 8(b). The print magnification can also be set to either "same size (100%)" or "fit to paper." Note that the aspect ratio and print magnification may also be configured to allow the user to set any value other than those described above.

[0099] Second Embodiment Next, an information processing device 101 according to a second embodiment will be described. In the first embodiment, the print application 200 uses the functions of the OS 250 to detect an object appearing on the shooting screen and acquire the dimensions of the object. However, depending on the OS 250 of the information processing device 101, there may be cases where the OS 250 does not support a function for detecting features from a captured image or a function for measuring the dimensions of the object. In the second embodiment, the print application 1200 accepts input of the dimensions of the object by the user.

[0100] 12 is a diagram showing the functional configuration of a print application 1200 in the second embodiment. The print application 1200 has a captured image acquisition unit 201, a dimension acquisition unit 1201, a paper size setting unit 203, a paper size storage unit 204, a print setting unit 205, an image processing unit 206, and a print job transmission unit 207. Since the units other than the dimension acquisition unit 1201 are the same as those in the first embodiment, their description will be omitted. Furthermore, since the hardware configuration of the information processing device 101 in the second embodiment is the same as that in the first embodiment, its description will be omitted. The following description will focus on the differences from the first embodiment.

[0101] In the second embodiment, the dimension acquisition unit 1201 receives input of the dimensions of an object by a user and acquires the input dimensions. The dimension acquisition unit 1201 displays a size input dialog 1310 for receiving input of the dimensions of the object on the touch panel display 108.

[0102] Fig. 13(a) is a diagram showing an example of a preview screen 1300 displayed in the print application 1200 of the second embodiment. The preview screen 1300 displays a print preview image 1301, a next button 1302, a cancel button 1303, and a size input button 1304. The difference from the preview screen 700 (Fig. 7) of the first embodiment is that the size input button 1304 is provided. When the print application 1200 accepts an operation of the size input button 1304 by the user, the print application 1200 displays a size input dialog 1310 as shown in Fig. 13(b) on the preview screen 1300 of Fig. 13(a).

[0103] 13(b), a guidance message 1311 for receiving input of the size of the object is displayed. Also provided are an input field 1312 for inputting the vertical size of the object and an input field 1313 for inputting the horizontal size. Also displayed are a cancel button 1314 and an OK button 1315.

[0104] The guidance message 1311 displays a message prompting the user to input the size of the object and a message explaining that the paper size will be determined based on the input size of the object. For example, the message may read, "Please input the size of the object to be photographed. *The paper size will be automatically determined based on the input size."

[0105] A cancel button 1314 is a button that accepts an instruction to cancel all operations in the size input dialog 1310. An OK button 1315 is a button that is operated when the values ​​input by the user in the input fields 1312 and 1313 are to be confirmed.

[0106] Next, the processing flow of the print application 1200 according to the second embodiment executed by the information processing device 101 will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the processing flow of the print application 1200 according to the second embodiment. The processing shown in this flowchart is performed by calling the program of the print application 1200 stored in the storage device 106 by the CPU 103 of the information processing device 101, expanding it in the RAM 105, and executing it by the CPU 103. The CPU 103 starts this processing when the user starts the print application 1200 and instructs the start of this function.

[0107] In S1401, the CPU 103 of the information processing device 101 displays the explanation screen 510 shown in FIG. 5(a) on the touch panel display 108, similarly to S401 (FIG. 4) in the first embodiment.

[0108] In S1402, when the user operates the OK button 508 on the instruction screen 510, the CPU 103 determines that an instruction to start shooting has been input, closes the instruction screen 510, and proceeds to S1403.

[0109] In S1403, the CPU 103 displays the photographing screen 500 shown in FIG. 5B. An image of an object 503 is captured within a photographable area 501 on the photographing screen 500. The print application 1200 then transmits a request to the OS 250 to detect feature points from the photographing screen 500. In the second embodiment, it is assumed that the OS 250 does not have a feature detection function. In this case, error information is transmitted from the OS 250.

[0110] In S1404, the print application 1200 receives an instruction from the user to move the positions of the feature points. The print application 1200 displays marks indicating the feature points 502a to 502d at each vertex of the captureable area 501 on the shooting screen 500. When these marks are moved by the user's slide operation, the print application 1200 moves and displays the marks to the new positions, and sets the new positions as the positions of the feature points 502a to 502d.

[0111] In S1405, if the capture button 504 on the capture screen 500 is operated, the print application 1200 determines that a capture instruction has been input, and proceeds to S1406. If the cancel button 505 on the capture screen 500 is operated, the processing of the print application 1200 ends.

[0112] In S1406, the print application 1200 displays a frame 506 indicating the area surrounded by the moved feature points 502a to 502d on the shooting screen 500. Then, the image within the frame is saved in the RAM 105. The image within the frame is considered to be the area of ​​the object.

[0113] In S1407, the print application 1200 displays the preview screen 1300 shown in Fig. 13(a). The image within the frame saved in S1406 is displayed on the preview screen 1300 as a print preview image 1301. Here, the print application 1200 requests the OS 250 to measure the dimensions of the long and short sides of the frame surrounding the object. In the second embodiment, the OS 250 does not support a dimension measurement function, so error information is sent from the OS 250.

[0114] In S1408, the print application 1200 accepts a user operation. If the size input button 1304 is operated, the process proceeds to S1409. If the next button 1302 is operated, the process proceeds to S417 in Fig. 4. If the cancel button 1303 is operated, the process of this flowchart and the flowchart in Fig. 4 ends.

[0115] In S1409, the print application 1200 displays the size input dialog 1310 shown in FIG.

[0116] In S1410, the print application 1200 accepts input of the dimensions of the object by the user. The user measures the dimensions of the object corresponding to the vertical size of the image within the frame displayed on the preview screen 1300 using a ruler or the like, and inputs the dimensions into a vertical size input field 1312. The user also measures the dimensions of the object corresponding to the horizontal size of the image within the frame using a ruler or the like, and inputs the dimensions into a horizontal size input field 1313.

[0117] If the OK button 1315 is operated in S1411, the process proceeds to S1412. If the cancel button 1314 is operated in S1411, the print application 1200 cancels the operation on the size input dialog, closes the size input dialog 1310, and returns to S1407.

[0118] In S1412, the print application 1200 acquires the values ​​entered in the input fields 1312 and 1313 as the dimensions of the long and short sides of the object and saves them in RAM 105. The print application 1200 sets the paper size based on the acquired dimensions of the long and short sides. The method for setting the paper size is the same as in the first embodiment, and any of the methods shown in FIG. 6 may be used.

[0119] In S1413, the print application 1200 corrects the image size so that the image within the frame is printed at a predetermined print magnification and aspect ratio on the paper size set in S1412. As in the first embodiment, the print magnification and aspect ratio are set to default values ​​that have been determined in advance. The default settings are a print magnification of "fit to paper" and an aspect ratio of "fixed." Note that the user may set any print magnification and aspect ratio.

[0120] In S1414, the print application 1200 closes the size input dialog 1310 and displays the preview screen 1300. The preview screen 1300 displays a print preview image that reflects the paper size set in S1412 and the image size correction made in S1413.

[0121] The subsequent processing is the same as the processing from S417 onwards in the first embodiment. That is, when the Next button 1302 is operated on the preview screen 1300, the print application 1200 transitions to the print screen 800. When the Print button 803 is operated on the print screen 800, the print setting information including the currently set paper size and the image (print data) within the frame after image size correction are sent to the printer 151, which is connected via communication. As a result, the image of the area within the frame surrounding the object is printed at a predetermined magnification and aspect ratio on paper of a paper size determined based on the dimensions set by the user.

[0122] As described above, in the second embodiment, the print application 1200 allows the user to input the dimensions of an object included in a captured image. The print application 1200 acquires the dimensions input by the user and determines the paper size to be used for printing based on the acquired dimensions. Therefore, even if the OS 250 does not have a function for detecting an object or a function for measuring the dimensions, it is possible to set a paper size appropriate for the dimensions of the object, enabling smooth printing. For example, if the user inputs the dimensions of the object in the print application 1200 and sets the print magnification to 1x and the aspect ratio to fixed, the print application 1200 sets the paper size based on the dimensions of the object. Then, an image of the same size as the dimensions of the object is printed on paper.

[0123] <Third embodiment> Next, an information processing device 101 according to a third embodiment will be described. Whether the OS 250 has a function for measuring dimensions can sometimes be determined based on the version of the OS 250. In the third embodiment, a dimension acquisition unit 1501 of the print application determines whether to request the OS 250 to acquire dimensions or to accept input from the user, based on the version information of the OS 250.

[0124] 15 is a diagram showing the arrangement of a dimension acquisition unit 1501 of a print application in the third embodiment. As shown in FIG. 15, the dimension acquisition unit 1501 has an OS version determination unit 1502 and an acquisition source switching unit 1503.

[0125] The OS version determination unit 1502 inquires of and acquires the version information of the OS 250. It is determined whether the acquired version information is a version that has a dimension measurement function.

[0126] The acquisition destination switching unit 1503 switches the acquisition destination of the dimensions based on the determination result by the OS version determination unit 1502. If the acquired version information is a version that has a dimension measurement function, the acquisition destination of the dimensions is set to the OS 250, and if the version does not have the dimension measurement function, the acquisition destination of the dimensions is set to the size input dialog displayed on the touch panel display 108. The size input dialog is the screen shown in FIG. 13(b) described in the second embodiment.

[0127] The configuration of the print application other than the dimension acquisition unit 1501 is the same as that of the first or second embodiment.

[0128] 16 is a flowchart showing the process flow for determining where to obtain the dimensions of an object included in the photographed image by the print application. This flowchart is executed, for example, before S401 in FIG. 4 or before S1401 in FIG. 14.

[0129] In step S1601, the print application acquires the version information of the OS 250 in the information processing apparatus 101.

[0130] In S1602, the print application determines whether the acquired version information is a predetermined version or higher. The predetermined version is a version that has a dimension measurement function, and version identification information is set in advance in the print application. If the version of the OS 250 of the information processing apparatus 101 is the predetermined version or higher, the process proceeds to S1603. If the version is an earlier version than the predetermined version, the process proceeds to S1604.

[0131] In S1603, the print application determines to acquire dimension information from the OS 250. In this case, the print application executes processing according to the flow shown in the flowchart of Fig. 4, as described in the first embodiment. Note that the content of the message on the explanation screen 510 displayed in S401 may be changed to a statement indicating that the OS 250 detects the object, such as "When an object is detected, the object will be automatically surrounded."

[0132] In S1604, the print application determines to accept dimension input by the user. In this case, the print application executes processing according to the flow shown in the flowchart of FIG. 14, as described in the second embodiment. Note that the content of the message on the instruction screen 510 displayed in S1401 may be changed to a statement that prompts the user to perform an operation, such as "Please select the shooting range by surrounding the object with a frame." The feature point detection request and dimension measurement request to the OS 250 may be omitted.

[0133] As described above, in the third embodiment, the print application changes the method of acquiring dimensions based on the version information of the OS 250 of the information processing device 101. Therefore, even in an information processing device that runs on a version of the OS 250 that does not support the dimension measurement function, the print application of the present disclosure can be used.

[0134] <Fourth embodiment> In the first to third embodiments, the print application determines the paper size based on the dimensions of the object captured on the shooting screen. However, if only one paper size can be set in the printer 151 or if the paper size cannot be changed due to a paper shortage or the like, the print application must print using the set, feedable paper size. In the fourth embodiment, the print application 1800 has a dimension acquisition unit 202 that acquires the dimensions of the object included in the captured image. The print application 1800 also has a print setting unit 1802 that sets the object to be printed using the dimensions acquired by the dimension acquisition unit 202 for the paper size set in the printer 151.

[0135] 17 is a diagram illustrating the concept of print settings in the fourth embodiment. As shown in the figure, the paper size is set to paper 1700 loaded in printer 151, and printing is performed so that the dimensions of object (image within frame) 1701 match the dimensions of the actual object. The setting items to be set in the print settings are "print magnification" and "aspect ratio," with "print magnification" set to "same size (100%)" and "aspect ratio" set to "fixed." For example, if the paper 1700 loaded in printer 151 is A4 size and the dimensions of the image within frame are postcard size (short side 100 mm x long side 148 mm), the image within frame 1701 is printed on A4 paper (short side 210 mm x long side 297 mm) with the postcard size dimensions (short side 100 mm x long side 148 mm). Also, for example, if the paper 1700 set in the printer 151 is B5 size (182 mm x 257 mm), the framed image 1701 is printed on the B5 size paper with the same dimensions as a postcard (short side 100 mm x long side 148 mm).

[0136] 18 is a diagram showing the functional configuration of a print application 1800 in the fourth embodiment. The print application 1800 has a captured image acquisition unit 201, a dimension acquisition unit 202, a paper size setting unit 1801, a paper size storage unit 204, a print setting unit 1802, an image processing unit 206, and a print job transmission unit 207. Similarly to the first embodiment, the OS 250 of the information processing device 101 has a feature detection unit 251 and a dimension measurement unit 252. It is also assumed that paper of a predetermined size is set in the printer 151 that is communicatively connected to the information processing device 101, and that paper size information 1851 for that paper is stored. The paper set in the printer 151 is paper that is in a state where it can be fed.

[0137] The units other than the paper size setting unit 1801 and print setting unit 1802 are the same as those in the first embodiment, and therefore their explanations will be omitted. Also, the hardware configuration of the information processing device 101 according to the fourth embodiment is the same as that in the first embodiment, and therefore its explanation will be omitted. The following explanation will focus on the differences from the first embodiment.

[0138] The paper size setting unit 1801 transmits a request to acquire paper size information to the printer 151. In response to the request from the information processing device 101, the printer 151 acquires paper size information 1851 of the loaded paper and transmits it to the requesting information processing device 101. The paper size setting unit 1801 sets the paper size indicated by the acquired paper size information 1851 as the paper size to be used for printing.

[0139] In the fourth embodiment, the print setting unit 1802 sets the object (image within the frame) to be printed with the dimensions acquired by the dimension acquisition unit 202 for the paper size of paper set in the printer 151. Specifically, the print setting unit 1802 sets the paper size to "set paper," the aspect ratio to "fixed," and the print magnification to "actual size." The image processing unit 206 executes image processing so that the object (image within the frame) is printed according to the paper size set in the paper size setting unit 1801 and the print settings (print magnification: actual size, aspect ratio: fixed) set in the print setting unit 1802.

[0140] The processing flow of the print application 1800 executed by the information processing device 101 will be described with reference to Fig. 19. Fig. 19 is a flowchart showing the processing flow of the print application 1800 according to the fourth embodiment. The processing shown in this flowchart is performed by calling the program of the print application 1800 stored in the storage device 106 by the CPU 103 of the information processing device 101, expanding it in the RAM 105, and executing it by the CPU 103. The CPU 103 starts this processing when the user starts the print application 1800 and instructs the start of this function.

[0141] Note that the processing of S1901 to S1914 is similar to S401 to S414 (FIG. 4) of the processing of the print application 1800 according to the first embodiment, and therefore detailed description thereof will be omitted. In S1901 to S1914, the print application 1800 requests the OS 250 to detect four feature points from the object captured on the capture screen 500 (FIG. 5(b)), and the OS 250 draws a frame around the area surrounded by the four feature points detected. If the OS 250 does not detect any feature points, or if the user wishes to change the position of the feature points, an instruction to move the position of the feature points is accepted. In this state, when the capture button 504 on the capture screen 500 is operated, the image within the frame is saved. In this state, the print application 1800 requests the OS 250 to measure the dimensions of the image within the frame, and acquires the dimensions of the long and short sides of the image within the frame from the OS 250. Thereafter, the process proceeds to S1914.

[0142] In S1914, the print application 1800 transmits a request to acquire the paper size to the printer 151 connected for communication. In S1915, the printer 151 acquires the paper size information 1851 of the paper currently set in the printer 151. It is assumed that the paper size information 1851 of the paper currently set in the printer 151 is held in the RAM 153 of the printer 151. In S1916, the printer 151 transmits the paper size information 1851 of the paper currently set in the printer 151 to the information processing apparatus 101.

[0143] In S1917, the print application 1800 sets the paper size indicated by the paper size information 1851 received from the printer 151 as the paper size to be used for printing.

[0144] In S1918, the print application 1800 performs print settings. In the fourth embodiment, for example, the print magnification is set to "same size (100%)" and the aspect ratio is set to "fixed."

[0145] In S1919, the print application 1800 corrects the image size so that printing is performed in accordance with the paper size set in S1917 and the print settings set in S1918. That is, image processing including enlargement or reduction is performed on the image within the frame so that the object (image within the frame) is printed at the same size as the acquired dimensions for the paper size currently set in the printer 151.

[0146] In S1920, the print application 1800 displays a print preview image of the image within the frame after image size correction on the preview screen 700 (FIG. 7). The subsequent processing is the same as the processing from S417 onwards in FIG. 4, and therefore description thereof will be omitted.

[0147] When a user inputs a print start instruction on the print screen 800 (FIG. 8), the print application 1800 sends a print job including print data and print setting information to the connected printer 151. The printer 151 executes printing processing on the set paper in accordance with the print setting information in accordance with the print job. As a result, an image of the object (image within the frame) is printed on the paper size of the paper set in the printer 151 with the dimensions of the object acquired by the print application 1800.

[0148] As described above, in the fourth embodiment, the print application 1800 acquires the dimensions of the area of ​​the object included in the captured image, and performs print settings so that the area of ​​the object is printed with the acquired dimensions on the paper size set in the printer 151. This makes it possible to print the photographed object in its actual dimensions on the paper size set in the printer 151.

[0149] In the above example, one type of paper size is set in the printer 151, and the print application 1800 acquires information on one type of paper size sent from the printer 151. However, the present invention is not limited to this example. Multiple paper sizes may be set in the printer 151. In this case, the print application 1800 may acquire information on all the paper sizes of the paper set in the printer 151, select one of the paper sizes, and set it as the paper size to be used for printing. The paper size may be selected by a user, or, as shown in the first embodiment, the paper size to be used for printing may be determined using one of multiple paper size determination methods.

[0150] 18 and 19 show an example in which information on dimensions of an object is acquired from the OS 250, but this is not limiting. As shown in the second embodiment, input of dimensions by a user may be accepted. Furthermore, as shown in the third embodiment, it may be determined whether information on dimensions of an object is acquired from the OS 250 or whether the user inputs the dimension information depending on the version of the OS 250. Furthermore, print settings are not limited to the print magnification "actual size (100%)" and the aspect ratio "fixed," and the print magnification and aspect ratio may be adjusted to fit the paper. Furthermore, the print magnification and aspect ratio can be changed by the user.

[0151] Furthermore, the screen examples, processing procedures, etc. in the above-described embodiments are merely examples and can be changed as appropriate.

[0152] <Other embodiments> The present disclosure can also be realized by providing a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0153] The disclosure of the above-described embodiment includes the following configurations. (Configuration 1) A program for causing a computer of an information processing device to execute a control method, The control method includes: an acquisition step of acquiring dimensions of an object included in the captured image; a setting step of setting a paper size of paper to be used for printing the object based on the dimensions of the object acquired in the acquisition step; A program comprising:

[0154] (Configuration 2) In the obtaining step, The program according to configuration 1, characterized in that it requests an operating system of the information processing device to acquire dimensions of the object included in the captured image, and acquires the dimensions of the object measured by the operating system.

[0155] (Configuration 3) In the obtaining step, 2. The program according to configuration 1, wherein the program accepts input of dimensions of the object by a user, and acquires the dimensions input by the user as the dimensions of the object.

[0156] (Configuration 4) The program according to configuration 1 or 2, further comprising a decision step of deciding whether to acquire the dimensions of the object from the operating system based on version information of the operating system of the information processing device, or to accept input of the dimensions of the object by a user.

[0157] (Configuration 5) The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, A program according to any one of configurations 1 to 4, characterized in that, among paper sizes where the length a of the long side of the area of ​​the object is less than or equal to the long side size A of the paper and the length b of the short side of the area of ​​the object is less than or equal to the short side size B of the paper, the paper size where the sum of the difference between the long side size A of the paper and the length a of the long side of the object and the difference between the short side size B of the paper and the length b of the short side of the object is the smallest is set as the paper size to be used for printing.

[0158] (Configuration 6) The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, A program according to any one of configurations 1 to 4, characterized in that, from among one or more candidate paper sizes in which the length a of the long side of the area of ​​the object is equal to or less than the long side size A of the paper, the paper size in which the length b of the short side of the area of ​​the object is equal to or less than the short side size B of the paper and the length b of the short side of the area of ​​the object is closest to the short side size B of the paper is set as the paper size to be used for printing.

[0159] (Configuration 7) The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, The program according to any one of configurations 1 to 4, characterized in that, from among one or more candidate paper sizes in which the length b of the short side of the object area is equal to or less than the short side size B of the paper, the paper size in which the length a of the long side of the object area is equal to or less than the long side size A of the paper and the length a of the long side of the object area is closest to the long side size A of the paper is set as the paper size to be used for printing.

[0160] (Configuration 8) The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, Among one or more candidate paper sizes in which the length a of the long side of the area of ​​the object is equal to or less than the long side size A of the paper, a paper size in which the length b of the short side of the area of ​​the object is equal to or less than the short side size B of the paper and the length b of the short side of the area of ​​the object is closest to the short side size B of the paper; Among one or more candidate paper sizes in which the length b of the short side of the area of ​​the object is equal to or less than the short side size B of the paper, a paper size in which the length a of the long side of the area of ​​the object is equal to or less than the long side size A of the paper and the length a of the long side of the area of ​​the object is closest to the long side size A of the paper; The program according to any one of configurations 1 to 4, characterized in that the paper size having the smaller sum of the long side size A of the paper and the short side size B of the paper is set as the paper size to be used for printing.

[0161] (Configuration 9) The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, The program according to any one of configurations 1 to 4, characterized in that in the setting step, a paper size whose long side size or short side size is closest to the length of the long side or short side of the area of ​​the target object is set as the paper size to be used for printing.

[0162] (Configuration 10) a print setting step of accepting print settings by a user; an image processing step of executing image processing based on the print settings received in the print setting step so that the area of ​​the object included in the captured image is printed; 10. The program according to any one of configurations 1 to 9, further comprising:

[0163] (Configuration 11) 11. The program according to configuration 10, wherein the print settings in the print setting step include a print magnification setting.

[0164] (Configuration 12) The program described in configuration 11, characterized in that in the print setting process, a selection is accepted as to whether the print magnification of the object area is to be the same as the dimensions of the object acquired in the acquisition process, or to be a magnification that matches the paper.

[0165] (Configuration 13) In the print setting step, if the print magnification of the area of ​​the object is set to match the paper, The program described in configuration 12 is characterized in that the printing magnification of the area of ​​the object is set to a magnification closest to 1 out of the magnification when aligned with the long side of the paper size set in the setting process and the magnification when aligned with the short side.

[0166] (Configuration 14) 11. The program according to configuration 10, wherein the print settings in the print setting step include setting of an aspect ratio.

[0167] (Configuration 15) 15. The program according to configuration 14, wherein the print setting step accepts a selection of whether to fix the aspect ratio or to fit the aspect ratio to the paper.

[0168] (Configuration 16) When the aspect ratio of the area of ​​the object is set to match the aspect ratio of the paper in the print setting step, 16. The program according to claim 15, wherein in the image processing step, the image of the area of ​​the object is corrected so that it matches the aspect ratio of the paper size set in the setting step.

[0169] (Configuration 17) A program for causing a computer of an information processing device to execute a control method, The control method includes: an acquisition step of acquiring dimensions of an object included in the captured image; a print setting step of setting the object so that it is printed with the dimensions of the object acquired in the acquisition step for a paper size of paper set in a printing device communicatively connected to the information processing device; A program comprising:

[0170] (Configuration 18) The program described in configuration 17, characterized in that the print setting process includes a process of requesting information on the paper size of the paper set to the printing device and obtaining information on the paper size of the paper set from the printing device.

[0171] (Configuration 19) In the obtaining step, The program described in configuration 17 or 18, characterized in that it requests an operating system of the information processing device to obtain dimensions of the object included in the captured image, and obtains the dimensions of the object measured by the operating system.

[0172] (Configuration 20) In the obtaining step, 19. The program according to configuration 17 or 18, wherein the program accepts input of dimensions of the object by a user, and acquires the dimensions input by the user as the dimensions of the object.

[0173] (Configuration 21) an acquisition means for acquiring dimensions of an object included in a captured image; a setting means for setting a paper size of paper to be used for printing the object based on the dimensions of the object acquired by the acquisition means; An information processing device comprising:

[0174] (Configuration 22) an acquisition means for acquiring dimensions of an object included in a captured image; a print setting means for setting the object so that it is printed with the dimensions of the object acquired by the acquisition means for the paper size of paper set in a printing device communicatively connected to the information processing device; An information processing device comprising:

[0175] (Configuration 23) A control method for an information processing device, comprising: an acquisition step of acquiring dimensions of an object included in the captured image; a setting step of setting a paper size of paper to be used for printing the object based on the dimensions of the object acquired in the acquisition step; A control method comprising:

[0176] (Configuration 24) A control method for an information processing device, comprising: an acquisition step of acquiring dimensions of an object included in the captured image; a print setting step of setting the object so that it is printed with the dimensions of the object acquired in the acquisition step for a paper size of paper set in a printing device communicatively connected to the information processing device; A control method comprising:

Claims

1. A program for causing a computer of an information processing device to execute a control method, The control method includes: an acquisition step of acquiring dimensions of an object included in the captured image; a setting step of setting a paper size of paper to be used for printing the object based on the dimensions of the object acquired in the acquisition step; A program comprising:

2. In the obtaining step, The program according to claim 1, characterized in that it requests an operating system of the information processing device to obtain dimensions of the object contained in the captured image, and obtains the dimensions of the object measured by the operating system.

3. In the obtaining step, 2. The program according to claim 1, further comprising: receiving input of dimensions of the object by a user; and acquiring the dimensions input by the user as the dimensions of the object.

4. The program according to claim 1, further comprising a decision step of deciding whether to obtain the dimensions of the object from the operating system based on version information of the operating system of the information processing device or to accept input of the dimensions of the object by the user.

5. The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, The program described in claim 1, characterized in that, among paper sizes where the length a of the long side of the object area is less than or equal to the long side size A of the paper and the length b of the short side of the object area is less than or equal to the short side size B of the paper, the paper size where the sum of the difference between the long side size A of the paper and the length a of the object's long side and the difference between the short side size B of the paper and the length b of the object's short side is the smallest is set as the paper size to be used for printing.

6. The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, The program described in claim 1, characterized in that, among one or more candidate paper sizes in which the length a of the long side of the object area is less than the long side size A of the paper, the paper size in which the length b of the short side of the object area is less than the short side size B of the paper and the length b of the short side of the object area is closest to the short side size B of the paper is set as the paper size to be used for printing.

7. The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, The program described in claim 1, characterized in that, among one or more candidate paper sizes in which the length b of the short side of the object area is less than the short side size B of the paper, the paper size in which the length a of the long side of the object area is less than the long side size A of the paper and the length a of the long side of the object area is closest to the long side size A of the paper is set as the paper size to be used for printing.

8. The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, In the setting step, Among one or more candidate paper sizes in which the length a of the long side of the area of ​​the object is equal to or less than the long side size A of the paper, a paper size in which the length b of the short side of the area of ​​the object is equal to or less than the short side size B of the paper and the length b of the short side of the area of ​​the object is closest to the short side size B of the paper; Among one or more candidate paper sizes in which the length b of the short side of the area of ​​the object is equal to or less than the short side size B of the paper, a paper size in which the length a of the long side of the area of ​​the object is equal to or less than the long side size A of the paper and the length a of the long side of the area of ​​the object is closest to the long side size A of the paper; 2. The program according to claim 1, wherein the paper size having the smaller sum of the long side size A and the short side size B is set as the paper size to be used for printing.

9. The long side size and the short side size are stored in advance for each of a plurality of different paper sizes, 2. The program according to claim 1, wherein in the setting step, a paper size whose long side size or short side size is closest to the length of the long side or short side of the area of ​​the object is set as the paper size to be used for printing.

10. a print setting step of accepting print settings by a user; an image processing step of executing image processing based on the print settings received in the print setting step so that the area of ​​the object included in the captured image is printed; 2. The program of claim 1, further comprising:

11. 11. The program according to claim 10, wherein the print settings in the print setting step include a print magnification setting.

12. The program according to claim 11, characterized in that in the print setting process, a selection is accepted as to whether the print magnification of the area of ​​the object is to be the same as the dimensions of the object acquired in the acquisition process, or to be a magnification that matches the paper.

13. In the print setting step, if the print magnification of the area of ​​the object is set to match the paper, The program according to claim 12, characterized in that the printing magnification of the area of ​​the object is set to a magnification that is closest to 1 out of the magnification when aligned with the long side of the paper size set in the setting process and the magnification when aligned with the short side.

14. 11. The program according to claim 10, wherein the print settings in the print setting step include setting of an aspect ratio.

15. 15. The program according to claim 14, wherein the print setting step accepts a selection of whether the aspect ratio is fixed or adjusted to fit the paper.

16. When the aspect ratio of the area of ​​the object is set to match the aspect ratio of the paper in the print setting step, 16. The program according to claim 15, wherein the image processing step corrects the image of the object area so that it matches the aspect ratio of the paper size set in the setting step.

17. A program for causing a computer of an information processing device to execute a control method, The control method includes: an acquisition step of acquiring dimensions of an object included in the captured image; a print setting step of setting the object so that it is printed with the dimensions of the object acquired in the acquisition step for a paper size of paper set in a printing device communicatively connected to the information processing device; A program comprising:

18. 18. The program according to claim 17, wherein the print setting step includes a step of requesting information on the paper size of the paper set in the printing device and acquiring the information on the paper size of the paper set in the printing device from the printing device.

19. In the obtaining step, The program according to claim 17, characterized in that it requests an operating system of the information processing device to obtain dimensions of the object contained in the captured image, and obtains the dimensions of the object measured by the operating system.

20. In the obtaining step, 18. The program according to claim 17, further comprising: receiving input of dimensions of the object by a user; and acquiring the dimensions input by the user as the dimensions of the object.

21. an acquisition means for acquiring dimensions of an object included in a captured image; a setting means for setting a paper size of paper to be used for printing the object based on the dimensions of the object acquired by the acquisition means; An information processing device comprising:

22. an acquisition means for acquiring dimensions of an object included in a captured image; a print setting means for setting the object so that it is printed with the dimensions of the object acquired by the acquisition means for the paper size of paper set in a printing device communicatively connected to the information processing device; An information processing device comprising:

23. A control method for an information processing device, comprising: an acquisition step of acquiring dimensions of an object included in the captured image; a setting step of setting a paper size of paper to be used for printing the object based on the dimensions of the object acquired in the acquisition step; A control method comprising:

24. A control method for an information processing device, comprising: an acquisition step of acquiring dimensions of an object included in the captured image; a print setting step of setting the object so that it is printed with the dimensions of the object acquired in the acquisition step for a paper size of paper set in a printing device communicatively connected to the information processing device; A control method comprising:

Images