Media size detection system, method, and program

Abstract

To determine whether a medium identification display set on a loading tray coincides with a size of a medium actually accommodated in the loading tray, and when they do not coincide, to display guidance and enable adjustment of the medium size set on the loading tray.SOLUTION: A media size detection system of the present disclosure includes: display determination means for analyzing a captured image including a medium identification display displayed on a loading tray and an actual medium size of the media actually accommodated in the loading tray, and determining whether or not the medium identification display matches the actual medium size; and processing execution means for performing processing according to a comparison result with the actual medium size.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a media size detection system, method, and program. [Background technology]

[0002] Patent Document 1 discloses a media supplying device in which the display of media size is changed by rotating a dial so that a user can check the size of the media stored in the loading tray from outside. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-112449 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, for example, there are cases where the media size display set according to Patent Document 1 and the like does not match the size of the media actually stored in the stacking tray. If the media size display does not match the actual size of the stored media, there is an issue that it becomes difficult for the user to determine what sheet size is stored in which stacking tray. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the media size detection system of the first disclosure is characterized by comprising (1) a display determination means for analyzing a captured image including a media identification indication displayed on a loading tray and an actual media size of the media actually contained in the loading tray, and determining whether the media identification indication matches the actual media size, and (2) a processing execution means for performing processing according to the comparison result with the actual media size.

[0006] The second media size detection method of the present disclosure is characterized in that (1) a display determination means analyzes a captured image including a media identification display displayed on the loading tray and the actual media size of the media actually contained in the loading tray to determine whether the media identification display and the actual media size match, and (2) a processing execution means performs processing according to the comparison result with the actual media size.

[0007] The third media size detection program of the present disclosure is characterized in that it causes a computer to function as (1) a display determination means that analyzes a captured image including a media identification indication displayed on a loading tray and the actual media size of the media actually contained in the loading tray, and determines whether the media identification indication matches the actual media size, and (2) a processing execution means that performs processing according to the comparison result with the actual media size. Effect of the Invention

[0008] According to the present disclosure, it is possible to determine whether the media identification display set on the loading tray matches the size of the media actually contained in the loading tray, and if there is a mismatch, guidance is displayed to adjust the media size to be set on the loading tray. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an internal configuration of an image forming apparatus according to an embodiment; [Diagram 2] 1 is a diagram showing an overall configuration of a printing system according to an embodiment; [Diagram 3] FIG. 2 is a diagram showing a configuration of a loading tray according to the embodiment; [Figure 4] FIG. 2 is a front view showing a configuration of a loading tray according to the embodiment. [Diagram 5] FIG. 2 is a configuration diagram showing a configuration of a dial of a sheet size setting unit according to the first embodiment. [Figure 6] 5 is a flowchart showing an operation of automatic sheet size detection processing in the image forming apparatus according to the first embodiment. [Figure 7]4 is a screen diagram showing an image of a loading tray captured by a camera of a mobile terminal in the first embodiment. FIG. [Figure 8] 5 is an explanatory diagram illustrating an image correction marker provided on a guide of a loading tray in the first embodiment. FIG. [Figure 9] FIG. 11 is a smiling diagram illustrating a comparison between the actual sheet size of a stacking tray and the selected sheet size desired by a user in an augmented reality display in the first embodiment. [Figure 10] FIG. 11 is an explanatory diagram for explaining a method for changing a folded display in the second embodiment. [Figure 11] 10 is a flowchart showing an operation of an automatic sheet size detection process in an image forming apparatus according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (A) First embodiment A first embodiment of a media size detection system, method, and program according to the present disclosure will be described below with reference to the drawings.

[0011] In the first embodiment, the present disclosure is applied to an image forming apparatus having a stacking tray as a print medium storage device. Note that the present disclosure can also be applied to other devices that form images on sheets as print media.

[0012] (A-1) Configuration of the First Embodiment (A-1-1) Overall composition FIG. 2 is a diagram showing the overall configuration of a printing system according to an embodiment.

[0013] 2, a printing system 10 according to the first embodiment includes an image forming apparatus 100 and a mobile terminal 201 operated by a user 200. The image forming apparatus 100 includes a mobile terminal 201 that is operated by a user 200.

[0014] Image forming apparatus 100 and mobile terminal 201 can transmit and receive information using a predetermined communication method. The communication method is not particularly limited, and for example, a wireless network (e.g., WiFi (registered trademark)) using standard technology such as IEEE802.11 (n / ac / ax) can be applied. Note that, although a case where a wireless communication method is applied is illustrated here, a wired communication method may also be applied.

[0015] [Mobile device 201] The mobile terminal 201 is an information communication terminal operated by the user 200, and has at least a communication function, a camera function, a calculation processing function, an operation function, a display function, etc. The mobile terminal 201 may be, for example, a smartphone, a personal computer, a tablet terminal, a wearable terminal, etc.

[0016] The mobile terminal 201 is assumed to have pre-installed print processing application software 1 (hereinafter also referred to as the "print app" as an abbreviation) for performing print processing using the image forming device 100, and sheet size detection application software 2 (hereinafter also referred to as the "sheet size detection app") as a media size detection system (or media size detection program).

[0017] The print application 1 and the sheet size detection application 2 may be different software, or the print application 1 may include the function of the sheet size detection application 2 as one of its functions.

[0018] The sheet size detection application 2 includes a display determination unit 21, a selected medium determination unit 22, and a process execution unit .

[0019] The display determination means 21 analyzes a captured image including the media size display (also called the media identification display) displayed on the loading tray 301 and the size of the media actually contained in the loading tray 301, and determines whether the media size display matches the actual media size.

[0020] Here, the medium identification indication includes a medium size indication including the medium size and the orientation of the medium.

[0021] The selected medium determination means 22 determines whether the size of the selected medium desired to be printed, input by the user, matches the actual size of the medium actually contained in the stacking tray 301.

[0022] The processing execution means 23 performs processing according to the result of the comparison with the actual medium size.

[0023] Mobile terminal 201 starts a print application, selects a sheet size desired by the user, and instructs print processing by transmitting image data to image forming apparatus 100. Mobile terminal 201 also starts a print application, which photographs the stacking tray of image forming apparatus 100, determines whether the sheet size set on the stacking tray of image forming apparatus 100 is the same as the sheet size desired by the user, and displays the result of the determination.

[0024] The processing of the printing application 1 performed on the mobile terminal 201 will be described in detail in the operation section. If the sheet size set in the stacking tray 301 differs from the sheet size desired by the user, the printing application 1 further determines whether the sheet size setting indicating the sheet size to be accommodated in the stacking tray is incorrect and displays the result.

[0025] When the sheet size setting of the stacking tray is incorrect, the print application 1 displays a correction method for correcting the display of the sheet size setting of the stacking tray to the correct display. On the other hand, when the sheet size setting of the stacking tray is not incorrect, the print application 1 determines whether the sheet size actually stored in the stacking tray matches the sheet size desired by the user.

[0026] [Image forming apparatus 100] The image forming apparatus 100 is, for example, a color image forming apparatus that employs an electrophotographic system, and prints an image based on input print data.

[0027] The image forming apparatus 100 starts printing according to the sheet size instructed from the mobile terminal 201. The image forming apparatus 100 forms and outputs an image on a sheet based on the print data received from the mobile terminal 201 by a predetermined communication method.

[0028] (A-1-2) Detailed configuration of the image forming device FIG. 1 is a diagram showing the internal configuration of an image forming apparatus 100 according to an embodiment.

[0029] 1, image forming apparatus 100 has one or more (two in the example of FIG. 1) stacking trays 301, paper feed rollers 101, a hopper 102, transport rollers 103L, transport rollers 103U, image forming unit 104, fixing unit 107, discharge rollers 108, medium discharge section 109, and medium stacker 110. Image forming apparatus 100 also has a transport path S formed in a roughly S-shape with respect to an internal lower frame.

[0030] The stacking tray 301 accommodates sheets P as print media. Fig. 2 illustrates an example in which the image forming apparatus 100 includes two stacking trays 301. The number of stacking trays 301 is not particularly limited, and may be one, or may be three or more.

[0031] In the first embodiment, the loading tray 301 includes a sheet size setting unit inside which is provided a sheet size detection unit that detects the sheet size of the sheet P contained in the loading tray 301, and a dial 600 (see FIG. 5) that displays the sheet size contained in the loading tray 301 based on the detection result of the sheet size detection unit.

[0032] As will be described later, in order to allow a user to check the sheet size of the stacking tray 301, an opening 304 (see FIG. 3) provided in the stacking tray 301 displays the sheet size indicated by a dial 600 as exemplified in FIG. 5. The opening 304 exposes the display of the dial 600, allowing the user to recognize the sheet size of the stacking tray 301. Note that the detailed configuration of the sheet size setting unit can be widely applied to existing technologies, and for example, the one described in Patent Document 1 can be applied.

[0033] The paper feed roller 101 is a roller member for, during printing, picking up sheets P one by one from the stack tray 301. The paper feed roller 101 picks up the sheet P in the direction of the arrow X shown in FIG.

[0034] The hopper 102 is a member that presses down the sheets P fed by the sheet feed roller 101 in order to reliably feed the sheets one by one.

[0035] The conveying roller 103L is a roller member that conveys the sheet P fed by the sheet feeding roller 101 to the conveying path S.

[0036] The conveying roller 103U is a roller member that conveys the conveyed sheet P to a conveying path in which the image forming unit 104 is provided.

[0037] The belt unit 106 is an endless belt, and is supported by, for example, a belt drive roller, a belt support roller as a driven roller, and a transfer roller of each image forming section 105 of the image forming unit 104. The belt unit 106 transports the sheet P along the transport path S while each of the four image forming sections 105 of the image forming unit transfers a toner image onto the sheet P as a print medium.

[0038] The image forming unit 104 is a unit having a plurality of image forming sections 105. In the example of FIG. 1, the image forming unit 104 includes four image forming sections 105 having different colors of toner as developer, and the four image forming sections 105 are arranged in order along the conveying path S. Each image forming section 105 of the image forming unit 104 forms an image based on input image data on one surface (e.g., the upper surface) of the sheet P being conveyed. The number and arrangement order of the image forming sections 105 are not particularly limited.

[0039] The fixing unit 107 is equipped with a fixing roller 107a having a heater and a pressure roller 107b, and applies heat and pressure to a developer image (toner image) formed on one side of the sheet P transported from the image forming unit 104, thereby fixing the image onto one side of the sheet P.

[0040] The discharge rollers 108 are roller members that transport the sheet P that has passed through the fixing unit 107 to a medium discharge section 109 .

[0041] The medium discharge unit 109 discharges the sheet P conveyed by the discharge rollers 108 to the outside of the image forming apparatus 100.

[0042] The medium stacker 110 is a stacking unit that stacks the sheets P discharged from the medium discharge unit 109.

[0043] (A-1-3) Configuration of loading tray 3 is a configuration diagram showing the configuration of the stacking tray 301 according to the embodiment. FIG. 3 is a plan view of the stacking tray 301 pulled out from the image forming apparatus 100.

[0044] As illustrated in FIG. 3, the stacking tray 301 has guide portions 302 arranged on three sides (that is, three sides) of the sheets P accommodated therein.

[0045] As described above, the stacking tray 301 has a sheet size setting section for setting the sheet size of the stored sheets P, and has an opening 304 for exposing a dial display indicated by the dial 600 of the sheet size setting section.

[0046] In the example of FIG. 3, the opening 304 is disposed on the left end side of the gripping portion 401 of the loading tray 301, but the position of the opening 304 is not particularly limited.

[0047] FIG. 4 is a front view showing the configuration of the loading tray 301 according to the embodiment.

[0048] 4 illustrates a case where an opening 403 exposing the dial display of dial 600 is provided on front surface 402 of gripping portion 401. Note that, in the example of Fig. 4, a case where opening 403 is provided on the right end side of gripping portion 401 of stacking tray 301 is illustrated, but the position of opening 403 is not particularly limited.

[0049] In this embodiment, the loading tray 301 is illustrated as having both the opening 304 in FIG. 3 and the opening 403 in FIG. 4 as openings through which a user can expose the sheet size of the sheets P contained in the loading tray 301, but it is sufficient if it has at least the opening 304 in FIG. 3.

[0050] In addition, in the first embodiment, both opening 304 in FIG. 3 and opening 403 in FIG. 4 are shown as exposing the dial display of dial 600. However, for example, instead of opening 304 in FIG. 3 and opening 403 in FIG. 4, a pocket formed of paper, plastic material, or the like into which a dedicated foldable display indicating various sheet sizes can be inserted or removed may be used.

[0051] FIG. 5 is a diagram showing the configuration of the dial 600 of the sheet size setting unit according to the first embodiment.

[0052] The configuration of the dial 600 of the sheet size setting unit is an example, and is not limited thereto and can be widely applied. For example, the one disclosed in Patent Document 1 can be applied. Here, the configuration of the dial 600 related to this embodiment will be described with reference to FIG. 5.

[0053] 5, dial 600 is rotatable around a rotation axis 601. Dial 600 is a combination of a cylindrical display portion 602, a substantially disk-shaped rotation locking portion 603, and a substantially disk-shaped dial protrusion portion (protrusion forming portion) 604, all of which are coaxially combined with each other.

[0054] The dial protrusion 604 has a protrusion 604a (convex portion) and a recessed portion 604b (recessed portion). A detection switch (not shown) detects the sheet size, and the dial protrusion 604 changes the pattern of engaging the protrusion 604a and the recessed portion 604b of the dial protrusion 604 according to the detected sheet size, thereby changing the dial display of the display unit 602. The engaged portion 603a is an engaged portion of the dial 600.

[0055] The display unit 602 has sheet size information written on the surface of a cylindrical member. For example, the display unit 602 has sheet sizes such as "A3", "A4", "A5", the orientation of the sheets stored in the stacking tray 301 (e.g., vertical, horizontal, etc.), and a two-dimensional code (e.g., QR code (registered trademark)) including the sheet size information of the sheet size and the sheet orientation, each corresponding to each other. Note that the sheet size information is not limited to the above. For example, if sheets other than the sheet sizes prepared in advance are stored in the stacking tray 301, "OTHER" indicating other sheet sizes may be included.

[0056] (A-2) Operation of the First Embodiment Next, the operation of the automatic sheet size detection process in the image forming apparatus 100 of this embodiment will be described with reference to the drawings.

[0057] FIG. 6 is a flowchart showing the operation of the automatic sheet size detection process in the image forming apparatus 100 according to the first embodiment.

[0058] [S901~S903] In the mobile terminal 201, the user 200 operates the mobile terminal 201 to start the installed sheet size detection application 2 (S901). Then, in the started sheet size detection application 2, the user 200 selects the sheet size to be printed (S902) and the printer (image forming device 100) to be used for printing (S903).

[0059] [S904~S907] Thereafter, the user activates the camera function of the mobile terminal 201, and takes an image of the loading tray 301 from directly above the loading tray 301 so that the image shows the sheet size of the sheets P set on the loading tray 301 and the opening 304 through which the dial display of the sheet size can be confirmed (S904).

[0060] The sheet size detection application 2 of the mobile terminal 201 corrects the distortion of the image (S905), and uses the corrected image to identify the sheet size of the stacking tray 301 (S906), and displays the identified sheet size on the display unit of the mobile terminal 201, such as an LCD display (S907).

[0061] An example of the process from S904 to S907 will be described with reference to the drawings. For example, as shown in Fig. 7, when the loading tray 301 is photographed by the camera of the mobile terminal 201, a dial display (sheet size) portion 501 exposed in the opening 304 of the loading tray 301 and a sheet size portion 502 of the sheet P accommodated in the loading tray 301 are photographed in the image.

[0062] For example, by photographing a portion including the three guide portions 302 of the stacking tray 301 as the portion 502, the sheet size of the sheets P actually stored can be identified.

[0063] That is, the sheet size detection application 2 can identify the sheet size of the sheet P from the size of the sheet storage space formed by the three guide portions 302. At this time, if distortion occurs in the image, it will affect the accurate identification of the sheet size, so as illustrated in FIG. 8, an image correction marker 701 is provided on each of the three guide portions 302. The sheet size detection application 2 performs keystone correction processing by performing coordinate conversion on the positions of the three image correction markers 701 on the image. This allows the sheet size detection application 2 to identify the actual sheet size using the corrected image.

[0064] Although the keystone correction process is shown here as an example of the image correction process, other image correction processes may be used. The process of deriving the sheet size from the size of the sheet storage space formed by the three guide parts 302 is not particularly limited and existing technologies can be widely applied. For example, the sheet size and the installation orientation of the sheet can be identified from the ratio of the vertical length to the horizontal length of the rectangular shape surrounded by the three guide parts 302 on the image.

[0065] [S908] In the mobile terminal 201, the sheet size detection application 2 determines whether the sheet size selected by the user in S902 (hereinafter also referred to as the "selected sheet size") matches the sheet size actually contained in the loading tray 301 identified in S906 (hereinafter also referred to as the "actual sheet size") (S908).

[0066] If they match, the process proceeds to S909, and if they do not match, the process proceeds to S910.

[0067] [S909] If the selected sheet size and the actual sheet size match (S908 / Match), the sheet size of the stack tray 301 is the sheet size desired by the user, so the sheet size detection application 2 of the mobile terminal 201 notifies the image forming apparatus 100 of the sheet size (S909) and starts printing. The subsequent printing process is an existing process, so a detailed description will be omitted here.

[0068] [S910] If the selected sheet size does not match the actual sheet size (S908 / mismatch), the sheet size detection application 2 determines whether the sheet size setting set in the stacking tray 301 matches the actual sheet size of the stacking tray 301 (S910). If they match, the process proceeds to S913, and if they do not match, the process proceeds to S911.

[0069] Here, a process for determining whether the sheet size setting of the stacking tray 301 matches the actual sheet size will be described.

[0070] For example, if the loading tray 301 is one in which the sheet size can be set, the sheet size setting of the loading tray 301 does not necessarily match the size of the sheets actually stored therein, and it may occur that the sheet size setting does not match the actual sheet size.

[0071] Since a user performs printing while looking at the display of the opening 304 or 403, if the sheet size setting displayed on the opening 403 of the stacking tray 301 does not match the actual sheet size, the user ends up printing in a sheet size that is not desired by the user.

[0072] Therefore, in the first embodiment, the sheet size detection application 2 analyzes the image area of ​​the portion 501 in the captured image to recognize the display of the opening 304, and also checks whether the sheet size setting of the stacking tray 301 matches the actual sheet size of the stacking tray 301. As a result, when the sheet size setting does not match the actual sheet size, a method for changing the sheet size setting is displayed on the display unit of the mobile terminal 201, and the user can be prompted to change to the correct sheet size setting.

[0073] [S911, S912] When the sheet size setting and the actual sheet size do not match (S910 / mismatch), the sheet size detection application 2 instructs the mobile terminal 201 on how to change the sheet size setting of the stacking tray 301.

[0074] In the first embodiment, since the sheet size is set by a dial, the direction and number of rotations of the dial 600 are instructed (S911) by the mobile terminal 201. Following the instruction, the user rotates the dial 600 (S912).

[0075] After completing the change of the sheet size setting, the process returns to S904, where the user takes an image of the stacking tray 301 and repeats the process.

[0076] Regarding the direction and number of times to rotate the dial 600, the sheet size detection application 2 takes into consideration the order of the sheet size information written on the display section 602 of the dial 600, and derives and outputs the closest direction of rotation (first rotation direction, or second rotation direction opposite to the first rotation direction) to achieve the actual sheet size and the number of times to rotate the dial 600 from the difference between the actual sheet size and the sheet size setting.

[0077] The method for changing the sheet size setting may be output by displaying the method on the display unit of the mobile terminal 201, by outputting audio from the mobile terminal 201, or by both display and audio output. For example, the sheet size detection application 2 may communicate with the image forming apparatus 100 and output and display the method on a display unit such as a liquid crystal display of the image forming apparatus 100. Even if the method for setting the sheet size is not a dial method, it is sufficient to be able to output a method for correctly changing the sheet size setting in the same manner as described above.

[0078] [S913, S914] If the sheet size setting matches the actual sheet size (S910 / match), the user activates the camera (or the two-dimensional code reading function) of the mobile terminal 201, and the dial display exposed in the opening 403 of the gripping portion 401 of the loading tray 301 is read by the camera (S913).

[0079] In response to this, the sheet size detection application 2 displays an augmented reality (AR) image showing the selected sheet size that the user desires to print on (S914).

[0080] [S915] The AR display of the selected sheet size is superimposed on an image of the actual stacking tray 301 captured by the camera of the mobile terminal 201, and it is determined whether the selected sheet size matches the actual sheet size (S915).

[0081] At this time, the overlapping position is determined by reading the two-dimensional code dialed through the opening 403 with the mobile terminal 201, reading the image correction marker 701 provided on the guide portion 302 of the loading tray 301, and determining the relative positional relationship of the image correction marker 701.

[0082] If they do not match, the process proceeds to S916, and if they match (S915 / match), the process returns to S904 and the process is repeated.

[0083] For example, as illustrated in FIG. 9(A), if the size of the AR display VP of the selected sheet size is approximately the same as the size of the sheet storage space SP formed by the three guide portions 302 of the stacking tray 301, it is determined that the selected sheet size matches the actual sheet size.

[0084] On the other hand, if the sheet storage space SP is larger than the AR display VP of the selected sheet size, as illustrated in FIG. 9(B), or if the sheet storage space SP is smaller than the AR display VP of the selected sheet size, as illustrated in FIG. 9(C), it is determined that the selected sheet size and the actual sheet size do not match.

[0085] [S916, S917, S918] If the selected sheet size and the actual sheet size do not match (S915 / Mismatch), an instruction to change the adjustment method of the guide portion 302 of the stacking tray 301 is displayed on the display portion of the mobile terminal 201.

[0086] Then, the user removes the sheet P from the stacking tray 301 (S916), adjusts the position of the guide portion 302 in accordance with the adjustment method for the guide portion 302 displayed on the display portion of the mobile terminal 201 (S917), and resets the desired sheet P on the stacking tray 301 (S918).

[0087] After the sheet has been reset, the process returns to S904, where the user takes an image of the stack tray 301 and repeats the process.

[0088] (A-3) Effects of the First Embodiment As described above, according to the first embodiment, it is possible to determine whether the sheet size display set on the loading tray 301 matches the actual sheet size actually contained in the loading tray 301, and if they do not match, guidance is displayed to adjust the sheet size to be set on the loading tray 301.

[0089] (B) Second embodiment Next, a second embodiment of the medium size detection system, method, and program according to the present disclosure will be described with reference to the drawings.

[0090] Similarly to the first embodiment, the second embodiment also illustrates an example in which the present disclosure is applied to an image forming apparatus having a loading tray as a print media storage device.

[0091] (B-1) Configuration of the second embodiment The second embodiment has the same configuration as the printing system of the first embodiment. In addition, the second embodiment differs from the first embodiment in the method of setting the sheet size of the stacking tray, but other configurations are the same as the image forming apparatus of the first embodiment.

[0092] Therefore, the image forming apparatus of the second embodiment will be referred to as "image forming apparatus 100A," and the components of image forming apparatus 100A of the second embodiment will be described using the symbols shown in Figures 1, 2, 3, and 4.

[0093] As illustrated in FIG. 2, a printing system 10 according to the second embodiment includes an image forming apparatus 100A and a mobile terminal 201 operated by a user 200.

[0094] As illustrated in FIG. 1, the image forming device 100A has one or more (two in the example of FIG. 1) loading trays 301, paper feed rollers 101, a hopper 102, conveying rollers 103L, conveying rollers 103U, an image forming unit 104, a fixing unit 107, discharge rollers 108, a media discharge section 109, and a media stacker 110.

[0095] In the second embodiment, the configurations of the opening 304 and the opening 403 of the loading tray 301 are different from those in the first embodiment.

[0096] In the first embodiment, the openings 304 and 403 expose the display portion 602 of the dial 600, whereas in the second embodiment, the openings 304 and 403 allow a dedicated folding display 1100 to be inserted and removed.

[0097] 10(A), for example, the dedicated folding display 1100 is a foldable sheet member made of paper or synthetic resin. The folding display 1100 is previously printed with sheet size information indicating the sheet size that can be accommodated in the stacking tray 301 and the installation direction of the sheet P. In addition, a two-dimensional code including the corresponding sheet size information is also provided to enable AR display.

[0098] The user folds the fold indicator 1100 so that it corresponds to the sheet size and installation direction of the sheets P stored in the target stacking tray 301, and inserts it into the openings 304 and 403. In this way, the user can be informed of the type and installation direction of the sheets P stored in the stacking tray 301.

[0099] (B-2) Operation of the Second Embodiment Next, the operation of the automatic sheet size detection process in the image forming apparatus 100A of the second embodiment will be described with reference to the drawings.

[0100] FIG. 11 is a flowchart showing the operation of the sheet size automatic detection process in the image forming apparatus 100A according to the second embodiment.

[0101] In FIG. 11, the same processes as those in FIG. 6 of the first embodiment are denoted by the same reference numerals, and the same processes as those in FIG. 6 of the first embodiment will be briefly described below.

[0102] [S901~S903] The user 200 operates the mobile terminal 201 to start the sheet size detection application 2 (S901), and selects the sheet size that the user 200 desires to print on (S902) and the printer to be used (image forming device 100A) (S903).

[0103] [S904~S907] The user activates the camera of the mobile terminal 201 and, as in the first embodiment, captures an image from directly above the loading tray 301, including the portion 502 including the three guide portions 302 of the loading tray 301 and the portion 501 displayed in the opening 304 (S904).

[0104] As in the first embodiment, the sheet size detection application 2 corrects the distortion of the image (S905) and uses the corrected image to identify the actual sheet size of the stacking tray 301 (S906). Then, the sheet size detection application 2 displays the identified sheet size on the display unit of the mobile terminal 201, such as a liquid crystal display (S907).

[0105] [S908] In the mobile terminal 201, the sheet size detection application 2 determines whether or not the selected sheet size selected in S902 matches the actual sheet size of the stacking tray 301 specified in S906 (S908). If they match, the process proceeds to S909, and if they do not match, the process proceeds to S1001.

[0106] [S909] If the selected sheet size and the actual sheet size match (S908 / Match), the actual sheet size of the stack tray 301 is the sheet size desired by the user, so the sheet size detection application 2 of the mobile terminal 201 notifies the image forming apparatus 100 of the sheet size (S909) and starts printing. The subsequent printing process is an existing process, so a detailed description will be omitted here.

[0107] [S1001] If the selected sheet size does not match the actual sheet size (S908 / mismatch), the sheet size detection application 2 determines whether the folding display of the stacking tray 301 matches the actual sheet size of the stacking tray 301 (S1001). If they match, the process proceeds to S913, and if they do not match, the process proceeds to S1002.

[0108] In the second embodiment, the user folds the folding indicator 1100 and inserts it into the openings 304 and 403 of the loading tray 301, but there may be cases where the folding indicator 1100 does not match the actual sheet size of the loading tray 301.

[0109] Therefore, in the second embodiment, the sheet size detection application 2 analyzes the image area of ​​the portion 501 in the captured image to recognize the display of the opening 304, and checks whether the folding display 1100 matches the actual sheet size of the stacking tray 301. As a result, when the folding display 1100 does not match the actual sheet size, a method for changing the folding display is displayed on the display unit of the mobile terminal 201, and the user can be prompted to change to the correct display.

[0110] [S1002, S1003] When the folded display and the actual sheet size do not match (S1001 / mismatch), the sheet size detection application 2 instructs the mobile terminal 201 on how to change the folded display.

[0111] For example, as illustrated in Fig. 10(A), a folding indication 1100 is a sheet member indicating the sheet size that can be accommodated in the stacking tray 301. For example, in Fig. 10(A), it is assumed that the reference numeral 1101 is indicated on the opening 403 of the stacking tray 301, and the reference numeral 1102 is the sheet size desired by the user.

[0112] In this example, mountain fold lines 1103 (1103A, 1103B) are displayed, and first, the user is instructed to fold along fold line 1103A, resulting in a state 1104 where the sheet has been folded once (FIG. 10(A)→FIG. 10(B)). Next, the user is instructed to fold along fold line 1103B, resulting in a state 1105 where the sheet has been folded twice (FIG. 10(B)→FIG. 10(C)).

[0113] Such a change method is displayed on the display unit of the mobile terminal 201 (S1002), and the user can confirm the folding (S1003) and change the display of the folded display 1100.

[0114] 11, two-dimensional code 705 is applied to A4 size and A5 size, but two-dimensional code 705 may be applied to all sheet sizes. Also, the size of the two-dimensional code displayed from opening 304 of stacking tray 301 and the size of the two-dimensional code displayed from opening 403 may be the same or different.

[0115] [S913, S914] If the folding indication and the actual sheet size match (S1001 / match), the camera (or two-dimensional code reading function) of the mobile terminal 201 is activated, and the folding indication of the opening 403 of the gripping portion 401 of the stacking tray 301 is read by the camera (S913).

[0116] In response to this, the sheet size detection application 2 displays an AR image showing the selected sheet size on which the user desires to print (S914).

[0117] [S915] The AR display of the selected sheet size is superimposed on an image of the actual stacking tray 301 captured by the camera of the mobile terminal 201 to determine whether the selected sheet size matches the actual sheet size (S915). If they do not match, the process proceeds to S916, and if they match (S915 / match), the process returns to S904 and is repeated.

[0118] [S916, S917, S918] If the selected sheet size and the actual sheet size do not match (S915 / Mismatch), an instruction to change the adjustment method of the guide portion 302 of the stacking tray 301 is displayed on the display portion of the mobile terminal 201.

[0119] Then, the user removes the sheet P from the stacking tray 301 (S916), adjusts the position of the guide portion 302 in accordance with the adjustment method for the guide portion 302 displayed on the display portion of the mobile terminal 201 (S917), and resets the desired sheet P on the stacking tray 301 (S918).

[0120] After the sheet has been reset, the process returns to S904, where the user takes an image of the stack tray 301 and repeats the process.

[0121] (B-3) Effects of the Second Embodiment As described above, according to the second embodiment, like the first embodiment, it is possible to determine whether the sheet size display set on the loading tray 301 matches the actual sheet size actually contained in the loading tray 301, and if there is a mismatch, guidance is displayed to adjust the sheet size to be set on the loading tray 301.

[0122] Furthermore, according to the second embodiment, the folding method of the folding display is displayed, so that the user can easily create a folding display even if the folding method is complicated. [Explanation of symbols]

[0123] 10...printing system, 201...mobile terminal, 100 and 100A...image forming apparatus, 1...printing application software (printing app), 2...sheet size detection application software (sheet size detection app), 21...display determination means, 22...selected medium determination means, 23...processing execution means, 101...paper feed roller, 102...hopper, 103L...conveying roller, 103U...conveying roller, 104...image forming unit, 105...image forming section, 106...belt unit, 107...fixing unit, 107a...fixing roller, 107b...pressure roller, 108...discharge roller, 109...media discharge section, 110...media stacker, 301...loading tray, 302...guide portion, 304...opening, 401...grip portion, 402...front portion, 403...opening, 501...portion, 502...portion, 600...dial, 601...rotation shaft, 602...display portion, 603...rotation locking portion, 603a...engaged portion, 604...dial protrusion portion, 604a...protrusion portion, 604b...recessed portion, 701...image correction marker, 705...two-dimensional code, 1100...folding indication, 1103 (1103A, 1103B)...folding line.

Claims

1. a display determination means for analyzing a captured image including a medium identification display displayed on a loading tray and an actual medium size of the media actually accommodated in the loading tray, and determining whether or not the medium identification display matches the actual medium size; a processing execution means for performing a process according to a result of the comparison with the actual medium size; 1. A media size detection system comprising:

2. The medium identification display has a two-dimensional code including at least information regarding a medium size; The display determination means recognizes the medium size as the medium identification display by reading the two-dimensional code, and determines whether the medium identification display and the actual medium size match.

2. The media size detection system of claim 1.

3. 2. The media size detection system according to claim 1, wherein, when the media identification display and the actual media size do not match, the process execution means outputs a method for changing the media identification display displayed on the loading tray.

4. The medium size detection system of claim 3, characterized in that when the medium identification display is a display surface rotation method in which a display surface indicating multiple medium sizes is rotated to change the medium identification display, the processing execution means outputs a change method including a rotation amount or rotation direction from the currently displayed medium identification display to the medium identification display corresponding to the actual medium size.

5. 4. The medium size detection system according to claim 3, wherein when the medium identification mark is a foldable sheet material indicating a plurality of medium sizes, the processing execution means outputs a folding method for the sheet material.

6. a selected medium determining means for determining whether or not the selected medium size that the user desires to print matches the actual medium size; When the selected medium size and the actual medium size do not match, the process execution means outputs a change method for changing the medium accommodated in the stacking tray.

2. The media size detection system of claim 1.

7. The media size detection system described in claim 6, characterized in that the selected media determination means displays the selected media size in augmented reality on an image capturing the loading tray, and determines the size of the selected media size and the size of the actual media on the captured image.

8. an indication determination means for analyzing a captured image including a medium identification indication displayed on the loading tray and an actual medium size of the media actually accommodated in the loading tray, and determining whether or not the medium identification indication and the actual medium size match; A processing execution means performs a process according to a result of the comparison with the actual medium size.

23. A method for detecting a medium size comprising:

9. Computer a display determination means for analyzing a captured image including a medium identification display displayed on a loading tray and an actual medium size of the media actually accommodated in the loading tray, and determining whether or not the medium identification display matches the actual medium size; a processing execution means for performing a process according to a result of the comparison with the actual medium size; A medium size detection program characterized by:

Images