Mobile terminal device and program

Abstract

To provide a portable terminal device capable of dispensing with selection setting operations related to service provided in an area after a user enters the area, when the user enters an area requiring a user authentication at entry.SOLUTION: A portable terminal device 100 includes a processor. When the processor receives a notification that a user has entered an area that requires user authentication at entry, and if a selection has been made in advance regarding service to be provided in the area, the processor notifies a system providing the service of the selected content.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a mobile terminal device and a program.

Background Art

[0002] The following Patent Document 1 discloses a system that omits authentication by associating camera information and a user at the time of camera purchase in order to register a photograph taken with a digital camera via the Internet and print it on an image forming device installed in a store.

[0003] The following Patent Document 2 discloses a system that detects approach to a check-in terminal at an airport or the like using Bluetooth (registered trademark) or the like and launches an application related to self-service for tickets.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] There are cases where a user enters a region where authentication is required at the time of entry and receives a service within the region. In that case, if the user makes a selection regarding the service after entering the region, it may take time for the setting operation or it may take time until the service is provided.

[0006] An object of the present invention is to provide a mobile terminal device and a program capable of eliminating the need to perform an operation for selecting settings related to a service provided within a region when a user enters a region where user authentication is required at the time of entry. [Means for solving the problem]

[0007] A mobile terminal device according to a first aspect of the present disclosure includes a processor, which, upon receiving notification that a user has entered an area requiring user authentication upon entry, notifies a system providing the service of the content of any pre-selected services within that area.

[0008] A mobile terminal device according to a second aspect of the present disclosure further comprises a display device, wherein the processor, when performing authentication by displaying an authentication image used for user authentication on the display device, acquires the state of the user's selection regarding services provided within the area.

[0009] A third aspect of the present disclosure of a mobile terminal device further comprises a display device, wherein the processor displays on the display device an authentication image used to authenticate the user and a configuration image for accepting selections regarding services provided within the area, in response to instructions from the user when entering the area.

[0010] A mobile terminal device according to a fourth aspect of this disclosure is a printing service in which the service prints print data that a user has registered in advance with the system providing the service using an image forming apparatus installed within the area, and the selection regarding the printing service is a selection regarding the timing of the printing.

[0011] A fifth aspect of the present disclosure is a mobile terminal device in which the selection relating to the printing service is a selection of whether or not to start printing as soon as the user enters the area.

[0012] A portable terminal device according to a sixth aspect of this disclosure, wherein the processor receives and notifies information regarding the destination to which the printed material containing the print data is discharged.

[0013] A mobile terminal device according to a seventh aspect of the present disclosure allows the processor to accept a choice of whether to cancel or wait printing if the print data is not printable by the image forming apparatus.

[0014] In a mobile terminal device according to an eighth aspect of the present disclosure, the processor instructs the service provider to provide the service in accordance with the selection when notifying the service provider of the selection.

[0015] The program of the ninth aspect of this disclosure causes a computer constituting a mobile terminal device to perform a control operation in which, upon receiving notification that a user has entered an area that requires user authentication upon entry, if a selection regarding services to be provided within that area has been made in advance, the computer notifies the system providing the service of the content of that selection. [Effects of the Invention]

[0016] According to the first aspect of this disclosure, when a user enters an area that requires user authentication upon entry, it is possible to provide a mobile terminal device that eliminates the need for the user to perform selection settings regarding services provided within that area after entering.

[0017] According to a mobile terminal device of a second aspect of this disclosure, when a user authenticates using an authentication image in order to enter an area where a service is provided, the status of the selection regarding the service can be notified to the system providing the service.

[0018] According to a third aspect of the present disclosure, when entering an area, it becomes possible to configure settings related to the services provided within that area.

[0019] According to the mobile terminal device of the fourth aspect of this disclosure, it is possible to select when to print when entering an area where printing services are provided.

[0020] According to the mobile terminal device of the fifth aspect of the present disclosure, it is possible to select whether to start printing at the time of entry without operating the image forming apparatus installed in the area where the printing service is provided.

[0021] According to the mobile terminal device of the sixth aspect of the present disclosure, it is possible to notify information about the recipient of a printed matter.

[0022] According to the mobile terminal device of the seventh aspect of the present disclosure, when the image forming apparatus is unable to print, the user can select whether to cancel the printing or wait.

[0023] According to the mobile terminal device of the eighth aspect of the present disclosure, it is possible to directly transmit an instruction to perform a service provided in the area without going through the device that manages the user's entry.

[0024] According to the program of the ninth aspect of the present disclosure, when a user enters an area where user authentication is required at the time of entry with respect to the mobile terminal device possessed by the user, control can be performed to eliminate the need to perform an operation of selection settings regarding the service provided in the area after entry.

Brief Description of the Drawings

[0025] [Figure 1] It is an overall conceptual diagram showing an example of an image forming system in the first embodiment of the present disclosure.​​​​​​​​​​​​​​​​​This is a functional block diagram of an image forming apparatus in an embodiment of the present disclosure. [Figure 8] This is a sequence diagram showing the first half of the processing between each device constituting the image forming system in the embodiment of this disclosure, in chronological order. [Figure 9] This is a sequence diagram showing the latter half of the processing between each device constituting the image forming system in the embodiment of this disclosure, in chronological order. [Figure 10] Figure 10(A) shows an example of the authentication and settings screen displayed on the display device of a mobile terminal, showing the state where the instant print setting is "off". Figure 10(B) shows another example of the authentication and settings screen, showing the state where the instant print setting is "on". Figure 10(C) shows yet another example of the authentication and settings screen, showing the state where information about the output tray has been notified. [Figure 11] This is an overall conceptual diagram showing an example of an image forming system in a second embodiment of the present disclosure. [Modes for carrying out the invention]

[0026] [First Embodiment] The image forming system 10 of the first embodiment of this disclosure will be described with reference to the drawings. The following embodiments are for illustrative purposes only and are not intended to limit this disclosure to the following embodiments.

[0027] Figure 1 is an overall conceptual diagram showing an example of an image forming system 10 according to the first embodiment. As shown in Figure 1, the image forming system 10 includes a user-operated mobile terminal device 100, an entrance gate system 200, a print management server 300, an image forming apparatus 400, and a payment server 500. Each of these components is connected to the others by a network such as the Internet 600.

[0028] Although this will be explained in detail later, I will briefly describe the general flow of processing in this image forming system 10. First, the user registers the image data to be printed with the print management server 300 using a mobile terminal device 100 or a client terminal device (not shown). It should be assumed that user information and payment information are associated with the image data during registration.

[0029] In step S1 of Figure 1, the user enters a store, such as a 24-hour convenience store, where an image forming apparatus 400 is installed, by passing through the entrance gate system 200. At that time, the user displays an authentication image used to authenticate the entering user on the display device of their mobile terminal device 100. At this time, in addition to the authentication image, the display device of the mobile terminal device 100 also displays the instant print settings screen. Now, let's assume that the user has turned "on" instant print on the instant print settings screen and has the authentication image read by the imaging device of the entrance gate system 200, thereby entering the store. Then, in step S2, the entrance management server 220 identifies the entered user and sends an entry notification to the print management server 300. In step S3, the print management server 300 identifies the mobile terminal device 100 that the user is carrying and sends an entry notification to the mobile terminal device 100.

[0030] Upon receiving the entry notification, in step S4, the mobile terminal device 100 obtains the current state of the print settings on the instant print settings screen and sends an instant print instruction, i.e., a print start instruction, to the print management server 300. Upon receiving the print start instruction, in step S5, the print management server 300 identifies the image data registered by the user and sends the image data and the print instruction to the image forming apparatus 400. In step S6, the image forming apparatus 400 starts printing the received image data.

[0031] In this way, by displaying an authentication image to be shown to the user upon entry, along with an immediate print settings screen, and allowing the user to choose whether or not to start printing immediately, printing will begin from the image forming machine 400 inside the store at the moment the user enters the store.

[0032] In this image forming system 10, there may be multiple mobile terminal devices 100 and multiple image forming apparatuses 400, each connected to the Internet 600. However, in this embodiment, for the sake of simplicity, we will describe the case where only one of each is connected to the Internet 600.

[0033] The mobile terminal device 100 will be described with reference to Figures 2 and 3. The mobile terminal device 100 is a portable terminal device such as a tablet computer or smartphone that is carried and operated by a user entering a store where the image forming apparatus 400 is installed. Figure 2 is a hardware configuration diagram of the mobile terminal device 100, and Figure 3 is a functional block diagram of the mobile terminal device 100. As shown in Figure 2, the mobile terminal device 100 includes a CPU 101, memory 102, storage device 103, communication interface 104, display device 105, and input device 106, each connected to the control bus 107.

[0034] The CPU 101 is a control microprocessor that controls the operation of each part of the mobile terminal device 100 based on a control program stored in the memory device 103.

[0035] Memory 102 temporarily stores the "on" / "off" status of the instant print setting (described later), information about the output tray received from the print management server 300, and other such information.

[0036] The storage device 103 is composed of a solid-state drive (abbreviated as SSD) or a hard disk drive (abbreviated as HDD), and stores a control program for controlling each part of the mobile terminal device 100. In this embodiment, the control program is described as being installed in the storage device 103, but it is not limited to this. The control program according to this embodiment may be provided in a form recorded on a computer-readable storage medium. For example, the control program according to this embodiment may be provided in a form recorded on an optical disc such as a CD (Compact Disc)-ROM or DVD (Digital Versatile Disc)-ROM, or in a form recorded on a semiconductor memory such as a USB (Universal Serial Bus) memory or memory card. Alternatively, the control program according to this embodiment may be obtained from an external device via a communication line connected to the communication interface 104.

[0037] The communication interface 104 performs communication control for communicating with the print management server 300, which is connected via the Internet.

[0038] The display device 105 is composed of a display device such as a liquid crystal panel or an organic EL display, and displays an image generated by the display control unit 111, which will be described later.

[0039] The input device 106 is composed of, for example, a capacitive touch panel formed on the surface of the display device 105. The user performs input operations by operating the input device 106 while viewing the user interface image displayed on the display device 105.

[0040] Furthermore, as shown in Figure 3, the mobile terminal device 100 performs its functions as a display control unit 111, an entry detection unit 112, a print instruction unit 113, and a registration information storage unit 114 by executing a control program stored in the storage device 103.

[0041] The display control unit 111 displays the authentication image stored in the registration information storage unit 114 on the display device 105 along with the generated service setting selection screen, in response to user instructions. Furthermore, when the display control unit 111 receives notification of output tray information from the image forming apparatus 400 via the print management server 300, it generates an image displaying the output tray information and displays it on the display device 105.

[0042] The entry detection unit 112 determines whether or not it has received an entry notification from the print management server 300.

[0043] When the entry detection unit 112 determines that an entry notification has been received, the print instruction unit 113 obtains the "on" or "off" state of the instant print setting, which was set by the user operating the service setting selection screen. If the instant print setting is in the "on" state, the print instruction unit 113 sends a print start instruction to the print management server 300.

[0044] The registration information storage unit 114 stores user information including the username and user ID, authentication images required when the user enters the store, and information on whether or not there is image data to be printed that the user has registered with the print management server 300.

[0045] Next, the entrance gate system 200 will be described. While a detailed explanation will be omitted, the entrance gate system 200 consists of a gate device 210 including an imaging device and a communication device, and an entrance management server 220, as shown in Figure 1. The gate device 210 is installed at the boundary of an area requiring user authentication upon entry, such as a cashierless store, and authenticates users entering that area. The imaging device reads the authentication image displayed on the display device 105 of the entering user's mobile terminal device 100 and transmits this information to the entrance management server 220 via the communication device. The entrance management server 220 identifies who has entered based on the received information and sends an entry notification to the print management server 300. For example, the entrance management server 220 identifies the user ID of the entering user and sends it to the print management server 300. Note that the entrance gate system 200 may also identify users exiting, but this is omitted in this embodiment.

[0046] Next, the print management server 300 will be described with reference to Figures 4 and 5. Figure 4 is a hardware configuration diagram of the print management server 300, and Figure 5 is a functional block diagram of the print management server 300. As shown in Figure 3, the print management server 300 is equipped with a CPU 301, memory 302, storage device 303, and communication interface 304, each connected to the control bus 305.

[0047] The CPU 301 is a control microprocessor that controls the operation of each part of the print management server 300 based on the control program stored in the memory device 303.

[0048] Memory 302 temporarily stores information about users received from the access control server 220, print instruction information received from the mobile terminal device 100, and the like.

[0049] The storage device 303 is composed of a hard disk drive (abbreviated as HDD) or a solid-state drive (abbreviated as SSD), and stores a control program for controlling each part of the print management server 300. In this embodiment, the control program is described as being installed in the storage device 303, but it is not limited to this. The control program according to this embodiment may be provided in a form recorded on a computer-readable storage medium. For example, the control program according to this embodiment may be provided in a form recorded on an optical disc such as a CD (Compact Disc)-ROM or DVD (Digital Versatile Disc)-ROM, or in a form recorded on a semiconductor memory such as a USB (Universal Serial Bus) memory or memory card. Alternatively, the control program according to this embodiment may be acquired from an external device via a communication line connected to the communication interface 304. The storage device 303 also stores print data and user information, which will be described later.

[0050] The communication interface 304 performs communication control for communicating with the mobile terminal device 100, entrance gate system 200, image forming apparatus 400, and payment server 500, which are connected via the internet.

[0051] Furthermore, as shown in Figure 5, the print management server 300 performs the following functions by executing the control program stored in the storage device 303.

[0052] The print data storage unit 311 stores image data to be printed, which has been registered in advance by the user, in association with the user ID. Here, "image data" refers to printable data that can be image-formed, created by the mobile terminal device 100 or a client terminal device (not shown), or acquired by such devices via a network such as the Internet 600. Such printable data includes raster or vector image file data, text file data, and PDL file data in which image data and text data are described in an image-formable page description language format.

[0053] Furthermore, this image data is assumed to have pre-associated and stored print settings specified by the user. These print settings include the number of copies to print, double-sided / single-sided printing settings, output paper size, and color / black and white selection.

[0054] The user information storage unit 312 stores user information. Specifically, the user information storage unit 312 stores the username, user ID, terminal identification ID of each user's mobile terminal device 100 or the identification ID of the application installed on the mobile terminal device 100, and credit card information in association with each other.

[0055] The entry notification processing unit 313 receives the user ID of a user who has entered from the entry gate system 200. Upon receiving the user ID, the entry notification processing unit 313 identifies the terminal identification ID or application identification ID held by the user information holding unit 312 and sends an entry notification to the mobile terminal device 100. This entry notification may also be sent using a push notification method to the mobile terminal device 100.

[0056] When the print instruction unit 314 receives a print start instruction from the mobile terminal device 100, it identifies the image data stored in the print data storage unit 311 in association with the user ID of the user in question. The print instruction unit 314 also transmits the identified image data to the image forming apparatus 400 and instructs it to print.

[0057] When the adjustment processing unit 315 receives a print failure notification from the image forming apparatus 400, it asks the user's mobile terminal device 100 whether to cancel the print or wait. If it receives an instruction to cancel the print, it instructs the image forming apparatus 400 to stop printing the user's image data. On the other hand, if the adjustment processing unit 315 receives an instruction to wait for the print, it sends an instruction to the image forming apparatus 400 to continue printing.

[0058] When the payment processing unit 316 receives notification from the image forming apparatus 400 that printing has been completed, it sends the credit card information and payment amount to the payment server 500 based on the credit card information registered in the user information holding unit 312 and performs the billing process.

[0059] Next, the image forming apparatus 400 will be described with reference to Figures 6 and 7. Figure 6 is a hardware configuration diagram of the image forming apparatus 400, and Figure 7 is a functional block diagram of the image forming apparatus 400. As shown in Figure 6, the image forming apparatus 400 includes a CPU 401, memory 402, storage device 403, image forming unit 404, communication interface 405, and output tray device 406, each connected to the control bus 407.

[0060] The CPU 401 is a control microprocessor that controls the operation of each part of the image forming apparatus 400 based on the control program stored in the memory device 403.

[0061] Memory 402 temporarily stores the print data to be printed by the image forming unit 404 of the image forming apparatus 400.

[0062] The storage device 403 is composed of a hard disk drive (abbreviated as HDD) or a solid-state drive (abbreviated as SSD), and stores a control program for controlling each part of the image forming apparatus 400. In this embodiment, the control program for the image forming apparatus 400 is described as being installed in the storage device 403, but it is not limited to this. The control program according to this embodiment may be provided in a form recorded on a computer-readable storage medium. For example, the control program according to this embodiment may be provided in a form recorded on an optical disc such as a CD (Compact Disc)-ROM or DVD (Digital Versatile Disc)-ROM, or in a form recorded on a semiconductor memory such as a USB (Universal Serial Bus) memory or memory card. Alternatively, the control program according to this embodiment may be acquired from an external device via a communication line connected to the communication interface 405.

[0063] The image forming unit 404 receives image data from the print management server 300 and processes it for printing according to the print settings also received from the print management server 300, printing it onto a recording medium such as paper.

[0064] The communication interface 405 performs communication control for communicating with the print management server 300, which is connected via the Internet 600, either through a LAN cable (not shown) or via a wireless LAN.

[0065] The output tray device 406 consists of multiple output trays, and printed materials are output to a different output tray for each user, where they are temporarily stored until the user takes them away.

[0066] Furthermore, as shown in Figure 7, the image forming apparatus 400 performs the functions of the print data receiving unit 411, the print feasibility determination unit 412, and the print control unit 413 by executing a control program stored in the storage device 403.

[0067] The print data receiving unit 411 receives image data and a print start instruction from the print management server 300, converts them into a printable data format, and temporarily stores them in the memory 402.

[0068] The print eligibility determination unit 412 monitors the status of the output tray device 406 and determines whether there is an empty output tray to which the printed material will be output. If there is an empty output tray, the print eligibility determination unit 412 decides which output tray to output the printed material to. The print eligibility determination unit 412 also monitors whether there is a shortage of consumables that would prevent printing, and whether there are any other equipment malfunctions such as paper jams. If printing is not possible, the print eligibility determination unit 412 sends a message to the print management server 300 to that effect.

[0069] If the printability determination unit 412 determines that printing is possible, the print control unit 413 controls the image forming unit 404 according to the print settings and prints the image data, which has been converted to a printable format and temporarily stored in the memory 402, onto a recording medium such as paper.

[0070] The payment server 500 processes the payment according to the credit card information and payment amount received from the print management server 300.

[0071] Next, the overall processing flow of the image forming system 10 will be explained with reference to Figures 8 and 9. Figure 8 is the first half of a sequence diagram showing the processing between each device constituting the image forming system 10 in chronological order, and Figure 9 shows the second half following Figure 8.

[0072] First, the user registers the image data to be printed with the print management server 300 using a mobile terminal device 100 or a client terminal device (not shown). During registration, the image data is associated with a user ID.

[0073] In step S801, the user operates the mobile terminal device 100 to launch the application software for entry authentication. When the entry authentication application software is launched, the display control unit 111 displays the authentication and setting screen 1000 shown in Figure 10(A) on the display device 105 in accordance with the user's instructions when entering the store.

[0074] Figure 10(A) shows an example of an authentication and setting screen 1000 displayed on the display device 105 of a mobile terminal device 100. As shown in Figure 10(A), the authentication and setting screen 1000 includes an authentication image used to authenticate a user entering a store and a setting image for accepting selections regarding services provided within the area. The authentication image is an image that encodes user information, such as a two-dimensional code image 1010. The setting image is, for example, an instant print selection button 1020. The two-dimensional code image 1010 is an image for user identification stored in the registration information storage unit 114. Alternatively, the two-dimensional code image 1010 may be generated by the display control unit 111 based on the username and user ID stored in the registration information storage unit 114.

[0075] The Instant Print Selection Button 1020 is displayed as a toggle button, allowing users to easily select "On" or "Off". When the Instant Print Selection Button 1020 is set to "On," it means that the printing of registered image data will begin immediately after the user enters the store; when it is set to "Off," it means that this will not happen. The Instant Print Selection Button 1020 should be in the "Off" state when the application is launched. In addition to the toggle button format shown in the diagram, the Instant Print Selection Button 1020 may also be displayed as a checkbox, a radio button selection, or a pull-down menu.

[0076] In step S802, the user enters the store by holding the display device 105 of the mobile terminal device 100 over the imaging device of the gate device 210 of the entrance gate system 200. The imaging device of the gate device 210 then reads the two-dimensional code image 1010 displayed on the display device 105 and queries the entrance management server 220 using the information contained in the two-dimensional code image 1010. The entrance management server 220 identifies who the user who entered is, for example, the user ID of the user who entered.

[0077] In step S803, the entrance management server 220 of the entrance gate system 200 sends the user ID of the user who entered to the print management server 300.

[0078] In step S804, when the print management server 300's entry notification processing unit 313 receives a user ID, it identifies the terminal identification ID or application identification ID corresponding to the user ID held by the user information holding unit 312. Then, it sends an entry notification to the mobile terminal device 100 that has this terminal identification ID or application identification ID. This entry notification is sent, for example, by sending a push notification to the mobile terminal device 100.

[0079] When the entry detection unit 112 of the mobile terminal device 100 determines that an entry notification has been received, in step S805, the print instruction unit 113 obtains the "on" / "off" state of the instant print selection button 1020 on the authentication and setting screen 1000. For example, as shown in Figure 10(B), if the instant print selection button 1020 is in the "on" state, the print instruction unit 113 sends a print start instruction along with the user ID to the print management server 300. On the other hand, as shown in Figure 10(A), if the instant print selection button remains in the "off" state, the print instruction unit 113 does not send a print start instruction.

[0080] In step S806, when the print instruction unit 314 of the print management server 300 receives the user ID and the print start instruction, it uses the user ID to identify the image data registered in the print data holding unit 311. The print instruction unit 314 then transmits the image data along with the print start instruction to the image forming apparatus 400.

[0081] In step S807, the print data receiving unit 411 of the image forming apparatus 400 receives a print start instruction and image data, converts them into a printable data format, and temporarily stores them in the memory 402.

[0082] In step S808, the printability determination unit 412 determines whether there is space in the output tray, whether there is a shortage of consumables, and whether there are any other equipment malfunctions such as a paper jam. If the printability determination unit 412 determines that printing is not possible, it sends a message to the print management server 300. If it is determined that printing is not possible, the following steps S809 to S816 are performed, corresponding to the upper part enclosed by the dotted line in Figure 9. On the other hand, if it is determined that printing is possible, the following steps S817 to S823 are performed, corresponding to the lower part enclosed by the dotted line in Figure 9.

[0083] If the image forming apparatus 400 notifies that printing is impossible, the adjustment processing unit 315 of the print management server 300 sends a notification to the mobile terminal device 100 in step S809 indicating that printing is impossible.

[0084] Upon receiving notification that printing is impossible, the display control unit 111 of the mobile terminal device 100 generates an inquiry screen in step S810, asking the user to choose whether to cancel or wait for printing, and displays it on the display device 105. If the user selects cancel, the print instruction unit 113 sends a print cancellation instruction to the print management server 300 in step S811. Upon receiving the print cancellation instruction, the adjustment processing unit 315 of the print management server 300 sends a print cancellation instruction to the image forming apparatus 400 in step S812. Upon receiving the print cancellation instruction, the print data receiving unit 411 of the image forming apparatus 400 erases the image data temporarily stored in the memory 402 in step S813 and terminates the printing process.

[0085] If, in response to the inquiry screen in step S810, the user operates the display device 105 of the mobile terminal device 100 to select "Wait for printing," the print instruction unit 113 sends a print wait instruction to the print management server 300 in step S814. Upon receiving the print wait instruction, the adjustment processing unit 315 of the print management server 300 sends a print wait instruction to the image forming apparatus 400 in step S815. Upon receiving the print wait instruction, the image forming apparatus 400 uses the print feasibility determination unit 412 to determine in step S816 whether or not it is in a state where printing can be performed, and waits for the process to be completed until it is in a state where printing can be performed.

[0086] If it is determined in step S808 that printing is possible, or if the printer is ready to process the print job in step S816, in step S817 the print feasibility determination unit 412 determines the output tray from which the printed material will be ejected. The print feasibility determination unit 412 then transmits the information of the output tray to the print management server 300.

[0087] In step S818, the print instruction unit 314 of the print management server 300 transmits the output tray information, which is information about the output destination received from the image forming apparatus 400, to the portable terminal device 100.

[0088] In step S819, the display control unit 111 of the mobile terminal device 100 generates a pop-up image to display the information of the output tray, which is information about the output destination, and displays it on the display device 105. Specifically, as shown in Figure 10(C), a notification message 1030 such as "Output to tray number 3" is displayed. In addition, the notification may be emphasized with a sound effect such as a chime sound 1040 to make it easier for the user to notice the notification, or the output tray information may be notified by voice.

[0089] In step S820, the print control unit 413 of the image forming apparatus 400 prints the image data that has been stored in memory and is ready for printing using the image forming unit 404, and discharges the printed material into the discharge tray determined in step S817.

[0090] When printing is complete, the print control unit 413 of the image forming apparatus 400 sends a print completion notification to the print management server 300 in step S821. In step S822, the payment processing unit 316 of the print management server 300 sends the credit card information and payment amount to the payment server 500 based on the credit card information registered in the user information holding unit 312, and requests billing processing.

[0091] In step S823, the payment server 500 processes the payment based on the received credit card information and payment amount.

[0092] Finally, the user who has entered the store moves to the location of the image forming apparatus 400, refers to the output tray information that has already been notified to the mobile terminal device 100, retrieves the printed material from the output tray where it is placed, and completes the process. In this way, the user does not need to operate the image forming apparatus 400 until the printed material is retrieved.

[0093] [Second Embodiment] In the first embodiment described above, the entry gate system 200 notifies the print management server 300 only of the user ID of the user who has entered, and the print management server 300 obtains the status of the instant print selection button on the mobile terminal device 100. In other words, in the first embodiment, the entry gate system 200 itself does not actually communicate with the mobile terminal device 100, and the print management server 300 communicates with the mobile terminal device 100. However, this disclosure is not limited to the first embodiment described above. In the second embodiment described below, the case in which the cashierless payment system 200A communicates with the mobile terminal device 100, obtains the entry notification and the setting status of the instant print selection button, and issues a print start instruction.

[0094] Figure 11 is an overall conceptual diagram showing an example of the image forming system 10A of the second embodiment. As shown in Figure 11, the image forming system 10A consists of a mobile terminal device 100, a cashierless payment system 200A, a print management server 300A, and an image forming apparatus 400. Since the components of the image forming system 10A of the second embodiment are substantially the same except for the cashierless payment system 200A and the print management server 300A, a detailed explanation will be omitted, and the same reference numerals will be used to describe the same components. Note that the payment server 500 of the first embodiment is integrated into the cashierless payment system 200A in the second embodiment.

[0095] In step S1', the user enters the store by holding the authentication and setting screen 1000, similar to that shown in Figure 10(A), over the display device 105 of the mobile terminal device 100 and the imaging device of the gate device 210A of the store's cashierless payment system 200A. The imaging device of the gate device 210A then reads the two-dimensional code image 1010 displayed on the display device 105 and uses the information contained in the two-dimensional code image 1010 to query the cashierless payment server 220A to find out who the entering user is. When the cashierless payment server 220A identifies who the entering user is, it identifies the terminal identification ID or application identification ID of the user's mobile terminal device 100. The cashierless payment server 220A stores the user name and user ID in association with the terminal identification ID or application identification ID of the user's mobile terminal device 100 that the user possesses.

[0096] Next, in step S2', the cashierless payment server 220A sends an entry notification to the mobile terminal device 100 held by the user using the identified terminal identification ID or application identification ID. When the mobile terminal device 100 receives the entry notification, it obtains the "on" or "off" state of the instant print selection button 1020 on the authentication and settings screen 1000. If the instant print selection button 1020 is in the "on" state, the print instruction unit 113 sends a print start instruction along with the user ID to the cashierless payment server 220A in step S3'.

[0097] When the cashierless payment server 220A receives a print start instruction, in step S4' it sends the print start instruction and the user ID to the print management server 300. When the print management server 300 receives the print start instruction, it identifies the image data to be printed based on the user ID and sends it to the image forming apparatus 400 along with the print start instruction in step S5'. The image forming apparatus 400 performs the printing process in step S6'.

[0098] When printing is complete, the image forming apparatus 400 sends a print completion notification to the print management server 300. The print management server 300 then sends a payment processing request to the cashierless payment server 220A, requesting billing. The cashierless payment server 220A performs the billing process based on the user information and payment processing request, and then completes the process.

[0099] In the second embodiment described above, an example was described in which, when the "immediate print" button 1020 on the authentication and setting screen 1000 of the mobile terminal device 100 is set to "on," a print start instruction is sent to the print management server 300 via the cashierless payment server 220A. However, this disclosure is not limited to the above embodiment. The print start instruction may also be sent directly from the mobile terminal device 100 to the print management server 300.

[0100] In the embodiments described above, the case in which the mobile terminal device 100 sends a print start instruction when the "immediate print" selection button is "on" was explained. In other words, the mobile terminal device 100 sent instructions for providing services according to the selection, such as a print start instruction, according to the state of the "immediate print" selection button. However, this disclosure is not limited to this. The "on" / "off" selection state of the "immediate print start" selection button may be notified to the print management server 300 or the cashierless payment server 220A, and when the selection of the button is "on", the print management server 300 or the cashierless payment server 220A may send a print start instruction.

[0101] The selection of print instructions described above was a binary choice between "on" and "off"—whether or not to print immediately—but this disclosure is not limited to this, and may involve selecting or excluding one or more options from, for example, three options.

[0102] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0103] Furthermore, the processor operations in each of the above embodiments may not be performed by a single processor, but may be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, and may be changed as necessary. [Industrial applicability]

[0104] In the above embodiment, an example was described in which the present disclosure is applied to a printing service in which print data registered in advance by a user is printed by an image forming apparatus 400 installed in an area requiring user authentication upon entry, such as a cashierless store. Furthermore, the selection of the printing service set by the user via the mobile terminal device 100 was an "on" / "off" selection regarding the timing of printing, that is, whether to start printing immediately upon the user entering the area or to perform instant printing. However, the present disclosure is not limited to this. For example, the user may select a setting to start printing at a predetermined timing after entry, so that they can receive the printed materials when they arrive at the image forming apparatus 400.

[0105] In various systems and services where users enter a store or make a payment by scanning an authentication image such as a QR code, the authentication image may be displayed, and the user may be allowed to switch between "on" and "off" service selections. After entering the store or making a payment, the user may receive the service corresponding to their selection. In areas requiring user authentication upon entry, such as cashierless payment stores, railways, and other service facilities where users register as members to receive services, the mobile terminal device 100 receives a notification that the user has entered. At that time, the user's selection regarding the services provided within that area is accepted in advance, and the content of that selection is notified to the service provider system upon receiving the entry notification.

[0106] For example, a train ticket could be configured to allow users to turn an "on" or "off" option for "reserved seat" or "paid seat," and if the reserved seat option is turned "on" when entering a station or boarding a train, reserved seat information could be issued, allowing the user to use a reserved seat. Similarly, a day-trip hot spring facility could be configured to allow users to turn an "on" or "off" option for "massage / rock bath" in the entry code, and if this option is turned "on" when entering, the above services could be provided. Furthermore, when making a payment by holding a mobile device display over a reader at a store, an option could be turned "on" or "off" to allow the system to donate any fractional amounts according to a predetermined method. [Explanation of Symbols]

[0107] 10, 10A Image Forming System 100 Mobile terminal devices 101 CPU 102 memory 103 Storage device 104 Communication Interface 105 Display device 106 Input device 107 Control bus 111 Display Control Unit 112 Entry detection unit 113 Print instruction section 114 Registration Information Storage Unit 200 Entrance Gate System 200A Cashierless Payment System 210, 210A gate device 220 Access Control Server 220A Cashierless Payment Server 300, 300A Print Management Server 301 CPU 302 memory 303 Storage device 304 Communication Interface 305 Control Bus 311 Print data storage unit 312 User Information Storage Unit 313 Entry Notification Processing Unit 314 Print instruction section 315 Adjustment Processing Unit 316 Payment Processing Unit 400 Image forming apparatus 401 CPU 402 memory 403 Storage device 404 Image Forming Unit 405 Communication Interface 406 Discharge tray device 407 Control Bus 411 Print Data Receiving Unit 412 Printability judgment section 413 Printing Control Unit 500 payment servers 600 Internet 1000 Authentication and Settings Screen 1010 QR code image 1020 Instant Print Selection Button 1030 Notification Message 1040 Chime sound

Claims

1. Equipped with a processor and a display device, When the processor performs authentication by displaying an authentication image used for user authentication on the display device, it acquires the status of the user's prior selection regarding the services provided within the area requiring user authentication upon entry. When notification is received that the user has entered the area, if a selection regarding the services to be provided within that area has been made in advance, the content of that selection will be notified to the system providing the service. Mobile terminal device.

2. The portable terminal device according to claim 1, wherein the processor displays on the display device an authentication image used to authenticate the user and a setting image for accepting selections regarding services provided within the area, in response to instructions from the user when entering the area.

3. The mobile terminal device according to claim 1 or 2, wherein the service is a printing service in which print data that has been registered in advance by the user to the system providing the service is printed by an image forming apparatus installed in the area, and the selection regarding the printing service is a selection regarding the timing of printing.

4. The choice relating to the printing service is a choice of whether or not to start printing as soon as the user enters the area, according to claim 3.

5. The portable terminal device according to claim 4, wherein the processor receives and notifies information regarding the destination to which the printed material containing the print data is discharged.

6. The portable terminal device according to claim 4, wherein the processor accepts a choice of whether to cancel printing or wait when the print data cannot be printed by the image forming apparatus.

7. The portable terminal device according to any one of claims 1 to 6, wherein the processor instructs the system providing the service to provide the service in accordance with the content of the selection when notifying the system of the selection.

8. A computer comprising a portable terminal device equipped with a display device, A program that, when performing authentication by displaying an authentication image used for user authentication on the display device, obtains the status of the user's prior selection regarding services provided within an area requiring user authentication upon entry, and, upon receiving notification that the user has entered, if a selection regarding services provided within that area has been made in advance, controls the program to notify the service provider of the content of that selection.

Images