Image forming apparatus

Abstract

To provide an image forming apparatus that acquires image data for printing uploaded to an external server in order to print an image with higher security and more convenience for a user, and forms an image.SOLUTION: A digital multi-function machine comprises: an operation unit that receives a user's operation; an image forming unit that, upon receiving an image data printing command from the user, forms an image based on the image data; a user authentication unit that acquires face image data for user authentication; and a communication unit that communicates with an external server. A control unit, when receiving the image data printing command from the user, acquires, from the external server, image data for printing based on print data specification information provided by the user, extracts one or more pieces of face image data from the image data for printing, determines whether the pieces of face image data include face image data matching a user's face image data acquired by the user authentication unit, when determining affirmative, permits printing the image data for printing, and when determining negative, does not permit printing.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] This disclosure relates to an image forming apparatus, and more particularly to an image forming apparatus that acquires image data for printing uploaded to an external server and forms an image.

Background Art

[0002] Conventionally, in an image forming apparatus such as a multifunction device installed in a store such as a convenience store, a proof photo printing service for printing a photo taken by a user with a mobile terminal such as a smartphone has been provided.

[0003] For example, there is known a proof photo printing method that provides a proof photo printing method that can be easily obtained without having to go to a special proof photo box or a photo specialty store by taking a photo by oneself and using a photo taken within a predetermined period when obtaining a proof photo (see, for example, Patent Document 1).

[0004] In such a proof photo printing service, after the user uploads a face photo from the mobile terminal to the management server and obtains a management number, when the management number is input in the proof photo printing service of the image forming apparatus in the store, the uploaded face photo can be printed.

[0005] Also, for example, there is known a printing order system characterized by including a number notification unit that notifies by mail so that the print number image is displayed on a mobile terminal owned by a customer, and a data transmission unit that causes the printing apparatus to print print data associated with the print number when the print number is input via the printing apparatus (see, for example, Patent Document 2).

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

[0007] However, the traditional method of obtaining and printing a management number issued to the user has security issues because, if a third party knows the management number, they can also print the facial photograph.

[0008] On the other hand, it is also conceivable to grant permission to print facial photographs using user authentication methods such as passwords, QR codes (registered trademarks), or NFC (Near Field Communication) contactless short-range wireless communication. However, these authentication methods increase the effort required from the user, which reduces user convenience.

[0009] This disclosure has been made in consideration of the circumstances described above, and its purpose is to provide an image forming apparatus that can print images with greater user convenience and security than conventional methods, by acquiring printable image data uploaded to an external server and forming images from that data. [Means for solving the problem]

[0010] This disclosure provides an image forming apparatus comprising: an operation unit that receives user input operations; an image forming unit that forms an image based on image data when it receives a print command for image data from a user; a user authentication unit that acquires face image data for user authentication; a communication unit that communicates with an external server and sends and receives various data with the server; and a control unit that controls the operation unit, the image forming unit, the user authentication unit, and the communication unit. The control unit, when it receives a print command for image data from a user, acquires print image data from the external server via the communication unit based on print data identification information provided by the user; extracts one or more face image data from the print image data; determines whether or not one of the one or more face image data matches the user's face image data acquired by the user authentication unit; if there is a match, permits the user to form an image based on the print image data; and if there is no match, does not permit the user to form an image based on the print image data.

[0011] In this disclosure, "image forming apparatus" refers to a device that forms and outputs an image, such as a copier or multifunction printer that has a copying function, or an MFP (Multifunctional Peripheral) that also includes functions other than copying. "Print data identification information provided by the user" refers to, for example, a predetermined management number issued to the user when the user uploads image data for printing to an external server. Additionally, the user's facial image data may be used as print data identification information. [Effects of the Invention]

[0012] According to this disclosure, in an image forming apparatus that acquires printable image data uploaded to an external server and forms an image, printing of the image data is permitted only if there is a match between the printable image data and the user's face image data acquired by the user authentication unit. This makes it possible to realize an image forming apparatus that enables image printing with greater user convenience and security than conventional methods. [Brief explanation of the drawing]

[0013] [Figure 1] This is an explanatory diagram illustrating an example of the configuration of an image forming system including a digital multifunction printer as disclosed herein. [Figure 2] Figure 1 is a block diagram showing the schematic configuration of a digital multifunction printer. [Figure 3] Figure 1 is a block diagram showing the schematic configuration of the user terminal. [Figure 4] Figure 1 is an explanatory diagram showing an example of how a user operates the digital multifunction printer. [Figure 5] Figure 1 is a flowchart showing the processing of the photo printing application on the user terminal. [Figure 6] Figure 1 shows an example of the layout of a user's face photo set in the photo printing application on the user's terminal. [Figure 7] Figure 1 shows an example of a screen displaying a user's face photograph taken with the user's terminal's photo printing application, along with a message indicating that the image is being uploaded. [Figure 8] Figure 1 is a flowchart showing the printing process for image data intended for printing on a digital multifunction printer. [Figure 9] Figure 1 shows another example of the layout of a user's face photo set in the photo printing application on the user's terminal. [Figure 10] This is a flowchart showing the printing process of image data for printing on a digital multifunction printer in the image forming system of Embodiment 2 of this disclosure. [Figure 11]In the image forming system according to Embodiment 3 of this disclosure, it is a flowchart showing the processing of a photo printing application on a user terminal. [Figure 12] In the image forming system according to Embodiment 3 of this disclosure, it is a flowchart showing the printing process of image data for printing on a digital multifunction peripheral. [Figure 13] In the image forming system according to Embodiment 4 of this disclosure, it is a flowchart showing the processing of a photo printing application on a user terminal. [Figure 14] In the image forming system according to Embodiment 4 of this disclosure, it is an example in which a face image for user authentication is specified from a group photo for printing in a photo printing application on a user terminal. [Figure 15] In the image forming system according to Embodiment 4 of this disclosure, it is a flowchart showing the printing process of image data for printing on a digital multifunction peripheral. [Figure 16] In the image forming system according to Embodiment 5 of this disclosure, it is a flowchart showing the processing of a photo printing application on a user terminal. [Figure 17] In the image forming system according to Embodiment 5 of this disclosure, it is an example in which a face image for user authentication is attached to an image for printing in a photo printing application on a user terminal. [Figure 18] In the image forming system according to Embodiment 5 of this disclosure, it is a flowchart showing the printing process of image data for printing on a digital multifunction peripheral.

Modes for Carrying Out the Invention

[0014] In this disclosure, an "image forming apparatus" is an apparatus that forms and outputs an image, such as a copying machine (copier function) having a copying function such as a printer using an electrophotographic method for image formation by toner, a digital multifunction peripheral, or an MFP (Multifunction Peripheral) including functions other than copying. "User terminals" are not limited to mobile information terminals such as smartphones and tablet devices or personal computers (PCs), but may also include electronic whiteboards, information displays, etc.

[0015] Furthermore, preferred embodiments of this disclosure will be described.

[0016] In the image forming apparatus according to this disclosure, the control unit may extract one or more face image data from the image data for printing, and determine whether or not among the one or more face image data, there is one that matches the user's face image data acquired by the user authentication unit.

[0017] In this way, in an image forming apparatus that acquires printable image data uploaded to an external server and forms an image, printing of the image data is permitted only if there is a match between the user's face image data acquired by the user authentication unit and the face image data pre-specified by the user within the printable image data. This makes it possible to realize an image forming apparatus that enables image printing with greater user convenience and security than conventional methods.

[0018] In the image forming apparatus disclosed herein, the print data identification information may be a management number issued to the user when the print image data is uploaded to the server, or the user's facial image data.

[0019] In this way, in an image forming apparatus that acquires printable image data uploaded to an external server and forms an image, printable image data associated with a pre-issued management number or user face image data is acquired from the external server. This makes it possible to realize an image forming apparatus that can print images with greater user convenience and security than conventional methods.

[0020] In the image forming apparatus according to this disclosure, the user authentication unit may include a camera that captures a user's face image, and may acquire the user's face image data from the user's face image captured by the camera.

[0021] In this way, in an image forming apparatus that acquires printable image data uploaded to an external server and forms an image, printing of the image data is permitted only if there is a match between the printable image data and the user's face image data acquired by the image forming apparatus's camera. This makes it possible to realize an image forming apparatus that enables image printing with greater user convenience and security than conventional methods.

[0022] In the image forming apparatus according to this disclosure, the user authentication unit may acquire the user's facial image data from a predetermined card containing the user's facial image or from a user's facial image registered in the user's terminal.

[0023] In this way, an image forming apparatus that acquires printable image data uploaded to an external server and forms an image will only permit printing of the image data if it matches a predetermined card image or a user's face image data acquired from a user terminal. This makes it possible to realize an image forming apparatus that enables image printing with greater user convenience and security than conventional methods.

[0024] In the image forming apparatus according to this disclosure, the user authentication unit may acquire the user's facial image data from the user's facial image uploaded to the server separately from the image data for printing.

[0025] In this way, in an image forming apparatus that acquires printable image data uploaded to an external server and forms an image, printing of the image data is permitted only if there is a match between the printable image data and the user's face image data uploaded to the server separately by the user. This makes it possible to realize an image forming apparatus that enables image printing with greater user convenience and security than conventional methods.

[0026] The following details of this disclosure will be illustrated with drawings. The following description is illustrative in all respects and should not be construed as limiting the scope of this disclosure.

[0027] [Embodiment 1] <Outline configuration of the image forming system 100> Based on Figures 1 to 4, an image forming system 100 including a digital multifunction printer 1, which is one embodiment of the image forming apparatus disclosed herein, will be described.

[0028] Figure 1 is an explanatory diagram showing an example of the configuration of an image forming system 100 including the digital multifunction printer 1 of this disclosure. Figure 2 is a block diagram showing the schematic configuration of the digital multifunction printer 1 shown in Figure 1. Figure 3 is a block diagram showing the schematic configuration of user terminal 2 in Figure 1. Figure 4 is an explanatory diagram showing an example of a user operating the digital multifunction printer 1 shown in Figure 1.

[0029] As shown in Figure 1, in the image forming system 100 disclosed herein, the digital multifunction printer 1 is connected to a user terminal 2 and a server 3 via a wired or wireless network 4.

[0030] Digital multifunction device 1 is a device such as a multifunction printer or MFP that digitally processes image data and has copy, printer, scanner, and facsimile functions.

[0031] User terminal 2 is a mobile device such as a smartphone, a tablet, or a personal computer (PC). It may also be an electronic whiteboard or an information display. User terminal 2 uploads image data and other files for printing to server 3 via network 4.

[0032] Server 3 is a server that stores print image data and other data uploaded from user terminal 2 via network 4, making it available for download from digital multifunction printer 1.

[0033] <Outline configuration of digital multifunction printer 1> Next, the general configuration of the digital multifunction printer 1 will be explained based on Figure 2. Figure 2 is a block diagram showing the schematic configuration of the digital multifunction printer 1 shown in Figure 1.

[0034] As shown in Figure 2, the digital multifunction printer 1 comprises a control unit 10, an image data acquisition unit 11, an image forming unit 12, a storage unit 13, an image processing unit 14, a communication unit 15, an operation panel 16, a camera 17, and a user authentication unit 18.

[0035] The following describes each component of the digital multifunction printer 1.

[0036] The control unit 10 comprehensively controls the digital multifunction printer 1 and consists of a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read-only memory), various interface circuits, and the like.

[0037] The control unit 10 monitors and controls all loads, including detection by each sensor, motor, clutch, and operation panel 16, in order to control the operation of the entire digital multifunction printer 1.

[0038] The image data acquisition unit 11 is the part that acquires image data from the server 3 via the network 4. Furthermore, the image data acquisition unit 11 may acquire image data through a document reading table, scanner, card reader, USB connector, or the like.

[0039] The image forming unit 12 is the part that prints the image data acquired by the image data acquisition unit 11 and processed by the image processing unit 14 onto paper.

[0040] Furthermore, the image forming unit 12 is equipped with a dye-sublimation printer that can print on media other than ordinary paper, such as glossy cardboard similar to paper used for silver halide photographs.

[0041] The memory unit 13 is an element or storage medium that stores information and control programs necessary to realize the various functions of the digital multifunction device 1. For example, semiconductor elements such as RAM and ROM, storage media such as hard disks, flash memory units, and SSDs (Solid State Drives) are used.

[0042] The memory unit 13 stores intermediate data such as information related to print job instructions (print jobs) and internal data (work memory) necessary for executing jobs, such as image data. Furthermore, the storage unit 13 has a spool area for temporarily storing print / fax data.

[0043] Furthermore, the data may be stored in different devices, such as a hard disk drive for the data storage area and a flash memory unit for the program storage area.

[0044] The image processing unit 14 is the part that, based on the analysis results of the job commands such as printing input from the operation unit 162, converts the image data input from the image data acquisition unit 11 into appropriate electrical signals and processes them to make them suitable for output such as enlargement and reduction.

[0045] The communication unit 15 is the part that communicates with external devices such as the server 3 via the network 4 and sends and receives data with these external devices.

[0046] The operation panel 16 consists of a display panel made of a liquid crystal panel or the like, and a touch panel, such as a capacitive type, which is placed on top of the display panel and detects the position where a finger is touched, and includes a display unit 161 and an operation unit 162.

[0047] The display unit 161 is the part that displays various types of information. The display unit 161 is composed of, for example, a CRT display, a liquid crystal display, or an EL display, and is a display device such as a monitor or line display for displaying electronic data such as processing status by the operating system or application software.

[0048] The control unit 10 displays the operation and status of the digital multifunction printer 1 through the display unit 161.

[0049] The control unit 162 is an interface for operating the digital multifunction printer 1 and is the part that receives commands from the user.

[0050] As shown in Figure 4, the camera 17 is attached to the digital multifunction printer 1 and is the part that acquires images within a predetermined shooting range. Camera 17 captures images of users who enter a predetermined shooting range and obtains image data of the users' faces.

[0051] The user authentication unit 18 is the part that extracts and analyzes the user's facial image data acquired by the camera 17 to identify and authenticate the user.

[0052] The user authentication unit 18 does not necessarily have to be located on the digital multifunction device 1, and may be configured independently of the digital multifunction device 1. For example, when performing user facial recognition, the system may be linked with a room surveillance camera system to acquire facial image data of the user in front of the digital multifunction printer captured by the surveillance camera system.

[0053] <Outline configuration of user terminal 2> Next, the general configuration of user terminal 2 will be explained based on Figure 3.

[0054] As shown in Figure 3, the user terminal 2 includes a control unit 20, an image data acquisition unit 21, a storage unit 22, an image processing unit 23, a communication unit 24, a display unit 25, an operation unit 26, and a camera 27.

[0055] The following describes each component of user terminal 2.

[0056] The control unit 20 is the part that comprehensively controls the user terminal 2 and consists of a CPU, RAM, ROM, various interface circuits, etc.

[0057] The image data acquisition unit 21 is the part that acquires image data captured by the camera 27.

[0058] The memory unit 22 is an element or storage medium that stores information and control programs necessary to realize various functions of the user terminal 2. For example, semiconductor elements such as RAM and ROM, storage media such as hard disks, flash memory units, and SSDs are used.

[0059] The image processing unit 23 is the part that, based on operation instructions from the operation unit 26, converts image data to be displayed on the display unit 25 into appropriate electrical signals and processes them to make them suitable for output such as enlargement and reduction.

[0060] The communication unit 24 communicates with the server 3 via the network 4 and sends and receives data such as setting information necessary for printing.

[0061] The display unit 25 is the part that displays various information from the user terminal 2.

[0062] The operation unit 26 is an interface for operating the user terminal 2 and is the part that receives commands from the user.

[0063] The display unit 25 and the operation unit 26 may be implemented by a display panel made of a liquid crystal panel or the like, and a touch panel such as a capacitive touch panel that is placed on top of the display panel and detects the position where a finger is touched.

[0064] Camera 27 captures a photo of the user's face when it enters a predetermined shooting range. The captured image data of the user's face is transmitted to server 3, for example, via network 4, according to the user's instructions.

[0065] <Flowchart of photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 1 of this disclosure> Next, an example of the photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 1 of this disclosure will be described based on Figures 5 to 7.

[0066] In Embodiment 1, it is assumed that a user takes a picture of their own face with the camera 27 in the photo printing application on the user terminal 2, uploads it to the server 3, and then downloads the face image data using a digital multifunction printer 1 installed in a store such as a convenience store to print the photo.

[0067] Figure 5 is a flowchart showing the processing of the photo printing application on user terminal 2 in Figure 1.

[0068] In step S1 of Figure 5, the control unit 20 of the user terminal 2 determines whether or not the photo printing application has been launched (step S1).

[0069] If the photo printing application is launched (if the determination in step S1 is Yes), in step S2, the control unit 20 instructs the user to take a facial image with the camera 27 (step S2).

[0070] In step S3, the control unit 20 captures the user's face image with the camera 27 and determines whether or not the image data acquisition unit 21 has acquired it (step S3).

[0071] When the camera 27 captures an image of the user's face and the image data acquisition unit 21 acquires it (if the determination in step S3 is Yes), in step S4, the control unit 20 instructs the user to set the layout of the photo (step S4).

[0072] Figure 6 shows an example of the layout of a user's face photo set in the photo printing application on user terminal 2 in Figure 1.

[0073] In the example shown in Figure 6, the user's photos are set to a size of 4 cm vertically and 3 cm horizontally, with a layout of 4 photos in 2 rows and 4 photos vertically and horizontally.

[0074] In step S5, the control unit 20 determines whether or not the layout setting has been accepted (step S5).

[0075] If the layout settings are accepted (if the determination in step S5 is Yes), in step S6, the control unit 20 uploads the user's face image data and layout settings to the server 3 via the communication unit 24 (step S6).

[0076] Figure 7 shows an example of a user's facial photograph taken with the photo printing application on user terminal 2 in Figure 1 (Figure 7(A)) and a screen indicating that the image is being uploaded (Figure 7(B)).

[0077] Next, in step S7, the control unit 20 issues a management number for photo printing and notifies the user (step S7), and then terminates the process. The management number may be displayed on the display unit 25, or it may be sent to the email address of the user who has been registered in advance.

[0078] Figure 8 is a flowchart showing the printing process of image data for printing from the digital multifunction printer 1 shown in Figure 1.

[0079] In step S11 of Figure 8, the control unit 10 of the digital multifunction printer 1 determines whether or not it has received a print instruction for a photograph (step S11).

[0080] For example, consider the case where printing a photo is selected from the menu displayed on the display unit 161 of the control panel 16.

[0081] If a print order for a photograph is received (if the determination in step S11 is Yes), in step S12, the control unit 10 displays the input form for the management number on the display unit 161 (step S12).

[0082] In step S13, the control unit 10 determines whether or not a management number has been entered (step S13).

[0083] If a management number is entered (if the determination in step S13 is Yes), in step S14, the control unit 10 obtains an image for printing from the server 3 based on the management number and extracts the user's face image data from the image for printing (step S14).

[0084] Next, in step S15, the control unit 10 captures a facial image of the user of the digital multifunction printer 1 with the camera 17, as shown in Figure 4 (step S15).

[0085] In step S16, the control unit 10 compares the user's face image data acquired from the server 3 with the user's face image data captured by the camera 17 to determine whether or not these face image data match (step S16).

[0086] If the facial image data matches (if the determination in step S16 is Yes), in step S17, the control unit 10 permits the display, download, and printing of the image (step S17).

[0087] Then, in step S18, the control unit 10 displays, downloads, and prints the image in response to user operation (step S18), and then terminates the process.

[0088] On the other hand, if the facial image data does not match (the determination in step S16 is No), in step S19, the control unit 10 does not allow the display, download, or printing of the image (step S19).

[0089] Then, in step S20, the control unit 10 notifies the user that it cannot allow the display, download, or printing of the image in response to the user's operation (step S20), and terminates the process.

[0090] (modified version) Figure 9 shows another example of the layout of a user's face photo set in the photo printing application for user terminal 2 in Figure 1.

[0091] As shown in Figure 9, it is also possible to incorporate facial images of people other than the user as the facial image for user authentication. In this case, the other person can act as an agent and print the photograph from the store's digital multifunction printer 1.

[0092] In this way, in a digital multifunction printer 1 that acquires print image data uploaded to an external server 3 and forms an image, printing of the image data is permitted only if there is a match between the print image data and the user's face image data acquired by the camera 17. This makes it possible to realize a digital multifunction printer 1 that enables image printing with greater user convenience and security than conventional methods.

[0093] (Embodiment 2) <Flowchart of photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 2 of this disclosure> Next, an example of the photo printing process of the digital multifunction printer 1 in the image forming system 100 of this embodiment 2 of the disclosure will be described based on Figure 10.

[0094] Embodiment 2 assumes a case where the digital multifunction printer 1 installed in a store such as a convenience store does not have a camera for taking pictures of users.

[0095] The general configuration of the image forming system 100 according to Embodiment 2 of this disclosure is the same as that of Embodiment 1 (Figures 1 to 3), except that the digital multifunction printer 1 does not have a camera, so a description will be omitted.

[0096] Figure 10 is a flowchart showing the printing process of image data for printing by the digital multifunction printer 1 in the image forming system 100 of Embodiment 2 of this disclosure.

[0097] The processes in steps S21-S24 and S29-S32 in Figure 10 correspond to the processes in steps S11-S14 and S17-S20 in Figure 8 (Embodiment 1), respectively, so their explanation is omitted.

[0098] Here, we will explain the process of steps S25 to S28 in Figure 10, which is different from Figure 8.

[0099] In step S24 of Figure 10, the control unit 10 obtains an image for printing from the server 3 based on the management number and extracts the user's face image data (step S24). Then, in step S25, the control unit 10 determines whether a predetermined card image or a smartphone image has been selected as the face image for identification (step S25).

[0100] Examples of images for the photo card include images of the user's driver's license or My Number card, which feature the user's face photo. Examples of smartphone images used for photography include user face images registered on the smartphone itself or in the photo printing application. Alternatively, the image may be a face image of a user registered on a designated social networking service or avatar.

[0101] If a card image is selected (if the determination in step S25 is "card image"), in step S26, the control unit 10 causes the image data acquisition unit 11 to read the image of the predetermined card and extracts the user's face image (step S26).

[0102] Then, in step S28, the control unit 10 compares the user's face image data obtained from the server 3 with the user's face image data extracted from a predetermined card image to determine whether or not these face image data match (step S28).

[0103] On the other hand, if a smartphone image is selected (if the determination in step S25 is "smartphone image"), in step S27, the control unit 10 extracts the user's face image received via the communication unit 24 (step S27).

[0104] Then, in step S28, the control unit 10 compares the user's face image data obtained from the server 3 with the user's face image data received from the smartphone to determine whether or not these face image data match (step S28).

[0105] Regardless of whether a card image or a smartphone image is selected, in step S28, if the face image data matches (if the determination in step S28 is Yes), in step S29, the control unit 10 permits the display, download, and printing of the image (step S29).

[0106] Then, in step S30, the control unit 10 displays, downloads, and prints the image in response to user operations (step S30), and then terminates the process.

[0107] On the other hand, if the facial image data does not match (if the determination in step S28 is No), in step S31, the control unit 10 does not allow the display, download, or printing of the image (step S31).

[0108] Then, in step S32, the control unit 10 notifies the user that it cannot allow the display, download, or printing of the image in response to the user's operation (step S32), and terminates the process.

[0109] In this way, in a digital multifunction printer 1 that acquires printable image data uploaded to an external server 3 and forms an image, printing of the image data is permitted only when there is a match between the printable image data and a predetermined card image selected by the user or the user's face image data acquired from the user terminal 2. This makes it possible to realize a digital multifunction printer 1 that enables image printing with greater user convenience and security than conventional methods.

[0110] (Embodiment 3) <Flowchart of photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 3 of this disclosure> Next, an example of the photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 3 of this disclosure will be described based on Figures 11 and 12.

[0111] In Embodiment 2, if the digital multifunction printer 1 installed in a store such as a convenience store does not have a camera to photograph the user, the user is given the option to choose whether to take a facial image for user authentication from a card image or a smartphone image within the store.

[0112] On the other hand, Embodiment 3 is characterized by allowing the user to select how to provide a facial image for user authentication when requesting printing from the photo printing application on the user terminal 2.

[0113] The general configuration of the image forming system 100 according to Embodiment 3 of this disclosure is the same as that of Embodiment 1 (Figures 1 to 3), except that the digital multifunction printer 1 does not have a camera, so a description will be omitted.

[0114] Figure 11 is a flowchart showing the processing of a photo printing application on a user terminal 2 in the image forming system 100 of Embodiment 3 of this disclosure.

[0115] The processes in steps S41 to S45 and S49 of Figure 11 correspond to the processes in steps S1 to S5 and S7 of Figure 5 (Embodiment 1), respectively, so their explanation is omitted.

[0116] Here, we will explain the process of step S47 in Figure 11, which is not shown in Figure 5.

[0117] In step S45 of Figure 11, if the layout setting for the photo is accepted (if the determination in step S45 is Yes), in step S46, the control unit 20 of the user terminal 2 presents the user with several methods for providing a facial image for user authentication and allows them to select one (step S46).

[0118] Next, in step S47, the control unit 20 determines whether a method for providing the face image has been selected (step S47).

[0119] If a method for providing facial images is selected (if the determination in step S47 is Yes), in step S48, the user's facial image data, layout settings, and method for providing facial images are uploaded to the server 3 via the communication unit 24 (step S48).

[0120] Figure 12 is a flowchart showing the printing process of image data for printing by the digital multifunction printer 1 in the image forming system 100 of the third embodiment of this disclosure.

[0121] The processes in steps S51-S54 and S57-S60 in Figure 12 correspond to the processes in steps S11-S14 and S17-S20 in Figure 8 (Embodiment 1), respectively, so their explanation is omitted.

[0122] Here, we will explain the processes in steps S55 and S56 of Figure 12, which are different from those in Figure 8.

[0123] In step S54 of Figure 12, after obtaining an image for printing from server 3 based on the management number and extracting the user's face image data (step S54), in step S55, the control unit 10 of the digital multifunction printer 1 obtains an image such as a card image or a smartphone image according to the method of providing face images that was previously selected by the user, and extracts the user's face image data from the image (step S55).

[0124] Then, in step S56, the control unit 10 compares the user's face image data obtained from the server 3 with the user's face image data extracted from images obtained according to a pre-selected method of providing face images, and determines whether these face image data match (step S56).

[0125] In this way, in a digital multifunction printer 1 that acquires printable image data uploaded to an external server 3 and forms an image, printing of the image data is permitted only if there is a match between the printable image data and the user's face image data acquired by a method previously selected by the user. This makes it possible to realize a digital multifunction printer 1 that enables image printing with greater user convenience and security than conventional methods.

[0126] (Embodiment 4) <Flowchart of photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 4 of this disclosure> Next, an example of the photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 4 of this disclosure will be described based on Figures 13 to 15.

[0127] Embodiment 4 is characterized in that, when printing a photograph containing multiple people, such as a group photo or a family photo, only the facial image of a specific person among the multiple people is designated as the facial image for user authentication.

[0128] The schematic configuration of the image forming system 100 according to Embodiment 4 of this disclosure is the same as that of Embodiment 1 (Figures 1 to 3), so a description will be omitted.

[0129] Figure 13 is a flowchart showing the processing of a photo printing application on a user terminal 2 in the image forming system 100 of Embodiment 4 of this disclosure.

[0130] In step S61 of Figure 13, the control unit 20 of the user terminal 2 determines whether or not the photo printing application has been launched (step S61).

[0131] If the photo printing application is launched (if the determination in step S61 is Yes), in step S62, the control unit 20 instructs the user to provide an image for printing (step S62).

[0132] Methods for providing images for printing include taking a picture with the camera 27, or selecting an image from the storage unit 22 of the user terminal 2, such as using an image application.

[0133] Next, in step S63, the control unit 20 determines whether or not an image for printing has been acquired (step S63).

[0134] If an image for printing is obtained (if the determination in step S63 is Yes), in step S64, the user is asked to specify a face image for user authentication from the image for printing (step S64).

[0135] Figure 14 shows an example in the image forming system 100 of Embodiment 4 of this disclosure in which a face image for user authentication is selected from a group photograph for printing in the photo printing application of the user terminal 2.

[0136] In the example in Figure 14, the faces of the man second from the left in the first row from the front and the woman third from the left in the third row from the front are circled to indicate their identification. The control unit 20 recognizes the circled face image of the person as a face image for user authentication.

[0137] In the case of a group photo, if there is no face image circled to indicate a specific face, the system may either recognize all face images of people in the group photo as user authentication face images, or it may display an error message until a face image is circled to indicate a specific face image.

[0138] Next, in step S65 of Figure 13, the control unit 20 determines whether or not a facial image for user authentication has been specified (step S65).

[0139] If a facial image for user authentication is specified (if the determination in step S65 is Yes), in step S66, the control unit 20 uploads the image data for printing and the settings for the facial image for user authentication to the server 3 (step S66).

[0140] Next, in step S67, the control unit 20 issues a management number for photo printing and notifies the user (step S67), and then terminates the process.

[0141] Figure 15 is a flowchart showing the printing process of image data for printing by the digital multifunction printer 1 in the image forming system 100 of Embodiment 4 of this disclosure.

[0142] The processes in steps S71-S73, S75, and S77-S80 in Figure 15 correspond to the processes in steps S11-S13, S15, and S17-S20 in Figure 8 (Embodiment 1), respectively, so their explanation is omitted.

[0143] Here, we will explain the processes in steps S74 and S76 of Figure 15, which are different from those in Figure 8.

[0144] In step S73 of Figure 15, if a management number is entered (if the determination in step S73 is Yes), in step S74, the control unit 10 obtains an image for printing from the server 3 based on the management number and extracts the face image data of the specified user (step S74).

[0145] Next, in step S75, the control unit 10 captures a facial image of the user of the digital multifunction printer 1 with the camera 17 (step S75).

[0146] In step S76, the control unit 10 determines whether or not there is a match among the specified user's face image data with the user's face image data captured by the camera 17 (step S76).

[0147] If the facial image data matches (if the determination in step S76 is Yes), in step S77, the control unit 10 permits the display, download, and printing of the image (step S77).

[0148] Then, in step S78, the control unit 10 displays, downloads, and prints the image in response to user operation (step S78), and then terminates the process.

[0149] On the other hand, if the facial image data does not match (the determination in step S76 is No), in step S79, the control unit 10 does not allow the display, download, or printing of the image (step S79).

[0150] Then, in step S80, the control unit 10 notifies the user that it cannot allow the display, download, or printing of the image in response to the user's operation (step S80), and terminates the process.

[0151] In this way, in a digital multifunction printer 1 that acquires print image data uploaded to an external server and forms an image, printing of the image data is permitted only when there is a match between the user's face image data acquired by the user authentication unit and the face image data pre-specified by the user within the print image data. This makes it possible to realize a digital multifunction printer 1 that enables image printing with higher user convenience and security than conventional models.

[0152] (Embodiment 5) <Flowchart of photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 5 of this disclosure> Next, an example of the photo printing process of the digital multifunction printer 1 in the image forming system 100 of Embodiment 5 of this disclosure will be described based on Figures 16 to 18.

[0153] Embodiment 5 is characterized by attaching a user authentication facial image to a different page from the image used for printing.

[0154] The schematic configuration of the image forming system 100 according to Embodiment 5 of this disclosure is the same as that of Embodiment 1 (Figures 1 to 3), so a description will be omitted.

[0155] Figure 16 is a flowchart showing the processing of a photo printing application on a user terminal 2 in the image forming system 100 of Embodiment 5 of this disclosure.

[0156] In step S81 of Figure 16, the control unit 20 of the user terminal 2 determines whether or not the photo printing application has been launched (step S81).

[0157] If the photo printing application is launched (if the determination in step S81 is Yes), in step S82, the control unit 20 instructs the user to provide an image for printing (step S82).

[0158] Methods for providing images for printing include taking a picture with the camera 27, or selecting an image from the storage unit 22 of the user terminal 2, such as using an image application.

[0159] Next, in step S83, the control unit 20 determines whether or not an image for printing has been acquired (step S83).

[0160] If an image for printing is obtained (if the determination in step S83 is Yes), in step S84, the user is instructed to provide a separate facial image for user authentication in addition to the image for printing (step S84).

[0161] Figure 17 shows an example in the image forming system 100 of Embodiment 5 of this disclosure in which a user authentication face image is attached to the image for printing in the photo printing application of the user terminal 2.

[0162] As shown in Figure 17, a separate image is provided for user authentication, in addition to the image for printing. In the example shown in Figure 17, the image for user authentication is attached to the first page, and the images for printing are attached to the second page and subsequent pages.

[0163] Next, in step S85 of Figure 16, the control unit 20 determines whether or not a facial image for user authentication has been provided (step S85).

[0164] Furthermore, if a separate image for user authentication is not provided in addition to the image for printing, the control unit 20 may recognize the user's face image in the print image as the user authentication image, or it may display an error message until a separate image for user authentication is provided in addition to the image for printing.

[0165] If a facial image for user authentication is provided (if the determination in step S85 is Yes), in step S86, the control unit 20 instructs the user to set the layout of the photo (step S86).

[0166] Next, in step S87, the control unit 20 determines whether or not the layout setting has been accepted (step S87).

[0167] If the layout settings are accepted (if the determination in step S87 is Yes), in step S88, the control unit 20 uploads the image data for printing, the face image for user authentication, and the layout settings to the server 3 via the communication unit 24 (step S88), and then terminates the process.

[0168] Figure 18 is a flowchart showing the printing process of image data for printing by the digital multifunction printer 1 in the image forming system 100 of Embodiment 5 of this disclosure.

[0169] In step S91 of Figure 18, the control unit 10 of the digital multifunction printer 1 determines whether or not it has received a print instruction for a photograph (step S91).

[0170] For example, consider the case where printing a photo is selected from the menu displayed on the display unit 161 of the control panel 16.

[0171] If a print order for a photograph is received (if the determination in step S91 is Yes), in step S92, the control unit 10 captures a picture of the user's face on the digital multifunction printer 1 with the camera 17 (step S92).

[0172] Next, in step S93, the control unit 10 obtains printable images, user authentication facial images, and layout setting data from the server 3 (step S93).

[0173] In this way, even without issuing a predetermined management number, user convenience is improved by obtaining printable images, user authentication facial images, and layout setting data from server 3 based on the facial image acquired by camera 17.

[0174] Next, in step S94, the control unit 10 compares the user's face image data captured by the camera 17 with the user's face image data acquired from the server 3 to determine whether or not there is a match (step S94).

[0175] If there is a matching face image data (if the determination in step S16 is Yes), in step S95, the control unit 10 permits the display, download, and printing of the image (step S95).

[0176] Then, in step S96, the control unit 10 displays, downloads, and prints the image in response to the user's operation (step S96), and then terminates the process.

[0177] On the other hand, if no matching face image data is found (the determination in step S94 is No), in step S97, the control unit 10 does not permit the display, download, or printing of the image (step S97).

[0178] Then, in step S98, the control unit 10 notifies the user that it cannot allow the display, download, or printing of the image in response to the user's operation (step S98), and terminates the process.

[0179] In this way, in a digital multifunction printer 1 that acquires print image data uploaded to an external server 3 and forms an image, printing of the image data is permitted only when there is a match between the print image data and the user's face image data provided separately by the user. This makes it possible to realize a digital multifunction printer 1 that enables image printing with greater user convenience and security than conventional methods.

[0180] Preferred embodiments of this disclosure include combinations of any of the embodiments described above. In addition to the embodiments described above, various modifications of this disclosure are possible. These modifications should not be construed as being outside the scope of this disclosure. This disclosure should include the meaning of equivalents to the claims and all variations within that scope. [Explanation of symbols]

[0181] 1: Digital multifunction printer, 2: User terminal, 3: Server, 4: Network, 10,20: Control unit, 11,21: Image data acquisition unit, 12: Image forming unit, 13,22: Storage unit, 14,23: Image processing unit, 15,24: Communication unit, 16: Operation panel, 17,27: Camera, 18: User authentication unit, 100: Image forming system, 25,161: Display unit, 26,162: Operation unit

Claims

1. An operating unit that accepts user input, When a print command for image data is received from a user, an image forming unit forms an image based on the image data, A user authentication unit that acquires facial image data for user authentication, A communication unit that communicates with an external server and sends and receives various data with the said server, The system comprises a control unit that controls the operation unit, the image forming unit, the user authentication unit, and the communication unit, When the control unit receives a print command for image data from the user, it obtains printable image data from the external server via the communication unit based on the print data identification information provided by the user, extracts one or more face image data from the printable image data, and determines whether or not one of the one or more face image data matches the user's face image data obtained by the user authentication unit. An image forming apparatus characterized by allowing the user to form an image based on the image data for printing if a match is found, and not allowing the user to form an image based on the image data for printing if no match is found.

2. The image forming apparatus according to claim 1, wherein the control unit extracts one or more face image data from the image data for printing, and determines whether or not among the one or more face image data, there is one that matches the user's face image data obtained by the user authentication unit, which is a face image forming apparatus according to claim 1.

3. The image forming apparatus according to claim 1 or 2, wherein the print data identification information is a management number issued to the user when the print image data was uploaded to the server, or the user's face image data.

4. The image forming apparatus according to claim 1 or 2, wherein the user authentication unit includes a camera that captures a user's face image, and the user's face image data is acquired from the user's face image captured by the camera.

5. The image forming apparatus according to claim 1 or 2, wherein the user authentication unit acquires the user's facial image data from the user's facial image described on a predetermined card or the user's facial image registered on the user's terminal.

6. The image forming apparatus according to claim 1 or 2, wherein the user authentication unit acquires the user's face image data from the user's face image uploaded to the server separately from the image data for printing.

Images