Scanner and program

Abstract

To provide a technique for enabling a user to confirm whether or not an image of a document prepared by the user is suitable for a predetermined use.SOLUTION: When MFP1 receives an instruction to start the data-scanning procedure from IF13, Tokyo uses the reading engine 16 to scan a document and generate scan AI. Then, MFP1 receives the designation of the purpose for the image of the document through user IF13, and transmits the generated scan image and the purpose indicating the received purpose to the generation AI server 200 through the communication IF14. In a case where the determination information which is output from the generation AI server 200 by the learned model 201 and includes whether or not the image indicated in the scan image is suitable for the use indicated in the use is received, whether or not the image of the read document is suitable for the designated use is notified through the user IF13 based on the determination information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technical field disclosed in this specification relates to a scanner that reads an image of a document and outputs image data, and a program for controlling the scanner. [Background technology]

[0002] Conventionally, there is known a scanner that generates image data of a scanned image according to a read setting corresponding to the type of image of a document. For example, Patent Document 1 discloses a scanner that accepts a setting of the type of image of a document and changes the amount of show-through correction according to the type of image set by the user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-92375 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for checking whether an image of a document prepared in advance by a user is suitable for a particular purpose. The technology disclosed in Patent Document 1 discloses a configuration in which a scanner determines the amount of correction for an image according to the type of image set by the user, but does not disclose a configuration for determining whether the image is suitable for a particular purpose. [Means for solving the problem]

[0005] A scanner made to solve this problem is a scanner comprising a reading engine, a user interface, and a communication interface, wherein the scanner can access a server that uses a trained model via the communication interface, and the trained model has been trained to be able to output judgment information including the suitability of an image for a purpose based on input data, and the scanner further includes a scanning process that, when a predetermined scan instruction is received via the user interface, scans an original using the reading engine and generates scan data showing an image of the original based on the scan results, and a scanning process that receives a specification of a purpose for the image of the original via the user interface. and a transmission process of transmitting the scan data generated by the scan process and usage data indicating the usage accepted in the specification process to the server via the communication interface. The scanner is further configured to, when it receives from the server via the communication interface the determination information output by the trained model, the determination information including whether or not the image shown in the scan data is suitable for the usage indicated in the usage data, execute a notification process of notifying, via the user interface, whether or not the image of the document read in the scan process is suitable for the usage specified in the specification process, based on the determination information.

[0006] The scanner disclosed in this specification accepts a specification of the purpose of an image of a document, and transmits the scan data generated by scanning the document along with information indicating the specified purpose to a server that uses a trained model. When the scanner then receives judgment information from the server indicating the suitability of the image output by the trained model, the scanner notifies the user via a user interface whether the document image is suitable for the purpose based on the judgment information. This allows the user to confirm whether the document image prepared by the user is suitable for the purpose specified by the user.

[0007] A control method for realizing the functions of the scanner, a computer program for controlling the scanner, and a computer-readable storage medium storing the computer program are also novel and useful. [Effects of the Invention]

[0008] The technology disclosed in this specification realizes a technology that allows a user to check whether an image of a document prepared by the user is suitable for a predetermined purpose. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is an explanatory diagram showing a schematic configuration of an MFP according to an embodiment of the present invention. [Figure 2] FIG. 10 is a sequence diagram illustrating an example of an AI scan procedure. [Figure 3] FIG. 10 is an explanatory diagram showing an example of an operation procedure for executing a scan. [Figure 4] FIG. 10 is an explanatory diagram showing an example of use type information. [Figure 5] 10 is a flowchart showing an example of a procedure for processing when an OK determination is made. [Figure 6] FIG. 10 is an explanatory diagram showing an example of a notification screen. [Figure 7] 10 is a flowchart showing an example of a procedure for processing when a determination is made NG; [Figure 8] 10A and 10B are explanatory diagrams showing examples of reason images and reason texts. [Figure 9] FIG. 2 is an explanatory diagram showing a schematic configuration of a terminal device. [Figure 10] FIG. 10 is a sequence diagram illustrating an example of an AI scan procedure. DETAILED DESCRIPTION OF THE INVENTION

[0010] A first embodiment of a scanner will be described in detail below with reference to the accompanying drawings. This specification discloses a multifunction peripheral (hereinafter referred to as "MFP") having various functions including an image reading function and a communication function.

[0011] As shown in Fig. 1, the MFP 1 of this embodiment includes a controller 10 including a CPU 11 and a memory 12. The MFP 1 also includes a user interface (hereinafter referred to as "user IF") 13, a communication interface (hereinafter referred to as "communication IF") 14, a print engine 15, and a reading engine 16, which are electrically connected to the controller 10. The MFP 1 is an example of a scanner. Note that the controller 10 in Fig. 1 is a general term for hardware and software used to control the MFP 1, and does not necessarily represent a single piece of hardware actually present in the MFP 1.

[0012] The CPU 11 of the MFP 1 executes various processes in accordance with programs read from the memory 12 and based on user operations. The memory 12 of the MFP 1 stores various programs including an operating system (hereinafter referred to as "OS") 21 and an AI scan program 22, as well as various data including application type information 23 and AI scan parameters 24. The memory 12 is also used as a work area when various processes are executed. The buffer provided in the CPU 11 is also an example of the memory 12. Details of the programs and data will be described later.

[0013] Note that an example of memory 12 is not limited to a ROM, RAM, HDD, etc. built into MFP 1, but may also be a storage medium that is readable and writable by CPU 11. For example, an external memory such as a USB memory or HDD connected to MFP 1 via communication IF 14, or a memory or HDD provided in a device connected to MFP 1 via communication IF 14 are also examples of memory.

[0014] Computer-readable storage media are non-transitory media. In addition to the above examples, non-transitory media also include recording media such as CD-ROMs and DVD-ROMs. Non-transitory media are also tangible media. On the other hand, electrical signals carrying programs downloaded from servers on the Internet are computer-readable signal media, which is a type of computer-readable medium, but are not included in non-transitory computer-readable storage media.

[0015] The user IF 13 includes hardware for displaying a screen for notifying the user of information and hardware for accepting operations by the user. The user IF 13 may include a touch panel having a screen display function and an operation acceptance function, or may include a combination of a display and hardware buttons, etc.

[0016] The communication IF 14 includes hardware for communicating with external devices. The communication IF 14 includes functions compatible with communication standards such as Wi-Fi (registered trademark), Ethernet (registered trademark), and USB. The MFP 1 may be equipped with multiple communication IFs 14 compatible with multiple communication standards.

[0017] Print engine 15 includes a configuration for printing an image on a print medium such as a sheet. The image formation method of print engine 15 is, for example, an electrophotographic method or an inkjet method. Print engine 15 may be configured to be capable of multi-color printing, or may be configured to perform only monochrome printing.

[0018] The reading engine 16 includes a configuration for scanning a document placed on the flatbed or a document placed on a document feeder and transported to a reading position, and generating scan data that is the scan result. The MFP1 of this embodiment is equipped with the reading engine 16 that can perform both color reading, which reads a document as a color image, and monochrome reading, which reads a document as a monochrome image.

[0019] The MFP1 can connect to the Internet 100 via the communication IF 14, and can access a generation AI server 200 via the Internet 100, for example, as shown in FIG. 1. The generation AI server 200 includes a trained model 201 that has been trained in advance using various data so as to output response data based on input data. The generation AI server 200 is an example of a server that uses a trained model. The trained model 201 may be a server of an AI provider that is publicly available on the Internet 100. An example of an AI provider is OpenAI.

[0020] The trained model 201 has been trained to be able to, upon receiving input of image data and information indicating the intended use of the image data, analyze the image data and determine whether the image data is suitable for the intended use. In other words, the trained model 201 has learned information indicating various intended uses of images and information indicating the conditions for images acceptable for each intended use, and can determine whether an image included in the input image data satisfies the conditions for use in the input intended use. For example, a trained model on a server provided by an AI provider is trained using big data. Therefore, the trained model 201 is expected to analyze the input image data and determine the suitability of the image data with high accuracy. For example, when the intended use of the image is a photograph to be used in a passport or visa application, the trained model 201 may have learned information indicating the conditions that must be met depending on the country or region of the application.

[0021] The generation AI server 200 may be provided with an API for having the trained model 201 determine whether the input image data is appropriate and returning information on the determination result. For example, the MFP 1 may be able to instruct the trained model 201 to output the determination result by inputting image data and information indicating the purpose into a predetermined API provided in the generation AI server 200.

[0022] Alternatively, the generation AI server 200 may have a chat function. When a question is input to the chat function, the generation AI server 200 may be able to output, to the device that input the question, a response indicating a determination result generated by the trained model 201 based on the input question. For example, the MFP 1 may be able to input image data, information indicating the purpose of the image data, and a character string (e.g., a prompt) requesting a determination as to whether the image data is suitable for that purpose into the chat function of the generation AI server 200, thereby instructing the trained model 201 to make a suitability determination.

[0023] Next, the procedure for determining an image by the MFP 1 will be described. The following process basically refers to CPU processing in accordance with instructions written in a program. In other words, processes such as "judging," "extracting," "selecting," "calculating," "deciding," "identifying," "acquiring," "receiving," and "control" in the following description represent CPU processing. CPU processing also includes hardware control using an OS API. In this specification, the operation of each program will be described without mentioning the OS. In other words, in the following description, a statement to the effect that "Program B controls Hardware C" may also mean that "Program B controls Hardware C using the OS API." Furthermore, CPU processing in accordance with instructions written in a program may be described in abbreviated terms. For example, it may be described as "performed by the CPU." Furthermore, CPU processing in accordance with instructions written in a program may be described in abbreviated terms, such as "performed by Program A."

[0024] In this specification, the terms "notification," "alert," "notification," "reply," "response," and "answer" are used not only to mean the transmission of information to a person, but also to mean communication or exchange of information between devices or between components within a device. Note that the components within a device include software.

[0025] Note that "obtaining" is used as a concept that does not require a request. In other words, the process of receiving data without the CPU requesting it is also included in the concept of "the CPU obtaining data." Furthermore, "data" in this specification is represented as a bit string that can be read by a computer. Data with the same substantial meaning but different formats will be treated as the same data. The same applies to "information" in this specification. Furthermore, "requesting" and "instructing" are concepts that indicate outputting information indicating a request or an instruction to the other party. Furthermore, information indicating a request or an instruction will also be simply referred to as a "request" or "instruction."

[0026] Furthermore, the process by a CPU to determine whether information A indicates event B is sometimes conceptually described as "determining whether event B is true from information A." The process by a CPU to determine whether information A indicates event B or event C is sometimes conceptually described as "determining whether event B or event C is true from information A."

[0027] In addition, in this specification, a setting item may be simply referred to as a "setting." A setting value may be simply referred to as a "setting." A setting value may also be referred to as a "parameter." Furthermore, storing a setting value in a memory or the like may be simply referred to as a "setting." An operation for setting or an input for setting may be simply referred to as a "setting."

[0028] The AI ​​scan procedure executed by the MFP1 will be explained with reference to the sequence diagram in Figure 2. This AI scan procedure is initiated when the MFP1 is ready to accept an AI scan instruction. Note that the AI ​​scan procedure of this embodiment is a procedure for scanning a document containing a facial photograph and determining whether the scan results are suitable for use as a photograph to be used in an application to a specified institution. In other words, the document to be scanned in the AI ​​scan procedure of this embodiment is intended to be a facial photograph to be attached to various application documents.

[0029] When the MFP 1 is in standby mode, it can display a standby screen on the user IF 13 (A01). For example, as shown in FIG. 3(A), the MFP 1 displays a standby screen 50 including a scan icon 51 and an AI scan icon 52. In addition to these icons, the standby screen 50 also displays a plurality of icons that can accept instructions for various functions that can be executed by the MFP 1. By accepting a user's operation on each icon, the MFP 1 can accept selection of a function corresponding to the operated icon. However, the following description will focus on scan-related functions, and descriptions of functions other than scan will be omitted.

[0030] The scan icon 51 is an icon that accepts an instruction to perform a scan, generate scan data, and save it in a specified destination. When an operation on the scan icon 51 is accepted, the MFP 1 can accept a setting operation for parameters related to the generation of scan data. Examples of parameters include a parameter for setting the scan resolution, a parameter for color settings indicating whether color scanning is to be performed, and a parameter indicating whether correction processing is to be performed on the scanned data. When the MFP 1 accepts a setting operation for specifying parameters, the MFP 1 executes a scan using the parameters specified by the setting operation. In other words, the user must determine for themselves the parameters necessary to obtain the scan data they desire and perform an operation on the MFP 1 to specify the necessary parameters. The scan icon 51 is an example of a control corresponding to scanning.

[0031] The AI ​​scan icon 52 is an icon that accepts an instruction to start an AI scan procedure. When an operation on the AI ​​scan icon 52 is accepted, the MFP 1 does not accept an operation to set parameters related to the generation of the scan data described above. An operation on the AI ​​scan icon 52 is an example of a predetermined scan instruction.

[0032] The user selects an AI scan procedure by operating the AI ​​scan icon 52 on the user IF 13 (A02). When the operation on the AI ​​scan icon 52 is accepted, the MFP 1 displays a usage selection screen 60 that accepts the selection of the usage of the image (A03), as shown in FIG. 3(B), for example. The usage selection screen 60 includes, for example, an execute button 61 that accepts an instruction to decide the usage and start scanning, a "Country to submit" button 62, and a "Document to submit" button 63.

[0033] The MFP 1 accepts the selection of the purpose through the operation of buttons 62 and 63. When the operation of the "Submit Country" button 62 is accepted, the MFP 1 displays options for the country or region to which the document containing the original to be scanned is to be submitted, and accepts the user's selection. When the operation of the "Document to Submit" button 63 is accepted, the MFP 1 displays options for the type of document, and accepts the user's selection.

[0034] 4, the MFP 1 stores, as use type information 23, information that associates submission destination 231 with submission document 232. Based on use type information 23 stored in memory 12, MFP 1 displays options when button 62 or button 63 is operated. For example, when button 62 is operated, MFP 1 displays a list of submission destinations 231 such as "Japan," "China," and "India" as options, and accepts selection of submission destination information indicating the country or region of the submission destination.

[0035] Furthermore, when the MFP 1 accepts an operation on the button 63, it displays a list of documents to be submitted 232 that can be combined with the submission destination information accepted via the operation on the button 62, such as "passport" or "visa," as options, and accepts the selection of document information indicating the documents to be submitted. Note that the MFP 1 may accept the selection of document information via the operation on the button 63, and then accept the selection of submission destination information via the operation on the button 62.

[0036] The user specifies the use of the image through a selection operation based on buttons 62 and 63 on the displayed use selection screen 60 (A04). A04 is an example of the designation process. As a result, the MFP 1 acquires the selected submission destination information and document information. Hereinafter, the combination of the submission destination information and the document information will be referred to as "use data." FIG. 4 is a diagram showing the correspondence between the use ID and the use data, which is the combination of the submission destination information and the document information.

[0037] The uses that can be specified on the MFP1 include the use of photographs for passport applications. For example, <1> The usage data of " is usage data indicating the usage of a photograph to be used for a passport application in Japan. In other words, when "Japan" is selected as the submission destination information and "Passport" as the document information, the MFP 1 selects "Purpose ID <1> It is determined that "usage data" is selected.

[0038] In addition, the uses that can be specified on the MFP1 include a photo to be used for a visa application for a specific country. For example, <4> The usage data of "Purpose ID" indicates that the photograph is to be used for a Chinese visa application. In other words, when "China" is selected as the submission destination information and "Visa" is selected as the document information, the MFP1 <4> It is determined that "usage data" is selected.

[0039] Instead of accepting the selection of submission destination information and document information via the operation of two buttons, the MFP 1 may display a list of usage data combining submission destination 231 and submission document 232 as options via the operation of a single button, and accept the user's selection of a combination of submission destination information and document information. Alternatively, the MFP 1 may first accept a selection of domestic or international use, and then accept the selection of a document if it is for domestic use, and accept the selection of a target country if it is for international use. Furthermore, for example, if the MFP 1 accepts the selection of "passport" or "My Number card" as document information, the MFP 1 may determine the submission destination information without accepting the user's selection of a submission destination, since applications are limited to documents issued in the user's own country.

[0040] The user selects the purpose of the image, places a document on the flatbed or document feeder, and then operates the execute button 61 to instruct the start of scanning (A11). This operation on the execute button 61 may be an example of a predetermined scan instruction. Note that the MFP 1 may not accept an operation on the execute button 61 until it accepts the selection of the purpose.

[0041] Upon receiving the operation at A11, the MFP 1 activates the reading engine 16 to read the image of the document and generate scan data (A12). A12 is an example of a scan process.

[0042] In the AI ​​scan procedure, the MFP 1 does not accept a parameter setting instruction, and instead performs a scan in A12 using AI scan parameters 24 stored in memory 12 at the time of shipment of the MFP 1. The AI ​​scan parameters 24 are information on a group of parameters suitable for performing an AI scan for various setting items related to the generation of scan data. In other words, when performing an AI scan by operating the AI ​​scan icon 52, the user does not need to set parameters for scanning a document, and can start the procedure with a simple operation. The AI ​​scan parameters 24 may be different for each use data. In this case, the MFP 1 determines the parameters to use in A12 based on the use data selected in A04.

[0043] The AI ​​scan parameters 24 are parameters for generating scan data suitable for the trained model 201 to determine suitability in a later procedure. For example, the AI ​​scan parameters 24 may have a "color" parameter set for the color setting item and a "high resolution" parameter set for the scan resolution setting item. Since the AI ​​scan procedure does not accept parameter setting operations, the MFP 1 can avoid scanning a document with inappropriate parameters. Note that the AI ​​scan parameters 24 do not include parameters indicating that data correction should be performed after reading, or information indicating the output destination of the scanned data.

[0044] The MFP 1 then instructs the generation AI server 200 to respond as to whether the image included in the scan data is suitable for the purpose indicated in the purpose data. At this time, the MFP 1 transmits the scan data generated in A12 and the purpose data of the purpose ID indicating the purpose selected by the user in A04 to the generation AI server 200 (A13). The MFP 1 may issue the instruction by, for example, transmitting the scan data and purpose data to the generation AI server 200 via a dedicated API, or by issuing a prompt. A13 is an example of a transmission process.

[0045] The scan data that the MFP1 sends to the generation AI server 200 in A13 may be the raw data obtained by the reading engine 16 (i.e., RAW data), or it may be data after processing such as format conversion has been performed by the MFP1. However, the MFP1 does not perform image correction on the scan data that would alter its contents. Furthermore, the MFP1 may instruct the generation AI server 200 not to perform image correction that would alter its contents in A13.

[0046] Image correction by the generation AI server 200 also includes image correction by the trained model 201. Image correction that alters content can include, for example, correction that changes facial features, correction that changes hairstyle, and correction that removes or adds accessories such as glasses. Furthermore, assuming that a user uses an AI scanning procedure to determine whether a scanned photograph is suitable for a particular purpose when submitting a paper document, the MFP 1 and the generation AI server 200 should not perform image correction on the scanned data that improves the appearance of the image, such as noise removal, edge enhancement, or smoothing, to the extent that such image correction does not constitute alteration. On the other hand, assuming that a user uses an AI scanning procedure to determine whether a scanned photograph is suitable for a particular purpose when submitting an electronic document, the MFP 1 and the generation AI server 200 may or may not perform image correction on the scanned data that improves the appearance of the image to the extent that such image correction does not constitute alteration.

[0047] Furthermore, the generation AI server 200 may process the scan data received from the MFP1 without altering its contents before inputting it to the trained model 201. For example, the generation AI server 200 may crop the scan data and input only the facial image to the trained model 201. The MFP1 generates scan data by scanning a predetermined scan range. Therefore, the scan data transmitted by A13 often includes unnecessary surrounding data around the facial image and is not cropped. In this specification, the case where the scan data transmitted by the MFP1 is cropped and input to the trained model 201 is also included in the category of the MFP1 inputting scan data to the trained model 201.

[0048] The generation AI server 200 determines, using the trained model 201, whether the image shown in the input scan data is suitable for the purpose indicated by the input purpose data, i.e., the country or region of submission and the type of document to be submitted (A15), and generates response data including the determination information output by the trained model 201. The generation AI server 200 then outputs the generated response data to the MFP1 (A16). As a result, after executing the transmission of A13, the MFP1 receives, via the communication IF14, determination information indicating the suitability of the image shown in the scan data from the generation AI server 200.

[0049] Photographs used for various applications have different standards depending on their purpose. For example, photographs for Japanese passport applications have various standards, such as dimensions, background, facial orientation, facial expression, decoration, and image quality. Furthermore, photograph standards for visa applications may differ depending on the country or region. If the trained model 201 has learned the photograph standards for each purpose, it can determine whether the photograph is suitable for that purpose based on the input scan data and purpose data. In this case, the MFP 1 sends the scan data and purpose data to the generation AI server 200 and instructs it to make a determination, allowing the user to check whether the original photograph meets the standard without knowing the exact standard.

[0050] Note that the generation AI server 200 may perform various processes on the data output by the trained model 201 without significantly altering the content of the data, and then transmit the data to the MFP 1. In this specification, the case where the MFP 1 receives data that has been subjected to various processes after being output by the trained model 201 is also included in the category of the MFP 1 receiving data output by the trained model.

[0051] If the generation AI server 200 determines that the image is suitable for the intended use based on the determination information included in the response data received from the generation AI server 200 (alt: [OK determination]), the MFP1 executes the OK determination process (A21). The procedure for the OK determination process will be described with reference to the flowchart in Figure 5. This OK determination process is executed by the CPU 11 of the MFP1 based on the AI ​​scan program 22.

[0052] In the OK determination process, the CPU 11 causes the user IF 13 to display a notification screen including information indicating that the image is suitable for the purpose (S101). S101 is an example of the notification process. For example, as shown in FIG. 6(A), the CPU 11 displays a notification screen 70 including a message indicating that the image of this document is suitable for the purpose, a save button 71, and an end button 72. FIG. 6(A) shows an example in which the specified purpose is a Japanese passport. For example, as shown in FIG. 6(A), the CPU 11 may display the notification screen 70 including information indicating the purpose.

[0053] Then, the CPU 11 waits until it receives an operation on the save button 71 or the end button 72 (S105). S105 is a process of receiving a selection of whether or not to output image data, and is an example of an output selection process.

[0054] In cases where submission as image data is possible or where the user wishes to keep a record, the user operates the save button 71 to request output of the image data. The image data to be output is data based on the scan data generated in A12, and is data representing an image including a facial image. On the other hand, in cases where the user only needs to know the judgment result and submits a photograph of the original, the user can operate the end button 72 to end the procedure.

[0055] When it is determined that output of image data has been selected by accepting an operation on save button 71 (S105: save), CPU 11 accepts the selection of a save destination (S106). For example, CPU 11 may display a list of selectable save destinations and accept the user's selection. Selectable save destinations include, for example, memory 12 of MFP 1, a USB memory attached to MFP 1, and a memory in an external device connected to MFP 1.

[0056] Then, the CPU 11 determines whether image data for output has been received (S111). The response data received from the generation AI server 200 at A16 in FIG. 2 may or may not include image data. If it is determined that the response data does not include image data, that is, that image data has not been received (S111: NO), the CPU 11 requests the generation AI server 200 to send image data (S112). The CPU 11 transmits an image acquisition request to the generation AI server 200 via the communication IF 14. The CPU 11 then waits until it receives image data from the generation AI server 200 (S113).

[0057] For example, the CPU 11 may request the generation AI server 200 in S112 to send image data in which a portion of the image has been cropped so that the size is suited to the purpose selected by the user in A04 of FIG. 2. For example, if the trained model 201 has learned the image data size suited to each purpose, the MFP 1 may be able to receive cropped image data. As described above, the scan data generated in A12 of FIG. 2 is image data that corresponds to the reading range of the MFP 1 and is likely not cropped. If the CPU 11 can receive cropped image data from the generation AI server 200, the CPU 11 does not need to crop the image data, reducing the processing load on the MFP 1. Furthermore, being able to output cropped image data makes it easier for the user to use the image data.

[0058] Furthermore, the CPU 11 may request the generation AI server 200 to send image data in a format suited to the application selected by the user, or a file in a file format suited to the application. For example, if the trained model 201 has trained an image format or file format suited to each application, the MFP 1 may be able to receive data in an image format or file format suited to the application.

[0059] If it is determined that image data has been received from the generation AI server 200 in response to the request (S113: YES), or if it is determined that image data has been received together with the response data (S111: YES), the CPU 11 generates a file containing the received image data and saves it in the selected save destination (S121). S121 is an example of output processing.

[0060] If the image data is received from the generation AI server 200 together with the judgment information, the CPU 11 can immediately output the image data without making the request of S112. On the other hand, if the response data received from the generation AI server 200 is only information indicating the judgment result, and the CPU 11 requests image data as needed, it can avoid unnecessary communication for receiving unnecessary image data.

[0061] Instead of saving the image data, the CPU 11 may output the image data to the application destination server as image data for submission, for example. If the image is appropriate, the image data can be output as image data in an appropriate image format, allowing the user to use the image data. If image data in an image format suitable for the intended use can be received from the generation AI server 200, the MFP 1 does not need to execute processing to generate image data in an appropriate image format from the scan data generated at A12 in FIG. 2, thereby reducing the processing load on the scanner.

[0062] The CPU 11 may also accept the selection of a save destination after receiving the image data in S113. When the CPU 11 accepts an operation on the AI ​​scan icon 52 on the standby screen 50 (see FIG. 3A), the CPU 11 may also accept the selection of a save destination before starting scanning, or after executing scanning, before or after sending the scan data to the generation AI server 200.

[0063] In addition, if image data in an image format suitable for the purpose selected by the user and trimmed to a size suitable for the purpose selected by the user cannot be received from the generation AI server 200, the CPU 11 may perform image format conversion and trimming processing itself and save it in the selected storage location.

[0064] After S121, or when it is determined that the user's operation on the end button 72 on the notification screen 70 has been accepted (S105: End), the CPU 11 ends the OK determination process and returns to the AI ​​scan procedure of FIG.

[0065] Returning to the explanation of the AI ​​scan procedure in Figure 2, if the MFP 1 determines that the image is not suitable for the intended use based on the judgment information included in the response data received from the generation AI server 200 (alt: [NG judgment]), it executes NG judgment processing (A22). The procedure for the NG judgment processing will be explained with reference to the flowchart in Figure 7. This NG judgment processing is executed by the CPU 11 of the MFP 1 based on the AI ​​scan program 22.

[0066] In the NG determination process, the CPU 11 causes the user IF 13 to display a notification screen including information indicating that the image is not suitable for the purpose (S201). S201 is an example of the notification process. For example, as shown in FIG. 6(B), the CPU 11 displays a notification screen 80 including a message indicating that the image of this document is not suitable for the purpose, a reason display button 81, and an end button 82. FIG. 6(B) shows an example in which the specified purpose is a Japanese passport. For example, as shown in FIG. 6(B), the CPU 11 may display the notification screen 80 including information indicating the purpose.

[0067] Then, the CPU 11 waits until it receives an operation on the reason display button 81 or the end button 82 (S205). S205 is an example of a display selection process.

[0068] When it is determined that an instruction to display the reason has been received by operating the reason display button 81 (S205: YES), the CPU 11 determines whether or not reason information has been received (S211). If reason information is included in the answer data received from the generation AI server 200, the CPU 11 determines in S111 that the reason information has been received. Note that if reason information has been received, the CPU 11 may display the reason on a notification screen based on the received reason information without waiting for acceptance of an operation on the reason display button 81. When answer data including reason information together with judgment information has been received from the server, the CPU 11 can immediately notify the user of the reason information.

[0069] If the answer data does not include reason information (S211: NO), the CPU 11 sends a reason acquisition request to the generation AI server 200 requesting that reason information be sent (S212). Then, the CPU 11 waits until reason information is received from the generation AI server 200 (S213). The CPU 11 may request the generation AI server 200 to send, as reason information, at least one of a reason image that shows the reason for inappropriateness in an image and reason text that expresses the reason for inappropriateness in text. The CPU 11 may instruct the generation AI server 200 on the language to be used for the reason text. The reason image is an example of image data that shows, in an image, the reason why the image is not suitable for the purpose. The reason text is an example of text data that shows, in text, the reason why the image is not suitable for the purpose.

[0070] If judgment information that does not include reason information is first received, and then when an instruction to display the reason is received, reason information is requested from the generation AI server 200, reason information will not be received if there is no need to display the reason, thereby avoiding unnecessary communication.

[0071] If it is determined that reason information has been received from the generation AI server 200 in response to the request (S213: YES), or if it is determined that reason information has already been received in the answer data (S211: YES), the CPU 11 causes the user IF 13 to display a reason notification screen including the received reason information (S215). S215 is an example of display processing. For example, as shown in FIG. 6(C), the CPU 11 displays a reason notification screen 90 including a reason image 91 showing the reason as an image, reason text 92 showing the reason as text, a save image button 93, and an end button 94. Note that it is sufficient for the reason notification screen 90 to include at least one of the reason image 91 and the reason text 92.

[0072] As shown in FIG. 8 , the reason notification screen 90 includes, for example, reason text 92 such as (a) too bright, (b) too dark, (c) the entire face does not fit on the screen, (d) the face is facing inappropriately, or (e) there is a garbage image, and a reason image 91 indicating the inappropriate portion. The reason image 91 is image data in which marks indicating the inappropriate portion are added to the scan data transmitted to the generation AI server 200 by A13. The reason image 91 may be cropped or may not be cropped. Furthermore, if there are multiple reasons, the CPU 11 may display reason images 91 in which all of the multiple reason portions are marked, or may display the reason notification screen 90 in which multiple reasons are arranged as separate reason images 91, or may be capable of accepting an instruction to switch the reason image 91 by scrolling, etc.

[0073] There are various reasons why an image may be determined to be unsuitable for a particular application, such as excessive or insufficient brightness of the facial image or background, the orientation of the facial image, the size of the facial image being outside the acceptable range, or noise in the image. Image noise indicates that the photo contains non-facial images. This is indicated when non-facial images are present in the background or foreground, or when strong reflected light is present. Furthermore, depending on the application, standards may be established for hairstyle, facial expression, clothing, glasses, accessories, and so on. The trained model 201 has learned the photo standards for each application and is likely to be able to present the reason if it determines that a photo is unsuitable for that application. In other words, by receiving reason information from the generation AI server 200 and displaying it on the reason notification screen 90, the MFP 1 can easily understand why the original photo does not meet the standard, even if the user does not know the exact standard, increasing the likelihood that the user will be able to prepare an appropriate photo that addresses the reason.

[0074] Then, the CPU 11 waits until it receives an operation on the Save Image button 93 or the End button 94 on the reason notification screen 90 (S216). If it determines that an instruction to save the reason image 91 has been received by operating the Save Image button 93 (S216: YES), the CPU 11 receives a designation of a save destination for saving the reason image 91 (S217). Selectable save destinations include, for example, the memory 12 of the MFP 1, a USB memory attached to the MFP 1, and a memory in an external device connected to the MFP 1.

[0075] When the designation of the save destination is accepted, the CPU 11 saves the reason image 91 in the designated save destination (S218). The CPU 11 may save the reason text 92 together with the reason image 91. After S218, or when it is determined that an operation on the end button 82 on the notification screen 80 has been accepted (S205: NO), or when it is determined that an operation on the end button 94 on the reason notification screen 90 has been accepted (S216: NO), the CPU 11 ends the NG determination process and returns to the AI ​​scan procedure of FIG. 2. A user who does not need the reason displayed operates the end button 82 on the notification screen 80. Furthermore, a user who does not need to save the reason image 91 operates the end button 94 on the reason notification screen 90.

[0076] Returning to the description of the AI ​​scan procedure in Fig. 2, after the OK determination process in A21 or the NG determination process in A22 is completed, the MFP 1 displays a standby screen (A31) and becomes ready to accept user operations.

[0077] As described above in detail, when the MFP1 of the first embodiment accepts an operation on the AI ​​scan icon 52, it accepts the specification of the intended use, scans the document to generate scan data, and transmits the generated scan data and usage data indicating the intended use to the generation AI server 200 that uses the trained model 201. The trained model 201 has learned the image standards for each intended use. Then, when the MFP1 receives determination information output from the trained model 201, it notifies the user IF 13 of the determination result of the trained model 201 indicated in the determination information. This allows the user to confirm whether the prepared document is suitable for the specified intended use.

[0078] Next, a second embodiment will be described in detail with reference to the accompanying drawings. This embodiment differs from the first embodiment in that the AI ​​scan procedure is executed by the MFP 1 in that a terminal device 101 equipped with a program for the AI ​​scan procedure is used. The same components and procedures as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and their description will be omitted.

[0079] 9, the terminal device 101 of this embodiment includes a controller 110 including a CPU 111 and a memory 112. The terminal device 101 is an example of an information processing device. The CPU 111 is an example of a computer. The terminal device 101 includes a user IF 113 and a communication IF 114, which are electrically connected to the controller 110.

[0080] The CPU 111 of the terminal device 101 executes various processes in accordance with programs read from the memory 112 and based on user operations. The memory 112 of the terminal device 101 stores various programs including an OS 121 and an AI scan program 122, as well as various data including application type information 123 and AI scan parameters 124. The AI ​​scan parameters 124 are information on parameters suitable for executing an AI scan, similar to the AI ​​scan parameters 24 of the first embodiment.

[0081] The user IF 113 includes hardware for displaying a screen to notify the user of information and hardware for accepting user operations. The communication IF 114 includes hardware for communicating with external devices. The terminal device 101 can be connected to the scanner 2 via the communication IF 114. The terminal device 101 can also be connected to the Internet 100 via the communication IF 114, and can access the generation AI server 200 via the Internet 100. The scanner 2 may or may not be able to access the Internet 100 or the generation AI server 200.

[0082] Next, an AI scan procedure performed by the terminal device 101 according to the second embodiment will be described with reference to the sequence diagram of Fig. 10. In the second embodiment, a user can instruct the start of the AI ​​scan procedure by operating the terminal device 101 (B01). The terminal device 101 starts the AI ​​scan procedure when, for example, an instruction to execute the AI ​​scan program 122 is received.

[0083] The terminal device 101 displays a use selection screen via the user IF 113 (B02) and accepts the use selection as in the first embodiment (B03). B03 is an example of use acceptance processing. The use selection screen displayed on the user IF 113 may be the same as the use selection screen 60 (see FIG. 3(B)) of the first embodiment, or may be different. The terminal device 101 acquires use data indicating the use based on the user's selection.

[0084] After selecting the purpose, the user inputs an instruction to execute an AI scan (B11) on the terminal device 101. The instruction to execute an AI scan received in B11 is an example of a predetermined scan instruction.

[0085] The terminal device 101 transmits the AI ​​scan parameters 124 stored in the memory 112 and a command indicating an instruction to execute a scan to the scanner 2 (B12). The scanner 2 executes a scan using the received AI scan parameters 124 (B13) and generates scan data. The scanner 2 then transmits the generated scan data to the terminal device 101 (B14). As a result, the terminal device 101 acquires the scan data. B14 is an example of a scan data acquisition process.

[0086] Then, the terminal device 101 transmits the scan data acquired from the scanner 2 and the usage data acquired in B03 to the generation AI server 200 (B21), and instructs the server to respond as to whether the image included in the scan data is suitable for the usage indicated in the usage data. The instruction in B21 is the same as the instruction in A13 in the first embodiment. B21 is an example of a transmission process.

[0087] The terminal device 101 may be able to accept an instruction to execute B11 before the selection of the purpose. In this case, the terminal device 101 may accept the selection of the purpose by the time the transmission of B21 starts, for example.

[0088] As in the first embodiment, the generation AI server 200 determines whether the image shown in the input scan data is suitable for the input purpose using the trained model 201 (B22), and generates response data including the determination information output by the trained model 201. Then, the generation AI server 200 outputs the generated response data to the terminal device 101 (B23). As a result, after executing transmission of B21, the terminal device 101 can receive determination information indicating the suitability of the image shown in the scan data from the generation AI server 200 via the communication IF 14.

[0089] When the terminal device 101 determines that the image is suitable for the intended use based on the determination information received from the generation AI server 200 (alt: [OK determination]), it executes the OK determination process (B31). The OK determination process is the same as the OK determination process of the first embodiment (see FIG. 5), and in this embodiment, it is executed by the CPU 111 of the terminal device 101 based on the AI ​​scan program 122.

[0090] If the judgment result received from the generation AI server 200 is an OK judgment, the CPU 111 of the terminal device 101 notifies the user IF 113 of the OK judgment in S101 of the OK judgment processing. S101 of the OK judgment processing executed by the CPU 111 of the terminal device 101 is an example of an application notification processing. The CPU 111 may be capable of accepting an instruction to save image data.

[0091] On the other hand, if the terminal device 101 determines that the image is not suitable for the intended use based on the determination information received from the generation AI server 200 (alt:[NG determination]), it executes NG determination processing (B32). The NG determination processing is the same processing as the NG determination processing of the first embodiment (see FIG. 7), and in this embodiment, it is executed by the CPU 111 of the terminal device 101 based on the AI ​​scan program 122.

[0092] If the judgment result received from the generation AI server 200 is a NG judgment, the CPU 111 of the terminal device 101 notifies the user IF 113 of the NG judgment in S201 of the NG judgment processing. S201 of the NG judgment processing executed by the CPU 111 of the terminal device 101 is an example of an application notification processing. The CPU 111 may be capable of receiving an instruction to notify reason information.

[0093] After B31 or B32, the terminal device 101 ends the AI ​​scan procedure. The terminal device 101 may be able to accept a determination instruction for another photograph.

[0094] As described above in detail, the terminal device 101 of the second embodiment transmits scan data generated by the scanner 2, together with usage data indicating the usage of the document, to the generation AI server 200 that uses the trained model 201. When receiving determination information output from the trained model 201, the terminal device 101 notifies the user of the determination result of the trained model 201 indicated in the determination information via the user IF 113. This allows the user to confirm whether the prepared document is suitable for the specified usage, as in the first embodiment.

[0095] It should be noted that the embodiments are merely examples and do not limit the present invention in any way. Therefore, the technology disclosed in this specification can naturally be improved and modified in various ways without departing from the spirit and scope of the present invention. For example, the scanner is not limited to the MFP 1, and may be a copy machine or a fax machine as long as it has an image reading function and a communication function.

[0096] Furthermore, the display format in each embodiment is not limited to the illustrated example. For example, the type, number, shape, etc. of each icon displayed on the standby screen 50 shown in FIG. 3(A) are not limited to the illustrated example. Furthermore, the instruction to start the AI ​​scan procedure is not limited to being received by the AI ​​scan icon 52 included in the standby screen 50, but may be received, for example, by a menu displayed after receiving an operation on the scan icon 51. In this case, the operation on the menu is an example of a predetermined scan instruction. Furthermore, the application selection screen 60 may be a screen that can at least receive a user's selection of an application, and the execute button 61 may be included on another screen.

[0097] Furthermore, notification of the determination result is not limited to notification using the various notification screens 70, 80, and 90 shown in the figures, but may also be notification by, for example, audio output, sending an email to a specified address, saving a file to a specified storage location, or printing. Furthermore, the display format of each notification screen is not limited to the examples shown in the figures. For example, the notification screen 70 may not include the save button 71. Furthermore, for example, the reason notification screen 90 may not include the save image button 93. In other words, the MFP 1 does not need to accept an instruction to save image data based on the scan data or an image showing the reason for NG.

[0098] Furthermore, the reason information received from the generation AI server 200 is not limited to the reason image 91 shown as an image or the reason text 92 shown as text, but may also be, for example, code information corresponding to various reasons. The reason information may be any information that can determine the content of the notification to be displayed on the reason notification screen 90 by the AI ​​scan program 22 of the MFP 1 or the AI ​​scan program 122 of the terminal device 101.

[0099] Furthermore, the MFP 1 and the terminal device 101 may be able to accept an instruction to change the AI ​​scan parameters 24 through an operation separate from an instruction to start the AI ​​scan procedure.

[0100] Furthermore, in the process when the determination is OK, the MFP 1 accepts a selection as to whether or not to output the image data (S105 in FIG. 5), but it is not necessary to accept such a selection. For example, if the determination is OK, the MFP 1 may simply notify the determination result and end the process, or may automatically save the image without accepting a selection.

[0101] Furthermore, in the processing when a NG judgment is made, the MFP 1 is supposed to accept a selection of whether or not to display the reason (S205 in FIG. 7), but it does not have to accept this selection. For example, if the judgment is NG, the MFP 1 may automatically display the reason, or may simply notify the judgment result and end the processing. Furthermore, if the MFP 1 receives reason information along with the judgment result, it may also notify the reason information. Furthermore, in the processing when a NG judgment is made, the MFP 1 is supposed to accept a selection of whether or not to save the image (S205 in FIG. 7), but it does not have to accept this selection.

[0102] Furthermore, the generation AI server 200 is not limited to one that has the trained model 201, but may be able to use a trained model 201 owned by another server. In this case, the generation AI server 200 passes the received scan data, usage data, etc. to the other server that has the trained model 201, and transmits response data to the MFP1 based on the response from the trained model 201. In other words, the generation AI server 200 is not limited to a server provided by an AI provider such as OpenAI, but may be, for example, a dedicated server provided by the manufacturer of the MFP1.

[0103] In addition, in each embodiment, a configuration has been illustrated in which the trained model 201 of the generation AI server 200 is used, but instead of the trained model 201, a configuration may also be used in which a program created based on the coding of a programmer is used.

[0104] Furthermore, in any flowchart or sequence diagram disclosed in each embodiment, the execution order of multiple processes in any multiple steps can be changed or executed in parallel as desired, as long as no contradictions occur in the processing content.

[0105] The processes disclosed in the embodiments may be executed by a single CPU, multiple CPUs, hardware such as an ASIC, or a combination thereof. The processes disclosed in the embodiments may be realized in various ways, such as a recording medium on which a program for executing the processes is recorded, or a method. [Explanation of symbols]

[0106] 1 MFP 2. Scanner 12 Memory 13 User Interface 14 Communication Interface 16 reading engines 101 Terminal equipment 111 CPU 200 Generation AI Server 201 trained models

Claims

1. A reading engine and A user interface; a communication interface; A scanner comprising: The scanner A server that uses a trained model can be accessed via the communication interface, and the trained model has been trained to output judgment information including the suitability of an image for a purpose based on input data; The scanner further comprises: When a predetermined scan instruction is given via the user interface, a scanning process of scanning an original document using the reading engine and generating scan data representing an image of the original document based on the scan result; a designation process for accepting designation of a use of the image of the document via the user interface; a transmission process of transmitting the scan data generated in the scan process and usage data indicating the usage accepted in the designation process to the server via the communication interface; Run The scanner further comprises: When the determination information output by the trained model is received from the server via the communication interface, the determination information including whether the image shown in the scan data is suitable for the purpose indicated in the purpose data, and executing a notification process for notifying, via the user interface, whether or not the image of the document read in the scanning process is suitable for the purpose specified in the specification process, based on the determination information. A scanner configured to:

2. 2. A scanner according to claim 1, The uses that can be specified in the above-mentioned specification process include use as a photograph for a visa application for a specific country. A scanner configured to:

3. 2. A scanner according to claim 1, The uses that can be specified in the specification process include a use as a photograph for a passport application. A scanner configured to:

4. 2. A scanner according to claim 1, The scanner a standby screen including an operator corresponding to scanning can be displayed on the user interface, and after an operation on the operator is performed, a setting operation of parameters related to generation of scan data can be accepted; The predetermined scan instruction can be received via the user interface without receiving the setting operation, When the predetermined scan instruction is received without receiving the setting operation, the scanning process, the designation process, and the transmission process are executed, and in the scanning process, a document is scanned using predetermined parameters; The scanner further comprises: When the determination information is received from the server via the communication interface, the notification process is executed. A scanner configured to:

5. 2. A scanner according to claim 1, The scanner When the determination information indicating that the image shown in the scan data is suitable for the purpose indicated in the purpose data is received, executing an output process that outputs image data based on the scan data generated in the scan process, the image data having an image format suited to the intended use accepted in the designation process; A scanner configured to:

6. 6. A scanner according to claim 5, The scanner The image data in an image format suitable for the purpose accepted in the designation process, output by the trained model, can be received from the server via the communication interface, and the trained model has been trained to output image data in an image format suitable for the input purpose based on the input scan data; In the output process, outputting the image data received from the server via the communication interface in an image format suited to the intended use accepted in the designation process; A scanner configured to:

7. 7. A scanner according to claim 6, The scanner receiving the image data from the server via the communication interface together with the determination information indicating that the image shown in the scan data is suitable for the purpose indicated in the purpose data; In the output process, outputting the image data in an image format suited to the intended use accepted in the designation process, which is received together with the determination information from the server via the communication interface; A scanner configured to:

8. 7. A scanner according to claim 6, The scanner When the determination information indicating that the image shown in the scan data is suitable for the purpose indicated in the purpose data is received, and the image data in an image format suitable for the purpose accepted in the designation process is not received, executes an output selection process for accepting a selection of whether or not to output image data via the user interface; When the selection to output image data is accepted in the output selection process, an image acquisition request for acquiring the image data is transmitted to the server via the communication interface, and when the image data in an image format suitable for the purpose accepted in the designation process, which has been output by the trained model in response to the image acquisition request, is received from the server, the output process is executed; When the selection not to output the image data is accepted in the output selection process, the output process is not executed. A scanner configured to:

9. 7. A scanner according to claim 6, The scanner It is possible to receive, from the server via the communication interface, the image data output by the trained model, which is in an image format suitable for the use accepted in the designation process and in which a portion of the image shown in the scan data has been cropped to suit the use accepted in the designation process, and the trained model has been trained to be able to output, based on input scan data, image data which is in an image format suitable for the input use and in which a portion of the image shown in the input scan data has been cropped to suit the input use; In the output process, outputting the image data received from the server via the communication interface in an image format suited to the intended use accepted in the designation process, and in which a portion of the image shown in the scan data has been cropped to suit the intended use accepted in the designation process; A scanner configured to:

10. 10. A scanner according to claim 9, In the transmission process, transmitting the untrimmed scan data generated in the scan processing and the usage data indicating the usage accepted in the designation processing to the server via the communication interface; In the output process, outputting the image data received from the server via the communication interface in an image format suited to the intended use accepted in the designation process, and in which a portion of the image shown in the scan data has been cropped to suit the intended use accepted in the designation process; A scanner configured to:

11. 6. A scanner according to claim 5, The scanner When the determination information indicating that the image shown in the scan data is suitable for the purpose indicated in the purpose data is received, executes an output selection process for accepting a selection of whether or not to output image data via the user interface; When the selection of outputting image data is accepted in the output selection process, the output process is executed; When the selection not to output the image data is accepted in the output selection process, the output process is not executed. A scanner configured to:

12. 2. A scanner according to claim 1, The scanner It is possible to receive reason information indicating the reason why the image is not suitable for the intended use from the server via the communication interface, and the trained model has been trained to output the reason information indicating the reason why the image is not suitable for the intended use when outputting the determination information indicating that the image is not suitable for the intended use; The scanner further comprises: When the determination information indicating that the image shown in the scan data is not suitable for the purpose indicated in the purpose data is received, executing a display process for displaying, via the user interface, a reason why the image is not suitable for the intended use, based on the reason information; A scanner configured to:

13. 13. A scanner according to claim 12, The reason information is text data indicating in text the reason why the image is not suitable for the intended use, and the trained model has been trained so that, when outputting the determination information indicating that the image is not suitable for the intended use, the trained model can output the reason information indicating in text the reason why the image is not suitable for the intended use, In the display process, displaying text based on the reason information via the user interface; A scanner configured to:

14. 13. A scanner according to claim 12, The reason information is image data that indicates, in an image, the reason why the image is not suitable for the intended use, and the trained model has been trained so that, when outputting the determination information indicating that the image is not suitable for the intended use, the trained model can output the reason information that indicates, in an image, the reason why the image is not suitable for the intended use, In the display process, displaying an image based on the reason information via the user interface; A scanner configured to:

15. 15. A scanner according to claim 14, The scanner receiving, via the communication interface, from the server, the reason information together with the determination information indicating that the image shown in the scan data is not suitable for the purpose indicated in the purpose data; In the display process, displaying, via the user interface, an image based on the reason information received together with the determination information from the server via the communication interface; A scanner configured to:

16. 15. A scanner according to claim 14, The scanner When the determination information indicating that the image shown in the scan data is not suitable for the purpose indicated in the purpose data is received, and the reason information is not received, executing a display selection process for accepting, via the user interface, a selection as to whether or not to display a reason why the image is not suitable for a particular purpose; When the selection of displaying a reason why the image is not suitable for the purpose is accepted in the display selection process, a reason acquisition request for acquiring the reason information is transmitted to the server via the communication interface, and when the reason information output by the trained model in response to the reason acquisition request is received from the server, the display process is executed; When the selection not to display the reason why the image is not suitable for the purpose is accepted in the display selection process, the display process is not executed. A scanner configured to:

17. 13. A scanner according to claim 12, The uses that can be designated in the designation process include a use as a photograph to be used in an application to a specified institution, The reason information corresponding to the purpose of the photograph being used for an application to a predetermined institution includes insufficient brightness of the facial image, In the display process, If the reason information received from the server includes insufficient brightness of the facial image, display information indicating insufficient brightness of the facial image via the user interface. A scanner configured to:

18. 13. A scanner according to claim 12, The uses that can be designated in the designation process include a use as a photograph to be used in an application to a specified institution, the reason information corresponding to the purpose of the photograph being used for an application to a predetermined institution includes a direction of the face image; In the display process, If the reason information received from the server includes the orientation of the face image, displaying information indicating that the orientation of the face image is inappropriate via the user interface. A scanner configured to:

19. 13. A scanner according to claim 12, The uses that can be designated in the designation process include a use as a photograph to be used in an application to a specified institution, the reason information corresponding to the purpose of the photograph being used for an application to a predetermined institution includes a size of a facial image; In the display process, If the reason information received from the server includes the size of the face image, displaying information indicating that the size of the face image is inappropriate via the user interface. A scanner configured to:

20. 13. A scanner according to claim 12, The uses that can be designated in the designation process include a use as a photograph to be used in an application to a specified institution, the reason information corresponding to the purpose of the photograph being used for an application to a predetermined institution includes noise in the face image; In the display process, If the reason information received from the server includes noise in the face image, displaying information indicating that noise is included in the face image via the user interface. A scanner configured to:

21. The computer of the information processing device When a specific scan instruction is given, a scan data acquisition process for instructing a scanner connected to the information processing device to scan an original document and acquiring, from the scanner, scan data indicating an image of the original document based on the scan result; a purpose receiving process for receiving a designation of a purpose for the image of the document; a transmission process of transmitting the scan data acquired in the scan data acquisition process and usage data indicating the usage accepted in the usage acceptance process to a server connected to the information processing device, the server using a trained model; The trained model has been trained to output judgment information including the suitability of the image for the purpose based on the input data, The computer of the information processing device further When the information processing device receives from the server the determination information output by the trained model, the determination information including whether the image shown in the scan data is suitable for the purpose indicated in the purpose data, executes an application notification process for notifying the information processing device whether the image of the document read by the scanner in the scan data acquisition process is suitable for the purpose accepted in the purpose acceptance process, based on the determination information; A program that is structured as follows.

Images