Information processing apparatus, image forming apparatus, image forming system, and control method

Abstract

For example, one of the objectives is to improve the accuracy of determining public use while preventing private use of the service. [Solution] The system comprises a communication unit that sends and receives files to and from a terminal device and an image forming apparatus, a recognition unit that recognizes recognition information from the file, and a control unit. The control unit determines, based on the recognition information, whether the processing of the file is for public or private use. If it determines that the processing is for public use, it permits the execution of the processing of the file. If it determines that the processing is for private use, it displays a first alert on the operation screen of the terminal device or the image forming apparatus, which includes a first message based on the recognition information and a display for inputting a second message. If the second message is input from the operation screen, it determines, based on the second message, whether to permit the execution of the processing of the file.

Description

【Technical Field】 【0001】 This disclosure relates to an information processing apparatus and the like. 【Background Art】 【0002】 For example, as disclosed in Patent Document 1, an image forming system is disclosed that determines whether it is for private use or public use based on character information extracted from an image to be printed in a print job. 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Patent Application Laid-Open No. 2014-171067 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 One object of this disclosure is to be able to improve the determination accuracy of public use while preventing private use of a service, for example. 【Means for Solving the Problems】 【0005】 The information processing apparatus of this disclosure includes a communication unit that transmits and receives files to and from a terminal device and an image forming device, a recognition unit that recognizes recognition information from the file, and a control unit. The control unit determines whether the processing of the file is for public use or private use based on the recognition information. If it is determined to be for public use, execution of the processing of the file is permitted. If it is determined to be for private use, a first alert including a first message based on the recognition information and a display for inputting a second message is displayed on an operation screen of the terminal device or the image forming device. When the second message is input from the operation screen, it is determined whether to permit execution of the processing of the file based on the second message. 【0006】 The image forming apparatus disclosed herein comprises a display unit, a control unit, a communication unit for sending and receiving files with an information processing device, and an execution unit for performing processing on the file. The control unit performs processing on the file when the information processing device determines that the file is a public file, and displays a first alert on the display unit, including a first message and a display for inputting a second message, when the information processing device determines that the file is a private file. 【0007】 The image forming system disclosed herein comprises a terminal device, an image forming apparatus, and a server device, wherein the terminal device or the image forming apparatus and the server device send and receive files, the server device recognizes recognition information from the file, determines whether the processing of the file is for public or private use based on the recognition information, executes processing on the file if it is determined to be for public use, and if it is determined to be for private use, displays a first alert on the operation screen of the terminal device or the image forming apparatus, including a first message based on the recognition information and a display for inputting a second message, and if the second message is input from the operation screen, determines whether to execute processing on the file based on the second message. 【0008】 The control method of the present disclosure includes a communication step of sending and receiving a file with a terminal device and an image forming apparatus, a recognition step of recognizing recognition information from the file, and a control step, wherein the control step determines, based on the text information, whether the processing of the file is for public use or private use, permits the processing of the file if it is determined to be for public use, and if it is determined to be for private use, displays a first alert on the operation screen of the terminal device or the image forming apparatus, which includes a first message based on the text information and a display for inputting a second message, and if a second message is input from the operation screen, determines, based on the second message, whether to permit the processing of the file. [Effects of the Invention] 【0009】 According to this disclosure, for example, it will be possible to provide information processing devices, etc., that can improve the accuracy of determining public use while preventing private use of the service. [Brief explanation of the drawing] 【0010】 [Figure 1] This is a diagram illustrating the system overview in the first embodiment. [Figure 2] This diagram illustrates the hardware configuration of the system in the first embodiment. [Figure 3] This diagram illustrates the hardware configuration of the system in the first embodiment. [Figure 4] This diagram illustrates the software configuration of the system in the first embodiment. [Figure 5] This diagram illustrates the software configuration of the system in the first embodiment. [Figure 6] This figure illustrates (a) an example of account information, (b) an example of judgment information, (c) an example of execution permission conditions, and (d) an example of conversation history in the first embodiment. [Figure 7] This diagram illustrates the file upload process flow in the first embodiment. [Figure 8] This diagram illustrates the print processing flow in the first embodiment. [Figure 9] This diagram illustrates the flow of the restriction release process in the first embodiment. [Figure 10] This diagram illustrates the flow of the language model generation process in the first embodiment. [Figure 11] This diagram illustrates the flow of the retraining process using additional files in the first embodiment. [Figure 12] This diagram illustrates the flow of the retraining process based on the judgment result in the first embodiment. [Figure 13] This figure illustrates an example of operation in the first embodiment. [Figure 14]A diagram for explaining the flow of print processing in the second embodiment. [Figure 15] A diagram for explaining an example of an operation example in the second embodiment. [Figure 16] A diagram for explaining an example of an operation example in the second embodiment. [Figure 17] A diagram for explaining an example of an operation example in the second embodiment. [Figure 18] A diagram for explaining an example of an operation example in the second embodiment. [Figure 19] A diagram for explaining the flow of scan processing in the third embodiment. [Figure 20] A diagram for explaining the flow of scan processing in the third embodiment. 【Modes for Carrying Out the Invention】 【0011】 There is a known print service that can upload a file onto a network and print the uploaded file. There is a service for corporations in the print service, and the service can be used for each account. Here, for example, when trying to print an uploaded file as a print file, there is a problem that it is impossible to determine whether the print file is a private file for individuals or a public file for work, and private files may be printed illegally. 【0012】 To solve such a problem, for example, there is a known method of analyzing the character information of an uploaded file to determine whether it is a private file or a public file. However, when determining whether a file is a public file or a private file from character information such as keywords for private files or public files, there is also a problem that public files may be misjudged as private files and the judgment accuracy is low. 【0013】 An information processing device that solves these problems will be described below with reference to the following embodiments. Note that the following embodiments are merely examples illustrating the invention described in the claims, and the technical scope of this disclosure is not limited to the embodiments described below. 【0014】 [1. First Embodiment] [1.1 About the System] [1.1.1 System Overview] Figure 1 is a diagram illustrating the overview of System 1. System 1 has a server device 10 as an information processing device and is connected to a network (NW). The server device 10 stores files containing images, text, etc., in its storage unit for each tenant or account, for example, with one or more terminal devices and one or more image forming devices connected on the network (NW). The server device 10 can send and receive stored files with, for example, terminal device 20 and image forming device 30. 【0015】 Furthermore, System 1 may include a terminal device 20. The terminal device 20 is connected to a network NW, for example. The terminal device 20 can upload (send) files containing images, text, etc., to the server device 10, for example. The terminal device 20 can also download (receive) files stored in the server device 10. 【0016】 Furthermore, System 1 includes an image forming apparatus 30. The image forming apparatus 30 is, for example, a device called a multifunction printer or an MFP (Multifunction Peripheral / Printer). For example, when the image forming apparatus 30 executes a job (print job), it can form an image on paper, which is a recording medium. The image forming apparatus 30 can execute jobs for multiple processes, such as copying, faxing, scanning, and printing. Here, "job" refers to the process that the image forming apparatus 30 executes. 【0017】 In this embodiment, the image forming apparatus 30 can, for example, connect to the server device 10 via a network (NW) and print files uploaded from the terminal device 20 via a print job. Furthermore, the image forming apparatus 30 can, for example, connect to the server device 10 via a network (NW) and upload scanned files acquired by a scan job to the server device 10. 【0018】 The terminal device 20 may be, for example, an information processing device such as a smartphone or a tablet. 【0019】 [1.1.2 Terminology] Hereafter, terms used in this specification will be used in a manner that can be understood by those skilled in the art, for example as follows: 【0020】 "Print service" refers to a service in which System 1 performs jobs such as uploading files and printing or scanning files. The print service is provided to users for each tenant and each account associated with that tenant. In the print service, for example, a user logs into System 1 using their account and uploads files stored on terminal device 20 to server device 10. Next, the user sends the files uploaded to server device 10 to image forming apparatus 30. The user then prints the files by executing a print job on image forming apparatus 30 and uses the print service. Alternatively, the user can upload scanned images obtained from image forming apparatus 30 as scanned files to server device 10. Next, the user can receive the scanned files from server device 10 to terminal device 20. 【0021】 In System 1, "user" refers to a general user (end user) among the users who utilize the print service. In this embodiment, users are, for example, employees, staff, and members belonging to a tenant. Users can use the print service for each account by logging into System 1 from a terminal device 20 or image forming apparatus 30 using, for example, an ID and password associated with each account. 【0022】 An "administrator" is a user who, for example, operates from terminal device 20 to perform tenant-specific management such as generating and updating trained language models stored in server device 10. An administrator may, for example, have administrator privileges granted as an attribute to their user account, or they may log in to system 1 using a dedicated administrator account. 【0023】 In this embodiment, "tenant" refers to the organization to which the user and administrator belong. In this embodiment, the organization may be a legal entity such as a company, an individual such as a sole proprietor, or a department or business unit of a legal entity such as the billing address for a print service. A tenant is linked to an account corresponding to each user who uses the print service. A tenant may consist of multiple groups, such as a general affairs department, a sales department, and a planning department, and each group may also consist of multiple sub-groups. 【0024】 "Public" generally refers to something that is open to the public, but in this specification, it refers to something related to business, such as the scope of a tenant's business or the scope of work performed by a user. Therefore, "public use" refers, for example, to a user using the print service in the course of their business. Public use may also include, for example, the following uses. 【0025】 Public use may include, for example, a user using the print service to print official files. Official files include, for example, files that use words or images included in the content of the tenant's business (work), files that contain information aligned with the purpose of the tenant's business, and files related to the tenant's business. Public use may also include, for example, using the print service to execute an official job. An official job may be a job that is executed within the scope of the tenant's business (for example, time and place). 【0026】 "Private" generally refers to matters relating to an individual or not being public, but in this specification, it refers to anything other than the "public" matters mentioned above, and matters outside of business. Therefore, "private use" in this embodiment refers to the use of the print service for personal purposes (private use). Private use refers to any use other than public use, but for example, the following uses may also be considered private use. 【0027】 Private use may include, for example, a user using the print service to print personal files. Personal files are, for example, files that contain few or no words or images related to the tenant's business, files that contain little or no information relevant to the tenant's purpose, or files unrelated to the tenant's business. Private use also refers to using the print service to perform personal jobs. Personal jobs may include, for example, jobs performed by the user that are outside the scope of the tenant's business. 【0028】 [1.2 Hardware Configuration] [1.2.1 Common Configuration] Figures 2 and 3 illustrate the hardware configuration of each device in this embodiment. The server device 10, the terminal device 20, and the image forming apparatus 30 each include at least a control unit, a storage unit, and a communication unit. In addition, each device has general functions as needed. 【0029】 Here, the control unit, memory unit, display unit, operation unit, and communication unit of each device will be described below. 【0030】 The control units (for example, control unit 100, control unit 200, control unit 300) are functional units for controlling the entire system. The control units realize various functions by reading and executing various programs stored in the memory unit. The control units may be implemented by one or more control devices / arithmetic units (CPU (Central Processing Unit), SoC (System on a Chip)). Alternatively, the control units may consist of one or more control circuits. 【0031】 The memory units (for example, memory unit 110, memory unit 210, memory unit 310) store various programs and data necessary for the operation of each device. The memory units are composed of, for example, storage, ROM (Read Only Memory), and RAM (Random Access Memory). 【0032】 Storage (for example, storage 112, storage 212, storage 312) is a non-volatile storage device capable of storing programs and data. For example, it may consist of storage devices such as HDDs (Hard Disk Drives) or SSDs (Solid State Drives). Alternatively, storage may be configured as an externally connectable USB (Universal Serial Bus) memory device. Furthermore, storage may be, for example, a storage area located in the cloud. 【0033】 ROM (for example, ROM114, ROM214, ROM314) is a non-volatile memory that can retain programs and data even when the power is turned off. ROM may store, for example, the firmware of each device or initial applications. 【0034】 RAM (for example, RAM116, RAM216, RAM316) is the main memory primarily used by the control unit of each device during execution. RAM is a rewritable memory that temporarily holds data including programs read from the storage or ROM of each device, as well as execution results. 【0035】 The display unit (for example, display unit 240, display unit 340) is a display device capable of displaying various information and various screens such as execution screens. The display unit may be a display device such as a liquid crystal display (LCD), an organic electroluminescence (OLED) display, or an electrophoretic display. The display unit also includes an interface to which a display device can be connected. For example, it may consist of an external display device connected via HDMI® (High-Definition Multimedia Interface), DVI (Digital Visual Interface), or DisplayPort. 【0036】 The operation unit (for example, operation unit 250, operation unit 350) is an operating device capable of receiving operation input from a user or administrator. For example, it may be a software key displayed on a touch panel integrated with the display unit, or a hardware key such as an operation button. Alternatively, the operation unit may be an operating device such as a keyboard or mouse. Furthermore, the operation unit may include an interface (for example, USB) to which an operating device can be connected. For example, each device may connect different operating devices (keyboards, mice, etc.) via the interface. 【0037】 The communication units (for example, communication unit 170, communication unit 270, communication unit 370) are communication interfaces that communicate with other devices. For example, a communication unit may be a network interface that can connect to a wireless LAN (Local Area Network), or a network interface that can connect to Ethernet (registered trademark) via a wired connection. Alternatively, a communication unit may be a communication device that can connect to a mobile communication network such as LTE (Long Term Evolution) / 4G / 5G / 6G. 【0038】 [1.2.2 Image forming apparatus] Next, with reference to Figure 3, the hardware configuration of the image forming apparatus 30 will be described. 【0039】 The image forming unit 360 forms an image, for example, on recording paper. The image forming unit 360 includes, for example, an image carrier, forms a toner image on the image carrier, and forms an image by transferring the toner image on the image carrier onto the recording paper. The image forming unit 360 may be configured as an image forming device such as a printer. Alternatively, the image forming unit 360 may form an image electronically as an image file. 【0040】 The image reading unit 365 reads the original document (image) and outputs it as image data. The image reading unit 365 may be, for example, a scanner, or a reading device utilizing a CCD (Charge Coupled Device), CIS (Contact Image Sensor), or CMOS (Complementary Metal-Oxide-Semiconductor) image sensor. 【0041】 [1.3 Software Configuration] The main software configurations for each device included in System 1 will be explained with reference to Figures 4 and 5. Figure 4 is a diagram showing the software configuration of the server device 10, and Figure 5(a) is a diagram explaining the main software configuration of the terminal device 20. Figure 5(b) is a diagram showing the software configuration of the image forming apparatus 30. Note that the software configurations shown in Figures 4 and 5 mainly describe the configurations necessary for this embodiment, and other configurations are omitted. 【0042】 [1.3.1 Server Equipment] First, let's describe the main software configuration of the server device 10. For example, the control unit 100 can implement the print service unit 1010, the UI provision unit 1012, the file recognition unit 1020, the conversation processing unit 1030, the question generation unit 1032, the conversation history acquisition unit 1040, and the model generation unit 1050 by reading and executing programs stored in the memory unit 110 (storage 112, ROM 114). 【0043】 The print service unit 1010 provides printing-related services. Printing-related services include, for example, accepting user logins, executing file upload processes, running print jobs for files, and running scan jobs for scanning documents. The print service unit 1010 controls the sending and receiving of files between the server device 10, the terminal device 20, and the image forming apparatus 30, which are necessary for the execution of the print services of system 1. The print service unit 1010 may store the received and acquired files in the storage unit 110 of the server device 10 for each account. 【0044】 Furthermore, the print service unit 1010 can, for example, restrict the upload process of acquiring files from the terminal device 20 or the execution of jobs in the image forming apparatus 30. The print service unit 1010 notifies the service execution unit 3010 to grant permission to execute a job (for example, permission to print for a print job, or permission to scan for a scan job). Permission to execute a job can take any form; for example, the server device 10 may send a notification granting permission or a notification lifting the restriction, or if permission to print is granted, it may send a print file, or if permission to scan is granted, it may send a notification that the scan is complete. 【0045】 Furthermore, the print service unit 1010 has a UI provision unit 1012. The UI provision unit 1012 provides, for example, a UI (user interface) for the print service. The user interface is a display screen that is displayed on the display units (for example, display unit 240, display unit 340) of the terminal device 20 and the image forming apparatus 30. The UI provision unit 1012 can display on the display units display screens such as an operation screen that displays files associated with an account and allows users to send and receive files, a notification screen that notifies the user, and an input screen that accepts input from the user. The UI provision unit 1012 may also display the user interface on the display units as a web screen using a browser application, for example. 【0046】 The file recognition unit 1020 recognizes recognition information from the file acquired by the print service unit 1010. The recognition information includes, for example, text information and image information contained in the file. The file recognition unit 1020 may, for example, acquire text information by recognizing characters, numbers, symbols, etc. from an image using image recognition, or it may also acquire image information by recognizing images such as the tenant's company logo, character, product image, etc. The file recognition unit 1020 may, for example, acquire recognition information from an image using machine learning such as deep learning, k-nearest neighbors, pattern recognition, or rule-based AI, or it may acquire recognition information using an external service, etc. 【0047】 The conversation processing unit 1030 performs processing such as creating conversations and receiving conversations from the user and recognizing the content of those conversations. The conversation processing unit 1030 is an automated response system, such as a chatbot, that creates and displays system messages to the user. For example, the conversation processing unit 1030 displays system messages on the terminal device 20 or the image forming apparatus 30, and recognizes and acquires user messages entered by the user from the terminal device 20 or the image forming apparatus 30. Here, a conversation is a message used for interaction with the user, and includes, for example, system messages and user messages. The conversation may be conducted via, for example, an operation display panel, or through a dialogue tool that exchanges messages via a voice input / output device. When using a dialogue tool via a voice input / output device, for example, it may have a voice recognition unit, or it may use an external service such as a voice processing service. 【0048】 Here, a system message (the first message) is, for example, a message used by System 1 to notify or ask a question to the user. System messages may include, for example, messages notifying the user that file processing (jobs) such as upload processing, print jobs, and scan jobs have been restricted, or messages asking the user a question based on a user message. Here, a question refers to, for example, a message displayed to obtain information to determine whether the use of the print service is public, when private use of the print service is suspected. 【0049】 Here, a user message (second message) refers to a message entered by a user to the system 1 from, for example, a terminal device 20 or an image forming apparatus 30. A user message may include, for example, a message containing the reason for lifting a restriction on file processing that has been restricted due to private use, or a response to that restriction. System messages and user messages may use languages ​​other than natural language, such as characters, figures, symbols, and combinations thereof. 【0050】 The conversation processing unit 1030 further includes a question generation unit 1032. The question generation unit 1032 generates questions. For example, the question generation unit 1032 generates system messages as questions from user messages, account information, recognition information, and execution permission conditions. The question generation unit 1032 may also generate questions from the conversation history. 【0051】 The conversation history acquisition unit 1040 acquires the conversation history. For example, the conversation history acquisition unit 1040 acquires system messages and user messages from the conversation processing unit 1030 and stores them as conversation history in the conversation history storage area 1150. 【0052】 The model generation unit 1050 generates a trained language model and stores it in the trained language model memory area 1160. The language model (trained language model) in this embodiment is a trained language model used, for example, when determining whether a file uploaded by a user is a public or private file, and it is a language model that outputs a first score indicating the probability that it is a public file. 【0053】 Here, the model generation unit 1050 may use various methods such as machine learning models and deep learning models as the language model it generates. In the case of machine learning models, methods such as support vector machines, random forests, and K-nearest neighbors may be used. In the case of deep learning models, methods such as convolutional neural networks (CNNs) and recurrent neural networks (RNNs) may be used. 【0054】 Furthermore, the memory unit 110 reserves an area for the account information storage area 1110, which stores account information. Account information is information for managing user information by linking and storing user information (for example, group in a tenant, information related to work) with an account. Account information may also store information such as user ID and password, and may be created for each tenant. Here, an example of account information stored in the account information storage area 1110 will be explained with reference to Figure 6(a). The account information stores group information (for example, "First Sales Department"), username (for example, "A"), the store where the user uses the service (for example, "Store B"), and the user's work management information (for example, "Mon, Wed, Fri, 9:00-17:00"). 【0055】 Furthermore, the storage unit 110 reserves an area for the file storage area 1120. The file storage area 1120 stores files acquired by the print service unit 1010. 【0056】 Furthermore, the memory unit 110 reserves an area for the judgment information storage area 1130, which stores judgment information. Judgment information is information indicating whether the uploaded file is a "public file" or a "private file". An example of judgment information stored in the judgment information storage area 1130 is explained with reference to Figure 6(b). The judgment information stores the file ID corresponding to the file being judged (for example, "240926031"), the judgment result of whether the file is a public or private file (for example, "private"), and a first score indicating the probability that it is a public file (for example, "18"). Here, the judgment result stores "public" for public use and "private" for private use. 【0057】 Furthermore, the storage unit 110 reserves an area for the execution permission condition storage area 1140, which stores the execution permission conditions. Execution permission conditions refer to, for example, conditions for permitting the execution of a process on a file. In this embodiment, the case of a schedule will be described as an example of an execution permission condition. Here, an example of an execution permission condition stored in the execution permission condition storage area 1140 will be described with reference to Figure 6(c). 【0058】 The conditions for permission to execute the system include remembering the date of the schedule (e.g., "2024 / 10 / 10"), the time (e.g., "9:00"), the type of schedule (e.g., "meeting"), and the participants (e.g., "section chief, department head"). The conditions for permission to execute the system may also include remembering the content of the meeting. For example, the content of the meeting could be remembered as the text "Planning meeting for a new product scheduled for release in May," or as keywords such as "May," "scheduled for release," "new product," and "planning." 【0059】 In this embodiment, the execution permission conditions store schedule information such as meeting schedules and business trip schedules, but other information may also be stored. The execution permission conditions may also store information such as the history of sending and receiving files between accounts in groupware, or the history of receiving attachments in email reception history. Furthermore, the server device 10 may have an external execution permission condition storage area 1140. In addition, the server device 10 may obtain the execution permission conditions from information such as an ERP (Enterprise Resource Planning) system, groupware, or mail server. 【0060】 Furthermore, the memory unit 110 reserves an area for a conversation history storage area 1150 that stores the conversation history. The conversation history is information that includes, for example, system messages and user messages as conversations. Here, an example of a conversation history stored in the conversation history storage area 1150 will be explained with reference to Figure 6(d). The conversation history stores the file ID corresponding to the identified file (for example, "240926031"), the history of system messages (for example, "Private files..."), and the history of user messages (for example, "Preparing for tomorrow's business trip..."). 【0061】 In this embodiment, the history of system messages and the history of user messages are stored in correspondence, but they may be stored without correspondence. For example, the conversation history may store system messages and user messages as messages separated by commas in chronological order, along with codes indicating the attributes of each message. 【0062】 Furthermore, the memory unit 110 reserves an area for the trained language model memory area 1160, which stores the trained language models. The trained language model memory area 1160 stores the trained language models generated by the model generation unit 1050. 【0063】 Note that multiple language models may be stored. The trained language model memory area 1160 may store, for example, a first language model that outputs (calculates) a first score indicating the probability of a public file, a second language model that calculates a second score indicating the degree of agreement between a user message and the execution permission conditions, and so on. 【0064】 Furthermore, the trained language model memory area 1160 may also store language models such as an image recognition AI that recognizes images within a file. For example, the first language model calculates the importance of words contained in a public file using the TF-IDF (Term Frequency-Inverse Document Frequency) method and adds words with high importance to the keyword list of the public file. 【0065】 The first language model analyzes the keyword list of public files and outputs a high first score for files with a high frequency of keyword usage, indicating a high probability that they are public files. On the other hand, the first language model outputs a low first score for files with no keywords or low keyword usage, indicating a low probability that they are private files. In other words, by outputting a first score from the first language model, the control unit 100 can determine whether a file is public or private from the first score. In this embodiment, the TF-IDF method is given as an example for the first language model, but it is also possible to output the first score using other methods such as the Word2Vec method or deep learning methods. 【0066】 Furthermore, the first language model is not limited to analyzing text information contained in a file, but can also analyze image information to output a first score. For example, the first language model may further include an image recognition AI, and after analyzing text information to calculate a first score, the image recognition AI may analyze the file's image information to calculate a first score. The first language model may, for example, pre-add images such as tenant watermarks, logos, and product photos to a public image list as official images, and compare the image information with the public image list using an image recognition AI or the like. If the image information contains images similar to official images, the first language model may add these to the first score and output it. Alternatively, it is conceivable to use a rule-based AI instead of the first language model for analysis. For example, words used in official files, tenant watermarks, and logos may be prepared in advance, and the control unit 100 may calculate a first score by adding the words, phrases, watermarks, and logos contained in the file when they match words, phrases, watermarks, and logos used in official files, or when images of watermarks and logos are included. 【0067】 Furthermore, the first language model may calculate the importance of words contained in private files, add words with high importance to the keyword list of private files, and subtract any keywords already present in the keyword list of private files before outputting the result. In this embodiment, the first language model for determining whether a file is public may have multiple different first language models for each department to which the user belongs, such as the general affairs department or the sales department, which handle different types of documents, or the first score may be output by combining the above methods. 【0068】 Furthermore, in the second language model, for example, various methods can be combined, similar to the first language model, to output a second score indicating the degree of match between the user message and the execution permission conditions. The second language model, for example, learns the execution conditions, and if the user message contains a schedule that closely resembles the schedule included in the learned execution conditions, it outputs a high second score, indicating a high degree of match with the execution conditions. Note that a second language model may be provided for each user. In addition to exact and partial schedule matches, the second language model can output a second score indicating the degree of match with the execution conditions based on schedule patterns, such as regular meetings or business trips on specific days of the week or with specific individuals. 【0069】 Furthermore, the storage unit 110 reserves an area for a job execution history storage area 1170 that stores the job execution history. The job execution history refers to, for example, the execution history of copy jobs and scan jobs in which the files were determined to be public files. In addition to the execution history, the job execution history storage area 1170 may also store recognition information corresponding to the files in which print jobs or scan jobs were performed, or it may store the job execution time and job execution location (store), or it may store the job settings of the files in which the jobs were performed. The job settings are, for example, the settings for print jobs and scan jobs, such as the paper size, number of copies, and whether or not to print on both sides. 【0070】 [1.3.2 Terminal Devices] Next, we will describe the main software configuration of the terminal device 20. 【0071】 The storage unit 210 of the terminal device 20 reserves an area for the file storage area 2110 to store files. The files stored in the file storage area 2110 are the same as the files stored in the server device 10, and include, for example, files before they are uploaded to the server device 10 and files downloaded from the server device 10. 【0072】 [1.3.3 Image forming apparatus] Next, the main software configuration of the image forming apparatus 30 will be described. For example, the control unit 300 can realize the service execution unit 3010 by reading and executing a program stored in the storage unit 310 (storage 312, ROM 314). 【0073】 The service execution unit 3010 executes processes related to the print service. Here, the service execution unit 3010 requires permission from the print service unit 1010 to execute a job. For example, if the service execution unit 3010 has permission to print from the print service unit 1010, it executes the printing of the print file obtained from the print service unit 1010 of the server device 10. Also, if the service execution unit 3010 has permission to scan from the server device 10, for example, it confirms the execution of a scan job and indicates that the scan file has been stored. 【0074】 For example, when the image forming apparatus 30 executes a print job to print a file, the server device 10 has already determined whether the use of the target file by the image forming apparatus 30 is for public or private purposes, or based on the conversation history. Therefore, the server device 10 can decide whether to permit the use after receiving the service request but before downloading the file. 【0075】 Furthermore, in this case, the user would waste time waiting for the file to download. For example, while the image forming apparatus 30 is downloading the target file, the server device 10 can determine whether the use is public or private based on the conversation history and decide whether or not to allow the job to run. 【0076】 Furthermore, when a user uses scan upload, the server device 10 can determine whether the received file will be used for public or private purposes, and then decide whether or not to allow the file upload. After deciding whether or not to allow the use of scan upload, the server device 10 can output a permission notification and / or a storage notification. The server device 10 may also indicate that the file has been stored if permission to use scan upload has been granted. 【0077】 Furthermore, storage 312 reserves space for a file storage area 3110 to store files. The files stored in the file storage area 3110 are the same as the files stored in the server device 10, and include, for example, print files and scanned files. 【0078】 [1.4 Processing Flow] The following describes the processing flow in this embodiment. Figure 7 shows the file upload processing flow between the server device 10 and the terminal device 20, and Figure 8 shows the print processing (job) flow between the server device 10 and the image forming apparatus 30. Figure 9 shows the restriction removal processing flow between the server device 10 and the terminal device 20 or the image forming apparatus 30, Figure 10 shows the language model generation processing flow of the server device 10, Figure 11 shows the retraining processing flow with additional files, and Figure 12 shows the retraining processing flow based on the judgment result. 【0079】 The following processing will be explained assuming that the control units (control unit 100, control unit 200, control unit 300) of each device (server device 10, terminal device 20, image forming apparatus 30) are executed. However, each configuration described in Figure 4 or Figure 5 may also execute the processing for each step. 【0080】 [1.4.1 File Upload Process Flow] First, the control unit 200 of the terminal device 20 performs a login process for the user to the print service (S202). Next, the control unit 200 sends (uploads) the file stored in the file storage area 1120 by the user who logged in through the login process to the server device 10 (S204). Meanwhile, the control unit 100 of the server device 10 receives the file sent from the terminal device 20 (S102). Here, the control unit 100, for example, obtains recognition information from the file sent from the terminal device 20 and stores it in the storage unit 110. The control unit 100 may store the recognition information included in the sent file, or it may store it as a separate file associated with the file (recognition information file). For example, if the file is in PDF format, the control unit 100 may store it as a file with embedded text and images. 【0081】 Next, the control unit 100 inputs the file received in S102 into the first language model and outputs a first score (S104). 【0082】 Next, the control unit 100 determines whether the file received in S102 is a private file based on the first score (S106). Here, if the first score is less than the first threshold, the control unit 100 may determine that the file received in S102 is a private file. 【0083】 If the received file is a private file, the control unit 100 determines that the user is using it for private purposes and creates a system message based on the recognition information (S106; Yes → S108). As an example of creating a system message, if the text information of the recognition information contains few or no official words, the control unit 100 may create a system message that includes content such as "This is not an official file (it is a private file), so the upload process has been restricted." Also, if the image information of the recognition information uses an image different from the company logo, character, product image, etc., the control unit 100 may create a system message that includes content such as "This is a different company logo, so the upload process has been restricted." 【0084】 Next, the control unit 100 activates the chatbot and sends the system message created in S108 to the terminal device 20 (S110). 【0085】 Furthermore, the control unit 100 turns on a flag that restricts the upload process of storing the received file from the terminal device 20 in the file storage area 1120 (S112), and then executes a restriction release process (S114). Here, the restriction flag is a flag that indicates that processing (jobs) on the file is restricted. 【0086】 Meanwhile, the control unit 200 determines whether or not it has received a system message from the server device 10 (S206). If the control unit 200 has received a system message from the server device 10, it displays a display screen containing the system message created in S108 as a first alert on the display unit 240 (S206; Yes → S208). Here, the control unit 200 may, for example, display a display screen that allows the user to select whether to request the removal of the restriction, or, instead of selecting whether to request removal, it may display a display screen on the display unit 240 that accepts the reason for removal as a user message (second message). 【0087】 Next, the control unit 200 determines whether or not it has selected to remove the restriction (S210). If the control unit 200 has selected to remove the restriction, it executes the restriction removal process (S210; Yes → S114). Here, the restriction removal process is a process to remove the restriction on processing when, for example, at least a part of the processing to be performed by the server device 10, terminal device 20 and image forming apparatus 30 in system 1 is restricted. The restriction removal process will be described later. 【0088】 Next, the control unit 100 determines whether the restriction flag is ON or OFF (S116). If the restriction flag is not turned OFF by S114 and the restriction flag is ON, the control unit 100 terminates the process (S116; Yes). On the other hand, if the restriction flag is turned OFF (S116; No), or if the control unit 100 does not determine in S106 that it is a private file (S106; No), the control unit 100 sends permission to set the job settings (S118) and executes the job setting process (S120). On the other hand, if the control unit 200 receives permission to set the job settings from the server device 10, it executes the job setting process (S212; Yes → S120). 【0089】 Here, the job setting process involves, for example, displaying an operation screen (display screen) for setting the job settings on the display unit 240 of the terminal device 20 and performing the settings. The control unit 100 stores the job settings set in the file storage area 1120 (S122). 【0090】 If you do not choose to remove the restriction (S210; No), or if you do not receive permission to configure the job settings (S212; No), the process will terminate. 【0091】 [1.4.2 Printing Process Flow] First, the control unit 300 of the image forming apparatus 30 logs in to the print service (S302). Once the image forming apparatus 30 logs in, the control unit 300 sends login information to the server device 10. Then, the control unit 100 of the server device 10 receives the login information from the image forming apparatus 30 (S132). Here, login information refers to information that can identify an account, for example. Next, the control unit 100 identifies the account from the received login information, retrieves the file associated with the account from the file storage area 1120 (S134), and sends the retrieved file to the image forming apparatus 30 (S136). 【0092】 Meanwhile, the control unit 300 of the image forming apparatus 30 receives a file sent from the server device 10 and displays an operation screen (display screen) for the received file on the display unit 340 (S304). Next, the control unit 300 selects a print file from the displayed files (S306). Here, a print file refers to a file to be printed by the image forming apparatus 30. The control unit 300 may also send the print file to the server device 10 when the user selects a print file and chooses to execute printing. The control unit 300 may set or reset job settings when selecting a print file. 【0093】 When the control unit 100 receives the print file and job settings from the image forming apparatus 30 (S138), it sends print permission to the image forming apparatus 30 (S140). Meanwhile, the control unit 300 of the image forming apparatus 30 determines whether or not print permission is available, and if it receives print permission from the server device 10, it executes the print job (S308; Yes → S310). If the control unit 300 does not receive print permission (S308; No), it terminates the process. 【0094】 [1.4.3 Flow of the restriction removal process] The restriction removal process is performed between the server device 10 and the terminal device 20 or the image forming apparatus 30. Here, as an example of this embodiment, it will be described as a process performed between the server device 10 and the terminal device 20. 【0095】 First, the control unit 200 receives a user message (S232). Here, the user message may include, for example, the reason for cancellation. The control unit 200 sends the user message, including the reason for cancellation, to the server device 10 (S234). Meanwhile, the control unit 100 determines whether or not it has received a user message. If it has received a user message, it stores the user message in the conversation history storage area 1150 and outputs a second score by inputting the user message into the second language model (S162; Yes → S164). 【0096】 Next, the control unit 100 determines whether or not the restriction can be lifted (S166). Here, the control unit 100 may determine that the restriction can be lifted if the second score output in S164 is equal to or greater than the second threshold. 【0097】 If the control unit 100 determines that the restriction can be lifted, it turns off the restriction flag (S166; Yes → S174). If it determines that the restriction cannot be lifted, it determines whether the specified number of times has been exceeded (S168). Here, the number of times refers to the number of times the system message has been displayed, and the specified number of times refers to the limit on the number of times the system message can be displayed. If the number of times exceeds the specified number (S168; Yes), or if no user message is received (S162; No), the control unit 100 terminates the process. 【0098】 On the other hand, if the number of times has not exceeded the specified number, the control unit 100 creates a system message based on the user message (S168; No → S170) and sends the system message to the terminal device 20 (S172). Here, the control unit 100 creates a question message in response to the user message as a system message based on the user message. For example, if the user message includes a type such as "for a meeting", the control unit 100 creates a system message such as "When is the meeting?" which inquires about the date and time of the execution permission conditions, or "Who is the meeting with?" which inquires about the participants of the execution permission conditions. 【0099】 Meanwhile, the control unit 200 determines whether or not a system message has been received. If a system message has been received, it displays a screen containing the received system message on the display unit 240 (S236; Yes → S238). At this point, the control unit 200 displays a screen on the display that allows user messages to be entered, and if a user message is entered by the user, it accepts the user message again (S240; Yes → S232). If the control unit 200 has not received a system message (S236; No), or if no user message is entered on the display screen in S238 (S240; No), it terminates the process. 【0100】 On the other hand, the control unit 200 terminates processing if it receives a notification from the server device 10 that the device is not registered (S144; Yes) or if it does not receive initial setup information from the server device 10 (S146; No). 【0101】 [1.4.4 Flow of Language Model Generation Process] While the language model generation process can, for example, be performed on terminal device 20, in this embodiment, it will be described as a process executed on server device 10 after login processing has also been performed from terminal device 20. 【0102】 First, the control unit 100 receives a file from the terminal device 20 (S402). Here, the file received from the terminal device 20 is, for example, a public file. Here, the control unit 100 may receive files from the terminal device 20 by separating the processing for receiving public files from the processing for receiving private files. 【0103】 Next, the control unit 100 retrieves keywords from the file (S404). Here, as explained in S104, one method for retrieving keywords from the file is to use morphological analysis to obtain important words as keywords from among the words. 【0104】 Next, the control unit 100 determines whether or not there is a job execution history, and if there is a job execution history, it retrieves a keyword from the job execution history in the job execution history storage area 1170, similar to S404 (S406; Yes → S408). 【0105】 Next, the control unit 100 creates a dataset from the extracted keywords, including if there is a job execution history (S406; No) (S410). Subsequently, the control unit 100 trains the language model with the dataset (S412) and creates a trained language model (S414). 【0106】 [1.4.5 Flow of the retraining process using additional files] First, the control unit 200 performs an administrator login (S522). Administrator login means logging into system 1 using an account reserved for administrators. Next, the control unit 200 sends additional files stored in the file storage area 2110, for example. Here, additional files refer to public files, etc., that have not yet been trained on the trained language model. 【0107】 Next, the control unit 100 receives the additional file (S422). Subsequently, the control unit 100 retrains the language model based on the additional file (S424). Here, the method for retraining the language model is almost the same as the flow of the language model generation process. The control unit 100 creates a dataset that includes the keywords from the additional file in addition to the dataset described in S410, and retrains the language model. 【0108】 Next, the control unit 100 notifies the terminal device 20 that the language model relearning is complete (S426). Meanwhile, the control unit 200 displays a display screen including the notification that the language model relearning is complete on the display unit 240 (S526). Here, the control unit 200 may display the option to update the language model after relearning is complete. The control unit 200 determines whether or not the option to update the language model has been selected. If the update is selected, it requests the server device 10 to update the language model (S528; Yes → S530). If the option not to update is selected, the process ends (S528; No). 【0109】 Meanwhile, the control unit 100 determines whether or not a request has been made to update the language model. If a request has been made, it updates the language model to the retrained one (S428; Yes → S430). If no request has been made, it terminates the process (S428; No). 【0110】 [1.4.6 Flow of the retraining process based on the judgment result] First, the control unit 200 performs administrator login (S542). At this point, the control unit 200 sends login information to the server device 10. Meanwhile, the control unit 100 receives the login information from the terminal device 20 (S442) and sends at least one judgment information stored in the judgment information storage area 1130 to the terminal device 20 (S444). 【0111】 The control unit 200 receives judgment information from the server device 10 (S544) and displays a display screen (confirmation / correction screen) on the display unit 240 that allows confirmation of the judgment information and correction of the judgment information (for example, public use or private use) (S546). Here, if the control unit 200 corrects the judgment of public use or private use from the confirmation / correction screen, for example, it sends the corrected information of the corrected judgment to the server device 10 (S548; Yes → S550). If the control unit 200 does not make any corrections from the confirmation / correction screen, for example, it terminates the process (S548; No). 【0112】 On the other hand, if the control unit 100 receives correction information, it performs language model retraining (S446; Yes → S448). Here, the method of language model retraining is almost the same as the flow of the language model generation process. The control unit 100 creates a new dataset by adding or deleting keywords corresponding to the correction information to the dataset described in S410, performs language model retraining, and updates the language model to the retrained model (S450). If the control unit 100 does not receive correction information, it terminates the process (S446; No). 【0113】 [1.5 Example of Operation] Figure 13 shows an example of the operation of the terminal device 20 in this embodiment. When the control unit 100 receives an upload file from the terminal device 20, it determines whether it is a public or private file. Figure 13(a) shows the operation when the terminal device 20 uploads a file to the server device 10, and as a result of determining that the uploaded file is a private file, the first alert is displayed on the operation screen shown on the display unit 240 of the terminal device 20. The display screen W200 in Figure 13(a) shows the system message M200 that says "Private files cannot be uploaded", a restriction release button B200, and an OK button B202. If the user selects the restriction release button B200, the control unit 200 displays the display screen W210 in Figure 13(b) on the display unit 240. On the other hand, if the user selects the OK button B202, the control unit 200 terminates the file upload process. 【0114】 The display screen W210 in Figure 13(b) shows a system message M210 that reads, "Private files cannot be uploaded. If you wish to remove the restriction, please write the reason for printing in the input field below," a user message input form F210 for entering a user message, a cancel button B210, and a send button B212. If the user selects the cancel button B210, the control unit 200 displays the display screen W200 in Figure 13(a), for example. On the other hand, if the user enters "To prepare for tomorrow's business trip" in the user message input form F210 and selects the send button B212, the control unit 200 displays the display screen W220 in Figure 13(c). 【0115】 Here, the control unit 200 sends the user message "To prepare for tomorrow's business trip." to the server device 10. The control unit 100 of the server device 10 feeds the user message into the second language model and outputs a second score. At this time, since the second score output from the second language model is less than the second threshold, it is determined that the restriction cannot be lifted. The control unit 100 then creates a system message asking the participant "Where is your business trip destination tomorrow?" based on the participant in the execution permission condition item that was not included in the user message, for example, and sends it to the terminal device 20. 【0116】 The display screen W220 in Figure 13(c) shows a system message M220 that reads "Where are you going on your business trip tomorrow?", a user message input form F220 for entering a user message, a cancel button B220, and a send button B222. If the user selects the cancel button B220, the control unit 200 displays the display screen W200 shown in Figure 13(a), for example. On the other hand, if the user enters "Company X in Hokkaido" in the user message input form F220 and selects the send button B222, the control unit 200 displays the display screen W230 shown in Figure 13(d). 【0117】 At this point, the control unit 200 sends "X Company in Hokkaido" as a user message to the server device 10. The control unit 100 of the server device 10 inputs the user message again into the second language model and outputs a second score. At this time, since the second score output from the second language model is equal to or greater than the second threshold, the control unit 100 determines that the restriction can be lifted. Based on the user message, the control unit 100 sends a system message to the terminal device 20, turning off the restriction flag and granting permission to set the job configuration. 【0118】 The display screen W230 in Figure 13(d) shows a system message M230 that reads, "Permission granted. Setting job settings." and an OK button B230. When the user selects the OK button B230, the control unit 200 displays, for example, the job settings screen on the display unit 240. 【0119】 In this way, for example, in a network printing service for businesses, an AI is created that can determine whether a file is private or public. The control unit 100 uses the created AI to analyze whether the acquired print file contains public and private words, and calculates the probability of whether it is a public or private file. If the print file is determined to be a private file, a first alert is displayed on the terminal device's operation screen to restrict the upload of the print file. Then, by responding using a chatbot or similar conversation based on the print file, it becomes possible to realize an information processing device that can accurately determine whether it is for public or private use. Therefore, it becomes possible to efficiently prevent private use of the print service, which has the effect of making it easier to manage tenant print costs, for example. 【0120】 Based on the results of image analysis determining whether a file is public or private, the automated response system can confirm any shortcomings for public use or any questionable aspects for private use, supplementing the information used for the determination. The automated response system (e.g., a chatbot) can automatically determine the reason for lifting restrictions, and if the reason is unsatisfactory (e.g., failure to meet execution permission conditions), it can ask additional questions. Furthermore, the automated response system can pre-configure execution permission conditions, etc. 【0121】 The default AI model (a retrained language model) of an AI capable of distinguishing between private and public files may collect files that have been printed (or scanned) to date and create a dataset for the AI ​​model representing public files. Furthermore, all judgment results and reasons for declassification can be stored, for example, by the server device 10, allowing the administrator to reconfirm the judgment results and reasons for declassification at any time and readjust the AI ​​model. 【0122】 In this embodiment, a first threshold determines whether a file is public or private, and a second threshold determines whether the execution permission conditions are met or not. Here, the first and second thresholds do not necessarily have to be one each; for example, multiple thresholds may be set for both the first and second thresholds. For example, if the higher of the first thresholds is not met, a system message asking a question may be displayed, and if the lower of the first thresholds is not met, only a system message indicating that processing has been restricted may be displayed and processing may be terminated. 【0123】 Furthermore, in this embodiment, the restriction flag is defined as a flag indicating that processing (jobs) on a file is restricted, but it may also be a flag that restricts only a part of the processing on a file. In that case, there may be multiple restriction flags. The control unit 100 may, for example, store the file under the condition of prohibiting printing if the lower of the first thresholds is not met, or impose restrictions such as prohibiting the use of a specific paper size. 【0124】 In this embodiment, the control unit 200 displays, for example, a release button for releasing the restriction in Figure 13(a), allowing the user to input a user message (second message) by selecting the release button B200. Here, for example, the control unit 200 may display Figure 13(b) from the beginning instead of Figure 13(a). 【0125】 Furthermore, in this embodiment, the first alert was displayed as a dialog box on the operation screen shown on the display unit 240. Here, for example, the control unit 200 may switch the operation screen and display it on the display unit 240 as a display screen. 【0126】 [1.6 Effects, etc.] According to this embodiment, if private use is detected, processing is restricted and a first alert is displayed on the operation screen to prevent private use of the service. When a second message is entered, a decision is made based on the second message as to whether the restriction can be lifted, thereby improving the accuracy of detecting public use. 【0127】 [2. Second Embodiment] The second embodiment will now be described. The second embodiment is one in which a question can be displayed to the user as a system message if there is an abnormality in the execution status of a job performed by the print service of the image forming apparatus 30. Here, the job execution status refers to information such as the time the job was executed (usage time) and the location where the job was executed (usage location). Furthermore, an abnormality in the job execution status refers to, for example, a private job if the usage time or usage location is a private job. 【0128】 The second embodiment will omit explanations of parts where the hardware and software configuration is the same as that of the first embodiment, and will focus on explaining the differences from the first embodiment. 【0129】 [2.1 Software Configuration] The trained language model memory area 1160 further stores a third language model, for example, which calculates a third score indicating the probability of a public job. The third language model outputs a third score representing the probability that a job is performed publicly, compared to the trained user's working hours and workplace. For example, the third language model outputs a high third score if the job is performed during or near working hours, or at or near the workplace, indicating a high probability of it being a public job. On the other hand, the third language model outputs a low third score if the job is performed at or near working hours, indicating a low probability of it being a public job, for example, if the job is performed at or near the workplace, indicating a low probability of it being a public job. 【0130】 The third language model can be any language model that can detect outliers or abnormal values, for example. For example, the third language model may be a regression model such as k-nearest neighbors or support vector machines, a time series analysis model such as ARIMA (Auto Regressive Integrated Moving Average) model, or a statistical model such as the Z-score method. The third language model may be assigned to each user, for example. Furthermore, the third language model may learn from job execution history, for example, so that it can improve the accuracy of determining whether a job is public or private, even if there are trending or seasonal fluctuations, such as a high frequency of certain job executions at certain times. 【0131】 [2.2 Processing Flow] The following describes the processing flow in this embodiment. Figure 14 is a diagram showing the print processing flow between the server device 10 and the image forming apparatus 30. Figure 14 replaces Figure 8 of the first embodiment, and between S138 and S120, S602 to S610 are executed, between S120 and S140, S612 is executed, and between S306 and S120, S702 to S706 are executed. 【0132】 First, the control unit 100 of the server device 10 outputs a third score by inputting the job execution status into the third language model (S602). 【0133】 The control unit 100 determines, for example, whether the job execution status when a print file is selected in S306 is a private job based on the third score (S604). Here, if the third score is less than the third threshold, it may be determined to be a private job. If the running job is a private job, the control unit 100 determines that the user is using it privately and creates a system message based on the usage time or location and the user information (S604; Yes → S606). 【0134】 Next, the control unit 100 activates the chatbot and sends the system message created in S606 to the image forming apparatus 30 (S608). Furthermore, the control unit 100 turns on a flag that restricts the process currently running (in this case, the print job) (S610) and executes a restriction release process (S114). 【0135】 Meanwhile, the control unit 300 of the image forming apparatus 30 determines whether or not it has received a system message from the server device 10 (S702). If the control unit 300 has received a system message from the server device 10, it displays a display screen containing the system message created in S606 as a second alert on the display unit 340 (S702; Yes → S704). Here, the control unit 300 may, for example, display a display screen that allows the user to select whether or not to request the release of the restriction, or it may display a display screen on the display unit 340 that accepts the reason for the release instead of allowing the user to select whether or not to release the restriction. Next, the control unit 300 determines whether or not it has selected to release the restriction (S706). If the control unit 300 has selected to release the restriction, it executes the restriction release process (S706; Yes → S114). 【0136】 Next, the control unit 100 determines whether the restriction flag is ON or OFF (S612). If the restriction flag is not released (OFF) by S114 and the restriction flag is ON, the control unit 100 terminates the process (S612; Yes). On the other hand, if the restriction flag is released (OFF) (S612; No), or if the control unit 100 does not determine in S106 that it is a private file (S604; No), the control unit 100 sends permission to print to the image forming apparatus 30 (S140). If the control unit 300 does not choose to release the restriction, it terminates the process (S308; No). 【0137】 [2.3 Example of Operation] Figures 15, 16, 17, and 18 illustrate an example of the operation of the image forming apparatus 30 in this embodiment. Figure 15(a) shows the operation of the image forming apparatus 30 when a print file is selected, and the display screen is shown on the display unit 340 of the image forming apparatus 30. 【0138】 In Figure 15(a), the display screen W300 shows "Test.pdf" as the print file selected in the print file display form F300, and also displays the "Next" button B300. When the user selects the "Next" button B300, the control unit 100 of the server device 10 determines whether the job is public or private based on the job execution status. If the control unit 100 determines that it is a private job, the control unit 300 of the image forming apparatus 30 displays the display screen W310 in Figure 15(b) on the display unit 340 as a second alert. 【0139】 On the display screen W310 in Figure 15(b), for example, a second alert window W312 is displayed as a dialog box. Window W312 displays the system message M310, "Printing is not possible outside of business hours," along with a restriction release button B310 and an OK button B312. If the user selects the restriction release button B310, the control unit 300 displays the display screen W320 shown in Figure 16(a) on the display unit 340. On the other hand, if the user selects the OK button B312, the control unit 300 terminates the print job for the print file. 【0140】 On the display screen W320 in Figure 16(a), for example, a window display W322 is displayed. The window display W322 displays a system message M320 that says "Printing is not possible outside of business hours. If you want to remove the restriction, please write the reason for printing in the input field below," a user message input form F320 for entering a user message, a cancel button B320, and a send button B322 is identified and displayed. If the user selects the cancel button B320, the control unit 300 displays the display screen W310 in Figure 15(b). If the user then enters information in the user message input form F320, the control unit 300 removes the identification display of the send button B322, and the user can select the send button B322. 【0141】 Figure 16(b) shows the operation of displaying the screen in the state where a user message has been entered into the user message input form F320 in Figure 16(a) on the display unit 340 of the image forming apparatus 30. In Figure 16(b), a window display W322 is displayed on the display screen W320, for example, as a dialog box. In the window display W322, the user message "To print materials for tomorrow's planning meeting" has been entered into the user message input form F320 for entering the user message, and a send button B324 with its identification display removed is displayed. When the user selects the send button B324, the control unit 300 displays the display screen W330 in Figure 17(a). 【0142】 On the display screen W330 in Figure 17(a), for example, a window display W332 is displayed. The window display W332 displays a system message M330 that says "When is the planning meeting?", an input interface area R330 where the meeting time can be selected, a cancel button B330, and a send button B332. If the user selects the cancel button B330, the control unit 300 displays the display screen W310 in Figure 15(b). If the user selects "9:00-10:00" as the meeting time in the input interface area R330 and selects the send button B332, the control unit 300 displays the display screen W340 in Figure 17(b). 【0143】 On the display screen W340 in Figure 17(b), for example, a window display W342 is displayed. The window display W342 displays a system message M340 that says "Who is scheduled to attend the planning meeting?", an input interface area R340 where participants can be selected, a cancel button B340, and a send button B342. If the user selects the cancel button B340, the control unit 300 displays the display screen W310 in Figure 15(b). If the user selects "You," "Section Chief," or "Department Head" as participants in the planning meeting in the input interface area R340 and selects the send button B342, the control unit 300 displays the display screen W350 in Figure 18. 【0144】 On the display screen W350 in Figure 18, for example, a window display W352 is shown. Window display W352 shows a system message M350 that reads "Printing has been permitted. Printing will begin," and an OK button B350. If the user selects OK B350, for example, the control unit 300 executes a print job for the print file. 【0145】 Thus, if an attempt is made to execute a job under abnormal job execution conditions, the control unit 100 can display a second alert to warn of private use. Similar to the first alert, a question is displayed to the user as a system message, and the user can respond to the question with a user message, thereby preventing private use of the service while improving the accuracy of determining public use. 【0146】 For example, the first stage of questioning is based on the result of the abnormality detection. The control unit 100 can display questions or notifications to the user as system messages, such as, "It has been determined that there is an abnormality in the usage time. Why are you using it during this time period?" 【0147】 Next, the second stage questions are created based on the first answer to the first stage questions. For example, the control unit 100 displays a system message to the user asking, "What are the topics for tomorrow's meeting?" in response to the first answer, "To prepare for tomorrow's meeting." Subsequent questions are created in the same way as the second stage questions, and so on, in order to supplement the information. If it is determined that the restriction cannot be lifted (rejected), the chatbot outputs additional questions, and the end user enters the reason, and this process is repeated. 【0148】 In this way, by using chatbot conversations based on user information, it is possible to accurately determine whether something is public or private. 【0149】 [3. Third Embodiment] The third embodiment will now be described. The third embodiment is an embodiment in which the image forming apparatus 30 can determine whether a job performed is for public or private use based on both the file and the job execution status. 【0150】 The third embodiment will omit explanations of parts where the hardware and software configuration is the same as that of the first and second embodiments, and will focus on explaining the differences from the first and second embodiments. 【0151】 [3.1 Processing Flow] The following describes the processing flow in this embodiment. Figures 19 and 20 are diagrams showing the scan processing (job) flow between the server device 10 and the image forming apparatus 30. Figures 19 and 20 replace Figure 14 of the second embodiment, with S642 executed before S602, S644 executed instead of S606, S646 to S654 executed after S612, S742 and S744 executed between S302 and S702, and S746 and S748 executed after S306 and S144. 【0152】 First, the control unit 300 of the image forming apparatus 30 activates the scanning function of the image forming apparatus 30 (S742), and sends the scanned file obtained by the scanning function to the server device 10 along with the job settings (S744). Meanwhile, the control unit 100 of the server device 10 receives the scanned file and job settings from the image forming apparatus 30 (S642). Here, the control unit 100 may, for example, recognize and acquire recognition information from the scanned file sent from the image forming apparatus 30 and temporarily store it in the storage unit 110 along with the file. 【0153】 Furthermore, the control unit 100 creates a system message based on the determination of private use (S644). If the determination of private use is, for example, a private file, the control unit 100 creates a system message based on recognition information, and if it is a private job, it creates a system message based on the usage time or location and user information. 【0154】 If the control unit 100 determines that the restriction flag is not ON, it determines whether or not the first score has been output (S646). If the first score has not been output, it outputs the first score by inputting the scan file into the first language model (S646; No → 648). Subsequently, the control unit 100 determines whether the scan file is a private file based on the first score, similar to S106 (S650). 【0155】 The control unit 100 determines that the user is using the scanned file for personal purposes if the scanned file is a personal file, and creates a system message based on this determination (S650; Yes → S644). On the other hand, if the first score has already been output (S646; Yes), or if the file is not personal (S650; No), the control unit 100 sends a scan permission to the image forming apparatus 30 (S652). The control unit 100 then stores the scanned file in the file storage area 1120 (S654). 【0156】 Meanwhile, the control unit 300 of the image forming apparatus 30 determines whether or not it has received permission to scan (S746). If it has received permission to scan, it displays a screen on the display unit 340 notifying that the scan job has been completed (S746; Yes → S748). Alternatively, if the control unit 300 has received permission to scan, it terminates the process (S746; No). 【0157】 [3.2 Example of Operation] The operation of the image forming apparatus 30 in this embodiment will now be described. When a user scans a document using the scanning function of the image forming apparatus 30, the control unit 300 displays a display screen on the display unit 340 that includes the system message "Scanning is not possible outside of business hours" as a second alert. 【0158】 Next, the user selects the restriction removal button and enters and sends the user message, "These are materials to be used in the planning meeting with the section chief tomorrow at 9:00." The control unit 100 inputs the user message into the second language model and outputs a second score. Here, since the second score is above the second threshold, the control unit 100 determines that the restriction can be removed and removes the restriction on the scan job. Subsequently, the control unit 100 determines whether the scanned file is a public or private file. Here, if the control unit 100 determines that the scanned file is a private file, the control unit 300 displays a display screen on the display unit 340 as the first alert, which includes the system message, "Files relating to products that are not handled cannot be scanned." 【0159】 The user selects the restriction removal button again, enters the user message "This is a presentation material for a product scheduled to be released in May," and sends it. The control unit 100 again inputs the user message into the second language model and outputs a second score. Here, since the second score is above the second threshold, the control unit 100 determines that the restriction can be removed and removes the restriction on the scan job. 【0160】 In this embodiment, the scan process was restricted twice based on the determination of private use. However, for example, if the control unit 100 has already lifted the restriction once, it may skip the process in S650 and send a scan permission to the image forming apparatus 30. Alternatively, if the control unit 100 determines in S650 that the file is private, it may first determine whether the restriction can be lifted by comparing the conversation history with the execution permission conditions before displaying the first alert. In this case, if the control unit 100 determines that the restriction can be lifted, it can send a scan permission without displaying the first alert and without requesting unnecessary input from the user. 【0161】 In this embodiment, before determining the contents of the scanned file, the job execution time, job execution location (store), and job settings (print file name, type, paper size, function, etc.) are compared with the job execution history. If there are any abnormalities (for example, processing is performed late at night, postcard printing has not been used before, or the duplex function is suddenly used), an alert is displayed on the MFP's panel screen. 【0162】 In this embodiment, to determine whether the print service is being used for private purposes, the system first determines whether it is a public or private job, and then determines whether it is a public or private file. Here, for example, the control unit 100 may use keywords obtained from the execution permission conditions related to the conversation history obtained in the determination of whether it is a public or private job to determine whether it is a public or private file. The control unit 100 can determine whether a file is private or not by referring not only to the meeting schedule but also to the content of the meeting, for example, so the accuracy of determining whether it is a private file is further improved. Furthermore, the user is less likely to be repeatedly determined to be using the service for private purposes, and will not experience any inconvenience. 【0163】 [4. Variant] This disclosure is not limited to the embodiments described above, and various modifications are possible. In other words, embodiments obtained by combining technical means that are appropriately modified within the scope of this disclosure are also included in the technical scope. 【0164】 Furthermore, although the embodiments described above are explained separately for the sake of explanation, they can be combined and implemented to the extent possible. In addition, we intend to obtain rights to any of the technologies described in this specification through amendments or divisional applications. 【0165】 Furthermore, in each embodiment, the program that operates in each device is a program that controls the CPU and other components (a program that makes the computer function) in order to realize the functions of the embodiments described above. The information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) during processing, and then stored in various ROMs or HDDs, and read, modified, and written by the CPU as needed. 【0166】 Here, the recording medium for storing the program may be any of the following: semiconductor media (e.g., ROM or non-volatile memory card), optical recording medium or magneto-optical recording medium (e.g., DVD (Digital Versatile Disc), CD (Compact Disc), BD (Blu-ray® Disc)), magnetic recording medium (e.g., magnetic tape, flexible disk), etc. 【0167】 Furthermore, when distributing the program to the market, it can be stored on a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server device is, of course, also included in this disclosure. 【0168】 Furthermore, the data mentioned above may not be stored within the device itself, but rather stored on an external device and retrieved as needed. For example, the data may be stored on a NAS (Network Attached Storage) or on the cloud. 【0169】 Furthermore, the scope of this disclosure is not limited to the configurations explicitly described in the specification, but also includes combinations of the technologies disclosed herein. While the configurations for which patent protection is sought are described in the attached claims, there is no intention to exclude them from the technical scope simply because they are not described in the claims. 【0170】 Furthermore, the phrases "in the case of..." and "when..." in the above-mentioned specification are explained as examples only, and do not represent a configuration limited to those described. Even for configurations other than those described, we disclose information that would be obvious to a person skilled in the art, and we intend to acquire rights to such information. 【0171】 Furthermore, the descriptions of the processes and data flows described in the specification are not limited to the order in which they are described. For example, configurations in which parts of the process are deleted or the order is rearranged are also disclosed, and the company intends to acquire rights to them. 【0172】 Furthermore, although the functions described in the embodiments are explained as being performed by each device, they may also be implemented by a single device or by utilizing an external server. 【0173】 Furthermore, each functional block or feature of the apparatus used in the embodiments described above may be implemented or executed by an electrical circuit, such as an integrated circuit or a plurality of integrated circuits. An electrical circuit designed to perform the functions described herein may include a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, discrete gates or transistor logic, discrete hardware components, or a combination thereof. The general-purpose processor may be a microprocessor, a conventional processor, controller, microcontroller, or state machine. The aforementioned electrical circuit may consist of digital circuits or analog circuits. Also, if advances in semiconductor technology lead to the emergence of integrated circuit technologies that replace current integrated circuits, one or more aspects of this disclosure may use new integrated circuits based on such technologies. [Explanation of Symbols] 【0174】 1 System 10 Server devices 20 Terminal devices 30 Image forming apparatus 100, 200, 300 Control Unit 110, 210, 310 Storage section 112, 212, 312 storage 114, 214, 314 ROM 116, 216, 316 RAM 240, 340 display section 250, 350 operation section 360 Image forming unit 365 Image Reading Unit 170, 270, 370 Communications Department

Claims

[Claim 1] A terminal device and an image forming apparatus, and a communication unit that sends and receives files, A recognition unit that recognizes recognition information from the aforementioned file, Control unit and Equipped with, The control unit, Based on the aforementioned recognition information, it is determined whether the processing of the file is for public or private use. If it is determined to be the aforementioned public use, permission will be granted to perform the processing on the file. If it is determined that the use is for private purposes, a first alert is displayed on the operation screen of the terminal device or the image forming apparatus, including a first message based on the recognition information and a display for inputting a second message. If the second message is input from the operation screen, a decision is made based on the second message whether to permit the execution of processing on the file. Information processing device. [Claim 2] The control unit determines whether the proportion of public words in the recognition information meets a predetermined threshold, and if it determines that the threshold is not met, it determines that it is for private use. The information processing apparatus according to claim 1. [Claim 3] The control unit creates a language model to determine whether a file is public or private, and uses the language model to determine whether the proportion of public words in the recognized information meets a predetermined threshold. The information processing apparatus according to claim 2. [Claim 4] When the image forming apparatus performs processing on the file, the control unit determines whether the processing on the file is for public or private use based on the time or location of processing on the file and the user's information. If it determines that the processing is for public use, it permits the execution of the processing on the file. If the processing is for private use, it displays a second alert on the operation screen of the image forming apparatus, which includes a first message based on the time or location of processing and the user's information, and a display for inputting a second message. The information processing apparatus according to claim 1. [Claim 5] Based on the second message received in the second alert, the control unit determines whether the processing of the file is for public or private use. If it determines it is for public use, it permits the execution of the processing of the file. If it determines it is for private use, it displays the first alert on the operation screen of the image forming apparatus. The information processing apparatus according to claim 4. [Claim 6] When the image forming apparatus performs processing on the file, the control unit determines whether the file is for public use or private use based on information regarding the job settings of the file. The information processing apparatus according to claim 4. [Claim 7] The system further includes a storage unit that stores conditions for determining whether to allow processing of the aforementioned file, The control unit determines, based on the conditions and the second message, whether or not to permit the execution of processing on the file. If it is determined that processing of the aforementioned file should not be permitted, the first alert, which includes the first message based on the second message, will be displayed on the operation screen. The information processing apparatus according to claim 1. [Claim 8] A display unit and a control unit, An information processing device and a communication unit that sends and receives files, An execution unit that performs processing on the aforementioned file, Equipped with, The control unit, When the information processing device determines that the file is a public file, the execution unit executes processing on the file. When the information processing device determines that the file is a private file, it displays a first alert on the display unit, which includes a first message and a display for inputting a second message. Image forming apparatus. [Claim 9] Terminal device and Image forming apparatus and Server device and Equipped with, The terminal device or image forming apparatus and the server device send and receive files. The aforementioned server device Recognition information is recognized from the aforementioned file, Based on the aforementioned recognition information, it is determined whether the processing of the file is for public or private use. If it is determined to be the aforementioned public use, permission will be granted to perform the processing on the file. If it is determined that the use is for private purposes, a first alert is displayed on the operation screen of the terminal device or the image forming apparatus, including a first message based on the recognition information and a display for inputting a second message. If a second message is entered from the aforementioned operation screen, a decision is made based on the second message whether to allow the execution of processing on the file. Image forming system. [Claim 10] A communication step for sending and receiving files between a terminal device and an image forming apparatus, A recognition step in which recognition information is recognized from the aforementioned file, Control step and Includes, The control step described above is: Based on the aforementioned recognition information, it is determined whether the processing of the file is for public or private use. If it is determined to be the aforementioned public use, permission will be granted to perform the processing on the file. If it is determined that the use is for private purposes, a first alert is displayed on the operation screen of the terminal device or the image forming apparatus, including a first message based on the recognition information and a display for inputting a second message. If the second message is input from the operation screen, a decision is made based on the second message whether to permit the execution of processing on the file. Control method.

Images