Image processing apparatus, image processing method, and program

Abstract

To allow a user who is to upload a file to a chat service to easily check the details of the file.SOLUTION: An image processing apparatus of the present invention has: scanning means that scans an image of a document to generate image data; receiving means that receives the setting of a condition for creating a summary based on the image data; and transmission means that transmits the generated image data and information indicating the set condition. A summary created on the basis of the transmitted condition is posted on a channel of the chat service.SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses that an image processing device transmits image data generated by scanning an image of an original to a chat server that provides a chat service. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-078084 Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, scanned data can be uploaded to a chat room of a chat service, but if the contents of the uploaded file cannot be determined from the file name, it is necessary to open the file and check it, which is time-consuming.

[0005] The present invention has been made in consideration of the above problems, and has an object to make it possible to easily check the contents of a file when uploading the file to a chat service. [Means for solving the problem]

[0006] The image processing device of the present invention has a scanning means for scanning an image of an original document to generate image data, a receiving means for receiving settings of conditions for generating a summary based on the image data, and a transmitting means for transmitting the generated image data and information indicating the set conditions, and is characterized in that the summary generated based on the transmitted conditions is posted on a channel of a chat service. Effect of the Invention

[0007] When uploading a file to a chat service, you can make it easy to check the contents of the file. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration of the present invention. [Diagram 2] FIG. 1 shows an example of a hardware configuration of an image processing device 101. [Diagram 3] FIG. 3 is a diagram showing an example of a hardware configuration of a mobile terminal 300. [Figure 4] FIG. 4 is a diagram showing an example of a hardware configuration of a message application server 400. [Diagram 5] FIG. 1 is a diagram showing an example of a hardware configuration of a character recognition server 500. [Figure 6] FIG. 6 is a diagram showing an example of the hardware configuration of a large-scale language model server 600. [Figure 7] FIG. 13 shows an example of a home screen displayed on the operation unit 207 of the image processing device 101. [Figure 8] FIG. 13 is a diagram showing an example of a sequence in which the image processing device 101 transmits a file and a thumbnail image generated by scanning to the message application server 400. [Figure 9] 1 is a flowchart showing an example of a process in which the image processing device 101 transmits a file generated by scanning and a thumbnail image to the message application server 400. [Figure 10] FIG. 13 is a diagram showing an example of a screen of a scan-to-chat function in the first embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a setting registration screen. [Figure 12] FIG. 1 is a diagram showing an example of a message screen of a message application according to the first embodiment; [Figure 13] FIG. 13 is a diagram showing an example of a sequence in which the image processing device 101 transmits a file generated by scanning and a character string extracted by OCR to the message application server 400. [Figure 14]A flowchart showing an example of a process in which a character string extracted by OCR from a file generated by the image processing device 101 through scanning is sent to the message application server 400. [Figure 15] A diagram showing an example of the Scan to Chat function screen [Figure 16] FIG. 13 is a diagram showing an example of a sequence in which the image processing device 101 transmits to the message application server 400 a file generated by scanning and a summary of character strings extracted by OCR. [Figure 17] 1 is a flowchart showing an example of a process for summarizing character strings extracted by OCR from a file generated by the image processing device 101 and transmitting the result to the message application server 400. [Figure 18] A diagram showing an example of the Scan to Chat function screen [Figure 19] A diagram showing an example of a message screen of a message app DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the configurations shown in the drawings. EXAMPLES

[0010] FIG. 1 is a diagram showing an example of a system configuration of the present invention. The system configuration of this embodiment is composed of an image processing device (MFP: Multi Function Peripheral) 101 that can communicate with a mobile terminal 300, which is an example of a terminal device, via a network 100, and a message application server 400. A character recognition server 500 and a large-scale language model server 600 are also connected via the network 100 and can communicate with each other. The message application server 400 receives messages and image data transmitted from the image processing device 101 and the mobile terminal 300. The message application server 400 is a chat server that manages a chat service that displays the received messages and image data on the mobile terminal 300 or a PC (not shown). The character recognition server 500 is a server that has a function of extracting characters in image data and converting the image data into character data. The large-scale language model server 600 is a server equipped with a language model that generates natural sentences using artificial intelligence in response to a request in free language. The network 100 of this embodiment may be the Internet or a LAN (Local Area Network). The network 100 may be wired or wireless. Furthermore, the message application server 400 may receive image data directly from the image processing device 101, or a cloud storage service may receive image data from the image processing device 101, and the message application server 400 may receive the image data from the cloud storage.

[0011] 2 is a diagram showing an example of a hardware configuration of the image processing device 101. The image processing device 101 includes a CPU 202, a ROM 203, a RAM 204, a storage 205, an operation unit I / F 206, an operation unit 207, a reading unit I / F 208, a reading unit 209, a printing unit I / F 210, a printing unit 211, a wireless communication unit I / F 212, and a wireless communication unit 213. The image processing device 101 also includes a FAX unit I / F 214, a FAX communication unit 215, a communication unit I / F 216, and a communication unit 217.

[0012] The control unit 201 including the CPU 202 controls the operation of the entire image processing device 101. The CPU 202 reads out a control program stored in the ROM 203 or the storage 205 to the RAM 204, and performs various controls such as reading control and printing control. The ROM 203 stores a control program executable by the CPU 202. The ROM 203 also stores a boot program and font data. The RAM 204 is a main memory, and is used as a work area and a temporary storage area for developing various control programs stored in the ROM 203 and the storage 205. The storage 205 stores image data, print data, various programs, and various setting information. In this embodiment, a flash memory is assumed as the storage 205, but an auxiliary storage device such as an SSD (Solid State Drive) or an HDD (Hard Disc Drive) may be used. An eMMC (embedded Multi Media Card) may also be used.

[0013] In the image processing device 101 of this embodiment, one CPU 202 executes each process shown in the flowcharts described later using one memory (RAM 204), but this is not limited to this. For example, each process shown in the flowcharts described later can be executed by using multiple CPUs, RAMs, ROMs, and storages in cooperation with each other. Also, some of the processes can be executed using hardware circuits such as ASICs and FPGAs.

[0014] An operation unit I / F 206 connects an operation unit 207 including a display unit such as a touch panel and hard keys to the control unit 201. The operation unit 207 displays information to a user and detects inputs from the user.

[0015] The reading unit I / F 208 connects the control unit 201 to a reading unit 209 such as a scanner. The reading unit 209 reads an image of an original document, and the CPU 202 converts the image into image data such as binary data. Image data generated based on the image read by the reading unit 209 is sent to an external device or printed on recording paper. The reading unit 209 has a transport means such as an ADF (Auto Document Feeder) (not shown), and can transport multiple original documents placed on a placement unit based on a single scan execution instruction from a user, and scan the images of the multiple original documents.

[0016] The printing unit I / F 210 connects a printing unit 211, such as a printer, to the control unit 201. The CPU 202 transfers image data (print data) stored in the RAM 204 to the printing unit 211 via the printing unit I / F 210. The printing unit 211 prints an image based on the transferred image data on recording paper fed from a paper feed cassette.

[0017] The wireless communication unit I / F 212 is an I / F for controlling the wireless communication unit 213, and connects the control unit 201 to an external wireless device (here, the mobile terminal 300) via wireless communication.

[0018] The control unit 201 is connected to the public line network 107 by controlling a FAX communication unit 215 such as a facsimile via a FAX unit I / F 214. The FAX unit I / F 214 is an I / F for controlling the FAX communication unit 215, and is capable of connecting to the public line network and controlling the facsimile communication protocol by controlling a modem and an NCU for facsimile communication.

[0019] The communication unit I / F 216 connects the control unit 201 to the network 100. The communication unit I / F 216 allows the communication unit 217 to transmit image data and various information inside the device to an external device on the network 100, and receives print data and information on the network 100 from an information processing device on the network 100. As a method of transmission and reception via the network 100, transmission and reception using e-mail and file transmission using other protocols (for example, FTP, SMB, WEBDAV, etc.) can be performed. Furthermore, image data and various setting data can be transmitted and received over the network 100 by accessing from the mobile terminal 300, the message application server 400, the character recognition server 500, and the large-scale language model server 600 via HTTP communication.

[0020] 3 is a diagram showing an example of a hardware configuration of the mobile terminal 300. Note that the mobile terminal 300 of the present embodiment is assumed to be a device such as a smartphone or a tablet PC, but may be any other device as long as it is an information processing device capable of Wi-Fi communication.

[0021] The CPU 307 reads out a control program stored in the ROM 308 and executes various processes for controlling the operation of the mobile terminal 300. The ROM 308 stores the control program. The RAM 309 is used as a temporary storage area such as a main memory and a work area for the CPU 307. The HDD 310 stores various data such as photographs and electronic documents.

[0022] The operation panel 301 has a touch panel function capable of detecting a user's touch operation, and displays various screens provided by the OS and an e-mail sending application. The operation panel 301 is also used to communicate with a message application server 400 and the like to confirm information. The user can input a desired operation instruction to the mobile terminal 300 by inputting a touch operation to the operation panel 301. The mobile terminal 300 has a hardware key (not shown), and the user can input an operation instruction to the mobile terminal 300 using this hardware key.

[0023] Camera 304 captures an image in response to an image capture instruction from a user. The photograph captured by camera 304 is stored in a predetermined area of ​​HDD 310. It is also possible to obtain information from a QR code (registered trademark) read by camera 304 using a program capable of analyzing the QR code (registered trademark).

[0024] The mobile terminal 300 can transmit and receive data to and from various peripheral devices via an NFC communication unit 305, a Bluetooth (registered trademark) communication unit 306, and a wireless LAN communication unit 311. The Bluetooth communication unit 306 of the mobile terminal 300 may be compatible with Bluetooth (registered trademark) Low Energy.

[0025] FIG. 4 is a diagram showing an example of a hardware configuration of the message application server 400. The CPU 401 reads out a control program stored in the ROM 402 and executes various processes for controlling the operation of the message application server 400. The ROM 402 stores the control program. The RAM 403 is used as a temporary storage area such as the main memory and work area of ​​the CPU 401. The HDD 405 stores various data such as messages, image data, and channel information. Data can be transmitted and received to and from various devices such as the mobile terminal 300, the image processing device 101, the character recognition server 500, and the large-scale language model server 600 via the communication unit 404. The communication unit 404 may perform wired communication using Ethernet (registered trademark) or wireless communication such as Wi-Fi.

[0026] 5 is a diagram showing an example of a hardware configuration of the character recognition server 500. The CPU 501 reads out a control program stored in the ROM 502, controls the operation of the character recognition server 500, and converts image data into character data upon receiving a request from the image processing device 101. The ROM 502 stores the control program. The RAM 503 is used as a temporary storage area such as the main memory and work area of ​​the CPU 501. The HDD 505 stores various data such as messages, image data, and channel information. Data can be transmitted and received via the communication unit 504 to and from various models such as the mobile terminal 300, the image processing device 101, and the message application server 400.

[0027] 6 is a diagram showing an example of the hardware configuration of the large-scale language model server 600. The CPU 601 reads out a control program stored in the ROM 602, controls the large-scale language model server 600, and processes requests from the image processing device 101, the mobile terminal 300, and the message application server 400. The ROM 602 stores the control program. The RAM 603 is used as a primary storage area such as the main memory and work area of ​​the CPU 601. The HDD 605 stores schedule information for each user. Data can be transmitted and received via a communication unit 604 to and from each model such as the image processing device 101, the mobile terminal 300, and the message application server 400.

[0028] 7 is a diagram showing an example of a home screen displayed on the operation unit 207 of the image processing device 101. The operation unit 207 is made up of a touch panel 701 that displays an operation screen, and LEDs 710 and 711. The touch panel 701 is an instruction means, and also functions as a receiving means that receives instructions from a user, and also functions as a display means that displays a screen. The user directly touches the screen displayed on the touch panel 701 with a finger, a stylus, or other object, and issues an instruction to execute each function based on the displayed screen.

[0029] 7 displays a home screen 708. The home screen 708 is the first screen for instructing the execution of each function of the image processing device 101, and is a screen for selecting a screen display for making various settings for each function executed by the image processing device 101, such as copy, fax, scan, and media print.

[0030] A status check button 705 is an object for displaying a screen (status check screen) for checking the status of the image processing apparatus 101. It is possible to display a transmission history and a job execution history from the status check screen (not shown).

[0031] The scan-to-chat button 702 is an object for displaying a setting screen for the scan-to-chat process. When the scan-to-chat button 702 is selected by the user, a scan-to-chat screen 1001 in Fig. 10 is displayed on the operation unit 207. The scan-to-chat process will be described in detail with reference to Figs. 8 and 9.

[0032] A scan button 703 is an object for displaying a scan selection screen (not shown) from the image processing apparatus 101. The scan selection screen is a screen for selecting a transmission function such as electronic mail transmission (E-mail), file transmission via SMB, FTP, or HTTP, and Internet fax (I-fax) transmission. Touching an object indicating a displayed transmission function displays a setting screen for each transmission function.

[0033] An address book button 704 is an object for displaying an address book screen of the image processing device 101 when selected by the user. LEDs 710 and 711 notify the user of the status of the image processing device 101. The LED 710 lights up while an e-mail or a print job is being received or executed, and the LED 711 lights up when an error occurs in the image processing device 101. The stop button 706 is an object for canceling various operations, and is an object that is constantly displayed on the operation unit 207. The HOME button 707 is an object for displaying a home screen 708, and is an object that is constantly displayed on the operation unit 207. The menu button 712 is an object for displaying a screen for setting the environment, such as the language to be used, and for setting each function.

[0034] FIG. 8 is a diagram showing an example of a sequence in which the image processing device 101 transmits a file and a thumbnail image generated by scanning to the message application server 400. In FIG.

[0035] In S801, the CPU 202 of the image processing device 101 controls the communication unit 217 to request channel information from the message app server 400 by HTTP communication. Specifically, the image processing device 101 transmits to the message app server 400 token information inputted to the image processing device 101 and information indicating a request for channel information in the workspace indicated by the token information. The image processing device 101 may accept input of account information such as a user ID and password for a chat service, obtain token information corresponding to the account information from the message app server 400, and transmit the token information. By transmitting user ID information inputted in the image processing device 101 to the message app server 400, information related to the user ID in the workspace is specified. Furthermore, in the case where only the user is allowed to read and write user information in the workspace, the authority is acquired by transmitting password information corresponding to the user ID information inputted in the image processing device 101 to the message app server 400.

[0036] Here, an example of the command to be transmitted is "HTTP GET https: / / message.com / api / conversations.list". The URL "https: / / message.com / api / conversations.list" described in this command is a URL for accessing the message app server 400. By transmitting token information to this URL, the message app server 400 searches for a workspace corresponding to the token information and a channel associated with the user. Note that the token information is input by the user via the setting registration screen 1101 of FIG. 11 displayed on the operation unit 207 of the image processing device 101.

[0037] Here, a workspace is like an organization to which multiple users belong in a messaging app, and may also be called a team. A channel is synonymous with a chat room in a workspace. A chat room here is a mechanism for multiple users participating in a chat room to send and receive messages to each other and communicate like a conversation. In this embodiment, a channel is described as a chat room, but it is not limited to this as long as it is a mechanism for multiple users to send and receive messages and communicate like a conversation. For example, it may be something like a group chat, a room, a talk room, or a group.

[0038] In S802, the CPU 401 of the message application server 400 checks whether access to the URL is permitted based on the token information and user ID received from the image processing device 101 via the communication unit 404. If permitted, the CPU 401 returns channel information included in the workspace corresponding to the token information to the image processing device 101. The image processing device 101 displays the received channel information on the operation unit 207.

[0039] In S803, the process waits for a channel confirmation operation by the user, and in S804, the channel information is confirmed by the user.

[0040] In S805, the CPU 202 of the image processing device 101 receives a scan execution instruction via the operation unit 207. In addition to the selection of the channel to post to, scan settings, transmission settings, thumbnail settings, and the like are also received from the user. In this sequence, a case where a thumbnail is selected by the Send button 1031 on the Summary / Text Extraction / Thumbnail Setting screen 1030 will be described.

[0041] In S806, the CPU 202 of the image processing apparatus 101 controls the reading unit 209 to scan the image of the document based on the scan settings set by the user.

[0042] In S807, the CPU 202 of the image processing device 101 generates an image file of the scanned image in a format set by the scan settings. The scan settings are those designated by the user on a detailed setting screen for scan-to-chat (not shown). The scan settings may be displayed and set together with the transmission settings on a transmission setting screen 1010 in FIG. 10.

[0043] In S808, the CPU 202 of the image processing apparatus 101 generates thumbnail images from the scanned data. The thumbnail images are generated in the format and resolution set on the summary / character extraction / thumbnail setting screen 1030.

[0044] In S809, the CPU 202 of the image processing device 101 transmits the same token information as in S801, information on the posting destination channel selected in S804, and the image file generated in S807 to the message app server 400 via the communication unit 217. Furthermore, in S809, the thumbnail image generated in S808 is also transmitted by HTTP communication. Here, an example of the command to be transmitted is "HTTP POST https: / / message.com / api / files.upload". Note that the file format used is the file format specified by the user on the scan-to-chat transmission setting screen 1010.

[0045] In S810, the CPU 401 of the message app server 400 searches for workspace information registered with the token information received in S809, and stores the received image file and thumbnail image in association with the channel specified in the channel information. As a result, when the user starts the message app on the mobile terminal 300 and selects the destination channel, a screen on which the image file and thumbnail image sent from the image processing device 101 are posted is displayed. The sent image file and thumbnail image are stored in a folder corresponding to the channel selected in S804. This folder is a folder managed on the chat service, and is also a folder on a cloud storage service linked to the chat service.

[0046] In S811, the CPU 401 of the message application server 400 transmits a result indicating whether or not the posting was successful to the image processing device 101 as response information of the HTTP communication. If the posting fails, the CPU 202 of the image processing device 101 may display a notification indicating that the posting failed on the operation unit 207. If the posting is successful, the CPU 202 of the image processing device 101 may also display a notification indicating that the posting was successful on the operation unit 207.

[0047] Fig. 9 is a flowchart showing an example of scan-to-chat processing executed by the image processing device 101. The CPU 202 reads a program stored in the ROM 203 into the RAM 204 and executes it, thereby executing the processing of the flowchart in Fig. 9.

[0048] When the CPU 202 detects in S901 that the scan-to-chat button 702 has been selected, the CPU 202 displays a scan-to-chat screen 1001 on the touch panel 701 of the operation unit 207 in S902.

[0049] Here, the screen that appears when the scan-to-chat button 702 is selected will be described with reference to FIG.

[0050] 10A is an example of a scan-to-chat screen displayed on the operation unit 207. The screen is displayed on the touch panel 701 when a scan-to-chat button 702 displayed on a home screen 708 is selected.

[0051] When the reset button 1005 is selected on the scan to chat screen 1001, the set information is cleared. At this time, the set channel information, user information, summary, character extraction, and thumbnail settings are cleared.

[0052] Furthermore, when the black and white start button 1006 or the color start button 1007 is selected on the scan to chat screen 1001, a scan and send process is started.

[0053] FIG. 10B is an example of a transmission setting screen displayed on the operation unit 207.

[0054] A transmission setting screen 1010 is displayed when a transmission setting button 1002 is selected on a scan-to-chat screen 1001. On this screen, the reading size, file format, message, file name, etc. can be set. For example, when a file format button 1011 is selected, the user can arbitrarily select from a list of file format candidates. In addition, the user can arbitrarily input a message and file name using a soft keyboard, etc.

[0055] FIG. 10C is an example of a channel setting screen displayed on the operation unit 207.

[0056] The channel setting screen 1020 is displayed when a channel setting button 1003 is selected on the scan to chat screen 1001. The channels displayed on this channel setting screen 1020 are displayed based on the channel list information received by the image processing device 101 from the message app server 400. On this screen, it is possible to set a destination channel and a mentioned user. When a channel button 1021 is selected, the selected channel is set as the destination channel. Note that multiple channels may be selectable. A user button 1022 is displayed based on the users participating in the channel corresponding to the channel button 1021, and a mentioned user can be set by selecting the user button.

[0057] When the back button 1023 is selected, the channel selection is maintained and the scan to chat screen 1001 is displayed on the operation unit 207 .

[0058] FIG. 10D is an example of a summary / text extraction / thumbnail setting screen displayed on the operation unit 207.

[0059] Summary / text extraction / thumbnail setting screen 1030 is displayed when summary / text extraction / thumbnail setting button 1004 is selected on scan-to-chat screen 1001 .

[0060] When the send together button 1031 is selected, it is possible to select whether to send a summary, a text extract, or a thumbnail. In Fig. 10, a display is shown in which a thumbnail is also sent. The summary and text extract will be described in the second and third embodiments. Note that if no summary and text extract are to be sent together, it is possible to leave this option blank, or to combine a number of options.

[0061] When the thumbnail setting format button 1032 is selected, the format of the thumbnail image can be determined. In the example of Fig. 10, JPEG is selected. Note that the format is not limited to JPEG as long as it can be previewed by the message application server 400.

[0062] When the resolution button 1033 is selected, the user can select the resolution at which the thumbnail images are to be generated. In the example of Fig. 10, the resolution is 720 x 480.

[0063] When the page number button 1034 is selected, it is possible to select which scanned page is to be used as the thumbnail image. In the example of Fig. 10, the first page is set to be used as the thumbnail image.

[0064] In Fig. 10, the setting items of format, resolution, and page number are described, but the settings are not limited to these as long as they relate to thumbnail images. For example, instead of making a thumbnail of the entire page, a portion may be enlarged. Also, if multiple thumbnails are required, multiple thumbnails may be set. Furthermore, the scan result may be displayed on the operation unit 207, allowing the user to select which portion to cut out. Thumbnail images can be freely set without departing from the essence of the present invention.

[0065] Here, the explanation returns to the flow of FIG.

[0066] In S903, the CPU 202 detects that the channel setting button 1003 has been selected. Then, in S904, the CPU 202 uses the token information 1103 and the user ID registered in advance to request channel information from the message application server 400 through HTTP communication.

[0067] Here, the setting registration screen of Fig. 11 will be described. Fig. 11 is a diagram showing an example of the setting registration screen. The setting registration screen 1101 is a screen displayed on the operation unit 207 of the image processing device 101. Note that the setting registration screen 1101 may also be displayed as a Web page on the operation unit of an information processing device such as a PC connected to the image processing device 101 via a network. The contents registered on the setting registration screen 1101 are stored in the storage 205 or the like.

[0068] A connection destination 1102 is a column showing organization information of a connection destination. A token information 1103 is a column of registered token information. An operation button 1104 is a column of operation buttons. In this item, an edit button 1105 and a generate button 1106 are displayed.

[0069] When the edit button 1105 is selected, the character strings of the token information, the connection destination information, etc. can be input and changed using a keyboard, etc. When the create button 1106 is selected, the home screen 708 is set to display the scan-to-chat button 702.

[0070] By clicking a new registration button 1107, it is possible to accept a character string input by the user and to add and register a connection destination and token information.

[0071] Here, the explanation returns to the flow of FIG.

[0072] In S905, the CPU 202 determines whether or not channel information has been received from the message application server 400 in response to the channel information acquisition request sent in S904. Specifically, it determines that channel list information has not been received if the status code in the HTTP communication response is an error or if the body information of the response includes a parameter indicating that the information cannot be acquired. If it is determined that the channel list information has been received, the process proceeds to S906. If not, the process proceeds to S917.

[0073] In S917, the CPU 202 displays information indicating that the channel list information could not be received on the channel setting screen 1020. At this time, the channel setting screen 1020 does not display any channel options.

[0074] In S918, the CPU 202 judges whether or not the back button 1023 has been selected. If it is judged that the back button 1023 has been selected, the process returns to S902. If not, the process returns to S918.

[0075] In S906 , the CPU 202 displays, on the touch panel 701 of the operation unit 207 , a channel setting screen 1020 on which the channel information and the like received from the message application server 400 are displayed.

[0076] In S907, the CPU 202 detects whether or not the channel setting screen 1020 has been operated via the touch panel 701 of the operation unit 207 and the channel and user have been confirmed. If confirmed, the process proceeds to S908. If not confirmed, the process returns to S907.

[0077] When the CPU 202 detects in S908 that the summary / text extraction / thumbnail setting button 1004 has been pressed, the CPU 202 displays a summary / text extraction / thumbnail setting screen 1030 on the operation unit 207 in S909.

[0078] In S910, the CPU 202 detects whether the summary / character extraction / thumbnail setting screen 1030 has been operated and the settings have been confirmed via the touch panel 701 of the operation unit 207. If the settings have been confirmed, the process proceeds to S911. If the settings have not been confirmed, the process returns to S910.

[0079] In S911, when the black and white start button 1006 or the color start button 1007 displayed on the operation unit 207 is selected, the CPU 202 controls the reading unit 209 based on the scan settings, reads the image of the document, and generates image data. The scan settings are scan settings specified by the user on a detailed setting screen for scan to chat (not shown).

[0080] In S912, the CPU 202 converts the image data generated in S911 into the file format set in the file format button 1011 on the transmission setting screen 1010, and generates an image file.

[0081] In S913, the CPU 202 generates a thumbnail image based on the image data generated in S916 and the format and resolution set on the summary / text extraction / thumbnail setting screen 1030.

[0082] In S914, the CPU 202 generates posting parameters. The posting parameters include information such as the channel to which the message is posted, the mention user, the file format, the file name, and the message. The file format is set to the one set in the file format button 1011 in the transmission settings. The file name is specified as the file name specified in the transmission settings.

[0083] In S915, the CPU 202 uses the token information 1103 registered in advance to send the file generated in S912 and S913 and the posting parameters to the message app server 400 by the POST method of HTTP communication. By sending this data (the file converted from image data and the posting parameters) to the message app server 400, the message app server 400 posts the file and thumbnail image to the specified channel based on the received parameters. The message app server 400 posts the image file and adds information.

[0084] In S916 , the result of the processing by the message application server 400 is displayed on the touch panel 701 of the operation unit 207 .

[0085] In this manner, the user can post an image file and its thumbnail image from the image processing device 101 to a specific channel of the message application server 400 .

[0086] Fig. 12 is a diagram showing an example of a message screen of a message application. A message screen 1201 in Fig. 12 is displayed after the message application is started in the mobile terminal 300 and the series of processes in Fig. 9 are executed in the image processing device 101. In addition, the mobile terminal 300 communicates with the message application server 400.

[0087] When a user starts a message application on the mobile terminal 300 and logs in by inputting the ID and password of the user's account, a screen dedicated to that user is displayed.

[0088] Message 1202 is a chat message that is displayed when a user having an account of user 1 posts a message on channel 3. Message 1202 is displayed (posted) when a user having an account of user 1 uses the image processing device 101 with the user ID of user 1 to transmit an image file generated by scanning and posting parameters to the message app server 400. In the example of FIG. 12, "Channel 3" is specified as the posting channel in the posting parameters, "User 3" is specified as the mentioned user, "material.pdf" is specified as the file name, and "These are meeting materials." is specified as the message.

[0089] By executing the above process, as in message 1202, both document.pdf and a thumbnail image of document.pdf are posted, allowing the user to get a rough idea of ​​the contents without opening document.pdf. EXAMPLES

[0090] In the first embodiment, a thumbnail image is attached together with an image file. In the second embodiment, a part of a text is extracted by OCR processing, and the extracted text is sent together with the image file.

[0091] FIG. 13 is a diagram showing an example of a sequence in which a part of a sentence is extracted from the OCR result of a file generated by scanning by the image processing device 101, and transmitted to the message application server 400 together with the file.

[0092] The processes from S801 to S807 are the same as those in Fig. 8, and therefore the description will be omitted. Note that, in the example of Fig. 13, a case will be described in which character extraction is selected by the Send button 1031 on the summary / character extraction / thumbnail setting screen 1030.

[0093] In S1301, the CPU 202 of the image processing device 101 transmits the image file generated in S807 to the character recognition server 500 via the communication unit 217 or the wireless communication unit 213. Also, setting information for character extraction set on the summary / character extraction / thumbnail setting screen 1030 may be transmitted to the character recognition server 500. In this case, the character recognition server 500 performs character recognition and edits the acquired character information as in S1304 based on the received setting information.

[0094] In S1302, the CPU 501 of the character recognition server 500 executes character recognition processing on the image indicated by the image file, and acquires character information.

[0095] In S1303, the image processing device 101 receives character information acquired from the character recognition server 500. Here, the received information may be text data, document data in which acquired character strings are arranged according to the image layout of an image file, or the like.

[0096] In S1304, the CPU 202 of the image processing device 101 organizes the character information extracted from the data received in S1303. This process is executed based on the character extraction settings configured on the summary / character extraction / thumbnail setting screen 1030. For example, a process of cutting out only the first three lines of the first page, or a process of extracting only keywords such as dates, people's names, and titles may be performed. Note that if detailed designation was performed at the stage of S1301 and organization is not necessary, this step may be skipped. By performing this organization, character information is generated.

[0097] In S1305, the CPU 202 of the image processing device 101 transmits the character information generated in S1304 together with the image file generated in S807 to the message application server 400 by HTTP communication via the communication unit 217. In addition, channel information of the posting destination, the message, and the like are also transmitted here.

[0098] Since steps S810 and S811 are the same as those in FIG. 8, their explanation will be omitted.

[0099] Although an example in which the character recognition server 500 performs the OCR process has been described with reference to FIG. 13, the CPU 202 of the image processing apparatus 101 may execute the OCR process and transmit character information using the result in step S1305.

[0100] Fig. 14 is a flowchart showing an example of scan-to-chat processing in the image processing device 101. The CPU 202 reads a program stored in the ROM 203 into the RAM 204 and executes it, thereby executing the processing of the flowchart in Fig. 14.

[0101] The processes from S901 to S909 are the same as those in Fig. 9, and therefore the description will be omitted. In this embodiment, an example will be described in which character extraction is selected by the Send button 1031 on the summary / character extraction / thumbnail setting screen 1030 displayed in S909.

[0102] The summary / character extraction / thumbnail setting screen 1030 will now be described with reference to FIG.

[0103] 15A is an example of a scan-to-chat screen displayed on the operation unit 207 in the embodiment 2. The display contents are the same as those in the embodiment 1, so the description will be omitted.

[0104] 15B is an example of a transmission setting screen displayed on the operation unit 207 in the embodiment 2. The display contents are the same as those in the embodiment 1, so a description thereof will be omitted.

[0105] 15C is an example of a channel setting screen displayed on the operation unit 207 in the embodiment 2. The display contents are the same as those in the embodiment 1, so a description thereof will be omitted.

[0106] FIG. 15D is an example of a summary / character extraction / thumbnail setting screen displayed on the operation unit 207 in the second embodiment.

[0107] In the first embodiment, an example was described in which a thumbnail was selected with the Send button 1031 and thumbnail settings were displayed, but in the second embodiment, character extraction was selected and a character extraction settings screen was displayed.

[0108] When the character extraction part button 1501 in the character extraction setting is selected, it is possible to select from among the options prepared in advance which part of the image shown by the image file is to be subjected to character recognition and character extraction by OCR. In the example of Fig. 15(D), the setting is made to extract characters from the first three lines. It is also possible to set it to extract the first ten lines, or to extract only important items such as dates, people's names, and titles.

[0109] When the maximum characters button 1502 is selected, the maximum number of characters can be set. In the example of Fig. 15(D), the maximum is set to 300 characters. This setting is a function to prevent chat messages from becoming too long, and does not necessarily have to be limited. When the maximum characters button 1502 is selected, the user can enter any number of characters.

[0110] In Fig. 15(D), the setting items of character extraction location and maximum characters are described, but the setting is not limited to these as long as it is related to OCR. For example, it is also possible to set the language to be acquired in OCR processing, or to set the inclination correction of image data generated by scanning before OCR processing. Furthermore, it is also possible to display an image of image data generated by scanning on the operation unit 207, and allow the user to select the area to be OCR processed.

[0111] Here, the explanation returns to the flow of FIG.

[0112] In S1401, the CPU 202 detects whether or not the summary / character extraction / thumbnail setting screen 1030 has been operated via the touch panel 701 of the operation unit 207 and the character extraction setting has been confirmed. If it has been confirmed, the process proceeds to S911. If it has not been confirmed, the process returns to S1401.

[0113] Since steps S911 and S912 are the same as those in the first embodiment, the description thereof will be omitted.

[0114] In S1402, the CPU 202 of the image processing device 101 transmits the image file generated in S912 to the character recognition server 500 via the communication unit 217 or the wireless communication unit 213, and requests the character recognition server 500 to extract character information from the image file. Note that, for example, if an area for OCR processing is set in advance, information about that area may be transmitted to the character recognition server 500, and the character recognition server 500 may execute OCR processing based on the area information received. In other words, OCR processing is executed only on the area indicated by the received area information in the image of the received image file. This makes it possible to reduce the time required for OCR processing.

[0115] In S1403, the CPU 202 of the image processing device 101 receives character information acquired by OCR processing by the character recognition server 500 via the communication unit 217 or the wireless communication unit 213. The character information received here may be text data or document data laid out based on the image of the image file.

[0116] In S914, the CPU 202 generates posting parameters. For example, if the character extraction setting is set to "first three lines" and the maximum characters to "300 characters," then character information that is the first three lines of character information and is 300 characters or less is extracted (specified) from the character information received in S1403. If the first three lines of character information exceed 300 characters, the number of characters extracted may be set to 300. It is also possible to set only one of the character extraction location and the maximum characters.

[0117] In addition to the extracted character information described above, information on the channel to which the post is to be made, information indicating the mentioned user, a message, and the like are set as the posting parameters.

[0118] In S915, the CPU 202 uses the token information 1103 registered in advance to send the file generated in S912 and S914 and the posting parameters to the message app server 400 by the POST method of HTTP communication. By sending this data (the file converted from image data and the posting parameters) to the message app server 400, the message app server 400 posts the file and the character string indicated by the extracted character information to the specified channel based on the parameters. The posting of the image file and the addition of information are performed by the message app server 400. Since S916 to S918 are the same as the processing in FIG. 9, a description thereof will be omitted.

[0119] In the present embodiment, an example has been described in which the character recognition server 500 is independent of the image processing device 101 and the message application server 400, but the present invention is not limited to this. For example, the CPU 202 of the image processing device 101 may execute the character recognition process (OCR process), or the CPU 401 of the message application server 400 may execute the character recognition process (OCR process). When the CPU 401 of the message application server 400 executes the character recognition process, the image processing device 101 transmits information indicating the character extraction setting to the message application server 400. Then, the message application server 400 extracts character information based on the information indicating the character extraction setting received. Then, the message application server 400 posts the extracted character information and the image file received from the image processing device 101 based on the received posting parameters.

[0120] As a result of the above, a user can post an image file from the image processing device 101 to a specific channel of the message app server 400, and character information (or extracted character information) obtained by performing character recognition processing on the image of the image file. EXAMPLES

[0121] In the first embodiment, a thumbnail image is attached. In the second embodiment, an example is described in which OCR processing is performed, and a part of the acquired character information is extracted and transmitted together with an image file. In the third embodiment, an example is described in which a large-scale language model is used to summarize a text, and the result is transmitted together with an image file.

[0122] FIG. 16 is a diagram showing an example of a sequence in which the image processing device 101 transmits to the message application server 400 a file generated by scanning and a summary generated using a large-scale language model.

[0123] Since steps S801 to S807 are the same as those in the first embodiment, the explanation will be omitted. In the example of Fig. 16, the case where the summary is selected by the Send Also button 1031 on the summary / character extraction / thumbnail setting screen 1030 will be explained.

[0124] In S1301, the CPU 202 of the image processing device 101 transmits the image file generated in S807 to the character recognition server 500 via the communication unit 217 or the wireless communication unit 213. Also, setting information for character extraction set on the summary / character extraction / thumbnail setting screen 1030 may be transmitted to the character recognition server 500. In this case, the character recognition server 500 performs character recognition and edits the acquired character information as in S1304 based on the received setting information.

[0125] In S1302, the CPU 501 of the character recognition server 500 executes character recognition processing on the image indicated by the image file, and acquires character information.

[0126] In S1303, the image processing device 101 receives character information acquired from the character recognition server 500. Here, the received information may be text data, document data in which acquired character strings are arranged according to the image layout of an image file, or the like.

[0127] In S1601, the CPU 202 of the image processing device 101 transmits the data acquired in S1303 to the large-scale language model server 600 via the communication unit 217 or the wireless communication unit 213, and requests a summary of the text. The request transmitted here is composed of model information and message information. The model information is information indicating which language model is to be used. The message information is composed of an item called role that specifies who the message is from, and an item called content that describes an instruction that can be written in free language. For example, by specifying "user" in the role, "summarize the following text in three lines" in the content, and further inputting text data, a three-line summary in bullet points can be requested from the input text data. The request transmitted here may include the character information (text data) acquired in S1303 and information indicating the conditions for the summary. The information indicating the conditions for the summary may be an instruction written in natural language. Also, a request including information indicating the conditions may be transmitted by specifying the URL of a WebAPI. Also, the large-scale language model server may have a character recognition function and execute a process equivalent to that of the character recognition server 500. In this case, the image processing device 101 transmits the image file generated by scanning to the large-scale language model server 600 .

[0128] In S1602, the large scale language model server 600 generates summary data based on the character information (text data) received in S1601 and information indicating the conditions for summarization.

[0129] In S1603, the image processing apparatus 101 receives the generated summary data from the large-scale language model server 600. In the reply from the large-scale language model server 600, the role mentioned above becomes "assistant" and the summary result is filled in the context.

[0130] In S1604, the CPU 202 of the image processing apparatus 101 displays the character string indicated by the summary data acquired in S1603 on the operation unit 207, and asks the user if there are any problems with the summary result. If resummarization is required, the CPU 202 also accepts instructions on how to resummarize.

[0131] If re-summarization is not required, in S1605, the CPU 202 of the image processing device 101 transmits the image file generated in S807 and the received summary data to the message application server 400 by HTTP communication via the communication unit 217. Here, channel information of the posting destination, the message, etc. are also transmitted. Since S810 and S811 are the same processes as those in FIG. 8, their explanations will be omitted.

[0132] On the other hand, if re-summarization is necessary as a result of S1604, in S1610, the CPU 202 of the image processing device 101 transmits a re-summarization instruction to the large-scale language model server 600 via the communication unit 217. The character information on which the summary is based has already been transmitted in S1601 and is held in the large-scale language model server 600, but may be re-transmitted again in S1610.

[0133] In S1611, the large scale language model server 600 generates summary data based on the character information received in S1610 and the summary conditions received again. In S1612, the image processing apparatus 101 receives the summary data from the large scale language model server 600.

[0134] Then, again in S1613, the CPU 202 of the image processing apparatus 101 displays the character string indicated by the summary data acquired in S1603 on the operation unit 207, and asks the user if there are any problems with the summary result. If necessary, the process returns to S1610 and the summary can be repeated to get closer to the summary result desired by the user.

[0135] In FIG. 16, an example has been described in which the character recognition server 500 performs OCR processing and the large-scale language model server 600 performs summarization processing, but the image processing device 101 may perform character recognition processing and summary data generation processing.

[0136] Fig. 17 is a flowchart showing an example of scan-to-chat processing in the image processing device 101. The CPU 202 reads a program stored in the ROM 203 into the RAM 204 and executes it, thereby executing the processing of the flowchart in Fig. 17.

[0137] The processes from S901 to S909 are the same as those in Fig. 9, and therefore description thereof will be omitted. Note that in this embodiment, an example will be described in which the summary is selected by the Send button 1031 on the summary / text extraction / thumbnail setting screen 1030 displayed in S909.

[0138] The summary / character extraction / thumbnail setting screen 1030 will now be described with reference to FIG.

[0139] 18A is an example of a scan-to-chat screen displayed on the operation unit 207 in the embodiment 3. The display contents are the same as those in the embodiment 1, so the description will be omitted.

[0140] 18B is an example of a transmission setting screen displayed on the operation unit 207 in the embodiment 3. The display contents are the same as those in the embodiment 1, so a description thereof will be omitted.

[0141] 18C is an example of a channel setting screen displayed on the operation unit 207 in the embodiment 3. The display contents are the same as those in the embodiment 1, so the description will be omitted.

[0142] FIG. 18D is an example of a summary / character extraction / thumbnail setting screen displayed on the operation unit 207 in the third embodiment.

[0143] In the second embodiment, an example was described in which character extraction was selected using the Send button 1031 and character extraction settings were displayed, but in the third embodiment, summary was selected and a summary settings screen was displayed.

[0144] When the summary method button 1801 is selected, the user can select how to summarize the text data from among the options prepared in advance. In the example of Fig. 18, the setting is for a three-line summary. In addition to "three-line summary," other settings such as "bullet points" and "no specification" can be set. When "bullet points" is set, the summary is generated in bullet points. When "no specification" is set, the summary is generated freely.

[0145] When the maximum characters button 1802 is selected, the number of characters in the generated summary can be selected. In this manner, the image processing device 101 can accept conditions regarding the number of characters in the summary. In the example of Fig. 18, the maximum is set to 300 characters. As in the second embodiment, this setting is merely a function for preventing chat messages from becoming too long, and is not necessarily required to impose a restriction.

[0146] When the summary translation button 1803 is selected, a request can be made to translate the summary into any language. Translation can help the recipient of the chat message to better understand the content. For example, when the summary translation button 1803 is selected, a list of languages ​​such as Japanese, English, and Chinese is displayed, and the operation unit 207 can accept the user's selection.

[0147] When the emphasis setting button 1804 is selected, a request is made to emphasize and summarize dates, important points, etc. from the character data. In the emphasis setting, it is possible to set a pattern for emphasis from word choice, a pattern for emphasis using symbols, and further, to use heading-level expressions in a format such as Markdown instead of plain text as the output format.

[0148] When the organizational understanding button 1805 is selected and the function understanding function is set to ON, the message app server 400 acquires organizational information held therein, and the summary can be set to be polite sentences according to the other party's position and the relationship with the user. Here, the user is the user corresponding to the user ID transmitted in S801, and the other party is the user designated as the mention user. The other party may be a user participating in the channel to which the message is posted. In this case, if at least one user with a higher position than the user participates in the channel to which the message is posted, a polite summary is automatically generated. In this case, the image processing device 101 acquires organizational information from the message app server 400 and transmits it to the large-scale language model server 600. When acquiring organizational information, communication is performed with the message app server 400 before S1601, and after acquiring organizational information, a summary instruction is given in S1601.

[0149] When the language learning button 1806 is selected and the language learning function is set to ON, the channel to which the message is to be posted is referenced, the language is learned, and a summary text is requested to be generated. This setting allows sending messages in expressions that are closer to the usual exchanges between the sender and the recipient than settings based on organization information. Even when language learning is performed, communication is performed with the message app server 400 before S1601, text information for the channel is obtained, and a summary instruction is issued in S1601.

[0150] Although an example of setting the button for understanding the organization 1805 and the button for learning language 1806 to automatically adjust the expression method has been described, the present invention is not limited to this. For example, the summary / character extraction / thumbnail setting screen 1030 may receive settings such as "honorific language" and "prohibit honorific language" from the user, and instructions for summarization based on the received settings may be given.

[0151] When the free description button 1807 is selected, the user can freely input the summary method using a soft keyboard, etc. When the setting is made using the free description button, other setting items may become invalid.

[0152] 18(D) describes the setting items of summarization method, maximum characters, summary translation, emphasis setting, organizational understanding, word usage learning, and free description, but the setting is not limited to these items as long as it is related to summarization. Any setting can be freely set within the scope of the present invention.

[0153] 18(E) is an example of a summary result confirmation screen 1800 displayed on the operation unit 207 in the third embodiment. When the black and white start button 1006 or color start button 1007 is selected to execute scanning, and after the summary process is completed, the summary result is displayed in an area 1810. The user checks the summary result generated by the large-scale language model server 600 by looking at this screen.

[0154] A Yes button 1811 or a No button 1812 is displayed. In order to press the No button 1812, it is necessary to set up re-summarization by selecting a Re-summarization Setting button 1813. By selecting the Re-summarization Setting button 1813, as in the case of the Free Description button 1807, text can be entered using the keyboard and the user can freely specify the method of summarization.

[0155] Now, returning to the explanation of the flow in Fig. 17, in S1701, the CPU 202 detects whether or not the summary / character extraction / thumbnail setting screen 1030 has been operated via the touch panel 701 of the operation unit 207 and the summary setting has been confirmed. If it has been confirmed, the process proceeds to S911. If it has not been confirmed, the process returns to S1701.

[0156] Since steps S911 and S912 are the same as those in the first embodiment, the description thereof will be omitted.

[0157] In S1402, the CPU 202 of the image processing device 101 transmits the image file generated in S912 to the character recognition server 500 via the communication unit 217 or the wireless communication unit 213, and requests the character recognition server 500 to extract character information from the image file. Note that, for example, if an area for OCR processing is set in advance, information about that area may be transmitted to the character recognition server 500, and the character recognition server 500 may execute OCR processing based on the area information received. In other words, OCR processing is executed only on the area indicated by the received area information in the image of the received image file. This makes it possible to reduce the time required for OCR processing.

[0158] In S1403, the CPU 202 of the image processing device 101 receives character information acquired by OCR processing by the character recognition server 500 via the communication unit 217 or the wireless communication unit 213. The character information received here may be text data or document data laid out based on the image of the image file.

[0159] In S1702, the CPU 202 of the image processing device 101 transmits the text information received in S1403 to the large-scale language model server 600 via the communication unit 217 or the wireless communication unit 213, and requests the generation of a summary. At this time, the CPU 202 transmits to the large-scale language model server 600 the text information, a summary generation instruction, and information indicating the summary conditions set on the summary / text extraction / thumbnail setting screen 1030 of Fig. 18(D).

[0160] In S1703 , the CPU 202 of the image processing device 101 receives the summary data generated by the large-scale language model server 600 via the communication unit 217 or the wireless communication unit 213 .

[0161] In S1704, the CPU 202 of the image processing apparatus 101 displays the summary indicated by the summary data from the large-scale language model server 600 on the operation unit 207, and asks the user whether or not the summary needs to be re-created.

[0162] In S1705, the CPU 202 of the image processing apparatus 101 determines whether or not there is a re-summarization request from the user. If the user presses the No button 1812 to instruct re-summarization, the process proceeds to S1706. On the other hand, if the user presses the Yes button 1811, the process proceeds to S914.

[0163] In S1706, the CPU 202 of the image processing apparatus 101 accepts as an instruction the content set by the re-summarization setting button 1813. Then, the process returns to S1702, and the process is started again from transmitting a summary request to the large-scale language model server 600.

[0164] In S914, the CPU 202 generates posting parameters. In addition to the summary data described above, the posting parameters include information on the posting destination channel, information indicating the mentioned user, a message, and the like.

[0165] In S915, the CPU 202 uses the token information 1103 registered in advance to send the file generated in S912 and S914 and the posting parameters to the message app server 400 by the POST method of HTTP communication. By sending this data (the file converted from image data and the posting parameters) to the message app server 400, the message app server 400 posts the file and the character string indicated by the summary data to the specified channel based on the received parameters. The posting of the image file and the addition of information are performed by the message app server 400. Since S916 to S918 are the same as the processing in FIG. 9, a description thereof will be omitted.

[0166] As a result of the above, the user can post, from the image processing device 101 to a specific channel of the message application server 400, an image file and a result of summarizing using a large-scale language model, to the message application server 400.

[0167] In the third embodiment, the character recognition server 500 performs character recognition processing on image data (image file) generated by scanning, and the large-scale language model server 600 performs summary generation processing. However, the present invention is not limited to this, and the message app server 400 or another server connected to the message app server 400 may perform character recognition processing on image data generated by scanning. Furthermore, the summary generation processing may also be performed by the message app server 400 or another server. In this case, the image processing device 101 transmits the image data generated by scanning, information indicating the conditions of the summary, and posting parameters including a summary instruction, information on the posting destination channel, etc., to the message app server 400. The message app server 400 performs the summary generation processing based on the information indicating the conditions of the summary included in the received posting parameters. The message app server 400 may request the generation processing to another server. In this case, the message app server 400 transmits information indicating the information on the summary to another server related to the chat service. The server related to the chat service is composed of a plurality of servers such as the message app server 400 and another server. The message app server 400 posts the generated summary and the received image data to the destination channel specified by the posting parameters. Even if the message app server 400 executes character recognition processing and summary generation processing, the summary may be confirmed on the operation unit 207. For this purpose, it is necessary to transmit the summary data generated by the message app server 400 to the image processing device 101.

[0168] The posting parameters including the generated image data and summary conditions may be transmitted to another server related to the chat service instead of the message application server 400, and then transmitted from the other server to the message application server 400. This is also true for the transmission of posting parameters in the first and second embodiments. The other server may be a general-purpose server that is not related to the chat service.

[0169] Here, the message application server 400 posts the image data and the abstract in the same message so that it is easy to know which image data the abstract is for. In other words, the received image data and the abstract are posted in association with each other.

[0170] Fig. 19 is a diagram showing an example of a message screen of a message application. A message screen 1201 in Fig. 19 is displayed after the message application is started in the mobile terminal 300 and the series of processes in Fig. 17 are executed in the image processing device 101.

[0171] When a user starts a message application on the mobile terminal 300 and logs in by inputting the ID and password of the user's account, a screen dedicated to that user is displayed.

[0172] Message 1901 is a chat message that is displayed when a user having an account of user 1 posts a message on channel 3. In this embodiment, message 1901 is displayed (posted) by operating image processing device 101 using user ID information of user 1 and transmitting an image file generated by scanning and posting parameters to message app server 400.

[0173] In the example of Fig. 19, "Channel 3" is specified as the posting channel, "User 3" is specified as the mention user, and "material.pdf" is specified as the file name among the posting parameters. And, as the posting comment, a three-line summary generated based on "material.pdf" to carry out the series of processes in Fig. 17 is described.

[0174] As shown in Figure 19, by posting both the document.pdf and the summary of the document.pdf, you can find out the contents of the document, such as the decisions made at the meeting or the date of the next meeting, without having to open the document. You can also use keywords in the summary to search for past chat messages.

[0175] <Other embodiments> The present invention can be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a storage medium. Then, one or more processors in the computer of the system or device can read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0176] 101 Image processing device 209 Reading unit 400 Message App Server 500 Character Recognition Server 600 Large-scale language model server 702 Scan to chat button

Claims

1. A scanning means for scanning an image of an original to generate image data; a reception unit for receiving settings of conditions for generating a summary based on the image data; a transmission means for transmitting the generated image data and information indicating the set conditions, The image processing device is characterized in that a summary generated based on the transmitted conditions is posted on a channel of a chat service.

2. 2. The image processing apparatus according to claim 1, wherein the condition is a condition related to the number of characters in the summary.

3. 2. The image processing apparatus according to claim 1, wherein the condition is a condition related to an expression of the summary.

4. 4. The image processing apparatus according to claim 3, wherein said transmission means transmits information indicating said set conditions to a server related to said chat service.

5. 2. The image processing apparatus according to claim 1, further comprising a receiving means for receiving the summary from a server which has generated the summary based on the information transmitted by the transmitting means.

6. 6. An image processing apparatus according to claim 5, further comprising display means for displaying the received summary.

7. 2. The image processing apparatus according to claim 1, wherein the summary and the image data are posted to the channel by the transmitting means transmitting the image data and the information.

8. The image processing device according to claim 7 , wherein the summary and the image data are posted to the channel in association with each other.

9. 2. The image processing apparatus according to claim 1, further comprising a printing means.

10. a scanning step of scanning an image of an original document to generate image data; a receiving step of receiving settings of conditions for generating a summary based on the image data; a transmission step of transmitting the generated image data and information indicating the set conditions, The image processing method further comprises posting a summary generated based on the transmitted conditions to a channel of a chat service.

11. a scanning step of scanning an image of an original document to generate image data; a receiving step of receiving settings of conditions for generating a summary based on the image data; a transmission step of transmitting the generated image data and information indicating the set conditions, A program for causing a computer to execute an image processing method, characterized in that a summary generated based on the transmitted conditions is posted on a channel of a chat service.

12. 12. The program according to claim 11, wherein the condition is a condition regarding the number of characters in the summary.

13. 12. The program according to claim 11, wherein the condition is a condition regarding an expression of the summary.

14. 14. The program according to claim 13, wherein said transmission step transmits information indicating said set conditions to a server related to said chat service.

15. 12. The program according to claim 11, further comprising a receiving step of receiving the summary from a server that has generated the summary based on the information transmitted in the transmitting step.

16. 16. The computer-readable medium according to claim 15, wherein the image processing method further comprises a display step of displaying the received summary.

17. 12. The program according to claim 11, wherein the summary and the image data are posted to the channel by transmitting the image data and the information in the transmitting step.

18. 18. The program according to claim 17, wherein the summary and the image data are posted to the channel in association with each other.

Images