Image forming apparatus and control method

Abstract

To provide a terminal device, etc., that posts a message containing an image when it is not possible to transmit the image using facsimile communication. [Solution] A first terminal device comprising a communication unit that can communicate with a server device that provides a service enabling the exchange of messages between multiple terminal devices, a control unit, and a display unit, wherein the control unit displays a message on the display unit indicating that the first communication device has received a first image from a second communication device, receives an instruction to transmit a second image to the second communication device, and if it is unable to transmit the second image to the second communication device, transmits an instruction to the server device to transmit a reply message to the second terminal device indicating that it has received the first image.

Description

Technical Field

[0001] This disclosure relates to a control method and the like.

Background Art

[0002] Conventionally, facsimile machines, which are one type of image communication device, have been widely used, and technologies for notifying the reception of facsimiles have also been proposed.

[0003] For example, in an image forming apparatus that creates a notification message for notifying the reception of a facsimile and sends it to a notification destination, a URL (Uniform Resource Locator) for specifying a preview of the received image and a URL for displaying a screen for selecting processing for the received data are included in the notification message. A technology has been proposed (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In recent years, the use of applications for sending and receiving messages between users, such as chat applications, has been spreading. Therefore, it is desirable to be able to view an image received via facsimile communication and send an image as a reply to the received image via a chat application. Here, when a user gives an instruction to reply to a facsimile via a chat application from a location outside the office or the like, a situation may be considered where the status of the facsimile to which the reply instruction has been given cannot be easily confirmed. When the reply image has been sent, the user cannot confirm the status of the facsimile, the reply may be delayed, and there is a problem that it may develop into a trouble. However, such problems are not considered in Patent Document 1.

[0006] In view of the above-mentioned issues, this disclosure aims to provide a terminal device, etc., that posts a message containing an image when it is not possible to transmit the image using facsimile communication. [Means for solving the problem]

[0007] To solve the above-mentioned problems, a first embodiment of the present disclosure is a first terminal device comprising a communication unit that can communicate with a server device that provides a service for exchanging messages between a plurality of terminal devices, a control unit, and a display unit, wherein the control unit displays a message on the display unit indicating that the first communication device has received a first image from a second communication device, receives an instruction to transmit a second image to the second communication device, and, if it is not possible to transmit the second image to the second communication device, transmits an instruction to the server device to transmit a reply message to the second terminal device indicating that it has received the first image.

[0008] A second embodiment of the present disclosure is a system comprising a first communication device, a second communication device, a first terminal device, a second terminal device, and a server device, wherein the first terminal device receives via the server device that the first communication device has received a first image from the second communication device, the first terminal device receives an instruction from the server device to transmit a second image from the first communication device to the second communication device, the first terminal device receives from the server device that the first communication device is unable to transmit the second image to the second communication device, and the first terminal device receives an instruction from the server device to transmit a message to the second terminal device.

[0009] A third embodiment of the present disclosure is a control method for a first terminal device equipped with a display unit, which is communicable with a server device that provides a service enabling the exchange of messages between a plurality of terminal devices, the control method comprising: the first communication device displaying a message on the display unit indicating that it has received a first image from a second communication device; the first communication device receiving an instruction to transmit a second image to the second communication device; and, if it is not possible to transmit the second image to the second communication device, transmitting an instruction to the server device to transmit a reply message to the second terminal device indicating that it has received the first image.

[0010] A fourth embodiment of the present disclosure is a control method for a system including a first communication device, a second communication device, a first terminal device, a second terminal device, and a server device, the control method comprising: the first terminal device receiving via the server device that the first communication device has received a first image from the second communication device; the first terminal device receiving an instruction from the server device to transmit a second image from the first communication device to the second communication device; the first terminal device receiving from the server device that the first communication device is unable to transmit the second image to the second communication device; and the first terminal device receiving an instruction from the server device to transmit a message to the second terminal device. [Effects of the Invention]

[0011] According to this disclosure, it will be possible to post a message containing an image if it is not possible to send the image using facsimile communication. [Brief explanation of the drawing]

[0012] [Figure 1] This is a diagram illustrating the overall configuration of the system in the first embodiment. [Figure 2] This is a diagram illustrating the functional configuration of the server device in the first embodiment. [Figure 3]It is a diagram for explaining an example of the data configuration of message information in the first embodiment. [Figure 4] It is a diagram for explaining an example of the data configuration of address information in the first embodiment. [Figure 5] It is a diagram for explaining the functional configuration of the terminal device in the first embodiment. [Figure 6] It is a diagram for explaining the functional configuration of the image communication device in the first embodiment. [Figure 7] It is a flowchart for explaining the processing flow of the image communication device in the first embodiment. [Figure 8] It is a flowchart for explaining the processing flow of the server device in the first embodiment. [Figure 9] It is a flowchart for explaining the processing flow of the terminal device in the first embodiment. [Figure 10] It is a diagram for explaining an operation example in the first embodiment. [Figure 11] It is a diagram for explaining the functional configuration of the server device in the second embodiment. [Figure 12] It is a diagram for explaining the functional configuration of the image communication device in the second embodiment. [Figure 13] It is a flowchart for explaining the processing flow of the image communication device in the second embodiment. [Figure 14] It is a diagram showing an operation example in the third embodiment. [Figure 15] It is a diagram showing an operation example in the fourth embodiment. [Figure 16] It is a diagram showing an operation example in the fifth embodiment. [Figure 17] It is a diagram showing an operation example in the sixth embodiment.

Modes for Carrying Out the Invention

[0013] Hereinafter, an embodiment for implementing the present disclosure will be described with reference to the drawings. Note that the following embodiment is an example for explaining the present disclosure, and the technical scope of the invention described in the claims is not limited to the following description.

[0014] [1. First Embodiment] [1.1 Overall Configuration] FIG. 1 is a diagram showing the overall configuration of the system 1 of the present disclosure. As shown in FIG. 1, the system 1 includes a server device 10, a terminal device 20, and an image communication device 30. The system 1 includes a plurality of terminal devices 20 (terminal device 20a, terminal device 20b) and a plurality of image communication devices 30 (image communication device 30a, image communication device 30b).

[0015] The server device 10, the terminal device 20, and the image communication device 30 are connected via a network NW1. The network NW1 is a network that connects each device. For example, it is realized by a LAN (Local Area Network) or a WAN (Wide Area Network). Also, it may be configured by combining these networks.

[0016] The image communication device 30 is a device having at least a facsimile (FAX / facsimile) function. The image communication device 30 may be installed in an image forming device such as a digital multi-function peripheral (MFP; Multi-Function Peripheral / Printer), or may be a single device. Also, the image communication device 30 can be connected to a telephone line network NW2 such as an analog line or a digital line (ISDN).

[0017] The server device 10 is an information processing device that provides a predetermined service (for example, an IoT platform), and is installed on the cloud, for example. In the present embodiment, the server device 10 provides a chat service and a cooperation service.

[0018] In this embodiment, the chat service refers to a service that enables the exchange of messages between users of the chat service. More specifically, the chat service is a service that enables the exchange (sending and receiving) of messages between each terminal device (multiple terminal devices) used by each user of the chat service.

[0019] In this embodiment, the collaborative service refers to a service that works in conjunction with the image communication device 30 to realize a predetermined function using the image communication device 30.

[0020] The terminal device 20 is a device used by the user and is an information processing device that consists of, for example, a mobile terminal such as a smartphone or tablet, or a PC (Personal Computer).

[0021] In this specification, "receiving a fax," "receiving a fax," and "fax reception" refer to receiving images using facsimile communication in accordance with the standard. Similarly, "sending a fax," "sending a fax," and "fax transmission" refer to sending images using facsimile communication in accordance with the standard. Facsimile communication is an electrical communication method for sending and receiving images, including text and graphics, and the transmission lines used for facsimile communication are called facsimile communication networks.

[0022] [1.2 Functional Configuration] [1.2.1 Server Equipment] Referring to Figure 2, the functional configuration of the server device 10 in this embodiment will be described. As shown in Figure 2, the server device 10 is configured to include a control unit 100, a storage unit 170, and an NW communication unit 180.

[0023] The control unit 100 is a functional unit for controlling the entire server device 10. The control unit 100 realizes various functions by reading and executing various programs stored in the storage unit 170, and is composed of one or more arithmetic units (e.g., CPU (Central Processing Unit)).

[0024] The control unit 100 functions as a message processing unit 102 and a coordination processing unit 104 by executing a program.

[0025] The message processing unit 102 implements a chat service. In this embodiment, the message processing unit 102 performs the following processes.

[0026] (1) Receiving and remembering posted messages The message processing unit 102 receives information (message information) including a message entered by the user via the NW communication unit 180. In this embodiment, the process of sending message information to the server device 10 is described as "posting". Also in this embodiment, posting message information that includes User A's chat application ID as the source information and User B's chat application ID as the destination information, and includes a predetermined message, is described as "posting a predetermined message from User A to User B".

[0027] Message information includes the message itself and its attributes. A message is the content entered by the user (e.g., text data). Message attributes are information related to the message, such as the sender's information, recipient's information, and the date and time of transmission.

[0028] The message information stores information that uniquely identifies the user using the chat service, including information about the sender and recipient. In this embodiment, the information that uniquely identifies the user using the chat service is referred to as the identification information.

[0029] Identification information may be information automatically assigned to the user in the chat service, or it may be information set or changed by the user (for example, service ID, user ID, account name, etc.).

[0030] In this embodiment, the chat application ID is used as identification information. The chat application ID is a unique ID assigned to a user by the chat service (control unit 100 of server device 10) when the user logs into the chat service for the first time. The chat application ID may be a sequential number such as "0X00000001", a random string, or a string or number calculated by a predetermined calculation method. Furthermore, the chat application ID cannot be changed by user actions, nor can it be changed even if other information (such as a service ID) is set or changed by the user.

[0031] Furthermore, the identification information does not have to be a chat application ID; any information that uniquely identifies a user of the chat service is acceptable. For example, the identification information could be a user-configurable ID that is different for each user (such as a service ID or user ID), or it could be information unique to the user (such as a phone number or email address).

[0032] Furthermore, files can be attached to messages. These files may include, for example, PDF (Portable Document Format) files, image files, audio files, and video files. Files may be included as part of the message, or they may be included separately in message information. Alternatively, instead of including the file itself in the message or message information, information identifying the file (for example, a file name or URL (Uniform Resource Locator)) may be included in the message, allowing the receiving device to retrieve the file based on this information.

[0033] When the message processing unit 102 receives message information, it stores the received message information in the message information storage area 172. At this time, the message processing unit 102 may store attached files in the file storage area 174, or it may add predetermined information (for example, the date and time of receipt) to the message information.

[0034] (2) Sending a message The message processing unit 102 sends the message to the user who is the recipient of the message by sending the message information based on the recipient's information. The method of sending may be either so-called pull delivery or push delivery.

[0035] When performing pull distribution, for example, the message processing unit 102 receives a request from another device via the network communication unit 180 to retrieve a message containing the chat application ID, which is identification information. At this time, the message processing unit 102 retrieves message information containing the received chat application ID as the destination from the message information storage area 172 and transmits the retrieved message information to the device that sent the request to retrieve the message.

[0036] When performing push notifications, the device information corresponding to the chat application ID (for example, the device's serial number or IMEI (International Mobile Equipment Identifier)) is stored in the storage unit 170 in advance. Then, the message processing unit 102 obtains the device information corresponding to the chat application ID included as the destination of the received message information, and sends the received message information to the device corresponding to that device information.

[0037] In this way, the message processing unit 102 can send messages sent by users of the chat service to a device used by the recipient user by performing the processes of receiving, storing, and sending messages.

[0038] The collaboration processing unit 104 implements the collaboration service. In this embodiment, the collaboration processing unit 104 performs the following processes. (1) Processing of receiving information about the image (received image) received from the image communication device 30 (2) Process of posting a message regarding the received image from the image communication device 30 to the user. (3) Processing to receive instructions from the user to reply by facsimile. (4) Processing to instruct the image communication device 30 to send a fax based on instructions from the user via facsimile. (5) Process for obtaining the result of FAX transmission from the image communication device 30 (6) Process of posting a message containing the execution result from the image communication device 30 to the user.

[0039] In this embodiment, the image received by the image communication device 30 using facsimile communication is referred to as the received image (first image). In this embodiment, a reply means sending an image (second image) to the sender of the received image indicating that the received image has been received. In this embodiment, the image sent during a reply is referred to as the reply image.

[0040] The integration processing unit 104 enables message-based communication with the user by executing the processes described above, thereby making the server device 10 function as a so-called chatbot (Bot). Therefore, the server device 10 can be either the sender or recipient of messages in the chat service, and is assigned a chat application ID corresponding to the server device 10. In this embodiment, the chat application ID corresponding to the server device 10 is described as "CHATBOT".

[0041] The storage unit 170 stores various programs and data necessary for the operation of the server device 10. The storage unit 170 is composed of storage devices such as a semiconductor memory SSD (Solid State Drive) or an HDD (Hard Disk Drive).

[0042] The memory unit 170 is allocated a message information storage area 172, a file storage area 174 for storing files, and an address information storage area 176 as storage areas.

[0043] The message information storage area 172 is an area for storing message information. The message information includes, for example, as shown in Figure 3, the sender chat application ID (e.g., "CHATBOT"), which is the identification information of the user who sent the message; the recipient chat application ID (e.g., "0X00000001"), which is the identification information of the user to whom the message is sent; the date and time the message was sent (e.g., "July 16, 2019, 12:20:39 PM"); the message itself (e.g., "A fax has been received..."); and information about any files attached to the message.

[0044] The information about the file attached to the message may be the file itself, or it may be information indicating the location of the file stored in the file storage area 174 (e.g., file path, file name, URL, etc.).

[0045] The address information storage area 176 stores the contact information of the chat application user and information (address information) related to the image communication device 30 used by that user. The address information includes, for example, the user's name (e.g., "A"), the user's chat application ID (e.g., "0X00000001"), the telephone number (e.g., "00011112222"), fax number (e.g., "0012345678"), and address (e.g., "198.51.100.1") of the image communication device 30 used by that user, as shown in Figure 4.

[0046] The address is information used by the coordinating processing unit 104 to communicate with the image communication device 30, and indicates the location of the image communication device 30 on the network NW1. In this embodiment, it is explained that an IP (Internet Protocol) address is stored as the address. Note that the address may also store a MAC (Media Access Control) address, port number, server name, domain name, or a combination of these.

[0047] The NW communication unit 180 communicates with other devices such as terminal devices 20 and image communication devices 30 via LAN or WAN. The NW communication unit 180 is composed of communication devices and communication modules, such as NICs (Network Interface Cards) used in wired / wireless LANs.

[0048] [1.2.2 Terminal Devices] Referring to Figure 5, the functional configuration of the terminal device 20 in this embodiment will be described. As shown in Figure 5, the terminal device 20 is configured to include a control unit 200, a display unit 240, an operation unit 250, a storage unit 270, and an NW communication unit 280.

[0049] The control unit 200 is a functional unit for controlling the entire terminal device 20. The control unit 200 realizes various functions by reading and executing various programs stored in the storage unit 270, and is composed of one or more arithmetic units (e.g., CPUs).

[0050] The control unit 200 functions as a message acquisition unit 202, a message posting unit 204, and a timeline display control unit 206 by executing the chat application 272 stored in the memory unit 270.

[0051] The message acquisition unit 202 acquires messages from the server device 10. For example, the message acquisition unit 202 sends a request to the server device 10 to acquire a message via the network communication unit 280. The request to acquire a message includes the chat application ID of the user using the terminal device 20 as identification information. In response to the request to acquire a message, the message acquisition unit 202 receives message information from the server device 10 and stores the received message information in the message information storage area 274.

[0052] Furthermore, if a file is attached to the acquired message, the message acquisition unit 202 acquires the file and stores it in the file storage area 276.

[0053] The message posting unit 204 generates message information including the message entered by the user and posts it to the server device 10 via the NW communication unit 280. The message posting unit 204 includes the chat application ID of the user using the terminal device 20 as source information in the message information. The message posting unit 204 also includes the chat application ID of the person exchanging messages with the message as destination information in the message information. The person exchanging messages with the message is, for example, a user other than the user operating the terminal device 20, and a user displayed on the timeline displayed by the timeline display control unit 206. Furthermore, the message posting unit 204 stores the posted message information in the message information storage area 274 and stores any files attached to the posted message in the file storage area 276.

[0054] The timeline display control unit 206 displays a timeline on the display unit 240. A timeline is a display method that arranges messages chronologically based on date information such as the date and time of transmission. For example, the timeline display control unit 206 reads message information stored in the message information storage area 274 in which the chat application ID of another user selected by the user is stored as the recipient or sender. The timeline display control unit 206 then arranges the messages contained in the read message information chronologically based on the date and time of transmission and displays them on the display unit 240. The timeline display control unit 206 may also display information indicating the sender (for example, the sender's name), the date and time of transmission, and any files attached to the message, along with the message.

[0055] The display unit 240 displays various information. The display unit 240 is composed of a display device such as an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) panel, or a microLED (Light Emitting Diode) display.

[0056] The operation unit 250 is a functional unit for receiving operations from a user using the terminal device 20, and is composed of an input device such as a touch sensor. The method of detecting input in the touch sensor can be any common detection method, such as a resistive touch sensor, an infrared touch sensor, an electromagnetic induction touch sensor, or a capacitive touch sensor. The terminal device 20 may be equipped with a touch panel in which the display unit 240 and the operation unit 250 are integrally formed. Furthermore, the operation unit 250 may be composed of various operating devices such as a mouse or keyboard, as long as the user can input information.

[0057] The storage unit 270 stores various programs and data necessary for the operation of the terminal device 20. The storage unit 270 is composed of, for example, a storage device such as a semiconductor memory SSD or HDD.

[0058] The memory unit 270 stores the chat application 272 and further reserves a message information storage area 274 and a file storage area 276 for storing files as storage areas.

[0059] The chat application 272 is a program that causes the control unit 200 to function as a message acquisition unit 202, a message posting unit 204, and a timeline display control unit 206. Alternatively, the chat application 272 may be a program that causes the control unit 200 to implement common functions performed when using a chat service. Common functions include, for example, a function to display a screen on the display unit 240 that includes an area for displaying a timeline and an area for entering post content, an address book function for managing message recipients, and a function for grouping users.

[0060] The message information storage area 274 stores message information acquired by the message acquisition unit 202 and message information posted by the message posting unit 204. The message information stored in the message information storage area 274 includes, for example, the information shown in Figure 3.

[0061] The NW communication unit 280 communicates with other devices such as the server device 10 and the image communication device 30 via LAN or WAN. The NW communication unit 280 utilizes communication methods such as Ethernet (registered trademark) LAN, LTE (Long Term Evolution) / 4G / 5G, etc. The NW communication unit 280 is composed of, for example, a NIC used in wired / wireless LANs, and a communication module that can connect to LTE / LTE-A (LTE-Advanced) / LAA (License-Assisted Access using LTE) / 5G lines.

[0062] [1.2.3 Image Communication Device] Referring to Figure 6, the functional configuration of the image communication device 30 of this embodiment will be described. As shown in Figure 6, the image communication device 30 is configured to include a control unit 300, an image reading unit 320, an image forming unit 330, a display unit 340, an operation unit 350, a storage unit 370, an NW communication unit 380, and a line communication unit 390.

[0063] The control unit 300 is a functional unit for controlling the entire image communication device 30. The control unit 300 realizes various functions by reading and executing various programs stored in the storage unit 370, and is composed of one or more arithmetic units (e.g., CPUs).

[0064] The control unit 300 functions as a fax transmission / reception unit 302, a linkage processing unit 304, and an image processing unit 306 by executing a program stored in the storage unit 370.

[0065] The FAX transmission / reception unit 302 performs FAX transmission and reception. For example, the FAX transmission / reception unit 302 transmits the image of the document read by the image reading unit 320 to another device via a telephone line (network NW2) from the line communication unit 390. In the case of Internet FAX, the FAX transmission / reception unit 302 transmits the image to another device via a network such as the Internet (network NW1) from the network communication unit 380.

[0066] In other words, the FAX transmission / reception unit 302 transmits and receives images with other devices by using standard G3 / G4 standards or other facsimile communication methods, or by using Internet FAX. The FAX transmission / reception unit 302 can use any known standard or protocol to perform facsimile communication.

[0067] Furthermore, the FAX transmission / reception unit 302 receives images transmitted using facsimile communication via the NW communication unit 380 or the line communication unit 390. The FAX transmission / reception unit 302 stores the received images (received images) as files in the file storage area 372.

[0068] The files stored in the file storage area 372 are, for example, PDF files. However, the files stored in the file storage area 372 may also be in formats such as TIFF (Tagged Image File Format) or JPEG (Joint Photographic Experts Group). If the FAX transmission / reception unit 302 receives multiple images at once, it may store a file in the file storage area 372 in which each image is stored on a different page (a file consisting of multiple pages).

[0069] The integration processing unit 304 executes processing related to the integration service. For example, the integration processing unit 304 executes the following processing: (1) Process to send the information of the received image to the server device 10 (2) Process to receive a fax transmission instruction from the server device 10 and execute the fax transmission. (3) Process to send the results of the fax transmission to the server device 10

[0070] The image processing unit 306 performs various image-related processing. For example, the image processing unit 306 performs sharpening and grayscale conversion processing on the image read by the image reading unit 320.

[0071] The image reading unit 320 reads the document and stores the scanned image data as an image file. The image reading unit 320 is composed of, for example, a scanner device equipped with equipment that converts optical information such as a CIS (Contact Image Sensor) or CCD (Charge Coupled Device) into electrical signals, and reads the document placed on the mounting table of the image communication device 30. The image reading unit 320 also stores the scanned image data as an image file in the file storage area 372. The image reading unit 320 may also be composed of an interface (terminal) for reading images stored in a USB memory.

[0072] The image forming unit 330 forms (prints) an image onto a recording medium. The image forming unit 330 is composed of, for example, a laser printer using an electrophotographic method.

[0073] The display unit 340 displays various information. The display unit 340 is composed of a display device such as an LCD, an organic EL panel, or a microLED display.

[0074] The operation unit 350 is a functional unit for receiving operations from a user using the image communication device 30, and is composed of an input device such as a touch sensor. The method of detecting input in the touch sensor can be any common detection method, such as a resistive touch sensor, an infrared touch sensor, an electromagnetic induction touch sensor, or a capacitive touch sensor. The image communication device 30 may also be equipped with a touch panel in which the display unit 340 and the operation unit 350 are integrally formed.

[0075] The memory unit 370 stores various programs and data necessary for the operation of the image communication device 30. The memory unit 370 is composed of, for example, a storage device such as a semiconductor memory SSD or HDD.

[0076] The storage unit 370 reserves a file storage area 372 as a storage area. The storage unit 370 also stores address information 374, which is information about the user using the image communication device 30.

[0077] The file storage area 372 stores image files of images received by the FAX transmission / reception unit 302 and image files of documents read by the image reading unit 320.

[0078] Address information 374 is information about the user using the image communication device 30. In this embodiment, the storage unit 370 stores information such as the name 3742 of the user using the image communication device 30, the chat application ID 3744 corresponding to that user, the telephone number 3746 and fax number 3748 of the image communication device 30 as address information 374. The information stored as address information 374 is set, for example, by the user using the image communication device 30.

[0079] The NW communication unit 380 communicates with other devices such as the server device 10 and the terminal device 20 via a LAN or WAN. The NW communication unit 380 is composed of communication devices and communication modules, such as NICs used in wired / wireless LANs.

[0080] The communication unit 390 is capable of communicating with a telephone line and communicates with other devices via the telephone line. The communication unit 390 is composed of, for example, an interface (terminal) into which a cable for connecting to a telephone line can be inserted.

[0081] [1.3 Processing Flow] Next, the processes performed in the devices constituting System 1 will be explained with reference to Figures 7 to 9. In the explanation of the processing flow, it will be assumed that the address information storage area 176 already stores the address information of the user receiving the image.

[0082] [1.3.1 Image Communication Device] Referring to Figure 7, the processing flow of the image communication device 30 will be explained. First, when a user performs a fax transmission operation, the control unit 300 (fax transmission / reception unit 302) uses facsimile communication to send the chat application ID, which is identification information, and the image selected by the user to the destination specified by the user (step S102; Yes → step S104). In other words, the fax transmission / reception unit 302 performs the fax transmission process.

[0083] If the G3 protocol is used for facsimile communication, the chat application ID is transmitted, for example, by including it in the Transmitting Subscriber Identification (TSI). For example, in order to transmit the chat application ID, the FAX transmission / reception unit 302 reads the chat application ID 3744 from the storage unit 370 before performing a FAX transmission. Then, in step S104, the FAX transmission / reception unit 302 transmits a signal including the chat application ID 3744 to the image communication device 30, which is the destination of the image, via the network NW2. In addition to the chat application ID 3744, the FAX transmission / reception unit 302 may also transmit the name 3742, telephone number 3746, and FAX number 3748, which are stored in the storage unit 370, to the image communication device 30, which is the destination of the image.

[0084] When the FAX transmission / reception unit 302 performs the FAX reception process, the control unit 300 obtains the chat application ID transmitted using facsimile communication (step S106; Yes → step S108). For example, the control unit 300 obtains the chat application ID from the information transmitted as the sending terminal identification number by decoding the signal received by the FAX transmission / reception unit 302. The control unit 300 may also obtain information such as the name, telephone number, and FAX number of the user who sent the image.

[0085] Next, the control unit 300 (cooperation processing unit 304) transmits reception information to the server device 10 (step S110). The reception information is information indicating that a fax has been received and includes the following information.

[0086] (1) Received image file The received image file is the received image file received by the FAX transmission / reception unit 302 in step S106. The received image file is stored in the file storage area 372 when the FAX transmission / reception unit 302 receives a FAX, so the linkage processing unit 304 can obtain it by reading the stored file. (2) Information of the image communication device 30 that transmitted the image The information of the image communication device 30 that sent the image is the information received using facsimile communication in step S106. For example, the coordinating processing unit 304 includes the chat application ID obtained in step S108 in the received information as information of the image communication device 30 that sent the image. The coordinating processing unit 304 may also include the name, telephone number, and fax number of the image communication device 30 that sent the image in the received information.

[0087] In addition to the information described above, the coordinating processing unit 304 also includes the chat application ID of the user using the image communication device 30 that received the image, i.e., the chat application ID 3744, in the received information.

[0088] Next, the control unit 300 (cooperation processing unit 304) determines whether or not it has received a fax transmission instruction from the server device 10 (step S112). In this embodiment, the fax transmission instruction includes information about the image to be transmitted using facsimile communication and the destination of the image.

[0089] When a fax transmission instruction is received, the control unit 300 (cooperation processing unit 304) performs a fax transmission of the image included in the fax transmission instruction to the recipient indicated by the recipient information (e.g., fax number) of the image included in the fax transmission instruction (step S112; Yes → step S114).

[0090] Next, the control unit 300 (cooperation processing unit 304) acquires the result of the FAX transmission in step S114 and sends the acquired result to the server device 10 (step S116).

[0091] For example, if the fax transmission process in step S114 is completed successfully, the linkage processing unit 304 sends information indicating successful completion as a result of the fax transmission to the server device 10. On the other hand, if the fax transmission process in step S114 is not completed successfully, the linkage processing unit 304 sends information indicating abnormal termination as a result of the fax transmission to the server device 10.

[0092] The situations in which the FAX transmission process does not complete successfully include cases where the FAX transmission job does not complete after a certain period of time has elapsed, or where FAX transmission itself is impossible. Cases where the FAX transmission job does not complete after a certain period of time include, for example, when a large number of FAX transmissions are scheduled on the sending image communication device 30 or the receiving image communication device 30, or when some kind of trouble occurs, making it impossible to send or receive a FAX. Cases where FAX transmission itself is impossible include cases where the telephone line to the recipient is busy, or when information indicating an error / busy termination is received from the receiving image communication device 30.

[0093] In other words, if a fax transmission job remains pending for a certain period of time, the coordination processing unit 304 sends information indicating abnormal termination as a result of the fax transmission to the server device 10. However, if fax transmission itself is impossible, the coordination processing unit 304 may send information indicating abnormal termination to the server device 10 without waiting for a certain period of time to elapse.

[0094] [1.3.2 Server Equipment] Referring to Figure 8, the processing flow of the server device 10 will be explained. First, the control unit 100 (cooperation processing unit 104) determines whether or not it has received received information from the image communication device 30 via the NW communication unit 180 (step S122).

[0095] When received information, the control unit 100 (cooperation processing unit 104) stores the information of the image communication device 30 that transmitted the image, which is included in the received information, in the address information storage area 176 (step S122; Yes → step S124). If the address information storage area 176 already contains information similar to the information of the image communication device 30 that transmitted the image, the cooperation processing unit 104 may skip the processing in step S124 or update the information to the information included in the received information.

[0096] Next, the control unit 100 (cooperation processing unit 104) notifies the user using the image communication device 30 that the FAX has been received that the image has been received (step S126). For example, the cooperation processing unit 104 performs the following processing.

[0097] (1) File storage The coordinating processing unit 104 stores the file (the received image file) included in the received information in the file storage area 174. (2) Obtaining the recipient of the message The integration processing unit 104 obtains the chat application ID of the user using the image communication device 30 that received the image from the received information. This enables the integration processing unit 104 to post a message to the user using the image communication device 30 that received the image. (3) Generating and posting message information The linking processing unit 104 generates message information with the source set to "CHATBOT" and the destination set to the chat application ID of the user using the image communication device 30 that received the image, and attaches the file stored in (1). The linking processing unit 104 may also include text in the message indicating that an image has been received, and text indicating information about the received image (for example, the name of the sender of the received image, fax number, file name, file size, number of pages of the received image, etc.). The message may also include information to display a button that allows the user to choose whether or not to reply.

[0098] Furthermore, the coordinating processing unit 104 posts the generated message information. In this embodiment, since a message information storage area 172 is reserved in the storage unit 170, the coordinating processing unit 104 does not need to transmit the generated message information to another device, but rather needs to store the generated message information in the message information storage area 172.

[0099] The message information stored in this manner is acquired by the terminal device 20 corresponding to the user using the image communication device 30 that received the image. This allows the user using the image communication device 30 that received the image to confirm that they have received the image by looking at the terminal device 20.

[0100] Next, the control unit 100 (cooperation processing unit 104) determines whether or not it has received an instruction to reply by facsimile from the terminal device 20 via the NW communication unit 180 (step S128). The instruction to reply by facsimile includes information that can identify the received image to be replied to. This information that can identify the received image is, for example, information that identifies the message posted in step S126 (for example, message ID or other information that can identify the message) or information that identifies the file attached to the message posted in step S126 (for example, file name). The instruction to reply by facsimile may be sent by message, or by a predetermined command or API (Application Programming Interface).

[0101] When the terminal device 20 receives an instruction to reply by facsimile, the control unit 100 (cooperation processing unit 104) sends an instruction to the image communication device 30 to send a fax (step S128; Yes → step S130). Specifically, the cooperation processing unit 104 performs the following processing. (1) Generating a reply image The linking processing unit 104 reads a file containing the received image to be replied to from the file storage area 174, based on information that allows it to identify the received image to be replied to. Then, the linking processing unit 104 generates a reply image based on the read file. The reply image is, for example, an image with text indicating that the received image has been received added to the first page of the received image. (2) Obtaining the recipient of the reply image In step S122, the integration processing unit 104 receives information about the image communication device 30 used by the user when sending the received image (for example, a fax number) based on the received information, which includes the file of the received image that is the target of the reply. If the received information received in step S122 includes a fax number, the integration processing unit 104 only needs to obtain that fax number. If the received information received in step S122 includes the chat application ID of the user who sent the received image, the integration processing unit 104 reads the address information in which the chat application ID is stored from the address information storage area 176. Then, the integration processing unit 104 obtains the fax number stored in the read address information.

[0102] The linking processing unit 104 may read message information from the message information storage area 172 of the message to which the received image to be replied to is attached, which is identified from information that can identify the received image to be replied to, and obtain the destination for the reply image based on the read message. In this case, if the message stored in the read message information contains a fax number, the linking processing unit 104 will obtain that fax number as the destination for the reply image. If the message contains the sender's name, the linking processing unit 104 may read address information containing the sender's name from the address information storage area 176 and obtain the fax number stored in the read address information as the destination for the reply image. (3) Obtaining the recipient of the fax transmission instruction The coordinating processing unit 104 reads the address information stored in the address information storage area 176, which contains the chat application ID acquired in step S126, and obtains the address of the image communication device 30 stored in the read address information. This identifies the image communication device 30 to which the fax transmission will be sent. (4) Sending instructions for sending a fax The coordinating processing unit 104 sends a fax transmission instruction, including the destination information for the reply image generated in (1) and the reply image acquired in (2), to the image communication device 30 identified by the address obtained in (3) via the network communication unit 180.

[0103] The reply image included in the FAX transmission instruction is transmitted by the FAX transmission / reception unit 302 of the image communication device 30 to the image communication device 30 that will receive the reply image, through the process shown in step S114 in Figure 7.

[0104] Next, the control unit 100 (cooperation processing unit 104) receives the result of the FAX transmission based on the instruction to reply by facsimile that was sent in step S130 from the image communication device 30 via the NW communication unit 180 (step S132).

[0105] Next, the control unit 100 (cooperation processing unit 104) determines whether the result of the FAX transmission received in step S132 is information indicating successful completion (step S134).

[0106] If the FAX transmission is not completed successfully, the control unit 100 (cooperation processing unit 104) posts a message to the user using the image communication device 30 that received the image from the server device 10, asking whether or not to send a message reply (step S134; No → step S136). The message posted in step S136 may include information to display a button that allows the user to select whether or not to send a message reply. In step S136, as in step S126, the cooperation processing unit 104 generates message information including a message asking whether or not to send a message reply, and stores the generated message information in the message information storage area 172.

[0107] Next, the control unit 100 (cooperation processing unit 104) determines whether or not it has received an instruction from the terminal device 20 to send a message reply via the NW communication unit 180 (step S138). The instruction to send a message reply may be sent by message, similar to the instruction to send a facsimile reply in step S128, or it may be sent by a predetermined command or API.

[0108] When an instruction to reply via message is received, the control unit 100 (cooperation processing unit 104) posts a message containing the reply image (reply message) from the server device 10 to the user who sent the received image (step S138; Yes → step S140). For example, the cooperation processing unit 104 performs the following processing. (1) Generating a reply image The linking processing unit 104 reads the file containing the received image to be replied to from the file storage area 174, similar to the processing in step S130. The linking processing unit 104 then generates a reply image by reducing the size of the image on the first page of the read file. The linking processing unit 104 may also use an image as the reply image in which an image such as text indicating receipt or a stamp is superimposed on the received image to be replied to. (2) Obtaining the recipient of the message The collaborative processing unit 104 obtains the chat application ID of the user who sent the received image from the received information received in step S122. (3) Generating and posting reply messages The linkage processing unit 104 uses the chat application ID obtained in (2) as the destination, generates message information for a message (reply message) with the reply image generated in (1) attached, and stores (posts) it in the message information storage area 172.

[0109] The message information stored in the message information storage area 172 through the above process is acquired by the terminal device 20 of the user who sent the received image. As a result, the user who sent the received image can know, via message, that the received image has been received and that the received image has been received by the recipient user.

[0110] Furthermore, if the fax transmission is successfully completed in step S134, the linkage processing unit 104 may post a message to the user who sent the instruction to reply by fax from the server device 10 indicating that the fax reply has been completed (step S134; Yes).

[0111] [1.3.3 Terminal Devices] Referring to Figure 9, the processing flow of the terminal device 20 will be explained. First, the control unit 200 (message acquisition unit 202) acquires the message (step S182). Then, the control unit 200 (timeline display control unit 206) displays the acquired message on the timeline (step S184). As a result, the message posted by the server device 10 shown in Figure 8 is displayed on the display unit 240.

[0112] The message displayed on the display unit 240 is as follows: (1) Message notifying the receipt of an image This is the message posted when the process in step S126 of Figure 8 is executed. (2) A message asking whether or not to reply via message. This is the message posted when the process in step S136 of Figure 8 is executed. (3) Messages including images for reply This is the reply message that is posted when the process in step S140 of Figure 8 is executed.

[0113] Of these, messages (1) and (2) are displayed on the terminal device 20 used by the user who received the received image (the first user). On the other hand, the reply message shown in (3) is displayed on the terminal device 20 used by the user who sent the received image (the second user). The reply image attached to the reply message is displayed on the timeline by the timeline display control unit 206.

[0114] Next, the control unit 200 determines whether or not the user has instructed a reply by facsimile (step S186). For example, in step S184, the timeline display control unit 206 displays a message notifying the receipt of the image, along with a button indicating that a reply by facsimile should be sent. At this time, if the button indicating that a reply by facsimile should be sent is selected, the control unit 200 determines that the user has instructed a reply by facsimile.

[0115] If an instruction to reply by facsimile is given, the control unit 200 sends an instruction to reply by facsimile to the server device 10 via the NW communication unit 280 (step S186; Yes → step S188). At this time, the control unit 200 sends to the server device 10 the instruction to reply by facsimile, along with information that can identify the received image to be replied to (for example, the message ID and the file name of the file attached to the message). If a reply by facsimile cannot be made, the server device 10 executes step S136 of the main process shown in Figure 8, and posts a message asking whether or not to reply by message. In this case, in step S184, the timeline display control unit 206 displays a button indicating whether or not to reply by message, along with the message asking whether or not to reply by message.

[0116] Next, the control unit 200 determines whether or not the user has instructed the user to reply via message (step S190). For example, the control unit 200 determines that the user has instructed the user to reply via message if the button indicating to reply via message displayed on the timeline is selected.

[0117] If a message reply operation is performed, the control unit 200 sends an instruction to the server device 10 to reply via the NW communication unit 280 (step S190; Yes → step S192).

[0118] [1.4 Example of Operation] Referring to Figure 10, an example of operation of this embodiment will be described. In the description of the operation example, the user who first sends the image will be referred to as the second user, and the user who receives the image will be referred to as the first user. The operation example will be described below in the order of the numbers shown in Figure 10.

[0119] (1) Send the image and chat app ID First, the second user transmits an image to the first user using the second communication device, image communication device 30b (the receiving device), which is the second communication device used by the second user. At this time, the image communication device 30b used by the second user transmits the image data and chat application ID of the image it has read to the first communication device, image communication device 30a, used by the first user, using facsimile communication.

[0120] (2) Transmission of received information The image communication device 30a (own device) sends the received image file, the chat application ID of the second user, and the chat application ID of the first user to the server device 10 as received information.

[0121] (3) Storing address information The server device 10 stores address information, including the chat application ID of the second user, which is included in the received information, in the address information storage area 176.

[0122] (4) Posting a message Server device 10 posts a message to the first user notifying them of the image's receipt. Terminal device 20a (first terminal device) used by the first user retrieves the message and displays it on the timeline.

[0123] This section describes the display screen W100 when a message indicating the receipt of an image is displayed on the timeline. As shown in the display screen W100 of Figure 10, the timeline displays message M100, which notifies the user of the image's receipt, and message M102, which contains the received image. The user can confirm the received image by looking at message M102. Below message M102, a button is displayed to select whether or not to send a reply by facsimile. The user can instruct a facsimile reply to the received image by selecting button B100 to send a reply by facsimile.

[0124] (5) Sending instructions for a reply by facsimile, (6) Sending instructions for sending a fax. If button B100 is selected, terminal device 20a sends a fax reply instruction to server device 10. Server device 10 sends a fax transmission instruction to image communication device 30a used by the first user. The fax transmission instruction includes a reply image.

[0125] (7) Fax transmission, (8) Anomaly detection, (9) Transmission of transmission results The image communication device 30a sends a reply image via fax based on the fax transmission instruction. If it detects that the fax transmission did not complete successfully, the image communication device 30a sends information indicating the abnormal termination as a result of the fax transmission to the server device 10.

[0126] (10) Posting a message asking whether or not to reply via message Server device 10 posts a message to the first user asking whether or not to reply via message. Terminal device 20a used by the first user retrieves the message and displays it on its timeline.

[0127] This section describes the display screen W110 when a message asking whether or not to reply via message appears on the timeline. As shown in the display screen W110 of Figure 10, the timeline displays message M110, which includes a message indicating that the reply via fax is not yet complete and asking whether or not to reply using the chat application (message). By viewing message M110, the user can confirm that the reply via fax is not yet complete. Message M110 also displays buttons for selecting whether or not to reply via message. The user can instruct to reply via message by selecting button B110 to reply via message.

[0128] (11) Sending instructions to reply via message If button B110 is selected, terminal device 20a sends a message instruction to server device 10 to reply.

[0129] (12) Posting a message Based on the instruction to reply via message, the server device 10 posts a message (reply message) containing a reply image to the second user. The terminal device 20b used by the second user (second terminal device) retrieves the reply message and displays it on its timeline.

[0130] The display screen W120 shown on the display unit 240 of the terminal device 20b used by the second user will now be described. As shown in the display screen W120 of Figure 10, the timeline displays message M120, which includes the reply image E120. The second user can confirm that the image has been received by the first user by viewing message M120.

[0131] In this embodiment, the reply image is described as being generated by the server device 10, but it may also be generated by the terminal device 20 or the image communication device 30. The device that generates the reply image should be determined, for example, according to the capabilities of each device, the content of the services provided by the server device 10, and the capabilities of the chat application.

[0132] For example, when terminal device 20 generates a reply image, in step S188 of Figure 9, when it sends a facsimile reply instruction to server device 10, the control unit 200 generates a reply image based on the file attached to the message notifying the reception of the image. Then, the control unit 200 includes the generated reply image in the facsimile reply instruction and sends it to server device 10. In this case, when the control unit 200 executes the process in step S192 of Figure 9, the control unit 200 sends the reply image generated in step S188 along with the message reply instruction to server device 10.

[0133] Furthermore, when terminal device 20 generates a reply image, if the user instructs it to reply via message, terminal device 20 may post a message addressed to the user who sent the received image. Specifically, in step S126, server device 10 also sends the chat application ID included in the received information received in step S122 to terminal device 20. The chat application ID may be sent from server device 10 to terminal device 20 in the message, or it may be sent separately from the message. When terminal device 20 receives instructions from the user to reply via message, it posts a reply message. Specifically, it sends the message information of the message with the reply image attached to server device 10, using the chat application ID received from server device 10 as the destination and the chat application ID of the user using terminal device 20 as the sender. In this way, the message with the reply image attached will be received by terminal device 20 used by the user who sent the received image, and the reply image will be displayed by terminal device 20.

[0134] Furthermore, when the image communication device 30 generates a reply image, in step S130 of Figure 8, the cooperation processing unit 104 of the server device 10 sends a fax transmission instruction that includes information that can identify the received image to be replied to. In step S114, the cooperation processing unit 304 of the image communication device 30 reads a file corresponding to the information that can identify the received image from the file storage area 372. Then, the cooperation processing unit 304 can generate a reply image based on the read image.

[0135] Furthermore, although this embodiment describes the server device 10 as providing the chat service and the collaboration service, the chat service and the collaboration service may be run on separate servers, or they may be run as separate services. For example, the provider of System 1 may provide only the collaboration service, and use an existing service for the chat service. Even in this case, the collaboration processing unit 104 will behave as a chatbot in the chat service. Therefore, it is possible to receive instructions from the user via messages between the terminal device 20 and the server device 10 through the chat service.

[0136] In this embodiment, it was explained that the second communication device, the image communication device, transmits the chat application ID along with the image, and the first communication device, the image communication device, which receives the image, obtains the chat application ID of the user who sent the image. However, other methods may be used to obtain the chat application ID of the user who sent the image. For example, the terminal device 20 may store an address book containing the chat application IDs, names, telephone numbers, and fax numbers of other users, and the address information stored in the server device 10 may be linked with the address book stored in the terminal device 20. In this case, the server device 10 only needs to identify the corresponding chat application ID from the name and fax number of the user who sent the image. Alternatively, the chat application registration information (e.g., chat application ID, name, fax number, etc.) may be stored in advance as address information, and the server device 10 only needs to identify the corresponding chat application ID from the name and fax number of the user who sent the image.

[0137] Furthermore, although this embodiment describes a process where, if a reply cannot be sent by fax, the user is asked whether or not to send a message reply, the process may be performed automatically without asking the user whether or not to send a message reply.

[0138] Furthermore, although this embodiment has been described as including a linkage processing unit 304 in the image communication device 30, it is also possible to provide a separate device (linkage device) capable of executing the processing performed by the linkage processing unit 304, instead of including the linkage processing unit 304 in the image communication device 30.

[0139] In this case, the image communication device 30 communicates with the cooperating device and performs the same processing as described in this embodiment. For example, when the image communication device 30 receives an image, it transmits the information of the received image to the cooperating device. The cooperating device transmits the received information based on the received image to the server device 10. Furthermore, when the cooperating device receives an instruction from the server device 10 to reply by facsimile, it controls the image communication device 30 to perform a FAX transmission based on the instruction to reply by facsimile, and obtains the result of the FAX transmission from the image communication device 30.

[0140] According to this embodiment, when a user issues a fax reply via a chat application, they can send a message reply even if the image communication device experiences problems such as the job being held up for a certain period of time. Therefore, when a fax reply is issued from a chat application, if the fax transmission job remains unfinished for any reason for a certain period of time, a reply indicating that the image has been received can be sent to the recipient's chat application.

[0141] [2. Second Embodiment] Next, the second embodiment will be described. Unlike the first embodiment, the second embodiment is an embodiment in which the image communication device has the function of acquiring and posting messages. In this embodiment, Figure 2 of the first embodiment is replaced with Figure 11, Figure 6 of the first embodiment with Figure 12, and Figure 7 of the first embodiment with Figure 13. The same reference numerals are used for the same functional parts and processes, and their descriptions are omitted.

[0142] In the system of this embodiment, in system 1 shown in Figure 1, the server device 10 is replaced with the server device 12 shown in Figure 11, and the image communication device 30 is replaced with the image communication device 32 shown in Figure 12.

[0143] Referring to Figure 11, the functional configuration of the server device 12 in this embodiment will be described. Unlike the server device 10, the control unit 100 of the server device 12 does not include a cooperation processing unit 104. Furthermore, the storage unit 170 is provided with a registration information storage area 178 for storing registration information, which includes the chat application ID of the chat service user and information about the user (for example, user attribute information such as username, and authentication information such as account name and password). In other words, the server device 12 in this embodiment provides only a chat service.

[0144] Referring to Figure 12, the functional configuration of the image communication device 32 in this embodiment will be described. Unlike the image communication device 30, the image communication device 32 further includes a message acquisition unit 308 and a message posting unit 310 in the control unit 300. In addition, the storage unit 370 has an address information storage area 376 where the user's chat application ID 378 is stored.

[0145] Furthermore, in this embodiment, the image communication device 32 behaves as a chatbot (Bot). Therefore, the image communication device 32 is pre-configured with a chat application ID for exchanging messages with the image communication device 32, and this is stored as the device's chat application ID 378.

[0146] The message acquisition unit 308 acquires a message destined for the image communication device 32 from the server device 12 via the network communication unit 380. The message acquisition unit 308 performs the same processing as the message acquisition unit 202.

[0147] The message posting unit 310 generates message information including a message for a user using the image communication device 32, and posts the generated message information via the network communication unit 380.

[0148] The processing flow in this embodiment will now be described. In this embodiment, the processing flow of the terminal device 20 is the same as in Figure 9 in the first embodiment. The server device 12 executes the processing performed by the message processing unit 102 described in the first embodiment.

[0149] Next, with reference to Figure 13, the processing flow of the image communication device 32 in this embodiment will be explained. In this embodiment, if the FAX reception processing is performed by the FAX transmission / reception unit 302 in step S106, the control unit 300 stores address information (step S106; Yes → step S202). For example, the control unit 300 stores address information, including information such as name, chat application ID, FAX number, and telephone number, transmitted by facsimile communication, in the address information storage area 376.

[0150] Next, the control unit 300 notifies the user using the image communication device 30 that the fax has been received that the image has been received (step S204). For example, the message posting unit 310 posts a message from the image communication device 30 to the user of the image communication device 30, attaching the received image file received in step S106.

[0151] Furthermore, if the control unit 300 receives a facsimile reply instruction from the terminal device 20, it will perform a fax transmission based on the received facsimile reply instruction (step S206; Yes → step S208). For example, based on information that allows identification of the received image to be replied to, which is included in the facsimile reply instruction, the control unit 300 reads the received image to be replied to, which is included in the facsimile reply instruction, from the file storage area 372. Then, the control unit 300 generates a reply image based on the read image data. Also, based on the information of the image communication device 30 that sent the received image, which was acquired in step S106, the control unit 300 obtains information on the destination of the reply image. The fax transmission / reception unit 302 transmits the reply image by fax based on the information on the destination of the reply image.

[0152] Next, the control unit 300 determines whether or not the FAX transmission was completed successfully (step S210). If the FAX transmission was not completed successfully, the control unit 300 (message posting unit 310) posts a message from the image communication device 30 to the user of the image communication device 30, asking the user to reply with a message (step S210; No → step S212).

[0153] Next, the control unit 300 determines whether or not it has received an instruction to reply by message from the terminal device 20 (step S214). If it has received an instruction to reply by message, the control unit 300 (message posting unit 310) posts a message including a reply image (step S214; Yes → step S216). For example, the message posting unit 310 generates a reply image based on the received image read in step S208. The message posting unit 310 also obtains the chat application ID received in step S106, that is, the chat application ID of the user who sent the received image. The message posting unit 310 posts a message including a reply image to the user who sent the received image from the image communication device 30.

[0154] Through the process described above, even if a user who receives an image is unable to send a reply image via facsimile communication, they can still send a message to the user who sent the image that includes a reply image based on the received image.

[0155] According to this embodiment, when a user receives an image via facsimile communication, they can use an existing chat service to reply with a message.

[0156] [3. Third Embodiment] Next, a third embodiment will be described. The third embodiment is an embodiment that allows users who respond to a message received in a chat application to choose whether or not to respond using the chat application. This embodiment can be applied to either the first or second embodiment, but the case where it is applied to the first embodiment will be described. In the description of this embodiment, the user who receives the received image will be referred to as the first user, and the user who sends the received image will be referred to as the second user.

[0157] In this embodiment, when the control unit 100 receives an instruction to reply by facsimile in step S128 in Figure 8, it determines whether or not the chat application ID of the second user is stored in the address information storage area 176. In this embodiment, even when the control unit 100 receives an instruction to reply by facsimile, it does not send an instruction to send a fax to the image communication device 30, but sends an instruction to send a fax to the image communication device 30 when it receives an instruction to execute a facsimile reply, as described later.

[0158] If the chat application ID of the second user is stored, the control unit 100 (cooperation processing unit 104) posts a message from the server device 10 to the first user, instructing the first user to choose either to reply by fax or by message.

[0159] The control unit 200 of the terminal device 20 transmits information indicating the reply method selected by the first user to the server device 10 via the NW communication unit 280. Specifically, if the user selects to reply by facsimile, the control unit 200 sends an instruction to the server device 10 to perform a facsimile reply. On the other hand, if the user selects to reply by message, the control unit 200 sends an instruction to the server device 10 to reply by message.

[0160] When the control unit 100 (cooperation processing unit 104) receives an instruction from the terminal device 20 to send a reply by facsimile, it executes a process to send a FAX transmission instruction to the image communication device 30 (step S130 in Figure 8). On the other hand, when the control unit 100 (cooperation processing unit 104) receives an instruction from the terminal device 20 to send a reply by message, it executes a process to post a message containing a reply image from the server device 10 to the second user (step S140 in Figure 8).

[0161] As a result of the process described above, the first user will be able to choose whether to reply to the second user, who is capable of replying via message, by fax or by message.

[0162] If the chat application ID of the second user is not stored, for example, the control unit 100 (cooperation processing unit 104) can post a message from the server device 10 to the first user asking whether or not to reply by fax.

[0163] An example of operation in this embodiment will be described with reference to Figure 14. The display screen W300 shown in Figure 14 is a diagram showing the timeline displayed on the terminal device 20a used by the first user. The display screen W300 in Figure 14 is similar to the display screen W100 shown in Figure 10.

[0164] If the user selects button B300 to send a reply by facsimile, a facsimile reply instruction is sent from terminal device 20a to server device 10 (Figure 14 (5)). Server device 10 determines whether the second user's chat application ID is stored in address information storage area 176 (Figure 14 (5a)), and posts a message based on the determination (Figure 14 (5b)).

[0165] If the server device 10 has the chat application ID of the second user stored, when the first user selects button B300 to reply by facsimile, display screen W310 is shown, which displays a timeline including message M310 for selecting the reply method.

[0166] The user can choose either button B310 to reply by message or button B312 to initiate a reply by fax.

[0167] If the user selects button B310 to send a message reply, the terminal device 20a sends a message reply instruction to the server device 10 (Figure 14 (11)). As a result, the server device 10 sends a message including a reply image to the second user (Figure 14 (12)).

[0168] If the user selects button B312 to instruct the system to send a reply by facsimile, the terminal device 20a sends an instruction to the server device 10 to send a reply by facsimile (Figure 14 (5c)). Based on the instruction to send a reply by facsimile, the server device 10 sends a request to the image communication device 30a to send a fax (Figure 14 (6)). This allows the image communication device 30a to send a reply image to the image communication device 30b using facsimile communication.

[0169] When this embodiment is applied to the second embodiment, the control unit 300 of the image communication device 30, in step S206 of Figure 13, determines whether the chat application ID of the second user is stored in the address information storage area 376 when it receives an instruction from the user to reply by facsimile. If the chat application ID of the second user is stored, the message posting unit 310 posts a message from the image communication device 30 to the first user, allowing the first user to choose either to reply by facsimile or by message.

[0170] If the first user chooses to reply by facsimile, the control unit 300 executes the process in step S208 in Figure 13. On the other hand, if the user chooses to reply by message, the control unit 300 executes step S216 in Figure 13.

[0171] According to this embodiment, when responding to a received image, if the user does not wish to receive a response by facsimile, they can respond by message.

[0172] [4. Fourth Embodiment] Next, the fourth embodiment will be described. The fourth embodiment is an embodiment that allows a user who is responding to a received message in the chat application to choose whether or not to respond using the chat application without instructing the image communication device to send a fax. This embodiment can be applied to either the first or second embodiment, but the case where it is applied to the first embodiment will be described. In the description of this embodiment, the user who receives the received image will be referred to as the first user, and the user who sends the received image will be referred to as the second user.

[0173] In this embodiment, after step S126 in Figure 8, the control unit 100 determines whether the chat application ID of the second user is stored in the address information storage area 176. If the chat application ID of the second user is stored in the address information storage area 176, the control unit 100 (cooperation processing unit 104) further posts a message from the server device 10 to the first user, prompting the user to choose whether or not to reply via message.

[0174] If the user chooses to reply via message, the control unit 100 of the server device 10 executes the process of posting a message containing the reply image (step S140 in Figure 8). If the user does not choose to reply via message, the control unit 100 (cooperation processing unit 104) should post a message from the server device 10 to the first user asking whether or not to reply via facsimile. Based on the user's selection, the control unit 100 should execute the process of sending the reply image via facsimile communication.

[0175] An example of operation in this embodiment will be described with reference to Figure 15. After storing the address information, the server device 10 determines whether or not the chat application ID of the second user is stored in the address information storage area 176 (Figure 15 (3a)). If the chat application ID is stored, the server device 10 posts a message to the first user from the server device 10 indicating that the FAX reception process has been executed (Figure 15 (4)) and a message inquiring whether or not to reply by message (Figure 15 (4a)).

[0176] The display screen W400 shown in Figure 15 is a diagram showing the timeline displayed on the terminal device 20a used by the first user. The display screen W400 in Figure 15 displays messages M400 and M402 indicating that the FAX reception process has been executed, and message M404 asking whether or not to reply by message. The timeline also displays a button B400 that instructs to reply by message and a button B402 that instructs not to reply by message. If the user selects button B400, the server device 10 posts a message with an attached reply image to the second user as the recipient.

[0177] When this embodiment is applied to the second embodiment, the control unit 300 of the image communication device 32 only needs to determine whether the chat application ID of the second user is stored in the address information storage area 376 after storing the address information. If the chat application ID of the second user is stored, the control unit 300 posts a message to the first user as the recipient, asking whether or not to reply by message. Based on the selection made by the user, the control unit 300 can send the reply using a message or facsimile communication.

[0178] According to this embodiment, after the user confirms a message indicating that an image has been received, they can then instruct the system to reply via message.

[0179] [5. Fifth Embodiment] Next, the fifth embodiment will be described. The fifth embodiment is an embodiment that enables the automatic sending of a confirmation of receipt using the chat application (message) when a confirmation of receipt is sent using the chat application. In the description of this embodiment, the user who received the received image will be referred to as the first user, and the user who sent the received image will be referred to as the second user.

[0180] This embodiment can be applied to either the first or second embodiment. In this embodiment, one of the server device 10, terminal device 20, or image communication device 32 stores information indicating whether or not the user has instructed a reply via message, and performs the following processing.

[0181] (1) When the control unit 100 (cooperation processing unit 104) of the server device 10 receives information from the image communication device 32, it further determines whether or not information indicating that the user has instructed a reply by message is stored. If information indicating that the user has instructed a reply by message is stored, the control unit 100 (cooperation processing unit 104) posts a message containing a reply image from the server device 10 to the second user. The control unit 100 (cooperation processing unit 104) also posts a message from the server device 10 to the first user indicating that a reply by message has been sent.

[0182] (2) When the control unit 100 of the terminal device 20 receives a message notifying it of the receipt of an image, it further determines whether or not information indicating that the user has instructed it to reply by message is stored. If information indicating that the user has instructed it to reply by message is stored, the control unit 100 sends an instruction to reply by message to the server device 10. The control unit 100 (timeline display control unit 206) also displays a message on the timeline indicating that a reply has been made by message.

[0183] (3) When the image communication device 32 performs the processing of receiving a fax, it determines whether or not it has stored information indicating that the user using the image communication device 32 that received the image has instructed it to reply by message. If it has stored information indicating that the user has instructed it to reply by message, the control unit 300 (message posting unit 310) posts a message containing the reply image from the image communication device 32 to the second user. The control unit 300 (message posting unit 310) also posts a message from the image communication device 32 to the first user indicating that it has sent a reply by message.

[0184] By performing the above process, the message containing the reply image is retrieved and displayed on the terminal device 20b used by the second user. Additionally, a message indicating that the message containing the reply image has been posted is retrieved and displayed on the terminal device 20a used by the first user.

[0185] An example of operation in this embodiment will be described with reference to Figure 16. The display screen W500 shown in Figure 16 is a diagram showing the timeline displayed on the terminal device 20a used by the first user. It is assumed that the first user had previously sent a reply acknowledging receipt using the chat application.

[0186] The display screen W500 in Figure 16 shows messages M500 and M502 indicating that the fax reception process has been executed, and message M504 indicating that an automatic confirmation reply has been sent using the chat application. The user can confirm that a message reply has been sent by checking message M504.

[0187] Furthermore, users may be able to configure whether or not to automatically send a confirmation reply using a chat application (messaging app).

[0188] According to this embodiment, the user does not need to perform an operation to reply by sending a message; a reply will be sent automatically via message.

[0189] [6. Sixth Embodiment] Next, the sixth embodiment will be described. The sixth embodiment is an embodiment that makes it possible to notify the user who sent the image of additional information such as service information. This embodiment can be applied to either the first or second embodiment, but the case in which it is applied to the first embodiment will be described. In the description of this embodiment, the user who received the received image will be referred to as the first user, and the user who sent the received image will be referred to as the second user.

[0190] In this embodiment, the server device 10 stores in the storage unit 170 a setting (service information notification) indicating whether or not to send a message containing service information to the user who sent the image, and the content of the notification, for each user using the collaborative service.

[0191] Furthermore, after sending a reply to the second user, the control unit 100 determines whether the first user has turned on service information notifications and whether the second user's chat application ID is stored in the address information storage area 176.

[0192] If the first user's service information notification is turned ON and the second user's chat application ID is stored in the address information storage area 176, the server device 10 prompts the first user to choose whether or not to notify the second user of service information. Specifically, the control unit 100 (cooperation processing unit 104) posts a message from the server device 10 to the first user asking whether or not to notify them of service information. If the first user chooses to notify the service information, the control unit 100 (cooperation processing unit 104) posts a message containing the service information from the server device 10 to the second user. The message containing the service information, including a reply image, is received and displayed by the terminal device 20b used by the second user.

[0193] This process allows the chat application ID of a second user, transmitted and received via facsimile communication, to be used not only for replies but also for sending service information.

[0194] An example of operation in this embodiment will be described with reference to Figure 17. The display screen W600 shown in Figure 17 is a diagram showing the timeline displayed on the terminal device 20a used by the first user. The display screen W600 in Figure 17 displays a button B600 that instructs the user to send a message reply, and when the user selects button B600, a reply is sent to the second user (Figure 17 (5) to (7)).

[0195] If the service information notification setting is ON on the server device 10 and the chat application ID of the second user is stored, a message M610 is displayed on the timeline, as shown on the display screen W610 in Figure 17, allowing the user to choose whether or not to notify the service information. If the first user selects button B610 to indicate that they want to notify the service information, an instruction to notify the service information is sent from the terminal device 20a to the server device 10 (Figure 17 (14)).

[0196] When the server device 10 receives an instruction to notify the second user of service information, the server device 10 posts a message containing the service information to the second user. This message is received and displayed by the terminal device 20b used by the second user as a message including a reply image (Figure 17 (15)).

[0197] For example, as shown in the display screen W620 of Figure 17, the message M620 containing service information is displayed on the timeline on the display unit 240 of the terminal device 20b used by the second user. The second user can learn about the service information by checking the message M620.

[0198] Furthermore, service information may be automatically notified to the second user if service information notifications are turned ON, without requiring the first user to choose whether or not to send it.

[0199] Furthermore, the second user may be able to configure whether or not to receive service information and other notifications from the first user within the chat application.

[0200] According to this embodiment, the first user can use the second user's chat application ID to notify them of predetermined information in addition to replying.

[0201] [7. Variant] The present invention is not limited to the embodiments described above, and various modifications are possible. That is, embodiments obtained by combining technical means that are appropriately modified without departing from the spirit of the present invention are also included in the technical scope of the present invention.

[0202] Furthermore, although the embodiments described above are explained separately for the sake of explanation, it goes without saying that they may be combined and implemented to the extent that is technically possible.

[0203] Furthermore, in the embodiments, the programs that run in each device are programs that control the CPU and the like (programs that make the computer function) in order to realize the functions of the embodiments described above. The information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) during processing, and then stored in storage devices such as various ROMs (Read Only Memory) and HDDs, and read, modified, and written by the CPU as needed.

[0204] Here, the recording medium for storing the program may be any of the following: semiconductor media (e.g., ROM or non-volatile memory card), optical recording medium / magneto-optical recording medium (e.g., DVD (Digital Versatile Disc), MO (Magneto Optical Disc), MD (Mini Disc), CD (Compact Disc), BD (Blu-ray® Disc), etc.), magnetic recording medium (e.g., magnetic tape, flexible disk, etc.). Furthermore, in addition to realizing the functions of the above-described embodiment by executing the loaded program, the functions of the present invention may also be realized by processing in cooperation with the operating system or other application programs based on the instructions of the program.

[0205] Furthermore, when distributing the program to the market, it can be stored on a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server computer is, of course, also included in the present invention. [Explanation of symbols]

[0206] 1 System 10, 12 Server equipment 100 Control Unit 102 Message Processing Unit 104 Interoperability Processing Unit 170 Storage section 172 Message Information Storage Area 174 File storage area 176 Address information storage area 178 Registered Information Storage Area 180 NW Communications Department 20 Terminal devices 200 Control Unit 202 Message Acquisition Unit 204 Message Submission Section 206 Timeline Display Control Unit 240 Display section 250 Operation section 270 Storage section 272 Chat apps 274 Message Information Storage Area 276 File storage area 280 NW Communications Department 30, 32 Image communication device 300 Control Unit 302 FAX transmission and reception unit 304 Interoperability Processing Unit 306 Image Processing Unit 308 Message Acquisition Unit 310 Message Submission Section 320 Image reading unit 330 Image forming unit 340 Display section 350 Control unit 370 Storage section 372 File storage space 374 Address Information 3742 Name 3744 Chat app ID 3746 Phone number 3748 FAX number 376 Address information storage area 378 My own chat app ID 380 NW Communications Department 390 Communication Section

Claims

[Claim 1] Server device, A first communication device and a second communication device, A first terminal device and a second terminal device A method for controlling a system in which the following are connected in a communication manner, When the first communication device receives the first image from the second communication device, it transmits predetermined information to the first terminal device via the server device. The first terminal device transmits a first instruction, which is an instruction to transmit a second image to the second communication device, to the first communication device. The first communication device transmits the second image to the second communication device based on the first instruction. The first terminal device transmits a second instruction to the first communication device, which is an instruction to send a message entered by the user to the second terminal device. The first communication device transmits the message to the second terminal device based on the second instruction. The first and second instructions are executed based on user operations received via the user interface of the first application running on the first terminal device. A control method characterized by the following:

Images