Image forming apparatus, system and control method

Abstract

To provide an image forming apparatus and the like that make available an input function of a terminal device in remote control of the image forming apparatus.SOLUTION: An image forming apparatus comprises: a display unit that displays an operating screen; a communication unit that transmits and receives data or a signal to and from a terminal device; and a control unit that transmits a start-up signal for starting up an input function to the terminal device when the communication unit transmits data of the operating screen to the terminal device, and in response to reception of an operation event signal generated by the terminal device, determines whether the operation event signal is to designate an input field of the terminal device, and as a result of the determination, the operation event signal is to designate the input field of the terminal device.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a remotely controlled image forming apparatus and the like. [Background technology]

[0002] In recent years, technologies have been developed that allow devices such as smartphones, tablets, and PCs to remotely control other devices.

[0003] Patent document 1 discloses that "when remotely controlling an operated terminal using an operating terminal, the screen of the operated terminal is displayed on the display of the operating terminal and operated on the operating terminal, and the operation signal is sent to the operated terminal via a web server and executed on the operated terminal." [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-323093 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology of Patent Document 1, a terminal device is operated by remote control from a terminal device, but there is no mention of using the input functions of the terminal device, such as an input conversion function such as kanji conversion, a voice input function, etc. When the terminal device is an image forming device, a user operates the operation screen of the image forming device (an operation screen including a software keyboard) displayed on the terminal device, but the input function is that of the image forming device, and it was not considered that the input operation function of the operating terminal itself would be used in remotely operating the image forming device.

[0006] In view of the above circumstances, the present disclosure provides an image forming apparatus or the like that allows an input function of a terminal device to be used when remotely operating the image forming apparatus using the terminal device. [Means for solving the problem]

[0007] The present disclosure is characterized in that an image forming apparatus includes a display unit that displays an operation screen, a communication unit that transmits and receives data or signals to and from a terminal device, and a control unit that transmits data of the operation screen to the terminal device, and in response to receiving an operation event signal from the terminal device, determines whether the operation event signal specifies an input field of the terminal device, and if the operation event signal specifies an input field of the terminal device, transmits an activation signal to the terminal device to activate an input function.

[0008] The present disclosure is also characterized in that the image forming apparatus comprises a display unit that displays an operation screen, a communication unit that transmits and receives data or signals to and from a terminal device, and a control unit that transmits data of the operation screen to the terminal device, and in response to receiving an operation event signal from the terminal device, determines whether the operation event signal is an operation that uses an input function of the terminal device, and if the operation event signal is an operation that uses the input function of the terminal device, transmits an activation signal to the terminal device to activate the input function.

[0009] The present disclosure also provides a method for remotely controlling an image forming apparatus operated by a terminal device, comprising: a display step for displaying an operation screen; a communication step for transmitting and receiving data or signals to and from the terminal device; and a control step for transmitting data of the operation screen to the terminal device by the communication step, and, in response to receiving an operation event signal from the terminal device, determining whether the operation event signal specifies an input field of the terminal device, and, if the operation event signal specifies an input field of the terminal device, transmitting an activation signal to the terminal device to activate an input function.

[0010] The present disclosure also provides a method for remotely controlling an image forming apparatus operated by a terminal device, comprising: a display step for displaying an operation screen; a communication step for transmitting and receiving data or signals to and from the terminal device; and a control step for transmitting data of the operation screen to the terminal device by the communication step, and, in response to receiving an operation event signal from the terminal device, determining whether the operation event signal is an operation that utilizes an input function of the terminal device, and, if the operation event signal is an operation that utilizes the input function of the terminal device, transmitting an activation signal to the terminal device to activate the input function. [Effects of the Invention]

[0011] According to the present disclosure, the operability when remotely operating an image forming apparatus using a terminal device is improved, input efficiency is improved, and there is no need to provide the image forming apparatus with the input function of the terminal device, which can have the excellent effect of reducing the cost of integration. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is an explanatory diagram illustrating a remote control system for an image forming apparatus according to a first embodiment. [Figure 2] 1 is an external view showing an image forming apparatus according to a first embodiment. [Figure 3] 1 is a block diagram showing a functional configuration of an image forming apparatus according to a first embodiment. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of a terminal device according to the first embodiment. [Figure 5] 5 is a flowchart showing a remote control process of the image forming apparatus according to the first embodiment. [Figure 6] 5 is a flowchart showing an input operation process of the image forming apparatus according to the first embodiment. [Figure 7] 5 is a flowchart showing a remote control process of the terminal device according to the first embodiment. [Figure 8] 5 is a flowchart showing an input operation process of the terminal device according to the first embodiment. [Figure 9] FIG. 2 is an explanatory diagram showing an operation screen displayed on a display unit of the image forming apparatus according to the first embodiment. [Figure 10] FIG. 2 is an explanatory diagram showing an operation screen displayed on a display unit of the terminal device according to the first embodiment. [Figure 11] FIG. 3 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of the image forming apparatus according to the first embodiment; [Figure 12] FIG. 3 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of the terminal device according to the first embodiment; [Figure 13] 3 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of the terminal device according to the first embodiment and a software keyboard of the terminal device. FIG. [Figure 14] 10 is a flowchart showing an input operation process of an image forming apparatus according to a second embodiment. [Figure 15] 10 is a flowchart showing an input operation process of a terminal device according to a second embodiment. [Figure 16] FIG. 11 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of a terminal device according to the second embodiment. [Figure 17] FIG. 11 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of a terminal device according to a third embodiment, and a software keyboard of the terminal device. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are merely examples for explaining the present disclosure, and the technical scope of the inventions described in the claims is not limited to the following description.

[0014] [1. First embodiment] [1.1 Remote control system configuration] FIG. 1 is an explanatory diagram showing a remote control system for an image forming apparatus according to the first embodiment. The remote control system 1 of the first embodiment includes an image forming apparatus 10 and a terminal apparatus 20, which are connected to each other via a network 30. The network 30 is a LAN (Local Area Network) or the Internet, and the connection form may be wired or wireless.

[0015] In the remote control system 1, the terminal device 20 can remotely control the image forming device 10. In the remote control system 1 of the first embodiment, when the image forming device 10 is remotely controlled from the terminal device 20, the input function of the terminal device 20 is used instead of the input function of the image forming device 10 depending on the input field.

[0016] [1.2 Configuration of each device] [1.2.1 Image forming device] Fig. 2 is an external view showing the image forming apparatus according to the first embodiment, and Fig. 3 is a block diagram showing the functional configuration of the image forming apparatus according to the first embodiment.

[0017] Image forming apparatus 10 is, for example, an MFP (Multifunction Peripheral) and has multiple modes for job processing in image formation. Image forming apparatus 10 includes a control unit 100, a storage unit 120, a document reading unit 130, an image forming unit 140, a display unit 150, an operation unit 160, and a communication unit 170, which are operated to execute jobs in each mode. An outline of each mode is described below.

[0018] The job processing mode is a mode in which general copy functions, fax functions, scanner functions, etc. When the image forming apparatus 10 is in the copy mode, it can execute a copy job, when in the fax mode, it can execute a fax job, and when in the scanner mode, it can execute a scanner job.

[0019] A copy job will be briefly described below. First, a document is set in document reading unit 130, and a copy operation is performed using operation unit 160. The user can check the document size, paper size, and copy settings (for example, single-sided printing, double-sided printing, combined printing, etc.) that have been set on display unit 150.

[0020] When the user performs a start operation on the operation unit 160, the copy process is executed. Specifically, the document reading unit 130 reads the document set by the user. The control unit 100, which will be described later, generates image data from the document read by the document reading unit 130.

[0021] Image forming unit 140 generates an image based on image data on paper conveyed from paper tray 1410 and outputs the image to paper output tray 1420. In this embodiment, paper refers to recording paper on which an image is formed. This includes not only ordinary plain paper, but also various paper media such as cardboard and glossy paper, as well as film on which an image can be formed.

[0022] Next, a brief explanation of the FAX job will be given below. When sending a fax, a document is set in the document reading unit 130, and the fax sending operation is performed using the operation unit 160. The user can check the document size and sending settings (destination fax number, etc.) that have been set on the display unit 150.

[0023] FAX processing is executed when the user performs a FAX start operation on the operation unit 160. The control unit 100, which will be described later, performs communication procedures with the other party using the communication unit 170. Then, when a state in which transmission is possible is ensured, the control unit 100 performs necessary processing on the compressed file, such as changing the compression format, and then performs processing to sequentially transmit the compressed file to the other party via the communication line.

[0024] Furthermore, when receiving a FAX, the control unit 100 receives a compressed file sent from the other party while performing a communication procedure in the communication unit 170, and performs expansion processing on the received compressed file in a compression / expansion processing unit (not shown).Then, various image processes are performed on the image data, and the result is output to the image forming unit 140. The image forming unit 140 forms an output image on a recording sheet based on the output image data.

[0025] In addition to the FAX mode, the function of sending scanned document image data also allows the document image data to be sent by email to an address stored in the storage unit 120.

[0026] Next, a brief description of the scanner job will be given below. First, a document is set on the document reading unit 130, and the scanner is operated using the operation unit 160. The user can check the document size and output image settings (image file type, etc.) that have been set on the display unit 150.

[0027] When a user performs a scan start operation on the operation unit 160, scanner processing is executed. Specifically, the document reading unit 130 reads the document set by the user. The control unit 100, which will be described later, generates image data from the document read by the document reading unit 130.

[0028] The image forming device 10 executes various jobs by combining these functions (copy function, fax function, scanner function). At this time, for multiple setting items in each job, each time a user performs setting operation input, the autocomplete function automatically extracts setting values ​​previously operated and set from the job operation history and displays them as setting history.

[0029] Regarding the job processing mode of the image forming apparatus, when a user operates the operation unit 160 to activate a desired job processing mode, the control unit 100 of the image forming apparatus 10 displays an initial screen of the activated job processing mode on the screen of the display unit 150. At this time, the initial setting values ​​of the setting items are displayed on the initial screen, and the setting values ​​can be changed from the operation unit 160.

[0030] Next, the functional configuration of the image forming apparatus 10 will be described with reference to FIG.

[0031] The control unit 100 is a functional unit for controlling the entire image forming apparatus 10. The control unit 100 realizes various functions by reading and executing control programs stored in the storage unit 120, and is configured with one or more arithmetic units (e.g., CPUs (Central Processing Units)). The functions realized by the control unit 100 will be described below.

[0032] The control unit 100 has an input operation processing function for performing input operation processing, an image formation processing function for performing image formation processing, etc. The control unit 100 executes a copy function, a FAX function, a scanner function, etc. as the image formation processing function.

[0033] The storage unit 120 is a functional unit that stores programs and data, and is configured by, for example, a semiconductor memory such as an SSD (Solid State Drive), an HDD (Hard Disk Drive), or the like.

[0034] The storage unit 120 stores a control program and operation screen data.

[0035] The control program is a program related to operational control of the image forming apparatus 10, and also controls processing related to input operations. The operation screen data is screen data that is displayed for performing input operations.

[0036] The document reading unit 130 reads an image of a document, and is configured by a scanner device or the like equipped with a device that converts optical information, such as a CIS (Contact Image Sensor) or a CCD (Charge Coupled Device), into an electrical signal.

[0037] For example, the document reading unit 130 reads the document placed on the document table within a range set according to the document size. The document may be set on the document table or in an automatic document feeder (ADF).

[0038] Image forming unit 140 is a functional unit for forming image data on a recording medium (e.g., recording paper). For example, recording paper is fed from paper tray 1410 in Fig. 2, and after an image is formed on the surface of the recording paper in image forming unit 140, the recording paper is discharged from discharge tray 1420. Image forming unit 140 is configured, for example, by a laser printer or the like that uses an electrophotographic system. Also, one or more paper trays 1410 are usually provided to store paper.

[0039] The display unit 150 displays various states of the image forming apparatus 10 and the state of operation inputs. For example, the display unit 150 is configured with a liquid crystal display (LCD), an organic EL panel, electronic paper using an electrophoretic system, or the like.

[0040] The operation unit 160 is a button, a switch, or the like that accepts operation input from a user. The operation unit 160 may be realized by a hardware input device such as a switch or a keyboard, or may be realized by a touch panel or the like that is integrally formed with the display unit 150. In this case, the method for detecting input on the touch panel may be any common detection method, such as a resistive film method, an infrared method, an electromagnetic induction method, or a capacitance method. The operation unit 160 of this embodiment is equipped with a hardware input device and a touch panel of the display unit 150, both of which are operable.

[0041] The communication unit 170 communicates with other devices. For example, the communication unit 170 may have an interface connectable to a network and be able to communicate with other devices via a wired / wireless local area network (LAN). Note that the communication unit 170 may send and receive image data from other devices (such as a USB memory) via a universal serial bus (USB) interface or the like. The communication unit 170 may also be connectable to a communication network such as a public line network, a local area network (LAN), or the Internet, and may send compressed files to external devices via the communication network by a communication method such as facsimile or email.

[0042] The image forming apparatus 10 may further include necessary functions in addition to the above-described configuration. For example, a management unit may be provided that includes a billing management unit so that the image forming apparatus 10 can be used only when a fee is paid by the user.

[0043] 1.2.2 Terminal Devices FIG. 4 is a block diagram showing the functional configuration of the terminal device according to the first embodiment. 4 is, for example, a personal computer (PC), a notebook PC, a tablet, a smartphone, or the like, and includes a control unit 200, a storage unit 220, a display unit 250, an operation unit 260, and a communication unit 270. The terminal device 20 operates each unit to remotely control the image forming apparatus 10 connected via the network 30.

[0044] The control unit 200 is a functional unit for controlling the entire terminal device 20. The control unit 200 realizes various functions by reading and executing control programs stored in the storage unit 220, and is configured by one or more arithmetic units (e.g., CPUs) and the like.

[0045] The storage unit 220 is a functional unit that stores programs and data, and is configured, for example, by a semiconductor memory such as an SSD, an HDD, or the like.

[0046] The display unit 250 displays various states of the terminal device 20 and the state of operation inputs, and is configured by, for example, a liquid crystal display (LCD), an organic EL panel, or the like.

[0047] The operation unit 260 is a button, a switch, or the like that accepts operation input from the user. The operation unit 260 may be realized by a hardware input device such as a switch or a keyboard, or may be realized by a touch panel or the like that is formed integrally with the display unit 250. The method for detecting input on the touch panel may be any common detection method, such as a resistive film method, an infrared method, an electromagnetic induction method, or a capacitance method.

[0048] The communication unit 270 communicates with other devices via a network. For example, the network communication unit has an interface that can be connected to a network and can communicate with other devices via a wired / wireless LAN (Local Area Network). It also supports wireless communication such as Bluetooth (registered trademark), Wi-Fi, and NFC, and can communicate with other compatible devices.

[0049] [1.3 Processing flow] It is assumed that the image forming apparatus 10 and the terminal apparatus 20 have a program installed for remote operation, and that the passwords and other information required for authentication login have been registered with each other. It is also assumed that the login authentication process for remote operation has also been completed. Therefore, a detailed description of this process will be omitted.

[0050] [1.3.1 Processing of image forming devices] The remote control processing of the image forming apparatus will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flowchart showing the remote control processing of the image forming apparatus according to the first embodiment. Fig. 6 is a flowchart showing the input operation processing of the image forming apparatus according to the first embodiment.

[0051] The control unit 100 of the image forming apparatus 10 displays an operation screen on the display unit 150 based on the operation screen data stored in the storage unit 120 (step S102). The control unit 100 transmits the data of the operation screen displayed on the display unit 150 to the terminal device 20 via the communication unit 170 (step S104). The control unit 100 receives an operation event signal from the terminal device 20 by the operation unit 260 (step S106). When the control unit 100 receives an operation event signal from the terminal device 20, it determines whether the operation is a designation operation for an input field or something else (step S108).

[0052] If it is a designation operation for an input field (step S108; Yes), the control unit 100 executes input operation processing (step S110). If it is not a designation operation for an input field (step S108; No), the control unit 100 executes operation processing based on the operation event signal (step S112). The input operation processing of step S110 will be described later.

[0053] The control unit 100 determines whether there is a change in the operation screen (step S114), and if there is a change (step S114; Yes), stores the data of the changed operation screen in the storage unit 120 and transmits the data to the terminal device 20 (step S116), and proceeds to step S118. If there is no change (step S114; No), proceeds to step S118.

[0054] In step S118, the control unit 100 determines whether the remote operation has ended (step S118), and if the remote operation has not ended (step S118; No), the control unit 100 returns to step S106, and if the remote operation has ended (step S118; Yes), the control unit 100 ends the processing.

[0055] If the operation event signal received from the terminal device 20 is a signal indicating a designation operation of an input field, the control unit 100 determines whether the operation uses the input function of the image forming device 10 or the input function of the terminal device 20.

[0056] It is set in advance whether the input fields on the operation screen are to use the input functions of the image forming device or the terminal device. For example, the input functions of the image forming device may be used for selecting each item or entering numbers, while the input functions of the terminal device (hereinafter referred to as the terminal input function) may be used for character conversion using an IME (Input Method Editor). Also, voice input or handwriting input may be used as the terminal input function. Input of paper size, for example, may be switched to voice input.

[0057] In the input field, if a number is entered, it may be switched to the input function of the image forming device, and if not, it may be switched to the terminal input function. Also, depending on the resolution of the terminal device 20 (for example, if the resolution is lower than a predetermined value), the terminal input function may be disabled.

[0058] Next, the input operation processing of the image forming apparatus in step S110 shown in FIG. 5 will be described with reference to FIG. The control unit 100 determines whether the input field uses the input function of the terminal device 20 (step S132). If the input field uses the terminal input function (step S132; Yes), the control unit 100 transmits an input function activation signal to the terminal device 20 (step S134). The control unit 100 receives input data from the terminal device 20 using the terminal input function via the communication unit 170 (step S136).

[0059] If the input field does not use the terminal input function (step S132; No), the control unit 100 receives an operation event signal from the terminal device 20 via the communication unit 170 (step S138), and performs processing using the input function of the image forming device based on that signal (step S140).

[0060] 1.3.2 Terminal Processing The remote control processing of the terminal device will be described with reference to Fig. 7 and Fig. 8. Fig. 7 is a flowchart showing the remote control processing of the terminal device according to the first embodiment. Fig. 8 is a flowchart showing the input operation processing of the terminal device according to the first embodiment.

[0061] The control unit 200 of the terminal device 20 receives the operation screen data from the image forming apparatus 10, stores it in the storage unit 220, and displays the operation screen on the display unit 250 (step S202). The control unit 200 performs input operation processing (step S204). The input operation processing of step S204 will be described later.

[0062] Control unit 200 checks whether data for the change operation screen has been received from image forming apparatus 10 via communication unit 270 (step S206). If data for the change operation screen has been received (step S206; Yes), control unit 200 stores the data for the change operation screen in storage unit 220 and displays the operation screen on display unit 250 (step S208), and then proceeds to step S210.

[0063] If the change operation screen has not been received (step S206; No), the process proceeds to step S210.

[0064] In step S210, the control unit 200 checks whether the remote control has ended, and if it has not ended (step S210; No), returns to step S204, and if it has ended (step S210; Yes), ends the remote control processing.

[0065] Next, the input operation processing of the terminal device in step S204 shown in FIG. 7 will be described with reference to FIG. By operating the operation unit 260 of the terminal device 20, the control unit 200 of the terminal device 20 generates an operation event signal (step S232), and the control unit 200 transmits the operation event signal to the image forming apparatus 10 via the communication unit 270 (step S234).

[0066] The control unit 200 checks whether an input function activation signal has been received from the image forming apparatus 10 via the communication unit 270 within a predetermined time (step S236). If the input function activation signal has been received (step S236; Yes), the control unit 200 activates the terminal input function (step S238). The control unit 200 generates input data through an input operation on the operation unit 260 using the terminal input function (step S240). Then, the control unit 200 transmits the input data to the image forming apparatus 10 via the communication unit 270 (step S242).

[0067] If the input function activation signal has not been received (step S236; No), the input operation process is completed.

[0068] [1.4 Example of operation] A specific example of the remote operation process of the first embodiment will be described based on the operation screens in Figures 9 to 13. Although remote operation of jobs is possible in various modes, the following description will be given taking as an example an operation screen for inputting a subject and file name to be sent by fax or email.

[0069] 9, an operation screen 500 displayed on the display unit 150 of the image forming apparatus 10 displays an address book destination input field 501, a subject input field 502, and a file name input field 503. Here, the subject input field 502 and the file name input field 503 are set to use the input function of the terminal device 20. When a "Remotely controlled" display 504 is displayed, it indicates that the terminal device 20 is in remote control mode.

[0070] The data for this operation screen is sent from the image forming apparatus 10 to the terminal apparatus 20 and is displayed as an operation screen 500-1 on the display unit 250 of the terminal apparatus 20, as shown in Fig. 10. When the user touches the subject input field 502-1, an operation event signal is sent to the image forming apparatus 10, and the image forming apparatus 10 sets the input field 502 as the input target.

[0071] 11, the image forming apparatus 10 transitions the operation screen displayed on the display unit 150 to an operation screen 530 for inputting a subject. An input field 531 for inputting a subject and a software keyboard 532 are displayed on the operation screen 530.

[0072] The image forming apparatus 10 sends the changed operation screen data and an input function activation signal to the terminal apparatus 20. The terminal apparatus 20 displays an operation screen 530-1 on the display unit 250 based on the sent operation screen data, as shown in FIG.

[0073] Since the input function activation signal is sent to the terminal device 20, the software keyboard 600 of the terminal device 20 is displayed on the lower half of the operation screen 530-1, as shown in Fig. 13. The display position of the software keyboard 600 may be anywhere on the display unit 250, and the position can be moved by the user.

[0074] The user inputs data using the software keyboard 600, converts the characters using an IME (Input Method Editor) of the terminal device 20, and sends the input data to the image forming device .

[0075] The image forming apparatus 10 displays the input data in the input field 531, and sends the data of the operation screen 530 to the terminal device 20, where it is reflected on the same operation screen 530-1.

[0076] [1.5 Effects] In this way, users can use the input functions of a terminal device that they are familiar with or that has sufficient functions, which improves operability and input efficiency. Also, there is no need to provide the input functions of a terminal device in the image forming apparatus, which reduces the cost of incorporating the function.

[0077] [2. Second Embodiment] When the image forming device of the second embodiment is remotely controlled from a terminal device, if the user performs an operation using the input function of the terminal device on an input field (for example, long press, double click, etc.), the input function of the terminal device is launched and used to perform the input operation.

[0078] The system configuration and the configuration of each device are the same as those in the first embodiment, so a description thereof will be omitted.

[0079] [2.1 Processing flow] [2.1.1 Processing by Image Forming Device] The remote control processing of the image forming apparatus according to the second embodiment is the same as the flowchart shown in Fig. 5, and therefore the description will be omitted. The input operation processing of the image forming apparatus in step S110 shown in Fig. 5 will be described. Fig. 14 is a flowchart showing the input operation processing of the image forming apparatus according to the second embodiment.

[0080] If the operation event signal transmitted from the terminal device 20 indicates a designation operation for an input field, the control unit 100 of the image forming apparatus 10 performs input operation processing (step S110). The control unit 100 checks whether the operation event signal indicates an operation that uses the terminal input function (step S152). If the operation indicates an operation that uses the terminal input function (step S152; Yes), the control unit 100 transmits an input function activation signal to the terminal device 20 (step S156). The control unit 100 receives input data from the terminal device 20 via the communication unit 170 using the terminal input function (step S158).

[0081] If the operation does not utilize the terminal input function (step S152; No), the control unit 100 receives an operation event signal from the terminal device 20 via the communication unit 170 (step S160), and performs processing using the input function of the image forming device based on that signal (step S162).

[0082] 2.1.2 Terminal Processing The remote control processing of the terminal device according to the second embodiment is the same as the flowchart shown in Fig. 7, and therefore the description will be omitted. The input operation processing of the terminal device in step S204 shown in Fig. 7 will be described. Fig. 15 is a flowchart showing the input operation processing of the terminal device according to the second embodiment.

[0083] The user uses the operation unit 260 of the terminal device 20 to perform an operation to use (activate) an input function of the terminal device 20. For example, an operation such as a long press or a double touch is registered in advance. In response to this operation, the control unit 200 of the terminal device 20 generates an operation event signal to use (activate) the terminal input function (step S252). The control unit 200 transmits the operation event signal to the image forming apparatus 10 via the communication unit 270 (step S254).

[0084] Control unit 200 receives an input function activation signal from image forming apparatus 10 via communication unit 270 within a predetermined time (step S256). Control unit 200 activates the terminal input function (step S258). Control unit 200 generates input data through an input operation on operation unit 260 using the terminal input function (step S260). Then, control unit 200 transmits the input data to image forming apparatus 10 via communication unit 270 (step S262).

[0085] [2.2 Example of operation] A specific example of the remote control process of the second embodiment will be described based on the operation screen of FIG. 16 is the same as the display screen of the terminal device in FIG. 12, and a description of the configuration will be omitted. Assume that a user touches and holds a finger on the subject input field 531-1. If a long press is registered in the image forming device 10 as an operation for activating the terminal input function, an operation event signal of this operation is sent from the terminal device 20 to the image forming device 10, and the image forming device 10 sends an input function activation signal to the terminal device 20. In response to this, the terminal device 20 displays the software keyboard of the terminal device 20, as shown in FIG. 13. The user uses this software keyboard to convert characters using the IME of the terminal device 20.

[0086] When it is desired to use the input function of the image forming device, the input function of the image forming device may be used by performing another operation such as a short one-touch on the input field. The switching of the input function is not limited to this, and it is sufficient to set the method of each operation.

[0087] [2.3 Effects] In this way, the user can easily switch the input function for the input field of the image forming device to the input function of the terminal device that the user is familiar with, improving operability and input efficiency. Also, there is no need to provide the input function of the terminal device in the image forming device, which reduces the cost of incorporating it.

[0088] 3. Third Embodiment The image forming apparatus according to the third embodiment displays a message indicating that an input function of a terminal device should be used in an input field.

[0089] The system configuration, the configuration of each device, and the processing flow are the same as those in the first and second embodiments, so a description thereof will be omitted.

[0090] [3.1 Example of operation] FIG. 17 is an explanatory diagram showing a subject entry operation screen displayed on the display unit of the terminal device according to the first embodiment and a software keyboard of the terminal device.

[0091] The operation screen of FIG. 17 is the same as the operation screen of the terminal device 20 of FIG. 13, and therefore a description of the configuration will be omitted. The color of the subject input field 531-1 is changed, and the semi-transparent text "Uses the input function of the terminal device" is displayed in the input field to notify the user that the subject input field will use the input function of the terminal device.

[0092] [3.2 Effects] In this way, by indicating in the input field that the input function of the terminal device is to be used, the user knows that the input function of the terminal device is available, and can operate efficiently without causing confusion.

[0093] [4. Modifications] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and designs that do not deviate from the gist of the present invention are also included in the scope of the claims.

[0094] In addition, the programs that run on each device in the embodiments are programs that control the CPU, etc. (programs that make a computer function) so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (e.g., RAM) during processing, and then stored in various ROMs and HDDs, and is read, modified, and written by the CPU as needed.

[0095] Here, the recording medium for storing the program may be any non-transitory recording medium, such as a semiconductor medium (e.g., a ROM or a non-volatile memory card), an optical recording medium or a magneto-optical recording medium (e.g., a DVD (Digital Versatile Disk), an MO (Magneto Optical Disk), an MD (Mini Disk), a CD (Compact Disk), or a BD (Blu-ray Disc (registered trademark))), or a magnetic recording medium (e.g., a magnetic tape or a flexible disk). Furthermore, not only are the functions of the above-described embodiments realized by executing the loaded program, but the functions of the present invention may also be realized by processing in cooperation with an operating system or other application programs, etc., based on instructions from the program.

[0096] Furthermore, when distributing the program on the market, the program can be stored in a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server computer is of course included in the present invention.

[0097] Furthermore, some or all of the devices in the above-described embodiments may be realized as LSI (Large Scale Integration), which is typically an integrated circuit. Each functional block of each device may be individually formed into a chip, or some or all of the functional blocks may be integrated into a chip. Furthermore, the integrated circuit method is not limited to LSI, and may be realized using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, it is of course possible to use an integrated circuit based on that technology. [Explanation of symbols]

[0098] 1: Remote control system 10: Image forming device 20: Terminal device 30: Network 100: Control unit 120: Storage section 130: Document reading unit 140: Image forming unit 150:Display section 160:Operation unit 170: Communications Department 200: Control section 220: Storage section 250:Display section 260:Operation unit 270: Communications Department 500, 500-1: Operation screen 501: Destination input field 502, 502-1: Subject input field 503: File name input field 504 :Display 530, 530-1: Operation screen 531, 531-1: Subject entry field 532, 532-1: Software keyboard 600: Software keyboard

Claims

1. a display unit that displays an operation screen; a communication unit for transmitting and receiving data or signals to and from a terminal device; A control unit; Equipped with The control unit displaying the operation screen on the display unit, the operation screen including a display indicating that remote control is being performed; transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, displaying the input operation screen on the display unit; On the input operation screen of the terminal device, an input function activation signal is transmitted to activate an input function of the terminal device that is longer in the longitudinal direction than the input operation screen. Image forming device.

2. a display unit that displays an operation screen; a communication unit for transmitting and receiving data or signals to and from a terminal device; A control unit; Equipped with The control unit displaying the operation screen on the display unit, the operation screen including a display indicating that remote control is being performed; transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation to designate an input field is performed on the operation screen of the terminal device, displaying an input operation screen on the display unit for inputting information including a destination; On the input operation screen of the terminal device, an input function activation signal is transmitted to activate an input function of the terminal device that is longer in the longitudinal direction than the input operation screen. Image forming device.

3. an image forming apparatus; A terminal device; and The terminal device and the image forming device transmit and receive data or signals, The image forming apparatus includes: Displaying an operation screen including a display indicating that remote operation is in progress, transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, Displaying the input operation screen, transmitting data of the input operation screen to the terminal device; The terminal device receiving data of the operation screen from the image forming apparatus; displaying the operation screen based on the data of the operation screen; When the data of the input operation screen is received, displaying the input operation screen based on the data of the input operation screen; The input function of the terminal device is displayed longer in the longitudinal direction than the input operation screen. system.

4. an image forming apparatus; A terminal device; and The terminal device and the image forming device transmit and receive data or signals, The image forming apparatus includes: Displaying an operation screen including a display indicating that remote operation is in progress, transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation to designate an input field is performed on the operation screen of the terminal device, Display the input operation screen for inputting information including the destination, transmitting data of the input operation screen to the terminal device; The terminal device receiving data of the operation screen from the image forming apparatus; displaying the operation screen based on the data of the operation screen; When the data of the input operation screen is received, displaying the input operation screen based on the data of the input operation screen; The input function of the terminal device is displayed longer in the longitudinal direction than the input operation screen. system.

5. The system according to claim 3 or 4, wherein the input functions are displayed in an overlapping manner on the input operation screen of the terminal device.

6. 5. The system according to claim 3, wherein the input functions are displayed in a movable state on the input operation screen of the terminal device.

7. 5. The system according to claim 3, wherein the input function is displayed below an input field on the input operation screen of the terminal device.

8. 5. The system according to claim 3, wherein the input operation screen of the terminal device notifies the user that the input function of the terminal device is available.

9. The system according to claim 4 , wherein the input operation screen of the terminal device notifies the input field that the input function of the terminal device is available.

10. 5. The system according to claim 3, wherein the input function of the terminal device is a software keyboard.

11. a display step for displaying an operation screen; a communication step of transmitting and receiving data or signals to and from a terminal device; a control step; Including, The control step displaying the operation screen including a display indicating that remote control is being performed in the display step; transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, displaying the input operation screen in the display step; transmitting an input function activation signal to the terminal device to activate an input function of the terminal device; On the input operation screen of the terminal device, the input function is displayed longer in the longitudinal direction than the input operation screen. Control method.

12. a display step for displaying an operation screen; a communication step of transmitting and receiving data or signals to and from a terminal device; a control step; Including, The control step displaying the operation screen including a display indicating that remote control is being performed in the display step; transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation to designate an input field is performed on the operation screen of the terminal device, displaying an input operation screen for inputting information including a destination address in the display step; transmitting an input function activation signal to the terminal device to activate an input function of the terminal device; On the input operation screen of the terminal device, the input function is displayed longer in the longitudinal direction than the input operation screen. Control method.

13. a display unit that displays an operation screen; a communication unit for transmitting and receiving data or signals to and from a terminal device; A control unit; Equipped with The control unit displaying the operation screen on the display unit, the operation screen including a display indicating that remote control is being performed; transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, displaying the input operation screen on the display unit; transmitting an input function activation signal to the terminal device to activate an input function of the terminal device; The input function of the image forming apparatus is used on the input operation screen according to the mode of the operation. Image forming device.

14. a display unit that displays an operation screen; a communication unit for transmitting and receiving data or signals to and from a terminal device; A control unit; Equipped with The control unit displaying the operation screen on the display unit, the operation screen including a display indicating that remote control is being performed; transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation to designate an input field is performed on the operation screen of the terminal device, displaying an input operation screen on the display unit for inputting information including a destination; transmitting an input function activation signal to the terminal device to activate an input function of the terminal device; The input function of the image forming apparatus is used on the input operation screen according to the mode of the operation. Image forming device.

Images