Image forming apparatus, system, and control method

Abstract

To provide an image forming apparatus and the like that make available an input function of a terminal device in remote control of the image forming apparatus.SOLUTION: An image forming apparatus comprises: a display unit that displays an operating screen; a communication unit that transmits and receives data or a signal to and from a terminal device; and a control unit that transmits a start-up signal for starting up an input function to the terminal device when the communication unit transmits data of the operating screen to the terminal device, and in response to reception of an operation event signal generated by the terminal device, determines whether the operation event signal is to designate an input field of the terminal device, and as a result of the determination, the operation event signal is to designate the input field of the terminal device.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to a remotely operated image forming apparatus and the like. [Background technology]

[0002] In recent years, technologies have been developed that allow devices such as smartphones, tablets, and PCs to remotely control other devices.

[0003] Patent document 1 discloses that "when remotely controlling an operated terminal using an operating terminal, the screen of the operated terminal is displayed on the display of the operating terminal and operated on the operating terminal, and the operation signal is sent to the operated terminal via a Web server and executed on the operated terminal." [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-323093 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology of Patent Document 1, a terminal device is operated by remote control from a terminal device, but there is no mention of using the input functions of the terminal device, such as an input conversion function such as kanji conversion, a voice input function, etc. When the terminal device is an image forming device, a user operates the operation screen of the image forming device (an operation screen including a software keyboard) displayed on the terminal device, but the input function is that of the image forming device, and it was not considered to use the input operation function of the operating terminal itself in remote control of the image forming device.

[0006] In view of the above circumstances, the present disclosure provides an image forming apparatus and the like that allows an input function of a terminal device to be utilized when remotely operating the image forming apparatus using the terminal device. [Means for solving the problem]

[0007] The present disclosure is characterized in that an image forming apparatus includes a display unit that displays an operation screen, a communication unit that transmits and receives data or signals with a terminal device, and a control unit that transmits data of the operation screen to the terminal device and, in response to receiving an operation event signal from the terminal device, determines whether the operation event signal specifies an input field of the terminal device, and, if the operation event signal specifies an input field of the terminal device, transmits an activation signal to the terminal device to activate an input function.

[0008] The present disclosure is also characterized in that an image forming apparatus includes a display unit that displays an operation screen, a communication unit that transmits and receives data or signals with a terminal device, and a control unit that transmits data of the operation screen to the terminal device and, in response to receiving an operation event signal from the terminal device, determines whether the operation event signal is an operation that utilizes an input function of the terminal device, and, if the operation event signal is an operation that utilizes the input function of the terminal device, transmits an activation signal to the terminal device to activate the input function.

[0009] The present disclosure also provides a method for remotely controlling an image forming device operated by a terminal device, comprising: a display step for displaying an operation screen; a communication step for transmitting and receiving data or a signal with the terminal device; and a control step for transmitting data of the operation screen to the terminal device by the communication step, and, in response to receiving an operation event signal by the terminal device, determining whether the operation event signal specifies an input field of the terminal device, and, if the operation event signal specifies an input field of the terminal device, transmitting an activation signal to the terminal device to activate an input function.

[0010] The present disclosure also provides a method for remotely controlling an image forming device operated by a terminal device, comprising: a display step for displaying an operation screen; a communication step for transmitting and receiving data or a signal with the terminal device; and a control step for transmitting data of the operation screen to the terminal device by the communication step, and, in response to receiving an operation event signal by the terminal device, determining whether the operation event signal is an operation that utilizes an input function of the terminal device, and, if the operation event signal is an operation that utilizes the input function of the terminal device, transmitting an activation signal to the terminal device to activate the input function. Effect of the Invention

[0011] According to the present disclosure, it is possible to achieve the excellent effects of improving operability when remotely operating an image forming apparatus using a terminal device, improving input efficiency, and eliminating the need to provide the image forming apparatus with the input function of a terminal device, thereby reducing the cost of integration. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is an explanatory diagram illustrating a remote control system for an image forming apparatus according to a first embodiment. [Diagram 2] 1 is an external view showing an image forming apparatus according to a first embodiment. [Diagram 3] 1 is a block diagram showing a functional configuration of an image forming apparatus according to a first embodiment. [Figure 4] 2 is a block diagram showing the functional configuration of a terminal device according to the first embodiment. FIG. [Diagram 5] 5 is a flowchart showing a remote control process of the image forming apparatus according to the first embodiment. [Figure 6] 5 is a flowchart showing an input operation process of the image forming apparatus according to the first embodiment. [Figure 7] 5 is a flowchart showing a remote control process of the terminal device according to the first embodiment. [Figure 8] 5 is a flowchart showing an input operation process of the terminal device according to the first embodiment. [Figure 9] FIG. 2 is an explanatory diagram showing an operation screen displayed on a display unit of the image forming apparatus according to the first embodiment. [Figure 10] FIG. 2 is an explanatory diagram showing an operation screen displayed on a display unit of the terminal device according to the first embodiment. [Figure 11] FIG. 2 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of the image forming apparatus according to the first embodiment; [Figure 12] FIG. 4 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of the terminal device according to the first embodiment; [Figure 13] 3 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of the terminal device according to the first embodiment, and a software keyboard of the terminal device; FIG. [Figure 14] 10 is a flowchart showing an input operation process of an image forming apparatus according to a second embodiment. [Figure 15] 13 is a flowchart showing an input operation process of a terminal device according to the second embodiment. [Figure 16] FIG. 11 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of a terminal device according to the second embodiment; [Figure 17] FIG. 11 is an explanatory diagram showing a subject entry operation screen displayed on a display unit of a terminal device according to a third embodiment, and a software keyboard of the terminal device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are merely examples for explaining the present disclosure, and the technical scope of the invention described in the claims is not limited to the following description.

[0014] [1. First embodiment] [1.1 Configuration of the remote control system] FIG. 1 is an explanatory diagram showing a remote control system for an image forming apparatus according to the first embodiment. The remote control system 1 of the first embodiment includes an image forming apparatus 10 and a terminal apparatus 20, which are connected to each other via a network 30. The network 30 is a LAN (Local Area Network) or the Internet, and the connection form may be wired or wireless.

[0015] In the remote control system 1, a terminal device 20 can remotely control an image forming device 10. In the remote control system 1 of the first embodiment, when the image forming apparatus 10 is remotely controlled from the terminal apparatus 20, the input function of the image forming apparatus 10 is not used according to the input field, but the input function of the terminal apparatus 20 is used.

[0016] [1.2 Configuration of each device] [1.2.1 Image forming device] Fig. 2 is an external view showing the image forming apparatus according to the first embodiment, and Fig. 3 is a block diagram showing the functional configuration of the image forming apparatus according to the first embodiment.

[0017] The image forming apparatus 10 is, for example, an MFP (Multifunction Peripheral) and has a plurality of modes related to job processing in image formation. The image forming apparatus 10 includes a control unit 100, a storage unit 120, a document reading unit 130, an image forming unit 140, a display unit 150, an operation unit 160, and a communication unit 170, and operates these units to execute jobs in each mode. An outline of each mode will be described below.

[0018] The job processing mode is a mode in which general copy functions, FAX functions, scanner functions, etc. When the image forming apparatus 10 is in the copy mode, it can execute a copy job, when in the FAX mode, it can execute a FAX job, and when in the scanner mode, it can execute a scanner job.

[0019] A copy job will be briefly described below. First, an original is set in the original reading unit 130, and a copy operation is performed by the operation unit 160. The user can check the original size, paper size, and copy settings (for example, single-sided printing, double-sided printing, aggregate printing settings, etc.) that have been set on the display unit 150.

[0020] When a user performs a start operation on the operation unit 160, the copy process is executed. Specifically, the document reading unit 130 reads the document set by the user. The control unit 100, which will be described later, generates image data from the document read by the document reading unit 130.

[0021] Image forming unit 140 generates an image based on image data on paper conveyed from paper tray 1410, and outputs the image to paper output tray 1420. In this embodiment, paper refers to recording paper on which an image is formed. This includes not only ordinary plain paper, but also various paper media such as cardboard and glossy paper, as well as film and the like on which an image can be formed.

[0022] Next, a brief explanation of the FAX job will be given below. When sending a FAX, a document is set in the document reading unit 130, and a FAX sending operation is performed using the operation unit 160. The user can check the document size and sending settings (destination FAX number, etc.) that have been set on the display unit 150.

[0023] FAX processing is executed when a user operates the operation unit 160 to start FAX. The control unit 100, which will be described later, performs a communication procedure with the other party using the communication unit 170. Then, when the control unit 100 has secured a state in which transmission is possible, it performs necessary processing on the compressed file, such as changing the compression format, and then performs processing to sequentially transmit the compressed file to the other party via the communication line.

[0024] Furthermore, when receiving a FAX, the control unit 100 receives a compressed file sent from the other party while performing a communication procedure in the communication unit 170, and performs decompression processing on the received compressed file in a compression / decompression processing unit (not shown). Then, various image processes are performed on the image data, and the data is output to the image forming unit 140. The image forming unit 140 forms an output image on a recording sheet based on the output image data.

[0025] In addition to the FAX mode, a function for sending scanned document image data is also available, which allows the document image data to be sent by e-mail to an address stored in the storage unit 120.

[0026] Next, a brief description of the scanner job will be given below. First, an original is set in the original reading unit 130, and the scanner is operated by the operation unit 160. The user can check the set original size and output image settings (image file type, etc.) on the display unit 150.

[0027] When a user performs a scan start operation from the operation unit 160, a scanner process is executed. Specifically, the document reading unit 130 reads the document set by the user. The control unit 100, which will be described later, generates image data from the document read by the document reading unit 130.

[0028] The image forming device 10 executes various jobs by combining these functions (copy function, FAX function, scanner function). At this time, for multiple setting items in each job, every time a user performs operation input for setting, the auto-complete function automatically extracts setting values ​​previously operated and set from the job operation history and displays them as the setting history.

[0029] Regarding the job processing mode of the image forming apparatus, when a user operates the operation unit 160 to activate a desired job processing mode, the control unit 100 of the image forming apparatus 10 displays an initial screen of the activated job processing mode on the screen of the display unit 150. At this time, the initial setting values ​​of the setting items are displayed on the initial screen, and the setting values ​​can be changed from the operation unit 160.

[0030] Next, the functional configuration of the image forming apparatus 10 will be described with reference to FIG.

[0031] The control unit 100 is a functional unit for controlling the entire image forming apparatus 10. The control unit 100 realizes various functions by reading and executing a control program stored in the storage unit 120, and is composed of one or more arithmetic devices (e.g., CPU (Central Processing Unit)) etc. The functions realized by the control unit 100 will be described below.

[0032] The control unit 100 has an input operation processing function for performing input operation processing, an image formation processing function for performing image formation processing, etc. The control unit 100 executes a copy function, a FAX function, a scanner function, etc. as the image formation processing function.

[0033] The storage unit 120 is a functional unit that stores programs and data. The storage unit 120 is configured, for example, by a semiconductor memory such as a solid state drive (SSD) or a hard disk drive (HDD).

[0034] The storage unit 120 stores a control program and operation screen data.

[0035] The control program is a program related to operational control of the image forming apparatus 10, and also controls processing related to input operations. The operation screen data is screen data that is displayed for performing an input operation.

[0036] The document reading unit 130 reads an image of a document, and is configured by a scanner device or the like equipped with a device that converts optical information, such as a CIS (Contact Image Sensor) or a CCD (Charge Coupled Device), into an electrical signal.

[0037] For example, the document reading unit 130 reads the document placed on the document placement table within a range set according to the document size. The document may be set on the document placement table or in an automatic document feeder (ADF).

[0038] Image forming unit 140 is a functional unit for forming image data on a recording medium (e.g., recording paper). For example, recording paper is fed from paper tray 1410 in Fig. 2, and after an image is formed on the surface of the recording paper in image forming unit 140, the recording paper is discharged from discharge tray 1420. Image forming unit 140 is configured, for example, by a laser printer using an electrophotographic method. Generally, one or more paper trays 1410 are provided to store paper.

[0039] The display unit 150 displays various states of the image forming apparatus 10 and the state of operation inputs. For example, the display unit 150 is configured with a liquid crystal display (LCD), an organic EL panel, electronic paper using an electrophoretic system, or the like.

[0040] The operation unit 160 is a button, a switch, etc. that accepts an operation input from a user. The operation unit 160 may be realized by a hardware input device such as a switch or a keyboard, or may be realized by a touch panel or the like that is integrally formed with the display unit 150. In this case, the method for detecting the input of the touch panel may be any common detection method such as a resistive film method, an infrared method, an electromagnetic induction method, or a capacitance method. The operation unit 160 of this embodiment includes a hardware input device and a touch panel of the display unit 150, both of which are operable.

[0041] The communication unit 170 communicates with other devices. For example, the communication unit 170 may have an interface connectable to a network and communicate with other devices via a wired / wireless LAN (Local Area Network). Note that the communication unit 170 may transmit and receive image data from other devices (e.g., USB memory, etc.) via a USB (Universal Serial Bus) interface or the like. The communication unit 170 may also be connectable to a communication network such as a public line network, a LAN (Local Area Network), or the Internet, and may transmit a compressed file to the outside via the communication network by a communication method such as facsimile or e-mail.

[0042] The image forming apparatus 10 may further include necessary functions other than the above-mentioned configuration. For example, a charge management unit may be provided so that the image forming apparatus 10 can be used only when a fee is deposited by a user.

[0043] 1.2.2 Terminal Equipment FIG. 4 is a block diagram showing a functional configuration of a terminal device according to the first embodiment. 4 is, for example, a personal computer (PC), a notebook PC, a tablet, a smartphone, or the like, and includes a control unit 200, a storage unit 220, a display unit 250, an operation unit 260, and a communication unit 270. The terminal device 20 operates each unit to remotely control the image forming apparatus 10 connected via the network 30.

[0044] The control unit 200 is a functional unit for controlling the entire terminal device 20. The control unit 200 realizes various functions by reading and executing a control program stored in the storage unit 220, and is composed of one or more arithmetic units (e.g., CPUs) and the like.

[0045] The storage unit 220 is a functional unit that stores programs and data, and is configured, for example, by a semiconductor memory such as an SSD, an HDD, or the like.

[0046] The display unit 250 displays various states of the terminal device 20 and the state of operational inputs, and is configured, for example, with a liquid crystal display (LCD) or an organic EL panel.

[0047] The operation unit 260 is a button, a switch, etc. that accepts an operation input from a user. The operation unit 260 may be realized by a hardware input device such as a switch or a keyboard, or may be realized by a touch panel or the like formed integrally with the display unit 250. The method for detecting the input of the touch panel may be any common detection method such as a resistive film method, an infrared method, an electromagnetic induction method, or a capacitance method.

[0048] The communication unit 270 communicates with other devices via a network. For example, the network communication unit has an interface that can be connected to a network, and can communicate with other devices via a wired / wireless LAN (Local Area Network). It also supports wireless communication such as Bluetooth (registered trademark), Wi-Fi, and NFC, and can communicate with other compatible devices.

[0049] [1.3 Processing flow] The image forming apparatus 10 and the terminal apparatus 20 are assumed to have installed therein a program for remote operation, and to have registered the passwords and other information required for authentication login with each other. Furthermore, it is assumed that login authentication processing for remote operation has also been completed. Therefore, a detailed description of this processing is omitted.

[0050] [1.3.1 Processing of image forming devices] A remote control process of the image forming apparatus will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flowchart showing the remote control process of the image forming apparatus according to the first embodiment. Fig. 6 is a flowchart showing the input operation process of the image forming apparatus according to the first embodiment.

[0051] The control unit 100 of the image forming apparatus 10 displays an operation screen on the display unit 150 based on the operation screen data stored in the storage unit 120 (step S102). The control unit 100 transmits data of the operation screen displayed on the display unit 150 to the terminal device 20 via the communication unit 170 (step S104). The control unit 100 receives an operation event signal by the operation unit 260 from the terminal device 20 (step S106). When the control unit 100 receives an operation event signal from the terminal device 20, it determines whether the operation is a designation operation of an input field or something else (step S108).

[0052] If it is a designation operation of an input field (step S108; Yes), the control unit 100 executes an input operation process (step S110). If it is not a designation operation of an input field (step S108; No), the control unit 100 executes an operation process based on the operation event signal (step S112). The input operation process of step S110 will be described later.

[0053] The control unit 100 determines whether there is a change in the operation screen (step S114), and if there is a change (step S114; Yes), stores the data of the changed operation screen in the storage unit 120 and transmits the data to the terminal device 20 (step S116), and proceeds to step S118. If there is no change (step S114; No), proceeds to step S118.

[0054] In step S118, the control unit 100 determines whether the remote operation has ended (step S118), and if the remote operation has not ended (step S118; No), the control unit 100 returns to step S106, and if the remote operation has ended (step S118; Yes), the control unit 100 ends the processing.

[0055] When the operation event signal received from the terminal device 20 is a signal indicating a designation operation of an input field, the control unit 100 determines whether the operation utilizes the input function of the image forming device 10 or the input function of the terminal device 20.

[0056] It is set in advance whether the input fields on the operation screen are to use the input functions of the image forming device or the input functions of the terminal device. For example, the input functions of the image forming device may be used for the selection of each item or for inputting numbers, and the input functions of the terminal device (hereinafter referred to as the terminal input functions) may be used for character conversion using an IME (Input Method Editor). In addition, voice input or handwriting input may be used as the terminal input function. Input of paper size, etc. may be switched to voice input.

[0057] In the input field, if a number is entered, the input function of the image forming apparatus is used, and otherwise the input function of the terminal is used. Also, depending on the resolution of the terminal device 20 (for example, when the resolution is lower than a predetermined value), the terminal input function may be disabled.

[0058] Next, the input operation process of the image forming apparatus in step S110 shown in FIG. 5 will be described with reference to FIG. The control unit 100 judges whether the input field uses the input function of the terminal device 20 (step S132). If the input field uses the terminal input function (step S132; Yes), the control unit 100 transmits an input function activation signal to the terminal device 20 (step S134). The control unit 100 receives input data by the terminal input function from the terminal device 20 via the communication unit 170 (step S136).

[0059] If the input field does not use the terminal input function (step S132; No), the control unit 100 receives an operation event signal from the terminal device 20 via the communication unit 170 (step S138), and performs processing using the input function of the image forming device based on that signal (step S140).

[0060] [1.3.2 Terminal device processing] The remote control processing of the terminal device will be described with reference to Fig. 7 and Fig. 8. Fig. 7 is a flowchart showing the remote control processing of the terminal device according to the first embodiment. Fig. 8 is a flowchart showing the input operation processing of the terminal device according to the first embodiment.

[0061] The control unit 200 of the terminal device 20 receives the operation screen data from the image forming apparatus 10, stores it in the storage unit 220, and displays the operation screen on the display unit 250 (step S202). The control unit 200 performs an input operation process (step S204). The input operation process of step S204 will be described later.

[0062] The control unit 200 checks whether data of the change operation screen has been received from the image forming apparatus 10 via the communication unit 270 (step S206). If data of the change operation screen has been received (step S206; Yes), the control unit 200 stores the data of the change operation screen in the storage unit 220 and displays the operation screen on the display unit 250 (step S208), and proceeds to step S210.

[0063] If the change operation screen has not been received (step S206; No), the process proceeds to step S210.

[0064] In step S210, the control unit 200 checks whether the remote control has been completed. If the remote control has not been completed (step S210; No), the control unit 200 returns to step S204. If the remote control has been completed (step S210; Yes), the control unit 200 ends the remote control process.

[0065] Next, the input operation process of the terminal device in step S204 shown in FIG. 7 will be described with reference to FIG. By operating the operation unit 260 of the terminal device 20, the control unit 200 of the terminal device 20 generates an operation event signal (step S232). The control unit 200 transmits the operation event signal to the image forming apparatus 10 via the communication unit 270 (step S234).

[0066] The control unit 200 checks whether an input function activation signal has been received from the image forming apparatus 10 via the communication unit 270 within a predetermined time (step S236). If an input function activation signal has been received (step S236; Yes), the control unit 200 activates the terminal input function (step S238). The control unit 200 generates input data by input operation from the operation unit 260 using the terminal input function (step S240). Then, the control unit 200 transmits the input data to the image forming apparatus 10 via the communication unit 270 (step S242).

[0067] If the input function activation signal has not been received (step S236; No), the input operation process is terminated.

[0068] [1.4 Example of operation] A specific example of the remote operation process of the first embodiment will be described with reference to the operation screens in Fig. 9 to Fig. 13. Although remote operation of a job is possible in various modes, the following description will be given taking as an example an input operation screen for inputting a subject and file name to be sent by FAX or email.

[0069] 9, an address book destination input field 501, a subject input field 502, and a file name input field 503 are displayed on an operation screen 500 displayed on the display unit 150 of the image forming apparatus 10. Here, the subject input field 502 and the file name input field 503 are set to use the input function of the terminal device 20. When "Remote operation in progress" display 504 is displayed, it indicates that the terminal device 20 is in remote operation mode.

[0070] The data of this operation screen is sent from the image forming apparatus 10 to the terminal apparatus 20, and is displayed as an operation screen 500-1 on the display unit 250 of the terminal apparatus 20, as shown in Fig. 10. When the user touches the subject input field 502-1, an operation event signal is sent to the image forming apparatus 10, and the image forming apparatus 10 sets the input field 502 as the input target.

[0071] 11, image forming apparatus 10 transitions the operation screen displayed on display unit 150 to an operation screen 530 for inputting a subject. On operation screen 530, a subject input field 531 and a software keyboard 532 are displayed.

[0072] The image forming apparatus 10 sends the changed operation screen data and an input function activation signal to the terminal apparatus 20. The terminal apparatus 20 displays an operation screen 530-1 on the display unit 250 based on the sent operation screen data, as shown in FIG.

[0073] Since the input function activation signal is sent to the terminal device 20, the terminal device 20 displays the software keyboard 600 of the terminal device 20 on the lower half of the operation screen 530-1, as shown in Fig. 13. The display position of the software keyboard 600 may be anywhere on the display unit 250, and the position can be moved by the user.

[0074] The user inputs data using the software keyboard 600, converts the characters using an IME (Input Method Editor) of the terminal device 20, and sends the input data to the image forming device .

[0075] The image forming apparatus 10 displays the input data in the input field 531, and transmits the data of the operation screen 530 to the terminal device 20, where it is reflected on the same operation screen 530-1.

[0076] [1.5 Effects] In this way, the user can use the input function of a terminal device that is familiar to the user or has sufficient functions, improving operability and input efficiency. Also, there is no need to provide the input function of a terminal device in the image forming apparatus, which reduces the cost of incorporating the function.

[0077] [2. Second embodiment] In the image forming device of the second embodiment, when remotely operated from a terminal device, when a user performs an operation that uses the input function of the terminal device on an input field (e.g., long press, double click, etc.), the input function of the terminal device is launched and used to perform the input operation.

[0078] The system configuration and the configuration of each device are the same as in the first embodiment, so a description thereof will be omitted.

[0079] [2.1 Processing flow] [2.1.1 Processing of image forming device] The remote control process of the image forming apparatus according to the second embodiment is the same as the flowchart shown in Fig. 5, and the description will be omitted. The input operation process of the image forming apparatus in step S110 shown in Fig. 5 will be described. Fig. 14 is a flowchart showing the input operation process of the image forming apparatus according to the second embodiment.

[0080] When the operation event signal transmitted from the terminal device 20 is a designation operation for an input field, the control unit 100 of the image forming apparatus 10 performs an input operation process (step S110). The control unit 100 checks whether the operation event signal is an operation using the terminal input function (step S152). If the operation is an operation using the terminal input function (step S152; Yes), the control unit 100 transmits an input function activation signal to the terminal device 20 (step S156). The control unit 100 receives input data by the terminal input function from the terminal device 20 via the communication unit 170 (step S158).

[0081] If the operation does not utilize the terminal input function (step S152; No), the control unit 100 receives an operation event signal from the terminal device 20 via the communication unit 170 (step S160), and performs processing using the input function of the image forming device based on that signal (step S162).

[0082] [2.1.2 Terminal device processing] The remote operation process of the terminal device according to the second embodiment is the same as the flowchart shown in Fig. 7, and the description will be omitted. The input operation process of the terminal device in step S204 shown in Fig. 7 will be described. Fig. 15 is a flowchart showing the input operation process of the terminal device according to the second embodiment.

[0083] A user uses the operation unit 260 of the terminal device 20 to perform an operation to use (activate) an input function of the terminal device 20. For example, an operation such as a long press or a double touch is registered in advance. In response to this operation, the control unit 200 of the terminal device 20 generates an operation event signal to use (activate) the terminal input function (step S252). The control unit 200 transmits the operation event signal to the image forming apparatus 10 via the communication unit 270 (step S254).

[0084] Control unit 200 receives an input function activation signal from image forming apparatus 10 via communication unit 270 within a predetermined time (step S256). Control unit 200 activates the terminal input function (step S258). Control unit 200 generates input data by input operation from operation unit 260 using the terminal input function (step S260). Then, control unit 200 transmits the input data to image forming apparatus 10 via communication unit 270 (step S262).

[0085] [2.2 Example of operation] A specific example of the remote control process of the second embodiment will be described with reference to the operation screen of FIG. Fig. 16 is the same as the display screen of the terminal device in Fig. 12, and a description of the configuration will be omitted. It is assumed that the user touches and holds the subject input field 531-1 with his / her finger. If a long press is registered in the image forming device 10 as an operation for activating the terminal input function, an operation event signal of this operation is sent from the terminal device 20 to the image forming device 10, and the image forming device 10 sends an input function activation signal to the terminal device 20. In response to this, the terminal device 20 displays the software keyboard of the terminal device 20, as shown in Fig. 13. The user uses this software keyboard to convert characters using the IME of the terminal device 20.

[0086] In addition, when it is desired to use the input function of the image forming apparatus, the input function of the image forming apparatus may be used by performing another operation such as a short one-touch on an input field. The switching of the input function is not limited to this, and it is sufficient to set the manner of each operation.

[0087] [2.3 Effects] In this way, the user can easily switch the input function of the image forming apparatus to the input function of the terminal device that the user is familiar with, improving operability and input efficiency. Also, there is no need to provide the input function of the terminal device in the image forming apparatus, which reduces the cost of incorporating the function.

[0088] [3. Third embodiment] The image forming apparatus according to the third embodiment displays a message indicating that an input function of a terminal device should be used for an input field.

[0089] The system configuration, the configuration of each device, and the process flow are the same as those in the first and second embodiments, so a description thereof will be omitted.

[0090] [3.1 Example of operation] FIG. 17 is an explanatory diagram showing a subject entry operation screen displayed on the display unit of the terminal device according to the first embodiment and a software keyboard of the terminal device.

[0091] The operation screen in FIG. 17 is the same as the operation screen of the terminal device 20 in FIG. 13, so a description of the configuration will be omitted. The color of the subject input field 531-1 is changed, and furthermore, semi-transparent text "Use of input function of terminal device" is displayed in the input field. This notifies the user that the subject input field will use the input function of the terminal device.

[0092] [3.2 Effects] In this way, by indicating in the input field that the input function of the terminal device is to be used, the user knows that the input function of the terminal device is available, and can perform operations efficiently without causing confusion.

[0093] [4. Modifications] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and designs that do not deviate from the gist of the present invention are also included in the scope of the claims.

[0094] In addition, the programs that run on each device in the embodiments are programs that control the CPU and the like (programs that make a computer function) so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (e.g., RAM) during processing, and is then stored in various ROMs and HDDs, and is read, modified, and written by the CPU as necessary.

[0095] Here, the recording medium for storing the program may be any non-transitory recording medium, such as a semiconductor medium (e.g., a ROM or a non-volatile memory card), an optical recording medium or a magneto-optical recording medium (e.g., a DVD (Digital Versatile Disk), an MO (Magneto Optical Disk), an MD (Mini Disk), a CD (Compact Dick), or a BD (Blu-ray Disc (registered trademark))), or a magnetic recording medium (e.g., a magnetic tape, a flexible disk, etc.). Furthermore, not only are the functions of the above-mentioned embodiments realized by executing the loaded program, but the functions of the present invention may also be realized by processing in cooperation with an operating system or other application programs, etc., based on instructions from the program.

[0096] In addition, when distributing the program on the market, the program can be stored in a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server computer is of course included in the present invention.

[0097] In addition, some or all of the devices in the above-mentioned embodiments may be realized as an LSI (Large Scale Integration), which is a typical integrated circuit. Each functional block of each device may be individually formed into a chip, or some or all of them may be integrated into a chip. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI appears due to advances in semiconductor technology, it is of course possible to use an integrated circuit based on that technology. [Explanation of symbols]

[0098] 1: Remote control system 10: Image forming device 20: Terminal device 30: Network 100: Control unit 120: Storage section 130: Document reading section 140: Image forming unit 150:Display section 160:Operation unit 170: Communications Department 200: Control section 220: Storage section 250:Display section 260:Operation unit 270: Communications Department 500, 500-1: Operation screen 501: Destination input field 502, 502-1: Subject input field 503: File name input field 504 :Display 530, 530-1: Operation screen 531, 531-1: Subject entry field 532, 532-1: Software keyboard 600: Software keyboard

Claims

1. A display unit that displays an operation screen; A communication unit for transmitting and receiving data or signals to and from a terminal device; A control unit; Equipped with The control unit: displaying the operation screen including a display indicating that remote control is being performed on the display unit; Transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, displaying the input operation screen on the display unit; An input function activation signal for activating an input function of the terminal device is transmitted to the terminal device. Image forming device.

2. A display unit that displays an operation screen; A communication unit for transmitting and receiving data or signals to and from a terminal device; A control unit; Equipped with The control unit: displaying the operation screen including a display indicating that remote control is being performed on the display unit; Transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation for designating an input field is performed on the operation screen of the terminal device, displaying an input operation screen for inputting information including a destination on the display unit; An input function activation signal for activating an input function of the terminal device is transmitted to the terminal device. Image forming device.

3. An image forming apparatus; A terminal device; having The terminal device and the image forming device transmit and receive data or signals, The image forming apparatus, Displaying an operation screen including a display indicating that remote operation is in progress; Transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, Displaying the input operation screen, Transmitting data of the input operation screen to the terminal device; The terminal device receiving data of the operation screen from the image forming apparatus; Displaying the operation screen based on the data of the operation screen; When the data of the input operation screen is received, displaying the input operation screen based on data of the input operation screen; Displaying the input functions of the terminal device system.

4. An image forming apparatus; A terminal device; having The terminal device and the image forming device transmit and receive data or signals, The image forming apparatus, Displaying an operation screen including a display indicating that remote operation is in progress; Transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation for designating an input field is performed on the operation screen of the terminal device, Display an input operation screen for inputting information including a destination, Transmitting data of the input operation screen to the terminal device; The terminal device receiving data of the operation screen from the image forming apparatus; Displaying the operation screen based on the data of the operation screen; When the data of the input operation screen is received, displaying the input operation screen based on data of the input operation screen; Displaying the input functions of the terminal device system.

5. The system according to claim 3 or 4, wherein the input functions are displayed in an overlapping manner on the input operation screen of the terminal device.

6. 5. The system according to claim 3, wherein the input functions are displayed in a movable state on the input operation screen of the terminal device.

7. 5. The system according to claim 3, wherein the input function is displayed below an input field on the input operation screen of the terminal device.

8. 5. The system according to claim 3, wherein the input operation screen of the terminal device notifies the user that the input function of the terminal device is available.

9. 5. The system according to claim 4, wherein the input operation screen of the terminal device notifies the input field that an input function of the terminal device is available.

10. 5. The system according to claim 3, wherein the input function of the terminal device is a software keyboard.

11. a display step for displaying an operation screen; A communication step of transmitting and receiving data or signals to and from a terminal device; A control step; Including, The control step comprises: displaying the operation screen including a display indicating that remote control is being performed in the display step; Transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation is performed on the terminal device to call up an input operation screen for inputting information including a destination, displaying the input operation screen in the display step; An input function activation signal for activating an input function of the terminal device is transmitted to the terminal device. Control methods.

12. a display step for displaying an operation screen; A communication step of transmitting and receiving data or signals to and from a terminal device; A control step; Including, The control step comprises: displaying the operation screen including a display indicating that remote control is being performed in the display step; Transmitting data of the operation screen including a display indicating that remote operation is being performed to the terminal device; When an operation for designating an input field is performed on the operation screen of the terminal device, displaying an input operation screen for inputting information including a destination in the display step; An input function activation signal for activating an input function of the terminal device is transmitted to the terminal device. Control methods.

Images