Image forming system, and method for controlling the image forming system

Abstract

During remote operation, there was a risk that the correct location indicated by the touch icon could become unclear. [Solution] An image forming system in which an image forming apparatus and a remote control device are connected to each other via a network, wherein the image forming apparatus includes a second display unit that displays an operation screen, and the remote control device includes a first display unit that displays the contents of the second display unit, and a remote control unit that changes the display format according to the position of the touch icon when remotely operating and displays it on the second display unit.

Description

Technical Field

[0001] The present invention relates to an image forming system and a control method for the image forming system.

Background Art

[0002] Conventionally, as shown in Patent Document 1, a system for remotely operating a copying machine as an image forming apparatus from a remote operation terminal as a remote operation device is known.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When remotely operating, an operator of the remote operation device can guide an operation to a user of the image forming apparatus using a touch icon or the like. However, in the above-described system, when the touch icon indicates near the edge of the screen, it may protrude from the screen area. During remote operation, the user of the image forming apparatus may not know the correct position indicated by the touch icon and may be led to an incorrect operation.

Means for Solving the Problems

[0005] An image forming system in which an image forming apparatus and a remote operation device are communicably connected via a network, the image forming apparatus including a second display unit that displays an operation screen, the remote operation device including a first display unit that displays the display content of the second display unit, and a remote control unit that causes the second display unit to display in a state where the display form is changed according to the position of a touch icon during remote operation.

[0006] A method for controlling an image forming system in which an image forming apparatus and a remote control device are connected to communicate via a network, wherein the image forming apparatus displays an operation screen, and the remote control device displays the contents of the operation screen, and displays them on the image forming apparatus in a state where the display format changes according to the position of the touch icon when remotely operating. [Brief explanation of the drawing]

[0007] [Figure 1] A block diagram showing the configuration of the image forming system. [Figure 2] A flowchart of the main routine in an information processing device, illustrating how to control the display of a pointer image. [Figure 3] A flowchart of a subroutine in an information processing device that shows a control method for determining the rotation angle of a pointer image. [Figure 4] A flowchart of a subroutine in an information processing device that shows a control method for rotating a pointer image to determine the angle at which it does not extend beyond the screen area, and whether it is enabled or disabled. [Figure 5] A schematic diagram showing the first display information, which is the initial screen of an image forming apparatus. [Figure 6] A schematic diagram showing the first display information of an information processing device and the second display information of an image forming apparatus, which display a first pointer image that does not extend beyond the screen area during remote operation. [Figure 7] A schematic diagram showing the first display information and the second display information, which display a second pointer image that extends beyond the screen area during remote operation. [Figure 8] A schematic diagram showing the first and second display information, which displays a third pointer image that does not extend beyond the screen area by rotating the second pointer image shown in Figure 7 by an angle θ. [Modes for carrying out the invention]

[0008] 1. Configuration of the image forming system As shown in Figure 1, the image forming system 1 comprises an information processing device 10, which is a remote control device, and an image forming apparatus 20. The information processing device 10 can remotely control the image forming apparatus 20. The information processing device 10 and the image forming apparatus 20 are connected to each other so that they can communicate with one another, for example, via a WAN (Wide Area Network) 30 such as the Internet. Note that the WAN 30 may also be a network such as a LAN (Local Area Network). The information processing device 10 and the image forming apparatus 20 are each assigned, for example, a unique IP address (Internet Protocol Address). These devices can communicate with a communication destination by specifying the IP address assigned to the destination. These devices can communicate using protocols such as HTTP (Hypertext Transfer Protocol) and HTTPS (Hypertext Transfer Protocol Secure).

[0009] The information processing device 10 is, for example, a computer. The information processing device 10 is composed of a first control unit 11, a first communication unit 12, and a first storage unit 13. The first control unit 11, which is a remote control unit, comprehensively controls each part of the information processing device 10. The first control unit 11 is composed of a CPU (Central Processing Unit), a UART (Universal Asynchronous Receiver Transmitter) for managing input / output, and logic circuits such as an FPGA (Field Programmable Gate Array) and a PLD (Programmable Logic Device). The first control unit 11 is also called a processor. In addition, the CPU of the first control unit 11 is sometimes specifically referred to as the processor.

[0010] The first storage unit 13 is composed of memory such as flash ROM (Read Only Memory) and HDD (Hard Disk Drive), which are rewritable non-volatile memories, and RAM (Random Access Memory), which are volatile memories. The non-volatile memory of the first storage unit 13 may also include an SSD (Solid State Drive). The CPU of the first control unit 11 reads the program stored in the non-volatile memory of the first storage unit 13 and executes it using the RAM of the first storage unit 13 as a working area. Furthermore, the first memory unit 13 stores the functions of a web browser, which the CPU of the first control unit 11 reads and executes, allowing it to operate as a web client, as described later.

[0011] The first communication unit 12 is configured to include a circuit capable of communication wirelessly or via a wire. The first communication unit 12 has an antenna in the case of wireless communication and a connector in the case of wired communication. The first communication unit 12 can communicate via the WAN 30. While the information processing device 10 uses the first communication unit 12 to send and receive data with the communication destination, for the sake of brevity, this process will be omitted in the following explanation. The same applies to the second communication unit 22 of the image forming apparatus 20, which will be described later.

[0012] Furthermore, the information processing device 10 includes a first input unit 14 and a first display unit 15. The first input unit 14 and the first display unit 15 are the so-called user interface for the operator of the information processing device 10. The first input unit 14 and the first display unit 15 are, for example, touch panel displays. In this case, the first input unit 14 is composed of a detection panel, and the first display unit 15 is composed of a display panel. The detection panel is constructed by overlaying it on the display panel. The detection panel can detect the operator's finger or other actions using methods such as capacitive, resistive, or optical detection. Incidentally, the first input unit 14 may be a keyboard, a mouse, a button, or the like. The first display unit 15 may be a stand-type liquid crystal display or the like.

[0013] The image forming apparatus 20 includes a second control unit 21, a second communication unit 22, a second storage unit 23, a second input unit 24, and a second display unit 25. Since these configurations of the image forming apparatus 20 are substantially the same as those of the information processing apparatus 10 described above, the description thereof is omitted. Incidentally, the function of a Web server is stored in the second storage unit 23, read out and executed by the CPU of the second control unit 21, and can operate as a Web server as described later. The second input unit 24 and the second display unit 25 are user interfaces for the user of the image forming apparatus 20.

[0014] The image forming apparatus 20 includes a printing unit 26. The printing unit 26 includes a printing mechanism such as a head and a conveyance roller (both not shown). Examples of the medium to be printed include plain paper, synthetic paper, photographic paper, film, and the like. The head is, for example, an inkjet method, and ejects and prints a plurality of colors of ink such as CMYK (Cyan, Magenta, Yellow, Black). Incidentally, the head may be a thermal method, an electrophotographic method, or the like.

[0015] The image forming apparatus 20 includes an image acquisition unit 27. The image acquisition unit 27 has a scanner (not shown) and can acquire an image of an original as a medium. Based on an instruction from the information processing apparatus 10 or detection by the second input unit 24, the image forming apparatus 20 can perform media processing such as printing, scanning, copying, and FAX by the printing unit 26, the image acquisition unit 27, and the like. Such an image forming apparatus 20 is also referred to as a multifunction peripheral.

[0016] 2. Control Method of Image Forming System Referring to the flowcharts shown in Figures 2 to 4 and the schematic diagrams shown in Figures 5 to 8, a control method in which the information processing device 10 remotely controls the image forming apparatus 20 will be explained. Figures 5 to 8 show the results when the second display information D2, described later, is displayed as a screen such as a display by the second display unit 25 of the image forming apparatus 20. Figures 6 to 8 also show the results when the first display information D1, described later, is displayed as a screen such as a display by the first display unit 15 of the information processing apparatus 10.

[0017] For the sake of brevity, the information processing device 10 will be simply referred to as "device 10" below. Furthermore, the process by which the first control unit 11 of device 10 reads the program for executing the remote control method stored in the first storage unit 13 and performs the processes described later will be omitted. Similarly, the process by which the second control unit 21 of the image forming apparatus 20 reads the program for executing the remote control method stored in the second storage unit 23 and performs the processes described later will also be omitted.

[0018] As shown in Figure 5, the image forming apparatus 20 first displays the second display information D20 related to the initial screen using the second display unit 25. The second display information D20 and other information that can be displayed by the second display unit 25, as shown in Figures 5 to 8, are collectively referred to as the second display information D2. Similarly, the first display information D11 and the like shown in Figures 6 to 8, which can be displayed by the first display unit 15 of the device 10, are collectively referred to as first display information D1. In the following description, the display of the second display information D2 by the second display unit 25 of the image forming apparatus 20 will be omitted. Similarly, the display of the first display information D1 by the first display unit 15 of the apparatus 10 will be omitted.

[0019] As shown in Figures 5 to 8, the second display information D2 is displayed on the second display unit 25, such as a display, corresponding to two-dimensional coordinates of the X and Y axes, with "0" representing zero as the base point. The coordinates indicating this second display information D2 also correspond to the addresses of memory such as RAM in the second storage unit 23 of the image forming apparatus 20. In other words, the image forming apparatus 20 can write and read the second display information D2 sequentially from the memory addresses of the second storage unit 23, and display it in accordance with the coordinates of the second display unit 25 as shown in Figures 5 to 8. Similarly, the device 10 can write, read, and display the first display information D1, corresponding to the memory address of the first storage unit 13 and the coordinates of the first display unit 15, such as a display, as shown in Figures 6 to 8.

[0020] As shown in Figures 5 to 8, the second display information D2, such as the second display information D20, is displayed within the range of the screen area (X1, Y1) from the coordinate base point "0". Hereinafter, the range from the coordinate base point "0" to the screen area (X1, Y1) will simply be referred to as the screen area or screen area (X1, Y1). The screen area is the range that the image forming apparatus 20 can display on the second display unit 25. The same applies when the device 10 displays the first display information D1 using the first display unit 15, as shown in Figures 6 to 8.

[0021] The second display information D20 displays the first menu M1 at the top of the screen area. For example, the first menu M1 includes icons indicating functions such as "Copy," "Scan," "Fax," "Print from Memory," "Status," and "Settings." Furthermore, the second display information D2 displays the second menu M2 in the lower left corner of the screen area. For example, the second menu M2 includes icons indicating functions such as "Home" and "Help". In addition, the second display information D2 displays the third menu M3 in the lower right corner of the screen area, which includes icons indicating functions such as "Scroll". Similarly, as shown in Figures 6 to 8, the device 10 can display the first display information D1, which includes each menu.

[0022] Users of the image forming apparatus 20 can select any of the icons in each menu by pointing to them using the second input unit 24. The image forming apparatus 20 can detect the icon selected by the second input unit 24 and perform processing related to the function corresponding to the selected icon. For example, suppose a user views the second display information D2 on the second display unit 25 of the image forming apparatus 20 and selects the "copy" icon for the first menu M1 using the second input unit 24. The image forming apparatus 20 can detect that the "copy" icon has been selected using the second input unit 24, acquire an image of the original using the image acquisition unit 27, and execute the process of making a copy to be printed using the printing unit 26.

[0023] Incidentally, users of the image forming apparatus 20 may contact the support center for the image forming apparatus 20 when problems occur with the image forming apparatus 20 or when they are unsure how to operate it. Based on requests from users of the image forming apparatus 20, operators at the support center may remotely control the image forming apparatus 20 using device 10.

[0024] In remote operation, the operator can use the device 10 to display the same information displayed on the screen area (X1, Y1) of the first display unit 15 of the image forming apparatus 20 in the screen area (X1, Y1) of the second display unit 25 of the image forming apparatus 20. Specifically, the operator can use device 10 to display the pointer, described later, which is displayed on the first display unit 15 of device 10, on the second display unit 25 of the image forming apparatus 20, and can instruct remote operation. The operator can guide the user of the image forming apparatus 20 to perform actions such as selecting an icon at the location indicated by the pointer. The flowcharts shown in Figures 2 to 4 specifically illustrate a control method in which the device 10 remotely controls the image forming apparatus 20, primarily through the display of a pointer, under the operation of an operator.

[0025] As shown in Figure 2, the device 10 starts processing. At the start of processing, although not shown in Figure 2, the device 10 operates a web browser based on the operator's input to the first input unit 14 and requests remote operation from the image forming apparatus 20. The image forming apparatus 20 operates as a web server and, based on the remote operation request from the information processing device 10, transmits the displayed second display information D20 via a web page or the like.

[0026] Device 10 acquires the second display information D20 transmitted from the image forming apparatus 20 (S101). Furthermore, if the user of the image forming apparatus 20 has already operated the second input unit 24, for example by performing a "scroll" operation on the third menu M3, and the initial screen, the second display information D20, has been updated, the image forming apparatus 20 can transmit the updated second display information D20. In this way, the device 10 can obtain the latest second display information D2 of the image forming apparatus 20. During remote operation, the first display unit 15 of the device 10 can acquire and display the second display information D2, which is the display content of the second display unit 25. In addition, the second display unit 25 of the image forming apparatus 20 can display the second display information D2, which is the operation screen.

[0027] As shown in Figure 6, the device 10 stores the acquired second display information D20 as first display information D11 in the first storage unit 13 and can display it using the first display unit 15. At this time, the device 10 can superimpose remote display information R, indicating "remote operation in progress," onto the first display information D11 at the bottom center of the screen area. The remote display information R is stored in the first storage unit 13.

[0028] The device 10 detects the operator's input via the first input unit 14 and acquires it as the coordinate position of the first pointer image P1 (S102). For example, the operator's input to the first input unit 14 is a mouse click. The device 10 can acquire the clicked position in the screen area (X1, Y1) and associate it with coordinates.

[0029] The first pointer image P1, and the second to third pointer images P2 and P3 described later, are collectively referred to simply as pointer P. The first to third pointer images P1 and P3 are the same image, although their positions and angles differ. Furthermore, the first to third instruction points B1 to B3 described later will be collectively referred to simply as instruction point B, the first to third starting points C1 to C3 described later will be collectively referred to simply as starting point C, and the first to third areas A1 to A3 described later will be collectively referred to simply as area A. The sizes of the first to third areas A3 are assumed to be the same.

[0030] As shown in Figures 6 to 8, for example, Pointer P is a touch icon, and an image of a "hand" is used. A touch icon is also called a "pointing finger icon." In this embodiment, it will be referred to as Pointer P to distinguish it from icons such as the first menu M1. The pointer P may be any image other than a "hand," such as an "arrow." The "hand" and "arrow" images are asymmetrical with respect to any direction, such as left, right, up, or down. As described later, when the device 10 rotates the pointer P, the fingertip of the "hand" or the tip of the "arrow" can be used as the rotation center point B. The pointer P contains information such as the "hand" image, point B, starting point C, and area A. This information for the pointer P is also stored in the first storage unit 13. Device 10 generates a pointer P (S103). Specifically, in the coordinates of the screen area (X1, Y1), device 10 uses the position of the acquired pointer P as the reference point B, and draws the pointer P as an image of a "hand" in area A, using the starting point C as the base point.

[0031] Here, "drawing" means that the device 10 writes display-related information to the first storage unit 13 at a memory address in the first storage unit 13 that corresponds to the coordinates of the screen area (X1, Y1). The device 10 can draw by superimposing a pointer P onto the first display information D1 stored in the first storage unit 13. The device 10 can sequentially read the superimposed pointer P, in addition to the first display information D1, from the address of the first storage unit 13, and display it on the first display unit 15 in correspondence with the coordinates of the screen area (X1, Y1). The same applies to the image forming apparatus 20.

[0032] For example, as shown in Figure 6, suppose the operator clicks the "Settings" icon of the first menu M1 in the first display information D11 using the mouse. Device 10 uses the position clicked by the mouse as the first instruction point B1 and draws it so that it is the position of the fingertip of the index finger in the "hand" image of the first pointer image P1. Specifically, the device 10 uses the position of the first pointer image P1 acquired in the screen area (X1, Y1) as the first instruction point B1, and the first starting point C1 as the base point for drawing, to draw the first pointer image P1 in the first area A1, superimposed on the first display information D1. The first pointer image P1 can be displayed superimposed on the first display information D1.

[0033] In this way, the device 10 acquires the position of pointer P (S102), generates pointer P by drawing it using the indicator point B, the starting point C, and the area A (S103), and can display pointer P superimposed on the first display information D1 based on the second display information D2 (S101) acquired from the image forming apparatus 20. When device 10 transmits the first pointer image P1 to image forming apparatus 20, as shown in Figure 6, the image forming apparatus 20 can superimpose the received first pointer image P1 onto the second display information D21 and display it using the second display unit 25.

[0034] Next, device 10 processes the subroutine "Sub-A" (S200). Hereafter, subroutine "Sub-A" will simply be referred to as "Sub-A". Referring to Figure 3, we will explain "Sub-A," which processes the angle θ to rotate pointer P. As described above, the device 10 attempts to draw, for example, by superimposing the pointer P onto the first display information D1 stored in the first storage unit 13. At this time, the device 10 determines whether the area occupied by area A from the starting point C of the pointer P extends beyond the screen area (X1, Y1) of the first display information D1 (S201). When device 10 determines that the pointer P does not extend beyond the screen area (S201: NO), it sets the angle θ to 0 degrees (S203) and returns to the main routine shown in Figure 2 as processing information for "Sub-A".

[0035] On the other hand, if device 10 determines that the pointer P is outside the screen area (S201:YES), it performs the processing of subroutine "Sub-B" (S300). Furthermore, in the following, if device 10 determines that pointer P is outside the screen area, including when it is rotating pointer P, it does not need to display pointer P on the image forming apparatus 20. In this case, the user of the image forming apparatus 20 may not know the correct position that pointer P is pointing to. This is because the user may be led to take incorrect actions, such as selecting an icon in the wrong position.

[0036] Let's explain an example where the pointer P extends beyond the screen area. As shown in Figure 7, suppose the operator clicks the "Scroll" icon of the third menu M3 in the first display information D12 using the mouse. Device 10 uses the position of the "Scroll" icon clicked by the mouse as the second instruction point B2, and sets it as the position of the index finger in the "Hand" image of the second pointer image P2, and attempts to draw the second pointer image P2.

[0037] In other words, the device 10 attempts to draw the second pointer image P2 in the second area A2 within the screen area (X1, Y1), using the position of the acquired second pointer image P2 as the second instruction point B2 and the second starting point C2 as the drawing base point. At this time, as shown in Figure 7, the device 10 can determine that the area occupied by area A from the starting point C of the second pointer image P2 extends beyond the screen area (X1, Y1) of the first display information D12 (S201: YES).

[0038] Specifically, the device 10 can determine that the area occupied by area A in the second pointer image P2 exceeds X1 of the screen area (X1, Y1) in the X-axis direction. Furthermore, the device 10 can determine that, with respect to the second pointer image P2, the area occupied by area A extends downwards beyond the position of "0", which is the base point of the screen area (X1, Y1), in the Y-axis direction, and reaches the negative region. If device 10 transmits this second pointer image P2 to image forming apparatus 20, then, as shown in Figure 7, image forming apparatus 20 superimposes the received second pointer image P2 onto the second display information D22 and displays it using the second display unit 25. The second pointer image P2 will be displayed extending beyond the screen area (X1, Y1) of the second display information D22.

[0039] Referring to Figure 4, the process of the device 10 rotating the pointer P and determining the effective angle θ or invalid angle of the subroutine "Sub-B" (S300) will be explained. In the following, the subroutine "Sub-B" will be simply referred to as "Sub-B". Device 10 initializes the angle θ for rotating the pointer P to 0 degrees (S301). Device 10 determines whether the area of ​​area A containing the pointer P rotated by angle θ extends beyond the screen area (X1, Y1) of the first display information D1 (S302).

[0040] By the way, as mentioned above with reference to Figure 7, in the "Sub-A" process shown in Figure 3, the device 10 has already determined that the second pointer image P2 extends beyond the screen area (X1, Y1) of the first display information D12 (S201: YES). Therefore, even in the initial determination (S302), the device 10 can determine that the second pointer image P2 extends beyond the screen area (X1, Y1) of the first display information D12 (S302: YES).

[0041] Next, the device 10 adds a predetermined angle, such as 1 degree, to the angle θ (S303), and rotates the area A containing the pointer P with the indicated point B as the center of rotation. Device 10 determines whether the added angle θ is 360 degrees (S304), and if it determines that it is 360 degrees (S304: YES), it determines that the angle θ is invalid (S305). Device 10 records the fact that the angle θ is invalid as processing information for "Sub-B" and returns to the processing for "Sub-A" shown in Figure 3. In other words, device 10 can determine that the pointer P will go outside the screen area even if the angle θ is changed from 0 degrees to 360 degrees. Since device 10 cannot find an angle θ in which the pointer P does not go outside the screen area, it records this as invalid in the processing information of "Sub-B".

[0042] On the other hand, if the device 10 determines that the added angle θ has not reached 360 degrees (S304: NO), it determines again whether the area of ​​area A containing the pointer P rotated by the added angle θ extends beyond the screen area (X1, Y1) of the first display information D1 (S302). In this way, the device 10 adds an angle θ (S303) until it reaches 360 degrees (S304:NO), and continues these processes until it determines that the area of ​​area A rotated by the added angle θ with respect to the pointer P does not extend beyond the screen area (X1,Y1) (S302:NO).

[0043] If device 10 determines that the area of ​​area A rotated by the added angle θ with respect to pointer P does not extend beyond the screen area (X1, Y1) (S302: NO), it validates the added angle θ (S306), and returns to the processing of "Sub-A" shown in Figure 3, with this information along with the added angle θ as processing information for "Sub-B".

[0044] Specifically, an example in which the device 10 rotates the pointer P by an angle θ will be described in detail with reference to Figures 7 and 8. As shown in Figure 7, the device 10 rotates the second area A2 around the second instruction point B2 with respect to the second pointer image P2, while adding a predetermined angle θ to it. As a result of the rotation, the device 10 can draw the third pointer image P3 within the third area A3, which is the same size as the second area A2, using the third starting point C3 (which is an updated version of the second starting point C2) as the base point for drawing, as shown in Figure 8. Furthermore, the third starting point C3 may be positioned as the corner of the third area A3 to the lower right of the third indicated point B3, corresponding to the second starting point C2 relative to the second area A2.

[0045] As shown in Figure 8, the device 10 can display the third pointer image P3 such that the area occupied by the third area A3, with respect to the third starting point C3, does not extend beyond the screen area (X1, Y1) of the first display information D13. In the example in Figure 8, the added angle θ is 180 degrees.

[0046] As described above, once device 10 has completed the "Sub-B" process shown in Figure 4, it returns to the "Sub-A" process shown in Figure 3. Device 10 determines whether the added angle θ is valid in the processing information of "Sub-B" (S202). If Device 10 determines that the angle θ is valid (S202:YES), it uses the angle θ obtained in "Sub-B" as the processing information for "Sub-A" and returns to the processing of the main routine shown in Figure 2. On the other hand, if device 10 determines that the angle θ is invalid (S202: NO), it sets the angle θ to 0 degrees (S203), uses this as processing information for "Sub-A", and returns to the processing of the main routine shown in Figure 2.

[0047] Device 10 determines whether the angle θ is not 0 degrees in the processing information of "Sub-A" (S104). This angle θ is also the processing information returned from "Sub-B" (S300). If the device 10 determines that the angle θ is not 0 degrees (S104: YES), it rotates the area A containing the pointer P around the indicator point B by an angle θ (S105). Hereafter, the rotation of area A containing the pointer P around the indicator point B by the device 10 will be simply referred to as "rotating the pointer P".

[0048] The device 10 displays the first display information D1, which includes a pointer P rotated by an angle θ, using the first display unit 15 (S106). Specifically, the device 10 superimposes the pointer P rotated by an angle θ onto the first display information D1 and displays it so that it does not extend beyond the screen area (X1, Y1). In this way, if the pointer P is in a position that extends beyond the screen area of ​​the first display unit 15, the device 10 can rotate it so that it does not extend beyond the screen area and change the display format for display.

[0049] Next, the device 10 transmits the pointer P rotated by an angle θ to the image forming apparatus 20. The device 10 can then include the pointer P rotated by an angle θ in the second display information D2 and display it on the second display unit 25 for the image forming apparatus 20 (S106). Specifically, the image forming apparatus 20 stores the received pointer P rotated by an angle θ in the second storage unit 23. The image forming apparatus 20 can superimpose the pointer P rotated by an angle θ onto the second display information D2 and draw it so that it does not extend beyond the screen area (X1, Y1). In this way, if the pointer P is in a position that extends beyond the screen area of ​​the second display unit 25 of the image forming apparatus 20, the apparatus 10 can rotate it so that it does not extend beyond the screen area and change the display format for display.

[0050] Alternatively, the device 10 may transmit the entire first display information D1, which includes a pointer P rotated by an angle θ, to the image forming apparatus 20, store it as second display information D2 in the second storage unit 23, and display it using the second display unit 25. In this way, when the device 10 is operating remotely, if the pointer P extends beyond the screen area (X1, Y1), it rotates it so that it does not extend beyond the screen area, and the image can be displayed on the image forming apparatus 20. Then the device 10 terminates the process.

[0051] In this way, when the device 10 is operated remotely, it can be rotated according to the position of the pointer P and displayed on the second display unit 25 of the image forming apparatus 20 with the display format of the pointer P changed. The device 10 can also display on the first display unit 15 in the same way. In remote operation, the user of the image forming apparatus 20 can understand the correct position indicated by the pointer P, and the operator of the apparatus 10 can guide the user to the correct operation.

[0052] Furthermore, if the pointer P is positioned outside the screen area of ​​the second display unit 25 of the image forming apparatus 20, or if the pointer P is rotated, the device 10 may change at least one of the display modes of the pointer P, such as color, size, or illumination state. Changing the illumination state may involve, for example, blinking. The device 10 can alert the user of the image forming apparatus 20. The device 10 can also display a similar message on the first display unit 15.

[0053] Thus, for example, in the case of the second pointer image P2 shown in Figure 7, the device 10 determines that it extends beyond the screen area of ​​the first display information D12. The device 10 rotates the second pointer image P2 by an angle θ to become the third pointer image P3, as shown in Figure 8, and can display it by superimposing it on the first display information D13 so that it does not extend beyond the screen area. Furthermore, the device 10 transmits the second pointer image P2, which has been rotated by an angle θ, to the image forming apparatus 20, and as shown in Figure 8, it can be superimposed on the second display information D23 as a third pointer image P3 so that it does not extend beyond the image boundaries.

[0054] On the other hand, if the device 10 determines that the angle θ is 0 degrees (S104: NO), it does not rotate the pointer P. The device 10 displays the area A containing the pointer P that is not rotated as the first display information D1 using the first display unit 15 (S106). Furthermore, the device 10 transmits a non-rotating pointer P to the image forming apparatus 20, which includes it in the second display information D2 and displays it using the second display unit 25.

[0055] Thus, for example, as shown in the first pointer image P1 in Figure 6, if the area occupied by area A from the starting point C does not extend beyond the screen area (X1, Y1) of the first display information D1, the device 10 can display area A including the pointer P without rotating it. Furthermore, the device 10 transmits a non-rotating pointer P to the image forming apparatus 20. The image forming apparatus 20 receives the non-rotating pointer P, stores it in the second storage unit 23, and includes it in the second display information D2, which can then be displayed by the second display unit 25.

[0056] Alternatively, the device 10 may transmit the entire first display information D1, which includes a non-rotating pointer P, to the image forming apparatus 20, store it as second display information D2 in the second storage unit 23, and display it using the second display unit 25. Thus, if the pointer P does not extend beyond the screen area (X1, Y1), the device 10 displays it without rotating it and terminates the process. The user of the image forming apparatus 20 can continue to understand the correct position indicated by the pointer P, and the operator of the apparatus 10 can guide the user to the correct action.

[0057] As described above, the image forming system 1 is configured such that the image forming apparatus 20 and the remote control device 10 are connected to each other via a network such as a WAN 30. The image forming apparatus 20 includes a second display unit 25 that displays second display information D2, which is an operation screen. The device 10 includes a first display unit 15 that displays the second display information D2, which is the content displayed on the second display unit 25, as the first display information D1. The device 10 also includes a first control unit 11, which is a remote control unit that changes the display format according to the position of the pointer P, which is a touch icon, when remotely operated, and displays it on the second display unit 25.

[0058] With this configuration of the image forming system 1, when the device 10 is operated remotely, it can be rotated according to the position of the pointer P and the display format of the pointer P can be changed and displayed on the second display unit 25 of the image forming apparatus 20. The device 10 can also display similarly on the first display unit 15. In remote operation, the user of the image forming apparatus 20 can understand the correct position indicated by the pointer P, and the operator of the apparatus 10 can guide the user to the correct operation.

[0059] Although embodiments have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and may be modified, substituted, deleted, etc., as long as it does not depart from the spirit of this invention. [Explanation of Symbols]

[0060] 1…Image forming system, 10…Information processing device, 11…First control unit, 12…First communication unit, 13…First storage unit, 14…First input unit, 15…First display unit, 20…Image forming apparatus, 21…Second control unit, 22…Second communication unit, 23…Second storage unit, 24…Second input unit, 25…Second display unit, 26…Printing unit, 27…Image acquisition unit, 30…WAN, A1…First area, A2…Second area, A3…Third area Rear, B1...First indicator point, B2...Second indicator point, B3...Third indicator point, C1...First starting point, C2...Second starting point, C3...Third starting point, D11, D12, D13...First display information, D20, D21, D22, D23...Second display information, M1...First menu, M2...Second menu, M3...Third menu, P1...First pointer image, P2...Second pointer image, P3...Third pointer image.

Claims

1. An image forming system in which an image forming apparatus and a remote control device are connected to communicate via a network, The image forming apparatus includes a second display unit that displays an operation screen, The remote control device is A first display unit that displays the contents of the second display unit, An image forming system comprising: a remote control unit that changes the display format according to the position of a touch icon when remotely operating the system and displays it on the second display unit.

2. The image forming system according to claim 1, wherein the remote control unit rotates the touch icon so that it does not protrude from the screen area of ​​the second display unit if the touch icon is in a position that protrudes from the screen area of ​​the second display unit, thereby changing the display form.

3. The image forming system according to claim 2, wherein the remote control unit changes at least one of the color, size, and illumination state of the display form of the touch icon when the touch icon is in a position that extends beyond the screen area of ​​the second display unit, or when the touch icon is rotated.

4. The image forming system according to claim 2, wherein the remote control unit rotates the touch icon so that it does not protrude from the screen area of ​​the first display unit if the touch icon is in a position that protrudes from the screen area of ​​the first display unit, thereby changing the display form.

5. The remote control device includes a first input unit, The image forming system according to claim 2, wherein the remote control unit rotates the touch icon with the position input by the first input unit as the rotation center.

6. A method for controlling an image forming system in which an image forming apparatus and a remote control device are connected to communicate via a network, The image forming apparatus displays an operation screen, The remote control device is The contents of the aforementioned operation screen are displayed, A control method for an image forming system, which causes the image forming apparatus to display an image in a state where the display format changes according to the position of a touch icon when it is operated remotely.

Images