Information processing system, program, and information processing method

Abstract

To provide an information processing system which can remotely operate a printer with the same sense as direct operation of the printer.SOLUTION: An information processing system comprises a printer and an information processing device. The printer comprises: a first display panel; one or more physical keys which are provided at a distance with respect to the first display panel, and operated in order to operate the printer; and a communication unit which communicates with the information processing device. The information processing device comprises: a second display panel; and a display unit which displays, on the second display panel, a panel object corresponding to the first display panel, and one or more objects which correspond to each of the one or more physical keys and execute the same function as in a case where the corresponding physical key is operated in the printer, so as to have the same positional relationship as that between the first display panel and the one or more physical keys.SELECTED DRAWING: Figure 12

Description

[Technical Field]

[0001] The present invention relates to an information processing system, a program, and an information processing method. [Background technology]

[0002] Conventionally, there has been a demand for remotely controlling a printer connected to a network using an information processing terminal capable of communicating with the printer. As an information processing terminal capable of remotely controlling a printer, for example, an information processing terminal as described in Patent Document 1 is known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-42564 Summary of the Invention [Problem to be solved by the invention]

[0004] When a printer is remotely operated using the information processing terminal described in Patent Document 1, only the screen data information displayed on the printer's display screen is displayed on the display unit of the information processing terminal. If the printer has physical keys that are directly operated to perform a specific operation, information corresponding to the physical keys is not displayed on the display unit of the information processing terminal. Therefore, when a user of the information processing terminal remotely controls the printer to perform an operation that would occur if the user operated the printer's physical keys, the user will have to perform the operation using a different procedure than when operating the printer directly. In this case, the user will remotely control the printer with a different feeling than when operating the printer directly, and may feel a strong sense of discomfort when remotely controlling the printer.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an information processing system that allows a user to remotely operate a printer with the same feeling as when operating the printer directly. [Means for solving the problem]

[0006] One aspect of the present invention is an information processing system having a printer and an information processing device, The printer a first display panel; one or more physical keys provided at a position spaced apart from the first display panel and operated to operate the printer; a communication unit that communicates with the information processing device; and The information processing device includes: a second display panel; and a display unit that displays, on the second display panel, a panel object corresponding to the first display panel and one or more objects that correspond to each of the one or more physical keys and that execute the same function in the printer as when the corresponding physical key is operated, in the same positional relationship as that between the first display panel and the one or more physical keys; The information processing system has the following features. [Effects of the Invention]

[0007] According to one aspect of the present invention, a printer can be remotely operated with the same feeling as when operating the printer directly. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of an information processing system according to an embodiment. [Figure 2] 1 is a block diagram of an information processing system according to an embodiment. [Figure 3] FIG. 1 is a front view of a printer according to an embodiment. [Figure 4] 10 is a diagram illustrating an example of a screen displayed on a display panel of a printer according to an embodiment. [Figure 5] 10 is a diagram illustrating an example of a screen displayed on a display panel of a printer according to an embodiment. [Figure 6] 10 is a diagram illustrating an example of a screen displayed on a display panel of a printer according to an embodiment. [Figure 7]10 is a diagram illustrating an example of a screen displayed on a display panel of a printer according to an embodiment. [Figure 8] 10 is an example of a screen displayed on a display panel of the information processing device according to the embodiment. [Figure 9] 10 is an example of a screen displayed on a display panel of the information processing device according to the embodiment. [Figure 10] 10 is an example of a screen displayed on a display panel of the information processing device according to the embodiment. [Figure 11] 10 is an example of a screen displayed on a display panel of the information processing device according to the embodiment. [Figure 12] 10 is an example of a screen displayed on a display panel of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] The embodiments described below are not limited to the drawings described by the brief description of the drawings.

[0010] A first aspect of the present invention is an information processing system having a printer and an information processing device, The printer a first display panel; one or more physical keys provided at a position spaced apart from the first display panel and operated to operate the printer; a communication unit that communicates with the information processing device; and The information processing device includes: a second display panel; and a display unit that displays, on the second display panel, a panel object corresponding to the first display panel and one or more objects that correspond to each of the one or more physical keys and that execute the same function in the printer as when the corresponding physical key is operated, in the same positional relationship as that between the first display panel and the one or more physical keys; The information processing system has the following features.

[0011] According to a first aspect of the present invention, a printer can be remotely operated with the same feeling as when operating it directly.

[0012] A second aspect of the present invention is an information processing system according to the first aspect, wherein the one or more physical keys include either a state switching key that is operated to switch the printer between a state in which it can perform printing and a state in which printing has been stopped, or a transport key that is operated to transport the printing medium contained in the printer.

[0013] According to a second aspect of the present invention, an object corresponding to a state change key or a conveyance key can be displayed at a position spaced apart from the panel object so as to have the same positional relationship as that between the first panel and the state change key or the conveyance key.

[0014] In a third aspect of the present invention, the first display unit is a touch panel including one or more operable touch keys, An information processing system according to the first or second aspect, wherein a first touch key among the one or more touch keys is a touch key for executing the same function in the printer as when a first physical key included in the one or more physical keys is operated.

[0015] According to a third aspect of the present invention, remote operation can be performed with the same feeling as when directly operating the touch panel of the printer.

[0016] A fourth aspect of the present invention is an information processing system according to the third aspect, in which the function equivalent to that performed when the first physical key is operated is either a function of switching the printer between a state in which it can perform printing and a state in which printing is stopped, or a function of transporting the printing medium contained in the printer.

[0017] According to a fourth aspect of the present invention, remote operation can be performed with the same feeling as when directly operating a touch key corresponding to a printer state change key or a transport key.

[0018] In a fifth aspect of the present invention, the first display panel is capable of switching between and displaying a plurality of screens including a home screen, An information processing system described in any one of the first to fourth aspects, wherein the one or more physical keys include a home key that is operated to switch the screen displayed on the first display panel to the home screen.

[0019] According to a fifth aspect of the present invention, remote operation can be performed with the same feeling as when directly operating the home key of the printer.

[0020] In a sixth aspect of the present invention, the first display panel is a touch panel including one or more operable touch keys, The printer is the printer according to any one of the first to fifth aspects, wherein the first display panel is made inoperable when the printer is remotely controlled by the information processing device.

[0021] According to a sixth aspect of the present invention, it is possible to prevent the printer from being directly operated while the printer is being remotely operated by an information processing device.

[0022] In a seventh aspect of the present invention, the printer further includes a storage unit and a capture unit, the capture unit captures a screen displayed on the first display unit as image data at predetermined intervals and stores the image data in the storage unit; the communication unit transmits the image data stored in the storage unit as a video stream to the information processing device; The information processing device is the printer according to any one of the first to sixth aspects, which displays the video stream received from the printer on the second display unit.

[0023] According to a seventh aspect of the present invention, it is possible to remotely operate a printer while checking the printer status on an information processing device.

[0024] An eighth aspect of the present invention is a first display panel; a physical key provided at a position spaced apart from the first display panel and operated to operate the printer; a communication unit that enables communication with an information processing device; 1. An information processing method for remotely operating a printer having the above-mentioned function by an information processing device having a second display panel through communication with the printer, A program that displays, on the second display panel, a panel object corresponding to the first display panel and one or more objects that correspond to each of the one or more physical keys and that perform the same function on the printer as when the corresponding physical key is operated, in the same positional relationship as between the first display panel and the one or more physical keys.

[0025] According to an eighth aspect of the present invention, the printer can be remotely operated with the same feeling as when operating it directly.

[0026] A ninth aspect of the present invention is a first display panel; a physical key provided at a position spaced apart from the first display panel and operated to operate the printer; a communication unit that enables communication with an information processing device; 1. An information processing method for remotely operating a printer having the above-mentioned function by an information processing device having a second display panel through communication with the printer, An information processing method in which a panel object corresponding to the first display panel and one or more objects corresponding to each of the one or more physical keys and for executing the same function in the printer as when the corresponding physical key is operated are displayed on the second display panel in the same positional relationship as that between the first display panel and the one or more physical keys.

[0027] According to a ninth aspect of the present invention, the printer can be remotely operated with the same feeling as when operating it directly.

[0028] An information processing system according to an embodiment of the present invention will be described below with reference to the drawings. The information processing system of the present invention is an information processing system having a printer that operates in a store, factory, etc. and is capable of communicating via a network, and an information processing device that is capable of remotely operating the printer by communicating with the printer via the network.

[0029] As shown in FIG. 1, the information processing system 10 includes a printer PR and an information processing device PC.

[0030] <Printer PR> The printer PR is a printer that prints printing information such as letters, symbols, figures, or barcodes on the printing surface of a rolled printing medium, and then transports the printing medium along a transport path so that it is discharged from the transport opening 42a (see Figure 3). As shown in FIG. 1, the printer PR is capable of communicating with the information processing apparatus PC via a network NW. The network NW is, for example, the Internet. The network NW may be a VPN (Virtual Private Network) established on the Internet. The network NW may be a LAN (Local Area Network) established in a store, factory, or the like.

[0031] The printer PR has a rectangular housing. As shown in Fig. 2, the printer PR has a transport unit 42, a printing unit (not shown), and an operation unit 20. The printer PR also has a control unit 30, a storage 34, and a communication unit 38.

[0032] The printer PR accommodates a print medium in a housing. The transport unit 42 includes a motor connected to a platen roller (not shown) and a drive circuit that drives the motor. The transport unit 42 rotates the platen roller, thereby transporting the print medium contained in the printer PR toward the printing unit and the transport opening 42a while sandwiched between the platen roller and a print head (described later). The transport opening 42a is provided on the front panel of the housing, as shown in FIG. 3. The transport opening 42a has a generally rectangular shape that extends laterally when viewed from the front of the printer PR, and is configured to allow the print medium to pass through. The print medium contained in the printer PR is transported by the transport unit 42 from the transport opening 42a to the outside of the housing of the printer PR and is then ejected. The printing unit includes a print head and prints on the print medium housed in the printer PR and transported by the transport unit 42 .

[0033] The operation unit 20 is operated by a user (not shown) through direct contact with the operation unit 20, thereby accepting operation inputs from the user to the printer PR. As shown in FIGS. 2 and 3, the operation unit 20 has a power key 21, a touch panel 24, and physical keys 22. The power key 21, touch panel 24, and physical key 22 are each provided at a predetermined position on the front panel of the printer PR, away from the transport opening 42a. As shown in Fig. 3, the power key 21, touch panel 24, and physical key 22 are arranged in a straight line at intervals from one another in order from top to bottom when viewed from the front of the printer PR. In the operation unit 20, the touch panel 24 and the physical keys 22 are surrounded by a rectangular virtual frame 20a when viewed from the front of the printer PR. That is, the frame 20a includes the touch panel 24 and the physical keys 22. The frame 20a does not include the power key 21. The power key 21 is operated to switch the power supply state of the printer PR between a power-on state and a power-off state.

[0034] The physical keys 22 are provided at predetermined positions on the opposite side of the touch panel 24 (described later) from the power key 21. Specifically, as shown in FIG. 3, one or more physical keys 22 are provided below the power key 21 when viewed from the front of the printer PR. In other words, the physical keys 22 are provided at positions spaced apart from the touch panel 24. The one or more physical keys 22 are operated to cause the printer PR to perform a predetermined operation corresponding to each of the one or more physical keys 22. The physical keys 22 receive user operation inputs to the printer PR by the user directly touching the keys. The one or more physical keys 22 include a state switching key 22a, a home key 22b, and a transport key 22c. As shown in Fig. 3, the state switching key 22a, the home key 22b, and the transport key 22c are arranged in a line at intervals from one another in order from left to right in the figure when viewed from the front of the printer PR. It is preferable that the touch panel 24 and the physical keys 22 are arranged together within an area that is easy for the user to operate. That is, it is preferable that the frame 20a is within an area that is easy for the user to operate. The area that is easy for the user to operate is, for example, an area that the user can operate by simply moving one hand or one arm without moving their shoulders significantly.

[0035] The state switching key 22a is operated to switch the printer PR between an online state and an offline state (see Figures 4 and 5). The online state of the printer PR is a state in which the printer PR can be made to perform a printing operation. The offline state of the printer PR is a state in which the printer PR is stopped from performing a printing operation. The online state is an example of a first state. The offline state is an example of a second state. When the printer PR is in the offline state, it is possible to perform operations such as setting the printing operation and operating the transport key 22c. Setting the printing operation includes adjusting the printing position relative to the print medium, setting the printing speed, setting the transport speed, and setting the density of the characters to be printed. Note that the printer PR may also allow setting the printing operation when it is in the online state. When the printer PR is in the online state and printing on a print medium, if the printer PR is switched to the offline state by operating the state switching key 22a, the printer PR stops printing on the print medium. This allows the user of the printer PR to interrupt the printing operation of the printer PR by operating the state switching key 22a to switch the printer PR to the offline state, for example, if the print content, such as the print position, is incorrect after the printer PR has performed a print operation. When the state switching key 22a is touched, it transmits a state switching signal to the control unit 30. In response to receiving the state switching signal, the control unit 30 switches the state of the printer PR between the online state and the offline state. As described below, the printer PR has a state switching touch key 26a that has the same function as the state switching key 22a. The state switching touch key 26a is displayed when the touch panel 24 is displaying a specific screen. Therefore, if the touch panel 24 is displaying a screen that does not display the state switching touch key 26a when the user wants to quickly switch the online / offline state of the printer PR, the user cannot operate the state switching touch key 26a to switch the state of the printer PR. Furthermore, depending on the user's level of proficiency, the user may not recognize the state switching touch key 26a as a touch key that has the function of switching the online / offline state of the printer PR. However, because the printer PR has the state switching key 22a as a physical key, even in the above case, the user can operate the state switching key 22a to switch the online / offline state of the printer PR.

[0036] The home key 22b is operated to switch the screen displayed on the touch panel 24 to a home screen G0 (see FIG. 4, details will be described later). When the home key 22b is touched, it transmits a home screen switching signal to the control unit 30. In response to receiving the home screen switching signal, the control unit 30 switches the screen displayed on the touch panel 24 to the home screen G0. As will be described later, the touch panel 24 switches between and displays a plurality of screens. The plurality of screens displayed on the touch panel 24 are configured in a hierarchical structure that starts from the home screen G0 and is associated with one another using the plurality of touch keys 26. When a screen that is deeper in the hierarchy than the home screen G0 is displayed on the touch panel 24, the user can immediately switch the screen displayed on the touch panel 24 to the home screen G0 by operating the home key 22b.

[0037] The transport key 22c is operated to transport the print medium stored in the printer PR from the transport opening 42a toward the outside of the housing. For example, the transport key 22c is pressed once after the user loads the print medium into the printer PR. In this case, the transport unit 42 transports the print medium stored in the storage unit in response to the operation of the transport key 22c, so that the leading edge of the print medium reaches a predetermined position outside the housing from the transport opening 42a. In other words, the transport key 22c is operated to transport the print medium to the reference position. When the transport key 22c is touched, it sends a transport signal to the control unit 30. In response to receiving the transport signal, the control unit 30 transports the print medium stored in the storage unit so that the leading edge of the print medium reaches a predetermined position outside the housing from the transport opening 42a.

[0038] Touch panel 24 displays the screen data input from control unit 30 as a visible screen. The screen displayed on touch panel 24 includes at least one of characters, symbols, figures, icons, and images. Touch panel 24 is an example of a first display panel. As shown in FIG. 3, the touch panel 24 is provided below the power key 21 and above the physical key 22 when viewed from the front of the printer PR. The touch panel 24 has a panel light-emitting unit 24a. The panel light-emitting unit 24a is configured to include a plurality of light-emitting elements. The light-emitting elements are, for example, LEDs (Light Emitting Diodes). The operation of the panel light-emitting unit 24a is controlled by the control unit 30. The panel light-emitting unit 24a causes the plurality of light-emitting elements to emit light based on the operation control by the control unit 30, thereby displaying screen data output from the control unit 30 on the touch panel 24 as a visible screen.

[0039] The touch panel 24 can switch between a plurality of screens to be displayed, as shown in Figures 4 to 7. The plurality of screens include a home screen G0 (see Figures 4, 5, and 7) and a menu screen G1 (see Figure 6).

[0040] 4, 5, and 7, the home screen G0 displays a status message ST1, a menu bar 25, touch keys 26, and an icon bar 27 at predetermined positions on the screen. One or more touch keys 26 are displayed on the home screen G0.

[0041] The status message ST1 is a character object that indicates the connection status of the printer PR to the network NW. When the printer PR is offline, the status message ST1 "offline" is displayed on the touch panel 24, as shown in Fig. 4. When the printer PR is online, the status message ST1 "online" is displayed on the touch panel 24, as shown in Figs. 5 and 7.

[0042] 4 to 7, the menu bar 25 is a rectangular object colored in a predetermined color and located on the left side of the screen, extending vertically in the drawing. The color of the menu bar 25 is changed depending on the connection status of the printer PR to the network NW.

[0043] The one or more touch keys 26 are objects that are operated to make the printer PR perform a predetermined operation corresponding to each of the one or more touch keys 26. The touch panel 24 accepts user operation inputs to the printer PR by the user directly touching each of the touch keys 26. Of the one or more touch keys 26, some of the touch keys 26 are displayed overlapping the menu bar 25. The one or more touch keys 26 include a state switching touch key 26a and a transport touch key 26c.

[0044] The state switching touch key 26a is operated to cause the printer PR to perform the same operation as when the state switching key 22a is operated. When the state switching touch key 26a is touched, the touch panel 24 transmits a state switching signal to the control unit 30. The state switching signal is the same signal as the signal transmitted to the control unit 30 when the state switching key 22a is touched. In this way, the state switching touch key 26a has the same function as the state switching key 22a. The transport touch key 26c is operated to cause the printer PR to perform the same operation as when the transport key 22c is operated. When the transport touch key 26c is touched, the touch panel 24 transmits a transport signal to the control unit 30. The transport signal is the same signal as the signal transmitted to the control unit 30 when the transport key 22c is touched. In this way, the transport touch key 26c has the same function as the transport key 22c. In this way, the touch panel 24 displays the touch keys 26 that are operated to perform the same actions as when the physical keys 22 are operated. That is, the touch keys 26 have the same functions as the physical keys 22. The state switching touch key 26a and the transport touch key 26c are displayed at a position separated from the menu bar 25 on the screen.

[0045] The one or more touch keys 26 may have functions such as a printing operation by the printer PR, a cutting operation for the print medium, switching the display of the touch panel 24 to one or more screens including the home screen G0, or updating the firmware of the printer PR. The one or more touch keys 26 may also have functions such as maintenance of the printer PR, replacing consumables, or changing the settings of the printer PR.

[0046] The icon bar 27 is an object located at the top of the screen as shown in Figures 4 to 7. One or more icons IC are displayed on the icon bar 27. The icons IC are image objects that indicate various states of the printer PR.

[0047] The menu screen G1 is displayed on the touch panel 24 by touching specific touch keys 26 arranged on top of the menu bar 25. As shown in Fig. 6, the menu screen G1 displays the menu bar 25, one or more touch keys 26, and an icon bar 27, each displayed at a predetermined position on the screen. The one or more touch keys 26 displayed on the menu screen G1 do not include the state switching touch key 26a and the transport touch key 26c.

[0048] The storage 34 is a storage device such as an HDD (Hard Disk Drive). The storage 34 is capable of storing information related to the printer PR. The storage 34 is an example of a storage unit. The information related to the printer PR includes screen data corresponding to multiple screens displayed on the touch panel 24.

[0049] As shown in Fig. 2, the control unit 30 controls the operation of each unit of the printer PR. The control unit 30 is configured to include a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and an interface. The ROM has a function of storing control programs and the like executed by the CPU. The RAM has a function of storing parameters and the like used in the control programs and the like executed by the CPU. The interface of the control unit 30 has a function of communicating with devices connected to the printer PR. The RAM is an example of a storage unit. The control unit 30 functions as a remote control enabling unit 32 and / or a server unit 36a by executing a control program on the CPU.

[0050] The remote control enabling unit 32 puts the printer PR into a remote controllable state in response to a request from the information processing device PC via the network NW. The remote controllable state is a state in which the user can operate the printer PR by communicating with the information processing device PC via the network NW. It is preferable that the remote control enabling unit 32 does not accept operation input from the operation unit 20 when the printer PR is in a remote control enabled state. It is preferable that the remote control enabling unit 32 puts the touch panel 24 into an inoperable display mode when the printer PR is in a remote control enabled state. The inoperable display mode is, for example, by turning off the output of the panel light emitting unit 24a so that no screen is output to the touch panel 24. At this time, the control unit 30 outputs, to the touch panel 24, image data corresponding to the screen and object to be displayed on the touch panel 24.

[0051] The server unit 36a functions as a VNC (Virtual Network Computing) server and includes a capture unit 36b. When the printer PR is in a remotely operable state, the capture unit 36b captures screen data output from the control unit 30 to the touch panel 24 as individual image data at predetermined intervals and stores the data in the storage 34. In other words, the capture unit 36b captures the screen displayed on the touch panel 24 as image data at predetermined intervals and stores the image data in the storage 34. The image data captured by the capture unit 36b is preferably stored individually in association with the time of capture. The capture unit 36b may also store the image data captured at predetermined intervals in the RAM of the control unit 30. When the printer PR is in a remotely operable state, the image data stored by the capture unit 36b is sequentially read out in real time by the communication unit 38 and transmitted to the information processing device PC as a video stream.

[0052] The communication unit 38 has a function of communicating with the information processing device PC via the network NW. When the printer PR is in a power-on state, the communication unit 38 is in an on state, enabling communication with the information processing device PC via the network NW and remote control by the information processing device PC. When the printer PR is in the power-off state, the communication unit 38 is in the off state, disabling communication with the information processing device PC via the network NW and remote operation by the information processing device PC. The power-on state of the printer PR includes a sleep state and a deep sleep state. A printer PR in the sleep state turns the communication unit 38 on. A printer PR in the deep sleep state turns the communication unit 38 off.

[0053] <Information processing device PC> As shown in FIG. 1, the information processing device PC is a computer terminal capable of communicating with the information processing device PC via the network NW. As shown in FIG. 2, the information processing device PC includes a display panel 62, an operation unit 63, a storage 66, a communication unit 64, and a control unit 60.

[0054] The display panel 62 is a display device capable of displaying screen data input from the control unit 60 as a visible screen. The screen displayed on the display panel 62 includes at least one of characters, symbols, figures, icons, and images. The display panel 62 may also have a touch panel function. It is preferable that the area of ​​the display screen of the display panel 62 is larger than the frame 20a. The display panel 62 is an example of a second display panel. The operation unit 63 receives user operation inputs to the information processing device PC. The operation unit 63 includes input devices such as a mouse and / or a keyboard. If the display panel 62 has a touch panel function, the operation unit 63 may include the display panel 62. The storage 66 is a storage device such as a HDD. The communication unit 64 has a function of communicating with the printer PR via the network NW.

[0055] As shown in Fig. 2, the control unit 60 controls the operation of each unit of the information processing device PC. The control unit 60 is configured to include a CPU, a ROM, a RAM, and an interface. The ROM has a function of storing the control program and remote control program executed by the CPU. The RAM has a function of storing parameters used in the control program and remote control program executed by the CPU. The interface of the control unit 60 has a function of communicating with devices connected to the information processing device PC. The information processing device PC can remotely control the printer PR via the communication unit 64 by executing a remote control program on the CPU. The remote control program includes, for example, "Web Config," which is open source software (OSS). The information processing device PC can remotely control the printer PR by connecting to the server unit 36a, which is the VNC server of the printer PR, as a VNC client using the remote control program.

[0056] <Remote Control Program> An example of the operation of the information processing system 10 when the information processing device PC executes a remote control program will be described.

[0057] When the remote control program is executed on the information processing device PC, the information processing device PC first displays a display window AP on the display panel 62, as shown in Fig. 8. The display window AP is preferably larger in actual size than the frame 20a. The information processing device PC then displays an input object F1 on the display panel 62 to request input from the user. The input object F1 includes an input field IP1, an input field IP2, and an execution key K1. The input field IP1 requests input of an ID (IDentification) number individually assigned to each of one or more printers PR. The ID number of the printer PR may include the IP address and / or port number of the printer PR. The input field IP2 requests input of a connection password corresponding to each ID number, for connecting as a VNC client to the server unit 36a of the printer PR corresponding to the ID number.

[0058] Next, in accordance with the request of the input object F1, the user inputs the ID number and connection password of the printer PR into the input fields IP1 and IP2, respectively, using the operation unit 63, and operates the execution key K1. At this time, the information processing device PC connects to the printer PR (hereinafter simply referred to as "printer PR") that corresponds to the input ID number and is online, and transmits the connection password. If the printer PR is in a power-off state or deep sleep state and the communication unit 38 is turned off, the information processing device PC cannot connect to the printer PR. In this case, the remote operation program notifies the user of an error indicating that the printer PR is in a power-off state or deep sleep state.

[0059] When the printer PR receives the connection password, the server unit 36a performs connection authentication of the user. If the user connection authentication is successful, the printer PR generates connection success information and sends it to the information processing device PC. The printer PR also connects the information processing device PC to the server unit 36a as a VNC client, thereby entering a client connection state. If the user connection authentication fails, the printer PR generates connection failure information and transmits it to the information processing device PC, requesting the information processing device PC to resend the ID number and connection password.

[0060] When the information processing device PC receives the connection success information, it switches the display within the display frame AP from the mode shown in Figure 8 to the mode shown in Figure 9, and displays the sidebar BR and multiple input keys within the frame. As shown in FIG. 9, the sidebar BR is a rectangular object that is arranged on the left side of the display frame AP and extends in the vertical direction in the drawing. The input keys are objects that are operated to cause the remote control program to perform predetermined operations corresponding to the respective input keys, including the remote control key K2.

[0061] Next, when the user operates the remote operation key K2 using the operation unit 63, the information processing device PC displays a frame object 70 within the display frame AP, as shown in Fig. 10. It is preferable that the frame object 70 is larger in actual size than the frame 20a. Then, the information processing device PC displays the connection key K3 on the display panel 62 to request the user to operate it.

[0062] Next, when the user operates the connection key K3 in response to a request from the information processing device PC, the information processing device PC displays an input object F2 on the display panel 62 and requests input from the user, as shown in Fig. 11. The input object F2 includes an input field IP3 and an execution key K4. The input field IP3 is an operation password corresponding to each ID number, and requests input of an operation password for remotely operating the printer PR corresponding to the ID number using VNC. Next, in accordance with the request of the input object F2, the user inputs the operation password into the input field IP3 using the operation unit 63 and operates the execution key K4. At this time, the information processing device PC transmits the operation password to the printer PR.

[0063] When the printer PR in the client-connected state receives the operation password, the server unit 36a performs remote operation authentication of the user. If the user's remote operation authentication is successful, the printer PR generates authentication success information and sends it to the information processing device PC. The printer PR also enters a remotely operable state. In the remotely operable state, the printer PR transmits screen data output from the control unit 30 to the touch panel 24 as a video stream to the information processing device PC via the communication unit 38 and the capture unit 36b. If the user's remote operation authentication fails, the printer PR generates authentication failure information and transmits it to the information processing device PC, requesting the retransmission of the operation password.

[0064] When the information processing device PC receives the authentication success information, it switches the display within the frame object 70 from the mode shown in Figure 11 to the mode shown in Figure 12, and displays a panel object 74 and one or more key objects 72 within the frame.

[0065] The panel object 74 is an object for reproducing the operation of the touch panel 24. The panel object 74 displays image data that is screen data output to the touch panel 24 captured by the capture unit 36b and received as a video stream from the printer PR. The shape and size of the panel object 74 are set to be the same as the actual shape and size of the touch panel 24 when viewed from the front of the printer PR.

[0066] The key objects 72 are objects for reproducing the actions that occur when the physical keys 22 are operated. Each of the one or more key objects 72 includes a state switching object 72a, a home object 72b, and a transport object 72c. That is, each of the one or more key objects 72 corresponds to one or more physical keys 22. The shape and size of the key objects 72 are set to be the same as the actual shape and size of the corresponding physical keys 22 when viewed from the front of the printer PR.

[0067] The state switching object 72a is operated to make the printer PR reproduce the operation that occurs when the state switching key 22a is operated. The state switching object 72a corresponds to the state switching key 22a. When the state switching object 72a is operated by a user's operation using the operation unit 20, the information processing device PC transmits state switching information to the server unit 36a of the printer PR. In response to receiving the state switching information, the server unit 36a transmits a state switching signal to the control unit 30. The state switching signal is the same signal as the signal transmitted to the control unit 30 when the state switching key 22a is touched. In this way, the state switching object 72a has the same function as the state switching key 22a.

[0068] The home object 72b is operated to make the printer PR reproduce the operation that occurs when the home key 22b is operated. The home object 72b corresponds to the home key 22b. When the home object 72b is operated by a user's operation using the operation unit 20, the information processing device PC transmits home screen switching information to the server unit 36a of the printer PR. In response to receiving the home screen switching information, the server unit 36a transmits a home screen switching signal to the control unit 30. The home screen switching signal is the same signal as the signal transmitted to the control unit 30 when the home key 22b is touched. In this way, the home object 72b has the same function as the home key 22b.

[0069] The transport object 72c is operated to make the printer PR reproduce the action that occurs when the transport key 22c is operated. The transport object 72c corresponds to the transport key 22c. When the transport object 72c is operated by a user's operation using the operation unit 20, the information processing device PC transmits transport information to the server unit 36a of the printer PR. In response to receiving the transport information, the server unit 36a transmits a transport signal to the control unit 30. The transport signal is the same signal as the signal transmitted to the control unit 30 when the transport key 22c is touched. In this way, the transport object 72c has the same function as the transport key 22c.

[0070] The positional relationship between the panel object 74 and the one or more key objects 72 is set to be the same as the positional relationship when the touch panel 24 and the one or more physical keys 22 are viewed in actual size from the front of the printer PR. That is, the information processing device PC causes the control unit 60 to execute the remote operation program, thereby displaying the panel object 74 and the key objects 72 on the display panel 62 so that the positional relationship is the same as the positional relationship between the touch panel 24 and the physical keys 22. In other words, the control unit 30 functions as a display unit by executing the remote operation program in the CPU.

[0071] When the control unit 30 of the printer PR outputs image data corresponding to one or more touch keys 26 to the touch panel 24, the information processing device PC displays touch key objects 76 corresponding to each of the touch keys 26 within the panel object 74. That is, the panel object 74 includes the touch key objects 76.

[0072] The touch key object 76 is an object for reproducing the action when the touch key 26 is operated. The touch key object 76 is an example of a third object. The positions of the touch key objects 76 in the panel object 74 are set to be the same as the positions of the touch keys 26 in the touch panel 24 when viewed from the front of the printer PR in actual size. That is, the information processing device PC displays the touch key objects 76 in the panel object 74 so that the positions are the same as the positions of the touch keys 26 in the touch panel 24.

[0073] As shown in FIG. 12, when the printer PR transmits image data of the home screen G0 to the information processing apparatus PC, the information processing apparatus PC displays a state switching object 76a and a transportation object 76c within the panel object 74.

[0074] The state switching object 76a is operated to make the printer PR reproduce the operation that occurs when the state switching touch key 26a is operated. The state switching object 76a corresponds to the state switching touch key 26a. When the state switching object 76a is operated by a user's operation using the operation unit 20, the information processing device PC transmits state switching information to the server unit 36a of the printer PR. In response to receiving the state switching information, the server unit 36a transmits a state switching signal to the control unit 30. The state switching signal is the same signal as the signal transmitted to the control unit 30 when the state switching key 22a is touched. In this way, the state switching object 76a has the same function as the state switching key 22a.

[0075] The transport object 76c is operated to make the printer PR reproduce the operation when the transport touch key 26c is operated. The transport object 76c corresponds to the transport touch key 26c. When the transport object 76c is operated by a user's operation using the operation unit 20, the information processing device PC transmits transport information to the server unit 36a of the printer PR. In response to receiving the transport information, the server unit 36a transmits a transport signal to the control unit 30. The transport signal is the same signal as the signal transmitted to the control unit 30 when the transport key 22c is touched. In this way, the transport object 76c has the same function as the transport key 22c.

[0076] When the user of the information processing device PC wishes to end the remote control of the printer PR, he or she operates the remote control key K2 (not shown in FIG. 12) on the side bar BR within the display frame AP, thereby ending the remote controllable state of the printer PR.

[0077] <Other> In the information processing device PC, the frame object 70 has a function as an object that reproduces the operation of the operation unit 20 included in the frame 20a. That is, the information processing device PC does not display an object corresponding to the power key 21 within the frame object 70. Therefore, according to the information processing system 10, it is possible to prevent an erroneous operation in which the object corresponding to the power key 21 is mistakenly operated when remotely operating the printer PR, thereby turning the printer PR into a power-off state.

[0078] <Action and effect> Next, the operation and effects of the information processing system 10 will be described.

[0079] The information processing device PC of the information processing system 10 executes the remote operation program to display the panel object 74 and the key object 72 on the display panel 62 so that the positional relationship between the panel object 74 and the physical key 22 is the same as that between the touch panel 24 and the physical key 22. Therefore, according to the information processing system 10, the printer PR can be remotely operated using the information processing device PC with the same feeling as when directly operating the printer PR. In particular, the physical keys 22 of the printer PR include a state switching key 22a and a transport key 22c. Therefore, according to the information processing system 10, the state switching object 72a and / or the transport object 72c can be displayed at a position spaced apart from the panel object 74 so as to have the same positional relationship as that between the touch panel 24 and the state switching key 22a and / or the transport key 22c.

[0080] The panel object 74 includes a touch key object 76. Therefore, according to the information processing system 10, the printer PR can be remotely operated using the information processing device PC with the same feeling as when directly operating the touch panel 24 of the printer PR.

[0081] The key object 72 includes a state switching object 72a and a transport object 72c. Therefore, according to the information processing system 10, it is possible to remotely operate the printer PR using the information processing device PC with the same feeling as when directly operating the state switching key 22a or transport key 22c of the printer PR.

[0082] The key object 72 includes a home object 72b. Therefore, according to the information processing system 10, the printer PR can be remotely controlled using the information processing device PC with the same feeling as when directly operating the home key 22b of the printer PR.

[0083] The panel object 74 includes a state switching object 76a and a transport object 76c. Therefore, according to the information processing system 10, the printer PR can be remotely controlled using the information processing device PC with the same feeling as when directly operating the state switching touch key 26a or transport touch key 26c of the printer PR.

[0084] ) When the printer PR is in a remotely operable state, the touch panel 24 is displayed in an inoperable state. In this case, the user recognizes that the printer PR is in a remotely operable state by visually checking the touch panel 24. Therefore, according to the information processing system 10, it is possible to prevent the user from directly operating the printer PR when the printer PR is being remotely operated by the information processing device PC.

[0085] The communication unit 38 transmits the image data stored in the storage 34 by the capture unit 36b as a video stream to the information processing device PC. Then, the information processing device PC displays the video stream transmitted from the communication unit 38 as a panel object 74 on the display panel 62. Therefore, according to the information processing system 10, it is possible to remotely operate the printer PR while checking the status of the printer PR on the information processing device PC.

[0086] As described above, an embodiment of the present invention has been described as an example, but the present invention is not limited to the above embodiment, and various modifications, changes, and improvements are possible within the scope of the technical concept of the present invention.

[0087] In the above-described embodiment, when a user executes a remote operation program on the information processing device PC, the input object F1 inputs an ID number assigned to each printer PR into the input field IP1. In the present invention, each printer may have multiple ID numbers for remote operation. The multiple ID numbers may differ from one another in terms of the operating authority for remotely operating the printer. For example, the operating authority for a printer may include firmware updates, maintenance work, consumable replacement, and printer setting changes. This allows, for example, a supervisor with higher authority than the operator who directly operates the printer to remotely operate the printer with different operating authority than the operator. Furthermore, for example, a person in charge of the printer manufacturer (e.g., a help desk staff member) may remotely operate the printer with different operating authority than the user who directly operates the printer (e.g., the manufacturer's customer).

[0088] In the above-described embodiment, the printer PR makes the user aware that the printer PR is in a remotely operable state by making the touch panel 24 in an inoperable display mode. However, in the present invention, the method of making the user aware that the printer PR is in a remotely operable state is not limited to making the first display panel in an inoperable display mode. For example, the printer may make the user aware that the printer is in a remotely operable state by changing the color of the backlight of the physical keys to a color different from that in the manual operation state. The printer may make the user aware that the printer is in a remotely operable state by turning off the backlight of the physical keys.

[0089] In the above-described embodiment, the printer PR has the touch panel 24 as the first display panel. However, the first display panel of the present invention does not have to have the function of a touch panel.

[0090] In the above-described embodiment, the one or more physical keys 22 include the state switching key 22a, the home key 22b, and the transport key 22c. However, the physical keys 22 of the present invention may include a cross key. In this case, the printer PR may display touch keys corresponding to the cross key on the touch panel 24. In this case, the information processing device PC executing the remote control program may display a remote control object corresponding to the cross key within the frame object 70. [Explanation of symbols]

[0091] 10: Information Processing Systems 20:Operation unit 22: Physical key 22a: State switching key 22b: Home key 22c: Transport key 24: Touch panel 26: Touch key 26a: State switching touch key 26c: Transport touch key 34: Storage 36b: Capture section 38: Communications Department 62: Display panel 72: Key object 72a: Switching object 72b: Home object 72c: Transport object 74: Panel object 76: Touch key object AP: Display frame G0: Home screen NW: Network PC: Information processing device PR: Printer

Claims

1. An information processing system comprising a printer and an information processing device, The aforementioned printer is The first display panel, One or more physical keys are provided at a position spaced apart from the first display panel and are operated to operate the printer, A communication unit that communicates with the aforementioned information processing device, It has, The aforementioned information processing device is The second display panel, A display unit that displays a panel object corresponding to the first display panel and one or more objects corresponding to each of the one or more physical keys, for executing the same function in the printer as when the corresponding physical key is operated, on the second display panel such that the positional relationship between the first display panel and the one or more physical keys is the same. An information processing system having the following features.

2. The information processing system according to claim 1, wherein the one or more physical keys include either a state switching key operated to switch the printer between a state in which it can perform printing and a state in which it has stopped printing, and a transport key operated to transport the printing medium contained in the printer.

3. The first display panel is a touch panel including one or more operable touch keys, The information processing system according to claim 1, wherein the first touch key among the one or more touch keys is a touch key for executing the same function in the printer as when the first physical key included in the one or more physical keys is operated.

4. The information processing system according to claim 3, wherein the same function as when the first physical key is operated is either a function to switch the printer between a state in which it can perform printing and a state in which it has stopped printing, or a function to transport the printing medium contained in the printer.

5. The first display panel is capable of switching between and displaying multiple screens, including the home screen. The information processing system according to claim 1, wherein the one or more physical keys include a home key that is operated to switch the screen displayed on the first display panel to the home screen.

6. The first display panel is a touch panel including one or more operable touch keys, The information processing system according to claim 1, wherein the first display panel is made inoperable when the printer is being remotely controlled by the information processing device.

7. The printer further comprises a storage unit and a capture unit, The capture unit captures the screen displayed on the first display panel as image data at predetermined intervals and stores it in the storage unit. The communication unit transmits the image data stored in the storage unit as a video stream to the information processing device. The display unit displays the video stream received from the printer on the second display panel. The information processing system according to claim 1.

8. The first display panel, A physical key is provided at a position spaced apart from the first display panel and is operated to operate the printer, A communication unit that enables communication with the information processing device, A program applied to an information processing device having a second display panel, which is an information processing device that can remotely control a printer having said printer by communication with said printer, A program that displays a panel object corresponding to the first display panel and one or more objects corresponding to each of the one or more physical keys, for executing the same function in the printer as when the corresponding physical key is operated, on the second display panel such that the positional relationship between the first display panel and the one or more physical keys is the same.

9. The first display panel, A physical key is provided at a position spaced apart from the first display panel and is operated to operate the printer, A communication unit that enables communication with the information processing device, An information processing method for remotely controlling a printer having a second display panel using an information processing device having a second display panel via communication with the printer, An information processing method for displaying on the second display panel a panel object corresponding to the first display panel and one or more objects corresponding to each of the one or more physical keys, for executing the same function in the printer as when the corresponding physical key is operated, such that the positional relationship between the first display panel and the one or more physical keys is the same.

Images