Image processing device, control program and control method for image processing device
The image processing device adapts operation screens based on distance from a mobile terminal, enabling seamless remote and local operation, improving user convenience and device operability.
Patent Information
- Application Number
- JP2024113080
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-07-16
- Publication Date
- 2025-09-04
- Estimated Expiration
- 2040-09-25
AI Technical Summary
Existing image processing devices lack the ability to seamlessly transition between remote operation and local operation based on user proximity, affecting operability and smooth operation.
The image processing device includes an operation screen data transmission mechanism, distance estimation, and control mechanisms to adapt the operation screen based on distance from a mobile terminal, disabling certain operations when the user is too far and enabling others when close, ensuring smooth operation and user convenience.
Enhances operability by allowing remote operation when necessary and ensuring critical local operations are performed only when the user is near the device, maintaining smooth device operation.
Smart Images

Figure 0007734242000001 
Figure 0007734242000002 
Figure 0007734242000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an image processing apparatus, a control program and a control method for the image processing apparatus, and more particularly to an image processing apparatus, a control program and a control method for the image processing apparatus that are wirelessly connected to a mobile terminal having a display and can accept operations by a user via the mobile terminal. [Background technology]
[0002] An example of this type of technology is disclosed in Patent Document 1. According to the technology disclosed in Patent Document 1, the distance between an image processing device and a mobile terminal is estimated, and a screen to be displayed on the display of the mobile terminal is determined based on the estimated distance. For example, if the estimated distance is less than a threshold, that is, if the distance between the image processing device and the mobile terminal is short, a screen for operating the image processing device is displayed on the display of the mobile terminal. This allows the user to operate the image processing device via the mobile terminal. On the other hand, if the estimated distance is equal to or greater than the threshold, that is, if the distance between the image processing device and the mobile terminal is long, a screen indicating the status of the image processing device is displayed on the display of the mobile terminal. This allows the user to check the status of the image processing device via the mobile terminal, although they cannot operate the image processing device via the mobile terminal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-256060 Summary of the Invention [Problem to be solved by the invention]
[0004] However, even when the image processing device and the portable terminal are far apart, in other words, even when the user is located far away from the image processing device, it would be more convenient for the user if the image processing device could be operated via the portable terminal, thereby improving the operability of the image processing device.
[0005] On the other hand, depending on the operation of the image processing device, it may be necessary (appropriate) for the user to be near the image processing device. For example, this applies to operations that require the user to be near the image processing device while checking the operation of the image processing device. For operations that require the user to be near the image processing device, it is desirable that they can be performed via the mobile terminal only when the user is near the image processing device, that is, only when the distance between the image processing device and the mobile terminal is short. This is essential for ensuring smooth operation of the image processing device.
[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a novel technique that can improve the operability and smooth operation of an image processing apparatus. [Means for solving the problem]
[0007] To achieve this object, the present invention includes a first invention relating to an image processing device, a second invention relating to a control program for the image processing device, and a third invention relating to a control method for the image processing device.
[0008] The first invention of the image processing device includes an operation screen data transmission means, a distance estimation means, and an operation screen data control means. 、 First nullification means and operation acceptance meansThe image processing device is wirelessly connected to a mobile terminal having a display and is capable of accepting user operations via the mobile terminal. The operation screen data transmission means transmits, to the mobile terminal, operation screen data for displaying an operation screen required to accept user operations on the display of the mobile terminal. The distance estimation means estimates the distance between the image processing device and the mobile terminal. The operation screen data control means controls the operation screen data according to the distance estimated by the distance estimation means. For example, when the distance estimated by the distance estimation means is equal to or less than a predetermined threshold, the operation screen data control means controls the operation screen data so that the operation screen is in a mode capable of accepting a specific operation by the user. On the other hand, when the distance estimated by the distance estimation means exceeds the threshold, the operation screen data control means controls the operation screen data so that the operation screen is in a mode in which the operation screen cannot accept the specific operation. Additionally, when a first operation instructing execution of a process that cannot be executed in parallel with the specific process is received via the mobile terminal during execution of a specific process in accordance with the specific operation, the first disabling means disables the instruction in accordance with the first operation. The operation receiving means is capable of directly receiving an operation from a user. The threshold value here is the maximum distance between the image processing device and the mobile terminal at which the user can directly operate the operation receiving means.
[0009] In the first aspect of the present invention, the device may further include a message data transmitting means that transmits, to the mobile terminal, message data for causing the mobile terminal to output a predetermined first message when the instruction following the first operation is disabled by the first disabling means.
[0010] In addition, in the first invention , th 2. A nullification means may further be provided. this The second disabling means disables the instruction according to the second operation when the operation receiving means receives a second operation, which is an operation instructing the execution of a process that cannot be executed in parallel with the specific process, during the execution of the specific process according to the specific operation.
[0011] In addition, when the operation receiving means and the second disabling means are provided, a message output means may be further provided, which outputs a predetermined second message when the instruction according to the second operation is disabled by the second disabling means.
[0012] A control program for an image processing device according to a second aspect of the present invention causes a computer of the image processing device to execute an operation screen data transmission procedure, a distance estimation procedure, an operation screen data control procedure, and a first invalidation procedure. Here, the image processing device is wirelessly connected to a mobile terminal having a display and is capable of accepting user operations via the mobile terminal. and also includes an operation receiving means capable of directly receiving an operation by the user. Then, in the operation screen data transmission procedure, operation screen data for displaying an operation screen required to accept a user operation on a display of the portable terminal is transmitted to the portable terminal. Then, in the distance estimation procedure, the distance between the image processing device and the portable terminal is estimated. Furthermore, in the operation screen data control procedure, the operation screen data is controlled according to the distance estimated by the distance estimation procedure. For example, when the distance estimated by the distance estimation procedure is equal to or less than a predetermined threshold, the operation screen data control procedure controls the operation screen data so that the operation screen is in a mode that allows the operation screen to accept a specific operation, which is a specific operation by the user. On the other hand, when the distance estimated by the distance estimation procedure exceeds the threshold, the operation screen data control procedure controls the operation screen data so that the operation screen is in a mode that prevents the operation screen from accepting the specific operation. In addition, in the first invalidation procedure, when a first operation, which is an operation instructing the execution of a process that cannot be executed in parallel with a specific process, is received via the portable terminal during execution of a specific process that follows the specific operation, the instruction following the first operation is invalidated. The threshold value here refers to the maximum distance between the image processing device and the mobile terminal at which the user can directly operate the operation reception means.
[0013] A control method for an image processing device according to a third aspect of the present invention includes an operation screen data transmitting step, a distance estimating step, an operation screen data controlling step, and a first invalidation step. Here, the image processing device is wirelessly connected to a mobile terminal having a display and is capable of accepting user operations via the mobile terminal. and also includes an operation receiving means capable of directly receiving an operation by the user.Then, in the operation screen data transmitting step, operation screen data for displaying an operation screen required to accept an operation by a user on a display of the portable terminal is transmitted to the portable terminal. Then, in the distance estimating step, the distance between the image processing device and the portable terminal is estimated. Furthermore, in the operation screen data control step, the operation screen data is controlled according to the distance estimated in the distance estimating step. For example, when the distance estimated in the distance estimating step is equal to or less than a predetermined threshold, the operation screen data control step controls the operation screen data so that the operation screen is in a mode that allows the operation screen to accept a specific operation, which is a specific operation by the user. On the other hand, when the distance estimated in the distance estimating step exceeds the threshold, the operation screen data control step controls the operation screen data so that the operation screen is in a mode that does not allow the operation screen to accept the specific operation. In addition, in the first disabling step, when a first operation, which is an operation instructing the execution of a process that cannot be executed in parallel with the specific process, is received via the portable terminal during execution of the specific process that follows the specific operation, the instruction according to the first operation is disabled. The threshold value here refers to the maximum distance between the image processing device and the mobile terminal at which the user can directly operate the operation reception means. [Effects of the Invention]
[0014] According to the present invention, it is possible to improve the operability of an image processing apparatus and to ensure smooth operation. [Brief explanation of the drawings]
[0015] [Figure 1] FIG. 1 is a perspective view of a multifunction peripheral according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the electrical configuration of the multifunction peripheral according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of a setting screen displayed on the display of the multifunction peripheral according to the first embodiment. [Figure 4] FIG. 4 is a diagram schematically showing the relationship between the multifunction peripheral and the mobile terminal according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of a terminal-side setting screen displayed on the display of the mobile terminal in the first embodiment. [Figure 6] FIG. 6 is a diagram showing another example of the terminal-side setting screen displayed on the display of the mobile terminal in the first embodiment. [Figure 7] FIG. 7 is a memory map conceptually showing the internal configuration of the RAM of the main storage unit of the multifunction peripheral according to the first embodiment. [Figure 8] FIG. 8 is a flowchart showing the flow of the setting control task in the first embodiment. [Figure 9] FIG. 9 is a flow diagram showing the flow of a Web server task in the first embodiment. [Figure 10] FIG. 10 is a flowchart showing the flow of a Web screen control task in the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a terminal-side setting screen displayed on the display of a mobile terminal in the second embodiment. [Figure 12] FIG. 12 is a flowchart showing the flow of a part of the Web screen control task in the third embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a message screen displayed on the display of the multifunction peripheral according to the fourth embodiment. [Figure 14] FIG. 14 is a diagram showing an example of a message screen displayed on the display of the mobile terminal in the fourth embodiment. [Figure 15] FIG. 15 is a flowchart showing the flow of the main body processing control task in the fourth embodiment. [Figure 16] FIG. 16 is a flow diagram showing the flow of a Web processing control task in the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0016] [First Example] A first embodiment of the present invention will be described using a multifunction peripheral (MFP) 10 shown in FIG. 1 as an example. FIG. 1 is a perspective view of the multifunction peripheral 10, showing the front, top, and left side of the multifunction peripheral 10 when it is installed in a usable state. That is, the up-down direction in FIG. 1 corresponds to the up-down direction of the multifunction peripheral 10. The diagonally lower right in FIG. 1 corresponds to the front of the multifunction peripheral 10, and the diagonally upper left in FIG. 1 corresponds to the rear of the multifunction peripheral 10. Furthermore, the diagonally lower left in FIG. 1 corresponds to the left of the multifunction peripheral 10, and the diagonally upper right in FIG. 1 corresponds to the right of the multifunction peripheral 10.
[0017] The multifunction device 10 has multiple functions such as a copy function, a printer function, an image scanner function, a fax function, etc. Therefore, the multifunction device 10 includes an image reading unit 12 as an example of an image reading means, and an image forming unit 14 as an example of an image forming means.
[0018] The image reading unit 12 is provided at the top of the multifunction peripheral 10 (its main body). The image reading unit 12 performs image reading processing, reading an image of an original (not shown) and generating two-dimensional read image data corresponding to the read image. To this end, the image reading unit 12 has a document table (not shown) on which the original is placed. The document table is formed of a transparent material such as glass in a roughly rectangular flat plate shape. Below the document table are provided an image reading unit having a light source, appropriate optical components such as mirrors and lenses, a line sensor, etc., and a drive mechanism for moving the image reading unit, all of which are not shown. Furthermore, above the document table is provided an automatic document feeder (ADF) 16, which also serves as a document pressing cover for pressing down the original placed on the document table.
[0019] The automatic document feeder 16 is provided so as to be capable of transitioning between a state in which the top surface of the document table is exposed to the outside and a state in which the top surface of the document table is covered. Therefore, the automatic document feeder 16 is coupled to the main body (housing) of the multifunction peripheral 10 via an appropriate fulcrum support member, such as a hinge (not shown). FIG. 1 shows a state in which the automatic document feeder 16 covers the top surface of the document table. When the automatic document feeder 16 is in the state in which the top surface of the document table is covered as shown in FIG. 1, the automatic document feeder 16 performs its original function. That is, the automatic document feeder 16 has a document placement tray 16a on which multiple documents, specifically, sheet-like documents, can be placed in a stack. When the automatic document feeder 16 is in the state in which the top surface of the document table is covered as shown in FIG. 1, the automatic document feeder 16 automatically feeds documents placed on the document placement tray 16a one by one (one by one) to an image reading position (not shown) by the image reading unit 12, i.e., the documents are subjected to image reading processing by the image reading unit 12. The automatic document feeder 16 is an optional device and may not be provided. In this case, a dedicated document pressing cover is provided instead of the automatic document feeder 16.
[0020] The image forming unit 14 is provided below the image reading unit 12. The image forming unit 14 performs image formation processing, i.e., printing, on paper, which is an example of a sheet-like image recording medium (not shown), based on appropriate image data such as the image reading data described above. This image formation processing is performed, for example, by a known electrophotographic method (Carlson process method). For this purpose, the image forming unit 14 includes a photosensitive drum, a charging device, an exposure device, a developing device, a transfer device, a fixing device, a cleaning device, a static elimination device, and the like, all of which are not shown. The paper after image formation processing by the image forming unit 14, i.e., the printed paper, is discharged to a paper discharge tray 18. The paper discharge tray 18 is provided between the image forming unit 14 and the image reading unit 12, in the so-called cavity space of the multifunction device 10, but is not limited to this structure. The image forming unit 14 is not limited to an electrophotographic method, and may perform image formation processing using, for example, an inkjet method.
[0021] Furthermore, a paper feed unit 20, an example of a paper feed means, is provided below the image forming unit 14, in other words, at the bottom of the multifunction device 10. This paper feed unit 20 has multiple, for example, four, paper feed cassettes 20a, 20a, .... Each paper feed cassette 20a, 20a, ... stores paper of an appropriate size, for example, paper of different sizes. Also, although not shown in FIG. 1 , a manual feed tray, which is an auxiliary paper feed tray, is provided on the right side of the multifunction device 10. The paper feed unit 20 uses one of the paper feed cassettes 20a, 20a, ... or the manual feed tray as a paper feed source, and feeds paper one sheet at a time from the paper feed source to the image forming unit 14, that is, provides the paper for image formation processing by the image forming unit 14.
[0022] In addition, an operation unit 22 having a generally rectangular plate shape is provided on the top of the multifunction device 10, at the front of the multifunction device 10. One side edge of the operation unit 22 is connected to the main body of the multifunction device 10, and the operation unit 22 is provided so as to be rotatable about the one side edge as an axis. One main surface of the operation unit 22 (the main surface facing upward in FIG. 1) is an operation surface, and a display 22b with a touch panel 22a is provided on this operation surface.
[0023] The display 22b with touch panel 22a is a component that integrally combines the display 22b having a rectangular display surface and the sheet-like touch panel 22a that is provided so as to overlap the display surface of the display 22b. The touch panel 22a is an example of an operation receiving unit that can receive touch operations by a user (not shown) using the multifunction peripheral 10, and is, for example, a projected capacitive panel. The display 22b is an example of a display unit that displays various screens including a setting screen 100 (described later), and is, for example, a liquid crystal display (LCD). Note that the touch panel 22a is not limited to a projected capacitive panel, and may be a panel of other types, such as a surface capacitive panel, an electromagnetic induction panel, a resistive film panel, or an infrared panel. The display 22b is not limited to a liquid crystal display, and may be, for example, an organic electroluminescence (EL) display.
[0024] A user typically stands in front of the multifunction peripheral 10 to use the multifunction peripheral 10, and in particular to operate the operation unit 22. To ensure good operability and visibility of the operation unit 22 by the user, the operation unit 22 is provided to be rotatable about the coupling portion with the main body of the multifunction peripheral 10 as described above, i.e., the orientation (tilt angle) of the operation surface of the operation unit 22 relative to the user is adjustable. Note that the operation unit 22 has appropriate hardware switches such as push button switches in addition to the touch panel 22a. In addition to the display 22b, the operation unit 22 also has appropriate light-emitting means such as a light-emitting diode (LED).
[0025] Furthermore, a human presence sensor 24 as an example of human detection means is provided at an appropriate position on the front of the multifunction device 10, for example, below the portion of the main body of the multifunction device 10 where it is connected to the operation unit 22; more precisely, a detection portion (detection window) of the human presence sensor 24 is provided. Although detailed explanation including illustrations will be omitted, the human presence sensor 24 has, for example, a pyroelectric infrared sensor, and forms a predetermined detection area in front of the multifunction device 10. The human presence sensor 24 outputs a human detection signal according to the presence or absence of a person, including a user, within the detection area. This human detection signal is used, for example, as a trigger when the multifunction device 10 returns from a power-saving state (a state in which power supply to some components is stopped) to a normal state (a state in which power is supplied to all components).
[0026] Fig. 2 is a block diagram showing the electrical configuration of multifunction peripheral 10. As shown in Fig. 2, multifunction peripheral 10 includes image reading unit 12, image forming unit 14, automatic document feeder 16, paper feed unit 20, operation unit 22, and human presence sensor 24, as well as control unit 30, auxiliary storage unit 32, and communication unit 34. These are connected to each other via a common bus 50. Note that image reading unit 12, image forming unit 14, automatic document feeder 16, paper feed unit 20, operation unit 22, and human presence sensor 24 are as described above.
[0027] The control unit 30 is an example of a control means that controls the overall operation of the multifunction device 10. To this end, the control unit 30 includes a computer, such as a CPU 30a, as a control execution means. The control unit 30 also includes a main memory unit 30b as a main memory means that can be directly accessed by the CPU 30a. The main memory unit 30b includes a ROM and a RAM (not shown). The ROM stores a control program for controlling the operation of the CPU 30a, known as firmware. The RAM provides a working area and a buffer area for the CPU 30a when it executes processing based on the control program.
[0028] The auxiliary storage unit 32 is an example of an auxiliary storage means. That is, various data such as the above-mentioned scanned image data are appropriately stored in the auxiliary storage unit 32. The auxiliary storage unit 32 includes, for example, a hard disk drive (not shown). In addition, the auxiliary storage unit 32 may include a rewritable non-volatile memory such as a flash memory.
[0029] The communication unit 34 is an example of a communication means. That is, the communication unit 34 is connected to a communication network (not shown) and is responsible for two-way communication processing via the communication network. The communication network referred to here includes a LAN, the Internet, a public switched telephone network, and the like. The LAN also includes a wireless LAN, particularly Wi-Fi (registered trademark). Therefore, the communication unit 34 has a wireless communication unit 34a that is responsible for wireless communication processing in accordance with Wi-Fi. The wireless communication unit 34a is also responsible for wireless communication processing in accordance with Bluetooth (registered trademark), which is a short-range wireless communication standard. Furthermore, the wireless communication unit 34a is also responsible for wireless communication processing in accordance with IrDA (registered trademark), which is an infrared communication standard.
[0030] As described above, the multifunction peripheral 10 according to the first embodiment has a display 22b with a touch panel 22a. Various screens are displayed on the display 22b with the touch panel 22a under the control of the CPU 30a, one of which is a setting screen 100 as shown in FIG. 3. The setting screen 100 is a screen for making various settings related to the multifunction peripheral 10, and is displayed by operating (pressing) a setting button, which is one of the controls arranged on a home screen (not shown). The setting screen 100 also allows the user to check various pieces of information related to the multifunction peripheral 10.
[0031] Specifically, an appropriate character string 102 representing the title of the setting screen 100 is arranged at the top left of the setting screen 100. Below the character string 102, a plurality of tabs, for example, three tabs 104, 106, and 108, are arranged horizontally. Of these three tabs 104, 106, and 108, the leftmost tab 104 is a status tab for checking the status of the multifunction device 10. The central tab 106 is a user management tab for managing information about users of the multifunction device 10. The rightmost tab 108 is a system setting tab for making various settings related to the multifunction device 10. Furthermore, an individual operation area 110 is arranged below the arrangement of the tabs 104, 106, and 108. In this individual operation area 110, an individual operation screen corresponding to the selected (operated) tab from among the tabs 104, 106, and 108 is displayed. 3 shows an example of a state in which the system settings tab 108 is selected, i.e., an example of a state in which the system settings operation screen 130 is displayed in the individual operation area 110. In this state, the system settings tab 108 has a different appearance from the other tabs 104 and 106, and is appropriately decorated, for example, by being colored in an appropriate color.
[0032] In the system setting operation screen 130, a plurality of item selection buttons 132, 132, ... for selecting items (menus) related to system settings are arranged in a vertical row on the left side. A detailed operation area 134 is arranged to the right of each item selection button 132, 132, .... In this detailed operation area 134, an individual detailed screen corresponding to an item selected by each item selection button 132, 132, .... Note that FIG. 3 shows an example of a state in which an item "image quality adjustment" related to adjustment of image quality among the system settings has been selected, and further, an item "common adjustment" related to adjustment common to each function such as the copy function and the printer function among the image quality adjustments has been selected. In this state, a detailed screen 150 for common adjustment is displayed in the detailed operation area 134. Furthermore, the item selection button 132 for selecting the common adjustment has a different appearance from the other item selection buttons 132, 132, .... Specifically, an appropriate decoration such as an appropriate color is applied.
[0033] On the common adjustment details screen 150, an appropriate character string 152 indicating the title of the common adjustment details screen 150 is disposed at the upper left position. Then, below the character string 152, an appropriate character string 154 indicating an index for registration adjustment of the image forming unit 14, which is one of the common adjustments, is disposed. Additionally, to the right of the character string 154, a button 156 for instructing execution of registration adjustment is disposed. Further, below the character string 154, an appropriate character string 158 indicating an index for cleaning of the fixing device (fixing roller) of the image forming unit 14, i.e., fixation cleaning, which is another common adjustment, is disposed. Then, to the right of the character string 158, a button 160 for instructing execution of fixation cleaning is disposed. Additionally, below the character string 158, a character string 162 indicating an index for black character / black line width adjustment, which is yet another common adjustment, is disposed. This black character / black line width adjustment refers to the adjustment of the width of black characters and black lines formed by the image formation process by the image forming unit 14. An appropriate element (GUI widget) for specifying the degree of black character / black line width adjustment, such as a combo box 164, is arranged to the right of the character string 162. Although detailed explanation including illustrations is omitted, other elements (GUI widgets such as buttons, character strings, etc.) are also arranged appropriately on the details screen 150. The details screen 150 can also be scrolled as necessary.
[0034] 3, common adjustments among the image quality adjustments in the system settings can be performed, and more precisely, operations for the common adjustments can be performed. Although detailed explanations including illustrations will be omitted, the setting screen 100 can be used to perform image quality adjustments other than the common adjustments, and can also be used to perform system settings other than image quality adjustments. In addition, the setting screen 100 can be used to check the status of the multifunction device 10 as described above, and can also be used to manage information about the user of the multifunction device 10.
[0035] As shown in FIG. 4 , the multifunction peripheral 10 according to the first embodiment is wirelessly connected to a mobile terminal 200, thereby allowing the multifunction peripheral 10 to accept user operations via the mobile terminal 200. In other words, the mobile terminal 200 functions as a remote controller for the multifunction peripheral 10. The mobile terminal 200 referred to here is, for example, a tablet, and has a display 210, specifically, a display 210 with a touch panel. The connection between the multifunction peripheral 10 and the mobile terminal 200 is established, for example, via Wi-Fi. The multifunction peripheral 10 and the mobile terminal 200 are also connected via Bluetooth. This Bluetooth connection is used to estimate the distance D between the multifunction peripheral 10 and the mobile terminal 200. That is, the multifunction peripheral 10 estimates the distance D between the multifunction peripheral 10 and the mobile terminal 200 based on the reception strength of radio waves emitted from the mobile terminal 200 for the Bluetooth connection. In FIG. 4, distance D is shown as the shortest distance between the multifunction peripheral 10 and the mobile terminal 200, but strictly speaking, it is the distance between the antennas (not shown) of both devices for Bluetooth connection.
[0036] Specifically, the multifunction device 10 includes a web server 70 for settings. This web server 70 is configured by, for example, a CPU 30a. When the mobile terminal 200 accesses the web server 70 via Wi-Fi, a terminal-side setting screen 300, such as that shown in Fig. 5, is displayed on the display 210 of the mobile terminal 200. The terminal-side setting screen 300 shown in Fig. 5 is generally similar to the setting screen 100 on the multifunction device 10 shown in Fig. 3.
[0037] 5, an appropriate character string 302 representing, for example, the model name of the multifunction peripheral 10 is arranged in the upper left position of the terminal-side setting screen 300. Three tabs 304, 306, and 308 similar to the tabs 104, 106, and 108 on the setting screen 100 on the multifunction peripheral 10 are arranged below the character string 302. Furthermore, below the arrangement of the tabs 304, 306, and 308, an individual operation area 310 similar to the individual operation area 110 on the setting screen 100 on the multifunction peripheral 10 is arranged. In this individual operation area 310, an individual operation screen corresponding to the selected tab from among the tabs 304, 306, and 308 is displayed. Note that, like FIG. 3, FIG. 5 shows an example of a state in which the system settings tab 308 is selected, i.e., an example of a state in which an operation screen 330 for system settings is displayed in the individual operation area 310. In this state, the system settings tab 308 appears differently from the other tabs 304 and 306 and is appropriately decorated, for example, colored appropriately.
[0038] On the left side of the operation screen 330 for system settings, a plurality of item selection buttons 332, 332, ... similar to the item selection buttons 132, 132, ... on the operation screen 130 of the multifunction peripheral 10 are arranged in a vertical row. A detailed operation area 334 similar to the detailed operation area 134 on the operation screen 130 of the multifunction peripheral 10 is arranged to the right of the item selection buttons 332, 332, .... In this detailed operation area 334, individual detailed screens corresponding to the items selected by the item selection buttons 332, 332, ... are displayed. Note that, similar to FIG. 3, FIG. 5 shows an example of a state in which image quality adjustment from the system settings has been selected, and furthermore, common adjustment from the image quality adjustment has been selected. In this state, a detailed screen 350 for common adjustment is displayed in the detailed operation area 334. Furthermore, the item selection button 332 for selecting the common adjustment has a different appearance from the other item selection buttons 332, 332, .... Specifically, it is appropriately decorated, such as by being colored appropriately.
[0039] On the common adjustment detail screen 350, a character string 352 similar to the character string 152 on the detail screen 150 on the multifunction device 10, i.e., an appropriate character string 352 representing the title of the common adjustment detail screen 350, is arranged in a position toward the upper left. Then, below the character string 352, a character string 354 similar to the character string 154 on the detail screen 150 on the multifunction device 10, i.e., an appropriate character string 354 representing an index for registration adjustment, is arranged. In addition, to the right of the character string 354, a button 356 similar to the button 156 on the detail screen 150 on the multifunction device 10, i.e., a button 356 for instructing execution of registration adjustment, is arranged. Furthermore, below the character string 354, a character string 358 similar to the character string 158 on the detail screen 150 on the multifunction device 10, i.e., an appropriate character string 358 representing an index for fixation cleaning, is arranged. Then, to the right of the character string 358, there is arranged a button 360 similar to the button 160 on the detailed screen 150 for common adjustment on the multifunction device 10, i.e., a button 360 for instructing execution of fixing device cleaning. In addition, below the character string 358, there is arranged a character string 362 similar to the character string 162 on the detailed screen 150 for common adjustment on the multifunction device 10, i.e., a character string 362 representing an index for black character / black line width adjustment. Then, to the right of the character string 362, there is arranged a combo box 364 similar to the combo box 164 on the detailed screen 150 for common adjustment on the multifunction device 10, i.e., a combo box 364 for instructing the degree of black character / black line width adjustment. Although detailed explanation including illustrations will be omitted, other elements are also arranged appropriately on the detailed screen 350 in FIG. 5. Furthermore, the detailed screen 350 can be scrolled as necessary.
[0040] That is, the terminal-side setting screen 300 in the state shown in Fig. 5 also allows common adjustments among the image quality adjustments in the system settings to be performed, as with the setting screen 100 on the multifunction device 10 in the state shown in Fig. 3, and more precisely, allows operations for the common adjustments to be performed. Also, although detailed explanation including illustrations will be omitted, the terminal-side setting screen 300 allows image quality adjustments other than the common adjustments to be performed, as with the setting screen 100 on the multifunction device 10, and further allows system settings other than image quality adjustments to be performed. In addition, the terminal-side setting screen 300 allows the status of the multifunction device 10 to be checked and also allows information about the user of the multifunction device 10 to be managed.
[0041] However, depending on the distance D between the multifunction device 10 and the mobile terminal 200, specifically, when the estimated value D' of the distance D exceeds a predetermined threshold value α (D'>α), the terminal-side setting screen 300 appears as shown in FIG. 6. In the terminal-side setting screen 300 shown in FIG. 6, the button 356 for instructing the execution of registration adjustment is grayed out, that is, the function of the button 356 is disabled. At the same time, the button 360 for instructing the execution of fixing device cleaning is also grayed out, that is, the function of the button 360 is also disabled. Here, the registration adjustment and the fixing device cleaning are examples of operations that require the user to be near the multifunction device 10, or in other words, examples of operations that the user must perform while checking the operation of the multifunction device 10. The threshold value α is the maximum distance between the user and the multifunction device 10 that is appropriate for the user to directly operate the multifunction device 10, and is, for example, 50 cm to 1 m. In other words, when the user is located far enough away from the multifunction device 10 that the user cannot directly operate the multifunction device 10, the terminal-side setting screen 300 will be displayed as shown in Fig. 6. That is, the functions of specific elements (two buttons 356 and 360 in this case) for accepting operations that require the user to be near the multifunction device 10 are disabled. As a result, operations that require the user to be near the multifunction device 10 cannot be performed via the mobile terminal 200.
[0042] On the other hand, when the estimated value D' of the distance D is equal to or less than the threshold value α (D'≦α), the terminal-side setting screen 300 will have a form as shown in Fig. 5. In short, for specific elements for accepting operations that require the user to be in the vicinity of the multifunction device 10, the functions are enabled only when the user is close enough to the multifunction device 10 to directly operate the multifunction device 10. In other words, operations that require the user to be in the vicinity of the multifunction device 10 can be performed via the mobile terminal 200 only when the user is in the vicinity of the multifunction device 10.
[0043] 6, the character string 354 representing the registration adjustment index and the character string 358 representing the fixation cleaning index are displayed in gray (semi-transparent). This is to emphasize that operations for instructing the execution of the registration adjustment and the fixation cleaning cannot be performed via the mobile terminal 200, but such a measure does not have to be taken.
[0044] Furthermore, operations that require the user to be near the multifunction device 10 include operations to instruct the initialization and optimization of the hard disk of the auxiliary storage unit 32. For specific elements corresponding to these operations, the functions are also disabled when the estimated value D' of the distance D exceeds the threshold value α.
[0045] As described above, when the mobile terminal 200 accesses the Web server 70 included in the multifunction peripheral 10, the terminal-side setting screen 300 is displayed on the display 210 of the mobile terminal 200. Such a terminal-side setting screen 300 is a so-called Web page, for example, configured using HTML. Therefore, for example, the "disable" attribute is applied to the terminal-side setting screen 300 in the manner shown in FIG. 6, and the buttons 356 and 360 serving as specific elements are grayed out. In other words, the terminal-side setting screen 300 in the manner shown in FIG. 6 is configured using HTML to which the "disable" attribute is applied. On the other hand, the terminal-side setting screen 300 in the manner shown in FIG. 5 is configured using HTML to which the "disable" attribute is not applied.
[0046] 7 shows a memory map 400 conceptually illustrating the internal configuration of the RAM of the main storage unit 30b. As shown in this memory map 400, the RAM has a program storage area 410 and a data storage area 450.
[0047] Of these, the program storage area 410 stores the control programs described above. Specifically, the control programs include a display control program 412, an operation detection program 414, an image reading control program 416, a document feed control program 418, an image formation control program 420, a paper feed control program 422, and a human detection program 424. The control programs also include an auxiliary storage control program 426 and a communication control program 428. Furthermore, the control programs include a setting control program 430, a web server program 432, and a web screen control program 434.
[0048] The display control program 412 is a program for generating display screen data required to display various screens, such as the setting screen 100, on the display 22b. The operation detection program 414 is a program for detecting an operation state on the touch panel 22a. The image reading control program 416 is a program for controlling the image reading unit 12. The document feed control program 418 is a program for controlling the automatic document feeder 16. The image forming control program 420 is a program for controlling the image forming unit 14. The paper feed control program 422 is a program for controlling the paper feed unit 20. The human detection program 424 is a program for controlling the human presence sensor 24. This human detection program 424 includes a program (subprogram) for determining the presence or absence of a human in the detection area described above, based on a detection signal from the human presence sensor 24. The auxiliary storage control program 426 is a program for controlling the auxiliary storage unit 32. The communication control program 428 is a program for controlling the communication unit 34. The communication control program 428 includes a program for estimating the distance D between the multifunction peripheral 10 and the portable terminal 200 based on the reception strength of Bluetooth radio waves emitted from the portable terminal 200, i.e., for calculating an estimated value D' of the distance D. Furthermore, the setting control program 430 is a program for causing the CPU 30a to execute a setting control task, which will be described later. The web server program 432 is a program for causing the CPU 30a to execute a web server task, which will be described later. And the web screen control program 434 is a program for causing the CPU 30a to execute a web screen control task, which will be described later.
[0049] Meanwhile, various types of data are stored in the data storage area 450. The various types of data referred to here include display image generation data 452, operation data 454, screen data 456, distance data 458, and the like.
[0050] The display image generation data 452 is data such as polygon data and texture data used to generate display screen data based on the above-mentioned display control program 412. The operation data 454 is data representing the operation state of the touch panel 22a, and more specifically, is time-series data representing the touch position (coordinates) of the user on the touch panel 22a. The screen data 456 is data for displaying the above-mentioned terminal-side setting screen 300 on the mobile terminal 200, that is, HTML data. The distance data 458 is data representing an estimated value D' of the distance D.
[0051] As described above, when the setting button on the home screen displayed on the display 22b of the multifunction device 10 is operated, the setting screen 100 (see FIG. 3) is displayed on the display 22b, and for this purpose the CPU 30a executes a setting control task in accordance with the setting control program 430. The flow of this setting control task is shown in FIG. 8. The CPU 30a executes the setting control task in response to the setting button being operated.
[0052] According to this setting control task, first, in step S1, the CPU 30a displays the setting screen 100 on the display 22b, and more precisely, displays an initial setting screen (not shown) on the display 22b, which is the first setting screen 100. Then, the CPU 30a advances the process to step S3.
[0053] In step S3, the CPU 30a waits for the setting screen 100 to accept some operation (S3: NO). If the setting screen 100 accepts some operation (S3: YES), the CPU 30a advances the process to step S5.
[0054] In step S5, the CPU 30a determines whether the operation accepted in step S3 is an end operation for instructing the end of the setting on the setting screen 100. For example, if the operation accepted in step S3 is an end operation (S5: YES), the CPU 30a advances the process to step S7. On the other hand, if the operation accepted in step S3 is not an end operation (S5: NO), the CPU 30a advances the process to step S9, which will be described later.
[0055] In step S7, the CPU 30a executes a predetermined ending process, including closing the setting screen 100. By executing the ending process in step S7, the CPU 30a ends the setting control task.
[0056] On the other hand, when the CPU 30a advances the process from step S5 to step S9, the CPU 30a performs a process in step S9 according to the operation accepted in step S3. After executing step S9, the CPU 30a returns the process to step S3.
[0057] At the same time, CPU 30a executes a web server task in accordance with web server program 432. As a result, terminal side setting screen 300 (see FIG. 5) is displayed on display 210 of mobile terminal 200 as described above. The flow of this web server task is shown in FIG. 9. CPU 30a executes the web server task in response to access to web server 70 from mobile terminal 200.
[0058] According to this Web server task, first, in step S101, the CPU 30a transmits to the mobile terminal 200 setting initial screen data for displaying the terminal-side setting screen 300 on the display 210 of the mobile terminal 200, specifically for displaying a terminal-side setting initial screen (not shown) which is the initial terminal-side setting screen 300. Note that data for displaying the terminal-side setting screen 300, including the setting initial screen data, is stored in the RAM (data storage area 450) of the main storage unit 30b as the above-mentioned screen data 456. After executing step S101, the CPU 30a advances the process to step S103.
[0059] In step S103, the CPU 30a waits for some terminal-side operation data to be sent from the mobile terminal 200 (S103: NO). The terminal-side operation data here refers to data corresponding to an operation accepted by the terminal-side setting screen 300. Then, when the terminal-side operation data is received from the mobile terminal 200 (S103: YES), the CPU 30a advances the process to step S105.
[0060] In step S105, the CPU 30a determines whether the terminal-side operation data received in step S103 is end operation data for instructing the end of setting on the terminal-side setting screen 300. For example, if the terminal-side operation data received in step S103 is end operation data (S105: YES), the CPU 30a proceeds to step S107. On the other hand, if the terminal-side operation data received in step S103 is not end operation data (S105: NO), the CPU 30a proceeds to step S109, which will be described later.
[0061] In step S107, the CPU 30a executes a predetermined termination process, including notifying the mobile terminal 200 that the termination operation data has been received. By executing the termination process in step S107, the CPU 30a ends the Web server task.
[0062] On the other hand, when the CPU 30a advances the process from step S105 to step S109, the CPU 30a performs processing in step S109 according to the operation data received in step S103. After executing step S109, the CPU 30a returns the process to step S103.
[0063] Furthermore, CPU 30a executes a web screen control task in accordance with web screen control program 434. As a result, the appearance of terminal-side setting screen 300 changes, that is, the appearance of specific elements changes, depending on estimated value D' of distance D between multifunction device 10 and mobile terminal 200, as described above. The flow of this web screen control task is shown in Figure 10. Note that while the web server task is being executed, CPU 30a repeatedly executes the web screen control task at regular intervals, for example, every one to several seconds.
[0064] According to this Web screen control task, in step S201, the CPU 30a first determines whether the terminal-side setting screen 300 currently displayed on the display 210 of the mobile terminal 200 is a predetermined screen, in other words, whether the above-mentioned screen data 456 is data representing the predetermined screen. The predetermined screen here refers to the terminal-side setting screen 300 in the form shown in FIGS. 5 and 6, that is, the terminal-side setting screen 300 including a specific element. In step S201, for example, if the currently displayed terminal-side setting screen 300 is the predetermined screen (S201: YES), the CPU 30a proceeds to step S203. On the other hand, if the currently displayed terminal-side setting screen 300 is not the predetermined screen (S201: NO), the CPU 30a (temporarily) terminates the Web screen control task.
[0065] In step S203, the CPU 30a determines whether the estimated value D' of the distance D based on the distance data 458 is equal to or less than the threshold value α. For example, if the estimated value D' is equal to or less than the threshold value α (S203: YES), the CPU 30a proceeds to step S205. On the other hand, if the estimated value D' exceeds the threshold value α (S203: NO), the CPU 30a proceeds to step S209, which will be described later.
[0066] In step S205, the CPU 30a determines whether a specific element included in the currently displayed terminal-side setting screen (predetermined screen) 300 is in a mode capable of accepting an operation, in other words, whether the above-mentioned screen data 456 is data representing such a terminal-side setting screen 300. Here, for example, if the specific element is in a mode capable of accepting an operation (S205: YES), the CPU 30a ends the web screen control task. On the other hand, if the specific element is in a mode not capable of accepting an operation (S205: NO), the CPU 30a proceeds to step S207.
[0067] In step S207, the CPU 30a updates the terminal-side setting screen 300 so that a specific element included in the terminal-side setting screen 300 can accept an operation, that is, transmits screen data for doing so to the mobile terminal 200. As a result, the specific element included in the terminal-side setting screen 300 can accept an operation, that is, the terminal-side setting screen 300 is updated to such an operation. With the execution of step S207, the CPU 30a ends the Web screen control task.
[0068] On the other hand, when the CPU 30a advances the process from step S203 to step S209, it determines in step S209 whether the specific element included in the currently displayed terminal-side setting screen 300 is in a state in which it is unable to accept an operation. This determination in step S209 is also made based on the above-mentioned screen data 456, similar to the determination in step S205. Here, for example, if the specific element is in a state in which it is unable to accept an operation (S209: YES), the CPU 30a ends the web screen control task. On the other hand, if the specific element is in a state in which it is able to accept an operation (S209: NO), the CPU 30a advances the process to step S211.
[0069] In step S211, the CPU 30a updates the terminal-side setting screen 300 so that a specific element included in the terminal-side setting screen 300 cannot accept operations, that is, transmits screen data for doing so to the mobile terminal 200. As a result, the specific element included in the terminal-side setting screen 300 becomes unable to accept operations, that is, the terminal-side setting screen 300 is updated to such an aspect. By executing step S211, the CPU 30a ends the Web screen control task.
[0070] As described above, according to the first embodiment, the user can operate the multifunction device 10 via the portable terminal 200. This contributes greatly to improving the operability of the multifunction device 10. On the other hand, operations that require the user to be near the multifunction device 10 can be performed via the portable terminal 200 only when the user is near the multifunction device 10. In other words, operations that require the user to be near the multifunction device 10 cannot be performed via the portable terminal 200 when the user is located far from the multifunction device 10. This is essential for ensuring smooth operation of the multifunction device 10. In other words, according to the first embodiment, it is possible to improve the operability and ensure smooth operation of the multifunction device 10.
[0071] Note that the CPU 30a in the first embodiment, specifically the CPU 30a executing the Web server task (see FIG. 9), constitutes an example of an operation screen data transmission means according to the present invention in cooperation with the communication unit 34. Additionally, the CPU 30a calculates an estimated value D' of the distance D between the multifunction peripheral 10 and the mobile terminal 200 in accordance with the above-mentioned communication control program 428, and the CPU 30a that calculates this estimated value D' constitutes an example of a distance estimation means in cooperation with the communication unit 34. Also, the CPU 30a executing the Web screen control task (see FIG. 10) is an example of an operation screen data control means.
[0072] Furthermore, in the first embodiment, the operations for performing registration adjustment and fixing cleaning are exemplified as operations that require the user to be near the multifunction device 10, but the present invention is not limited to these. As mentioned above, operations that require the user to be near the multifunction device 10 also include operations for instructing the initialization and optimization of the hard disk of the auxiliary storage unit 32. These operations are examples of specific operations according to the present invention.
[0073] In addition, in the first embodiment, as shown in Fig. 6, the case has been described in which the functions of two buttons 356 and 360 as specific elements on the terminal-side setting screen 300 are disabled by graying out those buttons 356 and 360, but this is not limiting. For example, the entire operation screen (i.e., page) corresponding to any of the tabs 304, 306, and 308 (i.e., appearing in the individual operation area 310) may be grayed out, thereby rendering the entire operation screen unable to accept operations. Also, the entire details screen corresponding to any of the item selection buttons 332, 332, ... (i.e., appearing in the detailed operation area 334) may be grayed out, thereby rendering the entire details screen unable to accept operations.
[0074] Furthermore, although Bluetooth radio waves are used to estimate the distance D, radio waves other than Bluetooth may also be used.
[0075] [Second Example] Next, a second embodiment of the present invention will be described.
[0076] In the second embodiment, for example, instead of the terminal-side setting screen 300 shown in Fig. 6, a terminal-side setting screen 300a as shown in Fig. 11 is displayed. In the terminal-side setting screen 300a shown in Fig. 11, the character string 354 and button 356 relating to registration adjustment and the character string 358 and button 360 relating to fixing device cleaning on the terminal-side setting screen 300 shown in Fig. 6 (and Fig. 5) are not displayed. In other words, in the second embodiment, by hiding a specific element, it becomes impossible for the specific element to accept an operation.
[0077] In the second embodiment, as in the first embodiment, the operability of the multifunction peripheral 10 can be improved and smooth operation can be achieved.
[0078] 11, the elements that are not to be hidden (362, 364, etc.) are arranged so as to fill the spaces where the hidden elements (354, 356, 358, and 360) were arranged, but this is not limiting. For example, the positions of the elements that are not to be hidden may be left unchanged.
[0079] Furthermore, in the second embodiment as well, the entire operation screen may be configured to be in a state where it is impossible to accept operations by, for example, hiding the entire operation screen corresponding to any of the tabs 304, 306, and 308. Alternatively, the entire details screen may be configured to be in a state where it is impossible to accept operations by hiding the entire details screen corresponding to any of the item selection buttons 332, 332, ....
[0080] [Third Example] Next, a third embodiment of the present invention will be described.
[0081] In the first embodiment (and the second embodiment) described above, the distance D was estimated based on the reception strength of the Bluetooth radio waves emitted from the mobile terminal 200 at the multifunction device 10 side, but in this third embodiment, the distance D is estimated by a different means.
[0082] Specifically, in the third embodiment, the distance D is estimated based on the detection result (human detection signal) by the human presence sensor 24, and strictly speaking, it is inferred whether or not the user is near the multifunction device 10. When the user is near the multifunction device 10, that is, when the user is detected by the human presence sensor 24, the specific element is in a state in which it is possible to accept an operation. On the other hand, when the user is located far from the multifunction device 10, that is, when the user is not detected by the human presence sensor 24, the specific element is in a state in which it is impossible to accept an operation.
[0083] In this third embodiment, step S301 shown in FIG. 12 is executed instead of step S203 in the Web screen control task described above (FIG. 10).
[0084] That is, in step S301, the CPU 30a determines whether or not a user is detected by the human presence sensor 24. Here, for example, if a user is detected by the human presence sensor 24 (S301: YES), the CPU 30a proceeds to step S205. On the other hand, if a user is not detected by the human presence sensor 24 (S301: NO), the CPU 30a proceeds to step S209.
[0085] According to the third embodiment, as in the first embodiment (and the second embodiment), the operability of the multifunction device 10 can be improved and smooth operation can be achieved.
[0086] In the third embodiment, since the person detected by the human sensor 24 may not be the user, it is essential that appropriate measures be taken to compensate for this.
[0087] [Fourth Example] Next, a fourth embodiment of the present invention will be described.
[0088] In the first embodiment (and the second and third embodiments), the setting screen 100 displayed on the display 22b of the multifunction device 10 and the terminal-side setting screen 300 (or 300a) displayed on the display 210 of the mobile terminal 200 can be operated independently of each other; in other words, they can be operated simultaneously. Therefore, for example, while a process based on an operation on one of the setting screen 100 and the terminal-side setting screen 300 is being executed, an operation to instruct the execution of some other process may be performed on the other. In particular, when an operation to instruct the execution of a process that cannot be executed in parallel with the currently executing process is performed, it is extremely important to know how to deal with this. Note that the process referred to here includes a process based on the operation of the specific element described above, that is, a specific process based on an operation that requires the user to be near the multifunction device 10.
[0089] In the fourth embodiment, if an operation is performed during the execution of a process that cannot be executed in parallel with the currently executing process, the currently executing process takes priority, and the instruction following the later operation is invalidated (ignored). In other words, the operation performed first takes priority, and a first-to-win principle is adopted. Note that if an operation is performed to execute a process that can be executed in parallel with the currently executing process, the instruction following the later operation is validated, that is, the process corresponding to the instruction is executed (in parallel). For example, this would occur if an operation to check the status of the multifunction device 10 was performed during the execution of the registration adjustment process described above.
[0090] Furthermore, in the fourth embodiment, when an operation is performed to instruct the execution of a process that cannot be executed in parallel with a process that is currently being executed, for example, when the operation is performed on the setting screen 100 of the multifunction device 10, a message screen 500 such as that shown in Fig. 13 is displayed on the display 22b of the multifunction device 10. This message screen 500 is a so-called modal dialog, and is displayed (pop-up displayed) so as to overlap the setting screen 100. The message screen 500 is displayed for a certain period of time, such as a few seconds, and then automatically closes. When this message screen 500 is displayed, the user recognizes that some process is being executed.
[0091] On the other hand, when an operation to instruct the execution of a process that cannot be executed in parallel with the currently running process is performed on the terminal-side setting screen 300, a message screen 600 such as that shown in Fig. 14 is displayed on the display 210 of the mobile terminal 200. This message screen 600 is also a modal dialog, and is displayed so as to overlap the terminal-side setting screen 300. After being displayed for a certain period of time, such as a few seconds, the message screen 600 is automatically closed.
[0092] In the fourth embodiment, the main body processing control task is executed as a subtask, so to speak, as part of step S9 in the setting control task described above (FIG. 8), in accordance with the flow shown in FIG.
[0093] According to this main body processing control task, the CPU 30a first determines in step S401 whether any processing is being executed. If any processing is being executed (S401: YES), the CPU 30a proceeds to step S403. On the other hand, if no processing is being executed, the CPU 30a proceeds to step S405, which will be described later.
[0094] In step S403, the CPU 30a determines whether the process according to the operation accepted in step S3 described above (FIG. 8) can be executed in parallel with the currently executing process. For example, if the process accepted in step S3 can be executed in parallel with the currently executing process (S403: YES), the CPU 30a proceeds to step S405. On the other hand, if the process accepted in step S3 cannot be executed in parallel with the currently executing process (S403: NO), the CPU 30a proceeds to step S407, which will be described later.
[0095] In step S405, CPU 30a starts executing processing in accordance with the operation accepted in step S3. This processing is executed by a subtask separate from the main body processing control task. Detailed description of this subtask, including illustrations, will be omitted. Upon execution of step S405, CPU 30a ends the main body processing control task.
[0096] On the other hand, when CPU 30a proceeds from step S403 to step S407, it displays message screen 500 (see FIG. 13) on display 22b in step S407. This message screen 500 is displayed for a certain period of time as described above, and then automatically closed. With the execution of step S407, CPU 30a ends the main body processing control task.
[0097] In the fourth embodiment, the Web processing control task is executed as part of step S109 in the Web server task described above (FIG. 9), that is, as a subtask, according to the flow shown in FIG.
[0098] According to this Web processing control task, the CPU 30a first determines in step S501 whether any processing is being executed. If, for example, any processing is being executed (S501: YES), the CPU 30a proceeds to step S503. On the other hand, if no processing is being executed, the CPU 30a proceeds to step S505, which will be described later.
[0099] In step S503, the CPU 30a determines whether the process according to the operation accepted in step S103 (FIG. 9) can be executed in parallel with the currently executing process. For example, if the process accepted in step S103 can be executed in parallel with the currently executing process (S503: YES), the CPU 30a proceeds to step S505. On the other hand, if the process accepted in step S103 cannot be executed in parallel with the currently executing process (S503: NO), the CPU 30a proceeds to step S507 (described later).
[0100] In step S505, the CPU 30a starts executing processing in accordance with the operation accepted in step S103. This processing is executed by a subtask separate from the Web processing control task. Detailed explanation of this subtask, including illustrations, will be omitted. With the execution of step S505, the CPU 30a ends the Web processing control task.
[0101] On the other hand, if the CPU 30a proceeds from step S503 to step S507, in step S507, it transmits message data to the mobile terminal 200 for displaying a message screen 600 (see FIG. 14) on the display 210 of the mobile terminal 200. As a result, the message screen 600 is displayed on the display 210 of the mobile terminal 200 for a certain period of time, and then the message screen 600 is closed. With the execution of step S507, the CPU 30a ends the Web processing control task.
[0102] As described above, according to the fourth embodiment, when an operation is performed to instruct the execution of a process that cannot be performed in parallel with a currently running process, the currently running process is given priority, and the instruction according to the later operation is invalidated. Furthermore, if the later operation is performed on the setting screen 100 of the multifunction device 10, for example, a message screen 500 (see FIG. 13) is displayed on the setting screen 100. Furthermore, if the later operation is performed on the terminal-side setting screen 300, a message screen 600 (see FIG. 14) is displayed on the terminal-side setting screen 300. This contributes significantly to the smooth operation of the multifunction device 10.
[0103] In the fourth embodiment, a subsequent operation performed on the setting screen 100 of the multifunction peripheral 10, or more precisely, an operation instructing the execution of a process that cannot be executed in parallel with a currently executing process, is an example of a second operation according to the present invention. The CPU 30a executing the main body processing control task (see FIG. 15), and in particular the CPU 30a that terminates the main body processing control task by executing step S407, is an example of a second disabling means according to the present invention. Furthermore, the CPU 30a executing step S407 in the main body processing control task, in cooperation with the display 22b, constitutes an example of a message output means according to the present invention. The message screen 500 displayed on the display 22b is an example of a second message according to the present invention. Instead of or in addition to the message screen 500 being displayed, an appropriate voice message may be output.
[0104] Furthermore, in the fourth embodiment, a subsequent operation performed on the terminal-side setting screen 300, strictly speaking, an operation instructing the execution of a process that cannot be executed in parallel with the currently executing process, is an example of a first operation according to the present invention. The CPU 30a executing the Web processing control task (see FIG. 16), and particularly the CPU 30a that terminates the Web processing control task by executing step S507, is an example of a first disabling means according to the present invention. Furthermore, the CPU 30a executing step S507 in the Web processing control task, in cooperation with the communication unit 34, constitutes an example of a message data transmission means according to the present invention. The message screen 600 displayed on the display 210 of the mobile terminal 200 is an example of a first message according to the present invention. Instead of or in addition to the message screen 600 being displayed, an appropriate voice message may be output from the mobile terminal 200.
[0105] [Other application examples] The above-described embodiments are specific examples of the present invention and do not limit the technical scope of the present invention. The present invention can also be applied to aspects other than these embodiments.
[0106] For example, although the connection between the multifunction peripheral 10 and the portable terminal 200 is established by Wi-Fi, a communication standard other than Wi-Fi may be adopted. In an extreme example, the multifunction peripheral 10 and the portable terminal 200 may be connected by only Bluetooth or IrDA, that is, all data including screen data may be transmitted and received between the multifunction peripheral 10 and the portable terminal 200. Note that when the multifunction peripheral 10 and the portable terminal 200 are connected by only IrDA, the distance D may be estimated based on the detection result by the human presence sensor 24 as in the third embodiment.
[0107] Furthermore, although a pyroelectric infrared sensor is employed as the human presence sensor 24, a sensor that uses ultrasonic waves or radio waves may also be employed. Furthermore, instead of or in addition to the human presence sensor 24, a video camera may be used.
[0108] In the above-described embodiments, the setting screen 100 and the terminal-side setting screen 300 are used as operation screens for settings, but the present invention is not limited to these. The present invention can also be applied to an operation screen for a job that causes the multifunction device 10 to execute a job.
[0109] Furthermore, although the terminal-side setting screen 300 is a web page configured using HTML, it is not limited to this. For example, the terminal-side setting screen 300 may be configured using a dedicated application program (app).
[0110] In addition, the mobile terminal 200 is not limited to a tablet, and may be, for example, a smartphone. A notebook personal computer may also be employed as the mobile terminal 200. Furthermore, a personal digital assistant (PDA), a feature phone, or the like may also be employed as the mobile terminal 200.
[0111] In each embodiment, the present invention is described as being applied to the multifunction peripheral 10, but the present invention is not limited to this. That is, the present invention can also be applied to image processing devices other than the multifunction peripheral 10.
[0112] Furthermore, the present invention is not limited to the form of an image processing device, but can also be provided in the form of a system, that is, an image processing system comprising an image processing device and a mobile terminal, or in the form of a program, that is, a control program for the image processing device, or even in the form of a method, that is, a control method for the image processing device.
[0113] Additionally, the present invention can also be provided in the form of a computer-readable recording medium on which a control program for an image processing device is non-transiently (non-transiently) recorded. Examples of the recording medium referred to here include semiconductor media such as SD memory cards and USB memory, and disc media such as CDs and DVDs. In addition to these portable storage media, device-embedded (built-in) storage media such as ROMs and hard disk drives can also be used as the recording medium referred to here. [Explanation of symbols]
[0114] 10…Multifunction device 22 ... Operation unit 22a ... Touch panel 22b … Display 24... Human sensor 30...Control section 30a...CPU 34 … Communications Department 34a... Radio communication section 100...Settings screen 200 … Mobile devices 210 … Display 300 ... Device setting screen 356, 360... buttons 500, 600... Message screen D... distance
Claims
1. An image processing device that is wirelessly connected to a mobile terminal having a display and can accept operations by a user via the mobile terminal, an operation screen data transmission means for transmitting operation screen data for displaying an operation screen required to accept the operation on the display to the mobile terminal; distance estimation means for estimating the distance to the mobile terminal; an operation screen data control means for controlling the operation screen data so that, when a distance estimated by the distance estimation means is equal to or smaller than a predetermined threshold, the operation screen is in a state in which it is possible to accept a specific operation that is the specific operation, and, when the estimated distance exceeds the threshold, the operation screen is in a state in which it is not possible to accept the specific operation; a first invalidation means for invalidating an instruction according to the first operation when a first operation is received via the mobile terminal, the first operation being the operation instructing execution of a process that cannot be executed in parallel with the specific process during execution of the specific process according to the specific operation; and an operation receiving means capable of directly receiving the operation; The image processing device, wherein the threshold value is a maximum value of the distance at which the user can directly operate the operation accepting means.
2. 2. The image processing device according to claim 1, further comprising a message data sending means for sending message data to the mobile terminal for causing the mobile terminal to output a predetermined first message when the instruction following the first operation is disabled by the first disabling means.
3. An image processing device as described in claim 1 or 2, further comprising a second disabling means for disabling an instruction following a second operation, which is an operation that instructs the execution of a process that cannot be executed in parallel with the specific process while the specific process is being executed, when the second operation is accepted by the operation accepting means.
4. The image processing device according to claim 3 , further comprising a message output unit that outputs a predetermined second message when the instruction according to the second operation is invalidated by the second invalidation unit.
5. A control program for an image processing device that is wirelessly connected to a mobile terminal having a display and can accept operations by a user via the mobile terminal, and also includes an operation accepting unit that can directly accept the operations, an operation screen data transmission procedure of transmitting to the mobile terminal operation screen data for displaying an operation screen required to accept the operation on the display; a distance estimation step of estimating a distance between the mobile terminal; an operation screen data control procedure for controlling the operation screen data so that, when a distance estimated by the distance estimation procedure is equal to or less than a predetermined threshold, the operation screen is in a mode capable of accepting a specific operation that is the specific operation, and, when the estimated distance exceeds the threshold, the operation screen is in a mode not capable of accepting the specific operation; and when a first operation is received via the mobile terminal, the first operation being an operation instructing execution of a process that cannot be executed in parallel with the specific process during execution of the specific process in accordance with the specific operation, causing a computer of the image processing device to execute a first invalidation procedure for invalidating the instruction in accordance with the first operation; The threshold value is a maximum value of the distance at which the user can directly operate the operation accepting means.
6. 1. A method for controlling an image processing device that is wirelessly connected to a mobile terminal having a display, can accept user operations via the mobile terminal, and also includes an operation accepting unit that can directly accept the operations, an operation screen data transmission step of transmitting to the mobile terminal operation screen data for displaying an operation screen required to accept the operation on the display; a distance estimation step of estimating a distance to the mobile terminal; an operation screen data control step of controlling the operation screen data so that, when the distance estimated by the distance estimation step is equal to or less than a predetermined threshold, the operation screen is in a mode capable of accepting a specific operation that is the specific operation, and, when the estimated distance exceeds the threshold, the operation screen is in a mode not capable of accepting the specific operation; and a first invalidation step of invalidating an instruction according to the first operation when a first operation is received via the mobile terminal, the first operation being the operation instructing execution of a process that cannot be executed in parallel with the specific process during execution of the specific process according to the specific operation, The threshold value is a maximum value of the distance at which the user can directly operate the operation accepting means.
Citation Information
Patent Citations
Notification method, interruption inhibition method, interruption control method, job processor, and user terminal
JP2006094127A
Image processing apparatus, screen information providing method, and program
JP2013256060A
Image forming apparatus, image forming system, and program
JP2017019121A
Remote operation system, image forming apparatus, remote operation method, and remote operation program
JP2017207850A
Image formation apparatus, image formation system and program
JP2019106712A