Portable terminal device, image processing device, and program

Abstract

To solve the problem in which there is a concern that an owner's privacy may be violated if an image of an application unrelated to image processing is displayed.SOLUTION: A portable terminal device includes a communication unit that communicates with an image processing device, a control unit that is capable of executing a plurality of applications including a first application related to image processing and a second application unrelated to image processing, and a display unit that displays an image corresponding to an application being executed. The control unit restricts the display of an image corresponding to the second application in a communication state in which a communication connection between the communication unit and the image processing device is established.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present disclosure relates to a mobile terminal device, an image processing device, and a program. [Background technology]

[0002] Patent Document 1 describes an image processing cooperation system in which an operation screen of an image processing device is displayed on a mobile terminal device, and the image processing device is operated from the mobile terminal device.

[0003] In this image processing linkage system, the image processing device transmits remote screen display data to the mobile terminal device. The mobile terminal device uses the remote screen display data to display a remote screen that allows remote operation of the image processing device. This allows the user to remotely operate the image processing device from the mobile terminal device by touching the remote screen displayed on the mobile terminal device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-219706 A Summary of the Invention

[0005] A portable terminal device according to a first aspect of the present disclosure includes a communication unit that communicates with an image processing device that performs image processing, a control unit capable of executing a plurality of applications including a first application related to the image processing and a second application unrelated to the image processing, and a display unit that displays an image corresponding to an application currently being executed among the plurality of applications, wherein the first application includes an operation application used to operate the image processing, and the control unit restricts the display of an image corresponding to the second application in a communication state in which a communication connection between the communication unit and the image processing device is established.

[0006] An image processing device according to a second aspect of the present disclosure includes a communication unit that communicates with a portable terminal device capable of executing a plurality of applications including a first application related to image processing and a second application unrelated to the image processing, an image processing unit that performs the image processing based on a user operation on the portable terminal device, and a control unit that controls the communication unit to send information to the portable terminal device to restrict the display of an image corresponding to the second application when a communication connection with the portable terminal device is established by the communication unit.

[0007] A program according to a third aspect of the present disclosure causes a mobile terminal device to execute the following steps: communicating with an image processing device that performs image processing; executing one of a plurality of applications including a first application that is an application related to the image processing and includes an operation application used to operate the image processing, and a second application that is not related to the image processing; displaying an image corresponding to an application that is being executed among the plurality of applications; and restricting the display of an image corresponding to the second application in a communication state in which a communication connection with the image processing device is established. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the configuration of an operation support system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an operation panel according to the embodiment. [Diagram 3] 5A and 5B are diagrams illustrating an example of a position where the mobile terminal device according to the embodiment is leaned against the image processing device. [Figure 4] 1 is a diagram illustrating an example of a configuration in which a mobile terminal device according to an embodiment is held vertically in an image processing device; [Diagram 5] 1 is a diagram illustrating an example of a configuration in which a mobile terminal device according to an embodiment is held horizontally in an image processing device; [Figure 6] FIG. 1 is a diagram illustrating an example of the configuration of an image processing device according to an embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a mobile terminal device according to an embodiment. [Figure 8] 11 is a flowchart illustrating a first operation example of restricting display of an image corresponding to a second application in a communication state in which a communication connection is established between a communication unit of the portable terminal device according to the embodiment and an image processing device. [Figure 9] 11 is a flowchart illustrating a second operation example for restricting display of an image corresponding to a second application in a communication state in which a communication connection is established between a communication unit of the portable terminal device according to the embodiment and an image processing device. [Figure 10] 13 is a flowchart illustrating a third operation example of restricting display of an image corresponding to a second application in a communication state in which a communication connection is established between the communication unit of the portable terminal device according to the embodiment and the image processing device. [Figure 11] 13 is a flowchart illustrating a fourth operation example for restricting display of an image corresponding to a second application in a communication state in which a communication connection is established between the communication unit of the portable terminal device and the image processing device according to the embodiment. [Figure 12] 5A to 5C are diagrams illustrating an example of transition of a display screen of the mobile terminal device according to the embodiment. [Figure 13] 11 is a diagram showing an example of a display screen in a communication state in which a connection is established between the mobile terminal device and the image processing device according to the embodiment; FIG. [Figure 14] 13 is a diagram showing another example of a display screen in a communication state in which a connection is established between the mobile terminal device and the image processing device according to the embodiment; FIG. [Figure 15] 11 is a diagram showing an example of a display screen when a notification condition is satisfied in a non-communication state in which a connection is not established between the mobile terminal device and the image processing device according to the embodiment; FIG. [Figure 16] 11 is a diagram showing an example of a display screen when a notification condition is satisfied in a communication state in which a connection is established between the mobile terminal device and the image processing device according to the embodiment; FIG. [Figure 17] 10 is a flowchart illustrating an example of the operation of the operation assistance system according to the embodiment. [Figure 18] 10 is a flowchart illustrating an example of the operation of an image forming apparatus according to a modified example of the embodiment. [Figure 19] 13 is a diagram showing another example of the display screen when the notification condition is satisfied in a state in which the mobile terminal device according to the modified example of the embodiment is connected to the image processing device. FIG. [Figure 20] 10 is a flowchart illustrating an example of the operation of a mobile terminal device according to a modified example of the embodiment. [Figure 21] 13 is a flowchart illustrating another operation example of the mobile terminal device according to the modified example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an operation assistance system including a mobile terminal device and an image processing device according to an embodiment will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0010] (1) Overview of the embodiment A portable terminal device may be used by a person other than the owner of the portable terminal device to operate an image processing device. In such a case, if an image of an application unrelated to image processing is displayed on the portable terminal device as an image of a notification for the owner, for example, there is a concern that the privacy of the owner may be violated. Therefore, the conventional technology of operating an image processing device using a portable terminal device has room for improvement from the viewpoint of information security.

[0011] The portable terminal device of the present disclosure comprises a communication unit that communicates with an image processing device that performs image processing, a control unit capable of executing a plurality of applications including a first application related to the image processing and a second application unrelated to the image processing, and a display unit that displays an image corresponding to an application currently being executed among the plurality of applications, wherein the first application includes an operation application used to operate the image processing, and the control unit restricts the display of an image corresponding to the second application in a communication state in which a communication connection between the communication unit and the image processing device is established.

[0012] (2) System configuration example 1 is a diagram showing an example of the configuration of an operation support system according to an embodiment of the present invention. The operation support system according to the present embodiment includes an image processing device 3 (also called a “printer”) and a mobile terminal device 5.

[0013] The image processing device 3 is a device that executes image processing including printing. The image processing device 3 may be capable of executing image processing other than printing, for example, scanning. The image processing device 3 also has a function of communicating with a mobile terminal device 5. In this embodiment, an example in which the image processing device 3 communicates with the mobile terminal device 5 via wireless communication will be mainly described, but the image processing device 3 may also communicate with the mobile terminal device 5 via wired communication. In the illustrated example, the image processing device 3 is a small printer for home use. However, the image processing device 3 may also be a large multifunction peripheral (MFP: Multi Function Printer) installed in an office or store.

[0014] The printing operation performed by the image processing device 3 is an operation that includes at least printing. The printing operation includes "printing" in which the mobile terminal device 5 transmits print data (image data) to the image processing device 3 and the image processing device 3 prints it. The printing operation also includes "copying" in which the image processing device 3 prints scan data (image data) obtained by scanning.

[0015] In the illustrated example, the image processing device 3 has a paper feed tray 36, a paper discharge tray 37, a document table cover 38, and a document table 39. The paper sheets set in the paper feed tray 36 are transported one by one to a printing unit 31a (not shown in FIG. 1, see FIG. 3), where printing is performed in the printing unit 31a, and the paper sheets are discharged from the document discharge tray 37. The document table cover 38 can be opened upward with an end of the document table 39 as a fulcrum, and a sheet is placed on the document table 39 with the document table cover 38 open, and scanning is performed with the document table cover 38 open or closed. The operation panel 32 is provided at a corner on the upper surface side of the image processing device 3. The operation panel 32 will be described in detail later, and the operation panel 32 accepts various operations related to the image processing device 3 from a user. In addition, a cutout portion 321 is provided in the operation panel 32. The mobile terminal device 5 may be placed against the cutout portion 321, and various operations related to the image processing device 3 may be received from the user through the mobile terminal device 5.

[0016] The mobile terminal device 5 is a device capable of operating the image processing device 3 through communication with the image processing device 3. The mobile terminal device 5 may be a mobile terminal, for example, a smartphone, a tablet terminal, a notebook computer (PC), etc. The mobile terminal device 5 moves along with the movement of the user.

[0017] The mobile terminal device 5 is capable of executing a plurality of applications. The plurality of applications include a first application related to the image processing of the image processing device 3 and a second application not related to the image processing of the image processing device 3. The first application includes an operation application used for operating the image processing of the image processing device 3. The mobile terminal device 5 displays an execution screen of an application being executed among the plurality of applications. Although details will be described later, the execution screen of the operation application is displayed, for example, as an execution screen of a mobile application for operating the image processing device 3. Note that, examples of the first application include a document application, a photo application, an email application, and a browser application. On the other hand, examples of the second application include a clock application, a weather forecast application, and a chat application.

[0018] A cutout 321 may be provided on an edge of the operation panel 32. Although details will be described later, the cutout 321 is provided as a place for leaning the mobile terminal device 5. By leaning the mobile terminal device 5 against the cutout 321 and connecting the mobile terminal device 5 and the image processing device 3 via a wired medium or a wireless medium, it becomes possible to display an execution screen of an operation application on the mobile terminal device 5. This makes it possible to use the mobile terminal device 5 as an operation screen for the image processing device 3 even if the image processing device 3 does not have a configuration for displaying an operation screen.

[0019] (3) Example of the configuration of the operation panel 32 FIG. 2 is a diagram showing an example of the configuration of the operation panel 32 according to the embodiment. The operation panel 32 has a function of accepting user operations (user inputs). The operation panel 32 has a display unit 32a and an operation unit 32b. The display unit 32a is composed of, for example, lamps 32a1 and 32a2 indicating paper settings such as the selected paper size and paper type, a lamp 32a3 indicating the status of the wireless network, and a lamp 32a4 indicating the status of the power supply. Hereinafter, the lamps 32a1, 32a2, 32a3, and 32a4 will be referred to as lamps unless otherwise specified. Each lamp is composed of, for example, an LED (Light Emitting Diode). The operation unit 32b has a button 32b1 for accepting paper settings, a button 32b2 for accepting wireless settings, a button 32b3 for setting the power supply to an on or off state, a button 32b4 for starting monochrome copying in which a monochrome image or grayscale image is formed on paper, and a button 32b5 for starting color copying in which a color image is formed on paper. Hereinafter, buttons 32b1, 32b2, 32b3, 32b4, and 32b5 will be referred to as buttons unless otherwise specified. Note that operation panel 32 may be configured as a touch panel display in which a touch panel as operation unit 32b is superimposed on a liquid crystal display as display unit 32a. Note that FIG. 2 shows an example in which notch 321 is provided on the left edge of operation panel 32.

[0020] (4) Configuration example of cutout portion 321 FIG. 3 is a diagram showing an example of a position where the mobile terminal device 5 according to the embodiment is leaned against the image processing device 3. As shown in FIG. 3, an NFC (registered trademark; Near Field Communication) antenna 321a is embedded in the cutout portion 321. As a result, if the mobile terminal device 5 equipped with an NFC function is leaned against the cutout portion 321, the mobile terminal device 5 can communicate with the image processing device 3 via the NFC antenna 321a. Therefore, communication between the mobile terminal device 5 and the image processing device 3 is possible via the NFC antenna 321a, and it is possible to display an execution screen of a printer operation application on the mobile terminal device 5. In addition, information (SSID, etc.) required for a Wi-Fi communication connection may be transmitted and received between the mobile terminal device 5 and the image processing device 3 through communication via the NFC antenna 321a. Thereafter, the mobile terminal device 5 and the image processing device 3 may establish a Wi-Fi communication connection, and the mobile terminal device 5 may be able to display an execution screen of a printer operation application through Wi-Fi communication. In addition, a Bluetooth (registered trademark) antenna may be embedded in the cutout portion 321. In this case, the portable terminal device 5 equipped with a Bluetooth antenna may be leaned against the cutout portion 321, and after pairing is performed, various signals may be transmitted and received between the portable terminal device 5 and the image processing device 3. This may enable the portable terminal device 5 to display an execution screen of a printer operation application through Bluetooth communication.

[0021] FIG. 4 is a diagram showing a configuration example in which the mobile terminal device 5 according to the embodiment is held vertically in the image processing device 3. In the example of FIG. 4, the mobile terminal device 5 is held by the holding units 321b and 321c in a state in which the connection terminal 321d is inserted into the lower part of the mobile terminal device 5 and electrically connected. Specifically, the holding unit 321b holds the upper and lower sides of the left edge of the mobile terminal device 5 from the left side of the notch 321, and prevents, for example, the volume control button from being pressed. The holding unit 321c holds the upper and lower sides of the right edge of the mobile terminal device 5 from the right side of the notch 321, and prevents, for example, the power button from being pressed. Note that the holding units 321b and 321c may be rotated 90 degrees, and the mobile terminal device 5 may be held in a state in which the mobile terminal device 5 is lying down. At this time, the connection terminal 321d itself may be rotated 90 degrees, and a cord on the end side of the connection terminal 321d may be extended.

[0022] Fig. 5 is a diagram showing a configuration example in which a mobile terminal device 5 according to an embodiment is held horizontally in the image processing device 3. In the example of Fig. 5, the mobile terminal device 5 is held by the holding units 321e and 321f in a state in which the connection terminal 321d is inserted into the lower part of the mobile terminal device 5 and electrically connected. Specifically, the holding unit 321f holds the upper and lower sides of the left edge of the mobile terminal device 5. Furthermore, the holding unit 321e holds the rear side of the holding unit 321f.

[0023] (5) Example of configuration of image processing device 3 FIG. 6 is a diagram showing an example of the configuration of an image processing device 3 according to an embodiment. As shown in FIG. 6, the image processing device 3 has a printing unit 31a, a scanner unit 31b, an operation panel 32, a control unit 34, a storage unit 35, and a communication unit 312. The image processing device 3 has a configuration capable of performing one or more types of image processing. In the present disclosure, the printing unit 31a and the scanner unit 31b are provided as components for performing image processing. The printing unit 31a and the scanner unit 31b constitute an image processing unit 31. However, the image processing device 3 may have a configuration having only one of the printing unit 31a and the scanner unit 31b.

[0024] In the present disclosure, the types of image processing executed by the image processing unit 31 include "print", "copy", and "scan". That is, the image processing device 3 has the functions of "print", "copy", and "scan". Although not shown in the figures, the image processing device 3 may have paper post-processing functions such as stapling, punching, sorting, and trimming in addition to the above-mentioned functions.

[0025] "Copy" is a function for printing an image read by the scanner unit 31b on paper by the printing unit 31a. "Print" is a function for printing an image based on data received from the outside by the communication unit 312 or an image based on data stored in a recording medium (not shown) connected to the image processing device 3 by the printing unit 31a. "Scan" is a function for saving an image read by the scanner unit 31b as data. The saving destination is, for example, an auxiliary storage device (non-volatile memory from another point of view) included in the storage unit 35, a storage medium connected to the image processing device 3, or another device that communicates with the image processing device 3 via the communication unit 312.

[0026] The image processing unit 31 does not necessarily have to support all of these functions. The image processing device 3 may support, for example, only one or two of the functions of "print", "copy", and "scan". The image processing unit 31 may further support the function of "email". "Email" is a function for setting and executing e-mail. In the "email" function, for example, part or all of the contents of an e-mail received by the communication unit 312 may be printed by the printing unit 31a, and the communication unit 312 may send image data read by the scanner unit 31b by e-mail.

[0027] The printing unit 31a prints an image under the control of the control unit 34. For example, the printing unit 31a prints on paper placed in the paper feed tray 36 shown in FIG. 1, and discharges the printed paper to the paper discharge tray 37. Specifically, if the printing unit 31a is configured as a laser printer, for example, the printing unit 31a primarily transfers toner images of each color of Y (yellow), M (magenta), C (cyan), and K (black) formed on a photosensitive drum onto an intermediate transfer belt, superimposes the four color toner images on the intermediate transfer belt, and then secondarily transfers the images onto the paper, thereby forming an image on the paper, and discharges the paper on which the image has been formed onto the paper discharge tray 37.

[0028] Although an example in which the printing unit 31a forms a color image on paper has been described, the present invention is not particularly limited to this. For example, the printing unit 31a may be configured to be capable of forming a monochrome image or a grayscale image on paper. The printing unit 31a may also be configured as an inkjet printer. In the example of FIG. 1, the printing unit 31a has only one paper feed tray 36, but the present invention is not particularly limited to this. For example, the printing unit 31a may have multiple paper feed trays 36. If the printing unit 31a has multiple paper feed trays 36, for example, the multiple paper feed trays 36 can accommodate paper of different sizes. Also, a partition plate may be provided in one paper feed tray 36, and the partition plate may enable the accommodation of paper of different sizes. Also, the printing unit 31a may have a function of selecting the size of paper.

[0029] The scanner unit 31b performs image scanning under the control of the control unit 34, and generates image data. Specifically, when the document table cover 38 shown in FIG. 1 is closed, the scanner unit 31b performs imaging (scanning) of a document placed on the document table 39 by an imaging device moving along the document glass, and generates image data.

[0030] The communication unit 312 communicates with the mobile terminal device 5. The communication unit 312 includes at least one of a wireless LAN communication unit 312a, an NFC communication unit 312b, and a USB communication unit 312c. The wireless LAN communication unit 312a performs wireless communication with the mobile terminal device 5 in a wireless LAN communication format. The NFC communication unit 312b performs wireless communication with the mobile terminal device 5 in an NFC format. The NFC communication unit 312b cooperates with the NFC antenna 321a in FIG. 3 to perform wireless communication in an NFC format. The USB communication unit 312c performs communication with the mobile terminal device 5 in a USB format via the connection terminal 321d in FIG. 4 or FIG. 5. Note that FIG. 1 shows an example in which the operation support system includes the image processing device 3 and the mobile terminal device 5, but may further include servers such as a file server, a mail server, and a Web server. In this case, the communication unit 312 can also communicate with servers such as a file server, a mail server, and a Web server.

[0031] The control unit 34 includes one or more processors and controls the entire image processing device 3. The control unit 34 executes various processes by executing a control program stored in the storage unit 35. The control unit 34 controls the operations of the printing unit 31a, the scanner unit 31b, the communication unit 312, and the operation panel 32. For example, when the control unit 34 receives a user's operation (instruction) via the operation unit 32b, the control unit 34 executes a process according to the operation content corresponding to the operation. Each lamp constituting the display unit 32a indicates the operation content corresponding to each operation according to the instruction from the control unit 34. For example, when the communication unit 311 is connected to the mobile terminal device 5 via a wireless medium, the lamp 32a3 remains lit. The control unit 34 may include a logic circuit or the like configured to perform only a certain operation.

[0032] The storage unit 35 includes various memories, such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an auxiliary storage device. The combination of the control unit 34 and the storage unit 35 may be regarded as a computer. The programs executed by the control unit 34 are stored in various memories, such as the ROM of the storage unit 35 and the auxiliary storage device.

[0033] The printing unit 31a, the scanner unit 31b, the communication unit 312, the operation panel 32, the control unit 34, and the storage unit 35 are connected by, for example, a bus 33. In Fig. 6, all the components are connected to one bus 33 in a schematic manner, but there may be multiple buses 33. For example, an address bus, a data bus, and a control bus may be provided as the multiple buses 33.

[0034] 1 illustrates the appearance of a multifunction device for home or personal use, not that of a business multifunction device, as the external appearance of the image processing device 3. However, the image processing device 3 may be operated in any manner. For example, the image processing device 3 may be installed in a company and used by a specific number of users, or may be installed in a store such as a supermarket or convenience store and used by an unspecified number of users.

[0035] (6) Example of the Configuration of the Mobile Terminal Device 5 7 is a diagram showing an example of the configuration of a mobile terminal device 5 according to an embodiment. The mobile terminal device 5 has a communication unit 510, a display unit 521, an operation unit 522, an imaging unit 530, a control unit 540, and a storage unit 550. The mobile terminal device 5 does not necessarily have to have the imaging unit 530. The mobile terminal device 5 further has a power supply unit (not shown). The power supply unit may include a battery.

[0036] The communication unit 510 communicates with the image processing device 3. The communication unit 510 includes at least one of a wireless LAN communication unit 510a, an NFC communication unit 510b, and a USB communication unit 510c. The wireless LAN communication unit 510a performs wireless LAN communication with the image processing device 3. The NFC communication unit 510b performs NFC communication with the image processing device 3. The USB communication unit 510c performs USB communication with the image processing device 3. The mobile terminal device 5 may further include a public network communication unit that performs communication via a public network. The public network may include a cellular communication network. The public communication network may be the cellular communication unit.

[0037] The display unit 521 displays an image under the control of the control unit 540. The operation unit 522 accepts a user operation (user input). The display unit 521 is configured with a liquid crystal display unit or an organic EL display unit. At least a part of the operation unit 522 may be integrated with the display unit 521 to configure the touch panel display unit 520. In the following, an example in which the display unit 521 and the operation unit 522 configure the touch panel display unit 520 will be mainly described. However, at least a part of the operation unit 522 may be configured as one or more physical buttons. The operation unit 522 detects the position of a touch operation on the display unit 521 and outputs the detection result.

[0038] The imaging unit 530 constitutes a camera including an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), etc. The imaging unit 530 electronically captures an image under the control of the control unit 540, and outputs image data.

[0039] The control unit 540 includes one or more processors and controls the entire portable terminal device 5. For example, the control unit 540 executes various processes and various controls by executing programs stored in the storage unit 550. The programs include a printer operation application (also simply referred to as an "operation application") for operating the image processing device 3. The control unit 540 may include a logic circuit or the like configured to perform only certain operations. The operations of the portable terminal device 5 described above and below may be operations controlled by the control unit 540.

[0040] The storage unit 550 includes various memories such as a ROM, a RAM, and an auxiliary storage device. The combination of the control unit 540 and the storage unit 550 may be regarded as a computer. The programs executed by the control unit 540 are stored in the ROM and / or the auxiliary storage device of the storage unit 550, for example.

[0041] Each unit of the mobile terminal device 5 is electrically connected by a bus 560. In the illustrated example, all the components are connected to one bus 560, but multiple buses, for example, an address bus, a data bus, and a control bus, may be provided. Also, an interface may be interposed between the bus 560 and each unit.

[0042] In the mobile terminal device 5 according to the embodiment, the storage unit 550 may store personal information that is information capable of identifying a specific individual. The personal information is, for example, address information such as an email address. The address information may be managed by the second application. The display unit 521 is capable of displaying an execution screen of the application currently being executed out of the first application and the second application. The control unit 540 is capable of executing each of the multiple applications.

[0043] In the mobile terminal device 5 according to the embodiment, the communication unit 510 communicates with the image processing device 3 that performs image processing. The control unit 540 is capable of executing a plurality of applications including a first application related to image processing and a second application unrelated to image processing. The first application includes an operation application used for operating the image processing. The display unit 32a displays an image corresponding to an application currently being executed among the plurality of applications. In a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 restricts the display of an image corresponding to the second application.

[0044] Here, the image corresponding to the second application is, for example, at least one of an icon of the second application, an execution screen of the second application, and a notification object by the second application.

[0045] Furthermore, "restricting display" may mean, for example, prohibiting display, performing limited display, or requesting user authentication (password input) and permitting display only if authentication is successful. For example, "restricting display of an image corresponding to the second application" may mean prohibiting display of an icon of the second application, prohibiting display of an execution screen of the second application, or prohibiting display of a notification object by the second application.

[0046] According to the mobile terminal device 5 of the embodiment, even if a person other than the owner of the mobile terminal device 5 uses the mobile terminal device 5 to operate the image processing device 3, the display of images corresponding to the second application unrelated to image processing is restricted, thereby making it possible to ensure the information security of the owner.

[0047] The first application includes an application (for example, a document application, a photo application, an email application, a browser application) that handles image data to be printed by the image processing device 3. In a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 may not restrict the display of an image corresponding to the first application, but may restrict the display of an image corresponding to the second application. According to such an operation example, the display of an image of an application that handles image data to be printed is not restricted, so that it becomes possible to select image data to be printed, and it is possible to prevent a decrease in user convenience.

[0048] Note that the selection of the image processing target on which the operation application performs image processing can be performed in the following ways, for example.

[0049] First, a related first application may be accessed (referenced) on the execution screen of the operation application. For example, "Print" displayed on the execution screen may be selected, then an icon indicating a "print subject" may be selected, and a specific first application suitable for the selected "print subject" may be selected from a list of related first applications, thereby selecting an image to be processed by the operation application (first configuration).

[0050] Secondly, in the operation application, a dedicated folder in which image data of the related first application is collected in advance may be created (second configuration).

[0051] By adopting the above first and second configurations, the risk that a person other than the owner of the mobile terminal device 5 will inadvertently transition to the home screen or launch a second application from the home screen in order to select an image processing target is reduced, thereby maintaining the information security of the owner.

[0052] Furthermore, the settings of the first application and the second application may be selected by the "settings" function when the mobile terminal device 5 is connected to the image processing device 3 or in advance (after the operation application is downloaded). For example, applications that are permitted to be displayed on the execution screen or applications that are prohibited from being displayed on the execution screen may be selected.

[0053] (7) Example of Operation of the Portable Terminal Device 5 8 to 11 are flowcharts illustrating an example of an operation for restricting the display of an image corresponding to the second application in a communication state in which a communication connection is established between the communication unit 510 of the mobile terminal device 5 and the image processing device 3. In FIG.

[0054] FIG. 8 is a flowchart illustrating a first operation example for restricting the display of an image corresponding to a second application in a communication state in which a communication connection is established between the communication unit 510 of the mobile terminal device 5 and the image processing device 3.

[0055] In the operation example of Fig. 8, the display unit 521 can display a home screen on which a plurality of icon image objects corresponding to a plurality of applications are arranged so as to be selectable by the user. In a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 causes the display unit 521 to display an operation screen corresponding to an operation application, and restricts transition from the operation screen to the home screen. According to such an operation example, since the operation of the home screen is restricted in the mobile terminal device 5, it is possible to ensure information security of the owner of the mobile terminal device 5.

[0056] In step S101, the mobile terminal device 5 determines the communication state with the image processing device 3. If the communication connection with the image processing device 3 is established (step S101; YES), the mobile terminal device 5 displays an execution screen of the operation application in step S102, and prohibits transition to the home screen in step S103. The process of step S103 corresponds to the process of prohibiting the display of the icon of the second application. On the other hand, if the communication connection with the image processing device 3 is not established (step S101; NO), the mobile terminal device 5 allows transition to the home screen in step S104.

[0057] 8 is a control operation to prevent transition to the start (home) screen of the mobile terminal device 5. However, when the connection of the mobile terminal device 5 to the image processing device 3 is released, such a restriction is unnecessary. Also, as an exception, when a phone call is received by the mobile terminal device 5, such a restriction may be released by, for example, pressing a button.

[0058] FIG. 9 is a flowchart illustrating a second operation example for restricting the display of an image corresponding to a second application in a communication state in which a communication connection is established between the communication unit 510 of the mobile terminal device 5 and the image processing device 3.

[0059] 9, the control unit 540 prohibits the start of the second application (display of the execution screen) in a communication state in which a communication connection is established between the communication unit 510 and the image processing device 3. According to such an operation example, even if a person other than the owner of the mobile terminal device 5 uses the mobile terminal device 5 to operate the image processing device 3, the display of the execution screen of the second application unrelated to image processing is restricted, so that information security of the owner can be ensured.

[0060] In step S201, the mobile terminal device 5 determines the communication state with the image processing device 3. If the communication connection with the image processing device 3 is established (step S201; YES), the mobile terminal device 5 permits the display of a notification (banner, pop-up) of the second application or an icon image object corresponding to the second application in step S202, and prohibits the start of the second application (display of the execution screen) in step S203. The process of step S203 corresponds to the process of prohibiting the display of the execution screen of the second application. On the other hand, if the communication connection with the image processing device 3 is not established (step S201; NO), the mobile terminal device 5 permits the display of a notification of the second application or an icon image object corresponding to the second application, and the start of the second application in step S204.

[0061] In this way, the operation of restricting the display of the image corresponding to the second application in Figure 9 is an operation that allows notifications (such as banners and pop-up notifications) of the second application on the mobile terminal device 5, but does not allow the second application to be launched.

[0062] FIG. 10 is a flowchart illustrating a third operation example for restricting the display of an image corresponding to a second application in a communication state in which a communication connection is established between the communication unit 510 of the mobile terminal device 5 and the image processing device 3.

[0063] In the operation example of FIG. 10, when a notification condition for notifying the user is satisfied in the second application in a non-communication state in which a communication connection between the communication unit 510 and the image processing device 3 is not established, the control unit 540 displays a notification image object representing a notification to the user, and does not display the notification image object even if a notification condition for notifying the user is satisfied in the second application in a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established. According to such an operation example, it is possible to prevent the notification image object from being displayed even if the notification condition is satisfied when a person other than the owner of the mobile terminal device 5 operates the mobile terminal device 5. Therefore, it is possible to more reliably ensure the information security of the owner of the mobile terminal device 5 who operates the image processing device 3.

[0064] In step S301, the mobile terminal device 5 determines the communication state with the image processing device 3. If the mobile terminal device 5 has established a communication connection with the image processing device 3 (step S301; YES), in step S302, the mobile terminal device 5 displays a notification in which notifications (banners, pop-ups) of the second application are prohibited or limited. The process of step S302 corresponds to a process of prohibiting the display of a notification object by the second application. On the other hand, if the mobile terminal device 5 has not established a communication connection with the image processing device 3 (step S301; NO), in step S303, the mobile terminal device 5 permits notifications of the second application.

[0065] In this way, the operation of restricting the display of the image corresponding to the second application in Fig. 10 is an operation of not even notifying the second application of the mobile terminal device 5. Note that even if the display is not restricted to this extent, a notification with a reduced amount of information may be provided, as will be described later with reference to Fig. 18.

[0066] FIG. 11 is a flowchart illustrating a fourth operation example for restricting the display of an image corresponding to a second application in a communication state in which a communication connection is established between the communication unit 510 of the mobile terminal device 5 and the image processing device 3.

[0067] In the operation example of FIG. 11, the display unit 521 displays a home screen on which a plurality of icon image objects corresponding to a plurality of applications are arranged so as to be selectable by the user. In a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 may make an icon image object corresponding to a first application selectable on the home screen while making an icon image object corresponding to a second application unselectable on the home screen. According to such an operation example, it is possible to prevent the start of the second application based on a selection operation of an icon image object corresponding to the second application while allowing an operation of the icon image object corresponding to the first application. Therefore, it is possible to more reliably ensure information security of the owner of the portable terminal device 5 who operates the image processing device 3.

[0068] In step S401, the mobile terminal device 5 determines the communication state with the image processing device 3. If the mobile terminal device 5 has established a communication connection with the image processing device 3 (step S401; YES), in step S402, the mobile terminal device 5 restricts the display of an icon image of the second application, thereby making the icon image unselectable on the home screen. On the other hand, if the mobile terminal device 5 has not established a communication connection with the image processing device 3 (step S401; NO), in step S403, the mobile terminal device 5 allows the display of the icon of the second application.

[0069] In addition, as a restriction on the display of the icon of the second application in step S402, the mobile terminal device 5 may, in a communication state, display an icon image object corresponding to the second application on the home screen while making the icon image object corresponding to the second application unselectable (such as the operation example in Figure 13 described below).

[0070] In addition, as a restriction on the display of the icon of the second application in step S402, the mobile terminal device 5 may not display an icon image object corresponding to the second application on the home screen in a communication state (such as an operation example in Figure 14 described later).

[0071] (8) Transition to the printer operation application execution screen FIG. 12 is a diagram showing an example of transition of a display screen of the mobile terminal device 5 according to the embodiment. Here, FIG. 12(A) shows an example of a home screen. As shown in FIG. 12(A), icon image objects of "File", "Mail", "Clock", "Photo", and "Weather" are displayed on the home screen. "File", "Mail", and "Photo" are examples of a first application related to image processing, and in particular, are examples of applications that handle image data to be printed by the image processing device 3. Image processing includes printing. The first application includes an operation application that handles image data to be printed by the image processing device 3.

[0072] FIG. 12(B) shows an example of a notification when a connection with the image processing device 3 is established. When a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 of the mobile terminal device 5 automatically starts an operation application or prompts the user to start the operation application. In the operation example of FIG. 12(B), when a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 of the mobile terminal device 5 prompts the user to start the operation application. According to such an operation example, the mobile terminal device 5 can quickly transition to a mode for operating the image processing device 3, and usability can be improved. In addition, in the operation example of FIG. 12(B), after a communication connection between the communication unit 510 and the image processing device 3 is established, the control unit 540 of the mobile terminal device 5 starts restricting the display of an image corresponding to the second application in response to receiving a predetermined operation from the user.

[0073] For example, when the mobile terminal device 5 establishes a connection with a printer, i.e., the image processing device 3, a notification to that effect (FIG. 12(B)) is displayed on the home screen (FIG. 12(A)). Specifically, together with the information "Connected to the printer. Do you want to launch the dedicated app?", information prompting the user to select either "Yes" or "No" is displayed as a pop-up window. Here, if "Yes" is selected, the mobile terminal device 5 launches an operation application.

[0074] FIG. 12(C) shows an example of an execution screen of an operation application. In the operation example of FIG. 12(C), the communication unit 510 of the mobile terminal device 5 receives an identifier of the image processing device 3 from the image processing device 3. The control unit 540 of the mobile terminal device 5 determines at least one of the operation screen corresponding to the operation application and the first application based on the identifier (printer ID). According to such an operation example, it is possible to display a screen suited to the image processing device 3. For example, in FIG. 12(C), icon image objects of the printer, the scanner, and the copy are included in the operation screen. This is because the printer ID of the image processing device 3 includes information indicating that the image processing device 3 has a printer function, a scanner function, and a copy function. For example, although not shown, if the printer ID of the image processing device 3 includes information indicating that the image processing device 3 has only a printer function, the icon image object clearly displayed on the operation screen may be only the printer icon image object, and the scan and copy icon image objects may not be displayed on the operation screen, or may be displayed semi-transparently.

[0075] Note that the identification information for identifying the printer ID of the image processing device 3 may be stored in advance in, for example, the storage unit 550. Furthermore, the identification information stored in advance in the storage unit 550 may hold a table of various printer IDs and reference information for identifying display screen data corresponding to the printer IDs in the table, and the display screen data may be identified by acquiring the printer ID of the image processing device 3 from the image processing device 3 when connecting to the image processing device 3 and comparing the acquired identifier with the table.

[0076] FIG. 12(D) shows a home screen in a state where an operation application is running. When a transition is made to the home screen in a state where an operation application is running, the home screen displays information saying "Printer operation-only mode" as a notification banner, and notifies the user that the operation application is running as a background job. Also, on the home screen, an icon image object corresponding to at least a part of the second application is grayed out (display is restricted), and the second application is not executed even if the icon image object is selected. According to the operation example of FIG. 12(D), the display of an image corresponding to an application that handles image data to be printed is not restricted, and therefore it is possible to select image data to be printed, and it is possible to prevent a decrease in user convenience.

[0077] 12D shows an example in which the second application not related to image processing is in a hidden state while the operation application is running, but the hidden state may be changed to a visible state by user authentication such as password authentication or biometric authentication, etc. Also, while the operation application is running, the second application not related to image processing may be in an inoperable state.

[0078] 12C shows an example of displaying a dedicated execution screen when an operation application is started, but is not limited to this. For example, if the image processing device 3 has an operation screen, the operation screen of the image processing device 3 may be displayed by mirroring.

[0079] Furthermore, in the operation example of FIG. 12(B), an example is shown in which user authentication such as password authentication or biometric authentication is not performed, but user authentication such as password authentication or biometric authentication may be performed at the same time.

[0080] (9) Display screen of portable terminal device 5 Examples of the display screen of the mobile terminal device 5 will be described with reference to FIGS.

[0081] (9.1) Example of a display screen when the mobile terminal device 5 and the image processing device 3 are connected FIG. 13 is a diagram showing an example of a display screen in a communication state in which a connection between the mobile terminal device 5 and the image processing device 3 according to the embodiment is established. In the operation example of FIG. 13, the control unit 540 of the mobile terminal device 5 displays an icon image object corresponding to the second application on the home screen in a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established, while disabling selection of the icon image object corresponding to the second application. According to such an operation example, the second application is not given substantial execution authority. Therefore, it is possible to more reliably ensure information security of the owner of the mobile terminal device 5 who operates the image processing device 3.

[0082] Specifically, an icon image object corresponding to a clock application is selected, but since the clock application is a second application unrelated to image processing, information stating "Cannot be started while printer is connected" is displayed as a pop-up window. In this way, the mobile terminal device 5 restricts the display of an image corresponding to the second application (execution screen of the second application) in a state of communication with the image processing device 3. In other words, restricting the display of an image corresponding to the second application is not limited to restricting the entire execution screen, but also includes making the icon image object unselectable as shown in FIG. 13.

[0083] (9.2) Other display screen examples when the mobile terminal device 5 and the image processing device 3 are connected FIG. 14 is a diagram showing another example of a display screen in a communication state in which a connection between the mobile terminal device 5 and the image processing device 3 according to the embodiment is established. In the operation example of FIG. 14, the control unit 540 of the mobile terminal device 5 does not display an icon image object corresponding to the second application on the home screen in a communication state in which a communication connection between the communication unit 510 and the image processing device 3 is established. According to such an operation example, the mobile terminal device 5 can deprive the user of an opportunity to operate the icon image objects (icon image objects of a clock and a weather forecast) corresponding to the second application. Therefore, it is possible to more reliably ensure information security of the owner of the mobile terminal device 5 who operates the image processing device 3. For example, the residence area of ​​the owner of the mobile terminal device 5 may be registered in the weather forecast application. Also, for example, the time of a country frequently visited by the owner of the mobile terminal device 5 may be set to be viewable in the clock application. FIG. 14 shows an example in which the icon image object of the second application not related to image processing is hidden (display of the icon image object with a diagonal line) while the mobile terminal device 5 and the image processing device 3 are connected. In this case, the user cannot select the icon image object of the second application to start the second application. Note that, while the mobile terminal device 5 and the image processing device 3 are connected, the icon image object of the second application not related to image processing may be grayed out or completely removed from the execution screen. In this way, the mobile terminal device 5 restricts the display of the image corresponding to the second application (the execution screen of the second application) in the communication state with the image processing device 3. Here, the restriction on the display of the image corresponding to the second application may be, as described above, that the icon image object is not selected to start the second application. Therefore, for example, the icon image object may be displayed semi-transparently, and the manner is not limited to the above example.

[0084] (9.3) When the mobile terminal device 5 and the image processing device 3 are not connected and the notification condition is satisfied FIG. 15 is a diagram showing an example of a display screen when a notification condition is satisfied in a non-communication state in which a connection between the mobile terminal device 5 and the image processing device 3 according to the embodiment is not established. In the operation example of FIG. 15, when a notification condition for notifying the user in the second application is satisfied in a non-communication state in which a communication connection with the image processing device 3 is not established, the control unit 540 of the mobile terminal device 5 displays a notification image object representing a notification to the user. According to such an operation example, a notification is issued under a situation in which operation of the image processing device 3 is not expected, so that the usability of the mobile terminal device 5 can be maintained. In FIG. 15, an example is shown in which information such as "Mr. A, it's sunny for now tomorrow." is displayed as a notification banner. In this way, the notification banner is an image corresponding to the second application unrelated to image processing, specifically, a notification image object. Therefore, for example, when a person other than the owner of the mobile terminal device 5 uses the mobile terminal device 5 for operating the image processing device 3, it may be difficult to ensure the information security of the owner of the mobile terminal device 5 unless some kind of restriction is imposed.

[0085] (9.4) When the mobile terminal device 5 and the image processing device 3 are connected and the notification condition is satisfied FIG. 16 is a diagram showing an example of a display screen when a notification condition is satisfied in a communication state in which a connection between the mobile terminal device 5 and the image processing device 3 according to the embodiment is established. In the operation example of FIG. 16, the control unit 540 of the mobile terminal device 5 does not display a notification image object even if the notification condition is satisfied in the second application. According to such an operation example, it is possible to prevent the notification image object from being displayed even if the notification condition is satisfied when a person other than the owner of the mobile terminal device 5 operates the mobile terminal device 5. Therefore, it is possible to more reliably ensure the information security of the owner of the mobile terminal device 5 who operates the image processing device 3. In FIG. 16, unlike FIG. 15, an example in which a notification banner is not displayed is shown. In this way, even if the notification condition is satisfied in a state in which the mobile terminal device 5 is connected to the image processing device 3, if a process of restricting the display of an image corresponding to the second application such as a notification banner is executed, it is possible to ensure the information security of the owner of the mobile terminal device 5.

[0086] (10) Example of operation FIG. 17 is a flowchart illustrating an example of the operation of the operation support system according to the embodiment.

[0087] In step S11, the mobile terminal device 5 determines whether or not a communication connection with the image processing device 3 has been established. If the mobile terminal device 5 determines that a communication connection with the image processing device 3 has been established, the process of step S11 proceeds to the process of step S12. On the other hand, if the mobile terminal device 5 determines that a communication connection with the image processing device 3 has not been established, the process of step S11 continues. Note that the mobile terminal device 5 may start an operation application at the same time as the communication connection with the image processing device 3 is established. According to such an operation, it becomes possible to operate the image processing device 3 from the mobile terminal device 5.

[0088] In step S12, the mobile terminal device 5 restricts the display of the image corresponding to the second application.

[0089] In step S13, the mobile terminal device 5 determines whether or not the communication connection with the image processing device 3 has been released. If the mobile terminal device 5 determines that the communication connection with the image processing device 3 has been released, the process of step S13 proceeds to the process of step S14. On the other hand, if the mobile terminal device 5 determines that the communication connection with the image processing device 3 has not been released, the process of step S13 continues. Note that the mobile terminal device 5 may execute a process of determining whether or not a selection operation of a release image object has been performed, instead of the process of determining whether or not the communication connection with the image processing device 3 has been released in step S13.

[0090] In step S14, the mobile terminal device 5 removes the restriction on the display of the image corresponding to the second application, and ends the process.

[0091] (11) Example of changes In the above embodiment, an operation example in which the mobile terminal device 5 takes the initiative in restricting the display of an image corresponding to the second application has been described, but the present invention is not limited to this. Here, an operation example in which the image processing device 3 takes the initiative in restricting the display of an image corresponding to the second application will be described.

[0092] In the image processing device 3 according to the embodiment, the communication unit 312 communicates with the portable terminal device 5 capable of executing a plurality of applications including a first application related to image processing and a second application unrelated to image processing. The image processing unit 31 executes image processing based on a user operation on the portable terminal device 5. In a communication state in which a communication connection with the portable terminal device 5 is established by the communication unit 312, the control unit 34 controls the communication unit 312 to transmit to the portable terminal device 5 information for restricting the display of an image corresponding to the second application.

[0093] According to such an operation example, it becomes possible for the image processing device 3 to restrict the display of the image corresponding to the second application to the mobile terminal device 5. Therefore, even if the image processing device 3 takes the lead, it becomes possible to ensure the security of the mobile terminal device 5.

[0094] Here, "restricting the display" may mean transmitting a "restriction command" to the mobile terminal device 5 to execute the display restriction on the terminal side. This makes it possible to ensure security.

[0095] Also, "restricting the display" may mean that the mobile terminal device 5 receives information required by the operation application on the mobile terminal device 5 side (for example, a printer ID) from the image processing device 3, thereby indirectly restricting the display on the terminal side. This makes it possible to ensure security.

[0096] Furthermore, in a case where the image processing device 3 generates display data (remote screen) on the mobile terminal device 5, "restricting display" may mean that the image processing device 3 generates the restricted display data and the mobile terminal device 5 receives it from the image processing device 3. This makes it possible to ensure security.

[0097] For example, assume that the mobile terminal device 5 is implemented with a process for restricting the display of an image corresponding to the second application depending on whether the restriction flag is set to 1, and further assume that the image processing device 3 is also given the authority to change the setting of the restriction flag. In such a case, it is sufficient to transmit flag information for setting the restriction flag to 1, together with the "printer ID", from the image processing device 3 to the mobile terminal device 5 as information for restricting the display of an image corresponding to the second application.

[0098] Also, for example, assume a case where the image processing device 3 is also granted execution authority for the process of restricting the display of the image corresponding to the second application. In such a case, a "control command" for restricting the display of the image corresponding to the second application may be transmitted from the image processing device 3 to the mobile terminal device 5 as information for restricting the display of the image corresponding to the second application.

[0099] FIG. 18 is a flowchart illustrating an example of the operation of the image processing device 3 according to the modified example of the embodiment.

[0100] In step S501, the image processing device 3 determines whether or not a communication connection has been established with the mobile terminal device 5. If the image processing device 3 determines that a communication connection with the mobile terminal device 5 has been established, the process of step S501 proceeds to the process of step S502. If the image processing device 3 determines that a communication connection with the mobile terminal device 5 has not been established, the process of step S501 continues.

[0101] In step S502, the image processing device 3 generates information for causing the mobile terminal device 5 to restrict the display of the image corresponding to the second application.

[0102] In step S503, the image processing device 3 transmits the generated information to the mobile terminal device 5, and the process ends.

[0103] (12) Other changes In the above embodiment, an example in which a notification image object is not displayed has been described as an example of a display screen when the notification condition is satisfied in a state in which the mobile terminal device 5 is connected to the image processing device 3, but the display screen is not particularly limited to this. FIG. 19 is a diagram showing another example of a display screen when the notification condition is satisfied in a state in which the mobile terminal device 5 according to the modified example of the embodiment is connected to the image processing device 3. In the operation example of FIG. 19, the control unit 540 displays a first notification image object representing a notification to the user when a notification condition for notifying the user is satisfied in the second application in a non-communication state in which a communication connection with the image processing device 3 is not established, and displays a second notification image object having a smaller amount of information than the first notification image object when the notification condition is satisfied in a communication state in which a communication connection with the image processing device 3 is established. With such an operation example, even if the notification condition is satisfied when the image processing device 3 is operated from the mobile terminal device 5, a notification with a reduced amount of information is possible, so that it is possible to ensure information security for the owner of the mobile terminal device 5 while improving usability.

[0104] Specifically, only the text information "1 new item" is notified as the notification image object. In this way, in the example of FIG. 19, less information is notified compared to the state in which the mobile terminal device 5 is not connected to the image processing device 3 (the state shown in FIG. 15). Note that the notification does not have to be displayed on the entire screen, but may be displayed on a partial area of ​​the screen. In other words, the amount of information indicated by the notification image object may be reduced.

[0105] (13) Other changes When the communication connection between the mobile terminal device 5 and the image processing device 3 is established, the following operations become possible.

[0106] The communication unit 510 receives the job history linked to the portable terminal device 5 from the image processing device 3, and the control unit 540 uses an operation application to display the job history on the display unit 521. According to this operation example, when operating the image processing device 3 from the portable terminal device 5, it is possible to refer to the job history related to the portable terminal device 5. This makes it possible to further improve usability.

[0107] For example, when the image processing device 3 is operated from the mobile terminal device 5 and a print job is processed by the image processing device 3, the print job is recorded in the job history in the image processing device 3. Therefore, by displaying the job history on the display unit 521 using an operation application, for example, when a medical fee statement (receipt) is printed by operating the image processing device 3 from the mobile terminal device 5 in a hospital, it can be useful for managing the receipt. Furthermore, if such a job history is viewed by a third party unrelated to the user, there is a risk of information leakage of the receipt, but if the display can be restricted as in this embodiment, it is possible to prevent such information leakage.

[0108] FIG. 20 is a flowchart illustrating an example of the operation of the mobile terminal device 5 according to the modified example of the embodiment.

[0109] In step S31, the mobile terminal device 5 determines whether or not a job history linked to the mobile terminal device 5 has been received from the image processing device 3. If it is determined that the mobile terminal device 5 has received a job history linked to the mobile terminal device 5 from the image processing device 3, the process of step S31 proceeds to the process of step S32. On the other hand, if it is determined that the mobile terminal device 5 has not received a job history linked to the mobile terminal device 5 from the image processing device 3, the process of step S31 continues.

[0110] In step S32, the mobile terminal device 5 causes the display unit 521 to display the job history using the operation application, and ends the process.

[0111] (14) Other changes If the communication connection between the mobile terminal device 5 and the image processing device 3 is established, the following operations are also possible.

[0112] The image processing includes scanning, the second application includes an application for managing address information that can be used as a destination of scan data by the image processing device 3, and the communication unit 510 transmits the address information to the image processing device 3. According to such an operation example, the image processing device 3 can transmit scan data to a destination specified by the address information. Therefore, for example, it is possible to send scan data captured by remotely operating the image processing device 3 from the mobile terminal device 5 to a destination registered as address information of the mobile terminal device 5.

[0113] Even in such an operation example, since the display can be restricted, it is possible to prevent leakage of address information including personal information and leakage of scanned data. For example, it is possible to remotely operate the image processing device 3 from the mobile terminal device 5 to scan a sheet of paper on which sales information of a store is written, and send the scanned data to a destination included in the address information registered in the mobile terminal device 5. Since the display can be restricted in this case as well, it is possible to prevent leakage of the sales information of the store to a third party. In addition, since it is only necessary to secure personnel to set the sheet of paper on which sales information of a store is written in the image processing device 3, and it is not necessary to register destination information in advance in the image processing device 3, it is also possible to improve the usability of the image processing device 3.

[0114] FIG. 21 is a flowchart illustrating another operation example of the mobile terminal device 5 according to the modified example of the embodiment.

[0115] In step S41, the mobile terminal device 5 acquires address information that can be used as a destination for the image processing device 3 to transmit scan data.

[0116] In step S42, the mobile terminal device 5 transmits the address information to the image processing device 3, and the process ends.

[0117] In addition, each of the above-mentioned operation flows is not limited to being performed independently, but can be performed by combining two or more operation flows. For example, some steps of one operation flow may be added to another operation flow, or some steps of one operation flow may be replaced with some steps of another operation flow. In each flow, it is not necessary to perform all steps, and only some steps may be performed.

[0118] In addition, the above-described embodiments are not limited to being implemented only as an operation assistance system. For example, the above-described embodiments may be implemented as a control method for a system such as an operation assistance system. Furthermore, for example, the above-described embodiments may be implemented as a program executed by a system such as an operation assistance system.

[0119] A program for causing a computer to execute the operations according to the above-described embodiments may be provided. The program may be recorded in a computer-readable medium. The computer-readable medium can be used to install the program in a computer. Here, the computer-readable medium on which the program is recorded may be a non-transient recording medium. The non-transient recording medium is not particularly limited, and may be, for example, a recording medium such as a CD-ROM or a DVD-ROM. In addition, circuits for executing the processes performed by each device according to the above-described embodiments may be integrated, and at least a part of the device may be configured as a semiconductor integrated circuit (chip set, SoC).

[0120] The terms "based on" and "depending on / in response to" used in this disclosure do not mean "based only on" or "depending only on", unless otherwise specified. The term "based on" means both "based only on" and "based at least in part on". Similarly, the term "depending on" means both "based only on" and "depending at least in part on". The terms "include", "comprise", and variations thereof do not mean including only the recited items, but may include only the recited items or may include additional items in addition to the recited items. Additionally, the term "or" used in this disclosure is not intended to be an exclusive or. Additionally, any reference to elements using designations such as "first", "second", etc., used in this disclosure is not intended to generally limit the quantity or order of those elements. These designations may be used herein as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed therein or that the first element must precede the second element in some manner. In this disclosure, where articles are added by translation, such as, for example, a, an, and the in English, these articles are intended to include the plural unless the context clearly indicates otherwise.

[0121] The above describes the embodiments in detail with reference to the drawings, but the specific configuration is not limited to that described above, and various design changes, etc. are possible without departing from the spirit of the invention.

[0122] (15) Additional Notes The following additional features relate to the above-described embodiment.

[0123] (Appendix 1) A communication unit that communicates with an image processing device that performs image processing; a control unit capable of executing a plurality of applications including a first application related to the image processing and a second application not related to the image processing; a display unit that displays an image corresponding to an application currently being executed among the plurality of applications, the first application includes an operation application used for operating the image processing, The control unit restricts display of an image corresponding to the second application in a communication state in which a communication connection between the communication unit and the image processing device is established. Mobile terminal device.

[0124] (Appendix 2) The image processing includes printing. the first application further includes an application that handles image data to be printed by the image processing device; The control unit, in the communication state, does not limit display of an image corresponding to the first application, and limits display of an image corresponding to the second application. 2. A mobile terminal device as described in claim 1.

[0125] (Appendix 3) the display unit is capable of displaying a home screen on which a plurality of icon image objects corresponding to the plurality of applications are arranged in a manner selectable by a user; The control unit, in the communication state, causes the display unit to display an operation screen corresponding to the operation application, and restricts transition from the operation screen to the home screen. 2. A mobile terminal device as described in claim 1.

[0126] (Appendix 4) the display unit displays a home screen on which a plurality of icon image objects corresponding to the plurality of applications are arranged in a manner selectable by a user; The control unit, in the communication state, makes an icon image object corresponding to the first application selectable on the home screen, while making an icon image object corresponding to the second application unselectable on the home screen. 2. A mobile terminal device as described in claim 1.

[0127] (Appendix 5) The control unit, in the communication state, causes an icon image object corresponding to the second application to be displayed on the home screen while making the icon image object corresponding to the second application unselectable. 5. A mobile terminal device as described in appendix 4.

[0128] (Appendix 6) The control unit, in a state in which the communication connection is established, does not display an icon image object corresponding to the second application on the home screen. 5. A mobile terminal device as described in appendix 4.

[0129] (Appendix 7) The control unit is When a notification condition for notifying a user is satisfied in the second application in a non-communication state in which the communication connection has not been established, a notification image object representing a notification to the user is displayed; In the communication state, even if the notification condition is satisfied in the second application, the notification image object is not displayed. 2. A mobile terminal device as described in claim 1.

[0130] (Appendix 8) The control unit is When a notification condition for notifying a user is satisfied in the second application in a non-communication state in which the communication connection has not been established, a first notification image object representing a notification to the user is displayed; When the notification condition is satisfied in the communication state, a second notification object notification image object having an amount of information smaller than that of the first notification object notification image object is displayed. 2. A mobile terminal device as described in claim 1.

[0131] (Appendix 9) The control unit automatically starts the operation application or prompts a user to start the operation application when the communication connection is established. 2. A mobile terminal device as described in claim 1.

[0132] (Appendix 10) The control unit releases the restriction when the communication connection is disconnected. 2. A mobile terminal device as described in claim 1.

[0133] (Appendix 11) the control unit starts the restriction in response to receiving a predetermined operation from a user after the communication connection is established. 2. A mobile terminal device as described in claim 1.

[0134] (Appendix 12) The communication unit receives an identifier of the image processing device from the image processing device, The control unit determines at least one of an operation screen corresponding to the operation application and the first application based on the identifier. 9. A mobile terminal device as described in claim 8.

[0135] (Appendix 13) the control unit causes the display unit to display a release image object for accepting a user operation for releasing the restriction through user authentication. 2. A mobile terminal device as described in claim 1.

[0136] (Appendix 14) the communication unit receives a job history associated with the portable terminal device from the image processing device; the control unit causes the display unit to display the job history using the operation application. 2. A mobile terminal device as described in claim 1.

[0137] (Appendix 15) The image processing includes scanning, the second application includes an application for managing address information available as a destination of scan data sent by the image processing device; The communication unit transmits the address information to the image processing device. 2. A mobile terminal device as described in claim 1.

[0138] (Appendix 16) Further comprising an operation unit for receiving an operation from a user, the control unit causes the display unit to display a setting screen for receiving a user's operation to select the first application. 2. A mobile terminal device as described in claim 1.

[0139] (Appendix 17) a communication unit that communicates with a mobile terminal device capable of executing a plurality of applications including a first application related to image processing and a second application not related to the image processing; an image processing unit that executes the image processing based on a user operation on the mobile terminal device; a control unit that controls the communication unit to transmit, to the portable terminal device, information for restricting display of an image corresponding to the second application when a communication connection with the portable terminal device is established by the communication unit and communication is detected; Image processing device.

[0140] (Appendix 18) A portable terminal device includes: communicating with an image processing device that performs image processing; Executing any one of a plurality of applications including a first application including an operation application used for operating the image processing, the first application being related to the image processing, and a second application not related to the image processing; displaying an image corresponding to a running application among the plurality of applications; and restricting display of an image corresponding to the second application in a communication state in which a communication connection between the communication unit and the image processing device is established. program. [Explanation of symbols]

[0141] 3 image processing device, 5 portable terminal device, 31 image processing unit, 31a printing unit, 31b scanner unit, 32 operation panel, 32a display unit, 32a1-32a4 lamps, 32b operation unit, 32b1-32b5 buttons, 33 bus, 34 control unit, 35 memory unit, 36 paper feed tray, 37 paper output tray, 38 manuscript stand cover, 39 manuscript stand, 312 communication unit, 312a wireless LAN communication unit, 312b NFC communication unit, 312c USB communication unit, 321 notch unit, 321a NFC, 321b, 321c, 321e, 321f hold unit, 321d connection terminal, 510 communication unit, 510a wireless LAN communication unit, 510b NFC communication unit, 510c USB communication unit, 520 touch panel display unit, 521 Display unit, 522 operation unit, 530 imaging unit, 540 control unit, 550 storage unit, 560 bus

Claims

1. A communication unit that communicates with an image processing device that performs image processing, A control unit capable of executing a plurality of applications, including a first application related to the image processing and a second application not related to the image processing, The system includes a display unit that displays an image corresponding to the application currently running among the aforementioned plurality of applications, The first application includes an operation application used for the image processing operation, The control unit, When a communication connection is established between the communication unit and the image processing device, the operation application is automatically launched, or a message prompting the user to launch the operation application is displayed, and When the aforementioned operation application is running, control is performed to restrict notifications from the second application. Terminal device.

2. The control unit automatically starts the operation application or displays a prompt to the user to start the operation application when the communication connection is established by short-range wireless communication. The terminal device according to claim 1.

3. The communication unit receives connection information used for wireless LAN communication connection with the image processing device from the image processing device via short-range wireless communication, The control unit, upon confirmation that the wireless LAN communication connection based on the connection information has been established, automatically launches the operation application or displays a prompt to the user to launch the operation application. The terminal device according to claim 1.

4. The aforementioned image processing includes printing, The first application further includes an application for handling image data to be printed by the image processing device, The control unit, in the communication state, restricts the display of images corresponding to notifications from the second application without restricting the display of images corresponding to the first application. The terminal device according to claim 1.

5. The display unit is capable of displaying a home screen in which multiple icon image objects corresponding to the multiple applications are arranged in a way that can be selected by the user. The control unit, in the communication state, causes the display unit to display an operation screen corresponding to the operation application and restricts the transition from the operation screen to the home screen. The terminal device according to claim 1.

6. The display unit displays a home screen in which multiple icon image objects corresponding to the multiple applications are arranged in a way that can be selected by the user. The control unit, in the communication state, makes the icon image object corresponding to the first application selectable on the home screen, while making the icon image object corresponding to the second application unselectable on the home screen. The terminal device according to claim 1.

7. The control unit, In a non-communication state where the aforementioned communication connection is not established, if the notification conditions for notifying the user are met in the second application, a notification image object representing the notification to the user is displayed. In the aforementioned communication state, even if the notification conditions are met in the second application, the notification image object will not be displayed. The terminal device according to claim 1.

8. The control unit, In a non-communication state where the aforementioned communication connection is not established, if the notification conditions for notifying the user are met in the second application, a first notification image object representing the notification to the user is displayed. In the aforementioned communication state, if the notification condition is met, a second notification image object having less information than the first notification image object is displayed. The terminal device according to claim 1.

9. When the communication connection is disconnected, the control unit releases the restriction on displaying the image corresponding to the notification from the second application. The terminal device according to claim 1.

10. After the communication connection is established, the control unit, upon receiving a predetermined operation from the user, starts restricting the display of the image corresponding to the notification from the second application. The terminal device according to claim 1.

11. The communication unit receives the identifier of the image processing device from the image processing device, The control unit determines, based on the identifier, at least one of the operation screen corresponding to the operation application and the first application. The terminal device according to claim 1.

12. The control unit causes the display unit to display an image object for releasing the restriction on the display of an image corresponding to a notification from the second application, in order to accept a user operation via user authentication to release the restriction on the display of the image corresponding to the notification from the second application. The terminal device according to claim 1.

13. The communication unit receives the job history associated with the terminal device from the image processing device, The control unit causes the job history to be displayed on the display unit using the operation application. The terminal device according to claim 1.

14. The aforementioned image processing includes scanning, The second application includes an application that manages address information that can be used as a destination for the scan data transmitted by the image processing device, The communication unit transmits the address information to the image processing device. The terminal device according to claim 1.

15. It further includes an operating section that accepts user input, The control unit causes the display unit to display a settings screen for accepting user input to select the first application. The terminal device according to claim 1.

16. A communication unit that communicates with a terminal device capable of executing multiple applications, including a first application related to image processing and a second application not related to image processing, An image processing unit that performs the image processing based on user operations on the terminal device, It comprises a control unit and, The control unit, When the communication unit establishes a communication connection with the terminal device and enters a communication state, the unit will automatically launch the operation application used for operating the image processing included in the first application on the terminal device, or display a prompt to the user to launch the operation application, and When the operation application is running on the terminal device, the communication unit controls the terminal device to send information to restrict notifications from the second application. Image processing device.

17. A terminal device, The steps include communicating with an image processing device that performs image processing, The steps include executing one of a plurality of applications, which include a first application that is an application related to the image processing and includes an operation application used for the image processing operation, and a second application that is not related to the image processing; The steps include: displaying an image corresponding to the application currently running among the aforementioned multiple applications; When a communication connection is established with the image processing device, the user automatically starts the operation application, or displays a message prompting the user to start the operation application. When the aforementioned operation application is running, the following steps are performed: restricting notifications from the second application. program.

Images