Display apparatus, image processing apparatus, and display control method of additional display

Abstract

The present invention provides a display device and the like capable of maintaining visibility of a target by appropriately controlling a display form of an additional display. A display device includes: a display unit that displays an operation screen including a target; and a control unit that controls the display of an additional display corresponding to the target on the basis of an operation by a user with respect to the target, the control unit changing the display form of the additional display when the display of the additional display overlaps a restricted area in which the display of the additional display is restricted.

Description

Technical Field

[0001] The present disclosure relates to a display device. Background Art

[0002] There is known a technique of displaying information (supplementary information) about an object such as a button or an icon on a screen of a display device by an operation such as mouse hovering or long pressing on the object. In addition, in the present disclosure, the display related to the information is referred to as additional display.

[0003] For example, Patent Document 1 discloses the following technique: when displaying a tooltip, in the case where the display of the tooltip overlaps an object item to be covered by the display of the tooltip, the display position of the object item is adjusted so that the display of the tooltip does not overlap the object item, and the tooltip represents information related to an object item (target) selected by a user. Prior Art Documents Patent Documents

[0004] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2014 - 123364 Summary of the Invention Technical Problem to be Solved by the Invention

[0005] An object of the present disclosure is to provide a display device or the like that can maintain the visual recognition of an object by appropriately controlling the display form of additional display. Solution to the Problem

[0006] In order to solve the above problems, a display device according to the present disclosure is characterized by including: a display unit that displays an operation screen including a target; and a control unit that controls the display of additional display corresponding to the target based on a user operation on the target, wherein the control unit changes the display form of the additional display when the display of the additional display overlaps a restricted area that restricts the display of the additional display.

[0007] In addition, an image processing device according to the present disclosure is characterized by including: a display unit that displays an operation screen including a target; a control unit that controls the display of additional display corresponding to the target based on a user operation on the target; and an image processing unit, wherein the control unit changes the display form of the additional display when the display of the additional display overlaps a restricted area that restricts the display of the additional display.

[0008] In addition, the display control method for additional display according to the present disclosure is characterized in that, based on an operation by a user on a target displayed on an operation screen, the display of the additional display corresponding to the target is controlled, and when the display of the additional display overlaps a restricted area that restricts the display of the additional display, the display form of the additional display is changed. Advantages of the Invention

[0009] According to the present disclosure, it is possible to provide a display device or the like that can maintain the visual recognition of a target by appropriately controlling the display form of an additional display. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a front view showing the overall configuration of the image processing apparatus according to the first embodiment. Figure 2 It is a functional block diagram of the image processing apparatus equipped with the display device according to the first embodiment. Figure 3 It is a flowchart showing the processing flow according to the first embodiment. Figure 4 It is a diagram showing an operation example according to the first embodiment. Figure 5 It is a diagram showing an operation example according to the first embodiment. Figure 6 It is a diagram showing an operation example according to the first embodiment. Figure 7 It is a diagram showing an operation example according to the first embodiment. Figure 8 It is a diagram showing an operation example according to the first embodiment. Figure 9 It is a diagram showing an operation example according to the first embodiment. Figure 10 It is a diagram showing an operation example according to the first embodiment. Figure 11 It is a diagram showing an operation example according to the first embodiment. Figure 12 It is a diagram showing an operation example according to the first embodiment. Figure 13 It is a diagram showing an operation example according to the first embodiment. Figure 14 It is a diagram showing an operation example according to the first embodiment. Figure 15 It is a flowchart showing the processing flow according to the second embodiment. Figure 16 It is a diagram showing an operation example according to the second embodiment. Figure 17This is a flowchart showing the process of the processing related to the third embodiment. Detailed implementation

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In addition, the following embodiments are examples for explaining the present disclosure, and the technical content described in the claims is not limited to the following description.

[0012] There is a known technique in which information (supplementary information) about a target is displayed as an additional display by an operation performed by a user or an operation such as mouse hovering or long pressing on an input field or a display field that is a display object.

[0013] For example, consider the following situation: in a button displayed on the screen of a display device such as a touch panel, due to the limitation of the number of characters in the display box, it is impossible to display all the strings of the caption, and an ellipsis "…" indicating that a part of the string is omitted is displayed.

[0014] In this case, when the button is selected by the user (for example, when the user long presses the button), the display device displays a tool tip as a form of additional display, and displays all the strings related to the caption. By confirming the displayed all strings, the user can correctly grasp the information and function of the button.

[0015] However, the targets constituting the screen include not only the targets that accept the selection made by the user and display additional displays, but also targets related to the display of important information such as the "title" of the screen, and targets that accept the input of important set values by the user.

[0016] If the additional display is displayed covering these important targets, there is a problem that the user cannot correctly grasp the information and function related to these important targets.

[0017] In the present disclosure, by appropriately controlling the display form of the additional display, a display device or the like capable of maintaining the visual recognition of the target is realized in the following embodiments.

[0018] [1. First Embodiment] [1.1 Functional Configuration] Figure 1 This is a diagram showing the overall configuration of the multifunction machine 100 which is an image processing apparatus related to the first embodiment. Figure 2 This is a functional configuration diagram of the multifunction machine 100 equipped with the display device 10 related to the first embodiment. The multifunction machine 100 Figure 2 On the basis of the configuration of the display device 10 shown by the dotted line box, further includes an image processing unit 21, and stores the job control program 195 in the storage unit 19.

[0019] The multifunction machine 100 is a form of an image processing apparatus that can perform various operations such as printing, copying, faxing, and image transmission in one housing. In addition, in the first embodiment, the form of the multifunction machine 100 is described as an example of an image processing apparatus. However, the image processing apparatus is not particularly limited as long as it is configured with the display device 10 according to the first embodiment. For example, it may also be a printer, a copier, a FAX (facsimile) device, etc. that limit various operation functions.

[0020] The multifunction machine 100 includes a control unit 11, a display unit 13, an operation input unit 15, a communication unit 17, a storage unit 19, and an image processing unit 21.

[0021] The control unit 11 comprehensively controls the entire display device 10 and the multifunction machine 100. The control unit 11 may be constituted by one or more processing devices (e.g., a CPU (Central Processing Unit), a SoC (System on Chip), etc.). The control unit 11 realizes its functions by reading and executing various programs stored in the storage unit 19.

[0022] The display unit 13 is a display component that displays various information to users, etc. The display unit 13 is constituted by, for example, an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, etc. The display unit 13 displays an operation screen corresponding to the state of the multifunction machine 100 (e.g., a home screen, a setting screen related to the execution of each operation, a history information screen, etc., which will be described later).

[0023] The operation input unit 15 is an input device that accepts the input of information by users, etc. The operation input unit 15 may be constituted by various input devices such as operation keys and buttons like hard keys and software keys. In addition, the operation input unit 15 may also be configured as a touch panel capable of input via the display unit 13. When the operation input unit 15 is configured as a touch panel, it can detect the touch operation of the user on the target displayed via the display unit 13 and acquire coordinate information, pressure-sensitive information, etc. on the touch panel. In this case, as the input method of the touch panel, common methods such as a resistive film method, an infrared method, an electromagnetic induction method, and a capacitive method can be adopted, for example.

[0024] The communication unit 17 includes an interface for wired / wireless communication, either one or both, for communicating with other external terminal devices (not shown) via a network NW such as a LAN (Local Area Network), WAN (Wide Area Network), the Internet, a telephone line, a facsimile line, etc. Additionally, for example, the communication unit 17 may also include interfaces related to (short-range) wireless communication technologies such as Bluetooth (registered trademark), NFC (Near Field Communication), Wi-Fi (registered trademark), ZigBee (registered trademark), Irda (Infrared Data Association), Wireless USB (Universal Serial Bus), etc.

[0025] The storage unit 19 is one or more storage devices that store various programs and various data required for the operation of the display device 10 and the multifunction machine 100. The storage unit 19 can be constituted by storage devices such as a RAM (Random Access Memory), SSD (Solid State Drive), HDD (Hard Disk Drive), ROM (Read Only Memory), etc.

[0026] In the first embodiment, the storage unit 19 stores a control program 191, a display control program 192, a display form determination program 193, a job control program 195, and secures a target storage area 194.

[0027] The control program 191 is a program read by the control unit 11 when comprehensively controlling the display device 10 and the multifunction machine 100. The control unit 11 that has read the control program 191 controls the driving of hardware such as the display unit 13, the operation input unit 15, the communication unit 17, and the image processing unit 21.

[0028] The display control program 192 is a program read by the control unit 11 when performing output control of the operation screen displayed by the display unit 13 and the operation input unit 15 configured as a touch panel. The control unit 11 that has read the display control program 192 controls the display of operation screens such as the home screen, the setting screen related to the execution of each job, and the history information screen. Additionally, the control unit 11 that has read the display control program 192 performs display control of additional displays according to the display form determined by the display form determination program 193.

[0029] The display form determination program 193 is a program read by the control unit 11 when determining the display form of additional display. The control unit 11 that has read the display form determination program 193 controls the display position of the additional display and the number of lines of the displayed string when the display coverage of the additional display restricts the restricted area of the display of the additional display. In addition, the restricted area related to the present disclosure refers to: (i) a target related to the display of important information, a target for receiving input of important setting values by the user, etc., and an area ensured on the operation screen for displaying a protected target (hereinafter, in the present disclosure, this target is referred to as a protected target) for the display on the operation screen, (ii) an area that restricts the display of the additional display itself (a specified area described later), or (iii) an area outside the displayable area including the touch panel (screen), and is an area where the control unit 11 restricts the display of the additional display.

[0030] For example, in the present disclosure, the title string in each operation screen is set as a protected target and the display is protected. In addition, for example, the number of copies in the "Copy" screen as an operation screen, the input completed fax number in the "Fax" screen, the input completed destination address in the "Scan" screen, the send history in the "Send History" screen, etc. can also be used as protected targets for receiving the display of important information, input of important setting values, etc.

[0031] The target storage area 194 is a recording area that stores the image information of the targets displayed on the operation screen. The control unit 11 that has read the display control program 192 performs display control of the targets constituting the operation screen based on the image information of the targets stored in the target storage area 194.

[0032] The job control program 195 is a program read by the control unit 11 when executing printing jobs related to printing and copying, and jobs related to fax and image transmission. The control unit 11 that has read the job control program 195 transfers to a job mode (print mode, copy mode, fax mode, image transmission mode) for executing each job and executes the job. In addition, when executing a job, the control unit 11 displays a job setting screen as an operation screen on the touch panel as needed, and the job setting screen receives setting values and function selections required for the execution of the job from the user. The control unit 11 executes each job based on the setting values and functions received via the job setting screen.

[0033] The image processing unit 21 includes an image forming unit 211 and an image input unit 213. The image forming unit 211 supplies paper from the paper supply unit 25, forms an image based on image data on the paper, and then discharges it to the paper discharge unit 27. The image forming unit 211 can be constituted by, for example, a laser printer adopting an electrophotographic method. In this case, the image forming unit 211 forms an image using toner supplied from an unillustrated toner cartridge corresponding to the toner color (for example, cyan, magenta, yellow, black).

[0034] The image input unit 213 generates image data by scanning an original document. The image input unit 213 can be constituted, for example, by a scanning device having an automatic document feeder (ADF), a platen for placing and reading an original document, etc. on the basis of an image sensor such as a CCD (Charge Coupled Device) or a CIS (Contact Image Sensor). The configuration of the image input unit 213 is not particularly limited as long as it can generate image data by reading a reflected light image from the original document image through an image sensor. In addition, the image input unit 213 can also be constituted, for example, by an interface that can acquire image data stored in a storage medium such as a USB memory or image data transmitted from an unillustrated external device. In addition, the image processing unit 21 can also include a method of performing, for example, shadow correction and density correction on the image data input from the image input unit 213 and generating image data for image transmission.

[0035] [1.2 Process flow] Next, the process flow of the first embodiment will be described. Figure 3 It is a flowchart for explaining the process related to the detection of an operation on a target or additional display to the determination of the display position and display string of the display form as the additional display. In addition, the process described in Figure 3 is the process executed by the control unit 11 by reading out a display control program 192, a display form determination program 193, etc.

[0036] The additional display according to the first embodiment is a display form for supplementarily displaying information related to a protection target such as a display of specified information and an input field. The additional display is known, for example, in display forms such as tooltips and balloons. The additional display can be a rectangular display or a dialog box display. In addition, the additional display can also be displayed in a pop-up window. Hereinafter, a rectangular tooltip will be described as one form of the additional display.

[0037] The control unit 11 determines whether an operation on a target or a tool tip is detected via an operation screen displayed on the operation input unit 15 configured as a touch panel (step S100).

[0038] When the control unit 11 determines that an operation on a target or a tool tip is detected, based on the acquired coordinate information of the touch panel, it sets a reference point of the tool tip and a restricted area including a specified area centered on the reference point (step S100: Yes → step S110). In addition, when it determines that an operation on a target or a tool tip is not detected, the control unit 11 stands by until an operation on a target or a tool tip is detected (step S100: No).

[0039] The control unit 11 temporarily sets an initial position related to the display position of the tool tip (step S120). Then, the control unit 11 temporarily sets the number of lines of the display string of the tool tip (step S130).

[0040] Then, the control unit 11 determines whether the display of the tool tip covers the restricted area (step S140). Here, the "display of the tool tip covering the restricted area" involved in the present disclosure means a phenomenon in which the display area (coordinate position) secured for displaying the tool tip and the display area (coordinate position) secured as the display area of the protection target and the tool tip itself partially or completely overlap, so that the complete display of the protection target, etc. is not maintained (protected).

[0041] When it determines that the display of the tool tip does not cover the restricted area, the control unit 11 determines the display position of the tool tip and the number of lines of the display string, and ends the process (step S140: No → step S150).

[0042] On the other hand, when it determines that the display of the tool tip covers the restricted area, the control unit 11 determines whether the number of lines of the display string of the tool tip is one line (step S140: Yes → step S160). When it determines that the number of lines of the display string of the tool tip is one line, the control unit 11 changes the number of lines of the display string to two lines (step S160: Yes → step S170).

[0043] Then, the control unit 11 determines whether the display of the tool tip covers the restricted area (step S180). When it determines that the display of the tool tip does not cover the restricted area, the control unit 11 determines the display position of the tool tip and the number of lines of the display string, and ends the process (step S180: No → step S150). On the other hand, when it determines that the display of the tool tip covers the restricted area, the control unit 11 transfers the process to step S200 (step S180: Yes → step S200).

[0044] In addition, in step S160, when it is determined that the number of lines of the display string of the tool tip is not 1 line, the control unit 11 determines whether the number of lines of the display string is 2 lines (step S160; No → step S190). When it is determined that the number of lines of the display string of the tool tip is 2 lines, the control unit 11 changes the number of lines of the display string to 3 lines (step S190: Yes → step S200).

[0045] Then, the control unit 11 determines whether the display of the tool tip covers the restricted area (step S210). When it is determined that the display of the tool tip does not cover the restricted area, the control unit 11 determines the display position of the tool tip and the number of lines of the display string, and ends the process (step S210: No → step S150). On the other hand, when it is determined that the display of the tool tip covers the restricted area, the control unit 11 transfers the process to step S220 (step S210: Yes → step S220).

[0046] The control unit 11 performs processing related to the movement of the tool tip (step S220). Then, the control unit 11 determines whether the tool tip has returned to the initial position (step S230). When it is determined that the tool tip has returned to the initial position, the control unit 11 determines the display position of the tool tip and the number of lines of the display string, and ends the process (step S230: No → step S150). On the other hand, when it is determined that the tool tip has not returned to the initial position, the control unit 11 transfers the process to step S120 (step S230: No → step S120).

[0047] [1.3 Operation Example] Next, the operation example according to the first embodiment will be described. Figure 4 FIG. is a diagram for explaining the display size of the tool tip 20 that can be displayed in the multifunction machine 100 (display device 10) according to the first embodiment and the number of lines of the display string.

[0048] Figure 4 (a) of FIG. is a diagram for explaining the tool tip 20a having a display size of a horizontal width of 600 px and a vertical width of 70 px. The tool tip 20a is an example of a tool tip that can display a string with a number of lines of "1 line" of 17 characters in full-width.

[0049] Figure 4 (b) of FIG. is a diagram for explaining the tool tip 20b having a display size of a horizontal width of 600 px and a vertical width of 110 px (70 px + 40 px). The tool tip 20b is an example of a tool tip that can display a string with a number of lines of "2 lines" of 17 characters in full-width.

[0050] Figure 4(c) is a diagram illustrating a tooltip 20c with a display size of horizontal width 600px × vertical width 150px (110px + 40px). The tooltip 20c is an example of a tooltip that can display a string with 17 full-width characters in "3 lines".

[0051] Figure 4 (d) is a diagram illustrating a tooltip 20d with a display size of horizontal width 300px × vertical width 70px. The tooltip 20d is an example of a tooltip that can display a string with 7 full-width characters in "1 line".

[0052] Figure 4 (e) is a diagram illustrating a tooltip 20e with a display size of horizontal width 300px × vertical width 110px (70px + 40px). The tooltip 20e is an example of a tooltip that can display a string with 7 full-width characters in "2 lines".

[0053] Figure 4 (f) is a diagram illustrating a tooltip 20f with a display size of horizontal width 300px × vertical width 150px (110px + 40px). The tooltip 20f is an example of a tooltip that can display a string with 7 full-width characters in "3 lines".

[0054] In addition, for example, in Figure 3 step S170 etc. of the flowchart, "changing the number of lines to 2 lines" means changing the display of the tooltip 20 from Figure 4 the tooltip 20a (1-line display) exemplified in to the tooltip 20b (2-line display). The control unit 11 performs control to switch the displayed tooltip 20 (20a to 20f) based on the determined display size and the number of lines of the display string in the Figure 3 processing related to the flowchart.

[0055] Next, Figure 5 (a) is a diagram illustrating a specified area R10 (hereinafter referred to as the specified area) centered on a reference point. The specified area R10 is an area that sets an area with a specified area (for example, horizontal width 280px × vertical width 140px) centered on the reference point (x, y) which is the operation position of the user's finger F10 as a specified area (reference area) that restricts the display of the tooltip. If the tooltip is displayed in the surrounding area centered on the user's operation position, the tooltip will be covered by the user's finger F10, making it difficult to see the tooltip. Therefore, by setting the surrounding area of the reference point as a specified area that restricts the display of the tooltip, the visual recognition of the tooltip can be maintained. In addition, in Figure 5In (a), the display area of the specified area R10 is set to a rectangle with a horizontal width of 280 px and a vertical width of 140 px. However, the display area and its shape of the specified area R10 can be appropriately set and changed in consideration of the displayable area of the touch panel, etc.

[0056] Figure 5 (b) is a diagram for explaining the display position (initial position) of the tooltip displayed by the control unit 11 when the user's finger F10 performs a target operation. In Figure 5 (b), as an example of the tooltip, the tooltip 20a illustrated in Figure 4 (a) is used for explanation.

[0057] The display position of the tooltip 20a uses the position where it touches the upper side (outer periphery) of the specified area R10 with the operation position of the user's finger F10 as the reference point as the initial position. This is because if the display position of the tooltip 20a is set below the specified area R10, the tooltip 20a will be covered by the user's finger F10 and it will be difficult to see the tooltip 20a.

[0058] The tooltip 20a is configured such that the center point 201a of the rectangle is located on the extension line R101 of the reference point (x, y). And, when there is a restricted area that limits the display of the tooltip 20a at this display position (configured position), the control unit 11 changes the display form of the tooltip 20a.

[0059] Next, an example of the change in the display form of the tooltip is explained. Figure 6 (a) and (b) are diagrams for explaining the control related to the movement of the tooltip as an example of the change in the display form of the tooltip. In addition, Figure 6 (c) and (d) are diagrams for explaining the change in the number of lines of the display string of the tooltip. In addition, in Figure 6 , as an example of the tooltip, the tooltip 20e explained in Figure 4 (e) is used for explanation.

[0060] For example, when there is a restricted area that limits the display of the tooltip 20e, the control unit 11 performs control to move the tooltip 20e along the outside of the specified area R10 in the counterclockwise direction (negative x-axis direction) shown by the arrow in the figure ( Figure 6 (a)). Figure 6 (a) shows the state (tooltip 20e2) after the x coordinate of the tooltip 20e1 has moved 5 px in the direction of the arrow in the figure.

[0061] Figure 6 (b) shows as Figure 6The movement of the tool tip 20e1 illustrated in (a) thereof, the state where the right side of the tool tip 20e1 reaches a position on the extension line to the left of the specified area R10 (tool tip 20e2). That is, when the display position of the upper left corner of the specified area R10 coincides with the display position of the lower right corner of the tool tip 20e1, the control unit 11 restricts the movement of the tool tip 20e1 in the negative x-axis direction (the left side direction in the figure). In addition, in the case where the tool tip 20e1 is configured to leave the specified area R10, the control unit 11 controls the movement of the x coordinate of the tool tip 20e1 to be within 5 px.

[0062] When the right side of the tool tip 20e1 reaches Figure 6 the display position shown in (b) thereof, the control unit 11 continues to move the tool tip 20e1 in the positive y-axis direction (the downward direction in the figure) by 5 px units. The control unit 11 continues to perform the control related to the movement of the tool tip 20e1 until the display of the tool tip 20e1 is in a position that does not cover the restricted area. In addition, in Figure 6 (a) and (b) thereof, considering users with a right dominant hand, the movement direction of the tool tip 20e is set to the counterclockwise direction. On the other hand, in the case of users with a left dominant hand, the movement direction of the tool tip 20e is preferably set to the clockwise direction. By changing the movement direction of the tool tip 20e according to the user's dominant hand, it is possible to prevent the tool tip from being covered by the user's finger as the user's finger moves.

[0063] Figure 6 (c) thereof is a diagram for explaining the case where the tool tip 20a is in contact with the upper side of the specified area R10 along the x-axis and the number of lines of the display string of the tool tip 20a is changed from "1 line" to "2 lines" (tool tip 20e). In addition, when the control unit 11 changes the number of lines of the display string from "1 line" to "2 lines", the control unit 11 maintains the position of the central axis (dashed line in the figure) of the corresponding tool tip 20a and tool tip 20e.

[0064] Figure 6 (d) thereof is a diagram for explaining the control of changing the number of lines of the display string of the tool tip 20a from "1 line" to "2 lines" (tool tip 20e) when the tool tip 20a is in contact with the right side of the specified area R10 along the y-axis. In addition, when the control unit 11 changes the number of lines of the display string from "1 line" to "2 lines", Figure 6 similar to (c) thereof, the control unit 11 maintains the position of the central axis (dashed line in the figure) of the corresponding tool tip 20a and tool tip 20e.

[0065] Next, a configuration example of the operation screen according to the first embodiment will be described. Figure 7Fig. (a) is a diagram illustrating an example of the display configuration of the home screen W10 as an operation screen. Figure 7 The home screen W10 illustrated in Fig. (a) can be configured as an operation screen that is displayed on the operation panel (operation input unit 15) and accepts operation inputs from the user, for example, when the power is turned on, during standby, when resuming from the sleep state, etc. Such a home screen W10 includes selection buttons B10 for modes, etc., a switching button B12, a setting button B14, and a title object O10. In addition to these components, the home screen W10 can also, as Figure 7 illustrated in Fig. (a), have a display area for displaying device (consumable) information such as toner remaining amount.

[0066] The selection buttons B10 for modes, etc. are selection buttons that accept the selection of action modes related to the execution of operations. For example, they manage an address book for destination information related to image sending operations, etc., and are buttons that accept the display instruction of setting history related to the execution of operations. Figure 7 Fig. (a) is an example of selectively displaying a "Copy" button, a "Fax" button, and a "Scan" button as the selection buttons B10 for modes, etc. When the control unit 11 accepts the user's selection of the "Copy" button, for example, it switches the operation mode of the multifunction machine 100 to the copy mode and displays a copy setting screen ([[]] Figure 7 Fig. (c)) on the touch panel that accepts the execution instruction of the copy operation. The switching button B12 is a button that accepts the input of a switching instruction for the selection buttons displayed as the selection buttons B10 for modes, etc. The setting button B14 is a button that accepts the display instruction of an unillustrated setting screen related to the device settings of the multifunction machine 100.

[0067] The title object O10 is a protected object that displays the title string "Home" of the home screen W10. When a tooltip is displayed overlaid (repeatedly) on the display of the title object O10, the control unit 11 changes the display form of the tooltip.

[0068] Figure 7 Fig. (b) is a diagram for explaining an example of the display configuration of the home screen W10 with selection buttons B10 for modes, etc. that are different from those in Fig. (a) and are displayed by the user's selection of the switching button B12. Figure 7 Fig. (a).

[0069] Figure 7(b) shows examples of the "Tray Settings" button, the "Cloud Collaboration Print..." button (where "Print" in "Cloud Collaboration Print Application" is followed by an ellipsis "…"), and the "Cloud Collaboration Scan..." button (where "Scan" in "Cloud Collaboration Scan Application" is followed by an ellipsis "…") as the mode selection buttons B10, etc. In addition, since the "Cloud Collaboration Print..." button and the "Cloud Collaboration Scan..." button have strings omitted by ellipsis characters, they are also targets for which tooltips showing all the omitted characters (strings) are displayed through operations such as mouse switching by the user.

[0070] Figure 7 (c) is a diagram illustrating the display configuration example of the copy setting screen W20 displayed by the control unit 11 in response to the selection of the "Copy" button, which is the mode selection button B10 for the home screen W10. The copy setting screen W20 includes a copy setting button B16, a start button B18, a reset button B20, a title object O12, and a copy number object O14.

[0071] The copy setting button B16 is a button for accepting the selection / input of setting items (set values) related to the execution of the copy operation. In Figure 7 (c), as examples of the setting items related to the execution of the copy operation, the "Paper Selection" button, the "Duplex Copy" button, and the "Magnification" button are displayed together with the set value (e.g., Paper Selection: A4).

[0072] The start button B18 is a button for accepting the input of an execution instruction for the copy operation. When the selection of the start button B18 is received, the control unit 11 executes the copy operation based on the setting content set via the copy setting screen W20. Additionally, the reset button B20 is a button for accepting a reset instruction for the content input / set via the copy setting screen W20.

[0073] The title object O12 is a protected object that displays the title string "Copy" of the copy setting screen W20. The copy number object O14 is a protected object for accepting the input of the copy number by the user. When a tooltip is displayed covering the display of the title object O12 or the copy number object O14, the control unit 11 changes the display form of the tooltip.

[0074] Figure 8Figure (a) 0 illustrates a display configuration example of a facsimile setting screen W30 that is displayed by a control unit 11 upon receiving a selection of a "Facsimile" button that is a mode selection button B10 or the like on a home screen W10. The facsimile setting screen W30 includes a facsimile setting button B22, a start button B18, a reset button B20, a volume button B24, and a facsimile number input target O16. In addition, for parts that can adopt the same configuration as those described in the home screen W10, copy setting screen W20, etc. described above, the same reference numerals may be used and their descriptions may be omitted.

[0075] The facsimile setting button B22 is a button for receiving a selection / input of a setting item (setting value) related to the execution of a facsimile operation. In Figure 8 Figure (a) 0, as setting items related to the execution of a facsimile operation, examples of an "Address Book" button, a "Transmission History" button, and a "Direct Input" button are shown.

[0076] The volume button B24 is a button for receiving a setting of the transmission / incoming call volume during facsimile transmission and reception.

[0077] The facsimile number input target O16 is a target for receiving a selection / input of a facsimile number related to facsimile transmission. For the input of a facsimile number to the facsimile number input target O16, it can be performed by selecting from an address book displayed by selecting the "Address Book" button, selecting from a transmission history displayed by selecting the "Transmission History" button, or directly inputting using a software key, a hardware key, etc. displayed by selecting the "Direct Input" button.

[0078] In addition, Figure 8 Figure (b) 0 is a diagram showing a situation where a user has input a facsimile number to the facsimile number input target O16. If the user has input a partial facsimile number (e.g., "0123456789") to the facsimile number input target O16, then this facsimile number input target O16 is treated as a protected target. When the display of a tool tip overlays the display of the facsimile number input target O16 where a facsimile number has been input, the control unit 11 changes the display form of this tool tip.

[0079] Figure 9 Figure (a) 0 illustrates a display configuration example of a scan setting screen W40 that is displayed by a control unit 11 upon receiving a selection of a "Scan" button that is a mode selection button B10 or the like on a home screen W10. The scan setting screen W40 includes a scan setting button B26, a start button B18, a reset button B20, and a destination input target O18. In addition, for parts that can adopt the same configuration as those described in the home screen W10, copy setting screen W20, etc. described above, the same reference numerals may be used and their descriptions may be omitted.

[0080] The scan setting button B26 is a button for accepting the selection / input of setting items (setting values) related to the execution of a scan operation. In Figure 9 , in (a), as setting items related to the execution of a scan operation, examples of the "address book" button, "send history" button, and "send setting" button are shown.

[0081] The destination input target O18 is a target for accepting the selection / input of the transmission destination (transmission destination address) of the image data generated by the scan operation. For the input of the transmission destination address to the destination input target O18, it can be performed by selecting from the address book displayed by selecting the "address book" button, selecting from the send history displayed by selecting the "send history" button, or direct input using software keys, hardware keys, etc. displayed based on a touch operation on the destination input target O18.

[0082] Figure 9 , (b) is a diagram showing the situation when the user inputs a transmission destination address to the destination input target O18. If the user inputs a partial destination address (e.g., "tanaka.jiro@example.com") to the destination input target O18, then the destination input target O18 is processed as a protected target. When the display of the tool tip overlays the display of the destination input target O18 where the transmission destination address has been input, the control unit 11 changes the display form of the tool tip.

[0083] Next, a specific display example of the tool tip according to the first embodiment will be described. Figure 10 , (a) is a diagram for explaining the display example of the tool tip 20e displayed by the control unit 11 when, for example, the "cloud collaboration print..." button, which is a mode selection button B10 in the home screen W10 shown in (b) of Figure 7 , is long-pressed by the user's finger F10 or the mouse hovers over it. Figure 10 , (a) is an example showing that there is no movement of the tool tip, but the display form of the tool tip 20a changes from the tool tip 20a with the number of display lines of the display string being "1 line" to the tool tip 20e with "2 lines".

[0084] On the other hand, Figure 10 , (b) is a diagram for explaining the display example of the tool tip 20a displayed by the control unit 11 when, for example, the "cloud collaboration scan..." button, which is a mode selection button B10 in the home screen W10 shown in (b) of Figure 7 , is long-pressed by the user's finger F10 or the mouse hovers over it. Figure 10(a) is an example in which the tooltip 20a is moved to the left (counterclockwise) in the figure because the display of the tooltip 20a covers the restricted area outside the displayable area of ​​the touch panel (screen).

[0085] Next, Figure 11 is the description in Figure 9 This is a diagram showing an example of the display configuration of the sending history screen W50 displayed by the control unit 11 when the user selects the "Send History" button as the scan setting button B26 in the scan setting screen W40 of (a). The sending history screen W50 includes a sending history display area R20, an OK button B28, a delete button B30, a title object O20, and a selected sending destination object O22.

[0086] The transmission history display area R20 is a display area that displays the destination (transmission destination address) of the image data generated by the scan job as the transmission history. The OK button B28 is a button that accepts input of an instruction to confirm the transmission destination address selected in the transmission history display area R20. When the transmission history selected by the user is checked in the transmission history display area R20 (the transmission destination object O22 is selected) and the user selects the OK button B28, the control unit 11 sets the transmission destination address determined by the transmission history in Figure 9 (a) and the like are exemplified in the destination input object O18. When receiving the user's selection of the start button B18, the control unit 11 transmits the image data to the destination address set in the destination input object O18.

[0087] The delete button B30 is a button for accepting a delete instruction of the transmission history from the transmission history display area R20. When the transmission history selected by the user is checked in the transmission history display area R20 (the transmission destination object O22 is selected), and the delete button B30 is selected by the user, the control unit 11 ends the display of the transmission history in the transmission history display area R20. In this case, the control unit 11 may also control the deletion of the history information related to the transmission history from the storage unit 19.

[0088] The title object O20 is a protection object of the title character string "Send History" of the send history screen W50. The selected send destination object O22 is a protection object related to the send history selected by the user and with a check mark indicating that it has been selected. When the display of the tooltip is overlaid on the display of the title object O20 or the selected send destination object O22, the control unit 11 changes the display format of the tooltip.

[0089] Figure 11 ​​Figure (b) shows an example of the tooltip 20a displayed by the control unit 11 when the transmission history "Legal Affairs Department..." at the bottommost part of the transmission history display area R20 is long-pressed by the user's finger F10 or the mouse hovers over it. In addition, Figure 11 Figure (c) shows an example of the tooltip 20a displayed by the control unit 11 when the transmission history "Legal Affairs Department..." (destination target O22 has been selected) at the second position from the topmost part of the transmission history display area R20 is long-pressed by the user's finger F10 or the mouse hovers over it.

[0090] Figure 11 The displays of the tooltip 20a exemplified in Figures (b) and (c) do not cover restricted areas such as the title target O20 and the selected destination target O22. Therefore, the tooltip 20a is displayed at the display position (initial position) above the specified area R10 in its original display form without accompanying a change in the number of lines of the display string.

[0091] Figure 12 Figure (a) illustrates an example of the tooltip 20a displayed by the control unit 11 when the transmission history "Direct input james.oliver@exam…" at the topmost part of the transmission history display area R20 is long-pressed by the user's finger F10 or the mouse hovers over it.

[0092] In Figure 12 Figure (a), when the tooltip 20a is to display "james.oliver@example.com" as all the characters, the display of this tooltip 20a will cover the display of the title target O20. In this case, the control unit 11 changes the display form of the tooltip 20a from a tooltip with a "1-line" display string to a tooltip with a "2-line" display string. As a result, as Figure 12 shown in Figure (b), the display of the title string "Transmission History" of the title target O20, which is the target to be protected, is maintained without being obstructed.

[0093] Figure 13 Figure (a) illustrates an example of the tooltip 20a displayed by the control unit 11 when the transmission history "tanaka.jiro@exam…" directly below the selected destination target O22 is long-pressed by the user's finger F10 or the mouse hovers over it.

[0094] In Figure 13In (a) of FIG. , when the entire string "tanaka.jiro@example.com" is to be displayed by the tool tip 20a, the display of the tool tip 20a overlaps the display of the selected destination target O22. In this case, the control unit 11 changes the display form by moving the tool tip 20a counterclockwise. As a result, as shown in Figure 13 (b) of FIG. , the display of the selected destination target O22 as the protection target is maintained without being obstructed.

[0095] Figure 14 (a) of FIG. is an example when the tool tip 20a is dragged in the upper right direction in a state where the tool tip 20a is displayed. Each time the control unit 11 detects the movement of the tool tip 20a, it determines the display position (coordinates) of the tool tip 20a and the number of lines of the display text. At the beginning of the movement, the tool tip 20a moves while maintaining the display directly above the user's finger F10 in a manner following the movement of the user's finger F10. However, in order not to cover the restricted area of the selected destination target O22, the display position is determined below the selected destination target O22 from the middle of the drag.

[0096] Figure 14 (b) of FIG. is an illustration of the case where the tool tip 20a is further dragged in the upper right direction from the position of Figure 14 (a) of FIG. . Each time the control unit 11 detects the movement of the tool tip 20a, it determines the display position (coordinates) of the tool tip 20a and the number of lines of the display text. As a result, when the display of the selected destination target O22 is no longer covered, the display position of the tool tip 20a returns to the position directly above the user's finger F10.

[0097] As described above, according to the first embodiment, when the display of the tool tip as an additional display covers the restricted area that restricts the display of the tool tip, the tool tip can be moved or the number of lines of the display string of the tool tip can be changed. With such a configuration, the display of the tool tip can prevent the tool tip from covering the target, so the visual recognition of the target can be maintained.

[0098] [2 Second Embodiment] The first embodiment is a method of changing the display position of the tool tip and the number of lines of the displayed string when the display of the tool tip as an additional display covers the restricted area. As an example of a change example of the display form of the tool tip, a method of performing transparent (transmissive) control on the display of the tool tip will be described.

[0099] Since the functional configuration of the multifunction machine 100 equipped with the display device 10 according to the second embodiment can be the same as that of the first embodiment, the description thereof is omitted here.

[0100] The processing flow according to the second embodiment may be to replace the flowchart of the first embodiment Figure 3 with the flowchart of Figure 15 . Additionally, for the processing that can be common with the processing described in Figure 3 , the same step numbers are marked, and the description thereof is omitted.

[0101] In Figure 15 's flowchart, when the processing from step S100 to step S130 ends, the control unit 11 determines whether the display of the tooltip covers the restricted area (step S140). If it is determined that the display of the tooltip does not cover the restricted area, the control unit 11 determines the display position of the tooltip and the number of lines of the display string, and ends the processing (step S140: No → step S150).

[0102] On the other hand, if it is determined that the display of the tooltip covers the restricted area, the control unit 11 transparently displays the tooltip and ends the processing (step S140: Yes → step S300).

[0103] Figure 16 's (a) is the same as the figure described in the operation example of Figure 13 (a) of the first embodiment, and is a figure reflecting the transparent display of the tooltip 20a according to the second embodiment. In addition, the transparent display according to the second embodiment means that when the tooltip 20a covers the restricted area such as the selected transmission destination target O22, the transparency (transmittance) of the tooltip 20a is changed (increased) to a degree that can distinguish the display content of the selected transmission destination target O22. The specific transparency applied to the tooltip 20a can be appropriately changed according to the default display settings applied to the tooltip 20a, and as long as it is a transparency that can distinguish the display content of the selected transmission destination target O22 as the protected target, it can also be semi-transparent.

[0104] As Figure 16 's (a) shows, by transparently displaying the tooltip 20a, it is possible to confirm the display content of the selected transmission destination target O22 as the protected target through the tooltip 20a.

[0105] ​​In addition, the transparent display (control) related to the second embodiment can also be combined with the movement processing of the tooltip 20a related to the first embodiment. That is, for example, when the transmission history "tanaka.jiro@exam…" located directly below the selected transmission destination target O22 is long-pressed by the user's finger F10 or the mouse hovers over it (refer to Figure 13 (a) of Figure 16 ), the tooltip 20a to be displayed is transparently displayed. After the tooltip 20a moves, by canceling the transparent display of the tooltip 20a, it is also possible to return to the original display form ( (b) of

[0106]

[0107] [3 Third Embodiment] In the third embodiment, in the first embodiment, after the display form of the tooltip as an additional display is changed, after a predetermined time, the display of the tooltip ends. Here, the predetermined time refers to a time scale as long as the user can confirm all the display contents (all strings) of the tooltip. For example, it can also be in units of several seconds.

[0108] Since the functional configuration of the multifunction machine 100 equipped with the display device 10 related to the third embodiment can be the same as the functional configuration related to the first embodiment, the description here is omitted.

[0109] [3.1 Process Flow] The process flow related to the third embodiment is the process flow added to the Figure 3 flowchart related to the first embodiment. Therefore, the description of the same process is omitted.

[0110] Figure 17 is a flowchart illustrating the process flow related to the third embodiment.

[0111] In Figure 3 after the processing of steps S100 to S230 of

[0112] Next, the control unit 11 displays a tool tip (step S400). Then, the control unit 11 determines whether a predetermined time has elapsed since the display of the tool tip started (step S410). When it is determined that the predetermined time has elapsed since the display of the tool tip started, the control unit 11 ends the display of the tool tip (step S410: Yes → step S420). On the other hand, when it is determined that the predetermined time has not elapsed since the display of the tool tip started, the control unit 11 continues the display of the tool tip (step S410: No → step S400).

[0113] As described above, according to the third embodiment, on the basis of the effects of the first embodiment, the display of the tool tip with the changed display form is restricted (removed) after a predetermined time has elapsed since the start of the display. Therefore, for example, it is possible to prevent the visual recognition of other objects covered by the moved tool tip from being reduced for a long time.

[0114] The present disclosure is not limited to the above-described embodiments, and various modifications can be made. That is, embodiments obtained by appropriately combining technically modified technical means without departing from the gist of the present disclosure are also included in the technical scope of the present disclosure.

[0115] In addition, for the sake of convenience in explanation, the above-described embodiments have parts described separately, but it goes without saying that they can also be combined and executed within the technically possible range.

[0116] In addition, in the embodiments, the programs running in the respective devices are programs for controlling a CPU or the like (programs for causing a computer to function) to implement the functions of the above-described embodiments. And the information processed by these devices is temporarily stored in a temporary storage device (for example, RAM) when it is being processed, and thereafter, it is stored in a storage device such as various ROMs (Read Only Memory), HDDs, and SSDs and read, modified, and written by the CPU as needed.

[0117] Here, as a computer-readable non-transitory recording medium that records a program in an information processing apparatus, it may also be a semiconductor medium (e.g., ROM, non-volatile memory card, etc.), an optical recording medium / magneto-optical recording medium (e.g., DVD (Digital Versatile Disc), MO (Magneto Optical Disc), MD (Mini Disc), CD (Compact Disc), BD (Blu-ray (registered trademark) Disc, etc.), a magnetic recording medium (e.g., magnetic tape, floppy disk, etc.), or any one of them. In this case, by the computer of the information processing apparatus reading the program recorded in the recording medium and executing it by this computer, not only the functions of the above-described embodiments are realized, but also based on the instructions of this program, processing is jointly performed with an operating system or other application programs, etc., thereby realizing the functions of the present disclosure.

[0118] In addition, in the case of being distributed to the market, the program can be stored in a removable recording medium for distribution, or transmitted to a service computer connected via a network such as the Internet. In this case, the storage device of the server computer is of course also included in the present invention.

[0119] In addition, each functional module or each feature of the device used in the above-described embodiments can be installed and executed by a circuit, for example, an integrated circuit or a plurality of integrated circuits. A circuit designed to realize the functions described in this specification may include: a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or a combination thereof. The general-purpose processor may be a microprocessor, or may be an existing type of processor, controller, microcontroller, or state machine. The above-described circuit may be composed of a digital circuit or an analog circuit. In addition, in the case where an integrated circuit technology that replaces the current integrated circuit appears with the progress of semiconductor technology, one or more aspects of the present disclosure can also use a new integrated circuit based on this technology. Explanation of Reference Numerals

[0120] 10 Display device 11 Control unit 13 Display unit 15 Operation input unit 17 Communication unit 19 Storage unit 191 Control program 192 Display control program 193 Display form determination program 194 Target storage area 195 Job control program 21 Image processing unit 211 Image forming unit 213 Image input unit 100 Multifunction machine

Claims

1. A display device, characterized in that: include: A display unit that displays an operation screen including a target; as well as a control unit that controls display of an additional display corresponding to the target based on a user's operation on the target, The control unit changes the display format of the additional display when the display of the additional display overlaps a restricted area where the display of the additional display is restricted.

2. The display device according to claim 1, characterized in that The restricted area includes a display area of ​​the object that displays a protected protection object. The control unit protects the display of the protection target by changing the display format of the additional display.

3. The display device according to claim 1, characterized in that The control unit changes the display format of the additional display by changing the display position of the additional display from a reference display position.

4. The display device according to claim 3, characterized in that: The reference display position is set outside a predetermined area with the operation position of the object by the user as a reference point and centered on the reference point. The control unit changes the display format of the additional display so that the additional display does not cover the predetermined area.

5. The display device according to claim 4, characterized in that: The control unit changes the display form of the additional display by moving the display position of the additional display along the predetermined area.

6. The display device according to claim 5, characterized in that: The control unit changes the display form of the additional display by moving the display position of the additional display counterclockwise along the predetermined area.

7. The display device according to claim 1, characterized in that The control unit changes the display format of the additional display by changing the number of lines of the display character string of the additional display from a reference number of lines.

8. The display device according to claim 7, characterized in that: The control unit changes the display format of the additional display by increasing or decreasing the number of lines of the display character string of the additional display from the reference number of lines.

9. The display device according to claim 1, characterized in that: The additional display includes a tool tip.

10. An image processing device, characterized in that: include: A display unit that displays an operation screen including a target; a control unit that controls display of an additional display corresponding to the target based on a user's operation on the target; as well as Image Processing Department, The control unit changes the display format of the additional display when the display of the additional display overlaps a restricted area where the display of the additional display is restricted.

11. A display control method for an additional display, which controls the display of an additional display corresponding to a target displayed on an operation screen based on an operation by a user, wherein: When the display of the additional display overlaps a restricted area that restricts the display of the additional display, the display form of the additional display is changed.

Images