Display device and program

Abstract

To provide a display device, or the like, which controls specific display elements displayed in a first area to be displayed also in a second area, on a screen including the first area and the second area.SOLUTION: A display device includes: an operation detection unit which detects an operation; a display unit which displays a screen including a scrollable first area and a second area; and a display control unit which controls display elements including specific display elements to be displayed in the first area. The display control unit scroll-displays the display elements displayed in the first area when the operation detection unit detects scroll operation, and storage-displays the specific display elements in the second area when the specific display elements are scroll-displayed toward the second area by the scroll display.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a display device and the like.

Background Art

[0002] Conventionally, in a device having a display unit, a technique has been used in which the entire display content displayed on the display unit can be browsed by scrolling the display unit. Also, in such a display, techniques for improving user convenience have been proposed.

[0003] For example, when using a magnifying glass in a real screen area where screen information is enlarged, in response to an operation of moving the magnifying glass outside the range of the display screen, the screen information in the display area is displayed on the magnifying glass, and the screen information in the real screen area is scrolled following the movement of the magnifying glass (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technique disclosed in Patent Document 1, when the screen information is scrolled, the buttons that were previously displayed and operable by the user protrude from the screen area and are no longer displayed in the screen area. As a result, even when viewing the scrolled screen information, the user cannot know the existence of the buttons.

[0006] In view of the above problems, an object of the present invention is to provide a display device or the like that performs control to also display a specific display element displayed in a first area in a second area on a screen including the first area and the second area.

Means for Solving the Problems

[0007] In order to solve the above problems, the display device of the present invention includes: an operation detection unit that detects an operation; a display unit that displays a screen including a first region and a second region that can be scrolled; a display control unit that controls to display a display element including a specific display element in the first region; and is characterized in that: when the operation detection unit detects a scroll operation, the display control unit scrolls the display elements displayed in the first region; when the specific display element is scrolled and displayed in the direction of the second region by the scroll display, the display control unit stores and displays the specific display element in the second region.

[0008] The display method of the present invention includes: an operation detection step of detecting an operation; a display step of displaying a screen including a first region and a second region that can be scrolled; a display control step of controlling to display a display element including a specific display element in the first region; and is characterized in that: when the operation detection step detects a scroll operation, the display control step scrolls the display elements displayed in the first region; when the specific display element is scrolled and displayed in the direction of the second region by the scroll display, the display control step stores and displays the specific display element in the second region.

[0009] The program of the present invention causes a computer to: have an operation detection function of detecting an operation; have a display function of displaying a screen including a first region and a second region that can be scrolled; have a display control function of controlling to display a display element including a specific display element in the first region; ​ to achieve The display control function When a scroll operation is detected by the operation detection function, the display elements displayed in the first area are scrolled and displayed, When the specific display element is scrolled and displayed in the direction of the second area by the scroll display, the specific display element is stored and displayed in the second area.

Advantages of the Invention

[0010] According to the present invention, on a screen including a first area and a second area, among the display elements displayed in the first area, for a specific display element, in the second area, it is displayed in a stored display mode. Here, by setting a button that receives an operation by the user as the specific display element, the user can grasp the presence of the button that is the specific display element by checking the first area and the second area.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this embodiment, as an example, an image forming apparatus including a display device to which the present invention is applied will be described.

[0013] [1. First Embodiment] [1.1 Functional Configuration] First, the overall configuration of the first embodiment will be described. FIG. 1 is an external perspective view showing an image forming apparatus 10 including a display device to which the present invention is applied, and FIG. 2 is a functional configuration diagram of the image forming apparatus 10.

[0014] As shown in FIG. 2, the image forming apparatus 10 includes a control unit 100, a display unit 110, an operation detection unit 120, a storage unit 130, an image input unit 140, an image forming unit 150, an image processing unit 160, and a communication unit 170.

[0015] The control unit 100 is a functional unit for controlling the entire image forming apparatus 10. The control unit 100 realizes various functions by reading and executing various programs, and is configured by, for example, one or more arithmetic units (for example, a CPU (Central Processing Unit)).

[0016] Also, the control unit 100 functions as a display control unit 102 by reading and executing a display control program 132 described later. The display control unit 102 is a functional unit that controls the display of the display unit 110. The display control unit 102 controls the display unit 110 to display one or more display elements. Here, a display element is an element that constitutes the screen to be displayed on the display unit 110. Specifically, it is a character string (label), icon, image, etc. that displays information, or a button, radio button, list, slider, menu, etc. that can be operated by the user. A region (for example, a panel) including display elements may also be regarded as a display element.

[0017] When many display elements are included in a predetermined area secured in the display unit 110, some display elements will protrude from the predetermined area and will not be displayed in the predetermined area. Therefore, among the display elements, there will be display elements that are in a state of being displayed in the predetermined area (hereinafter referred to as "in the display state") and display elements that are not displayed in the predetermined area (hereinafter referred to as "in the non-display state").

[0018] In order to change the display elements in the non-display state to the display state, the display control unit 102 performs control to scroll the display elements. Scroll display is a display control method in which all the display elements displayed in a predetermined area secured in the display unit 110 are moved in a certain direction by a certain distance. By doing so, a part of the display elements that were in the non-display state becomes in the display state, while a part of the display elements that were in the display state becomes in the non-display state. Note that the moving direction in the scroll display is called the scroll direction, and the moving distance is called the scroll amount.

[0019] The display control unit 102 executes a scroll display in response to a scroll operation detected by the operation detection unit 120. The scroll operation is an operation for specifying a scroll direction and a scroll amount, and is, for example, a touch operation such as a swipe. In this case, the direction in which the finger is moved becomes the scroll direction, and the movement distance of the finger becomes the scroll amount. In addition to this, the scroll operation may be a flick operation, an operation of moving a mouse wheel, an operation of selecting an arrow key on a keyboard, or an operation of moving a knob included in a scroll bar or selecting a scroll button.

[0020] The display unit 110 is a functional unit for displaying various information to the user, and is configured by, for example, an LCD (Liquid Crystal Display) or the like. Further, the operation detection unit 120 is a functional unit for detecting an operation by the user, and is configured by various key switches, a device for detecting input by contact, or the like. The user sets the functions to be used and the output conditions via the operation detection unit 120.

[0021] The display unit 110 and the operation detection unit 120 may be configured as separate bodies, or may be configured as a touch panel in which the display unit 110 and the operation detection unit 120 are integrally formed. The method for detecting the input of the touch panel may be a general detection method such as a resistive film method, an infrared method, an electromagnetic induction method, or a capacitance method. In the image forming apparatus 10 of the present embodiment, the display unit 110 and the operation detection unit 120 are integrally formed and will be described as operating as a touch panel.

[0022] The storage unit 130 is a functional unit in which various programs and various data necessary for the operation of the image forming apparatus 10 are stored. The storage unit 130 is configured by, for example, an SSD (Solid State Drive) which is a semiconductor memory, an HDD (Hard Disk Drive), or the like.

[0023] In addition, the storage unit 130 stores a display control program 132 which is a program for causing the control unit 100 to function as the display control unit 102.

[0024] The image input unit 140 is a functional unit for reading image data input to the image forming apparatus 10. The image input unit 140 is connected to a document reading unit which is a functional unit for reading an image of a document, and inputs the image data output from the document reading unit. Further, the image input unit 140 may input image data from another terminal device via the communication unit 170. Further, the image input unit 140 may input image data from a storage medium such as a USB (Universal Serial Bus) memory or an SD card.

[0025] The image forming unit 150 is a functional unit for forming output data based on the image data on a recording medium (for example, recording paper). For example, recording paper is fed from a paper feed tray, an image is formed on the surface of the recording paper in the image forming unit 150, and then discharged from the discharge tray. The image forming unit 150 is configured by, for example, a laser printer or the like using an electrophotographic method.

[0026] The image processing unit 160 is a functional unit for performing various image processes on the image data. For example, it performs sharpness processing or color conversion processing on the image data.

[0027] The communication unit 170 is a functional unit for the image forming apparatus 10 to communicate with other devices. For example, it is realized by a NIC (Network Interface Card) used in a wired / wireless LAN (Local Area Network) or a communication module connectable to a 3G / LTE / 5G line.

[0028] [1.2 Flow of processing] Next, the main process of this embodiment will be described. The main process of this embodiment is executed when the control unit 100 reads out the display control program 132 and the control unit 100 operates as the display control unit 102.

[0029] In this embodiment, the display area of the display unit 110 includes two areas, which are respectively defined as a client area (first area) and a title area (second area).

[0030] The client area is an area where scroll display is possible and where display elements including specific display elements are displayed. The title area is an area where a title string (e.g., "Administrator Mode") representing the display content of the client area is displayed. The title area is an area secured above the client area and has a size (height) sufficient to display the title string. Thus, the title area may be secured as an area smaller than the client area.

[0031] Here, the specific display element is a display element included in the client area and stored and displayed in the title area. For example, it is a display element such as a button. The button is an element displayed on the screen to receive an operation of selection by the user. By selecting the button, the user can give an instruction for a predetermined process to the image forming apparatus 10.

[0032] The specific display element is stored and displayed in the title area. Storing and displaying means displaying as a display mode for making the user visually recognize the existence of the specific display element, and displaying it as if the specific display element is stored according to the size of the title area. For example, when the specific display element is a button, in the title area, a figure imitating the shape of the button is displayed as the stored and displayed specific display element. In this way, the stored and displayed specific display element performs a simplified display compared to the display mode of the original specific display element. As the display mode of the stored and displayed button, the display of the character part displayed on the button is omitted, or the background color is made the same as the background color of the title area, and it is displayed as a figure leaving only the outer frame of the button. In this way, by storing and displaying the specific display element, it becomes easier for the user to visually recognize the existence of the specific display element.

[0033] When displaying a figure as a stored and displayed specific display element, the background color of the figure may be the same as the background color of the specific display element (e.g., a button), or may be a different color that is different from both the background color of the specific display element and the background color of the title area. Also, as a stored and displayed specific display element, instead of displaying the frame or background color of the specific display element, only the characters displayed on the specific display element (e.g., the characters displayed on the surface of the button) may be displayed. Further, the figure, characters, etc. in which the specific display element is stored and displayed may be displayed based on the display position where the specific display element is displayed and the width of the specific display element. Note that the stored and displayed specific display element shall not be selectable by the user.

[0034] Summarizing the above, among the display elements displayed in the client area, when a specific button is used as the specific display element, it is displayed as a button in the client area and as a figure in the title area. If it is displayed as a button, the user can instruct the image forming apparatus 10 to perform a predetermined process by selecting the button. However, if it is displayed as a figure, even if the user selects the figure, the user cannot instruct the image forming apparatus 10 to perform a predetermined process.

[0035] Among the display elements included in the client area, which display element is to be used as the specific display element may be set in advance by the designer of the image forming apparatus 10 or the like. Note that the image forming apparatus 10 may determine the specific display element. For example, a display element displayed at a predetermined position such as the uppermost part of the client area may be determined as the specific display element, or a display element for instructing screen transition or a display element for instructing a specific process may be determined as the specific display element.

[0036] Hereinafter, the processing content of the specific display control unit 102 will be described with reference to FIG. 3. In the present embodiment, it is described assuming that the setting screen of the image forming apparatus 10 is displayed in the client area and the OK button for applying the setting is the specific display element.

[0037] First, the display control unit 102 scrolls and displays the client area in response to a scroll operation by the user (step S102). Subsequently, the display control unit 102 determines whether or not the confirmation button, which is a specific display element, has become non-displayed in the client area by scrolling and displaying the display elements in the client area in the direction of the title area (step S104).

[0038] In the present embodiment, if a part or all of the confirmation button is displayed in the client area, the confirmation button is in the displayed state. If the entire confirmation button is not displayed in the client area, it is in the non-displayed state. Whether or not the confirmation button has become non-displayed is determined, for example, by whether or not the area where the confirmation button is displayed is included in the range to be displayed by the client area. When the area where the confirmation button is displayed is not included in the range to be displayed by the client area, the display control unit 102 determines that the confirmation button has become non-displayed in the client area.

[0039] When the confirmation button has become non-displayed in the client area, the display control unit 102 stores and displays the confirmation button in the title area (step S104; Yes → step S106). In step S104, when it is determined that the confirmation button is in the displayed state in the client area, the process returns to step S102 (step S104; No → step S102).

[0040] Subsequently, with the confirmation button stored and displayed in the title area being in the displayed state, the display control unit 102 scrolls and displays the display elements included in the client area in response to a scroll operation (step S108). Then, the display control unit 102 determines whether or not the confirmation button is in the displayed state in the client area (step S110). When the confirmation button is in the displayed state in the client area, the display control unit 102 deletes the confirmation button stored and displayed in the title area in step S106 (step S110; Yes → step S112).

[0041] In step S110, if it is determined that the OK button is not in the displayed state in the client area, the process returns to step S108 (step S110; No → step S108).

[0042] When the process of step S112 is completed, the process returns to step S102. Through such processing, even when the OK button is not in the displayed state in the client area, the stored and displayed OK button can be displayed in the title area.

[0043] Through such processing, if the OK button is in the displayed state in the client area, the stored and displayed OK button is not displayed. On the other hand, if the OK button is not in the displayed state in the client area, the stored and displayed OK button is displayed. Therefore, for the OK button which is a specific display element, it will be displayed either in the client area or stored and displayed in the title area and then displayed.

[0044] [1.3 Operation Example] Next, with reference to the drawings, the operation example of this embodiment will be described. First, with reference to FIG. 4, the operation of displaying the OK button stored and displayed in the title area will be described. FIG. 4(a) is a display example when the setting screen of the image forming apparatus 10 is displayed on the display unit 110, FIG. 4(b) is a display example when a scroll operation is being performed, and FIG. 4(c) is a display example when the OK button is in a non-displayed state in the client area.

[0045] As shown in FIG. 4(a), on the display unit 110 of the image forming apparatus 10, a screen display W100 including a title area E100 and a client area E102 is displayed as a setting screen. The title area E100 is arranged above the client area E102, and the title string "Administrator Mode" is displayed. The client area E102 includes display elements such as an OK button B100, a label L102 for displaying the setting item name, and a color selection button B102.

[0046] When the operation detection unit 120 detects that an upward scroll operation is performed on the client area E102 with the title area E100 being displayed, the display control unit 102 scrolls and displays the display elements included in the client area E102 upward. As a result, as shown in FIG. 4(b), a display screen W102 in which the display elements included in the client area E102 are moved upward is displayed on the display unit 110.

[0047] A part of the display elements included in the client area E102 may overlap with the position where the title area E100 is displayed. The display elements that overlap with the display position of the title area E100 are displayed so as to be hidden under the title area E100. For example, in the example of FIG. 4(b), a part of the OK button B100 is displayed so as to be hidden under the title area E100.

[0048] Furthermore, when the operation detection unit 120 detects that a scroll operation is performed on the client area E102 in the direction of the title area E100, the display control unit 102 scrolls and displays the display elements included in the client area E102 upward in the direction where the title area E100 is located. As a result, a screen display W104 as shown in FIG. 4(c) is displayed on the display unit 110. FIG. 4(c) is a display example when the OK button B100 is in a non-display state in the client area E102. In this case, the display control unit 102 displays the stored OK button M100 in the title area E100. The example of FIG. 4(c) is an example in which the display control unit 102 displays the stored OK button M100 at a position corresponding to the horizontal position where the OK button B100 is arranged. By doing so, the user can visually recognize that the OK button B100 is included in the client area E102 and the position where the OK button B100 is displayed when it is in a display state.

[0049] In addition, in the state of FIG. 4(c), when the operation detection unit 120 detects that a scroll operation has been performed on the client area E102 in the direction of the title area E100, the display control unit 102 scrolls and displays the display elements included in the client area E102 in the upward direction where the title area E100 is located. At this time, the display elements included in the client area E102 move upward. The display elements other than the specific display element become non-displayed from the client area E102 due to the scroll display, but the stored and displayed confirmation button M100 remains displayed in the title area E100.

[0050] Also, in the state of FIG. 4(c), when the operation detection unit 120 detects that a scroll operation has been performed on the client area E102 in the downward direction opposite to the direction of the title area E100, the display control unit 102 scrolls and displays the display elements included in the client area E102 in the downward direction opposite to the direction where the title area E100 is located. As a result, the display control unit 102 displays the screens as shown in FIGS. 4(b) and 4(a). That is, when the user performs a scroll operation in the downward direction opposite to the direction of the title area E100, a part or all of the confirmation button B100, which is a specific display element, is displayed in the client area E102. Then, when the confirmation button B100 becomes a displayed state, the display control unit 102 deletes the stored and displayed confirmation button M100.

[0051] Note that although it has been described that no instruction for a predetermined process is given even if the confirmation button M100 stored and displayed by the user is selected, instead, the display control unit 102 may redisplay the confirmation button B100 when the confirmation button M100 stored and displayed by the user is selected or when a predetermined operation is performed.

[0052] For example, assume that in the display unit 110, as shown in the screen display W106 of FIG. 5(a), the stored and displayed confirmation button M100 is in a state of being displayed in the title area E100. When a downward scroll operation in the direction opposite to that of the title area E100 is performed in this state, as shown in FIG. 5(b), the display control unit 102 causes the screen display W108 in which the area E104 including the confirmation button B100 is overlaid on the client area E102 to be displayed. Also, when an upward scroll operation in the direction of the title area E100 is performed in the state shown in FIG. 5(b), the display control unit 102 erases the area E104 and performs a display like the screen display W106 of FIG. 5(a). By doing so, when the user wants to display the confirmation button B100, the user can immediately cause the confirmation button B100 to be displayed in the client area E102 by performing a scroll operation in the direction opposite to that of the title area.

[0053] In addition, when an operation of selecting the title area E100 is performed even when the stored and displayed confirmation button M100 is displayed in the title area E100, as shown in FIG. 5(b), the display control unit 102 may also display the area E104. Further, when the title area B100 is selected by the user, the display control unit 102 may scroll and display the display elements of the client area E102 so that the confirmation button B100 is displayed in the client area E102, and display the screen display W110 shown in FIG. 5(c).

[0054] As another operation example, the area for displaying the stored and displayed specific display element may be an area other than the title area E100. For example, as shown in FIG. 6(a), when a status area E108 is displayed at the lower part of the client area E102, the display control unit 102 may display the specific display element stored and displayed in the status area E108. That is, the status area E108 is set as the second area.

[0055] FIG. 6(b) is an example of a screen display W122 in a state where a scroll operation is performed in the downward direction opposite to the direction of the status area E108, and a part of the OK button B100 is no longer displayed from the client area E102. Further, FIG. 6(c) is an example of a screen display W124 when a scroll operation is further performed in the downward direction, which is the direction of the status area E108, and all of the OK button B100 is no longer displayed in the client area E102. As shown in FIG. 7(c), the display control unit 102 displays the OK button M102 stored and displayed in the status area E108 instead of the OK button B100.

[0056] As yet another operation example, when the title area E100 is included above the client area E102 and the status area E108 is included below the client area E102, the specific display element stored and displayed in the area in the direction in which the specific display element has disappeared may be displayed. For example, when the specific display element is scrolled in the direction of the title area E100 and becomes non-displayed, the specific display element stored and displayed in the title area E100 is displayed. Also, when the specific display element is scrolled in the direction of the status area E108 and becomes non-displayed, the specific display element stored and displayed in the status area E108 is displayed. By doing so, it becomes possible for the user to visually recognize the direction in which the scroll operation should be performed when the specific display element is to be displayed.

[0057] Also, when there are a plurality of lines of the specific display element, the display control unit 102 may sequentially display the specific display elements stored and displayed in the title area E100 by replacing them.

[0058] In the above-described embodiment, it has been described that the setting screen is displayed on the display unit 110 of the image forming apparatus 10. However, for example, the display control program 132 may be executed on a terminal device such as a smartphone connected to the image forming apparatus 10. By doing so, even when the display area is limited as in the case of a smartphone, it becomes possible to display the specific display element stored and displayed in the title area E100.

[0059] According to this embodiment, even when a specific display element is in a non-display state in the client area, the specific display element stored and displayed in the title area is displayed. Therefore, by visually recognizing the title area, the user can immediately grasp the existence of the specific display element.

[0060] In addition, the user can immediately display a specific display element (for example, a button) when necessary by performing a scroll operation in a direction opposite to the direction of the title area or selecting the title area in which the stored and displayed specific display element is displayed. Therefore, an improvement in user convenience can be expected.

[0061] Furthermore, when displaying a specific display element, by displaying the area including the specific display element so as to overlap the client area, even when the display area is limited, the display area can be effectively utilized.

[0062] [2. Second Embodiment] Next, the second embodiment will be described. The second embodiment is an embodiment in which a part of the stored and displayed specific display element is also displayed even when a part of the specific display element is displayed in the client area. This embodiment replaces FIG. 3 of the first embodiment with FIG. 7, and the same functional parts and processes are denoted by the same reference numerals, and the description thereof will be omitted. Note that the specific display element will be described as an OK button.

[0063] In addition, in this embodiment, in the client area, the state in which all the OK buttons are displayed is defined as the display state, and the state in which all the OK buttons are not displayed is defined as the non-display state. Also, in the client area, the state in which a part of the OK buttons is displayed is defined as the partial display state.

[0064] [2.1 Flow of Processing] The flow of the main process of this embodiment will be described with reference to FIG. 7. In step S104, when it is determined that the OK button is not in a non-display state in the client area, the display control unit 102 then determines whether the OK button is partially displayed in the client area (step S104; No → step S202).

[0065] If the OK button is partially displayed in the client area, the display control unit 102 displays a part of the stored OK button in the title area (step S202; Yes → step S204). Note that the display size of the stored OK button may be changed according to the size of the OK button displayed in the client area. Specifically, if the ratio of the OK button displayed in the client area is small, the stored OK button is displayed large, and if the ratio of the OK button displayed in the client area is large, the stored OK button is displayed small.

[0066] If the OK button is in a display state in the client area, the process returns to step S102 (step S202; No → step S102).

[0067] Also, in step S110, when it is determined that the OK button is not in a display state in the client area, the display control unit 102 then determines whether the OK button is partially displayed in the client area (step S110; No → step S206). If the OK button is partially displayed in the client area, the display control unit 102 displays a part of the stored OK button in the title area (step S206; Yes → step S208). Note that if the OK button is in a non-display state in the client area, the process returns to step S108 (step S206; No → step S108).

[0068] [2.2 Operation Example] Next, with reference to the drawings, an operation example of the present embodiment will be described. First, with reference to FIG. 8, the operation of displaying the OK button stored and displayed in the title area will be described. FIG. 8(a) is a display example when the OK button is in the displayed state, FIG. 8(b) is a display example when the OK button is in a partially displayed state, and FIG. 8(c) is a display example when the OK button is in a non-displayed state in the client area.

[0069] As shown in FIG. 8(a), on the display unit 110 of the image forming apparatus 10, a screen display W200 including a title area E200 and a client area E202 is displayed as a setting screen. Display elements are displayed in the client area E202, and the OK button B200, which is a specific display element, is included.

[0070] When the client area E202 is scrolled upward by the user in the upward direction, which is the direction of the title area E200, the display control unit 102 scrolls and displays the display elements in the client area E202 upward. As a result, on the display unit 110 of the image forming apparatus 10, as shown in FIG. 8(b), a screen display W202 in which the OK button B200 is partially displayed in the client area E202 is displayed. In this case, as shown in FIG. 8(b), the display control unit 102 displays a part of the stored and displayed OK button M200 in the title area E200.

[0071] Furthermore, when the client area E202 is scrolled upward by the user in the upward direction, which is the direction of the title area E200, all of the OK button B200 disappears from the client area E202. In such a case, the display control unit 102 displays the stored and displayed OK button M200 in the title area E200.

[0072] When a scroll operation is performed in the downward direction, which is the direction opposite to that of the title area E200, the display control unit 102 displays a screen as shown in FIGS. 8(b) and 8(a) according to the size of the OK button B200 displayed in the client area E202. That is, when a part of the OK button B200, which is a specific display element, is displayed in the client area E202 due to the scroll operation, the display control unit 102 displays a part of the stored and displayed OK button M200 in the title area E200. When all of the OK button B200, which is a specific display element, is displayed in the client area E202, the display control unit 102 erases the stored and displayed OK button M200 from the title area E200.

[0073] According to the present embodiment, when a scroll operation is performed, it is possible to change the size of the stored and displayed specific display element according to the scroll amount by the operation. As a result, it is possible to more naturally allow the user to visually recognize the stored and displayed specific display element.

[0074] [3. Third Embodiment] Next, the third embodiment will be described. The third embodiment is an embodiment in which a predetermined area (hereinafter referred to as a "menu area") is provided in the client area, and buttons included in the menu area are used as specific display elements. This embodiment replaces FIG. 3 of the first embodiment with FIG. 9. The same functional parts and processes are denoted by the same reference numerals, and the description thereof will be omitted.

[0075] Also, in this embodiment, in the client area, if a part or all of the buttons in the menu area are displayed, the buttons in the menu area are in the display state. In the client area, a state in which all of the buttons in the menu area are not displayed is defined as a non-display state.

[0076] [3.1 Flow of Processing] The flow of the process of this embodiment will be described with reference to FIG. 9. First, the display control unit 102 scrolls and displays the display elements within the client area in response to a scroll operation (step S102). Subsequently, when the user performs a scroll operation in the direction of the title area, the display control unit 102 determines whether the button in the menu area, which is a specific display element, has become invisible in the client area (step S302).

[0077] If the button in the menu area, which is a specific display element, becomes invisible in the client area, the display control unit 102 stores and displays the button in the menu area in the title area (step S302; Yes → step S304).

[0078] The display control unit 102 may store and display the button in the menu area based on the horizontal position of the button arranged in the menu area. By doing so, the user can quickly visually recognize the position of the button included in the menu area by looking at the title area. Note that the menu area may be a larger (higher) area than the title area. In this case, the display control unit 102 displays a reduced graphic of the button in the menu area as the button stored and displayed in the menu area.

[0079] If the button in the menu area is visible in the client area, the process returns to step S102 (step S302; No → step S102).

[0080] Subsequently, with the button in the menu area stored and displayed in the title area, the display control unit 102 scrolls and displays the display elements within the client area in response to a scroll operation (step S108). Then, if the button in the menu area becomes visible in the client area, the display control unit 102 deletes the stored and displayed button in the menu area from the title area (step S306; Yes → step S308). Then, the process returns to step S102.

[0081] [3.2 Operation Example] Next, with reference to the drawings, the operation example of this embodiment will be described. First, with reference to FIG. 10, the operation of storing and displaying the buttons in the menu area in the title area will be described. FIG. 10(a) is a display example of the initial state of the setting screen of the image forming apparatus 10, FIG. 10(b) is a display example when a scroll operation is performed in the direction of the title area, and FIG. 10(c) is a display example when the buttons in the menu area are in a non-display state in the client area.

[0082] As shown in FIG. 10(a), on the display unit 110 of the image forming apparatus 10, a display including a title area E300 and a client area E302 is displayed as a screen display W300. In the title area E300, a character string "Administrator Mode", which is the title of the screen display W300, is displayed. The client area E302 includes display elements such as buttons, and further includes a menu area E304. The menu area E304 includes a return button B300 and a button B302 that can be selected by the user, and further, a character string "Basic Settings" is displayed as a subtitle. The return button B300 and the confirmation button B302 are specific display elements.

[0083] When the client area E302 is scrolled upward by the user in the direction of the title area E300, the display control unit 102 displays a screen display W302 in which the display elements of the client area E302 are scrolled and displayed as shown in FIG. 10(b). As shown in FIG. 10(b), the display control unit 102 displays the display elements included in the client area E302 so as to be hidden below the title area E300 while fixing the position of the title area E300. For example, the menu area E304 is displayed so as to overlap the title area E300 above.

[0084] Furthermore, when the client area E302 is scrolled upward by the user in the direction of the title area E300, the display control unit 102 displays a screen display W304 as shown in FIG. 10(c) on the display unit 110 of the image forming apparatus 10. In this way, when the scroll amount increases, the menu area E304 becomes non-displayed in the client area E302. Also, the back button B300 and the OK button B302 included in the menu area E304 similarly become non-displayed in the client area E302.

[0085] Triggered by the back button B300 and the OK button B302, which are specific display elements, becoming non-displayed in the client area E302, the display control unit 102 stores and displays the back button B300 and the OK button B302 of the menu area E304 in the title area E300. For example, as shown in FIG. 10(c), the stored back button M300 and the stored OK button M302 are displayed in the title area E300. By displaying in this way, the user can visually recognize the existence of the back button B300 and the OK button B302.

[0086] Also, in the state of FIG. 10(c), when a scroll operation is performed on the client area E302 in the downward direction opposite to the direction of the title area E300, the display control unit 102 displays screens as shown in FIGS. 10(b) and 10(a) according to the display state of the client area E302. That is, when the user performs a scroll operation in the downward direction opposite to the direction of the title area E300, and as a result, the back button B300 and the OK button B302, which are specific display elements, become displayed, the stored back button M300 and the stored OK button M300 stored in the title area E300 are erased.

[0087] When the stored and displayed back button M300 and the stored and displayed confirm button M302 are displayed in the title area E300, according to the user's operation, a menu area E304 including the back button B300 and the confirm button B302, which are specific display elements, may be displayed in the client area E302. For example, assume that on the display unit 110, as in the screen display W306 of FIG. 11(a), the stored and displayed back button M300 and the stored and displayed confirm button M302 are in a state of being displayed in the title area E300. When a downward scroll operation in the direction opposite to the direction of the title area E300 is performed in this state, as shown in FIG. 11(b), the display control unit 102 displays a screen display W308 in which the menu area E304 is superimposed on the client area E302. Further, when a scroll operation is performed in the upward direction, which is the direction of the title area E300, in the state shown in FIG. 11(b), the display control unit 102 erases the area E304 and performs a display such as the screen display W306 of FIG. 11(a). By doing so, when the user wants to display the buttons included in the menu area, the user can immediately display the buttons included in the menu area by performing a scroll operation in the direction opposite to the direction of the title area E300. Note that when an operation of selecting the title area E300 is performed in the state of FIG. 11(a), the display control unit 102 may also display the menu area E304 superimposed on the client area E302.

[0088] Note that in this embodiment, as in the first embodiment, in the client area, it has been described that the specific display element takes either a display state or a non-display state. However, it may be in a partial display state as in the second embodiment. In this case, as in the second embodiment, when the buttons in the menu area are in a partial display state in the client area, the display control unit 102 displays a part of the buttons stored and displayed in the menu area in the title area.

[0089] According to this embodiment, even when a specific display element is included in an area that occupies a certain area, it is possible to make the user visually recognize the position and presence of the specific display element included in that area. Further, when a scroll operation is performed in a direction opposite to the direction of the title area, the area including the specific display element is immediately displayed, so that the display area can be effectively utilized.

[0090] [4. Fourth Embodiment] Next, the fourth embodiment will be described. The fourth embodiment is an embodiment in which, in addition to the operation of the third embodiment, when a display element other than the specific display element is selected by the user, a menu area is also displayed, and the display content and processing content in the menu area are changed. This embodiment replaces FIG. 9 of the third embodiment with FIG. 12. Note that the same functional parts and processes are denoted by the same reference numerals, and the description thereof will be omitted.

[0091] In this embodiment, it will be described that the menu area includes a button that is a specific display element. Further, when a display element other than the specific display element included in the client area is selected by the user, it will be described that the character string displayed on the button that is the specific display element and the process when the button is selected by the user are changed. In this way, in this embodiment, controlling to perform a display different from that of the original button or a process different from the process performed when the original button is selected when the button is selected is referred to as changing the role. By changing the role, a button that receives an instruction to execute a predetermined process for a button that is a specific display element can be displayed as a button that receives an instruction to execute another predetermined process.

[0092] [4.1 Flow of Processing] The flow of processing in this embodiment will be described with reference to FIG. 12. In step S304, when the button in the stored and displayed menu area is displayed in the title area, subsequently, the display control unit 102 determines whether a display element other than the specific display element included in the client area has been selected by the user (step S402).

[0093] When a display element other than the specific display element is selected by the user, subsequently, the display control unit 102 displays a menu area in the client area and changes the role of the buttons included in the menu area (step S402; Yes → step S404). At this time, the display control unit 102 changes the role of the buttons according to the display element selected by the user.

[0094] Regarding the correspondence regarding how to change the role of the buttons for the selected display element, it may be set in advance by the designer of the image forming apparatus 10 or the like.

[0095] Subsequently, when a button arranged in the menu area is selected, the control unit 100 executes processing corresponding to the selected button (step S406; Yes → step S408). Then, the display control unit 102 erases the menu area from the client area and returns the role of the buttons to the original role (step S410). Then, it returns to step S402.

[0096] In step S402, when the display element is not selected, the control unit 100 determines whether a scroll operation has been performed (step S402; No → step S412). When a scroll operation has been performed, the display control unit 102 scrolls and displays the client area according to the scroll operation (step S412; Yes → step S108).

[0097] When the buttons in the menu area are in a displayed state in the client area, the display control unit 102 erases the buttons in the stored and displayed menu area from the title area (step S306; Yes → step S308). In step S306, when the buttons in the menu area are not in a displayed state in the client area, it returns to step S412 (step S306; No → step S402).

[0098] In step S410, the roles of the buttons in the menu area are restored. Therefore, when the menu area is displayed by scrolling in the direction opposite to that of the title area, if the buttons in the menu area arranged in the client area are made visible, the original buttons will be displayed in the client area. Further, when a button included in the menu area is selected, the control unit 100 executes a process based on the role of the original button.

[0099] In this way, the user can execute different instructions for the buttons in the menu area displayed by selecting display elements other than the specific display element and the buttons in the menu area displayed by operations other than selecting display elements other than the specific display element.

[0100] [4.2 Operation Example] Next, with reference to FIG. 13, an operation example of the present embodiment will be described. FIG. 13(a) is a display example of the initial state of the setting screen of the image forming apparatus 10, FIG. 13(b) is a display example of a state in which the buttons in the stored and displayed menu area are displayed in the title area, and FIG. 13(c) is a display example when a display element other than the specific display element included in the client area is selected.

[0101] As shown in FIG. 13(a), on the display unit 110 of the image forming apparatus 10, a display including a title area E400 and a client area E402 is displayed as a screen display W400. In the title area E400, a character string "Administrator Mode", which is the title of the screen display W400, is displayed.

[0102] The client area E402 includes display elements such as buttons, and further includes a menu area E404. In the menu area E404, buttons B400 and B402, which are buttons that can be selected by the user, are arranged, and further, a character string "Basic Settings" is displayed as a subtitle. Note that in the client area, display elements that are not specific display elements (for example, a label or a button for setting the volume at the time of key touch, display element E406) are also displayed.

[0103] Here, the button B400 is a "Return" button for canceling the content set on the basic settings screen and returning to the original screen. Also, the button B402 is an "OK" button for confirming the content set on the basic settings screen and returning to the original screen.

[0104] FIG. 13(b) is an example display of a screen display W402 when the user scrolls the client area E402 in the direction of the title area E400. In the title area E400, as buttons of the stored display menu area E404, the stored display M400 of the button B400 and the stored display M402 of the button B402 are displayed.

[0105] Also, FIG. 13(c) shows an example display of a screen display W404 to be displayed when a display element E406 that is not a specific display element among the display elements in FIG. 13(b) is selected. As shown in FIG. 13(c), in the screen display W404, the menu area E404 is displayed so as to overlap the client area E402, and a pop-up area E408 based on the display element selected by the user is displayed so as to overlap the client area E402. At this time, the client area E402 is grayed out.

[0106] The menu area E404 includes the button B400 and the button B402, but the roles of the button B400 and the button B402 are changed. For example, the role of the button B400 is changed to a "Clear" button for canceling the operation performed by the user on the pop-up area E408. Also, the role of the button B402 is changed to an "OK" button for confirming the operation performed by the user on the pop-up area E408.

[0107] For example, in the example of FIG. 13(c), the pop-up area E408 for setting the key touch volume includes a "large" button for increasing the key touch volume and a "small" button for decreasing the key touch volume. The user sets the key touch volume by selecting the "large" button or the "small" button. After the key touch volume is set, if the "confirm" button B402 for confirming the key touch volume is selected, the set key touch volume is confirmed. If the "clear" button B400 is selected, the key touch volume is returned to the setting when the pop-up area E408 was displayed, regardless of the set key touch volume.

[0108] Furthermore, when the user selects either the "Clear" button B400 or the "Confirm" button B402, the display control unit 102 erases the menu area E404 and the pop-up area E408, and displays the buttons in the menu area stored and displayed in the title area E400. That is, the screen display W402 shown in FIG. 13(b) is restored.

[0109] In this way, buttons B400 and B402 were originally buttons for returning to the original screen from the basic settings screen, but when a display element in client area E402 is selected, they become buttons for confirming an operation on the pop-up area. In this way, the role of the buttons, which are specific display elements arranged in the menu area, is changed.

[0110] According to this embodiment, even if the menu area is not displayed from the client area, it is possible to display buttons and the like for inputting instructions related to a selected display element in the menu area when the user selects a display element. This makes it possible to effectively utilize the display area, and since the user does not need to perform an operation to display the menu area, it is expected that the operability for the user will be improved.

[0111] [5. Modifications] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and designs and the like within the scope not departing from the gist of the present invention are also included in the claims. Also, although the above-described embodiments have some parts described separately for convenience of explanation, it goes without saying that they may be executed in combination within the technically possible range.

[0112] Also, regarding the processing flow, even if it is other than the above description, the order of steps may be changed or some steps may be omitted within a non - contradictory range. Also, it goes without saying that the above - described embodiments can be executed in combination with each other.

[0113] Also, the programs operating in each device in the embodiment are programs (programs that function a computer) that control a CPU or the like so as to realize the functions of the above - described embodiments. And the information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) during its processing, and then stored in storage devices such as various ROMs, HDDs, and SSDs, and read by the CPU as needed for correction and writing.

[0114] Also, when distributing to the market, the program can be stored in a portable recording medium for distribution, or transferred to a server computer connected via a network such as the Internet. In this case, it goes without saying that the storage device of the server computer is also included in the present invention.

Explanation of Reference Numerals

[0115] 10 Image forming apparatus 100 Control unit 102 Display control unit 110 Display unit 120 Operation unit 130 Storage unit 132 Display control program 140 Image input unit 150 Image forming unit 160 Image processing unit 170 Communication Department

Claims

1. A detection unit that detects an operation; a display unit capable of displaying a screen including a scrollable first area and a scrollable second area; a display control unit that controls displaying a plurality of display elements in the first area and the second area; Equipped with The display control unit is As the display element in the first region, one or both of a first display element that is displayed only in the first region and a second display element that can be displayed in either the first region or the second region are displayed, when a scroll operation in a direction toward the second area is detected by the detection unit from a state in which both the first area and the second area are simultaneously displayed, a first display element or a second display element displayed in the first area is scrolled toward the second area; When the first display element is not displayed in the first area, it is not displayed in the second area; Even if a part of the second display element overlaps with the second region, the whole of the second display element continues to be displayed, and after the whole of the second display element is no longer displayed in the first region by a subsequent scroll operation, the second display element is fixedly displayed in the second region. Display device.

2. The display device according to claim 1 , wherein the second display element fixedly displayed in the second area is displayed smaller than the second display element displayed in the first area.

3. The display device according to claim 1 , wherein the first area and the second area are simultaneously displayed on the screen before and after the scroll operation.

4. The display device according to claim 1 , wherein the second display element is gradually made invisible from the first area in response to an upward scroll operation.

5. The display device according to any one of claims 1 to 4, wherein the display control unit, when a second display element is displayed in the second area and a scroll operation is performed in the downward direction, moves and displays the second display element in the first area.

6. The display device of any one of claims 1 to 5, wherein when a second display element is displayed in the second area, the display control unit displays the second display element at a position different from the position immediately before the selection operation when the detection unit detects an operation of selecting a display element other than the second display element.

7. 7. The display device according to claim 1, wherein when the display control unit displays the second display element in the second area, the display control unit changes the shape of the second display element relative to the shape in which the second display element is displayed in the first area and displays the second display element in the second area.

8. The display device according to claim 1 , wherein the second display element includes a touch-operable button.

9. The display device according to claim 1 , wherein the display control unit further displays a third display element that displays only the second area.

10. A computer having a detection unit for detecting an operation and a display unit capable of displaying a screen including a first area and a second area that can be scrolled, A program for executing a display control step of controlling display of a plurality of display elements in the first area and the second area, The display control step includes: As the display element in the first region, one or both of a first display element that is displayed only in the first region and a second display element that can be displayed in either the first region or the second region are displayed, when a scroll operation in a direction toward the second area is detected by the detection unit from a state in which both the first area and the second area are simultaneously displayed, a first display element or a second display element displayed in the first area is scrolled toward the second area; When the first display element is not displayed in the first area, it is not displayed in the second area; Even if a part of the second display element overlaps with the second region, the whole of the second display element continues to be displayed, and after the whole of the second display element is no longer displayed in the first region by a subsequent scroll operation, the second display element is fixedly displayed in the second region. program.

Images