Image processing apparatus, control method of image processing apparatus, and program

Abstract

To improve operability in making transition of an icon from a current page to another page by drag and drop.SOLUTION: A method includes: detecting whether any of ends of an icon has contacted a display frame of a page (S505) irrespective of a position of a finger or a pen for operation; and when a contact state continues for a predetermined period (S506), making transition of the page (S507). This enables smooth and intuitive movement of the icon to a subsequent page.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an image forming apparatus having a function of moving an icon to which a function relating to image formation is assigned between pages by a drag operation. [Background technology]

[0002] In a computer equipped with a touch panel, a function is known that allows a user to move content displayed on the screen to any page or position by a drag-and-drop operation using the user's finger. For example, in a smartphone, an application icon can be moved to any page by a drag-and-drop operation. Specifically, the application icon is selected with a finger by a drag operation and moved to the left or right edge of the screen, and when it is detected that the finger is in contact with the left or right edge area for a predetermined period of time or more, a page transition is performed. Then, by moving the icon after the page transition and then removing the finger from the screen, the icon can be moved to any position. Furthermore, Patent Document 1 discloses that in an electronic book, pages can be changed by a touch operation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-79315 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a page on which many application icons are arranged, such as the above-mentioned smartphone, when a user moves a specific icon from a current page to an arbitrary page, a drag-and-drop operation is an intuitive and easy-to-understand operation for the user. However, when a method used in a conventional smartphone is applied to a device with a large screen size, the amount of icon to be moved to the left and right ends of the screen by dragging becomes large. This places a burden on the user in terms of operation. In addition, for example, depending on the timing of the operation, there are cases where a finger cannot be detected at the left and right ends of the screen. In this case, the finger is recognized as being removed from the icon before the page is switched, and the icon returns to its original position on the original page. This causes a problem that the operation at the time of switching pages becomes complicated. This problem is not limited to application icons, but can occur commonly when content displayed on a screen is moved to a different page by a drag-and-drop operation. In view of the above problems, a main object of the present invention is to provide a user interface device that improves the convenience of a user when moving content to a different page. [Means for solving the problem]

[0005] The user interface device of the present invention comprises a display means for displaying a page on which content is arranged in an area surrounded by a display frame, an input means for accepting a movement operation by an input indicator on a first content arranged on the page, a display control means for switching the displayed page to another page based on the position of the first content being moved in accordance with the movement operation by the input indicator regardless of the position of the input indicator, and a placement means for placing the first content on the other page in accordance with the movement operation by the input indicator accepted by the input means after switching to the other page by the display control means. Effect of the Invention

[0006] According to the present invention, when moving content, the page is switched when any edge of the content touches the display frame regardless of the position of the input indicator, so that the content can be moved to another page intuitively, thereby improving the convenience for the user when moving between pages of content. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a hardware configuration diagram of an image forming apparatus according to a first embodiment of the present invention. [Diagram 2] 13(a) to (c) are diagrams showing examples of changes in the display screen. [Diagram 3] FIG. 4 is a diagram showing an example of a display screen. [Figure 4] 13(a) to (f) are diagrams showing examples of changes in the display screen. [Diagram 5] 4A and 4B are diagrams illustrating the operation procedure of the image forming apparatus. [Figure 6] FIG. 11 is a diagram showing an example of a display screen in the second embodiment. [Figure 7] FIG. 11 is a diagram illustrating a processing procedure according to the second embodiment. [Figure 8] FIG. 13 is a diagram illustrating a processing procedure according to a third embodiment. [Figure 9] FIG. 13 is an explanatory diagram of a processing procedure according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] First Embodiment An embodiment in which the user interface device of the present invention is applied to an image forming apparatus will be described below. Fig. 1 is a diagram showing the hardware configuration of an image forming apparatus according to a first embodiment of the present invention. The image forming apparatus 101 is configured by connecting various functional components to a system bus 110. The functional components include a computer having a basic configuration of a CPU 111, a RAM 112, and a ROM 113. The CPU (Central Processing Unit) 111 controls the overall operation of the image forming apparatus 101 by executing a control program of the present invention. In other words, the control program is for making the computer operate as the image forming apparatus 101. The RAM (Random Access Memory) 112 is a volatile rewritable storage medium, and functions as a work area for the CPU 111. The ROM (Read Only Memory) 113 is a non-rewritable storage medium, and stores a startup program for the CPU 111 and the like.

[0009] Also connected to the system bus 110 are an input unit 114, a display control unit 115, an external memory I / F (I / F is an abbreviation for interface; the same applies below), a printer I / F 117, a scanner I / F 118, and a communication I / F controller 119. The components 111 to 119 connected to the system bus 110 are configured to be able to exchange data with one another via the system bus 110.

[0010] The input unit 114, in cooperation with the CPU 111, functions as an input means for accepting operations such as dragging and moving with an input indicator on content arranged on a page displayed on the screen. The content is an image of a certain display size such as an icon to which a function related to image formation is assigned. The input indicator is the user's hand, finger, or electronic pen. When a user operation with the input indicator is accepted, the input unit 114 generates a control signal according to the operation content and supplies it to the CPU 111. The input unit 114 has a touch panel 120 as an input device that accepts user operations. The touch panel 120 is an input device that outputs coordinate information according to a position touched on an input unit configured, for example, as a plane. The CPU 111 controls each part of the image forming apparatus 101 according to a control program based on a control signal that is generated and supplied by the input unit 114 in response to a user operation performed on the input device. This allows the image forming apparatus 101 to perform an operation according to the user operation.

[0011] Display control unit 115 has a display 121, and functions as a display means for displaying a page on which content is arranged on a screen surrounded by a display frame in cooperation with CPU 111. Specifically, display control unit 115 outputs a display signal for displaying a page on which multiple contents are arranged to display 121. The display signal is generated based on a display control signal received from CPU 111, which CPU 111 generates in accordance with a control program. Display 121 displays a GUI screen constituting a GUI (Graphical User Interface) based on the display control signal.

[0012] The touch panel 120 is configured integrally with the display 121 and functions as a touch panel display. For example, the touch panel 120 is configured so that the light transmittance does not interfere with the display of the display 121, and is attached to the upper layer of the display surface of the display 121. Then, input coordinates on the touch panel 120 are associated with display coordinates on the display 121. This makes it possible to configure a GUI that makes it appear as if the user can directly operate the screen displayed on the display 121. The touch panel 120 may be of any type among various touch panels such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.

[0013] An external memory 122, such as a hard disk, a CD, a DVD, or a memory card, can be attached to the external memory I / F 116. Under the control of the CPU 111, data is read from the attached external memory 122 and data is written to the external memory 122. The above-mentioned control programs and the like are stored in the external memory 122, and are called by the RAM 112 and executed as appropriate.

[0014] A printer 123 is connected to the printer I / F 117. Under the control of the CPU 111, image data to be printed by the printer 123 is transferred to the printer 123 via the printer I / F 117, and the printer 123 prints out the image data on a recording medium. A scanner 124 is connected to the scanner I / F 118. Based on the control of the CPU 111, the scanner 124 reads an image on a document and generates image data. The generated image data is stored in the RAM 112, the ROM 113, and the external memory 122 via the scanner I / F 118. In addition, a copy function is realized by the printer 123 printing based on the image data generated by the scanner 124. A communication I / F controller 119 communicates with various networks 102, such as a LAN, the Internet, wired networks, wireless networks, etc., under the control of the CPU 111. For example, image data generated by a scanner 124 can be transmitted to the outside via the network 102, and image data received from the outside via the network 102 can be printed by a printer 123.

[0015] The CPU 111 detects the following operations and states on the touch panel 120. (i) Touch down: When a finger or pen (object) touches the touch panel. (ii) Move: Moving a finger or pen while it is still in contact with the touch panel. (iii) Touch on: The state in which a finger or pen is touching the touch panel. (iv) Touch-up: The state in which a finger or pen that was touching the touch panel is removed. (v) After detecting a touchdown within the area of ​​a software button displayed on the display 121, the finger or pen is moved outside the software button area while still touching the area.

[0016] The touch panel 120 is a touch panel capable of detecting multi-touch. That is, when touch-down, touch-on, move, touch-up, etc. are performed simultaneously with multiple fingers or pens, the operation and state can be detected. These operations and the position coordinates of the fingers or pens touching the touch panel 120 are notified to the CPU 111 via the system bus 110, and the CPU 111 determines what operation has been performed on the touch panel based on the notified information. For a move, the moving direction of the finger or pen moving on the touch panel 120 can also be determined for each vertical and horizontal component on the touch panel 120 based on the change in the position coordinates.

[0017] 2 and 3 are diagrams showing examples of changes in a screen displayed on a display 121 of the image forming apparatus 101. The image forming apparatus 101 optically reads a paper document and converts it into electronic data. It has a copy function for printing the image on another paper medium after image processing, and a send function for transmitting the read electronic data to another device via the network 102. It also has a box function for saving electronic data to an external memory 122, etc. It also has a web browser function for formatting and displaying content such as HTML acquired from an external server via the network 102. Application programs (abbreviated as AP) for realizing each of these functions are stored independently in the ROM 113 as different APs in the image forming apparatus 101. Then, the required AP is executed by the CPU 111 in response to an operation instruction from the user, and a screen is displayed on the display 121.

[0018] 2(a) shows a custom menu screen displayed on the display 121 under the control of the CPU 111. The custom menu stores the setting values ​​of the APs and displays button icons (for convenience, referred to as application buttons) corresponding to the AP functions, which are examples of content, on the screen. When the user presses a desired application button, the stored setting values ​​are reproduced and the AP corresponding to the application button is called. In FIG. 2(a), a display area 201, which is a screen surrounded by a display frame, displays a plurality of application buttons. Each of the application buttons displayed here is associated with an AP executable by the image forming apparatus and a setting value related to image formation set therein. When any of the application buttons displayed in the display area 201 is pressed, the screen switches to the AP screen associated with the application button. The setting value associated with the application button is also reflected. The application buttons displayed in the display area 201 can also be associated with user information authenticated by user authentication. A title and a comment can be set for each application button, and the setting content can be arbitrarily determined by the user who registered the application button.

[0019] For example, the copy button 202 is set with a title "Copy" and displays a comment such as "Double-sided, 2 copies." Each application button displays an AP name, an icon, a title related to a setting value, a comment, and the like associated with the application button. The copy button 202 is associated with a copy AP, and the setting values ​​associated with the button include a setting for printing on both sides and a setting value for setting the number of copies to 2. When the copy button 202 is selected by the user, the screen switches to the screen shown in FIG. 3, which will be described later.

[0020] My button 203 in FIG. 2(a) is an application button for displaying in display area 201 only application buttons associated with the currently authenticated user. Shared application button 204 is an icon (button image) for displaying in display area 201 only application buttons associated with all users, that is, available to all users. Page position display mark 205 is also displayed in display area 201. Page position display mark 205 shows each page as a schematic circle, indicating that multiple pages exist virtually lined up in the left-right direction. In the example of FIG. 2(a), it is shown that there are three pages of custom menus. It is also shown that the currently displayed screen is the first page virtually located at the far left.

[0021] In the display area 201, page switching buttons 206 and 207 are also displayed. The page switching button 206 is an icon for manually instructing a transition (page switching) to a page virtually arranged to the right of the currently displayed page. The page switching button 207 is an icon for instructing a transition to a page virtually arranged to the left. If there are no other pages in the direction in which the application button can be moved, the CPU 111 displays a message to that effect on the screen and disables the movement. In this case, the page switching buttons 206 and 207 are displayed in a grayed-out state. In the example of FIG. 2(a), since there are no pages to the left of the currently displayed page, the application button 207 is displayed in a grayed-out state and movement is disabled.

[0022] When the page switching button 206 is pressed on the screen of FIG. 2(a), the list of application buttons in the display area 201 scrolls to the left side of the screen (FIG. 2(b)), and transitions to the screen of FIG. 2(c). On the screen of FIG. 2(c), the page position display mark 205 moves to the middle of the three. This indicates that the second page of three pages is currently being displayed. The sort button 208 is an icon for enabling the movement of application buttons. When the sort button 208 is set to ON, the application button can be moved between pages by a drag-and-drop operation. That is, the application button on a certain page can be placed at any location on any page. In this example, the application button can be placed at any location on pages 1 to 3. When the sort button 208 is set to OFF, the drag-and-drop operation cannot be performed.

[0023] In this example, an example of drag-and-drop operation using the rearrangement application button 208 is described, but other examples are also possible. For example, pressing and holding the application button to be moved switches to a mode in which drag operation is possible, and the application button can be moved and arranged to any desired location. Therefore, it goes without saying that the present invention can be applied even to embodiments such as the other examples.

[0024] Fig. 3 shows an example of a copy AP setting screen that is displayed when the copy button 202 in Fig. 2(a) is selected. Here, the double-sided printing is set in the double-sided button 301. Also, the number of copies to print area 302 shows that the number of copies to print is set to 2.

[0025] Next, an example of a drag and drop operation will be described with reference to Fig. 4(a) to (f). The display screen in Fig. 4(a) shows a state in which the copy button 202 is moved by dragging 401 in a display frame 402. Here, an example will be described in which the page displayed on the screen is switched while maintaining the display state in which the copy button 202 is dragged. FIG. 4(a) shows the first page of the display screen. In this example, the copy button 202 being operated by dragging 401 is in contact with the display frame 402. The processing procedure at this time will be described later, but when the copy button 202 being operated by dragging 401 is in contact with the display frame 402, it transitions to the next page and becomes possible to drop. It is assumed that the next page is the page on the right of the screen. The coordinates 403 of the top left corner of the copy button 202 to be moved by dragging 401 are (x1, y1), and the width 404 is w1. The coordinates 405 of the top left corner of the display frame 402 are (x2, y2), and the width 406 is w2. In this case, when the value of x1+w1 exceeds w2+x2, it is determined that the copy button 202 is in contact with the display frame 402. Conversely, assume that the copy button 202 is moved to the left page. In this case, when the value of x1 falls below x2, it is determined that the copy button 202 is in contact with the display frame 402.

[0026] Fig. 4(b) shows the second page of the display screen. The touch shown in Fig. 4(a) moves the copy button 202 to the second page, and the drop 407 operation places the copy button 202 moved by drag 401 in an empty position. The order in which the copy button 202 is moved by the drop 407 operation is linked to the order in which the application buttons are placed when the custom menu screen is generated.

[0027] An example of linking the order in which copy button 202 moves to the order in which application buttons are arranged will be described with reference to FIG. 4(d) and FIG. 4(e). FIG. 4(d) shows the first page of the display screen in this example, and FIG. 4(e) shows the initial state of the second page of the display screen. These figures show an example in which application buttons are arranged in the order selected by the user when a custom menu screen is generated. In the illustrated example, the application buttons are arranged at positions 409 to 420. The display size of the application buttons can be set to S size, M size, or L size, but here, it is assumed that six application buttons can be arranged on one screen at M size. Note that in FIG. 4(e), 415, 418 to 420 are blank positions as indicated by the dashed lines in the figure, and no application buttons are arranged therein. When the arrangement of copy button 202 is changed, the arrangement of the other application buttons also changes. Then, as a result of the rearrangement, the custom menu updates the arrangement information anew.

[0028] Fig. 4(b) shows a state in which the copy button 202 originally located at position 411 in Fig. 4(d) has been moved to a blank position indicated as 419 on the second page in the initial state shown in Fig. 4(e). With this operation, the application buttons (including blank positions) located at positions 412 to 414 in Fig. 4(d) and 415 in Fig. 4(e) move to positions 411 to 414 in Fig. 4(d). Also, the application buttons (including blank positions) located at positions 416 to 419 in Fig. 4(e) move to positions 415 to 418 in Fig. 4(e) as shown in Fig. 4(b). Fig. 4(c) shows an example of a case where the copy button 202 is moved to the second page by the contact shown in Fig. 4(a), and then the drop 408 operation is performed at the position 416 where the mail button is located. In this case, the copy button 202, which was originally located at the position 411 in Fig. 4(d), is moved to the position 416 in Fig. 4(e), and therefore the application buttons (including blank spaces) located at the positions 412 to 414 in Fig. 4(d) and 415 in Fig. 4(e) are moved to the positions 411 to 414 in Fig. 4(d). Also, the mail button located at the position 416 in Fig. 4(e) is moved to the position 415 in Fig. 4(e) as shown in Fig. 4(c).

[0029] Note that, although an example has been described here in which, when an application button is moved, a plurality of other application buttons are rearranged so as to complement the position before the movement, other methods may be used. For example, as an application button is moved, its position may be swapped with other application buttons that were located at the destination of the movement. Specifically, when the copy button 202 located at position 411 is dragged and dropped at position 416, the mail button originally located at position 416 is rearranged to position 411. In this case, the placement of the other buttons does not change.

[0030] Also, if another application button is located at the destination, the other application button may be rearranged to complement the position before the movement, and if the destination is a blank position, the other application buttons may not be rearranged. Specifically, when copy button 202 located at position 411 is dragged and dropped at position 416, the application buttons located at positions 412 to 416 are rearranged to move to positions 411 to 415. On the other hand, when copy button 202 is dropped at the blank position 415, copy button 202 is placed at position 415, and the other application buttons are not rearranged. Therefore, position 411 becomes blank.

[0031] Also, when an application button is dragged, the positions where the button can be dropped may be displayed in color to make it easier to see where the button can be dropped. FIG. 4(f) is an example of displaying the positions where the button can be dropped in color. In this way, by displaying the server button 417 in a position where it overlaps with the copy button 202 being dragged in color, the user can easily recognize the positions where the application button being dragged can be placed. Note that when the copy button 202 being dragged is in the blank positions 415, 418 to 420, these blank positions may also be displayed in color.

[0032] Next, an example of a content operation method by image forming apparatus 101 will be described with reference to Fig. 5. Here, an example is shown in which the content to be operated is an icon. Figs. 5(a) and (b) are explanatory diagrams of the procedure of processing executed when the custom menu screen shown in Fig. 2 is displayed on display 121 in image forming apparatus 101. Each processing step is executed by CPU 111 executing a program stored in ROM 113 or external memory 122.

[0033] 5(a), the CPU 111 and the display control unit 115 display a list of icons included in the custom menu screen on the display 121 in response to a predetermined operation by the user (S501). The CPU 111 determines whether or not a touch-down is detected on a certain icon (first content, first icon) (S502). When a touch-down is detected on the first icon (S502: YES), the CPU 111 determines whether or not the icon rearrangement flag is enabled, that is, whether or not the flag is set (S503). When the rearrangement flag is set, the mode is switched to one in which the first icon can be moved by dragging 401 shown in FIG. 4(a). The icon rearrangement flag is set by the CPU 111 when the rearrangement application button 208 is set to ON. Conversely, when the rearrangement application button 208 is set to OFF, the CPU 111 turns off the icon rearrangement flag. It is also possible to configure the icon rearrangement flag to be set when a touch-down for a predetermined time or longer is detected on the first icon.

[0034] In S503, if the icon rearrangement flag is set for the first icon (S503: YES), CPU 111 moves the dragged first icon in accordance with the user operation (S504). If no touch-down is detected on the first icon in S502 (S502: NO), and if the icon rearrangement flag is not set in S503 (S503), the CPU 111 ends the process.

[0035] Thereafter, CPU 111 judges whether the first icon and the display frame are in contact with each other (S505). As described above, if the x coordinate of the left end of the first icon is x1, the width of the first icon is w1, the x coordinate of the left end of the display frame is x2, and the width of the display frame is w2, it is judged that the first icon and the display frame are in contact with each other if x1+w1≧w2+x2 or x1≦x2. If they are in contact with each other (S505: YES), CPU 111 judges whether the contact state continues for a predetermined time based on a threshold (time threshold) (S506). The time threshold is, for example, 0.1 to several seconds. If the contact time is less than the threshold, the process returns to S505 (S506: NO). If it is equal to or greater than the threshold (S506: YES), CPU 111 transitions the page (S507). Thereafter, CPU 111 executes the icon drop process (S508) and ends the process. In S505, if the first icon and the display frame are not in contact with each other (S505: NO), the icon drop process is immediately executed (S508), and the process ends.

[0036] FIG. 5(b) is a detailed procedure explanatory diagram of the icon drop process of S508 in FIG. 5(a). Referring to FIG. 5(b), CPU 111 judges whether or not the finger during dragging has been touched up (S509). If the finger during dragging has not been touched up (S509: NO), the process returns to S55. If the finger during dragging has been touched up (S509: YES), CPU 111 judges whether or not the first icon overlaps with another icon (second content, second icon) that is already displayed (S510). If the first icon overlaps with the second icon (S510: YES), CPU 111 determines whether or not to shift the position of the second content or to place the first content in a blank position according to the degree of the overlap. In this example, the second icon is shifted and the first icon is placed (S511), and the process ends. Whether or not the first icon and the second icon overlap is judged based on the degree of overlap between the area of ​​the first icon and the area of ​​the second icon. If the overlap is equal to or greater than a predetermined threshold, it is determined that there is overlap. In this embodiment and the following description, the overlap threshold is set to 60%. In S510, if the first icon does not overlap the second icon (S510: NO), CPU 111 places the first icon in a blank position (S512) and ends the process.

[0037] In this way, according to the image forming apparatus 101, when an icon is transitioned to the next page, it is determined whether any edge of the icon is in contact with the display frame, regardless of the position of the user's finger. Therefore, unlike the conventional method, it is not necessary to provide a UI operation area in the direction of the icon movement, and it is also possible to avoid the finger being erroneously recognized as having left the icon even though it is being dragged. Therefore, a more intuitive operating environment can be provided, improving user convenience. In the first embodiment, the drag-and-drop operation when listing icons included in a custom menu screen is described as an example. However, the present invention is not limited to an example in which a list of multiple icons is displayed, and it goes without saying that the present invention can be applied to the movement operation of various contents that can be displayed on the screen.

[0038] <Second embodiment> Next, a second embodiment will be described. The configuration of the image processing device 101 is the same as that of the first embodiment. In the following description, the same elements as those of the first embodiment are given the same reference numerals. In the first embodiment, a simple example was described in which it was determined whether an icon and a display frame are in contact when the icon is to be transitioned to the next page. In the second embodiment, the display size of the first icon is detected (including the case where it is obtained in advance), and the threshold for determining that the first icon has contacted the display frame is changed according to the display size of the first icon. The threshold in this embodiment is not a time threshold, but a threshold for determining whether or not the page is transitioned if the first icon protrudes from the display frame. The method for setting and changing the threshold is to map the threshold and a predetermined display size (for example, S, M, L display size) used in the AP. Therefore, when a touchdown of the first icon is detected, it is possible to change the threshold for determining that contact has occurred according to the display size.

[0039] Thereafter, while dragging the first icon, it is determined whether the first icon is in contact with the display frame based on a threshold determined according to the display size of the first icon. For example, when it is desired to move the application button to a page existing to the right of the display frame, if the size is M and the threshold is M1, it is determined that the application button is in contact with the display frame 402 when the value of x1+w1-M1 exceeds w2+x2. Conversely, when it is desired to move the application button to a page existing to the left of the display frame, it is determined that the application button is in contact with the display frame 402 when the value of x1+M1 falls below x2. Here, it is assumed that the larger the display size of the icon, the larger the threshold value is set. As a result, when the icon is small in size, if the icon overlaps the display frame even a little, a page transition is performed, and when the icon is large in size, it is possible to control so that a page transition is not performed even if the icon overlaps the display frame only a little. Hereinafter, the second embodiment will be described, focusing on the difference from the first embodiment.

[0040] Fig. 6 is an explanatory diagram of a display screen in the second embodiment. The same elements as those shown in Fig. 2 are given the same reference numerals. The display size of the icon of the copy button 202 in Fig. 2(a) is medium size, but the copy button 601 in Fig. 6 is small size. Fig. 7 is an explanatory diagram of the processing procedure of the image forming apparatus 101 in the second embodiment, and corresponds to Fig. 5(a) in the first embodiment. The same processing steps as in Fig. 5(a) are indicated with the same reference numerals. As in the first embodiment, the icon drop processing of S508 in Fig. 7 is shown in Fig. 5(b). The following describes the parts that differ from Fig. 5(a). 7 are realized by the CPU 111 executing a program stored in the ROM 113 of the image forming apparatus 101 or the external memory 122, similarly to FIG. 5(a).

[0041] After the custom menu is displayed, the first icon is selected, and the process up to the determination of whether the icon rearrangement flag is set (S501 to S503) is the same as in the first embodiment (FIG. 5(a)). In the second embodiment, if the icon rearrangement flag is set for the first icon (S503: YES), CPU 111 detects (obtains) the display size of the first icon (S701). Then, a threshold value for determining that the first icon and the display frame are in contact with each other is set (S702). Thereafter, the first icon is moved (S504).

[0042] CPU 111 determines whether the moving first icon and the display frame are in contact with each other based on a set threshold (S703). If CPU 111 determines that they are in contact, it determines whether the contact state has continued for a predetermined time based on the threshold (S704). If it is equal to or greater than the threshold (S704: YES), CPU 111 proceeds to the process of S507 and subsequent steps described above. If it is less than the threshold (S704: NO), CPU 111 proceeds to the process of S703 described above.

[0043] According to the second embodiment, when the display size of the icon is different, the threshold value for determining that the icon and the display frame are in contact is also changed. Therefore, it is possible to prevent erroneous operations due to page transitions when the user does not recognize the contact between the icon and the display frame, and more intuitive operations are possible.

[0044] <Third embodiment> Next, a third embodiment will be described. The configuration of the image processing device 101 is the same as that of the first embodiment. In the following, the same elements as those of the first embodiment will be described with the same reference numerals. In the third embodiment, when an icon is in contact with a display frame, the icon stops moving (stands still) and the contact continues for a predetermined time, causing a page transition. The third embodiment will be described below, focusing on the differences from the first embodiment.

[0045] FIG. 8 is an explanatory diagram of the processing procedure of the image forming apparatus 101 in the third embodiment, and corresponds to FIG. 5(a) of the first embodiment. The same processing steps as those in FIG. 5(a) are indicated with the same numbers. As in the first embodiment, the icon drop processing of S508 in FIG. 8 is shown in FIG. 5(b). The following description will focus on the parts that differ from FIG. 5(a). Note that, as in FIG. 5(a), each processing step in FIG. 8 is realized by the CPU 111 executing a program stored in the ROM 113 or external memory 122 of the image forming apparatus 101.

[0046] After the custom menu is displayed, the process is the same as in the first embodiment until it is determined whether or not the first icon is in contact with the display frame (S501 to S505). In the third embodiment, if the first icon is in contact with the display frame (S505: YES), it is determined whether the first icon is stationary (S801). The first icon being stationary means that no pixel movement of a predetermined number of pixels is detected within a predetermined time for determining stationary state. If the first icon is stationary (S801: YES), CPU 111 proceeds to the process of S506 described above. If the first icon is not stationary (S801: NO), CPU 111 returns to S505. In this way, according to the third embodiment, a page transition is not possible unless the first icon is stationary. In other words, a page transition does not occur unless the user confirms that a page transition is to occur. Therefore, it is possible to avoid a situation in which a page transition occurs due to an erroneous operation or an unintended operation during dragging, and it is possible to improve user convenience.

[0047] <Fourth embodiment> Next, a fourth embodiment will be described. The configuration of the image processing device 101 is the same as that of the first embodiment. In the following, the same elements as those in the first embodiment will be described with the same reference numerals. In the fourth embodiment, after it is detected that an icon is touched for a predetermined period of time, a page transition is performed when the icon is moved in the direction in which a page exists. The fourth embodiment will be described below, focusing on the differences from the first embodiment.

[0048] FIG. 9 is an explanatory diagram of the processing procedure of the image forming apparatus 101 in the fourth embodiment, and corresponds to FIG. 5(a) of the first embodiment. The same processing steps as those in FIG. 5(a) are given the same reference numerals. As in the first embodiment, the icon drop processing of S508 in FIG. 9 is shown in FIG. 5(b). The following description will focus on the parts that differ from FIG. 5(a). Note that, as in FIG. 5(a), each processing step in FIG. 9 is realized by the CPU 111 executing a control program stored in the ROM 113 or external memory 122 of the image forming apparatus 101.

[0049] After the custom menu is displayed, the process is the same as in the first embodiment until it is determined whether the first icon and the display frame have come into contact and the time of contact has exceeded a predetermined time (S501 to S506). In the fourth embodiment, when the first icon and the display frame are in contact for a predetermined period of time (S506: YES), CPU 111 judges whether or not movement by dragging in the direction in which another page exists has been detected (S901). When movement is detected (S901: YES), CPU 111 proceeds to S507 described above. When movement is not detected (S901: NO), CPU 111 returns to S506. (S901) According to the fourth embodiment, when a page transition occurs, a user must perform a dragging operation to move the page. Therefore, the user can move the page in the direction he or she desires, which improves the convenience of the page.

[0050] <Other embodiments> Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. In addition, parts of the above-mentioned embodiments may be appropriately combined. Furthermore, the content that can be scrolled and dragged and dropped on the display 121 is not limited to the information of the application button on the custom menu screen. The present invention can be applied to the display of any other data as long as it can be scrolled and dragged and dropped. The present invention can also be applied to display items other than application buttons, as long as the display items are contents that execute processing associated with the display items when pressed by a user. The present invention can also be applied to contents that scroll in any direction, such as contents that scroll up, down, diagonally, etc., in addition to contents that scroll left and right.

[0051] In the above embodiment, the image forming device 101 having multiple functions such as a copy function and a scanner function has been described as an example, but the present invention can also be applied to an image processing device having only some of these functions. The present invention may also be applied to other image forming devices such as personal computers, PDAs, mobile phones, FAX machines, cameras, video cameras, and other image viewers.

Claims

[Claim 1] a display means for displaying a page in which content is arranged in an area surrounded by a display frame; an input unit that receives a movement operation by an input indicator with respect to a first content arranged on the page; a display control means for switching a displayed page to another page based on a position of the first content being moved in accordance with a movement operation of the input indicator, regardless of a position of the input indicator; and a placement means for placing the first content on the other page in accordance with a movement operation by the input indicator received by the input means after the display control means has switched to the other page. A user interface device.

Images