IMAGE PROCESSING APPARATUS, CONTROL METHOD FOR IMAGE PROCESSING APPARATUS, AND PROGRAM

Abstract

To provide operability comfortable to a user in the case of switching two display modes having different screen configurations on the basis of a multi-touch operation.SOLUTION: A display is switched from a first display mode to a second display mode in accordance with a start of a pinch-out operation to a first display area for displaying a preview image, and display is switched from the second display mode to the second display mode according to the fact that a pinch-in operation to the first display area is ended and that display size of a preview image reaches a prescribed threshold.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an image processing apparatus, a control method for an image processing apparatus, and a program. [Background technology]

[0002] In recent years, in order to enable intuitive operation by users, information processing devices equipped with touch panels capable of detecting multi-touch operations are becoming common. Examples of multi-touch operations performed on such touch panels include pinching in and pinching out. Pinch-in is an operation in which an object displayed on the touch panel is pinched with two fingers, and this operation allows intuitive reduction of the object. Pinch-out is an operation in which two fingers are spread apart on an object displayed on the touch panel, and this operation allows intuitive enlargement of the object.

[0003] Patent Document 1 discloses that an image being enlarged and displayed on a display is reduced by a pinch-in operation, and the enlarged display is terminated when the display magnification of the image falls to a predetermined threshold value or less. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-190982 A Summary of the Invention [Problem to be solved by the invention]

[0005] Here, when an image is enlarged and displayed, the screen configuration may change from before the image is enlarged. For example, various operation buttons for the displayed image may be displayed before the image is enlarged, and the operation buttons may be hidden when the image is enlarged. In such a case, if a user keeps two fingers on the touch panel and continuously performs an operation such as spreading and narrowing the distance between the fingers, the image will be enlarged and reduced alternately. In this case, if the only condition for switching between displaying and hiding the operation buttons is whether the display size of the image exceeds a threshold value, a situation occurs in which two display states with different screen configurations are continuously switched. As a result, the screen may appear to the user to be flickering, and comfortable operability may not be provided.

[0006] An object of the present invention is to provide a user with comfortable operability when switching between two display modes with different screen configurations based on a multi-touch operation. [Means for solving the problem]

[0007] An image processing device comprising: a reception means for receiving a user operation; and a display control means for displaying an operation screen including a preview image and a function key for issuing an instruction to execute processing on image data corresponding to the preview image, wherein when the reception means receives an operation for enlarging the preview image, the display control means An operation screen is displayed that does not include the function keys and that includes the enlarged preview image and a predetermined button different from the function keys, and when the predetermined button is operated, the operation screen that includes the function keys is displayed. 13. An image processing device comprising: Effect of the Invention

[0008] According to the present invention, it is possible to provide a user with comfortable operability when switching between two display modes having different screen configurations based on a multi-touch operation. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of a hardware configuration of an image processing apparatus according to an embodiment of the present invention. [Diagram 2]FIG. 13 is a diagram showing an example of a screen displayed on a display of the image processing device. [Diagram 3] 13 is a flowchart showing a process for switching display of a preview screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and all of the combinations of features described in the embodiments are not necessarily essential to the solution of the invention.

[0011] Fig. 1 is a diagram showing an example of the hardware configuration of an image processing apparatus according to the present embodiment, in which an MFP (Multi Function Peripheral) is taken as an example of the image processing apparatus.

[0012] The MFP 101 includes a CPU 111 to a printer 122. The CPU 111, RAM 112, ROM 113, input unit 114, display control unit 115, external memory I / F 116, and communication I / F controller 117 are connected to a system bus 110. In addition, a touch panel 118, a display 119, and an external memory 120 are connected to the system bus 110. Each processing unit is configured to be able to exchange data with each other via the system bus 110. The CPU 111, RAM 112, and ROM 113 are abbreviations for Central Processing Unit, Random Access Memory, and Read Only Memory, respectively.

[0013] ROM 113 is a non-volatile memory, and image data, other data, various programs for operating CPU 111, and the like are stored in respective predetermined areas. RAM 112 is a volatile memory, and is used as a temporary storage area such as a main memory and a work area of ​​CPU 111. CPU 111 controls each unit of this MFP 101 using RAM 112 as a work memory according to a program stored in ROM 113, for example. Note that the program for operating CPU 111 may be stored in advance not only in ROM 113, but also in external memory (hard disk, etc.) 120.

[0014] Input unit 114 accepts a user operation, generates a control signal according to the operation, and supplies it to CPU 111. For example, input unit 114 accepts a user operation from a keyboard (not shown), a mouse (not shown), or touch panel 118 that function as an input device. Note that touch panel 118 is an input device that outputs coordinate information according to a position touched on an input unit configured in a planar manner, for example. CPU 111 controls each unit of this MFP 101 according to a program, based on a control signal generated and supplied by input unit 114 according to a user operation performed on the input device. This allows MFP 101 to perform an operation according to the user operation.

[0015] The display control unit 115 outputs a display signal for displaying an image on the display 119. For example, the CPU 111 supplies a display control signal generated according to a program to the display control unit 115. The display control unit 115 generates a display signal based on the display control signal and outputs the display signal to the display 119. For example, the display control unit 115 causes the display 119 to display a GUI screen constituting a GUI (Graphical User Interface) based on the display control signal generated by the CPU 111.

[0016] The touch panel 118 is configured integrally with the display 119 and functions as a touch panel display. For example, the manufacturer configures the touch panel 118 so that the light transmittance does not interfere with the display of the display 119, and attaches it to the upper layer of the display surface of the display 119. Then, the manufacturer associates input coordinates on the touch panel 118 with display coordinates on the display 119. This configures a GUI that allows the user to directly operate the screen displayed on the display 119. The touch panel 118 may be any of various touch panel types, such as a resistive film type, a capacitive type, an optical type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.

[0017] An external memory 120 such as a hard disk, a floppy disk, a CD, a DVD, a memory card, or the like can be attached to the external memory I / F 116. The external memory I / F 116 reads data from the attached external memory 120 and writes data to the external memory 120 under the control of the CPU 111.

[0018] A communication I / F controller 117 communicates with various networks 102, such as a LAN, the Internet, wired or wireless networks, under the control of the CPU 111. For example, image data generated by a scanner 121 can be transmitted to the outside via the network 102, and image data received from the outside via the network 102 can be printed by a printer 122. Various devices, such as PCs, other MFPs, printers, and servers, are connected to the network 102 so as to be able to communicate with the MFP 101.

[0019] The scanner 121 reads an image on a document and generates image data. The generated image data is stored in the RAM 112, the ROM 113, etc. The printer 122 prints out the image data on a recording medium based on a user instruction input via the input unit 114 or a command input from an external device via the communication I / F controller 117. The printer 122 also performs printing based on the image data generated by the scanner 121, thereby realizing a copy function.

[0020] The CPU 111 can identify, for example, the following gesture operations and states on the touch panel 118: A finger or pen (input indicator) touches the touch panel (hereinafter referred to as touch start); A state in which a finger or pen is in contact with the touch panel (hereinafter referred to as touch on); A finger or pen moves while still in contact with the touch panel (hereinafter referred to as touch move); A finger or pen that was in contact with the touch panel is removed (hereinafter referred to as touch end); A state in which nothing is touching the touch panel (hereinafter referred to as touch off), etc. These operations and the position coordinates of the finger or pen touching the touch panel are notified to the CPU 111 via the system bus 110, and the CPU 111 identifies operations performed on the touch panel based on the notified information. Regarding touch move, the direction of movement of the finger or pen moving on the touch panel can also be determined for each vertical component and horizontal component on the touch panel based on the change in the position coordinates. An operation of quickly moving from a touch start to a touch end on the touch panel is called a click. Also, a stroke is considered to have been drawn when a touch is started on the touch panel, followed by a certain amount of touch movement and then a touch end. The operation of drawing a stroke quickly is called a flick. A flick is an operation of touching a finger on a touch panel, moving the finger quickly for a certain distance, and then releasing the finger; in other words, an operation of quickly tracing the touch panel with a finger as if flicking it. When CPU 111 detects a touch-move of a predetermined distance or more at a predetermined speed or more and detects a touch end in that state, it determines that a flick has been performed. When a touch-move of a predetermined distance or more is detected and a touch-on is detected in that state, it determines that a drag has been performed.

[0021] Furthermore, the touch panel 118 supports multi-touch and can simultaneously detect multiple touch-on or touch-move positions. When touching the touch panel with two fingers or a stylus pen, the fingers may be moved in a manner that shortens or lengthens the distance between the two points in the direction of the line segment connecting the two points. The operation of the user bringing two fingers closer together or apart is called a "pinch operation" because it resembles the action of pinching or stretching an object with fingers. The operation of spreading the distance between two fingers on the touch panel is called a pinch out, and the operation of narrowing the distance between two fingers is called a pinch in.

[0022] Usually, a pinch operation is often performed using the thumb and index finger of a user. When one or both of the touch positions move from a state where two points are touched on at the same time, the CPU 111 determines that a pinch operation has started. The CPU 111 can also calculate the center point coordinates of the line segment connecting the two points being pinched and the distance between the two points. When the interval between the two touch positions widens, the CPU 111 determines that a pinch out operation has started. It may be determined that a pinch out operation has started when the interval between the two touch positions widens by a predetermined value or more stored in a storage area. When the finger or pen is removed from the touch panel 118 and the touch becomes one point or less, the CPU 111 detects this as a touch end and determines that the pinch out operation has ended. When the interval between the two touch positions narrows, the CPU 111 determines that a pinch in operation has started. It may be determined that a pinch in operation has started when the interval between the two touch positions narrows by a predetermined value or more stored in a storage area. When the finger or pen is removed from touch panel 118 and the touch becomes one point or less, CPU 111 detects this as a touch end and determines that the pinch-in operation has ended.

[0023] Next, a preview function of the MFP 101 will be described. In this embodiment, the preview function is a function for displaying image data stored in the RAM 112 or the external memory 120 on the display 119. The CPU 111 performs display control for displaying a preview screen including one or more pages on the display 119. That is, the CPU 111 generates image data in a format suitable for display on the display 119 from the stored image data. Hereinafter, image data in a format suitable for display on the display 119 is referred to as a preview image. Note that the image data stored in the external memory 120 may be composed of multiple pages, and in that case, a preview image is generated for each page. The preview function is not limited to a preview before printing by the printer 122, and can be applied to any purpose for checking the contents of the image data.

[0024] The MFP 101 can store image data in the RAM 112 or the external memory 120 by several methods. For example, the MFP 101 stores image data generated by reading an image on a document by the scanner 121. Alternatively, the MFP 101 stores image data received from an external device such as a PC connected to the network 102 via the communication I / F controller 117. Alternatively, the MFP 101 stores image data received from a portable storage medium (such as a USB memory or a memory card) attached to the external memory I / F 116. Alternatively, the MFP 101 may store image data in the external memory 120 by another storage method. Note that the stored image data may be data reflecting various settings including print settings for a document read by the scanner 121. Also, the image data displayed on the display 119 may include character information, may include image information such as a photograph or a graphic image, or may include both or other information. Also, the image data may be a sample image stored inside in advance.

[0025] 2 is a screen example showing a preview image displayed on display 119 of MFP 101. Preview screen 200 shown in Fig. 2(A) is a screen for displaying a preview image, and includes a preview display area 201, a navigation area 217, and a page control area 218.

[0026] Preview display area 201 is a display area for displaying preview image 202, and is an area capable of receiving gesture operations from the user. Note that in this embodiment, only one page of preview image is displayed in preview display area 201, but multiple pages may be displayed simultaneously. CPU 111 of MFP 101 can detect gesture operations on preview display area 201 and manipulate the display of preview image 202. The gesture operation includes the above-mentioned flick, drag, pinch in, and pinch out, but other operations may also be adopted as the gesture operation. Note that the area that accepts the gesture operation may include an area near the preview display area 201.

[0027] The preview image 202 is an image that has been reduced or enlarged to a size appropriate for display from stored image data, or may be an image created based on various settings, including print settings, for the image data.

[0028] The close button 203 is a button for closing the preview screen 200 and transitioning to another screen. When the user touches this button, the CPU 111 ends the preview function.

[0029] The transmission instruction button 204 is a button for instructing transmission of the displayed image data. When the user touches this button, the CPU 111 performs a process of transmitting the image data to an external device such as a PC connected to the network 102. Also, the preview screen 200 is closed and a transition is made to another screen. When no settings related to transmission (such as a transmission destination) have been made before transitioning to the preview screen 200, the CPU 111 makes the transmission instruction button 204 invisible. Also, the stop button (not shown) is a button for stopping the transmission process. When the user touches this button, the CPU 111 stops the transmission process, closes the preview screen 200, and makes a transition to another screen. When no settings related to transmission have been made before transitioning to the preview screen 200, the CPU 111 makes the stop button invisible. When the stop button is displayed, the close button 203 is made invisible.

[0030] The print instruction button 205 is a button for instructing printing of the displayed image data. When the user touches this button, the CPU 111 starts the print process by the printer 122, closes the preview screen 200, and transitions to another screen. The CPU 111 hides the print instruction button 205 if no settings related to printing (output paper size, number of copies, etc.) have been made.

[0031] Preview image enlargement button 206 is a button for enlarging and displaying preview image 202 displayed in preview display area 201. When the user touches this button, CPU 111 enlarges the size of preview image 202 and displays it in preview display area 201.

[0032] The page number display area 207 is a display area that indicates the total number of pages and the page number of the currently displayed preview image 202 when the image data is composed of multiple pages. When the displayed page is changed, the CPU 111 determines the page number of the preview image 202, and updates the display contents of the page number display area 207. In the example of Fig. 2(A), it is indicated that the total number of pages of the image data is 5, and the currently displayed page is the 3rd page.

[0033] Page back button 208 is a change button for issuing a page change instruction to change the displayed preview image 202 to the previous page when the image data consists of multiple pages. When the user touches this button, CPU 111 reads out the image data of the previous page and displays it in place of the currently displayed preview image 202. Alternatively, when multiple pages are displayed simultaneously in preview display area 201, the display content is updated so that preview image 202 corresponding to the previous page is positioned at the center of preview display area 201.

[0034] The page next button 209 is a change button for instructing a page change to the next page of the displayed preview image 202 when the image data consists of multiple pages. When the user touches this button, the CPU 111 reads out the image data of the next page and displays it in place of the currently displayed preview image 202. Alternatively, when multiple pages are simultaneously displayed in the preview display area 201 , the display contents are updated so that the preview image 202 corresponding to the next page is positioned at the center of the preview display area 201 .

[0035] The page delete button 210 is a button for deleting the page corresponding to the displayed preview image 202 from the image data. When the user touches this button, the CPU 111 displays a delete confirmation screen (not shown) on the preview screen 200 so as to superimpose it on the page, allowing the user to select whether or not to delete the page from the image data.

[0036] The file type display area 211 is an area that displays the file type associated with the displayed image data. If the format of the image data is PDF, the CPU 111 displays an image indicating PDF in the file type display area 211. If the format of the image data is JPEG, the CPU 111 displays an image indicating JPEG. If a file type is not associated with the image data, the CPU 111 makes the file type display area 211 non-displayable.

[0037] The file name display area 212 is an area that displays the file name associated with the displayed image data. If a file name is not associated with the image data, the CPU 111 makes the file name display area 212 non-displayable.

[0038] Navigation area 217 is an area where various buttons for issuing processing instructions for preview image 202 are displayed, including close button 203, send instruction button 204, and print instruction button 205. The buttons on navigation area 217 are associated with the display conditions of navigation area 217, and when navigation area 217 is hidden, close button 203, send instruction button 204, and print instruction button 205 are also hidden.

[0039] The page control area 218 is an area where various buttons for controlling the page of the preview image 202 displayed in the preview display area 201 are displayed. The page control area 218 displays a page number display area 207, a page back button 208, a page forward button 209, and a page delete button 210. The buttons and areas on the page control area 218 are associated with the display conditions of the page control area 218. When the page control area 218 is hidden, the page number display area 207, the page back button 208, the page forward button 209, and the page delete button 210 are also hidden.

[0040] Here, the enlargement control of preview image 202 by a user's pinch out operation will be described. In this embodiment, the user can enlarge preview image 202 by touching preview display area 201 with a finger or a pen and performing a pinch out operation. In addition, in response to the start of a pinch out operation, navigation area 217 and page control area 218 are hidden, and the range of preview display area 201 that occupies preview screen 200 is expanded.

[0041] When CPU 111 detects the start of a pinch out operation on preview display area 201, it changes the layout of preview screen 200 and performs processing to enlarge the display size of preview image 202. CPU 111 also identifies touch center coordinates of two or more touch positions, and arranges preview image 202 in preview display area 201 at a position enlarged based on the identified touch center coordinates.

[0042] Furthermore, in response to a pinch out operation, navigation area 217 and page control area 218 are hidden, whereby the display area that preview display area 201 occupies on preview screen 200 is expanded.

[0043] The navigation area 217 and the page control area 218 may be hidden at the same time as the enlargement process of the preview image 202, or may be hidden when a movement of a distance equal to or greater than a predetermined value is performed, which is separate from the judgment of a pinch-out operation that is pre-stored in the memory area.

[0044] Preview screen 200 in FIG. 2B is an example in which CPU 111 accepts a pinch out operation from the user and enlarges preview image 202 and expands preview display area 201. In this embodiment, FIG. 2A is called "normal display mode," and FIG. 2B is called "enlarged display mode." That is, normal display mode refers to a state in which preview display area 201, navigation area 217, and page control area 218 are displayed on preview screen 200. Moreover, enlarged display mode refers to a state in which navigation area 217 and page control area 218 are hidden on preview screen 200, preview display area 201 is expanded, and buttons 213 to 216 are displayed.

[0045] Preview image enlargement button 213 is a button for enlarging preview image 202 displayed in preview display area 201. It has the same role as preview image enlargement button 206 in that it enlarges preview image 202. The enlargement ratio may be different between preview image enlargement button 206 and preview image enlargement button 213. This allows preview image 202 to be enlarged and displayed at an optimal enlargement ratio for each display mode. In this embodiment, three levels of enlargement ratio are determined, and each time a touch of preview image enlargement button 213 is detected, preview image 202 with a display size in which the enlargement ratio is increased by one level is displayed in preview display area 201.

[0046] Preview image reduction button 214 is a button for reducing the size of preview image 202 displayed in preview display area 201. When the user touches this button, CPU 111 reduces the size of preview image 202 to a predetermined display size and displays it in preview display area 201.

[0047] Preview image movement buttons 215 are buttons for moving the display position of preview image 202 displayed in preview display area 201. When the user touches this button, CPU 111 shifts the display position of the image by a predetermined amount of movement and displays it in preview display area 201. The display area of ​​preview image 202 moves in the direction in which each button is pressed.

[0048] Close button 216 is a button for ending the enlarged display mode and changing the screen layout to that of the normal display mode. When the user touches this button, CPU 111 switches the display content from the enlarged display mode to the normal display mode.

[0049] Here, a description will be given of control for reducing the display of preview image 202 by a user's pinch-in operation. In this embodiment, the user can reduce the display of preview image 202 by touching preview display area 201 with a finger or a pen and performing a pinch-in operation.

[0050] When CPU 111 detects a pinch-in operation on preview display area 201, it changes the layout of preview screen 200 and performs processing to reduce the display size of preview image 202. CPU 111 also identifies touch center coordinates of two or more touch positions, and arranges preview image 202 in preview display area 201 at a position reduced based on the identified touch center coordinates.

[0051] Furthermore, when CPU 111 detects the touch end and determines that the pinch-in operation has ended, if the display size of preview screen 200 is equal to or smaller than a predetermined threshold, CPU 111 switches the display content from the enlarged display mode to the normal display mode, and makes each of buttons 213 to 216 invisible, and displays navigation area 217 and page control area 218.

[0052] The pinch out operation and the pinch in operation can be successively switched between the two operations while the fingers or the pen are still touching the touch panel 118. For example, when the user continuously widens and narrows the distance between the two fingers while keeping the two fingers touching the touch panel 118, the display size of the preview image 202 is alternately enlarged and reduced. At this time, if the only condition for switching between the enlarged display mode and the normal display mode is whether the display size of the preview image 202 exceeds 100%, the two display modes will be switched frequently. As a result, the screen will appear to the user to flicker due to the enlargement and reduction of the preview display area 201 and the display and non-display of the navigation area 217 and the page control area 218. Therefore, the present embodiment is characterized in that the condition for switching from the normal display mode to the enlarged display mode by the pinch operation is different from the condition for switching from the enlarged display mode to the normal display mode. Specifically, the start of the pinch out operation is the condition for switching from the normal display mode to the enlarged display mode. On the other hand, the condition for switching from the enlarged display mode to the normal display mode is whether or not the display size of the preview image 202 becomes equal to or smaller than a predetermined threshold value by a pinch-in operation, and also whether or not a touch end operation has been performed. For example, when the user starts a pinch-out operation in the normal display mode, the display mode is switched to the enlarged display mode even if the finger or pen is touching the touch panel 118. On the other hand, when the user starts a pinch-in operation in the enlarged display mode, the display mode is not switched to the normal display mode as long as the finger or pen is touching the touch panel 118 even if the display size of the preview image 202 becomes equal to or smaller than a predetermined threshold value, but is switched to when the finger or pen is removed. In this embodiment, if the display size of the preview image 202 in the normal display mode is set as a reference (100%), the display mode is switched to the normal display mode when the display size reaches 100% by a pinch-in operation and a touch end is detected. Next, a specific example of a method for changing the display position of the preview image 202 displayed in the preview display area 201 will be described. When a drag operation on the preview display area 201 is detected, the CPU 111 of the MFP 101 identifies the direction and amount of movement of the drag operation.The display position of the preview image 202 in the preview display area 201 is changed according to the direction and amount of drag. For example, in response to a drag operation that moves the touch position by a certain distance to the right, the display position of the preview image 202 in the preview display area 201 is moved to the right by the certain distance. In the enlarged display mode of FIG. 2B, a pinch-in operation is performed to reduce the preview image 202, and then a drag operation is performed to the right, resulting in a preview screen like that of FIG. 2C. Here, when a pinch-in operation is further performed and the enlarged display mode is switched to the normal display mode, the navigation area 217 and the page control area 218 are arranged at a position overlapping the preview image 202. Therefore, when it is determined that the pinch-in operation has ended and the layout is switched from the enlarged display mode to the normal display mode, the preview image 202 is moved and displayed at a position that does not overlap the navigation area 217 and the page control area 218. For example, the preview image 202 is arranged so that the center of the preview display area 201 in the normal display mode is at the center of the preview display area 201.

[0053] This prevents the preview image 202 from overlapping with the navigation area 217 or the page control area 218, preventing buttons from being pressed or contents from being confirmed, thereby providing the user with high operability.

[0054] Furthermore, the method of switching from the normal display mode to the enlarged display mode may be an operation other than a pinch out operation. For example, the CPU 111 may switch the display content from the normal display mode to the enlarged display mode when the user touches the preview image enlargement button 206. Alternatively, the CPU 111 may switch the display content from the normal display mode to the enlarged display mode when the user clicks on the preview image 202 or the preview display area 201 in the normal display mode.

[0055] Furthermore, the method of switching the display contents from the enlarged display mode to the normal display mode may be an operation other than a pinch out operation or touching the close button 216. For example, when the user touches the preview image reduction button 214, the CPU 111 may switch the layout from the enlarged display mode to the normal display mode if it determines that the display size of the preview image 202 is smaller than a predetermined display size. In this way, switching the mode by a plurality of means has the effect of improving user convenience.

[0056] Next, a series of processes for changing the display contents of preview screen 200 displayed on display 119 by a user operation will be described in detail with reference to the flowchart in Fig. 3. Each step in Fig. 3 is processed by CPU 111 of MFP 101 executing a program. The program to be executed is stored in a memory such as ROM 113 or external memory 120, and is expanded in RAM 112 and executed.

[0057] The CPU 111 accepts a user operation on the touch panel 118 (S301). Then, the CPU 111 determines whether or not the operation detected in S301 is a click operation (S302). If it is determined that the operation is a click operation, the process proceeds to S303. If it is determined that the operation is not a click operation, the process proceeds to S309.

[0058] In S303, CPU 111 determines whether or not the click operation is performed on preview image enlargement button 206. If it is determined that the click operation is performed on preview image enlargement button 206, the process proceeds to S306. If it is determined that the click operation is not performed on preview image enlargement button 206, the process proceeds to S304. Then, in S304, CPU 111 determines whether or not the click operation is performed on preview image 202. If it is determined that the click operation is performed on preview image 202, the process proceeds to S305. If it is determined that the click operation is not performed on preview image 202, the display change is not performed on preview image 202 and preview display area 201. In this case, a process different from the display change on preview image 202 and preview display area 201 is performed, but this process is not directly related to the present invention, so a description of this process will be omitted here.

[0059] In S305, CPU 111 determines whether the current display content of preview screen 200 is in normal display mode. Only in the normal display mode, by accepting a click operation on preview image 202, the display is switched to an enlarged display mode including a process of enlarging preview display area 201. If it is determined that the display mode is normal, the process proceeds to S306. If CPU 111 determines that the display mode is not normal display mode, the display of preview image 202 and preview display area 201 is not changed.

[0060] In S306, the CPU 111 enlarges the display size of the preview image 202. Then, CPU 111 expands preview display area 201 by hiding navigation area 217 and page control area 218 (S307). CPU 111 also changes the display position of preview image 202 so that the center of preview image 202 with the enlarged display size and the center of the area of ​​enlarged preview display area 201 are aligned (S308).

[0061] In S309, the CPU 111 determines whether or not the operation detected in S301 is a Touch-Move operation. If it is determined that the operation is a Touch-Move operation, the process proceeds to S310. If it is determined that the operation is not a Touch-Move operation, the process proceeds to S321.

[0062] In S310, CPU 111 determines whether or not the touch-move operation is a drag operation. If it is determined that the touch-move operation is a drag operation, the process proceeds to S311. If it is determined that the touch-move operation is not a drag operation, the process proceeds to S313. Then, in S311, CPU 111 determines whether or not the current display of preview screen 200 is in the enlarged display mode. Only in the enlarged display mode, the drag operation on preview image 202 is accepted, thereby performing a process of changing the display position of preview image 202. If it is determined that the enlarged display mode is in the enlarged display mode, the process proceeds to S312. If it is determined that the enlarged display mode is not in the enlarged display mode, CPU 111 does not perform a display change on preview image 202 and preview display area 201. Then, in S312, CPU 111 changes the display position of preview image 202 with respect to preview display area 201 according to the drag direction and the amount of movement.

[0063] In S313, the CPU 111 determines whether or not the Touch-Move operation is a pinch out operation. If it is determined that the Touch-Move operation is a pinch out operation, the process proceeds to S314. If it is determined that the Touch-Move operation is not a pinch out operation, the process proceeds to S318.

[0064] In S314, CPU 111 enlarges the display size of preview image 202, and places preview image 202 at the enlarged position based on the touch center coordinates (S315).

[0065] In S316, CPU 111 determines whether the current display of preview screen 200 is in normal display mode. If it is determined that it is in normal display mode, the process proceeds to S317. If it is determined that it is not in normal display mode, no display change is made to preview image 202 and preview display area 201. In S317, CPU 111 expands preview display area 201 by hiding navigation area 217 and page control area 218. That is, when a pinch out operation is started in normal display mode, the display is switched from normal display mode to enlarged display mode.

[0066] In S318, CPU 111 determines whether the touch-move operation is a pinch-in operation. If it is determined that the touch-move operation is a pinch-in operation, the process proceeds to S319. If it is determined that the touch-move operation is not a pinch-in operation, no display change is made to preview image 202 and preview display area 201. Then, in S319, CPU 111 reduces the display size of preview image 202, and places preview image 202 at a reduced position based on the touch center coordinates (S320).

[0067] In S321, the CPU 111 determines whether the operation detected in S301 is a touch-end operation. If it is determined that the operation is a touch-end operation, the process proceeds to S322. If it is determined that the operation is not a touch-end operation, the process is terminated as it is not a process for changing the display.

[0068] In S322, CPU 111 determines whether the display size of preview image 202 is below a predetermined threshold. When the accepted event is a touch end operation caused by a finger or pen being released from a pinch-in operation, and the display size of preview image 202 becomes equal to or smaller than the threshold, switching of the display content from the enlarged display mode to the normal display mode is executed. Here, assuming that the display size of preview image 202 displayed in the normal display mode is the reference (display magnification 100%), the condition for switching to the normal display mode is that the display magnification is reduced to 100% by pinching in. In this embodiment, the threshold is set to the same display size as that of preview image 202 displayed in the normal display mode. If CPU 111 determines that the display size of preview image 202 is below the predetermined threshold, the process proceeds to S323. If the display size of preview image 202 is not below the predetermined threshold, no process is performed.

[0069] In S323, CPU 111 makes some or all of buttons 213 to 216 invisible, displays navigation area 217 and page control area 218, and reduces preview display area 201. That is, CPU 111 switches the display content from the enlarged display mode to the normal display mode.

[0070] In S324, CPU 111 changes the display position of preview image 202 so that the center of preview image 202 and the center of the reduced preview display area 201 are aligned at the same position.

[0071] As described above, according to this embodiment, the condition for switching the display content of the preview screen 200 from the normal display mode to the enlarged display mode is different from the condition for switching the display content of the preview screen 200 from the enlarged display mode to the normal display mode.

[0072] Specifically, the condition for switching from normal display mode to enlarged display mode is the timing at which the start of a pinch out operation (starting to move fingers) is detected. On the other hand, the condition for switching from enlarged display mode to normal display mode is the timing at which the end of a pinch in operation (releasing fingers) is detected. When switching between the two different display contents of normal display mode and enlarged display mode in both directions, by setting discontinuous conditions of the start of a pinch out operation and the end of a pinch in operation, flickering does not occur, providing a comfortable operation.

[0073] Also, the conditions for switching between the normal display mode and the enlarged display mode may be reversed. That is, the condition for switching from the normal display mode to the enlarged display mode may be the timing at which the end of a pinch-out operation (the fingers are released) is detected. And the condition for switching from the enlarged display mode to the normal display mode may be only that the display size of the preview image 202 reaches a predetermined threshold, and not that the end of a pinch-in operation is detected.

[0074] Furthermore, according to this embodiment, in the enlarged display mode, only buttons related to operations on the preview image 202 and a button for exiting the enlarged display mode are displayed, so that unnecessary buttons are not displayed, resulting in increased convenience.

[0075] In addition, in the present embodiment, the navigation area 217 and the page control area 218 are described as being hidden in the enlarged display mode, but only one of them may be hidden. Also, in the enlarged display mode, the navigation area 217 and the page control area 218 may not be hidden, and the display area may be displayed in a reduced size.

[0076] According to the present embodiment, in the enlarged display mode, the preview image enlargement button 213 and the preview image reduction button 214 are displayed, but a different configuration may be used. For example, when the display content is switched from the normal display mode to the enlarged display mode by a pinch-out operation, the preview image enlargement button 213 and the preview image reduction button 214 may be hidden. In this case, the number of buttons to be displayed is reduced, which has the effect of preventing the user from getting confused about the operation and increasing convenience.

[0077] In the above description of the embodiment, an MFP is used as an example of an apparatus for implementing the present invention, but the apparatus for implementing the present invention is not limited to an MFP. In other words, the present invention is applicable to image processing apparatuses that can process at least image data, including image forming apparatuses such as printers, scanners, FAX machines, and digital cameras, and information processing apparatuses such as PCs and mobile information terminals, in addition to MFPs.

[0078] The present invention can also be realized by executing the following process. That is, software (computer program) that realizes the functions of the above-mentioned embodiments is supplied to a system or device via a network or various storage media. Then, the computer (or CPU, MPU, etc.) of the system or device reads and executes the program. In this case, the program and the storage medium on which the program is stored constitute the present invention. [Explanation of symbols]

[0079] 118 Touch Panel 119 Display

Claims

1. An image processing device, A receiving means for receiving a user operation; a display control means for displaying a preview image and an operation screen including function keys for issuing an instruction to execute processing on image data corresponding to the preview image; Equipped with when the reception means receives an operation for enlarging the preview image, the display control means displays an operation screen not including the function key and including the enlarged preview image and a predetermined button different from the function key; When the predetermined button is operated, an operation screen including the function keys is displayed.

13. An image processing device comprising:

2. The display control means displaying an operation screen including the preview image of a first display size and the function keys; when the reception means receives an operation for enlarging the preview image, displaying an operation screen that does not include the function key and includes the preview image enlarged to a size larger than the first display size and a predetermined button different from the function key; When the predetermined button is operated, an operation screen including a preview image of the first display size and the function keys is displayed.

2. The image processing device according to claim 1,

3. The operation for enlarging the preview image is an operation on a button for enlarging the preview image.

3. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing device.

4. A button for enlarging the preview image is displayed before and after the preview image is enlarged.

4. The image processing device according to claim 3.

5. The operation for enlarging the preview image is a pinch out operation.

3. The image processing device according to claim 1, wherein the first and second inputs are input to the image processing device.

6. when the reception means receives an operation for enlarging the preview image, the display control means displays an operation screen not including a display area including the function keys and including the enlarged preview image and the predetermined button; When the predetermined button is operated, an operation screen including a display area including the function keys is displayed.

6. The image processing device according to claim 1,

7. when the reception means receives an operation for enlarging the preview image, the display control means displays an operation screen that does not include a display area including the function keys and that does not include a display area in which control for a page of the preview image can be executed, and that includes the enlarged preview image and the predetermined button; When the predetermined button is operated, an operation screen including a display area including the function keys and a display area in which control over the page of the preview image can be executed is displayed.

2. The image processing device according to claim 1,

8. When the reception means receives an operation for enlarging the preview image, the display control means displays an operation screen including the function keys when the reception means receives an operation for reducing the preview image in a state in which the operation screen does not include the function keys and includes the enlarged preview image and the predetermined button.

8. The image processing device according to claim 1,

9. when the reception means receives an operation for enlarging the preview image, the display control means displays the operation screen not including the function key and including the enlarged preview image, the predetermined button, and a button for reducing the preview image; When the button for reducing the preview image is operated, an operation screen including the function keys is displayed.

9. The image processing device according to claim 1,

10. When the reception means receives an operation for enlarging the preview image, the display control means displays the operation screen that does not include the function key and includes the enlarged preview image, the predetermined button, and a button for changing the display position of the preview image.

10. The image processing apparatus according to claim 1, further comprising:

11. The process for the image data corresponding to the preview image is a print process.

11. The image processing device according to claim 1,

12. The process for the image data corresponding to the preview image is a transmission process.

11. The image processing device according to claim 1,

13. 13. The image processing apparatus according to claim 1, further comprising a reading unit for reading an image of an original to generate the image data.

14. 14. The image processing device according to claim 1, wherein while the function keys are hidden and the preview image is enlarged, a print instruction to print an image corresponding to the preview image is not accepted.

15. An image processing device, comprising: A receiving means for receiving a user operation; a display control means for displaying an operation screen including a first display area including a preview image and a second display area including function keys for issuing an instruction to execute processing on image data corresponding to the preview image; Equipped with when the reception means receives an operation for enlarging the preview image, the display control means displays an operation screen not including the second display area including the function keys, and including the enlarged preview image and a predetermined button different from the function keys; When the predetermined button is operated, an operation screen including the second display area including the function keys is displayed.

13. An image processing device comprising:

16. The display control means displaying an operation screen including the first display area including the preview image having a first display size and the second display area including the function keys; when the reception means receives an operation for enlarging the preview image, displaying an operation screen including the preview image not including the second display area including the function keys and enlarged to a size larger than the first display size, and a predetermined button different from the function keys; When the predetermined button is operated, an operation screen including the first display area including a preview image of the first display size and the second display area including the function keys is displayed.

16. The image processing device according to claim 15,

17. A control method executed by an image processing device, comprising: a receiving step of receiving a user operation; a display control step of displaying an operation screen including a preview image and function keys for issuing an instruction to execute processing on image data corresponding to the preview image; Equipped with the display control step, when the reception step receives an operation for enlarging the preview image, displays an operation screen that does not include the function key and includes the enlarged preview image and a predetermined button different from the function key; When the predetermined button is operated, an operation screen including the function keys is displayed. A control method comprising the steps of:

18. A control method executed by an image processing device, comprising: a receiving step of receiving a user operation; a display control step of displaying an operation screen including a first display area including a preview image and a second display area including function keys for issuing an instruction to execute processing on image data corresponding to the preview image; Equipped with When an operation for enlarging the preview image is accepted at the accepting step, the display control step displays an operation screen not including the second display area including the function keys, and including the enlarged preview image and a predetermined button different from the function keys; When the predetermined button is operated, an operation screen including the second display area including the function keys is displayed. A control method comprising the steps of:

19. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 16.

Images