Input device, input method, and image forming apparatus

Abstract

To provide an image formation device which can facilitate second and subsequent linear contact operations.SOLUTION: An image formation device 10 that receives an input through a contact operation of an operator, comprises: a general control unit 141 and a touch part 130a that detect a contact operation of the operator in a first detection region; a locus determination unit 143 that determines whether or not the detected contact operation indicates an operation of drawing a linear locus; and a detection control unit 144 that controls the general control unit 141 and the touch part 130a so as to detect the next contact operation in a second detection region wider than the first detection region when it is determined that an operation of drawing a linear locus is indicated.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] This disclosure relates to a technique for receiving input by an operator's contact operation.

Background Art

[0002] Conventionally, in a multi-function peripheral (MFP) having functions such as a scanner, a printer, a copier, etc., for example, an operator may give an instruction to the MFP by moving a finger so as to draw a linear trajectory while maintaining the state of touching the touch panel with the finger.

[0003] For example, when setting various print conditions for the MFP before executing printing, a setting screen on which a large number of setting items are displayed as a list is opened, one setting item is selected from the plurality of displayed setting items, and the condition is set. Since there are many setting items, there are also setting items that cannot be completely displayed on one screen. In order to display (scroll) the non-displayed setting items, a long scroll bar is displayed on the setting screen together with the plurality of setting items, and an elevator is displayed in the scroll bar. The operator moves the finger along the direction of the scroll bar so as to draw a linear trajectory while maintaining the state of touching the elevator in the scroll bar, thereby erasing some of the displayed items on the screen and newly displaying the non-displayed setting items on the screen.

[0004] Here, an operation of moving a finger in a specific direction while touching the touch panel with one finger is called a swipe.

[0005] Furthermore, touch gestures such as pinch-in and pinch-out are used to zoom in or out, for example, on a touch panel screen. Pinch-in refers to the action of bringing two fingers closer together while they are in contact with the touch panel, drawing a linear path with each finger. Pinch-out refers to the action of separating two fingers while they are in contact with the touch panel, drawing a linear path with each finger.

[0006] Patent Document 1 discloses an input device that receives input from an operator by detecting the touched position. The display screen of the input device has a matrix of multiple icons X, Y, Z, .... Each of the multiple icons X, Y, Z, .... corresponds to a predetermined function X, function Y, function Z, .... When a touch operation is performed on icon Y, the selection operation for icon Y is provisionally confirmed, and the control unit of the input device expands the detection area of ​​icon Y to what it was before the touch operation in order to finalize the selection of icon Y.

[0007] In this way, when you touch an icon, an expanded detection area is created around that icon, and the next touch is made easier by allowing you to touch the expanded detection area. [Prior art documents] [Patent Documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2018-132937 [Overview of the project] [Problems that the invention aims to solve]

[0009] Here, as mentioned above, when applying the technology disclosed in Patent Document 1 to the case of scrolling through items in a list displayed with a scroll bar, the result is as follows.

[0010] When the user touches an elevator within the scroll bar, an expanded detection area is created around that elevator. This makes it easier to perform the next touch operation on the elevator. However, expanding the detection area of ​​the elevator does not contribute to improving the usability of moving the elevator within the scroll bar. For example, if the user's finger moves outside the scroll bar while moving the elevator, the elevator cannot be moved along the scroll bar. As a result, there is a problem in that the user cannot scroll as desired.

[0011] Furthermore, as mentioned above, in cases where pinch-in or pinch-out touch operations are used to reduce or increase the size of the preview image displayed on the touch panel screen, icons like those described in Patent Document 1 are not displayed within the preview image. Therefore, when the operator touches the screen with their finger, the detection area for the icons is not expanded. In other words, the technology disclosed in Patent Document 1 cannot be applied to this case.

[0012] One aspect of this disclosure aims to provide an input device, an input method, and an image forming apparatus that facilitate subsequent linear contact operations. [Means for solving the problem]

[0013] One aspect of the present disclosure is an input device that receives input by an operator's touch operation, comprising: detection means for detecting the operator's touch operation within a first detection area; trajectory determination means for determining whether the detected touch operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next touch operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and display means having a screen. If it is determined that the operation is drawing a linear trajectory, a display control means controls the display means to switch the content displayed on the screen in accordance with that operation.The system is configured such that, when the screen is one in which the preview image is located in the center of the background image, the first detection region coincides with the region of the preview image, and the second detection region coincides with the region of the background image. Furthermore, when the detection means detects a pinch-in or pinch-out as the first contact operation, the display control means causes the display control means to reduce or enlarge the preview image on the screen according to the pinch-in or pinch-out operation, whether the pinch-in or pinch-out operation is performed within the area of ​​the background image including the preview image, or whether it is performed within or outside the area of ​​the preview image. It is characterized by the following:

[0014] Here, further ,line If it is determined that the action is drawing a trajectory, the display control means controls the display means to switch the content displayed on the screen in accordance with that action. Step It would be wise to prepare.

[0018] Here, the trajectory determination means further determines whether the next detected contact operation indicates an action that traces a linear trajectory, and if it is determined that the action indicates an action that traces a linear trajectory, it further includes a matching determination means that determines whether the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation are the same or similar, and the display control means may further control the display means to switch the content displayed on the screen according to the action corresponding to the next detected contact operation if they are the same or similar.

[0019] Here, the matching determination means may make the determination by comparing the linear trajectory corresponding to the first detected contact operation with the linear trajectory corresponding to the next detected contact operation.

[0020] Another aspect of the present disclosure is an input device that receives input by an operator's touch operation, comprising: detection means for detecting an operator's touch operation within a first detection area; trajectory determination means for determining whether the detected touch operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next touch operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; display means having a screen; and display control means for controlling the display means to switch the content displayed on the screen in accordance with the action, if it is determined that the action represents a linear trajectory. The means further includes a matching determination means for determining whether the next detected contact operation indicates an action that traces a linear trajectory, and if it is determined that it indicates an action that traces a linear trajectory, for determining whether the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation are the same or similar, and the display control means further controls the display means to switch the content displayed on the screen according to the action corresponding to the next detected contact operation if they are the same or similar, and the matching determination means makes the determination by comparing the linear trajectory corresponding to the first detected contact operation and the linear trajectory corresponding to the next detected contact operation. The display control means further controls the display means to switch the content displayed on the screen according to the length of the linear trajectory corresponding to the next detected contact operation, based on the length of the linear trajectory corresponding to the first detected contact operation. Characterized by .

[0021] Here, the trajectory determination means further determines the number of fingers of the operator used in the detected contact operation, and the coincidence determination means further determines that when the number of fingers of the operator used in the first detected contact operation is different from the number of fingers of the operator used in the next detected contact operation, the operation corresponding to the first detected contact operation and the operation corresponding to the next detected contact operation do not coincide or are not similar.

[0022] Here, the trajectory determination means further determines whether the next detected contact operation indicates an operation of drawing a point, and the display control means further controls the display means to switch the content displayed on the screen according to the operation when it is determined that the operation indicates drawing a point.

[0023] Here, it may further include a release means for returning the detection area used by the detection means from the second detection area to the first detection area.

[0024] A further aspect of the present disclosure is an input device that receives input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and release means for returning the detection area used by the detection means from the second detection area to the first detection area. A coincidence determination means for determining whether the operation corresponding to the first detected contact operation and the operation corresponding to the next detected contact operation coincide or are similar and, is provided, and when the coincidence determination means determines that the linear trajectory corresponding to the first detected contact operation and the linear trajectory corresponding to the next detected contact operation do not coincide or are not similar, the release means returns to the first detection area so .

[0025] Here, the release means may return to the first detection area when a predetermined time has elapsed since the first contact operation was detected and no next contact operation is detected.

[0026] A further aspect of the present disclosure is an input device that receives input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and release means for returning the detection area used by the detection means from the second detection area to the first detection area. Release reception means for receiving an operation to return to the first detection area from the operator and, is provided, and when the release reception means receives an operation to return to the first detection area, the release means returns to the first detection area so .

[0027] If the detection means detects an operator's contact operation in an area outside the second detection area, the release means may be returned to the first detection area.

[0028] A further aspect of the present disclosure is an input device that receives input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and release means for returning the detection area used by the detection means from the second detection area to the first detection area. Voice input means that accepts the operator's voice. and, Equipped with, When the voice input means receives voice input, the release means returns to the first detection area. so .

[0029] Here, further, the area is wider than the first detection area. including the first detection region The second detection area may be provided with notification means for notifying the operator that the next contact operation is being detected.

[0030] A further aspect of the present disclosure is an input device for receiving input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and notification means for notifying the operator that the next contact operation is being detected in the second detection area that is wider than the first detection area and includes the first detection area. Display means having a screen and, The notification means controls the display means to display on the screen that detection is in progress in the second detection area. Characterized by .

[0031] A further aspect of the present disclosure is an input device for receiving input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and notification means for notifying the operator that the next contact operation is being detected in the second detection area that is wider than the first detection area and includes the first detection area. Display means having a screen and, The system includes such a feature, wherein the largest detection area detectable by the detection means coincides with the display area of ​​the screen, the second detection area is set within the largest detection area, and the notification means controls the display means to highlight the second detection area or an area outside the second detection area and display it on the screen. Characterized by .

[0032] A further aspect of the present disclosure is an input device for receiving input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and notification means for notifying the operator that the next contact operation is being detected in the second detection area that is wider than the first detection area and includes the first detection area. Audio output means for outputting sound and, The notification means controls the voice output means to notify by voice that detection is in progress in the second detection area. Characterized by .

[0033] A further aspect of the present disclosure is an input device for receiving input by an operator's contact operation, comprising: detection means for detecting the operator's contact operation within a first detection area; trajectory determination means for determining whether the detected contact operation represents an action that traces a linear trajectory; detection control means for controlling the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action represents a linear trajectory; and notification means for notifying the operator that the next contact operation is being detected in the second detection area that is wider than the first detection area and includes the first detection area. Vibrating means having a vibration function and,The notification means controls the vibration means to notify by vibration that detection is in progress in the second detection area. Characterized by .

[0034] Another aspect of the present disclosure is an input method used in an input device that receives input by an operator's touch operation, comprising: a detection step of detecting an operator's touch operation within a first detection area; a trajectory determination step of determining whether the detected touch operation indicates an action that traces a linear trajectory; and a detection control step of controlling the detection step to detect the next touch operation in a second detection area that is wider than the first detection area and includes the first detection area, if it is determined that the action traces a linear trajectory, the input device comprises a display means having a screen, and when the screen is a screen in which a preview image is located in the center of a background image, the first detection area coincides with the area of ​​the preview image, and the second detection area coincides with the area of ​​the background image. Furthermore, if a pinch-in or pinch-out is detected as the first contact operation by the detection step, if the next contact operation, a pinch-in or pinch-out, is performed within the area of ​​the background image including the preview image, then the preview image on the screen will be displayed in a reduced or enlarged manner according to the pinch-in or pinch-out, regardless of whether the pinch-in or pinch-out is performed within or outside the area of ​​the preview image. It is characterized by the following:

[0035] Another aspect of this disclosure is an image forming apparatus characterized by comprising the above-described input device. [Effects of the Invention]

[0036] According to this embodiment, when it is determined that the operation is drawing a linear trajectory, the next contact operation is detected in a second detection area which is wider than the first detection area, thus making it easier to perform subsequent linear contact operations. [Brief explanation of the drawing]

[0037] [Figure 1] (a) A schematic diagram of the image forming apparatus 10. (b) A block diagram showing the configuration of the control circuit 100. [Figure 2](a) A cross-sectional view of the touch panel 130 is shown. (b) A diagrammatic representation of the detection signal 201 output from the touch section 130a when contact is made at one point. (c) A diagrammatic representation of the detection signals 210-214 output from the touch section 130a when contact is made with one line (swipe). (d) A diagrammatic representation of the detection signals 220-224 and 225-229 output from the touch section 130a when contact is made with two lines (pinch-in). (e) A diagrammatic representation of the detection signals 240-244 and 245-249 output from the touch section 130a when contact is made with two lines (pinch-out). [Figure 3] (a) Shows the detection signal 271 output from the touch unit 130a when contact is made at one point. (b) Shows the aggregate of detection signals 272 output from the touch unit 130a when contact is made with one line (swipe). (c) Shows the aggregate of detection signals 273 output from the touch unit 130a when contact is made with two lines (pinch-in). (d) Shows the aggregate of detection signals 274 output from the touch unit 130a when contact is made with two lines (pinch-out). [Figure 4] (a) and (b) show frame images 301 and 302 displayed on the display unit 130b. [Figure 5] This shows the frame image 303 displayed on the display unit 130b. [Figure 6] (a) to (c) show frame images 304, 305, and 306 displayed on the display unit 130b. [Figure 7] (a) to (c) show frame images 307, 308, and 309 displayed on the display unit 130b. [Figure 8] (a) and (b) show frame images 310 and 311 displayed on the display unit 130b. [Figure 9] This shows the frame image 312 displayed on the display unit 130b. [Figure 10] This shows the frame image 313 displayed on the display unit 130b. [Figure 11] This shows the frame image 314 displayed on the display unit 130b. [Figure 12] This shows the frame image 315 displayed on the display unit 130b. [Figure 13] This shows the frame image 316 displayed on the display unit 130b. [Figure 14] This shows the frame image 317 displayed on the display unit 130b. [Figure 15] This is a flowchart showing the operation of the image forming apparatus 10. [Modes for carrying out the invention]

[0038] [Embodiment] 1. Example 1 The image forming apparatus 10, which is Example 1 of the embodiment, will be described below.

[0039] 1.1 Image forming apparatus 10 As shown in Figure 1(a), the image forming apparatus 10 is a tandem-type color multifunction device that has the functions of a scanner, printer, and copier.

[0040] The image forming apparatus 10 is provided with a paper feed unit 113 at the bottom of the housing for storing and feeding recording sheets. Above the paper feed unit 113 is a printer 112 that forms images using an electrophotographic method. Further above the printer 112 are an image reader 111 that reads a document and generates image data, and an operation panel 119 with a screen that accepts input operations from the operator.

[0041] The image reader 111 has an automatic document transporter. The automatic document transporter transports documents placed in the document tray 117 one by one to a predetermined scanning position via a transport path. The image reader 111 scans the documents transported to the scanning position by the automatic document transporter, or documents placed on the document glass plate by the operator, and obtains image data consisting of multi-level digital signals of red (R), green (G), and blue (B). The image reader 111 transports the documents that have been transported from the document tray 117 and scanned to the document output tray 118.

[0042] The image data of each color component obtained by the image reader 111 undergoes various data processing in the control circuit 100 and is further converted into image data of the respective reproduced colors: yellow (Y), magenta (M), cyan (C), and black (K).

[0043] The printer 112 consists of an intermediate transfer belt stretched by a drive roller, a driven roller, and a backup roller, a secondary transfer roller, four image-making units, a fixing unit, a control circuit 100, etc., which are arranged at predetermined intervals along the direction of travel of the intermediate transfer belt opposite the intermediate transfer belt.

[0044] The four imaging units each create images of toners in the colors Y, M, C, and K. Specifically, each imaging unit consists of a photosensitive drum which is the image carrier, an LED array for scanning and exposing the surface of the photosensitive drum, a charging charger, a developer, a cleaner, and a primary transfer roller.

[0045] The paper feeding unit 113 consists of multiple paper feed cassettes for storing recording sheets of different sizes, and multiple pickup rollers for feeding these recording sheets from each paper feed cassette onto the transport path.

[0046] In each of the multiple imaging units, each photoreceptor drum is uniformly charged by a charger and exposed by an LED array, forming an electrostatic latent image on the surface of the photoreceptor drum. Each electrostatic latent image is developed by a corresponding color developer, forming toner images of colors Y to K on the surface of each photoreceptor drum. The toner images are then sequentially transferred onto the surface of the intermediate transfer belt by the electrostatic action of each primary transfer roller located on the back side of the intermediate transfer belt.

[0047] On the intermediate transfer belt, the image creation timing for each color is staggered so that toner images of colors Y to K are transferred in multiple layers.

[0048] Meanwhile, recording sheets are fed from one of the paper feed cassettes in the paper feed unit 113 in accordance with the image creation operations of multiple image creation units.

[0049] The recording sheet is transported along the transport path to the secondary transfer position, where the secondary transfer roller and backup roller face each other across the intermediate transfer belt. At the secondary transfer position, the electrostatic action of the secondary transfer roller transfers the Y-K colored toner images that have been multiple times transferred on the intermediate transfer belt onto the recording sheet. The recording sheet, with the Y-K colored toner images transferred to it, is then transported to the fixing unit.

[0050] The toner image on the surface of the recording sheet is heated and pressed, and fused to the surface of the recording sheet as it passes through the fixing nip formed between the heating roller and the pressure roller pressed against it in the fixing unit. After passing through the fixing unit, the recording sheet is sent to the print output tray 116.

[0051] The control panel 119 (release acceptance means) includes a touch panel 130, multiple operation buttons, a speaker 115a, and a microphone 115b (voice input means).

[0052] The touch panel 130 consists of a display unit 130b (display means) made of a liquid crystal display board or the like, and a touch unit 130a provided on the upper surface of the display unit 130b that detects contact by the operator's finger or a stylus pen (operating body) (Figure 2(a)). Figure 2(a) shows a cross-sectional view of the touch panel 130. Multiple operation buttons each accept presses by the operator's finger or the like. The speaker 115a (audio output means) converts analog audio signals into sound and outputs sound. The microphone 115b converts sound into an electrical signal (analog audio signal).

[0053] The touch panel 130 displays settings and various messages configured by the operator. The touch panel 130 and operation buttons also receive commands from the operator to return the second detection area to the first detection area, such as instructions to start copying, setting the number of copies, setting copying conditions, setting the data output destination, and setting the position and size of the detection area defined by the user, and notify the control circuit 100 of the received information.

[0054] 1.2 Touch section 130a The touch section 130a is, for example, a contact detection device using a projected capacitance method, and has a structure in which two electrode layers, an X-axis electrode layer and a Y-axis electrode layer, are formed in a matrix. By capturing the change in capacitance of the X-axis electrode and the Y-axis electrode, the contact position on the XY coordinate system is detected as a detection signal.

[0055] The touch unit 130a outputs the X and Y coordinate values ​​of the detected contact position as detection signals to the input / output circuit 158.

[0056] Figures 2(b) to 2(e) graphically illustrate the detection signals output from the touch unit 130a when contact is made at one point, when contact is made with one line (i.e., when swiping), and when contact is made with two lines (i.e., when pinching in or pinching out).

[0057] Here, swiping refers to the action of moving one finger in a specific direction while it is in contact with the touch area 130a. Pinch-in refers to the action of bringing two fingers closer together while they are in contact with the touch area 130a. Pinch-out refers to the action of separating two fingers while they are in contact with the touch area 130a.

[0058] When contact is made at one point, a detection signal 201 is output from the touch unit 130a, as shown in Figure 2(b).

[0059] Furthermore, when contact is made with a single line, detection signals 210 to 214 are output from the touch unit 130a, as shown in Figure 2(c). The arrow 217 indicates the direction in which the operator's finger moves, and the detection signals 210 to 214 form a trajectory 216. Note that the trajectory 216 is shown virtually and does not actually occur. The same applies to Figures 2(d) and (e) below.

[0060] Furthermore, when two lines make contact (pinch-in), detection signals 220-224 and 225-229 are output from the touch unit 130a, as shown in Figure 2(d). Arrows 232 and 234 indicate the direction in which the operator's fingers move, respectively. Detection signals 220-224 form trajectory 231, and detection signals 225-229 form trajectory 233.

[0061] Furthermore, when two lines are touched (pinch-out), detection signals 240-244 and 245-249 are output from the touch unit 130a, as shown in Figure 2(e). Arrows 252 and 254 indicate the direction in which the operator's fingers move, respectively. Detection signals 240-244 form trajectory 251, and detection signals 245-249 form trajectory 253.

[0062] Next, a specific example of the detection signal output from the touch unit 130a is shown.

[0063] When contact is made at one point, a detection signal 271 is output from the touch unit 130a, as shown in Figure 3(a). The detection signal 271 consists of a pair of X and Y coordinate values. The same applies to Figures 3(b) to (d).

[0064] Furthermore, when contact is made with a single line, a set of detection signals 272 is output from the touch unit 130a, as shown in Figure 3(b). The set of detection signals 272 consists of, for example, five detection signals. Here, the order of the five detection signals (pairs of X and Y coordinate values) in the set 272 corresponds to the order in which the operator's finger contacted the touch unit 130a. The same applies to Figures 3(c) and (d).

[0065] Furthermore, when contact (pinch-in) is made with two wires, a detection signal assembly 273 is output from the touch unit 130a, as shown in Figure 3(c). The assembly 273 includes two assemblies 273a and 273b. Each of the assemblies 273a and 273b corresponds to contact with a single wire.

[0066] Furthermore, when contact is made with two wires (pinch-out), a detection signal assembly 274 is output from the touch unit 130a, as shown in Figure 3(d). The assembly 274 includes two assemblies 274a and 274b. Each of the assemblies 274a and 274b corresponds to contact with a single wire.

[0067] 1.3 Control circuit 100 As shown in Figure 1(b), the control circuit 100 consists of a CPU (Central Processing Unit) 151, ROM (Read Only Memory) 152, RAM (Random Access Memory) 153, image memory 154, image processing circuit 155, network communication circuit 156, scanner control circuit 157, input / output circuit 158, printer control circuit 159, memory circuit 160, input circuit 161, output circuit 162, output circuit 163, input / output circuit 167, and bus 166, etc.

[0068] The CPU 151, ROM 152, RAM 153, image memory 154, image processing circuit 155, network communication circuit 156, scanner control circuit 157, input / output circuit 158, printer control circuit 159, input circuit 161, output circuit 162, output circuit 163, and input / output circuit 167 are interconnected via bus 166. The memory circuit 160 is connected to input / output circuit 167.

[0069] The CPU 151, ROM 152, and RAM 153 constitute the main control unit 140.

[0070] RAM 153 temporarily stores various control variables and data such as the number of copies set by the operation panel 119, and also provides a work area for program execution by the CPU 151.

[0071] ROM 152 stores control programs and other information for executing various jobs, such as copy operations. Alternatively, it may be said that the control programs and other information are stored in the memory circuit 160.

[0072] The CPU 151 operates according to the control program stored in the ROM 152.

[0073] Image memory 154 temporarily stores image data included in print jobs, etc.

[0074] The image processing circuit 155, for example, performs various data processing on the R, G, and B color component image data obtained by the image reader 111 to convert it into image data of the Y, M, C, and K reproduced colors.

[0075] The network communication circuit 156 receives print jobs from external terminal devices via the network. The network communication circuit 156 also sends emails via the network.

[0076] The scanner control circuit 157 controls the image reader 111 to perform the document scanning operation.

[0077] The input / output circuit 158 ​​receives a detection signal from the touch unit 130a and outputs the received detection signal to the detection unit 142 of the main control unit 140, which will be described later. It also receives a frame image from the display control unit 145 of the main control unit 140, which will be described later, and outputs the received frame image to the display unit 130b of the operation panel 119 for display. Here, the image that is displayed across the entire display surface of the display unit 130b of the touch panel 130 is called a frame image.

[0078] The memory circuit 160 is composed of non-volatile semiconductor memory. Alternatively, the memory circuit 160 may be composed of a hard disk.

[0079] The memory circuit 160 pre-stores, for each frame image displayed on the display surface of the touch panel 130b, the size and position 181 of the first detection area (described later) and the size and position 182 of the second detection area (described later). Here, the size and position 181 of the first detection area are predetermined for each frame image displayed on the display surface. Similarly, the size and position 182 of the second detection area (described later) are predetermined for each frame image. The memory circuit 160 also has a region for storing the size and position 183 of the second detection area set by the user for each frame image. Here, the second detection area is larger than the first detection area. The first and second detection areas will be described later.

[0080] The input circuit 161 is connected to the microphone 115b. The input circuit 161 converts the analog audio signal received from the microphone 115b into a digital audio signal and outputs the generated digital audio signal to the voice recognition unit 148 of the main control unit 140, which will be described later.

[0081] The output circuit 162 is connected to the speaker 115a. The output circuit 162 converts the digital audio signal received from the audio generation unit 150 of the main control unit 140 (described later) into an analog audio signal, and outputs the generated analog audio signal to the speaker 115a.

[0082] The output circuit 163 is connected to a vibrator (not shown; vibration means) provided in the image forming apparatus 10. The output circuit 163, under the control of the notification unit 149 of the main control unit 140 (described later), instructs the vibrator to vibrate.

[0083] 1.4 Frame images displayed on the screen As an example, we will explain the frame image displayed on the touch panel 130 of the image forming apparatus 10.

[0084] (1) Example of scrolling by swiping This section explains how to scroll through items in a list by swiping.

[0085] The frame images 301 and 302 shown in Figures 4(a) and 4(b), respectively, are frame images that are displayed when, for example, various copy conditions (settings) are set for the MFP before performing a copy.

[0086] Frame image 301 contains a list 401 of some of the numerous setting items. Since there are many setting items, some setting items are not included in list 401. To display the setting items not included in list 401, frame image 301 includes a long scroll bar 402 along with list 401, and an elevator 403 is included within scroll bar 402.

[0087] The detection area 404 is set to overlap the scroll bar 402. When a finger touches the detection area 404, that contact is considered valid. Note that in Figure 4(a), the sizes of the scroll bar 402 and the detection area 404 appear different. This is for illustrative purposes to distinguish and make the respective areas easier to see in the drawing. In reality, the sizes of the scroll bar 402 and the detection area 404 are the same, and the area of ​​the scroll bar 402 coincides with the detection area 404.

[0088] Here, detection region 404 is referred to as the first detection region. The first detection region is the detection region before it is expanded.

[0089] In order to display (scroll through) setting items not included in list 401, the operator can move the elevator 403 within the scroll bar 402 along the direction of the scroll bar 402, thereby deleting some of the setting items included in list 401 and adding new setting items not included in list 401.

[0090] To move the elevator 403 within the scroll bar 402, move (swipe) your finger within the detection area 404 as shown by the arrow 405, while keeping your finger in contact with the elevator 403 along the direction of the scroll bar 402.

[0091] In this way, by moving a finger while it is in contact with the touch panel, the MFP can display new setting items that were not included in the frame image 301. This allows the operator to set conditions using the new setting items.

[0092] The frame image 302 shown in Figure 4(b) is displayed after the operator moves their finger while keeping it in contact with the elevator 403, as described above.

[0093] Frame image 302 contains a list 411 which includes some setting items that differ from the list 401 in frame image 301. Using frame image 302, the operator can set conditions for the newly displayed setting items.

[0094] In frame image 301, the detection area 404 coincides with the area of ​​the scroll bar 402. On the other hand, in frame image 302, the detection area 414 is large enough to cover the list 411, scroll bar 412, copy display area 416, and numeric keypad area 417, and coincides with these areas. In other words, the detection area 414 is larger than the detection area 404. The numeric keypad area 417 is an area for receiving input for the number of copies, and the number received is set as the number of copies, which is then displayed in the copy display area 416.

[0095] Here, detection region 414 is referred to as the second detection region. The second detection region is an enlarged detection region.

[0096] The size and position of the second detection area are predetermined for each frame image displayed on the screen. Alternatively, the size and position of the second detection area may be set based on user input. Furthermore, different sizes and positions of the second detection area may be set for each user.

[0097] In this way, swiping can be performed within the expanded detection area 414. Because the detection area is expanded, if the detection area remained at its original size 404, it would be possible to prevent the swipe from starting outside the detection area or ending outside the detection area, thus preventing the swipe operation from being invalidated.

[0098] Even when performing a swipe that starts within the number of copies display area 416 and ends within the staple setting area 418, as shown by the arrow 415 in frame image 302, this swipe is valid and the list 411 is scrolled.

[0099] (2) An example of zooming in or out on a preview image by pinching in or out. Here, we will explain how to enlarge or reduce preview images, etc., by pinching in or pinching out, using Figures 5, 6(a)-(c), and 7(a)-(c).

[0100] (a) Frame image 303 As an example, the frame image 303 shown in Figure 5 has a preview image 422, which is a reduced version of the image to be printed, placed in the center of the background image 421 in order to confirm the content of the image to be printed.

[0101] A detection area 423 is defined for the preview image 422. In Figure 5, the size of the preview image 422 and the size of the detection area 423 are different. This is to make the respective areas easier to distinguish and view in the drawing. In reality, the size of the preview image 422 and the size of the detection area 423 are the same, and the area of ​​the preview image 422 coincides with the detection area 423.

[0102] Here, detection region 423 is referred to as the first detection region. The first detection region is the detection region before it is expanded.

[0103] Within the detection area 423, pinch-in or pinch-out gestures 425 are accepted, and pinch-in or pinch-out gestures 424 are also accepted in areas outside the detection area 423 (areas within the background image 421, excluding the preview image 422).

[0104] When a pinch-in or pinch-out gesture 425 is detected within the detection area 423, the preview image 422 is reduced in size or enlarged. Also, when a pinch-in or pinch-out gesture 424 is detected outside the detection area 423, the background image 421 is reduced in size or enlarged.

[0105] (b) Pinch-in or pinch-out within the detection area 423 The following describes the case where pinch-in or pinch-out gestures are accepted within the detection area 423.

[0106] (Frame image 304) When a pinch-out gesture 425 is detected within the detection area 423, the preview image 422 is enlarged. The frame image 304 after the preview image 422 has been enlarged is shown in Figure 6(a).

[0107] Frame image 304 includes a preview image 432 obtained by enlarging the preview image 422. In frame image 304, the detection region 423 is enlarged to become the detection region 433. The size of the detection region 433 is the same as the size of the background image 431, and the detection region 433 corresponds to the area of ​​the background image 431.

[0108] Here, detection region 433 is referred to as the second detection region. The second detection region is an enlarged detection region.

[0109] When a pinch-out or pinch-in gesture is detected within the detection area 433, the preview image 432 is enlarged or reduced. Because the detection area is enlarged, the preview image 432 will be enlarged or reduced whether a pinch-out or pinch-in gesture 435 is detected within the detection area 432, or whether a pinch-out or pinch-in gesture 434 is detected outside the preview image 432, as long as it is within the detection area 433.

[0110] (Frame image 305) When a pinch-out gesture 435 is detected within the detection area 433, the preview image 432 is enlarged. The frame image 305 after the preview image 432 has been enlarged is shown in Figure 6(b).

[0111] Frame image 305 contains a preview image 442 obtained by enlarging the preview image 432. The detection region 443 in frame image 305 and the detection region 433 in frame image 304 are the same size. The detection region 443 corresponds to the area of ​​the background image 441.

[0112] If a pinch-out or pinch-in gesture is detected within the detection area 443, the preview image 442 will be enlarged or reduced. Within the detection area 443, the preview image 442 will be enlarged or reduced whether a pinch-out or pinch-in gesture 445 is detected within the preview image 442 or outside the preview image 442.

[0113] (Frame image 306) When a pinch-out gesture 445 is detected within the detection area 443, the preview image 442 is enlarged. The frame image 306 after the preview image 442 has been enlarged is shown in Figure 6(c).

[0114] Frame image 306 contains a preview image 452 obtained by enlarging the preview image 442. The detection region 453 in frame image 306 and the detection region 443 in frame image 305 are the same size. The detection region 453 corresponds to the area of ​​the background image 451.

[0115] When a pinch-out or pinch-in gesture is detected within the detection area 453, the preview image 452 is enlarged or reduced.

[0116] (c) Pinch-in or pinch-out outside the detection area 423 The following describes the case where pinch-in or pinch-out gestures are accepted outside the detection area 423.

[0117] (Frame image 307) When a pinch-out gesture 425 is detected outside the detection area 423 shown in Figure 5, the background image 421 is enlarged. The frame image 307 after the background image 421 has been enlarged is shown in Figure 7(a).

[0118] Frame image 307 includes background image 461, which is obtained by enlarging background image 421 shown in Figure 5. In frame image 307, the detection region 423 shown in Figure 5 is enlarged to become detection region 463. The size of detection region 463 is the same as the size of background image 461, and detection region 463 corresponds to the area of ​​background image 461.

[0119] Here, detection region 463 is referred to as the second detection region. The second detection region is an enlarged detection region.

[0120] When a pinch-out or pinch-in gesture is detected within the detection area 463, the background image 461 is enlarged or reduced. Because the detection area is enlarged, the background image 461 is enlarged or reduced whether a pinch-out or pinch-in gesture 465 is detected within the preview image 466, or whether a pinch-out or pinch-in gesture 464 is detected outside the preview image 466, as long as it is within the detection area 463.

[0121] (Frame image 308) When a pinch-out gesture 465 is detected within the detection area 463, the background image 461 is enlarged. The frame image 308 after the background image 461 has been enlarged is shown in Figure 7(b).

[0122] Frame image 308 includes background image 471, which is obtained by enlarging background image 461. The detection region 463 in frame image 307 and the detection region 473 in frame image 308 are the same size. The detection region 473 corresponds to the region of background image 471.

[0123] Within the detection area 473, if a pinch-out or pinch-in gesture is detected, the background image 471 will be enlarged or reduced. Within the detection area 473, the background image 471 will be enlarged or reduced whether a pinch-out or pinch-in gesture 475 is detected within the preview image 476 or outside the preview image 476.

[0124] (Frame image 309) When a pinch-out gesture 475 is detected within the detection area 473, the background image 471 is enlarged. The frame image 309 after the background image 471 has been enlarged is shown in Figure 7(c).

[0125] Frame image 309 contains background image 481, which is obtained by enlarging background image 471. The detection region 483 in frame image 309 and the detection region 473 in frame image 308 are the same size. The detection region 483 corresponds to the region of background image 481.

[0126] When a pinch-out or pinch-in gesture is detected within the detection area 483, the background image 481 is enlarged or reduced.

[0127] (3) Detection area and display area The relationship between the maximum display area of ​​the display section 130b of the touch panel 130 and the maximum detection area of ​​the touch section 130a will be explained below.

[0128] Generally, the size and position of the maximum display area in the display unit 130b coincide with the size and position of the maximum detection area in the touch unit 130a.

[0129] However, this is not the only example.

[0130] As shown in Figure 8(a), the detection area 492 may include the display area 491. In other words, the size of the detection area 492 is larger than the size of the display area 491.

[0131] Furthermore, as shown in Figure 8(b), the display area 494 may include the detection area 493. In other words, the size of the display area 494 is larger than the size of the detection area 493.

[0132] Furthermore, the size of the first detection area is smaller than the size of the second detection area, and also smaller than the size of the maximum detection area. Also, the size of the second detection area is either smaller than the size of the maximum detection area, or equal to the size of the maximum detection area.

[0133] (4) Areas to be excluded from the detection area You may also set areas to be excluded from the detection area that detects swipe, pinch-in, and pinch-out operations.

[0134] The frame image 312 shown in Figure 9 contains specific icon images for instructing specific operations in the image forming apparatus 10.

[0135] For example, icons such as 505a to instruct the start of a job, 505b to instruct the stop of a running job, 504a to instruct the reset of settings to their default values, 504b to instruct the logout, 504c to instruct the transition to the home screen, 503a to display help information, 503b to display the remaining amount of consumables, 503c to display the details of an error, and 502a to display various information are displayed.

[0136] These icon images are used to perform specific actions, and may have higher priority than actions such as swiping, pinching in, and pinching out.

[0137] Therefore, the remaining area after excluding areas 502, 503, 504, and 505, where these icon images are located, from the largest detection area may be set as the detection area 501.

[0138] Within the detection area 501, the detection area before expansion (first detection area) and the detection area after expansion (second detection area) are defined as described above.

[0139] (5) The first detection signal and subsequent detection signals The frame image 313 shown in Figure 10 illustrates the case where scrolling is performed by swiping.

[0140] Here, as will be described later, the first detection signal received after the control unit 141 has transitioned the frame image displayed on the display surface of the display unit 130b to another frame image is called the first detection signal. Also, after the first detection signal is received, the detection signals received from the second time onward are called the second and subsequent detection signals. After receiving the second and subsequent detection signals, as described above, if the expanded detection area is released and returns to the original detection area, the first detection signal received thereafter is called the first detection signal, and the detection signals received after that first detection signal are called the second and subsequent detection signals. Similarly, for swiping, pinch-out, and pinch-in, they are referred to as the first swipe, the first pinch-out, the first pinch-in, the second and subsequent swipes, the second and subsequent pinch-outs, the second and subsequent pinch-ins, and so on.

[0141] Alternatively, the amount of scrolling on the screen could be adjusted based on the length of the first swipe, and then based on the length of subsequent swipes.

[0142] In other words, the amount of scrolling on the screen can be switched based on the length of the trajectory from the second detection signal onwards, using the length of the trajectory from the first detection signal as a reference.

[0143] In the frame image 313 shown in Figure 10, arrow 511 represents the trajectory of the first detection signal, arrow 512 represents the trajectory of the second detection signal, and arrow 513 represents the trajectory of the third detection signal.

[0144] If the length of the trajectory created by the first detection signal is "1", and the length of the trajectory created by the second detection signal is "0.5", then the scroll amount will be half of the initial scroll amount.

[0145] Furthermore, if the length of the trajectory from the first detection signal is set to "1", and the length of the trajectory from the third detection signal is "3.0", then the scroll amount will be set to three times the initial scroll amount.

[0146] This allows the amount of scrolling from the second detection onwards to be determined based on the length of the trajectory from the second detection signal onwards.

[0147] (6) Example of releasing the expanded detection area An example of how to clear an expanded detection area will be explained.

[0148] In the frame image 314 shown in Figure 11, a list is displayed, and the items in the displayed list are scrolled vertically. The frame image 314 also shows the first swipe 521 and subsequent touch operations 522-526 that draw linear trajectories.

[0149] As described above, after a swipe 521 is performed within the detection area 527, scrolling occurs, and the detection area 527 expands to become the detection area 528.

[0150] Subsequently, subsequent contact operations can be performed within the detection area 528.

[0151] Here, if, in the second or subsequent attempts, a contact operation that bends in an L-shape, such as contact operation 522, is performed, this contact operation is not a swipe, so the expanded detection area 528 is deactivated and returns to the original detection area 527. Subsequently, detection is performed in the detection area 527.

[0152] Furthermore, in subsequent touch operations, such as touch operation 523, if a diagonal linear touch operation is performed with a large amount of movement in the scrolling direction, the expanded detection area 528 is maintained because this touch operation is a swipe.

[0153] Furthermore, in subsequent touch operations, such as touch operations 524 and 525, which involve a small amount of movement in the scrolling direction and are linear, these are not swipes, so the expanded detection area 528 is deactivated and returns to the original detection area 527. Subsequently, detection is performed in the detection area 527.

[0154] Furthermore, if a U-shaped contact operation is performed on the second or subsequent attempts, such as contact operation 526, this is not a swipe, so the expanded detection area 528 is deactivated and returns to the original detection area 527. Subsequently, detection is performed in the detection area 527.

[0155] As described above, if the first touch operation is a swipe, the detection area expands and accepts subsequent touch operations. If the second or subsequent touch operation is the same swipe as the first, the expanded detection area is maintained. On the other hand, if the second or subsequent touch operation is a different touch operation than the first swipe, the expanded detection area is deactivated and returns to the original detection area.

[0156] Thus, if the second and subsequent touch operations are the same swipe as the first, the expanded detection area is maintained. In this case, since the third touch operation is also likely to be a swipe, maintaining the expanded detection area allows for the operability of the third touch operation to be maintained.

[0157] Maintaining the expanded detection area isn't limited to swiping.

[0158] If the second and subsequent contact operations are the same pinch-in or pinch-out as the first, the enlarged detection area is maintained. Here, pinch-in and pinch-out are considered to be the same type of contact operation.

[0159] (7) Another example of deactivating the expanded detection area Let's discuss another example of how to clear an expanded detection area.

[0160] In the frame image 315 shown in Figure 12, the list 532 is displayed, and the items in the list 532 are scrolled vertically. Also, in the frame image 315, after the first swipe is completed, an enlarged detection area 531 is set.

[0161] In this case, if a swipe 533 is performed in the detection area 531, the items in the list 532 are scrolled vertically, as described above. Also, the detection area 531 is maintained.

[0162] On the other hand, if a swipe 534 is performed in an area outside the detection area 531, the detection area 531 is released and returns to its original detection area. Also, if a pinch-in or pinch-out is performed in an area outside the detection area 531, the detection area 531 is released and returns to its original detection area.

[0163] As described above, if a contact operation is performed in an area outside the expanded detection area, the detection area is deactivated and returns to its original detection area.

[0164] (8) Display during repeated input As mentioned above, if the second and subsequent contact operations are of the same type as the first, the expanded detection area is maintained. In this way, repeated input of the same contact operation is permitted.

[0165] In the frame image 316 shown in Figure 13, a message indicating that repeated input of the same contact operation is permitted is displayed in the message area 541. The message area 541 also contains an icon image 542 for releasing the enlarged detection area 543. When a contact operation is detected on the icon image 542, the enlarged detection area 543 is released and returns to the original detection area.

[0166] In this case, in frame image 316, the message area 541, which includes the icon image 542, is excluded from the configured detection area 543.

[0167] By viewing the message in message area 541, the operator can understand that repeated input of the same contact operation is permitted.

[0168] (9) Highlighting of the detected area The detection area, etc., may be highlighted to indicate its extent.

[0169] The frame image 317 shown in Figure 14 shows the detection area 551 before enlargement, the detection area 552 after enlargement, and the invalid area 553 that was excluded from the detection area. Note that the invalid area 553 is an area that does not accept touch operations such as swiping, pinching in, and pinching out.

[0170] In frame image 317, the detected area 551, the detected area 552, and the invalid area 553 are highlighted by thick borders surrounding each area.

[0171] Furthermore, the color of the border surrounding each area may be changed. The border surrounding each area may also be made to blink. Additionally, different colored hatching may be applied within each area. In this way, each area is highlighted.

[0172] Note that frame image 317 does not indicate that detection region 551 and detection region 552 are set simultaneously, but rather shows an example of highlighting those regions.

[0173] 1.5 Main control unit 140 The main control unit 140 is configured as shown in Figure 1(b) by the CPU 151 operating according to the control program, and comprises the overall control unit 141, detection unit 142, trajectory determination unit 143, detection control unit 144, display control unit 145, match determination unit 146, release unit 147, voice recognition unit 148, notification unit 149, and voice generation unit 150.

[0174] Here, the CPU 151, ROM 152, RAM 153, input / output circuit 158, memory circuit 160, input circuit 161, output circuit 162, output circuit 163, input / output circuit 167 and bus 166, operation panel 119, overall control unit 141, detection unit 142, trajectory determination unit 143, detection control unit 144, display control unit 145, match determination unit 146, release unit 147, voice recognition unit 148, notification unit 149 and voice generation unit 150 constitute the input device.

[0175] (1) Control Unit 141 As the CPU 151 operates according to the control program, the overall control unit 141 uniformly controls the image memory 154, image processing circuit 155, network communication circuit 156, scanner control circuit 157, input / output circuit 158, printer control circuit 159, input circuit 161, output circuit 162, input / output circuit 167, output circuit 163, etc. In addition, the overall control unit 141 uniformly controls the detection unit 142, trajectory determination unit 143, detection control unit 144, display control unit 145, match determination unit 146, release unit 147, voice recognition unit 148, notification unit 149, and voice generation unit 150.

[0176] The central control unit 141 determines whether the input received from the operation panel 119 or the network communication circuit 156 is for login, copy, print, scan to mail, or other. If the received input is for login, copy, print, scan to mail, or other, the central control unit 141 controls the system to execute the login process, copy process, print process, scan to mail process, or other process, respectively.

[0177] The central control unit 141 manages the transitions of the frame images displayed on the display unit 130b of the operation panel 119.

[0178] The control unit 141 stores, for each frame image, what types of touch operations can be accepted when that frame image is displayed. In other words, the control unit 141 stores, for each frame image, whether it can accept touch operations such as swiping, pinching out, pinching in, point touch, and other operations. Normally, point touch can be accepted regardless of which frame image is displayed. Also, when a frame image containing a list along with a scroll bar is displayed, swiping can be accepted. Furthermore, when a frame image containing a preview image or the like is displayed, pinching out and pinching in can be accepted.

[0179] The control unit 141 reads the size and position 181 of the first detection area from the memory circuit 160 and sets the first detection area as the detection area for detecting contact operations.

[0180] (2) Detection unit 142 The detection unit 142 receives a detection signal from the touch unit 130a via the input / output circuit 158. Here, the received detection signal is, for example, a single detection signal or a collection of detection signals, as shown in Figures 3(a) to (d). Hereafter, it will simply be referred to as the detection signal.

[0181] The detection unit 142 determines whether the received detection signal indicates a position within the currently set detection area (first detection area or second detection area). If the received detection signal does not indicate a position within the currently set detection area, the received detection signal is not accepted as a swipe, pinch out, or pinch in operation. In other words, it may be accepted as an operation other than swiping, pinch out, and pinch in, for example, as a point contact operation. On the other hand, if the received detection signal indicates a position within the currently set detection area, the received detection signal is accepted as a contact operation that may be a swipe, pinch out, or pinch in operation.

[0182] In this way, the detection unit 142 detects a contact operation in the first detection area or the second detection area that is set.

[0183] When the detection unit 142 receives a detection signal, it writes the received detection signal, along with information indicating which time it was received, to the memory circuit 160.

[0184] The detection unit 142 controls the trajectory determination unit 143 to determine whether the contact operation indicated by the detection signal is a swipe, pinch-out, pinch-in, point contact, or other operation. The detection unit 142 also controls the trajectory determination unit 143 to determine the number of fingers used by the operator in the contact operation indicated by the detection signal.

[0185] Here, the touch unit 130a and the detection unit 142 constitute the detection means.

[0186] (3) Trajectory judgment unit 143 The trajectory determination unit 143 performs the following actions under the control of the detection unit 142.

[0187] The trajectory determination unit 143 determines whether the trajectory drawn by the received detection signal is a point or a line.

[0188] Here, as shown in Figure 2(b), the trajectory determination unit 143 determines that it is the trajectory of a point when it receives a single detection signal.

[0189] Furthermore, as shown in Figures 2(c) to 2(e), the trajectory determination unit 143 determines that a collection of detection signals is a line trajectory. In this case, as shown in Figures 3(b) to 3(d), the trajectory determination unit 143 determines the direction of the line based on the arrangement of the multiple detection signals included in the collection. If it determines that it is the trajectory of a single line, the trajectory determination unit 143 determines that it is a swipe operation.

[0190] Furthermore, as shown in Figures 2(d) to (e), when the trajectory determination unit 143 detects multiple clusters, it determines that they are the trajectories of multiple lines. Here, the trajectory determination unit 143 determines the direction of each line. If there are two lines, and the two lines are almost identical, and the directions of the two lines are opposite, the trajectory determination unit 143 determines that it is a pinch-out operation. Also, if there are two lines, and the two lines are almost identical, and the directions of the two lines are opposite, the trajectory determination unit 143 determines that it is a pinch-in operation.

[0191] In this way, the trajectory determination unit 143 uses the received detection signal to determine whether the contact operation indicated by the detection signal represents an action that traces a predetermined linear trajectory. An action that traces a predetermined linear trajectory is a swipe action, a pinch-out action, or a pinch-in action. The trajectory determination unit 143 also uses the received detection signal to determine whether the contact operation indicated by the detection signal represents an action that traces a point.

[0192] The trajectory determination unit 143 outputs the determination result to the detection control unit 144, the matching determination unit 146, and the display control unit 145.

[0193] Furthermore, the trajectory determination unit 143 determines the number of fingers used by the operator in the detected contact operation. Specifically, the trajectory determination unit 143 uses the received detection signal to determine the number of fingers used by the operator in the contact operation indicated by the detection signal. If there is one received cluster, it is determined that one finger was used by the operator. If there are multiple received clusters, it is determined that the number of fingers used by the operator is equal to the number of clusters.

[0194] The trajectory determination unit 143 outputs the number of fingers used to the match determination unit 146.

[0195] (4) Detection control unit 144 The detection control unit 144 receives a determination result from the trajectory determination unit 143 indicating whether or not the contact operation is an action that traces a predetermined linear trajectory.

[0196] If the received judgment result determines that the initial contact operation follows a predetermined linear trajectory, the detection control unit 144 reads the size and position 182 of the second detection area from the memory circuit 160 and sets the second detection area, which is larger than the first detection area, as the detection area for detecting the next contact operation. Alternatively, the detection control unit 144 may read the size and position 183 of the detection area set by the user from the memory circuit 160 and set the read detection area as the second detection area, which is larger than the first detection area, for detecting the next contact operation. The detection control unit 144 controls the detection unit 142 to detect the next contact operation in the second detection area.

[0197] Furthermore, as shown in Figure 9, if an icon image relating to an operation with a higher execution priority than the operation of drawing a predetermined linear trajectory is displayed on the screen, the detection control unit 144 sets a second detection area excluding the area corresponding to the area where the icon image is displayed.

[0198] (5) Display control unit 145 The display control unit 145 receives a determination result from the trajectory determination unit 143 indicating whether the contact operation indicated by the detection signal represents an action that traces a predetermined linear trajectory. If the display control unit 145 determines from the received determination result that the action represents an action that traces a predetermined linear trajectory, it controls the display unit 130b to switch the content displayed on the screen according to that action.

[0199] For example, the display control unit 145 scrolls through the setting items in the list 401 by swiping in the frame image 301 shown in Figure 4(a), changing the displayed setting items as shown in the list 411 shown in the frame image 302 shown in Figure 4(b).

[0200] Furthermore, the display control unit 145 receives a determination result from the matching determination unit 146 (described later) indicating whether the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation match or are similar. If the received determination result indicates that they match or are similar, the display control unit 145 controls the display unit 130b to switch the content displayed on the screen according to the action corresponding to the next detected contact operation.

[0201] For example, the display control unit 145 enlarges or reduces the preview image 422 in the frame image 303 shown in Figure 5 by a pinch-in or pinch-out operation, and displays the enlarged or reduced preview image 432 as shown in the frame image 304 shown in Figure 6(a).

[0202] Here, "matching actions" means that the first action is a pinch-in and the next action is also a pinch-in. "Similar actions" means that the first action is a pinch-in and the next action is a pinch-out, or vice versa.

[0203] Furthermore, the display control unit 145 controls the display unit 130b to switch the display content according to the length of the linear trajectory corresponding to the next detected contact operation, based on the length of the linear trajectory corresponding to the first detected contact operation.

[0204] Here, for example, as shown in Figure 10, the display control unit 145 switches the amount of scrolling on the screen in proportion to the length of the trajectory from the second and subsequent detection signals, based on the length of the trajectory from the first detection signal.

[0205] Furthermore, the display control unit 145 receives a determination result from the trajectory determination unit 143 indicating whether the next detected contact operation indicates a point-drawing operation. If the received determination result indicates a point-drawing operation, the display control unit 145 controls the display unit 130b to switch the content displayed on the screen according to that operation.

[0206] Here, for example, as shown in Figure 4(b), if a point contact is detected on one of the numeric keypad icons in the numeric keypad area 417 while the expanded detection area 414 is waiting for a swipe operation as a contact operation, the display control unit 145 considers that a number corresponding to the numeric keypad icon that was the target of the contact operation has been entered, and controls the display unit 130b to change the number of copies to the entered number and display it.

[0207] (6) Match determination unit 146 The matching determination unit 146 receives a determination result from the trajectory determination unit 143 indicating whether the next detected contact operation represents an action that traces a predetermined linear trajectory. If the received determination result indicates an action that traces a predetermined linear trajectory, the matching determination unit 146 determines whether the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation are identical or similar.

[0208] In detail, the matching determination unit 146 makes the determination of whether they match or are similar by comparing the linear trajectory corresponding to the first detected contact operation (first trajectory) with the linear trajectory corresponding to the next detected contact operation (next trajectory).

[0209] The first trajectory and the next trajectory are stored in the memory circuit 160 as detection signals, respectively.

[0210] More specifically, the matching unit 146 considers both trajectories to be matching if the first trajectory is a swipe and the next trajectory is also a swipe. Furthermore, the matching unit 146 considers both trajectories to be matching if the first trajectory is a swipe and the next trajectory is a swipe in the reverse direction of the first trajectory. Also, the matching unit 146 considers both trajectories to be matching if the first trajectory is a pinch-in and the next trajectory is also a pinch-in. Finally, the matching unit 146 considers both trajectories to be matching if the first trajectory is a pinch-out and the next trajectory is also a pinch-out.

[0211] Furthermore, the matching determination unit 146 considers both trajectories to be similar if the first trajectory is a pinch-out and the next trajectory is a pinch-in. The same applies in the reverse case.

[0212] On the other hand, the matching unit 146 considers that if the first trajectory is a pinch-out and the next trajectory is a swipe, then both trajectories do not match. The same applies in the reverse case. Also, the matching unit 146 considers that if the first trajectory is a pinch-in and the next trajectory is a swipe, then both trajectories do not match. The same applies in the reverse case.

[0213] Furthermore, the matching determination unit 146 considers that if the first trajectory is a tap and the next trajectory is a swipe, the two trajectories do not match. The same applies in the reverse case.

[0214] Furthermore, the matching determination unit 146 receives the number of operator fingers used from the trajectory determination unit 143. Using the received number of operator fingers, the matching determination unit 146 determines whether the number of operator fingers used in the first detected contact operation is different from the number of operator fingers used in the next detected contact operation. If they are different, it determines that the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation are not identical or similar.

[0215] More specifically, the matching determination unit 146 considers both operations to be matching if the first trajectory is a one-finger operation (swipe) and the next trajectory is also a one-finger operation (swipe).

[0216] Furthermore, the matching determination unit 146 considers both operations to be matching if the first trajectory is a two-finger operation (pinch-in or pinch-out) and the next trajectory is also a two-finger operation (pinch-in or pinch-out).

[0217] On the other hand, the matching determination unit 146 considers that if the first trajectory is a two-finger operation (pinch-in or pinch-out) and the next trajectory is a one-finger operation (swipe), then the two operations do not match. The same applies in the reverse case.

[0218] The matching determination unit 146 outputs the determination result of whether they match or are similar to the cancellation unit 147 and the display control unit 145.

[0219] (7) Release section 147 The release unit 147 determines whether the release condition is met to return the detection area used by the touch unit 130a from the second detection area to the first detection area.

[0220] The conditions for deactivation are met in the following cases:

[0221] (a) When the determination result received from the matching determination unit 146 indicates that the linear trajectory corresponding to the first detected contact operation and the linear trajectory corresponding to the next detected contact operation do not match or resemble each other. (b) When an operation instruction is received from the control panel 119 via the input / output circuit 158 ​​by the operator to return from the second detection area to the first detection area. (c) When the touch unit 130a receives a detection signal for a contact operation by the operator's body in an area outside the second detection area. (d) When an operation instruction is received by voice from microphone 115b via input circuit 161 (e) If a predetermined time has elapsed since the initial contact operation was detected, and no further contact operation is received from the touch unit 130a. If the release conditions are met, the release unit 147 returns the detection area used by the touch unit 130a from the second detection area to the first detection area, as shown below.

[0222] The release unit 147 receives a determination result from the matching determination unit 146 indicating whether the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation match or are similar. If the received determination result indicates that the linear trajectory corresponding to the first detected contact operation and the linear trajectory corresponding to the next detected contact operation do not match or are similar, the release unit 147 returns the detection area from the second detection area to the first detection area.

[0223] Furthermore, the release unit 147 receives an operation instruction from the operation panel 119 via the input / output circuit 158 ​​to return the detection area from the second detection area to the first detection area by the operator. Upon receiving the operation instruction, the release unit 147 returns the detection area from the second detection area to the first detection area.

[0224] Furthermore, the release unit 147 receives a detection signal of the operator's contact operation from the touch unit 130a in an area outside the second detection area. Upon receiving this contact operation detection signal, the release unit 147 returns the detection area from the second detection area back to the first detection area.

[0225] Furthermore, the release unit 147 receives operation instructions via voice from the microphone 115b through the input circuit 161. Upon receiving operation instructions via voice, the release unit 147 returns the detection area from the second detection area to the first detection area.

[0226] Furthermore, if a predetermined time has elapsed since the initial contact operation was detected, and no further contact operation is received from the touch unit 130a, that is, if no further contact operation is detected, the release unit 147 returns the detection area from the second detection area to the first detection area.

[0227] Here, the operator may be able to set a predetermined time each time an operation is performed.

[0228] Furthermore, it may be possible to set a predetermined time for each registered user. For example, the predetermined time for user A may be set to "0.5 seconds," and for user B, it may be set to "1.7 seconds."

[0229] (8) Notification Department 149 The notification unit 149 stores the notification mode. The notification mode is set to either ON or OFF. If the operator has set the notification mode to ON, it indicates that the operator will be notified that the next contact operation is being detected. On the other hand, if the operator has set the notification mode to OFF, it indicates that the operator will not be notified that the next contact operation is being detected in the second detection area.

[0230] When notification mode is ON, if the notification unit 149 is detecting the next contact operation in the second detection area, which is wider than the first detection area, it will notify the operator of this fact as follows.

[0231] The notification unit 149 controls the display unit 130b to display on its surface that detection is in progress in the second detection area.

[0232] Furthermore, the notification unit 149 may control the output circuit 162 to notify by voice that detection is in progress in the second detection area. The speaker 115a outputs a voice message indicating that detection is in progress.

[0233] Furthermore, the notification unit 149 may control the output circuit 163 to notify that detection is in progress in the second detection area by vibration. The vibrator vibrates as a result of the control of the output circuit 163. In this way, the vibration of the vibrator notifies that detection is in progress in the second detection area.

[0234] Furthermore, the notification unit 149 may, for example, control the display unit 130b to highlight the second detection area or an area outside the second detection area and display it on the display surface of the display unit 130b, as shown in Figure 14.

[0235] (9) Voice recognition unit 148 The voice recognition unit 148 receives a digital audio signal from the input circuit 161 connected to the microphone 115b. The voice recognition unit 148 analyzes the received digital audio signal and performs voice recognition processing. For example, if the voice recognition unit 148 receives the audio signal "start copying", it generates an instruction indicating "start copying". Also, if the voice recognition unit 148 receives the audio signal "display print settings screen", it generates an instruction indicating "display print settings screen". The voice recognition unit 148 outputs the generated instruction to the release unit 147.

[0236] (10) Voice generation unit 150 The voice generation unit 150, under the control of the notification unit 149, generates a digital audio signal indicating that detection is in progress in the second detection area, and outputs the generated digital audio signal to the output circuit 162. The output circuit 162 converts the digital audio signal received from the voice generation unit 150 into an analog audio signal. The speaker 115a outputs a digital audio signal indicating that detection is in progress in the second detection area.

[0237] 1.6 Description of operation when the image forming apparatus 10 accepts contact operations. The operation of the image forming apparatus 10 when it accepts swipe, pinch-in, and pinch-out touch operations will be explained using the flowchart shown in Figure 14.

[0238] The touch unit 130a remains in standby mode until it receives a touch input from the operator (NO in step S101).

[0239] When the detection unit 142 receives a contact operation (detection signal) from the operator (YES in step S101), it determines whether the received detection signal indicates a position within the currently set detection area (first detection area or second detection area). In other words, it determines whether the received detection signal indicates a position within the valid range (step S102).

[0240] If the received detection signal is determined not to indicate a position within the valid range (NO in step S102), the control unit 141 returns control to step S101 and repeats the process.

[0241] If the received detection signal indicates a position within a valid range (YES in step S102), the trajectory determination unit 143 determines whether the contact operation is a valid operation, that is, whether the contact operation is a swipe, pinch-in, or pinch-out operation (indicating an operation that draws a linear trajectory), or any other operation (step S103).

[0242] If it is determined that the operation is something else (NO in step S103), the control unit 141 returns control to step S101 and repeats the process.

[0243] If the control unit determines that the contact operation is a swipe, pinch-in, or pinch-out operation (YES in step S103), the control unit 141 controls the display control unit 145, network communication circuit 156, scanner control circuit 157, printer control circuit 159, etc., to perform a display or processing corresponding to the contact operation (step S104).

[0244] The detection unit 142 stores the received contact operation, that is, the received detection signal, by writing it to the memory circuit 160 (step S105).

[0245] The detection control unit 144 expands the detection area, which is the effective range of the contact operation, and sets a second detection area (step S106).

[0246] The notification unit 149 determines whether or not to notify the operator that the system is in a repeat input state, based on the set notification mode (step S107). If it determines that it is necessary to notify the operator that the system is in a repeat input state (YES in step S108), the notification unit 149 notifies the operator that the system is in a repeat input state (step S108).

[0247] Next, if the touch unit 130a receives a contact operation from the operator (YES in step S109), the matching determination unit 146 determines whether the received contact operation matches or is similar to a stored contact operation (step S110).

[0248] If it is determined that they are a match or similar (YES in step S110), the control unit 141 controls the display control unit 145, network communication circuit 156, scanner control circuit 157, printer control circuit 159, etc. to display or process according to the received contact operation (step S111).

[0249] If it is determined that there is no match or similarity (NO in step S110), the release unit 147 returns the effective range of the contact operation to its original state. In other words, the release unit 147 returns the detection area from the second detection area to the first detection area (step S114). The general control unit 141 controls the display control unit 145, network communication circuit 156, scanner control circuit 157, printer control circuit 159, etc. to perform display or processing according to the received contact operation (step S115). Next, the general control unit 141 moves control to step S113.

[0250] If the touch unit 130a does not accept a touch operation from the operator (NO in step S109), the control unit 141 transfers control to step S112.

[0251] The release unit 147 determines whether the release conditions for releasing the second detection area are met (step S112). If the release conditions are not met (NO in step S112), the control unit 141 returns control to step S109 and repeats the process.

[0252] If the release condition is met (YES in step S112), the release unit 147 returns the effective range of the contact operation to its original state. In other words, the release unit 147 returns the detection area from the second detection area to the first detection area (step S113). Next, the control unit 141 returns control to step S101 and repeats the process.

[0253] This concludes the explanation of how the device works when accepting swipe, pinch-in, and pinch-out touch gestures.

[0254] 1.7 Summary As explained above, Example 1 has the effect of making it easier to perform linear contact operations from the second time onward.

[0255] 2. Other variations Several embodiments and modifications have been described above. However, the invention is not limited to these embodiments and modifications. The invention may also be described as follows.

[0256] (1) In the above description, the image forming apparatus 10 is assumed to be a tandem-type color multifunction device having the functions of a scanner, printer, and copier. However, it is not limited to this. A printing device having the function of a printer may be used instead of the image forming apparatus 10. Alternatively, an image reading device having the function of a scanner may be used instead of the image forming apparatus 10.

[0257] (2) The embodiments and modified examples of the above embodiments may be combined.

Industrial Applicability

[0258] The input device of the present disclosure has the effect of facilitating linear contact operations after the second time, and is useful as a technology for receiving input by an operator's contact operation.

Explanation of Signs

[0259] 10 Image forming apparatus 100 Control circuit <00​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​

Claims

1. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A display means having a screen, If it is determined that the operation is drawing a linear trajectory, a display control means controls the display means to switch the content displayed on the screen in accordance with that operation. Equipped with, When the screen is one in which the preview image is located in the center of the background image, the first detection region coincides with the region of the preview image, and the second detection region coincides with the region of the background image. When the display control means detects a pinch-in or pinch-out as the first contact operation, if the subsequent pinch-in or pinch-out operation occurs within the area of ​​the background image including the preview image, the display control means will reduce or enlarge the preview image on the screen according to the pinch-in or pinch-out operation, regardless of whether the operation is performed within or outside the area of ​​the preview image. An input device characterized by the following features.

2. The trajectory determination means further determines whether the next detected contact operation indicates an action that traces a linear trajectory. Furthermore, if it is determined that the operation is drawing a linear trajectory, the system includes a matching determination means for determining whether the operation corresponding to the first detected contact operation and the operation corresponding to the next detected contact operation are the same or similar. The display control means further controls the display means to switch the content displayed on the screen according to the action corresponding to the next detected contact operation, if they match or are similar. The input device according to feature 1.

3. The matching determination means makes the determination by comparing the linear trajectory corresponding to the first detected contact operation with the linear trajectory corresponding to the next detected contact operation. The input device according to feature 2.

4. The trajectory determination means further determines the number of fingers of the operator used in the detected contact operation, The matching determination means further determines that if the number of fingers used by the operator in the first detected contact operation is different from the number of fingers used by the operator in the next detected contact operation, the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation are not identical or similar. The input device according to feature 2.

5. Furthermore, a release means returns the detection region used by the detection means from the second detection region back to the first detection region. The input device according to claim 1, characterized by comprising:

6. The release means returns to the first detection area if no further contact operation is detected after a predetermined time has elapsed since the initial contact operation was detected. The input device according to feature 5.

7. Furthermore, a notification means provides to the operator that the next contact operation is being detected in the second detection area, which is wider than the first detection area and includes the first detection area. The input device according to claim 1, characterized by comprising:

8. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A display means having a screen, If it is determined that the operation is drawing a linear trajectory, a display control means controls the display means to switch the content displayed on the screen in accordance with that operation. Equipped with, The trajectory determination means further determines whether the next detected contact operation indicates an action that traces a linear trajectory. Furthermore, if it is determined that the operation is drawing a linear trajectory, the system includes a matching determination means for determining whether the operation corresponding to the first detected contact operation and the operation corresponding to the next detected contact operation are the same or similar. The display control means further controls the display means to switch the content displayed on the screen in accordance with the action corresponding to the next detected contact operation, if they match or are similar. The matching determination means makes the determination by comparing the linear trajectory corresponding to the first detected contact operation with the linear trajectory corresponding to the next detected contact operation. The display control means further controls the display means to switch the content displayed on the screen according to the length of the linear trajectory corresponding to the next detected contact operation, based on the length of the linear trajectory corresponding to the first detected contact operation. An input device characterized by the following features.

9. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A release means for returning the detection region used by the detection means from the second detection region back to the first detection region, It includes a matching determination means for determining whether the action corresponding to the first detected contact operation and the action corresponding to the next detected contact operation are the same or similar, The release means returns to the first detection area if the matching determination means determines that the linear trajectory corresponding to the first detected contact operation and the linear trajectory corresponding to the next detected contact operation do not match or resemble each other. An input device characterized by the following features.

10. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A release means for returning the detection region used by the detection means from the second detection region back to the first detection region, It includes a release reception means that receives an operation from the operator to return to the first detection area, If the release receiving means receives an operation to return to the first detection area, the release means returns to the first detection area. An input device characterized by the following features.

11. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A release means for returning the detection region used by the detection means from the second detection region back to the first detection region, It includes a voice input means for receiving the operator's voice, When the voice input means receives voice input, the release means returns to the first detection area. An input device characterized by the following features.

12. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A notification means for notifying the operator that the next contact operation is being detected in the second detection area, which is wider than the first detection area and includes the first detection area, A display means having a screen, comprising, The notification means controls the display means to display on the screen that detection is in progress in the second detection area. An input device characterized by the following features.

13. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A notification means for notifying the operator that the next contact operation is being detected in the second detection area, which is wider than the first detection area and includes the first detection area, A display means having a screen, comprising, The largest detection area detectable by the detection means coincides with the display area of ​​the screen, and the second detection area is set within the largest detection area. The notification means controls the display means to highlight the second detection area or an area outside the second detection area and display it on the screen. An input device characterized by the following features.

14. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A notification means for notifying the operator that the next contact operation is being detected in the second detection area, which is wider than the first detection area and includes the first detection area, It comprises an audio output means for outputting sound, The notification means controls the voice output means to notify by voice that detection is in progress in the second detection area. An input device characterized by the following features.

15. An input device that receives input through a touch operation by an operator, Within the first detection area, a detection means for detecting the operator's contact operation, A trajectory determination means for determining whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control means controls the detection means to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. A notification means for notifying the operator that the next contact operation is being detected in the second detection area, which is wider than the first detection area and includes the first detection area, A vibrating means having a vibration function, The notification means controls the vibration means to notify by vibration that detection is in progress in the second detection area. An input device characterized by the following features.

16. An input method used in an input device that receives input through a touch operation by an operator, A detection step that detects the operator's contact operation within the first detection area, A trajectory determination step to determine whether the detected contact operation indicates an action that traces a linear trajectory, If it is determined that the operation is drawing a linear trajectory, a detection control step controls the detection step to detect the next contact operation in a second detection area that is wider than the first detection area and includes the first detection area. Includes, The input device includes a display means having a screen, When the screen is one in which the preview image is located in the center of the background image, the first detection region coincides with the region of the preview image, and the second detection region coincides with the region of the background image. Furthermore, if a pinch-in or pinch-out is detected as the first contact operation by the detection step, if the next contact operation, a pinch-in or pinch-out, occurs within the area of ​​the background image including the preview image, then the preview image on the screen will be displayed in a reduced or enlarged manner according to the pinch-in or pinch-out, regardless of whether the operation is performed within or outside the area of ​​the preview image. An input method characterized by the following:

17. An image forming apparatus comprising an input device according to any one of claims 1 to 15.

Images