Operation input device and image forming device

Abstract

To perform highlighting when an indicator passes above a plurality of operation images before selection of an operation image is settled when receiving input in a non-contact manner to prevent an input error.SOLUTION: An operation input device receives non-contact operations to operation images performed by an indicator. The operation input device comprises a display panel and a detection unit. A detection unit outputs a first output value and a second output value. When a first operation image being an operation image corresponding to the second output value when the first output value is a first reference value and a second operation image being an operation image corresponding to the second output value when the first output value is a second reference value are different from each other, the display panel highlights the first operation image and the second operation image.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an operation input device that accepts a non-contact operation, and to an image forming apparatus that is provided with the operation input device. [Background technology]

[0002] There are devices where input is made by touching the screen. Examples of such devices include ticket machines at stations and car navigation systems. Sometimes the touch position shifts and the user ends up touching the button next to the one they intended to touch. In other words, input errors can occur. When an input error occurs, the user must cancel the input and redo the settings. This is annoying for users. Therefore, displays are sometimes devised to reduce input errors.

[0003] Patent Document 1 describes a touch-type input device that selects one of a plurality of buttons displayed by operating a touchpad and determines the selection based on a pressing operation of the touchpad, in which a point on the touchpad indicated by a user is associated with a virtual pointer in a virtual area including a plurality of buttons displayed on a display device, and each button in the virtual area is set with a selection area and a decision area including the selection area, and a control unit that selects the button corresponding to the selection area when the virtual pointer enters any of the selection areas, and determines the selection when a pressing operation of the touchpad is detected while the virtual pointer is in the decision area corresponding to the selected button. A display is provided so that the desired button can be pressed even if the finger shakes when pressing the button. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-257629 A Summary of the Invention [Problem to be solved by the invention]

[0005] In an input device equipped with a touch panel, buttons (operation keys) are displayed. The user moves his / her finger toward the button he / she wants to press and presses (touches) the surface of the screen. In a touch panel, the end point of the touch action is the screen. The end point of the touch action is clear. Even if the position of the finger shakes or shifts while moving, the position of the finger can be corrected before touching.

[0006] However, infectious diseases can be transmitted by contact with objects (contact infection). Touch panels are touched by human fingers. For this reason, it is possible to equip devices that are touched by multiple people with a non-contact user interface.

[0007] In non-contact selection and input, gestures are made on displayed operation buttons (operation keys). For example, a gesture is made by bringing a finger closer to a button. However, if the position of the finger shakes or the finger is moved diagonally toward the button, there is a high possibility that the input will be accepted as an input for a button other than the intended button. Compared to using a touch panel, it is expected that non-contact input devices will make it easier to make button selection mistakes, i.e., input mistakes.

[0008] The device described in Patent Document 1 is a device in which input is made by pressing a touch panel. It is not a non-contact input device. Patent Document 1 does not mention input errors that may occur with a non-contact input device.

[0009] In consideration of the problems with the conventional technology described above, the present invention provides a method for accepting input non-contact, in which when the pointer passes over multiple operation images before the selection of the operation image is confirmed, the images are highlighted to prevent input errors. [Means for solving the problem]

[0010] In order to solve the above problem, an operation input device according to the present invention accepts a non-contact operation on an operation image by a pointer. The operation input device includes a display panel and a detection unit. The display panel displays an operation screen including the operation image on a display surface. The detection unit outputs a first output value and a second output value. The detection unit outputs a value according to a distance between the display surface and the pointer in a direction perpendicular to the display surface as the first output value. The detection unit outputs a value according to a position of the pointer on a plane parallel to the display surface as the second output value. When a first operation image, which is the operation image corresponding to the second output value when the first output value is a first reference value, is different from a second operation image, which is the operation image corresponding to the second output value when the first output value is a second reference value different from the first reference value, the display panel highlights the first operation image and the second operation image. Effect of the Invention

[0011] According to the present invention, when input is accepted in a non-contact manner, it is possible to highlight a plurality of operation images when a pointer passes over the operation images before the selection of the operation images is confirmed. The highlighting draws attention and prevents input errors. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of a multifunction peripheral according to an embodiment. [Diagram 2] FIG. 4 is a diagram illustrating an example of an operation panel according to the embodiment. [Diagram 3] FIG. 4 is a diagram illustrating an example of a detection unit according to the embodiment. [Figure 4] 5A to 5C are diagrams illustrating an example of detection of the distance and position of a pointer according to the embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of division of an area on an operation screen according to the embodiment; [Figure 6] FIG. 11 is a diagram illustrating an example of a designated position display according to the embodiment. [Figure 7] 11A and 11B are diagrams illustrating an example of a non-contact operation and a highlighting display according to an embodiment. [Figure 8]FIG. 13 is a diagram illustrating an example of an operation screen in which a highlighted display is displayed according to the embodiment. [Figure 9] FIG. 13 is a diagram showing an example of a screen display when a selected operation image is confirmed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] 1 to 8, an operation input device 100 according to an embodiment of the present invention and an image forming device including the operation input device 100 will be described below. In the following description, a multifunction peripheral 200 will be taken as an example of an image forming device. However, the elements of the configuration, arrangement, etc. described in each embodiment do not limit the scope of the invention and are merely illustrative examples.

[0014] (1.Multifunction machine 200) First, an overview of a multifunction peripheral 200 according to an embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a diagram showing an example of a multifunction peripheral 200 according to an embodiment. Fig. 2 is a diagram showing an example of an operation panel 4 according to an embodiment.

[0015] The multifunction device 200 includes a control unit 1, a storage unit 2, a document reading unit 3, an operation panel 4, and a printing unit 5. The control unit 1 controls the operation of the multifunction device 200. For example, the control unit 1 is a circuit board. The control unit 1 controls the operation of each unit of the multifunction device 200 for a job (copying or sending). The control unit 1 includes a control circuit 11, an image data generation circuit 12, an image processing circuit 13, and a communication circuit unit 14. The control circuit 11 performs processing and calculations related to the job. The image data generation circuit 12 includes an A / D conversion circuit. The image data generation circuit 12 processes the analog image signal output by the document reading unit 3 after reading the document, and generates document image data. The image processing circuit 13 is an integrated circuit for image processing (for example, an ASIC). The image processing circuit 13 performs image processing of the document image data.

[0016] The communication circuit unit 14 includes a communication control circuit and a communication memory. The communication memory stores communication software. The communication control circuit controls communication based on the communication software. The communication circuit unit 14 communicates with a computer 300. For example, the computer 300 is a PC or a server. The communication circuit unit 14 receives print data from the computer 300. Based on the received print data, the control unit 1 causes the printing unit 5 to print (print job). Also, in a scan transmission job, the control unit 1 causes the communication circuit unit 14 to transmit a transmission file based on the document image data to a set destination.

[0017] The multifunction device 200 includes a RAM, a ROM, and a storage as a memory unit 2. For example, the storage is either an HDD or an SSD, or both. The control unit 1 controls each unit based on the programs and data stored in the memory unit 2. The document reading unit 3 includes a light source and an image sensor. The document reading unit 3 reads a document and outputs an analog image signal.

[0018] The operation panel 4 accepts settings from the user. The operation panel 4 includes a display panel 6 and a detection unit 7. The operation panel 4 may or may not include hard keys for operation. FIG. 2 shows an example of the operation panel 4 including a hard key for transitioning to a home screen. For example, the display panel 6 is a liquid crystal display panel or an organic EL display panel. As shown in FIG. 2, the display panel 6 is a part of the operation panel 4, and a display surface 61 is visible. The control unit 1 causes a message and an operation screen 62 (setting screen) to be displayed on the display panel 6 (display surface 61). That is, the display panel 6 displays the operation screen 62 on the display surface 61. FIG. 2 shows an example of the operation panel 4 that displays a home screen. The home screen is a type of the operation screen 62.

[0019] The operation screen 62 includes an operation image i0 selected by a non-contact operation. The control unit 1 causes the display panel 6 to display the operation image i0. For example, the operation image i0 is an image such as a button (soft key), a tab, or an icon. The operation panel 4 includes a detection unit 7. The detection unit 7 is attached to the display surface 61 of the display panel 6. For example, the detection unit 7 includes a projected capacitive panel. The detection unit 7 can also be used as a touch panel. Based on the output of the detection unit 7, the control unit 1 recognizes the operated operation image i0 (details will be described later). For example, the operation panel 4 accepts the type of job to be executed and the setting value of the job. Based on the output of the operation panel 4, the control unit 1 recognizes the setting content.

[0020] The printing unit 5 includes a paper feed unit 5a, a paper transport unit 5b, an image forming unit 5c, and a fixing unit 5d. For example, the paper feed unit 5a includes a paper cassette for setting paper and a paper feed roller for feeding paper. When printing, the control unit 1 causes the paper feed unit 5a to supply paper. The paper transport unit 5b includes, for example, a motor and a pair of transport rollers. The control unit 1 causes the paper transport unit 5b to transport the paper sent out from the paper feed unit 5a. For example, the image forming unit 5c includes a photosensitive drum, a charging device, an exposure device, a developing device, and a transfer roller. The control unit 1 charges the photosensitive drum and exposes the photosensitive drum based on image data. The control unit 1 also develops the electrostatic latent image on the photosensitive drum with toner. The control unit 1 also transfers the toner image to the paper. For example, the fixing unit 5d includes a heater and a fixing roller. The control unit 1 causes the fixing unit 5d to heat and pressurize the paper to which the toner image has been transferred. The control unit 1 causes the fixing unit 5d to fix the toner image.

[0021] (2. Operation Input Device 100) An example of the operation input device 100 according to the embodiment will be described with reference to Fig. 2 to Fig. 4. Fig. 3 is a diagram showing an example of the detection unit 7 according to the embodiment. Fig. 4 is a diagram showing an example of detection of the distance and position of the indicator according to the embodiment.

[0022] The operation input device 100 includes an operation panel 4. The operation panel 4 includes a display panel 6 and a detection unit 7. In the following description, an example will be described in which the output of the detection unit 7 is input and the control unit 1 performs processing related to highlighting. Therefore, the operation input device 100 may also include the control unit 1. Note that, instead of the control unit 1, a display control circuit (display control unit) may be provided in the operation panel 4, which receives the output of the detection unit 7 and performs control and processing related to highlighting. In this case, the display control circuit may perform the control and processing of the control unit 1 described below.

[0023] The operation input device 100 is a device that accepts non-contact operation by an indicator. The indicator is moved to indicate and select an operation image i0 displayed on the display panel 6. The indicator may be a finger of a user (a person setting) of the operation panel 4. The indicator may also be a tool such as a pen (stylus pen) that is held by the user and to which the detection unit 7 reacts. The shape of the indicator as a tool is not limited to a pen type. As in the case of the touch type, it is assumed that the indicator will often be a finger.

[0024] The detection unit 7 detects the position of the pointer. As shown in FIG. 3, the detection unit 7 includes a capacitance detection panel and a panel controller 71. In the following description, the capacitance detection panel is referred to as a detection panel 72. The detection panel 72 is transparent. For example, the detection panel 72 is attached to the display surface 61 of the display panel 6. A capacitance detection touch panel can be used as the detection panel 72. The detection panel 72 has a higher sensitivity than a touch panel whose surface is actually touched.

[0025] In the following description, the direction perpendicular to the display surface 61 of the display panel 6 is referred to as the Z direction. For example, the display surface 61 of the display panel 6 is rectangular. One of the long and short directions of the display surface 61, which is perpendicular to the Z direction and parallel to the display surface 61 of the display panel 6, is referred to as the X direction, and the other is referred to as the Y direction. In the following description, when viewing the display surface 61 of the display panel 6 from the front, the left-right direction is referred to as the X direction, and the up-down direction is referred to as the Y direction.

[0026] FIG. 3 is a diagram showing an example of the detection panel 72. For example, the detection panel 72 includes electrodes arranged in a matrix. The electrodes are transparent. The detection panel 72 includes a layer including a plurality of electrodes (hereinafter referred to as X electrodes) arranged in an X direction (vertical direction in FIG. 3) and connected by a diamond-shaped (rectangular) conductive film. In FIG. 3, the X electrodes are denoted by symbols X1 to Xn. The detection unit 7 includes a layer including a plurality of electrodes (hereinafter referred to as Y electrodes) arranged in a Y direction (horizontal direction in FIG. 3) and connected by a diamond-shaped (rectangular) conductive film. In FIG. 3, the Y electrodes are denoted by symbols Y1 to Yn. The resolution of the detection unit 7 is determined based on the number of X electrodes and the number of Y electrodes.

[0027] Each electrode (conductive film) is connected to the panel controller 71. The capacitance detected by the panel controller 71 differs between when the pointer is held over the upper surface of the detection unit 7 and when it is not held over the upper surface. When the user brings the pointer close to the upper surface of the detection unit 7 (detection panel 72), the capacitances of the electrodes and the pointer (human body) are coupled. The detected capacitance differs depending on the degree of capacitance coupling. In other words, the magnitude of the detected capacitance differs depending on the distance between the upper surface of the detection unit 7 (display surface 61 of the display panel 6) and the pointer (see FIG. 4).

[0028] For example, the panel controller 71 applies a voltage to one of the X and Y electrodes. The panel controller 71 switches between the electrodes to which the voltage is applied in sequence. The panel controller 71 also reads the voltage of each of the other electrodes (electrodes to which no voltage is applied). If a voltage is applied to adjacent electrode patterns and there is a potential difference between the electrodes, a capacitance according to the insulator (dielectric) is obtained. For example, the closer the finger is to the detection unit 7, the greater the detected capacitance.

[0029] For example, the capacitance when no pointer is held over is set as the reference capacitance. The panel controller 71 recognizes the electrodes whose capacitance has changed from the reference capacitance. The panel controller 71 determines the capacitance of the electrode whose capacitance has changed the most. The capacitance value corresponds to the distance between the pointer and the detection unit 7 (display surface 61). The panel controller 71 also determines the coordinates of the electrode whose capacitance has changed the most as the position of the pointer (coordinates on the XY plane). The coordinates are information indicating which X electrode and which Y electrode it is.

[0030] The panel controller 71 notifies the control unit 1 of the magnitude of the obtained capacitance and the position (coordinates) of the indicator. Hereinafter, a value indicating the magnitude of the obtained capacitance is referred to as a first output value V1. Also, a value indicating the determined position (coordinates) of the indicator is referred to as a second output value V2. The detection unit 7 outputs the first output value V1 and the second output value V2 to the control unit 1 (see FIG. 3). That is, the detection unit 7 outputs a value according to the distance between the display surface 61 and the indicator in the direction perpendicular to the display surface 61 as the first output value V1. The detection unit 7 outputs a value according to the position of the indicator as viewed from a plane parallel to the display surface 61 (position on the XY plane) as the second output value V2.

[0031] The detection unit 7 may recognize the distance and the position of the indicator by using other methods. For example, the panel controller 71 may recognize the distance and the position of the indicator by measuring the charging speed of the electric charge of each electrode. The detection unit 7 may also be a capacitive touch panel of another type. The detection unit 7 may also use an infrared detection device that includes a plurality of infrared emitting elements and a plurality of infrared receiving elements and detects the distance between the display surface 61 and the indicator and the position of the indicator as viewed from a plane parallel to the display surface 61.

[0032] (3. Division of operation screen 62) Next, an example of division of areas on the operation screen 62 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of division of areas on the operation screen 62 according to the embodiment.

[0033] FIG. 5 shows an example of an operation screen 62 displayed on the operation panel 4 and the display panel 6. As shown in FIG. 5, the operation screen 62 may be divided in advance into a plurality of divided areas F1. The dashed lines in FIG. 5 indicate the boundaries of the divided areas F1. As shown in FIG. 5, the control unit 1 may display the boundaries of the divided areas F1. Also, the control unit 1 may not display the boundaries of the divided areas F1. Each divided area F1 includes one operation image i0 (button).

[0034] (4. Confirmation of selection and operation screen 62 and non-contact operation) Next, an example of a non-contact operation in the operation input device 100 according to the embodiment will be described with reference to Fig. 4 to Fig. 6. Fig. 6 is a diagram showing an example of a designated position display according to the embodiment.

[0035] The operation input device 100 accepts non-contact operation. The selection of the operation image i0 can be confirmed without touching the operation image i0 (button) displayed on the display panel 6. This eliminates the need to touch the display surface 61 of the display panel 6 when operating or inputting. This reduces contact with objects that are touched by multiple people. This has the effect of preventing mass infection of infectious diseases in the office.

[0036] When selecting an operation image i0 displayed on the display panel 6, the user brings the pointer (finger) close to the operation image i0 to be selected. The control unit 1 determines (recognizes) the operation image i0 that the pointer comes close enough to, without touching the display panel 6, as the selected operation image i0. In other words, input can be performed by bringing the pointer close.

[0037] For non-contact operation, in the operation input device 100, there are a first distance L1, a second distance L2, and a third distance L3 between the display surface 61 and the indicator in a direction perpendicular to the display surface 61. The relationship is first distance L1>second distance L2>third distance L3. The third distance L3 is greater than zero. The first distance L1 is the distance at which the first output value V1 becomes the first reference value R1. The second distance L2 is the distance at which the first output value V1 becomes the second reference value R2. The third distance L3 is the distance at which the first output value V1 becomes the third reference value R3. The memory unit 2 stores the first reference value R1, the second reference value R2, and the third reference value R3 in a non-volatile manner (see FIG. 1).

[0038] For example, the first distance L1 is 10 cm. The first reference value R1 is a capacitance value detected when the distance between the display surface 61 and the indicator in the direction perpendicular to the display surface 61 is about 10 cm. The first distance L1 may be longer or shorter than 10 cm. For example, the second distance L2 is 6 cm. The second reference value R2 is a capacitance value detected when the distance between the display surface 61 and the indicator in the direction perpendicular to the display surface 61 is about 6 cm. The second distance L2 may be longer or shorter than 6 cm. For example, the third distance L3 is 2 cm. The third reference value R3 is a capacitance value detected when the distance between the display surface 61 and the indicator in the direction perpendicular to the display surface 61 is about 2 cm. The third distance L3 may be longer or shorter than 2 cm. When the detected capacitance increases as the pointer approaches, the relationship is third reference value R3>second reference value R2>first reference value R1.

[0039] Even if the distance between the display surface 61 and the pointer is the same, the detected capacitance may vary depending on the person. Also, the magnitude of the detected capacitance may be affected by humidity. Therefore, the first distance L1, the second distance L2, and the third distance L3 may vary depending on the person or the environment.

[0040] When confirming the selection of the operation image i0, the user moves the indicator closer to the operation image i0 to be selected. The control unit 1 recognizes the position of the indicator on a plane parallel to the display surface 61 (the position of the indicator on the XY plane) based on the second output value V2. The control unit 1 determines the operation image i0 that overlaps with the position of the indicator on the XY plane when the indicator is at the third distance L3 as the selected operation image i0. In other words, the control unit 1 determines the operation image i0 that overlaps with the position of the indicator on the XY plane when the first output value V1 becomes the third reference value R3 as the selected operation image i0. For example, the control unit 1 causes the display panel 6 to newly display the operation screen 62 corresponding to the operation image i0 that has been determined to be selected.

[0041] Furthermore, when the first output value V1 becomes the third reference value R3, the control unit 1 may determine the operation image i0 included in the divided region F1 overlapping the position (coordinates) of the indicator recognized based on the second output value V2 as the selected operation image i0. In this case, there is an effect of substantially expanding the area within which it is determined that the operation image i0 has been operated. For example, even if the position of the indicator recognized based on the second output value V2 is outside the operation image i0, the control unit 1 determines the operation image i0 included in the divided region F1 overlapping the position of the indicator as the selected operation image i0.

[0042] Furthermore, the operation input device 100 may display an instruction position. The instruction position display is a display that clearly indicates the operation image i0 pointed to by the indicator before the selected operation image i0 is confirmed. The instruction position display can also be said to be a display that clearly indicates the operation image i0 that will be selected if the finger is brought closer. For example, the control unit 1 causes the display panel 6 to display an instruction position for the operation image i0 that corresponds to the position of the indicator on a plane parallel to the display surface 61 while the distance between the indicator and the display surface 61 exceeds the third distance L3 and is less than the first distance L1 (first reference value R1≦first output value V1<third reference value R3).

[0043] The control unit 1 may recognize the operation image i0 overlapping the position (coordinates) of the indicator recognized based on the second output value V2 as the indicated operation image i0. The control unit 1 may also recognize the operation image i0 included in the divided region F1 overlapping the position (coordinates) of the indicator recognized based on the second output value V2 as the indicated operation image i0. In this case, the range determined to be indicating the operation image i0 is substantially expanded. For example, even if the position of the indicator recognized based on the second output value V2 is outside the operation image i0, the control unit 1 recognizes the operation image i0 included in the divided region F1 overlapping the position of the indicator as the indicated operation image i0.

[0044] The control unit 1 may display only the indicated operation image i0 as the indicated position. The control unit 1 may also display the indicated position for the entire divided area F1 including the indicated operation image i0. When displaying the indicated position, the control unit 1 may add a display color to the indicated operation image i0 or the divided area F1 including the indicated operation image i0. For example, the control unit 1 may set the color of the portion (pixels) other than the characters and lines of the indicated operation image i0 or the divided area F1 including the indicated operation image i0 as the indicated position display color. The indicated position display color may be gray, blue, or red. Furthermore, the operation panel 4 may accept the selection of the indicated position display color. In this case, the control unit 1 uses the selected indicated position display color. The user can grasp the operation image i0 that the control unit 1 recognizes as being indicated.

[0045] FIG. 6 is a diagram showing an example of the indication position display. FIG. 6 shows an example of a state in which an operation image i0 including the character "Copy" is indicated. For example, when the indicator (finger) is moved to the right in the state of FIG. 6, the indication position display of the operation image i0 including the character "Copy" is released, and the indication position display of the operation image i0 including the character "Send" is started. This allows the operation image i0 for which an indication is being accepted to be known when the indicator is moved above the display panel 6. The indication position indication color may be different from or the same as the first emphasis color described later. Also, the indication position indication color may be different from or the same as the second emphasis color described later.

[0046] (5. Non-contact operation and highlighting) Next, an example of non-contact operation and highlighting in the operation input device 100 according to the embodiment will be described with reference to Figs. 7 to 9. Fig. 7 is a diagram showing an example of non-contact operation and highlighting according to the embodiment. Fig. 8 is a diagram showing an example of an operation screen 62 that is highlighted according to the embodiment. Fig. 9 is a diagram showing an example of a screen display when the selected operation image i0 is confirmed.

[0047] The start of Fig. 7 is the point when the display panel 6 starts displaying, the detection unit 7 starts operating, and the operation input device 100 (operation panel 4) becomes ready to accept operation. For example, when the main power switch of the multifunction device 200 is turned on, or when the power saving mode of the multifunction device 200 is released, the flowchart of Fig. 7 starts. First, the control unit 1 continues to check whether the first output value V1 has become the first reference value R1 (Step #1, No in Step #1 -> Step #1). That is, the control unit 1 checks whether the indicator has approached the display surface 61 until the distance between the indicator and the display surface 61 becomes the first distance L1.

[0048] When the first output value V1 becomes the first reference value R1 (Yes in step #1), the control unit 1 recognizes the first operation image i1 (step #2). The first operation image i1 is the operation image i0 (the operation image i0 corresponding to the second output value V2) that is indicated when the first output value V1 becomes the first reference value R1. In other words, the control unit 1 recognizes the operation image i0 below the indicator when the distance between the indicator and the display surface 61 is the first distance L1 as the first operation image i1.

[0049] After the first output value V1 becomes the first reference value R1, the control unit 1 checks whether the first output value V1 becomes the second reference value R2 (step #3). That is, as a result of the pointer being brought closer to the display surface 61, the control unit 1 checks whether the distance of the pointer to the display surface 61 becomes the second distance L2.

[0050] For example, after step #2, when the distance between the display surface 61 and the indicator exceeds the first distance L1, the indicator is separated from the display surface 61. In this case, the control unit 1 may determine that the first output value V1 has not become the second reference value R2 (No in step #3). In this case, the control unit 1 executes step #1 (return to step #1). For example, in the case where the detected capacitance increases as the distance between the indicator and the display surface 61 becomes closer, when the first output value V1 becomes less than the first reference value R1, the control unit 1 may determine that the first output value V1 has not become the second reference value R2.

[0051] After the first output value V1 becomes the first reference value R1, the user may wander the indicator while maintaining the distance between the indicator and the display surface 61. For example, the user may be confused about which operation image i0 to select and may wander the indicator. After the distance between the display surface 61 and the indicator becomes the first distance L1, while the distance between the display surface 61 and the indicator is closer than the first distance L1 (while the first output value V1 is a value when the distance is closer than the first reference value R1), the control unit 1 may continue to monitor the first output value V1 at a predetermined cycle. For example, if the detected capacitance increases as the distance between the indicator and the display surface 61 becomes closer, after the first output value V1 becomes equal to or greater than the first reference value R1, the control unit 1 may continue to monitor the first output value V1 at a predetermined cycle while the first output value V1 is equal to or greater than the first reference value R1.

[0052] When the first output value V1 becomes the second reference value R2 (Yes in step #3), the control unit 1 recognizes the second operation image i2 (step #4). The second operation image i2 is the operation image i0 (the operation image i0 corresponding to the second output value V2) that was indicated when the first output value V1 became the second reference value R2. In other words, the control unit 1 recognizes the operation image i0 below the indicator when the distance between the indicator and the display surface 61 is the second distance L2 as the second operation image i2.

[0053] Then, the control unit 1 checks whether the first operation image i1 and the second operation image i2 are the same (step #5). In other words, the control unit 1 checks whether the operation image i0 designated at the first distance L1 is the same as the operation image i0 designated at the second distance L2. That is, the control unit 1 checks whether the position of the indicator has shifted or swayed in the process of moving the indicator toward the third distance L3.

[0054] When the first operation image i1 and the second operation image i2 are the same (Yes in step #5), the control unit 1 does not highlight the image (step #6). When the first operation image i1 and the second operation image i2 are different (No in step #5), the control unit 1 highlights the image (step #7).

[0055] FIG. 8 shows an example of highlighting. FIG. 8 shows an example in which the first operation image i1 is a button including the characters "Fax Box" and the second operation image i2 is a button including the characters "Polling Box". When highlighting is performed, as shown in FIG. 8, the control unit 1 may display the first operation image i1 in a first highlight color on the display panel 6. For example, the control unit 1 displays pixels other than the characters and frame lines of the first operation image i1 in the first highlight color. Furthermore, as shown in FIG. 8, the control unit 1 may highlight not only the first operation image i1 but also the divided area F1 including the first operation image i1 on the display panel 6.

[0056] 8, the control unit 1 may cause the display panel 6 to display the second operation image i2 in a second accent color. For example, the control unit 1 may cause pixels other than the characters and frame lines of the second operation image i2 to be displayed in the second accent color. Furthermore, as shown in FIG. 8, the control unit 1 may cause the display panel 6 to highlight not only the second operation image i2 but also the divided area F1 including the second operation image i2.

[0057] The first highlight color is determined in advance. The first highlight color may be blue, red, or another color. The operation panel 4 may accept the selection of the first highlight color. The second highlight color is also determined in advance. The second highlight color may be blue, red, or another color. The operation panel 4 may accept the selection of the second highlight color. The first highlight color and the second highlight color are different. However, the first highlight color and the second highlight color may be the same color. FIG. 8 shows an example in which the first highlight color and the second highlight color are different. By highlighting, the operation image i0 in which the pointer is located above can be clearly displayed in the process of bringing the pointer closer to the display surface 61. The user can be informed of the possibility that a non-contact operation that selects an undesired operation image i0 is being performed. The user can be urged to operate carefully to avoid input errors.

[0058] The highlighting may be performed by a method other than adding a display color. For example, the control unit 1 may blink or enlarge the first operation image i1, the second operation image i2, or the divided area F1 including them, change the color of the characters included, or add a mark such as an arrow.

[0059] Furthermore, when highlighting, the control unit 1 may display a message M1 indicating the purpose of highlighting on the display panel 6 (step #8). As shown in FIG. 8. The control unit 1 may display a message M1 (first message) such as "Please bring your finger close to the button you want to select among the colored buttons." The message M1 urges the user to operate the buttons carefully. Alternatively, the control unit 1 may display a message M1 on the display panel 6 informing the user that there was a deviation in the indicated position during the non-contact operation. As shown in FIG. 8, the control unit 1 may display a speech bubble including the message M1. If a message display area is provided on the operation screen 62, the control unit 1 may display the message M1 in the message display area.

[0060] After step #7 or step #9, the control unit 1 eventually recognizes that the first output value V1 has become the third reference value R3 (step #9). The control unit 1 recognizes the third operation image i3 (step #10). The third operation image i3 is the operation image i0 (the operation image i0 corresponding to the second output value V2) that was specified when the first output value V1 became the third reference value R3. Then, the control unit 1 determines that the third operation image i3 is the selected operation image i0 (step #11). For example, the control unit 1 newly displays the operation screen 62 corresponding to the selected operation image i0 on the display panel 6. Then, the control unit 1 executes step #1 (return to step #1).

[0061] Note that the control unit 1 may display the second message M2 before displaying the new operation screen 62 by confirming the selected operation image i0 (third operation image i3). In other words, the control unit 1 may display the second message M2 on the display panel 6 and then display the new operation screen 62 on the display panel 6. Fig. 9 shows an example of the display of the second message M2. The control unit 1 displays, as the second message M2, a message informing the user that the operation image i0 (third operation image i3) has been confirmed as selected.

[0062] Highlighting does not mean that operation is no longer possible. After highlighting, the user can continue operation (selection of the operation image i0). Highlighting does not impede operation. The user moves the indicator (finger) closer toward the operation image i0 that he or she wants to select. When the first output value V1 reaches the third reference value R3, the selected operation image i0 is confirmed. Note that the operation image i0 whose selection can be confirmed is not limited to the highlighted operation image i0. It is also possible to move the indicator toward the highlighted operation image i0 and confirm the selection of the operation image i0.

[0063] When highlighting is performed, the control unit 1 may cause the display panel 6 to continue the highlighting until the first output value V1 becomes equal to the third reference value R3. After starting the highlighting, when the first output value V1 becomes equal to the first reference value R1, the control unit 1 may cause the display panel 6 to end the highlighting.

[0064] (6. Modifications) Next, a modified example of the operation input device 100 according to the present invention will be described. In the above description, an example was described in which a warning is displayed when the operation image i0 designated at the first distance L1 is different from the operation image i0 designated at the second distance L2. That is, an example was described in which the designated operation image i0 is confirmed twice until the operation image i0 is selected. However, the designated operation image i0 may be confirmed three or more times between the first distance L1 and the third distance L3. When all of the designated operation images i0 do not match, the control unit 1 may display a warning about the designated operation image i0.

[0065] In this way, the operation input device 100 according to the embodiment and the modified example accepts a non-contact operation on the operation image i0 by the indicator. The operation input device 100 includes a display panel 6 and a detection unit 7. The display panel 6 displays an operation screen 62 including the operation image i0 on a display surface 61. The detection unit 7 outputs a first output value V1 and a second output value V2. The detection unit 7 outputs a value according to the distance between the display surface 61 and the indicator in a direction perpendicular to the display surface 61 as the first output value V1. The detection unit 7 outputs a value according to the position of the indicator on a plane parallel to the display surface 61 as the second output value V2. When a first operation image i1, which is an operation image i0 corresponding to the second output value V2 when the first output value V1 is a first reference value R1, is different from a second operation image i2, which is an operation image i0 corresponding to the second output value V2 when the first output value V1 is a second reference value R2 different from the first reference value R1, the display panel 6 highlights the first operation image i1 and the second operation image i2.

[0066] If the operation image i0 indicated before the selection and confirmation of the operation image i0 is different, there is a possibility that the indicator (finger) has shaken, or the indicator has been brought close at an angle to a plane parallel to the display surface 61. There is a possibility that a non-contact operation has been performed so that the operation image i0 to be selected is not selected. In other words, there is a possibility that the gesture will result in an input error. When there is a possibility of such an input error, it is possible to clearly indicate the operation image i0 indicated at each distance (each first output value V1). In other words, when there are multiple operation images i0 over which the indicator is held during the non-contact operation process to select the operation image i0, it is possible to clearly indicate the multiple held operation images i0. This makes it possible to make the user aware that an input error may occur. By highlighting, it is possible to inform the user that there may be a problem with the gesture to select the operation image i0.

[0067] The operation input device 100 includes a control unit 1. The control unit 1 receives the output of the detection unit 7. Based on the second output value V2, the control unit 1 may recognize the position of the indicator on a plane parallel to the display surface 61. The control unit 1 may determine the operation image i0 corresponding to the second output value V2 when the first output value V1 is the first reference value R1 as the first operation image i1. The control unit 1 may determine the operation image i0 corresponding to the second output value V2 when the first output value V1 is the second reference value R2 as the second operation image i2. Based on the second output value V2, the operation image i0 in which the indicator is located above can be determined. This allows the first operation image i1 and the second operation image i2 to be accurately determined.

[0068] The display panel 6 may newly display the operation screen 62 corresponding to the third operation image i3. The third operation image i3 is the operation image i0 determined to be selected, and corresponds to the second output value V2 when the first output value V1 becomes the third reference value R3. The third reference value R3 is a value when the distance is closer than the first reference value R1 and the second reference value R2. The display panel 6 may perform an indication position display showing the operation image i0 indicated by the indicator while the first output value V1 is equal to or greater than the first reference value R1 and less than the third reference value R3. The third distance L3 is closer to the display surface 61 than the first distance L1 and the second distance L2. The indicator is highlighted before approaching the display surface 61 to the third distance L3. The indicator can be highlighted before the selected operation image i0 is confirmed by bringing the indicator closer to the display surface 61 to the third distance L3. The user can select the operation image i0 after being notified of the possibility of an input error by the highlighting. The operation can be continued even after the highlighting. In other words, the operation image i0 to be selected for highlighting can be determined. Therefore, the highlighting does not interfere with the operation. Also, the operation image i0 pointed to by the pointer can be clearly displayed before the selection is confirmed.

[0069] The control unit 1 receives the output of the detection unit 7. The control unit 1 recognizes the position of the indicator on a plane parallel to the display surface 61 based on the second output value V2. The control unit 1 may determine the operation image i0 corresponding to the second output value V2 when the first output value V1 is the first reference value R1 as the first operation image i1. The control unit 1 may determine the operation image i0 corresponding to the second output value V2 when the first output value V1 is the second reference value R2 as the second operation image i2. The control unit 1 may determine the operation image i0 corresponding to the second output value V2 when the first output value V1 is the third reference value R3 as the third operation image i3. The control unit 1 may determine the third operation image i3 as the selected operation image i0. While the first output value V1 is equal to or greater than the first reference value R1 and less than the third reference value R3, the control unit 1 may cause the display panel 6 to perform an indication position display for the operation image i0 corresponding to the second output value V2. The third distance L3 is closer to the display surface 61 than the first distance L1 and the second distance L2. Highlighting is performed before the indicator approaches the display surface 61 to the third distance L3. As a result, after highlighting, the desired operation image i0 can be selected by moving the indicator closer to the operation image i0 to be selected. In other words, the user can check the possibility of an input error by the highlighting and then select the operation image i0. The operation can be continued even after highlighting. Highlighting does not interfere with the operation. In addition, the operation image i0 pointed to by the indicator can be clearly displayed before the selection is confirmed.

[0070] When highlighting the first operation image i1, the display panel 6 may display the first operation image i1 in a predetermined first highlight color. The first operation image i1 can be highlighted in a specific color. The operation image i0 determined to be selected when the user is at the first distance L1 can be clearly shown to the user.

[0071] When highlighting the second operation image i2, the display panel 6 may display the second operation image i2 in a predetermined second highlight color. The second operation image i2 can be highlighted in a specific color. The operation image i0 determined to be selected when the second distance L2 is reached can be clearly shown to the user. Furthermore, the first operation image i1 and the second operation image i2 may be clearly shown by using different highlight colors.

[0072] The operation screen 62 may be divided into a plurality of divided regions F1 in advance. One divided region F1 may include one operation image i0 and may be a region larger than the operation image i0 included therein. The display panel 6 may highlight the divided region F1 including the operation image i0 to be highlighted. A region larger than the operation image i0 can be highlighted. The area to be highlighted can be enlarged. This makes it easier to see which operation image i0 is highlighted.

[0073] The display panel 6 may display the boundary of the divided region F1. The boundary can be visually recognized. Furthermore, when the first operation image i1 and the second operation image i2 are highlighted, the display panel 6 may display a message M1 indicating the purpose of the highlighting. Even a first-time operator can understand the purpose (intention) of the highlighting.

[0074] The image forming apparatus (multifunction device 200) according to the embodiment includes the above-mentioned operation input device 100 and a printing unit 5 that performs printing. It is possible to display the operation image i0 selected when the distance between the indicator and the display surface 61 is a first distance L1, and the operation image i0 selected when the distance is a second distance L2. The highlighted display can inform the user that there may be a problem with the gesture to select the operation image i0. It can make the user aware that an input error may occur. It is possible to provide an image forming apparatus with fewer input errors while including the non-contact type operation input device 100.

[0075] Although the embodiment of the present invention has been described, the scope of the present invention is not limited to this embodiment, and various modifications can be made without departing from the spirit of the invention. [Industrial Applicability]

[0076] The present invention can be used in an operation input device and an image forming apparatus that accept non-contact operations. [Explanation of symbols]

[0077] 100 Operation input device 200 Multifunction device (image forming device) 1 Control unit 5 Printing unit 6 Display panel 61 Display surface 62 Operation screen 7 Detection unit F1 Division area M1 Message R1 First reference value R2 Second reference value R3 3rd reference value V1 1st output value V2 Second output value i0 Operation image i1 1st operation image i2 2nd operation image i3 3rd operation image

Claims

1. An operation input device that accepts a non-contact operation on an operation image by a pointer, a display panel that displays an operation screen including the operation image on a display surface; a detection unit that outputs a first output value and a second output value, The detection unit is outputting, as the first output value, a value corresponding to a distance between the display surface and the indicator in a direction perpendicular to the display surface; outputting, as the second output value, a value corresponding to a position of the indicator on a plane parallel to the display surface; An operation input device in which, when a first operation image, which is the operation image corresponding to the second output value when the first output value is a first reference value, and a second operation image, which is the operation image corresponding to the second output value when the first output value is a second reference value different from the first reference value, are different, the display panel highlights the first operation image and the second operation image.

2. A control unit is provided, The control unit is The output of the detection unit is input, recognizing a position of the indicator on a plane parallel to the display surface based on the second output value; determining, as a first operation image, the operation image corresponding to the second output value when the first output value is the first reference value; The operation input device according to claim 1 , wherein the operation image corresponding to the second output value when the first output value is the second reference value is determined to be a second operation image.

3. the display panel newly displays the operation screen corresponding to the third operation image; the third operation image is the operation image that is determined to be selected and corresponds to the second output value when the first output value becomes a third reference value, The third reference value is a value when the distance is shorter than the first reference value and the second reference value. is the value, The operation input device according to claim 1 or 2, wherein the display panel displays an indication position showing the operation image being indicated by the indicator while the first output value is equal to or greater than the first reference value and less than the third reference value.

4. A control unit is provided, The control unit is The output of the detection unit is input, recognizing a position of the indicator on a plane parallel to the display surface based on the second output value; determining, as a first operation image, the operation image corresponding to the second output value when the first output value is the first reference value; determining, as a second operation image, the operation image corresponding to the second output value when the first output value is the second reference value; determining, as the third operation image, the operation image corresponding to the second output value when the first output value is the third reference value; determining the third operation image as the selected operation image; The operation input device according to claim 3 , wherein while the first output value is equal to or greater than the first reference value and less than the third reference value, the display panel performs the indication position display for the operation image corresponding to the second output value.

5. When the first operation image is highlighted, The operation input device according to claim 1 , wherein the display panel displays the first operation image in a predetermined first accent color.

6. When the second operation image is highlighted, The operation input device according to claim 1 , wherein the display panel displays the second operation image in a second accent color that is determined in advance.

7. The operation screen is divided into a plurality of divided areas in advance, One of the divided regions is Including one of the operation images, an area larger than the one operation image, The operation input device according to claim 1 , wherein the display panel highlights the divided area including the operation image to be highlighted.

8. The operation input device according to claim 7 , wherein the display panel displays the boundaries of the divided regions.

9. When the first operation image and the second operation image are displayed in a highlighted manner, The operation input device according to claim 1 , wherein the display panel displays a message indicating the purpose of the highlighting.

10. An operation input device according to any one of claims 1 to 9; and a printing unit that performs printing.

Images