Display input device and image forming apparatus

Abstract

To improve operability for a user by controlling whether or not to generate vibration or notification sound for causing the user to recognize a touch operation, according to an operating state of a device.SOLUTION: An image forming apparatus 10 comprises: a display unit 21 which displays an operation object; a touch panel 23 which detects a touch operation to the operation object displayed on the display unit 21; a vibration generation unit 26 which generates vibration on a screen of the display unit 21 and a buzzer 25 which generates notification sound; and a control unit 31 which activates the vibration generation unit 26 or the buzzer 25 to generate the vibration or the notification sound when a touch operation to the operation object is detected by the touch panel 23. The control unit 31 switches existence of the vibration or the notification sound of the vibration generation unit 26 or the buzzer 25 depending on which of a plurality of preset operating states the image forming apparatus 10 is in.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a display input device and an image forming apparatus in which input is performed by a touch operation, and more particularly to a technique for notifying whether or not a touch operation has been performed. [Background technology]

[0002] The display input device has a display unit and a touch panel arranged on the screen of the display unit, displays a GUI (Graphical User Interface) or the like on the screen of the display unit, detects a touch operation (input operation) on the GUI on the screen of the display unit by a user's finger or the like using the touch panel, and accepts input to the GUI.

[0003] Furthermore, the method described in Patent Document 1 includes, in an electronic device having a display and a touch-sensitive surface, displaying a first view of a first application, detecting a first portion of a first input, simultaneously displaying portions of the first and second application views if the first portion of the first input satisfies an application switching criterion, detecting a second portion of the first input while simultaneously displaying portions of the first and second application views, ceasing display of portions of the second application view and displaying the first application view if the second portion of the first input satisfies a first view display criterion (lift-off of a contact detected in a first region), and maintaining simultaneous display of portions of the first and second application views on the display after detecting lift-off of the contact if the second portion of the first input satisfies a multi-view display criterion (lift-off of a contact detected in a second region). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2017-528776 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, in a display input device, a touch operation on a GUI displayed on a display unit is detected by a touch panel, but a user often does not recognize whether or not the touch operation has been performed correctly.

[0006] For this reason, it is conceivable that vibrations or notification sounds, etc., may be generated every time a touch operation is performed, allowing the user to recognize in real time whether or not their touch operation has been accepted.

[0007] In Patent Document 1, multiple application views (GUIs, etc.) are displayed on a display, and the display of each application view is switched in response to a touch operation on the touch-sensitive surface, but vibrations, notification sounds, etc. are not generated with each touch operation as described above.

[0008] Furthermore, depending on the condition of the display input device, it may not be desirable to generate vibration or a notification sound every time a touch operation is performed.

[0009] The present invention has been made in consideration of the above-mentioned circumstances, and aims to improve operability for users by controlling whether or not to generate vibrations or notification sounds to recognize touch operations, depending on the operating state of the device. [Means for solving the problem]

[0010] A display input device according to one aspect of the present invention comprises a display unit that displays an operation target, an operation detection unit that detects a touch operation on the operation target displayed on the display unit, an operation notification unit that generates a vibration on a screen of the display unit or generates a notification sound, and a control unit that, when a touch operation on the operation target is detected by the operation detection unit, activates the operation notification unit to generate the vibration or the notification sound, and the control unit switches whether or not to generate the vibration or the notification sound by the operation notification unit depending on which of a plurality of preset operating states the operating state of the display input device is in. Effect of the Invention

[0011] According to the present invention, by controlling whether or not to generate vibrations or notification sounds for recognizing a touch operation depending on the operating state of the device, it is possible to improve operability for the user. [Brief description of the drawings]

[0012] [Figure 1] 1 is a cross-sectional view showing an image forming apparatus according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a main internal configuration of an image forming apparatus according to an embodiment of the present invention; [Diagram 3] 13 is a diagram conceptually illustrating a data table in which a plurality of operating states of an image forming apparatus, a plurality of operation targets, and a plurality of pieces of operation information indicating whether or not vibration and notification sound are used in combination are associated with each other and registered. FIG. [Figure 4] 4 is a diagram showing a keyboard and control buttons displayed on the screen of a display unit. FIG. [Diagram 5] FIG. 13 is a diagram conceptually showing a data table in which each piece of operation information has been changed. [Figure 6] 10 is a flowchart showing a control procedure for selecting an operational state of the image forming apparatus, changing operation information associated with the selected operational information, and registering the changed operation information in the data table. [Figure 7] FIG. 4 is a diagram showing a menu selection screen displayed on a display unit. [Figure 8]FIG. 13 is a diagram showing an operation information list screen displayed on the display unit. [Figure 9] FIG. 13 is a diagram showing an operation information change screen displayed on the display unit. [Figure 10] FIG. 13 is a diagram showing a state in which keys of the keyboard are displayed in an enlarged scale. [Figure 11] FIG. 13 is a diagram showing variation images of key characters. [Figure 12] FIG. 13 is a diagram showing another operation information change screen displayed on the display unit. [Figure 13A] A flowchart showing a process for switching whether or not vibration, notification sound, etc. are generated depending on which of a plurality of operating states the device is in when a keyboard key or a control button displayed on a display screen is touched. [Figure 13B] 13B is a flowchart showing the process following FIG. 13A. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] A display input device and an image forming device according to an embodiment of the present invention will be described below. FIG. 1 is a cross-sectional view showing an image forming device according to an embodiment of the present invention. An image forming device 10 is an example of a display input device according to an embodiment of the present invention. As shown in FIG. 1, the image forming device 10 is an MFP (multi-function peripheral) having multiple functions such as a copy function and a facsimile function. The image forming device 10 includes an image reading unit 11 and an image forming unit 12.

[0014] The image reading unit 11 has an image pickup element (such as a CCD sensor) that optically reads an image of a document, and an analog output of this image pickup element is converted into a digital signal to generate image data representing the image of the document.

[0015] The image forming section 12 forms an image represented by the image data on a recording sheet, and includes an image forming unit 3M for magenta, an image forming unit 3C for cyan, an image forming unit 3Y for yellow, and an image forming unit 3Bk for black. In each of the image forming units 3M, 3C, 3Y, and 3Bk, the surface of the photosensitive drum 4 is uniformly charged, the surface of the photosensitive drum 4 is exposed to light, an electrostatic latent image is formed on the surface of the photosensitive drum 4, the electrostatic latent image on the surface of the photosensitive drum 4 is developed into a toner image, and the toner image on the surface of the photosensitive drum 4 is primarily transferred to the intermediate transfer belt 5. As a result, a color toner image is formed on the intermediate transfer belt 5. This color toner image is secondarily transferred to the recording sheet P conveyed from the paper feed section 14 through the conveying path 8 in the nip area N between the intermediate transfer belt 5 and the secondary transfer roller 6.

[0016] Thereafter, the recording paper P is heated and pressed in the fixing device 15 so that the toner image on the recording paper P is fixed by thermocompression, and the recording paper P is then discharged onto a discharge tray 17 via discharge rollers 16 .

[0017] Next, Fig. 2 is a block diagram showing the main internal configuration of the image forming apparatus 10. As shown in Fig. 2, the image forming apparatus 10 includes an image reading unit 11, an image forming unit 12, a display unit 21, an operation unit 22, a touch panel 23, a FAX communication unit 24, a buzzer 25, a vibration generating unit 26, a RAM (Random Access Memory) 27, a storage unit 28, and a control unit 29. These components transmit and receive data or signals to and from each other via a bus.

[0018] The display unit 21 is configured with a liquid crystal display (LCD) or an organic light-emitting diode (OLED) display.

[0019] The operation unit 22 includes physical keys such as a numeric keypad, a decision key, a start key, etc. In response to the operation of each key, an instruction corresponding to each key is input to the operation unit 22.

[0020] A touch panel 23 is disposed on the screen of the display section 21. The touch panel 23 is a so-called resistive film type or capacitive type touch panel, which detects a contact (touch) of a user's finger or the like with the touch panel 23 together with the contact position, and outputs a detection signal indicating the coordinates of the contact position to a control section 31 (described later) of the control unit 29, etc.

[0021] Further, the facsimile (FAX) communication unit 24 starts facsimile communication with a remote facsimile device via a line network based on a predetermined communication protocol, and transmits and receives image data showing an original to and from the remote facsimile device via the line network.

[0022] Buzzer 25 is provided near display unit 21 and generates a notification sound. Vibration generating unit 26 is a vibrator, a piezoelectric element and its drive mechanism, or the like. Buzzer 25 is provided, for example, on the back side of display unit 21 and generates vibrations on the screen of display unit 21 and touch panel 23 provided on the screen. The notification sound is heard by the user, and the vibrations of touch panel 23 are sensed by the user's finger, etc.

[0023] The storage unit 28 is a large-capacity storage device such as a solid state drive (SSD) or a hard disk drive (HDD), and stores various application programs and various data.

[0024] The control unit 29 is composed of a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit), etc. The control unit 29 functions as a control unit 31 by the processor executing a control program stored in the ROM or the storage unit 28.

[0025] The control unit 31 comprehensively controls the image forming apparatus 10. The control unit 29 is connected to the image reading unit 11, the image forming unit 12, the display unit 21, the operation unit 22, the touch panel 23, the buzzer 25, the vibration generating unit 26, the RAM 27, and the storage unit 28. The control unit 31 controls the operation of these components and transmits and receives signals or data between these components.

[0026] The control unit 31 serves as a processing unit that executes various processes necessary for image formation by the image forming apparatus 10. The control unit 31 also has a function of controlling the display operation of the display unit .

[0027] Furthermore, the control unit 31 accepts operation instructions input by the user based on a detection signal output from the touch panel 23 or an operation of a physical key of the operation unit 22. For example, the control unit 31 accepts a touch operation on a GUI (Graphical User Interface) or the like displayed on the screen of the display unit 21 through the touch panel 23. Thus, the touch panel 23 functions as an operation unit into which a user operation on the screen of the display unit 21 is input.

[0028] In the image forming apparatus 10 configured as above, for example, a user places an original on the image reading unit 11 and inputs an instruction to execute a copy job by operating the operation unit 22. In accordance with the instruction to execute the copy job input to the operation unit 22, the control unit 31 causes the image reading unit 11 to read the image of the original, and causes the image forming unit 12 to print the image on recording paper.

[0029] Furthermore, the user places an original on image reading unit 11, operates operation unit 22 to input the telephone number of the receiving facsimile device, and then inputs an instruction to execute a facsimile job. In accordance with the instruction to execute a facsimile job input to operation unit 22, control unit 31 causes image reading unit 11 to read the image of the original, and causes facsimile communication unit 24 to transmit the telephone number of the receiving facsimile device to the line network. When the receiving facsimile device responds to the call, facsimile communication unit 24 transmits image data showing the image of the original to the other facsimile device via the line network.

[0030] On the other hand, when a user operates a button displayed as a GUI on the screen of display unit 21, touch panel 23 detects the touch operation and outputs a detection signal to control unit 31. When control unit 31 receives the detection signal, it drives vibration generating unit 26 to generate vibrations on touch panel 23 provided on the screen portion of display unit 21, or generates a notification sound from buzzer 25. The user recognizes that the operation performed on touch panel 23 and the above button has been performed normally by sensing the vibration of touch panel 23 with his / her fingertip or hearing the notification sound.

[0031] Here, the vibration of the touch panel 23 generated by the vibration generating unit 26 and the notification sound generated by the buzzer 25 are useful for the user to recognize the above, but depending on the situation of the image forming apparatus 10, it may not be preferable for the vibration or notification sound to be generated every time a touch operation is performed. For example, depending on the situation, the user may find the vibration or notification sound annoying.

[0032] Therefore, in this embodiment, a data table DT as shown in FIG. 3 is stored in the storage unit 28. The data table DT stores a schedule of how vibration or a notification sound is generated or not generated depending on the operation state of the image forming apparatus 10. The control unit 31 performs control to switch between the generation of vibration by the vibration generating unit 26 and the generation of a notification sound by the buzzer 25, depending on which of a plurality of pre-set operation states the operation state of the image forming apparatus 10 is in, based on the data table DT. This allows the user to recognize that the operation performed on the touch panel 23 and the above-mentioned buttons has been performed normally by the vibration or notification sound, while not generating the vibration or notification sound depending on the operation state of the image forming apparatus 10, thereby improving operability for the user.

[0033] 3, a standby state, a function operation state, a power saving state, an error occurrence state, etc. are set as a plurality of operation states of the image forming apparatus 10. Furthermore, the function operation state is classified into a copy job and a facsimile job.

[0034] Moreover, in the data table DT, a keyboard and control buttons are set as multiple operation objects to be displayed on the screen of the display unit 21. Fig. 4 illustrates the keyboard KB and control buttons SB displayed on the screen of the display unit 21. The keyboard KB and control buttons SB are examples of a GUI.

[0035] In addition, in the data table DT, multiple pieces of operation information are set for each keyboard and control button, such as whether or not vibration is generated by the vibration generating unit 26, the vibration level, the type of vibration, whether or not a notification sound generated by the buzzer 25 is used in conjunction, whether or not a touched key is displayed enlarged, whether or not a variation of the touched key is displayed, and whether or not a schedule is set.

[0036] In such a data table DT, in the default setting, the type of keyboard to be operated "QWERTY" and the control button to be operated "enabled" are stored in association with both copy jobs and facsimile jobs in the function activation state. Furthermore, for the keyboard, "none", vibration level "none", vibration type "none", combined use of notification sound "none", enlarged key display "none", key variation display "none", and schedule "none" are associated. Furthermore, for the control buttons, "none", vibration level "none", vibration type "none", combined use of notification sound "none", enlarged key display "none", key variation display "-", and schedule "none" are associated. Note that the presence or absence of key variation display corresponds only to the keyboard. Furthermore, the presence or absence of schedule is common to the keyboard and the control buttons. Furthermore, "-" indicates that it cannot be set.

[0037] In the data table DT, in the default settings, the standby state, the power saving state, and the error occurrence state are all associated with "disabled" for the keyboard to be operated and "enabled" for the control buttons to be operated, and further, for the control buttons, "none" for vibration, "none" for vibration level, "none" for vibration type, "none" for use with notification sound, "none" for enlarged key display, "-" for key variation display, and "none" for schedule.

[0038] Each piece of operation information of the default setting in the data table DT is changed in response to a touch operation by the user on the GUI on the screen of the display unit 21. For example, the operation information in the data table DT is changed as shown in FIG.

[0039] 5, the keyboard of a copy job in a function-activated state is associated with the following operation information: keyboard type "Japanese", vibration "on", vibration level "medium", vibration type "A", combined use of notification sound "on", enlarged key display "on", key variation display "not on", and schedule "on". Also, the control button of a copy job in a function-activated state is associated with the following operation information: control button "enabled", vibration "on", vibration level "medium", vibration type "A", combined use of notification sound "on", enlarged key display "on", key variation display "-", and schedule "on".

[0040] 5, the keyboard of a facsimile job in a function-activated state is associated with the following operation information: keyboard type "Japanese", vibration "on", vibration level "large", vibration type "A", combined use of notification sound "on", enlarged key display "off", key variation display "on", and schedule "off". The control button of a facsimile job in a function-activated state is associated with the following operation information: control button "enabled", vibration "on", vibration level "medium", vibration type "B", combined use of notification sound "on", enlarged key display "on", key variation display "-", and schedule "off".

[0041] 5, the keyboard in the power saving state is associated with "disabled" as the operation information. For the control buttons in the power saving state, the following operation information is registered: control button "enabled", vibration "none", vibration level "none", vibration type "none", enlarged key display "none", combined use of notification sound "none", key variation display "-", and schedule "none". When vibration is "none", the vibration level, vibration type, and combined use of notification sound are set to "none".

[0042] Next, a process of selecting an operational state of the image forming apparatus 10, changing the operation information associated with the selected operational information, and registering the changed information in the data table DT will be described with reference to the flowchart shown in FIG.

[0043] For example, it is assumed that the control unit 31 causes the display unit 21 to display a menu selection screen G1 as shown in Fig. 7. A plurality of menu items M1, M2, M3, . . . are displayed on the menu selection screen G1 shown in Fig. 7.

[0044] When the user touches menu item M4 for changing operation information on menu selection screen G1, control unit 31 detects the touch operation on menu item M4 through touch panel 23, accepts a menu item display instruction associated with menu item M4, and causes display unit 21 to display operation information list screen G2 as shown in FIG. 8 (S101).

[0045] The operation information list screen G2 shown in FIG. 8 displays the same contents as those in the data table DT shown in FIG. 3, including each operating state, each operation target, and each operation information of default settings.

[0046] For example, the user touches and selects a display area of ​​a function operation status (copy job) field on the operation information list screen G2. The control unit 31 accepts a display instruction for an operation information change screen associated with the function operation status (copy job) field through the touch panel 23 (S102), and causes the display unit 21 to display an operation information change screen G3 as shown in FIG. 9 (S103).

[0047] 9 includes a keyboard display area R1 and a control button display area R2. In the keyboard display area R1, a text box TX11 for accepting a selection of the type of keyboard, a button B11 for accepting a selection of whether or not to use vibration generated by the vibration generating unit 26, a button B12 for accepting a selection of the level of vibration, a text box TX12 for accepting a selection of the type of vibration, a button B13 for accepting a selection of whether or not to use a notification sound, a button B14 for accepting a selection of whether or not to display an enlarged display of keys, a button B15 for accepting a selection of whether or not to display variations of keys, and a button B16 for accepting a selection of whether or not to display a schedule are displayed.

[0048] In addition, the control button display area R2 displays a button B21 for accepting a selection of whether or not to vibrate, a button B22 for accepting a selection of the vibration level, a text box TX21 for accepting a selection of the type of vibration, a button B23 for accepting a selection of whether or not to use a notification sound, and a button B24 for accepting a selection of whether or not to enlarge the display of keys.

[0049] For example, when a user touches a text box TX11 in the keyboard display area R1 on the operation information change screen G3, an instruction to display a pull-down menu of the keyboard type is received by the control unit 31 via the touch panel 23, and the control unit 31 causes a pull-down menu showing the keyboard type to be displayed.

[0050] The control unit 31 displays in the text box TX11 the type of keyboard selected by the user's operation on the pull-down display, and sets the selected type of keyboard as information indicating the operation target in the operation information (S104). Here, data indicating an image of the keyboard and the coordinates of each key of the keyboard for each of the multiple types of keyboards is stored in advance in the storage unit 28. The various keyboards include keyboards with different key arrangements, or keyboards applicable to multiple types of languages. When executing a copy job, the control unit 31 reads out the image of the determined keyboard and the data indicating the coordinates of each key of the keyboard from the storage unit 28, and displays the keyboard on the display unit 21 as a GUI.

[0051] Here, it is assumed that the user selects "Yes" for vibration by touching the button B11 in the keyboard display area R1 on the operation information change screen G3.

[0052] The control unit 31 receives an instruction to set the vibration "on" associated with the button B11 through the touch panel 23, and sets the vibration "on" to be generated by the vibration generating unit 26 as part of the operation information (S104).

[0053] When "Yes" for vibration is set as the operation information, the control unit 31 receives a setting instruction for each setting content for the vibration corresponding to the buttons B12 to B16 and the text box TX12 via the touch panel 23, and sets the content indicated by the setting instruction as part of the operation information (S104). The type of vibration is set by changing the vibration frequency, intermittent cycle of vibration, etc., and is stored in advance in the storage unit 28. When executing a copy job, the control unit 31 reads out the frequency, intermittent cycle, etc. of the vibration type indicated by the operation information from the storage unit 28, and causes the vibration generating unit 26 to generate vibration of that type.

[0054] Furthermore, when the user does not touch the button B11 in the display area R1 of the keyboard and an instruction to select "no" vibration is received by the control unit 31 via the touch panel 23, the control unit 31 maintains the operation information of the default setting indicating "no" vibration without changing it (S104). At this time, the control unit 31 does not receive a setting instruction for each setting content for vibration corresponding to the buttons B12 to B16 and the text box TX12.

[0055] For example, when the control unit 31 receives an instruction to determine "Yes" for the enlarged display of the key associated with the button B14 through the touch panel 23, the control unit 31 sets "Yes" for the enlarged display of the operation key as the operation information (S104). At this time, the control unit 31 does not receive a setting instruction corresponding to the button B15. Image data showing the enlarged key is stored in advance in the storage unit 28 for each of the multiple keys constituting various keyboards. When the control unit 31 detects a touch operation on a key of the keyboard displayed on the screen of the display unit 21 through the touch panel 23 when the operation information showing the enlarged display of the key indicates "Yes" during the execution of a copy job, the control unit 31 reads image data showing the key in an enlarged form from the storage unit 28 and displays the enlarged key at the position of the key where the touch operation was detected. For example, when the keyboard KB is displayed on the screen of the display unit 21 as shown in FIG. 10, if the "G" key is touched, the enlarged key KL is displayed at the position of the "G" key.

[0056] Also, when the user does not touch the button B14 in the display area R1 of the keyboard, but instead touches the button B15, the control unit 31 accepts an instruction to select "Yes" for the key variation display associated with the button B15 through the touch panel 23, and sets "Yes" for the key variation display as a part of the operation information (S104). For each of a plurality of keys constituting various keyboards, image data showing a variation image of the character of the key is stored in advance in the storage unit 28. When the control unit 31 detects a touch operation on a key of the keyboard through the touch panel 23 when the operation information showing the key variation display shows "Yes" during the execution of a copy job, the control unit 31 reads out image data showing a variation image of the character of the key from the storage unit 28, and displays the variation image of the character of the key at the position of the key where the touch operation was detected. For example, when the keyboard KB is displayed on the screen of the display unit 21 as shown in FIG. 11, when the "O" key is touched, the variation image Va of "O" is displayed at the position of the "O" key. When the user touches any character in the variation image Va, the control unit 31 detects the touch operation on that character through the touch panel 23, and accepts the input of that character.

[0057] When the control unit 31 receives an instruction associated with the button B16 through the touch panel 23, it sets the schedule "Yes" as part of the operation information in accordance with the instruction, and when it does not receive the instruction, it maintains the default setting operation information indicating the schedule "No" (S104). Based on the user's operation of the operation unit 22, the control unit 31 sets a date and time indicating a period during which each piece of operation information in the data table DT or each piece of operation information in the default setting is to be applied, and stores the date and time in the storage unit 28.

[0058] When the control unit 31 receives a confirmation instruction associated with the OK key K11 on the operation information change screen G3 through the touch panel 23, it stores the operation information set in accordance with the setting instruction based on the operation of each of the buttons B11, B12, the text box TX12, and each of the buttons B13 to B16 in the data table DT, and updates the setting information in the data table DT (S105). Note that each of the operation information for the default setting is stored in the storage unit 28 separately from the data table DT.

[0059] Next, a process will be described when the user touches the button B21 in the control button display area R2. When the control unit 31 detects a touch operation on the button B21 through the touch panel 23, the control unit 31 accepts a setting instruction indicating that the vibration generated by the vibration generating unit 26 corresponding to the button B21 is to be "enabled," and sets the "enabled" vibration as part of the operation information (S104).

[0060] When the control unit 31 sets vibration "on" as part of the operation information for the control button, it accepts a setting instruction for each setting content for vibration corresponding to the buttons B22 to B24 and the text box TX21 via the touch panel 23, and sets the content indicated by the setting instruction as part of the operation information in the same manner as in the case of the keyboard described above (S104). When executing a copy job, the control unit 31 also controls the vibration operation and display operation according to the operation information in the same manner as in the case of the keyboard described above. However, the control unit 31 does not perform an operation based on the operation information set based on the button B15 as an operation related to the control button.

[0061] In this way, copy job is selected as the function operation state on the operation information list screen G2, and on the operation information change screen G3, for the keyboard, the type of keyboard, the presence or absence of vibration, the vibration level, the vibration type, the presence or absence of notification sound, the presence or absence of enlarged key display, the presence or absence of key variation display, and the presence or absence of schedule are selected and registered as the respective operation information, and for the control buttons, the presence or absence of vibration, the vibration level, the vibration type, the presence or absence of notification sound, and the presence or absence of enlarged key display are selected and registered as the respective operation information in the data table DT. Also, when "Present" for schedule is registered as operation information, a date and time indicating a period during which each operation information registered in the data table DT or each operation information of the default setting is applied is set according to the user's input operation on the schedule setting screen, and stored in the storage unit 28.

[0062] Operation information indicating "Yes" for the schedule set based on button B16 in display area R1 of the keyboard is also applied to the control button, and the schedule for each piece of operation information on the keyboard is also applied to the schedule for each piece of operation information on the control button.

[0063] Also, when a facsimile job with its functions in operation is selected on the operation information list screen G2, each piece of operation information for the keyboard and each piece of operation information for the control buttons are registered on the operation information change screen G3 in the same manner as in the case of a copy job. Also, when "Yes" for schedule is registered as operation information, a date and time indicating the period during which each piece of operation information in the data table DT or each piece of operation information in the default settings is applied is set according to the user's input operation on the schedule setting screen.

[0064] In addition, when the user touches any one of the standby state, the power saving state, and the error occurrence state in the operation information list screen G2, the control unit 31 accepts an instruction associated with the touch operation for the standby state, the power saving state, or the error occurrence state through the touch panel 23, and displays another operation information change screen G4 as shown in FIG. 12 on the display unit 21. In the standby state, the power saving state, and the error occurrence state, the keyboard KB shown in FIG. 5 is not displayed on the display unit 21, and only the control button SB is displayed on the display unit 21. Therefore, in the other operation information change screen G4 shown in FIG. 12, a button B21 for accepting a selection of whether or not vibration is to be performed, a button B22 for accepting a selection of the level of vibration, a text box TX21 for accepting a selection of the type of vibration, a button B23 for accepting a selection of whether or not to use a notification sound in combination, and a button B24 for accepting a selection of whether or not to display an enlarged key are displayed, similarly to the display area R2 of the control buttons of the operation information change screen G3 shown in FIG. 9.

[0065] Note that, here, for the standby state, power saving state, and error occurrence state, the control unit 31 changes the contents of the operation information based on the user's operation of the operation unit 47, etc.; however, for the standby state, power saving state, and error occurrence state, the control unit 31 may not accept a change in the contents of the operation information based on the user's operation of the operation unit 47, etc., and may maintain the above-mentioned default settings.

[0066] The process of setting and registering each of the operation information by touching the buttons B21, B22, text box TX21, and each of the buttons B23 to B25 in the control button display region R2 of the operation information change screen G4 is similar to the process of setting and registering each of the operation information by touching the buttons B21, B22, text box TX21, each of the buttons B23, B24 in the control button display region R2 of the operation information change screen G3, and the button B16 in the keyboard display region R1 as described above. Also, when "Yes" for schedule is registered as operation information, a date and time indicating a period for applying each of the operation information in the data table DT or each of the operation information in the default setting is set according to the user's input operation on the schedule setting screen.

[0067] In this way, in the data table DT, each piece of operation information associated with an operation state is updated for each operation state of the image forming apparatus 10. When the data table DT is updated again, if any one of the standby state, the function operating state (copy job), the function operating state (fax job), the power saving state, and the error occurrence state is selected by a touch operation on the operation information list screen G2 displayed on the display unit 21, the control unit 31 accepts a selection instruction corresponding to the touch operation via the touch panel 23, temporarily resets each piece of operation information corresponding to the operation state indicated by this selection instruction to its respective default setting, and updates the operation information again.

[0068] Next, the process of switching whether or not vibration or notification sound is generated depending on which of the above-mentioned multiple operating states the device is in when a keyboard key or a control button displayed on the screen of display unit 21 is touched will be described with reference to the flowcharts shown in Figures 13A and 13B.

[0069] The control unit 31 determines whether the operation state of the image forming apparatus 10 is set to a standby state, a function operating state (copy job), a function operating state (facsimile job), a power saving state, or an error occurrence state (S201).

[0070] The control unit 31 refers to the data table DT stored in the storage unit 28, and reads out from the data table DT each piece of operation information associated with the standby state, the function operating state (copy job), the function operating state (facsimile job), the power saving state, or the error occurrence state determined in S201 (S202). The control unit 31 determines the presence or absence of a schedule based on the operation information of the schedule (S203), and when determining that there is no schedule (S203 "NO"), stores the operation information read out in S202 in the RAM 27 (S204).

[0071] Furthermore, when the control unit 31 determines that there is a schedule (S203 "YES"), it reads out the date and time indicating the period during which each piece of operation information in the data table DT or each piece of operation information in the default setting is to be applied from the storage unit 28, and determines whether each piece of operation information in the data table DT or each piece of operation information in the default setting is to be applied (S205). When the control unit 31 determines that each piece of operation information in the data table DT is to be applied (S206 "DT"), it stores each piece of operation information read out in S202 in the RAM 27 (S204).

[0072] Furthermore, when the control unit 31 determines that the operation information of the default setting should be applied (S206 "Default"), the control unit 31 does not store the operation information read out in S202 in the RAM 27, but reads the operation information of the default setting from the memory unit 28 and stores it in the RAM 27 (S207).

[0073] The control unit 31 displays a keyboard and control buttons on the screen of the display unit 21 based on each piece of operation information stored in the RAM 27 (S208). For example, when each piece of operation information associated with a copy job in a function operating state is stored in the RAM 27, the control unit 31 determines the type of keyboard based on the operation information of the operation target, and displays the determined type of keyboard on the screen of the display unit 21, and also displays control buttons on the screen of the display unit 21 based on the operation information of the operation target. Also, when each piece of operation information associated with a standby state is stored in the RAM 27, the control unit 31 displays control buttons on the screen of the display unit 21 based on the operation information of the operation target.

[0074] Next, the control unit 31 waits for a touch operation of a keyboard key or a control button displayed on the screen of the display unit 21 (S209 "No"), and when a touch operation of a keyboard key or a control button is detected through the touch panel 23 (S209 "Yes"), it accepts the input by this touch operation (S210). Then, based on each operation information stored in the RAM 27, the control unit 31 determines whether or not vibration is generated in response to the touch operation of the key or the control button, the vibration level, the vibration type, and whether or not a notification sound is also used, and controls whether or not vibration is generated by the vibration generation unit 26, the vibration level, and the vibration type, and controls whether or not a notification sound is generated by the buzzer 25 according to this determination result (S211).

[0075] In addition, the control unit 31 determines whether or not the keys or control buttons are to be enlarged based on the enlarged display operation information stored in RAM 27 (S212), and if it determines that the enlarged display is "yes" (S212 "yes"), it reads out image data showing an enlarged version of the key or control button detected in S209 from the memory unit 28, and displays the enlarged key or control button at the position of the touched key or control button on the screen of the display unit 21 (S213).

[0076] Thereafter, the control unit 31 determines whether or not the operating state of the image forming device 10 has changed (S214), and if the operating state of the image forming device 10 has not changed (S214 "No"), the control unit 31 returns to S209 and waits for the next key or the next control button on the keyboard displayed on the screen of the display unit 21 to be touched.

[0077] Furthermore, in S212, if the control unit 31 determines that the enlarged display of the key or control button is "NO" (S212 "NO"), it determines whether or not a key or a control button was detected in S209 (S215), and if a key was detected (S215 "KEY"), it determines whether or not a variation display is present based on the operation information of the variation display stored in the RAM 27 (S216). If the control unit 31 determines that the variation display is "YES" (S216 "YES"), it reads out image data showing a variation image Va of the detected key from the storage unit 28, and displays the variation image Va of this key on the screen of the display unit 21 (S217).

[0078] At this time, the user looks at the key variation image Va displayed on the screen of the display unit 21 and touches any of the characters in the variation image Va. The control unit 31 detects the touch operation on any of the characters in the variation image Va through the touch panel 23, and accepts the input of the touch operation on this character (S218).

[0079] Thereafter, the control unit 31 determines whether or not the operating state of the image forming apparatus 10 has changed (S214), and if the operating state has not changed (S214 "No"), returns to S209 and waits for the touch operation of the next key on the keyboard or the next control button displayed on the screen of the display unit 21.

[0080] Furthermore, when the control unit 31 determines that a control button has been detected (S215 “CONTROL”), or when a key has been detected (S215 “KEY”) but the variation display has been determined to be “NONE” (S216 “NONE”), the control unit 31 determines whether or not the operating state of the image forming apparatus 10 has changed (S214) without displaying the key variation image Va on the screen of the display unit 21. If the operating state has not changed (S214 “No”), the control unit 31 returns to S209 and waits for a touch operation of the next key of the keyboard or the next control button displayed on the screen of the display unit 21.

[0081] Moreover, when the control unit 31 determines that the operating state of the image forming apparatus 10 has changed (S214 "Yes"), the control unit 31 temporarily ends the control procedure shown in FIGS. 13A and 13B, and resumes the process from S201.

[0082] In this embodiment, the control unit 31 switches whether or not vibration and notification sounds are generated in response to touch operations according to the operating state of the image forming apparatus 10, so that vibration or notification sounds are not always generated when operations are performed on the touch panel 23 and the above-mentioned buttons, and for example, vibration and notification sounds can be prevented from being generated in response to touch operations when in a power saving state. This control by the control unit 31 makes it possible to prevent vibration and notification sounds from being generated when it is preferable for the user that vibration and notification sounds not be generated, thereby preventing a situation in which the user finds vibrations and notification sounds annoying.

[0083] In addition, when in the power saving state, the generation of vibrations and the generation of notification sounds can be set to "off" to further reduce power consumption.

[0084] Incidentally, the configuration and processing of the embodiment described above with reference to FIGS. 1 to 13A and 13B are merely one embodiment of the present invention, and it is not intended that the present invention be limited to these configurations and processing. [Explanation of symbols]

[0085] 10 Image forming device 11 Image reading unit 12 Image forming section 21 Display section 22 Control section 23 Touch Panel 24 Facsimile Communication Department 25 Buzzer 26 Vibration generating unit 27 RAM 28 Memory section 29 Control Unit 31 Control Unit

Claims

1. A display input device, comprising: A display unit that displays an operation target; an operation detection unit that detects a touch operation on an operation target displayed on the display unit; an operation notification unit that generates a vibration on the screen of the display unit or generates a notification sound; a control unit that, when a touch operation on the operation target is detected by the operation detection unit, activates the operation notification unit to generate the vibration or the notification sound; The control unit switches whether or not the operation notification unit generates the vibration or the notification sound depending on which of a plurality of preset operating states the operation state of the display input device is in.

2. each of the operation states includes a functional operation state for activating any one of a plurality of preset functions of the display input device; The display input device according to claim 1, wherein the control unit switches whether or not the operation notification unit generates the vibration or the notification sound depending on which of the functions is being activated when the operating state of the display input device is in the functional operation state.

3. 3. The display input device according to claim 1 or claim 2, wherein when the operation detection unit detects a touch operation on the operation target, the control unit activates the operation notification unit to generate the vibration or the notification sound and to enlarge the operation target displayed on the display unit.

4. the operation target is a key of a keyboard displayed on the display unit, 3. The display input device according to claim 1, wherein when the operation detection unit detects a touch operation on the key, the control unit activates the operation notification unit to generate the vibration or the notification sound and display a plurality of characters associated with the character of the key.

5. The display input device according to claim 1 or 2, wherein the control unit switches between generating and not generating the vibration or the notification sound by the operation notification unit according to an operating state of the display input device, in accordance with a preset schedule.

6. each of the operating states includes a power saving operating state of the display / input device; The display / input device according to claim 1 , wherein the control unit prevents the operation notification unit from generating the vibration or the notification sound when the operation state of the display / input device is in the power saving operation state.

7. A display input device according to claim 1; and an image forming unit that forms an image on a recording medium.

Images