Image forming apparatus and input device

Abstract

It enables screen operation that does not rely on visual cues. [Solution] The image forming apparatus of the embodiment comprises a display control unit and an audio control unit. When a first image having a plurality of display areas including a display area for a copy count setting item is displayed on the touchscreen, the display control unit changes the selected display area from the first display area to the second display area among the plurality of display areas and displays it based on a first user operation on the touchscreen. When a second image having a display area for the number of copies to be set for a copy count setting item is displayed on the touchscreen, the display control unit changes the number of copies in the copy count display area and displays it based on a first user operation on the touchscreen. The audio control unit controls the output of information corresponding to the selected display area as audio.

Description

Technical Field

[0001] Embodiments of the present invention relate to an image forming apparatus and an input device.

Background Art

[0002] It has been considered to install user interfaces for visually impaired users in various devices. For example, some MFPs (Multifunction Peripherals) are equipped with a user interface that outputs voice guidance and recognizes the voice of the input user.

[0003] However, even in a quiet office, the user has to operate the MFP by speaking. Therefore, the user may hesitate to use the MFP, and such a user interface may not be convenient for the user.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the embodiments of the present invention is to provide a technology that enables screen operations without relying on vision.

Means for Solving the Problems

[0006] The image forming apparatus of this embodiment comprises a display control unit and an audio control unit. When a first image having a plurality of display areas including a display area for a copy count setting item is displayed on the touchscreen, the display control unit changes the selected display area from the first display area to the second display area among the plurality of display areas based on a first user operation on the touchscreen and displays it. When a second image having a display area for the number of copies to be set for a copy count setting item is displayed on the touchscreen, the display control unit changes the number of copies in the copy count display area and displays it based on a first user operation on the touchscreen without changing the selected display area from the copy count display area. The audio control unit controls the output of information corresponding to the selected display area as audio from an audio output device based on an operation on the touchscreen. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a schematic block diagram showing an example of the configuration of an image forming apparatus according to an embodiment. [Figure 2] Figure 2 shows an example of the transition from the top image displayed on the touchscreen of the image forming apparatus according to the embodiment to another image. [Figure 3] Figure 3 shows an example of the transition from a copy setting image displayed on the touchscreen of the image forming apparatus according to the embodiment to another image. [Figure 4] Figure 4 shows an example of the transition from an image for setting voice guidance to another image displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 5] Figure 5 shows an example of the image transition associated with the setting of the number of copies displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 6] Figure 6 shows an example of image transitions associated with color mode settings displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 7]Figure 7 shows an example of the image transition associated with single-sided / double-sided settings displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 8] Figure 8 shows an example of image transitions associated with the audio speed setting displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 9] Figure 9 is a flowchart showing an example of processing associated with user operation on the top image displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 10] Figure 10 is a flowchart showing an example of processing associated with user operation on a copy setting image displayed on the touchscreen of an image forming apparatus according to an embodiment. [Figure 11] Figure 11 is a flowchart showing an example of processing associated with user operation on an image for setting the number of copies displayed on the touchscreen of an image forming apparatus according to an embodiment. [Figure 12] Figure 12 is a flowchart showing an example of processing associated with user operation on a color mode setting image displayed on the touchscreen of an image forming apparatus according to an embodiment. [Figure 13] Figure 13 is a flowchart showing an example of processing associated with user operation on a single-sided / double-sided setting image displayed on the touchscreen of the image forming apparatus according to the embodiment. [Figure 14] Figure 14 is a flowchart showing an example of processing associated with user operation in an image for setting voice guidance displayed on the touchscreen of an image forming apparatus according to an embodiment. [Figure 15] Figure 15 is a flowchart showing an example of processing associated with user operation on an image for setting the audio speed displayed on the touchscreen of an image forming apparatus according to an embodiment. [Modes for carrying out the invention]

[0008] [Example Configuration] The embodiments will be described below with reference to the drawings. Figure 1 is a schematic block diagram showing an example configuration of an image forming apparatus 1 according to an embodiment. The image forming apparatus 1 is an electronic device equipped with an electrophotographic printing function. The image forming apparatus 1 will be described as an MFP equipped with a copy function, a print function, a facsimile function, and a scanner function, etc.

[0009] The image forming apparatus 1 includes a control unit 10, a control panel 20, a scanner unit 30, a communication circuit 40, an input / output interface 50, an audio output device 60, and a printer unit 70.

[0010] The control unit 10 controls the operation of each part of the image forming apparatus 1. The control unit 10 includes a control circuit 11, a main memory 12, and a storage 13.

[0011] The control circuit 11 corresponds to the central part of the image forming apparatus 1. The control circuit 11 is an element that constitutes the computer of the image forming apparatus 1. The control circuit 11 includes a processor such as a CPU (Central Processing Unit). In addition to the CPU, or in place of the CPU, the control circuit 11 may also include an ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or GPU (Graphics Processing Unit). The control circuit 11 loads a program pre-stored in the main memory 12 or storage 13 into the main memory 12. The control circuit 11 performs various processes by executing the program loaded into the main memory 12. The program is a program that implements each part described later in the control circuit 11 and causes the control circuit 11 to execute the processing of each part.

[0012] The main memory 12 corresponds to the main storage part of the image forming apparatus 1. The main memory 12 is an element that constitutes the computer of the image forming apparatus 1. The main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or a program in the non-volatile memory area. The main memory 12 uses the volatile memory area as a work area where data is appropriately rewritten by the control circuit 11. For example, the main memory 12 includes a ROM (Read Only Memory) as the non-volatile memory area. For example, the main memory 12 includes a RAM (Random Access Memory) as the volatile memory area.

[0013] The storage 13 corresponds to the auxiliary storage part of the image forming apparatus 1. The storage 13 is an element that constitutes the computer of the image forming apparatus 1. For example, the storage 13 includes an HDD (Hard Disk Drive). The storage 13 may include a semiconductor storage medium such as an SSD (Solid State Drive) in addition to or instead of the HDD. The storage 13 stores the above-described program, data used by the control circuit 11 to perform various processes, and data generated by the processing of the control circuit 11. The storage 13 is an example of a storage device.

[0014] The control panel 20 includes a touch screen 21 and input buttons 22.

[0015] The touch screen 21 is a device capable of displaying images and inputting instructions based on user operations on the touch screen 21. The touch screen 21 includes a display device capable of displaying images. The display device may be, but is not limited to, a liquid crystal display or an organic EL (electroluminescence) display. The touch screen 21 is laminated on the display device and includes an input device capable of inputting instructions based on user operations on the touch screen 21. The user operation on the touch screen 21 is a user operation involving contact with the touch screen 21. The touch screen 21 is also referred to as a touch panel.

[0016] The input button 22 is a button such as a print start button that can be pressed. The input button 22 is an interface capable of inputting instructions based on user operations on the input button 22.

[0017] The scanner unit 30 is a device that reads images such as characters, figures, and photographs drawn on a sheet placed at a predetermined position. The scanner unit 30 includes a line sensor. The line sensor may be of the CCD (Charge Coupled Device) type. The line sensor may be of the CIS (Contact Image Sensor) type. The scanner unit 30 generates image data based on the image read using the line sensor. The scanner unit 30 transmits the generated image data to the control unit 10. The control unit 10 stores the received image data in the storage 13 or transmits it to the printer unit 70.

[0018] The communication circuit 40 is an interface for communicably connecting the image forming apparatus 1 and the user terminal via a wired or wireless network. For example, the user terminal may be, but is not limited to, a PC (Personal Computer) or the like.

[0019] The input / output interface 50 is an interface for connecting the image forming apparatus 1 with external equipment. The input / output interface 50 includes a wired cable connector. For example, the external equipment is an audio output device, but is not limited to this.

[0020] The audio output device 60 is a device capable of outputting sound under the control of the control circuit 11. For example, the audio output device 60 is a speaker.

[0021] The printer unit 70 is a unit that forms an image on a sheet. The printer unit 70 forms an image on a sheet based on image data transmitted from a user terminal via a network using its print function. The printer unit 70 also forms an image on a sheet based on image data generated by the scanner unit 30 using its copy function. Here, an example of a printer unit 70 using a tandem toner image transfer unit is described. The printer unit 70 includes a storage unit 71, a transport unit 72, an image forming unit 73, and a fuser 74.

[0022] The storage unit 71 stores the sheets. The storage unit 71 includes a paper feed cassette and a pickup roller. The paper feed cassette stores the sheets. The pickup roller takes out the sheets one by one from the paper feed cassette. The pickup roller supplies the taken sheets to the transport unit 72.

[0023] The transport unit 72 transports the sheet in the printer unit 70. The transport unit 72 includes a plurality of rollers and a registration roller. The plurality of rollers include a roller that transports the sheet supplied by the pickup roller to the registration roller. The plurality of rollers are located downstream of the fuser 74, which will be described later, and include a roller that discharges the sheet to the output tray. The registration roller transports the sheet to the transfer unit in accordance with the timing at which the transfer unit of the image forming unit 73, which will be described later, transfers the toner image to the sheet.

[0024] The image forming unit 73 forms a toner image on the sheet. The image forming unit 73 includes an intermediate transfer belt, a plurality of developing units, an exposure unit, and a transfer unit. The intermediate transfer belt is an endless belt. The plurality of developing units correspond to the number of toner types. The plurality of developing units include a developing unit for black, a developing unit for cyan, a developing unit for magenta, and a developing unit for yellow. Each developing unit includes a photoreceptor drum. Each developing unit includes a charger, a developing device, a primary transfer roller, a cleaning unit, and a static eliminator around the photoreceptor drum. The photoreceptor drum is a drum having a photoreceptor layer on its surface. The charger uniformly charges the photoreceptor layer on the surface of the photoreceptor drum. The developing device develops the electrostatic latent image on the surface of the photoreceptor drum with toner. The developing device forms a toner image on the surface of the photoreceptor drum. The primary transfer roller faces the photoreceptor drum and sandwiches the intermediate transfer belt. The primary transfer roller transfers the toner image on the surface of the photoreceptor drum onto the intermediate transfer belt. The cleaning unit removes untransferred toner from the surface of the photoreceptor drum. The static eliminator irradiates the surface of the photoreceptor drum with light. The static eliminator removes static electricity from the photoreceptor layer of the photoreceptor drum by irradiating it with light. The exposure unit irradiates the surface of the photoreceptor drum in each developing unit with laser light through an optical system such as a polygon mirror. The exposure unit forms an electrostatic pattern as an electrostatic latent image on the surface of the photoreceptor drum. The transfer unit transfers the charged toner image on the surface of the intermediate transfer belt to the sheet. The transfer unit includes support rollers and secondary transfer rollers configured to sandwich the intermediate transfer belt and the sheet from both sides in the thickness direction.

[0025] The fuser 74 applies heat and pressure to the sheet on which the toner image supplied from the image forming unit 73 has been formed. The fuser 74 fixes the toner image formed on the sheet to the sheet using heat and pressure.

[0026] The hardware configuration of the image forming apparatus 1 is not limited to the configuration described above. The image forming apparatus 1 may, as appropriate, omit or change the above-described components and add new components. The image forming apparatus 1 does not have to have an audio output device 60. The audio output device 60 may be connected to the image forming apparatus 1 via an input / output interface 50.

[0027] The various components implemented in the control circuit 11 described above will now be explained. The control circuit 11 implements the detection unit 111, the display control unit 112, the sound control unit 113, and the setting unit 114. Each part implemented in the control circuit 11 can also be called a function. Each part implemented in the control circuit 11 can also be said to be implemented in the control unit which includes the control circuit 11 and the main memory 12.

[0028] The detection unit 111 detects user operations on the touchscreen 21. User operations on the touchscreen 21 include swipe operations, double-tap operations, and tap operations.

[0029] A swipe operation is an example of an operation that moves a single point of contact on the touchscreen 21 in a short time in a time series. A swipe operation is an example of a first user operation. A swipe operation includes a downward swipe operation. A downward swipe operation is a swipe operation along a first direction from top to bottom. A downward swipe operation is an example of a third user operation. A swipe operation includes an upward swipe operation. An upward swipe operation is a swipe operation along a second direction from bottom to top, which is the opposite direction to the first direction. An upward swipe operation is an example of a fourth user operation.

[0030] Swipe gestures are used to input instructions such as the following: First, we will describe the case where the touchscreen 21 displays an image having multiple display areas that can be set as the selected display area. A display area is an area for displaying characters. A display area may be an area whose outer edge can be recognized by a frame, etc. A display area may be a virtual area that does not have a frame, etc., and whose outer edge cannot be recognized. The selected state is a state in which an area is selected in order to perform the process associated with the selected display area. The selected state is also called the focused state. The selected display area is one display area. In this example, the swipe operation is an operation that inputs an instruction to the control circuit 11 to change the selected display area from the first display area to the second display area. The first display area is one of the multiple display areas. Before the swipe operation, the first display area is the selected display area. The first display area is the display area that transitions from the selected display area to the non-selected display area based on the swipe operation. The second display area is one of the multiple display areas that is different from the first display area. Before the swipe operation, the second display area is a non-selected display area. The second display area is a display area that transitions from a non-selected display area to a selected display area based on a swipe operation. Next, we will describe the case where the touchscreen 21 displays an image having one display area that can be set to the selected display area. In this example, the swipe operation is an operation that inputs an instruction to the control circuit 11 to change the numerical value displayed in one of the display areas.

[0031] A double-tap operation is an example of an operation on the touchscreen 21 in which a tap is performed twice, with the tap being made to contact one point and then released. A double-tap operation is an example of a second user operation. A double-tap operation is an operation that inputs an instruction to the control circuit 11 to execute the process associated with the selected display area.

[0032] A tap operation is an example of an operation on the touchscreen 21 in which a point is touched and then the contact is released. A tap operation is an example of a fifth type of user operation. A tap operation is an operation in which an instruction is input to the control circuit 11 to output information corresponding to the selected display area by voice from the audio output device 60. The information corresponding to the selected display area includes information about the display in the selected display area. The information about the display in the selected display area may also be information indicating the characters displayed in the selected display area. The information indicating the characters displayed in the selected display area only needs to include at least the characters displayed in the selected display area. The information about the display in the selected display area may also be information indicating the content of the characters displayed in the selected display area. The information indicating the content of the characters displayed in the selected display area only needs to include at least the same content as the characters displayed in the selected display area. The audio output device 60 repeatedly outputs the same information corresponding to the selected display area by voice each time the user performs a tap operation.

[0033] Furthermore, user operations on the touchscreen 21 do not need to be performed within the selected display area; they can be performed anywhere on the touchscreen 21. Therefore, upward swipe, downward swipe, tap, and double-tap operations can be performed anywhere on the touchscreen 21.

[0034] The display control unit 112 controls the display on the touchscreen 21. In the following description, "display" in the processing of the display control unit 112 includes controlling the display to display. The display control unit 112 displays an image on the touchscreen 21. The display control unit 112 displays the selected display area in a recognizable manner. The recognizable manner is a visual manner such as color or pattern, but is not limited to these. The recognizable manner may be a color that a visually impaired user can recognize as the selected display area.

[0035] The audio control unit 113 controls the audio output device 60 to output information corresponding to the selected display area based on user operation on the touchscreen 21. Outputting information corresponding to the selected display area based on user operation means outputting information corresponding to the selected display area after the user operation. The audio control unit 113 controls the audio output to output information related to the display in the selected display area for each user operation on the touchscreen 21.

[0036] The setting unit 114 sets data for the setting items. In one example, the setting unit 114 sets default data for the setting items. In another example, the setting unit 114 sets data for the setting items based on user operation on the touchscreen 21.

[0037] [Example image] This section describes an example image displayed on touchscreen 21.

[0038] Figure 2 shows an example of a transition from the top image Ima displayed on the touchscreen 21 to another image.

[0039] The display control unit 112 displays the top image Ima on the touchscreen 21 based on user operation on the touchscreen 21. The top image Ima has multiple display areas Aa to Ad. The top image Ima displays the multiple display areas Aa to Ad in the order of display area Aa, display area Ab, display area Ac, and display area Ad, arranged in a first direction. Display area Aa is the first display area of ​​the multiple display areas Aa to Ad along the first direction. If the first direction is from top to bottom, the first display area is also called the uppermost display area. Display area Ad is the last display area of ​​the multiple display areas Aa to Ad along the first direction. If the first direction is from top to bottom, the last display area is also called the lowermost display area. In relation to the last display area, the first display area is virtually the display area adjacent to the last display area along the first direction. The last display area is, in relation to the first display area, virtually the display area adjacent to the first display area along the second direction. When the top image Ima is displayed on the touchscreen 21, the display control unit 112 changes the selected display area from the first display area to the second display area among the multiple display areas Aa to Ad based on the swipe operation and displays it.

[0040] Display area Aa displays the text "Copy Start". The following describes the case where display area Aa is the selected display area in the top image Ima. Display area Aa is an area where instructions can be entered to start the copy function with the default data set for multiple copy setting items based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays an image on the touchscreen 21 to confirm the start of the copy.

[0041] The setting display area Ab displays the text "Copy Settings". The following describes the case where display area Ab is a selected display area in the top image Ima. Display area Ab is an area where instructions to display the copy settings image Imb can be entered based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the copy settings image Imb on the touchscreen 21 with display area Aba as the selected display area.

[0042] Display area Ac displays the text "Voice Guidance App Settings". The following describes the case where display area Ac is a selected display area in the top image Ima. Display area Ac is an area where instructions can be entered to display the voice guidance setting image Imc based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the voice guidance setting image Imc on the touchscreen 21 with display area Aca selected as the display area.

[0043] Display area Ad displays the text "End voice guidance". The following describes the case where display area Ad is a selected display area in the top image Ima. Display area Ad is an area where an instruction to end voice guidance can be entered based on a double-tap operation. The display control unit 112 displays a predetermined image on the touchscreen 21 based on the double-tap operation.

[0044] Figure 3 shows an example of a transition from the copy setting image Imb displayed on the touchscreen 21 to another image.

[0045] The copy setting image Imb is an image used to set data for multiple copy setting items. The copy setting image Imb has multiple display areas Aba to Abf. The copy setting image Imb displays the multiple display areas Aba to Abf in the order of Aba, Abb, Abc, Abd, Abe, and Abf, arranged in a first direction. Display area Aba is the first display area of ​​the multiple display areas Aba to Abf along the first direction. Display area Abf is the last display area of ​​the multiple display areas Aba to Abf along the first direction. When the copy setting image Imb is displayed on the touchscreen 21, the display control unit 112 changes the selected display area from the first display area of ​​the multiple display areas Aba to Abf to the second display area based on the swipe operation and displays it.

[0046] Display area Aba is the display area for the copy count setting item. The copy count setting item is the item for setting the number of copies. The copy count setting item is an example of a copy setting item set for the copy function. The copy count setting is an example of a copy setting before executing the copy function. Since the number of copies is an example of a numerical value, the copy count setting item is an example of a numerical setting item for which a numerical value is set. Display area Aba displays the word "Number of Copies" to indicate the copy count setting item. Display area Aba displays the number of copies set for the copy count setting item by the setting unit 114 in text. For example, the number of copies that can be set is any value up to a predetermined value. Before the setting unit 114 sets the number of copies based on user operation, display area Aba displays the default number of copies "1".

[0047] This section describes the case where the display area Aba is a selected display area in the copy setting image Imb. Display area Aba is an area where instructions can be entered to display the copy quantity setting image Imd based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the copy quantity setting image Imd on the touchscreen 21 with display area Abaa as the selected display area. Before displaying the copy quantity setting image Imd, the display control unit 112 displays the number of copies set for the copy quantity setting item displayed in display area Abaa in display area Abaa. For example, suppose that the display area Aba of the copy setting image Imb displays the copy quantity "1" before displaying the copy quantity setting image Imd. In this example, the display area Abaa of the copy quantity setting image Imd displays the copy quantity "1".

[0048] Display area Abb is the display area for the color mode setting item. The color mode setting item is the item for setting the color mode. The color mode setting item is an example of a copy setting item. The color mode setting is an example of a copy setting. Display area Abb displays the text "Color Mode" to indicate the color mode setting item. Display area Abb displays the color mode set for the color mode setting item by the setting unit 114. For example, the configurable color modes are full color, black and white, or auto color. Before the setting unit 114 sets the color mode based on user operation, display area Abb displays the default color mode "Full Color" in text.

[0049] This section describes the case where the display area Abb is a selected display area in the copy setting image Imb. Display area Abb is an area where instructions can be entered to display the color mode setting image Ime based on a double-tap operation. The display control unit 112 displays the color mode setting image Ime on the touchscreen 21 based on the double-tap operation. The display control unit 112 displays the color mode setting image Ime as a selected display area that displays the color mode set for the color mode setting item. The color mode set for the color mode setting item is the color mode displayed in display area Abb before the color mode setting image Ime is displayed. For example, the display area Abb of the copy setting image Imb displays the color mode "Full Color" before the color mode setting image Ime is displayed. In this example, the color mode setting image Ime displays the display area Abba that displays the color mode "Full Color" as a selected display area.

[0050] Display area Abc is the display area for single-sided / double-sided setting items. Single-sided / double-sided setting items are items for setting the single-sided / double-sided mode. Single-sided / double-sided mode is a mode that sets the correspondence between the reading side of the original and the printed side of the copied sheet. Single-sided / double-sided setting items are an example of copy setting items. Single-sided / double-sided setting is an example of copy setting. Display area Abc displays the text "Single-sided / Double-sided" to indicate the single-sided / double-sided setting item. Display area Abc displays the single-sided / double-sided mode set for the single-sided / double-sided setting item by the setting unit 114 in text. For example, the configurable single-sided / double-sided modes are a mode that copies a single-sided original on one side or a mode that copies a double-sided original on both sides. Before the setting unit 114 sets the single-sided / double-sided mode based on user operation, display area Abc displays the default single-sided / double-sided mode, "Single-sided original copied on one side".

[0051] This section describes the case where display area Abc is a selected display area in the copy setting image Imb. Display area Abc is an area where instructions can be entered to display the single-sided / duplex setting image Imf based on a double-tap operation. The display control unit 112 displays the single-sided / duplex setting image Imf on the touchscreen 21 based on the double-tap operation. The display control unit 112 displays the single-sided / duplex setting image Imf as a selected display area that displays the single-sided / duplex mode set for the single-sided / duplex setting item. The single-sided / duplex mode set for the single-sided / duplex setting item is the single-sided / duplex mode displayed in display area Abc before the display of the single-sided / duplex setting image Imf. For example, the display area Abc of the copy setting image Imb displays the single-sided / duplex mode "Single-sided original to single-sided copy" before the display of the single-sided / duplex setting image Imf. In this example, the single-sided / double-sided setting image Imf displays the display area Abca, which displays the single-sided / double-sided mode "Single-sided original copy to single-sided," as the selected display area.

[0052] Display area Abd displays the text "Copy Start". The following describes the case where display area Abd is a selected display area in the copy setting image Imb. Display area Abd is an area where instructions can be entered to start the copy function with data set for multiple copy setting items based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays an image on the touchscreen 21 to confirm the start of the copy.

[0053] Display area Abe displays the word "Reset". The following describes the case where display area Abe is the selected display area in the copy setting image Imb. Display area Abe is an area where instructions can be entered to reset the data set for multiple copy setting items to default data based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb with the multiple copy setting items reset to default data on the touchscreen 21.

[0054] Display area Abf displays the word "Cancel". The following describes the case where display area Abf is a selected display area in the copy setting image Imb. Display area Abf is an area where instructions to display the top image Ima based on a double-tap operation can be entered. Based on the double-tap operation, the display control unit 112 displays the top image Ima on the touchscreen 21 with display area Ab as the selected display area.

[0055] This section explains the image (Imd) used for setting the number of copies. The copy count setting image Imd is an image used to set the number of copies for the copy count setting item. The copy count setting image Imd has one display area Abaa.

[0056] Display area Abaa is the display area for the number of copies to be set for the number of copies setting item. Display area Abaa displays the number of copies in text. When the image for setting the number of copies Imd is displayed on the touchscreen 21, the display control unit 112 changes and displays the number of copies in display area Abaa based on a swipe operation without changing the selected display area from display area Abaa. Display area Abaa is an area where instructions can be entered to set the number of copies displayed in display area Abaa for the number of copies setting item based on a double-tap operation.

[0057] The following describes the processing of the control circuit 11 based on a double-tap operation when the copy count setting image Imd is displayed on the touchscreen 21. Based on the double-tap operation, the setting unit 114 sets the number of copies displayed in display area Abaa for the copy count setting item. Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Aba as the selected display area. The display control unit 112 displays the number of copies set by the setting unit 114 in display area Aba of the copy setting image Imb.

[0058] This section explains the image IME used for setting the color mode. The color mode setting image Ime is an image used to set the color mode for a color mode setting item. The color mode setting image Ime has multiple display areas Abba to Abbbd. The color mode setting image Ime displays the multiple display areas Abba to Abbbd in the order of Abba, Abbb, Abbc, and Abbbd, arranged in a first direction. Display area Abba is the first display area of ​​the multiple display areas Abba to Abbbd along the first direction. Display area Abbbd is the last display area of ​​the multiple display areas Abba to Abbbd along the first direction. When the color mode setting image Ime is displayed on the touchscreen 21, the display control unit 112 changes the selected display area from the first display area of ​​the multiple display areas Abba to Abbbd to the second display area based on the swipe operation and displays it.

[0059] Display area Abba is the display area for setting the color mode for the color mode setting item. Display area Abba displays the color mode "Full Color" in text. The case where display area Abba is the selected display area in the color mode setting image Ime will be explained below. Display area Abba is an area where instructions can be entered to set the color mode "Full Color" displayed in display area Abba to the color mode setting item based on a double-tap operation. The setting unit 114 sets the color mode "Full Color" displayed in display area Abba to the color mode setting item based on the double-tap operation. The display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abba as the selected display area based on the double-tap operation. The display control unit 112 displays the color mode "Full Color" set by the setting unit 114 in the display area Abba of the copy setting image Imb.

[0060] Display area Abbb is the display area for setting the color mode for the color mode setting item. Display area Abbb displays the color mode "black and white" as text. The case where display area Abbb is the selected display area in the color mode setting image Ime will be explained below. Display area Abbb is an area where instructions can be entered to set the color mode "black and white" displayed in display area Abbb to the color mode setting item based on a double-tap operation. The setting unit 114 sets the color mode "black and white" displayed in display area Abbb to the color mode setting item based on the double-tap operation. The display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abb as the selected display area based on the double-tap operation. The display control unit 112 displays the color mode "black and white" set by the setting unit 114 in display area Abb of the copy setting image Imb.

[0061] Display area Abbc is the display area for setting the color mode for the color mode setting item. Display area Abbc displays the color mode "Auto Color" in text. The case where display area Abbc is the selected display area in the color mode setting image Ime will be explained below. Display area Abbc is an area where instructions can be entered to set the color mode setting item to the color mode "Auto Color" displayed in display area Abbc based on a double-tap operation. The setting unit 114 sets the color mode setting item to the color mode setting item to the color mode "Auto Color" displayed in display area Abbc based on the double-tap operation. The display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abbc as the selected display area based on the double-tap operation. The display control unit 112 displays the color mode "Auto Color" set by the setting unit 114 in the display area Abbc of the copy setting image Imb.

[0062] Display area Abbbd displays the word "Cancel". The following describes the case where display area Abbbd is a selected display area in the color mode setting image Ime. Display area Abbbd is an area where instructions can be entered to display the copy setting image Imb based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abbb as the selected display area.

[0063] This section explains the IMF image for single-sided / double-sided settings. The single-sided / double-sided setting image Imf is an image used to set the single-sided / double-sided mode for a single-sided / double-sided setting item. The single-sided / double-sided setting image Imf has multiple display areas Abca to Abcc. The single-sided / double-sided setting image Imf displays the multiple display areas Abca to Abcc in the order of Abca, Abbcb, and Abcc, arranged in a first direction. Display area Abca is the first display area of ​​the multiple display areas Abca to Abcc along the first direction. Display area Abcc is the last display area of ​​the multiple display areas Abca to Abcc along the first direction. When the single-sided / double-sided setting image Imf is displayed on the touchscreen 21, the display control unit 112 changes the selected display area from the first display area of ​​the multiple display areas Abca to Abcc to the second display area based on the swipe operation and displays it.

[0064] Display area Abca is the display area for setting the single-sided / double-sided mode for the single-sided / double-sided setting item. Display area Abca displays the single-sided / double-sided mode "Single-sided copy of single-sided document" in text. The case where display area Abca is the selected display area in the single-sided / double-sided setting image Imf is described below. Display area Abca is an area where instructions can be entered to set the single-sided / double-sided mode "Single-sided copy of single-sided document" displayed in display area Abca to the single-sided / double-sided setting item based on a double-tap operation. The setting unit 114 sets the single-sided / double-sided mode "Single-sided copy of single-sided document" displayed in display area Abca to the single-sided / double-sided setting item based on the double-tap operation. The display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abc as the selected display area based on the double-tap operation. The display control unit 112 displays the single-sided / double-sided mode "Single-sided original copied on one side" set by the setting unit 114 in the display area Abc of the copy setting image Imb.

[0065] Display area Abcb is the display area for setting the single-sided / double-sided mode for the single-sided / double-sided setting item. Display area Abcb displays the single-sided / double-sided mode "Double-sided copy of double-sided document" in text. The following describes the case where display area Abcb is the selected display area in the single-sided / double-sided setting image Imf. Display area Abcb is an area where instructions can be entered to set the single-sided / double-sided mode "Double-sided copy of double-sided document" displayed in display area Abcb to the single-sided / double-sided setting item based on a double-tap operation. Based on the double-tap operation, the setting unit 114 sets the single-sided / double-sided mode "Double-sided copy of double-sided document" displayed in display area Abcb to the single-sided / double-sided setting item. Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abc as the selected display area. The display control unit 112 displays the single-sided / double-sided mode "Double-sided copy of double-sided document" set by the setting unit 114 in display area Abc of the copy setting image Imb.

[0066] Display area Abcc displays the word "Cancel". The following describes the case where display area Abcc is a selected display area in the single-sided / double-sided setting image Imf. Display area Abcc is an area where instructions can be entered to display the copy setting image Imb based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 with display area Abcc as the selected display area.

[0067] Figure 4 shows an example of the transition from the voice guidance setting image Imc displayed on the touchscreen 21 to another image.

[0068] The voice guidance setting image Imc is an image for setting data for multiple voice guidance setting items. The voice guidance setting image Imc has multiple display areas Aca to Ace. The voice guidance setting image Imc displays the multiple display areas Aca to Ace in the order of display area Aca, display area Acb, display area Acc, display area Acd, and display area Ace, arranged in a first direction. Display area Aca is the first display area of ​​the multiple display areas Aca to Ace along the first direction. Display area Ace is the last display area of ​​the multiple display areas Aca to Ace along the first direction. When the voice guidance setting image Imc is displayed on the touchscreen 21, the display control unit 112 changes the selected display area from the first display area of ​​the multiple display areas Aca to Ace to the second display area based on the swipe operation and displays it.

[0069] Display area Aca is a display area related to the settings items for the startup operation guide. The settings items for the startup operation guide are items for setting the voice guidance for the startup operation guide. The settings items for the startup operation guide are an example of voice guidance settings items that can be set for voice guidance. Display area Aca displays the text "Operation Guide Settings" to indicate the settings items for the startup operation guide. Display area Aca displays the text whether or not the settings have been set for the settings items for the startup operation guide by the setting unit 114. Before the setting unit 114 sets whether or not the settings have been set based on user operation, display area Aca displays the default "Yes".

[0070] This section describes the case where the display area Aca is the selected display area in the voice guidance setting image Imc. Display area Aca is an area where instructions can be entered to display the operation guide setting image based on a double-tap operation. The operation guide setting image is an image used to set whether or not to set the setting items for the operation guide at startup. The display control unit 112 displays the operation guide setting image on the touchscreen 21 based on the double-tap operation.

[0071] Display area Acb is a display area related to the voice speed setting item. The voice speed setting item is an item for setting the voice speed of the voice guidance. The voice speed setting item is an example of a voice guidance setting item. The voice speed setting is an example of a voice setting for voice guidance. Since voice speed is an example of a numerical value, the voice speed setting item is an example of a numerical setting item. Display area Acb displays the text "Voice Speed ​​Setting" to indicate the voice speed setting item. Display area Acb displays the voice speed set for the voice speed setting item by the setting unit 114 in text. For example, the configurable voice speed is an arbitrary level value with a predetermined level such as 10 as the upper limit. Before the setting unit 114 sets the voice speed based on user operation, display area Acb displays the default voice speed "3".

[0072] This section describes the case where the display area Acb is a selected display area in the voice guidance setting image Imc. The display area Acb is an area where instructions to display the voice speed setting image Img based on a double-tap operation can be entered. Based on the double-tap operation, the display control unit 112 displays the voice speed setting image Img on the touchscreen 21 with the display area Acba as the selected display area. Before displaying the voice speed setting image Img, the display control unit 112 displays the voice speed set for the voice speed setting item displayed in the display area Acb in the display area Acba. For example, suppose the display area Acb of the voice guidance setting image Imc displays voice speed "3" before displaying the voice speed setting image Img. In this example, the display area Acba of the voice speed setting image Img displays voice speed "3".

[0073] Display area Acc is a display area related to volume setting items. Volume setting items are items for setting the volume of voice guidance. Volume setting items are an example of voice guidance setting items. Volume setting is an example of voice setting. Since volume is an example of a numerical value, volume setting items are an example of a numerical setting item. Display area Acc displays the text "Volume Setting" to indicate the volume setting item. Display area Acc displays the volume set for the volume setting item by the setting unit 114 in text. For example, the configurable volume is an arbitrary level value with a predetermined level such as 10 as the upper limit. Before the setting unit 114 sets the volume based on user operation, display area Acc displays the default volume "3".

[0074] This section describes the case where the display area Acc is a selected display area in the voice guidance setting image Imc. The display area Acc is an area where an instruction to display the volume setting image Imh based on a double-tap operation can be entered. Based on the double-tap operation, the display control unit 112 displays the volume setting image Imh on the touchscreen 21 with the display area Acca selected as the display area. Before displaying the volume setting image Imh, the display control unit 112 displays the volume set for the volume setting item displayed in the display area Acca in the display area Acca. For example, suppose the display area Acc of the voice guidance setting image Imc displays volume "3" before displaying the volume setting image Imh. In this example, the display area Acca of the volume setting image Imh displays volume "3".

[0075] The display area Acd displays the word "Reset" in text. The following describes the case where the display area Acd is selected in the voice guidance setting image Imc. The display area Acd is an area where instructions can be entered to reset the data set for multiple voice guidance setting items to default data based on a double-tap operation. Based on the double-tap operation, the display control unit 112 displays the voice guidance setting image Imc with the multiple voice guidance setting items reset to default data on the touchscreen 21.

[0076] Display area Ace displays the word "Back". The following describes the case where display area Ace is the selected display area in the voice guidance setting image Imc. Display area Ace is an area where instructions to display the top image Ima based on a double-tap operation can be entered. Based on the double-tap operation, the display control unit 112 displays the top image Ima on the touchscreen 21 as the selected display area Ac.

[0077] This section explains the image (Img) used for setting the audio speed. The audio speed setting image (Img) is an image used to set the audio speed for the audio speed setting item. The audio speed setting image (Img) has one display area (Acba).

[0078] The display area Acba is the display area for setting the voice speed for the voice speed setting item. The display area Acba displays the voice speed in text. When the voice speed setting image Img is displayed on the touchscreen 21, the display control unit 112 changes and displays the voice speed in the display area Acba based on a swipe operation without changing the selected display area from the display area Acba. The display area Acba is an area where instructions can be entered to set the voice speed displayed in the display area Acba for the voice speed setting item based on a double-tap operation.

[0079] The following describes the processing of the control circuit 11 based on a double-tap operation when the voice speed setting image Img is displayed on the touchscreen 21. Based on the double-tap operation, the setting unit 114 sets the voice speed displayed in the display area Acba for the voice speed setting item. Based on the double-tap operation, the display control unit 112 displays the voice guidance setting image Imc on the touchscreen 21 as the selected display area Acb. The display control unit 112 displays the voice speed set by the setting unit 114 in the display area Acb of the voice guidance setting image Imc.

[0080] This explains the image "Imh" used for volume settings. The volume setting image Imh is an image used to set the volume for a specific volume setting item. The volume setting image Imh has one display area Acca.

[0081] Display area Acca is the display area for setting the volume for a volume setting item. Display area Acca displays the volume in text. When the volume setting image Imh is displayed on the touchscreen 21, the display control unit 112 changes and displays the volume in display area Acca based on a swipe operation without changing the selected display area from display area Acca. Display area Acba is an area where instructions can be entered to set the volume displayed in display area Acca for a volume setting item based on a double-tap operation.

[0082] The following describes the processing of the control circuit 11 based on a double-tap operation when the volume setting image Imh is displayed on the touchscreen 21. Based on the double-tap operation, the setting unit 114 sets the volume displayed in the display area Acca for the volume setting item. Based on the double-tap operation, the display control unit 112 displays the voice guidance setting image Imc on the touchscreen 21 as the selected display area for display area Acc. The display control unit 112 displays the volume set by the setting unit 114 in the display area Acc of the voice guidance setting image Imc.

[0083] Next, we will describe some examples of image transitions based on user interaction.

[0084] This section explains the image transitions associated with setting the number of copies based on user input. Figure 5 shows an example of the image transitions associated with the number of copies set on the touchscreen 21. Figure 5 shows an example where the user changes the number of copies from 1 to 2.

[0085] The touchscreen 21 displays the copy setting image Imb as the selected display area Aba. Display area Aba displays the number of copies "1". Assume the user has performed a double-tap operation. Based on the double-tap operation, the touchscreen 21 displays the copy number setting image Imd as the selected display area Abaa. The touchscreen 21 may display the copy number setting image Imd instead of the copy setting image Imb. The touchscreen 21 may also display the copy number setting image Imd superimposed on the copy setting image Imb. Display area Abaa displays the number of copies "1" that was displayed in display area Aba before the display of the copy number setting image Imd. Assume the user has performed an upward swipe operation. Based on the upward swipe operation, the touchscreen 21 displays the number of copies "2" in display area Abaa without changing the selected display area from display area Abaa. Assume the user has performed a double-tap operation. Based on a double-tap operation, the touchscreen 21 displays the copy setting image Imb as the selected display area Aba. Display area Aba displays the number of copies as "2".

[0086] This section explains the image transitions associated with color mode settings based on user input. Figure 6 shows an example of the image transition associated with the color mode setting displayed on the touchscreen 21. Figure 6 shows an example of the user changing the color mode from full color to black and white.

[0087] The touchscreen 21 displays the copy setting image Imb as the selected display area Abb. Display area Abb displays the color mode "Full Color". Assume the user has performed a double-tap operation. Based on the double-tap operation, the touchscreen 21 displays the color mode setting image Ime as the selected display area Abba, which displays the color mode "Full Color". The touchscreen 21 may display the color mode setting image Ime instead of the copy setting image Imb. The touchscreen 21 may also display the color mode setting image Ime superimposed on the copy setting image Imb. Assume the user has performed a downward swipe operation. Based on the downward swipe operation, the touchscreen 21 changes the selected display area from display area Abba to display area Abbb, which displays the color mode "Black and White". Assume the user has performed a double-tap operation. Based on the double-tap operation, the touchscreen 21 displays the copy setting image Imb as the selected display area Abb. Display area Abb displays the "black and white" color mode.

[0088] This section explains the image transitions associated with single-sided / double-sided printing settings based on user input. Figure 7 shows an example of the image transition associated with the single-sided / double-sided setting displayed on the touchscreen 21. Figure 7 shows an example of a user changing the single-sided / double-sided mode from a mode that copies a single-sided document on one side to a mode that copies a double-sided document on both sides.

[0089] The touchscreen 21 displays the copy setting image Imb as the selected display area Abc. Display area Abc displays the single-sided / double-sided mode "Single-sided copy of single-sided document". The user performs a double-tap operation. Based on the double-tap operation, the touchscreen 21 displays the single-sided / double-sided setting image Imf as the selected display area Abca, which displays the single-sided / double-sided mode "Single-sided copy of single-sided document". The touchscreen 21 may display the single-sided / double-sided setting image Imf instead of the copy setting image Imb. The touchscreen 21 may also display the single-sided / double-sided setting image Imf superimposed on the copy setting image Imb. The user performs a downward swipe operation. Based on the downward swipe operation, the touchscreen 21 changes the selected display area from display area Abca to display area Abbcb, which displays the single-sided / double-sided mode "Double-sided copy of double-sided document". The user performs a double-tap operation. Based on a double-tap operation, the touchscreen 21 displays the copy setting image Imb as the selected display area Abc. Display area Abc displays the single-sided / double-sided mode "Double-sided copy of double-sided document".

[0090] This section explains the image transitions associated with setting the audio speed based on user input. Figure 8 shows an example of the image transitions associated with the voice speed setting displayed on the touchscreen 21. Figure 8 shows an example where the user changes the voice speed from 3 to 4.

[0091] The touchscreen 21 displays the voice guidance setting image Imc as the selected display area Acb. Display area Acb displays voice speed "3". The user performs a double-tap operation. Based on the double-tap operation, the touchscreen 21 displays the voice speed setting image Img as the selected display area Acba. The touchscreen 21 may display the voice speed setting image Img instead of the voice guidance setting image Imc. The touchscreen 21 may display the voice speed setting image Img superimposed on the voice guidance setting image Imc. Display area Acba displays the voice speed "3" which was displayed in display area Acb before the display of the voice speed setting image Img. The user performs an upward swipe operation. Based on the upward swipe operation, the touchscreen 21 displays voice speed "4" in display area Acba without changing the selected display area from display area Acba. The user performs a double-tap operation. Based on a double-tap operation, the touchscreen 21 displays the image Imc for voice guidance settings as the selected display area Acb. The display area Acb displays the voice speed "4".

[0092] Note that the image transitions associated with volume settings based on user input are the same as those associated with audio speed settings based on user input, as explained using Figure 8, so their explanation will be omitted.

[0093] Furthermore, among the images displayed on the touchscreen 21, the higher-level image is also called the first image. Images at a lower level than the first image are also called the second image. If the top image Ima is the first image, then the copy setting image Imb or the voice guidance setting image Imc are the second images. If the copy setting image Imb is the first image, then the copy count setting image Imd, the color mode setting image Ime, or the single-sided / double-sided setting image Imf are the second images. If the voice guidance setting image Imc is the first image, then the voice speed setting image Img or the volume setting image Imh are the second images.

[0094] [Example of operation] Next, we will explain the processing performed by the control circuit 11 of the image forming apparatus 1 configured as described above. The processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, depending on the embodiment, steps in the processing procedure described below may be omitted, replaced, or added as appropriate.

[0095] Figure 9 is a flowchart showing an example of processing associated with user interaction on the top image Ima displayed on the touchscreen 21.

[0096] The display control unit 112 displays the top image Ima on the touchscreen 21 based on a predetermined user operation (ACT1). Here, in the top image Ima, the display area Aa that displays "Copy Start" is assumed to be the selected display area.

[0097] The audio control unit 113 controls the system to output information in voice according to the selected display area when the top image Ima is displayed based on a predetermined user operation (ACT2). In ACT2, for example, the audio control unit 113 controls the system to output "Copy Start Selected" in voice as information corresponding to the selected display area Aa.

[0098] The detection unit 111 waits for user input (ACT3). If the detection unit 111 does not detect user input (ACT3, NO), the detection unit 111 continues processing ACT3. If the detection unit 111 detects user input (ACT3, YES), the process transitions from ACT3 to ACT4. The detection unit 111 detects whether the user input is a swipe operation or not (ACT4). If the user input is a swipe operation (ACT4, YES), the process transitions from ACT4 to ACT5. If the user input is not a swipe operation (ACT4, NO), the process transitions from ACT4 to ACT7.

[0099] The display control unit 112 changes the selected display area from the first display area to the second display area among the multiple display areas Aa to Ad based on the swipe operation and displays it (ACT5). In ACT5, for example, the display control unit 112 switches the selected display area among the multiple display areas Aa to Ad and displays it with each swipe operation.

[0100] Let's take a downward swipe operation when the top image Ima is displayed on the touchscreen 21 as an example. Based on the downward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. First, let's explain the case where the first display area is a display area other than the last display area among the multiple display areas Aa to Ad. In this example, based on the downward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. For example, in the top image Ima, let's assume that the display area Aa that displays "Copy Start" is the selected display area. Based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Aa to display area Ab adjacent to display area Aa along the first direction and displays it. Next, let's explain the case where the first display area is the last display area. In this example, the display control unit 112 changes the selected display area from the first display area to the second display area, which is the first display area, based on a downward swipe operation. The first display area is the display area adjacent to the last display area virtually along the first direction. For example, in the top image Ima, the selected display area is the display area Ad that displays "End voice guidance". Based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Ad to the first display area Aa, which is the first display area, and displays it.

[0101] Let's take an example of an upward swipe operation when the top image Ima is displayed on the touchscreen 21. Based on the upward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the second direction and displays it. First, let's explain the case where the first display area is a display area other than the first of the multiple display areas Aa to Ad. In this example, based on the upward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the second direction and displays it. For example, in the top image Ima, let's assume that the display area Ad that displays "End voice guidance" is the selected display area. Based on the upward swipe operation, the display control unit 112 changes the selected display area from display area Ad to the display area Ac adjacent to display area Ad along the second direction and displays it. Next, let's explain the case where the first display area is the first display area. In this example, the display control unit 112 changes the selected display area from the first display area to the second display area, which is the last display area, based on the upward swipe operation. The last display area is the display area virtually adjacent to the first display area along the second direction. For example, in the top image Ima, the selected display area is the display area Aa that displays "Copy Start". Based on the upward swipe operation, the display control unit 112 changes the selected display area from display area Aa to the last display area Ad, which is the last display area, and displays it.

[0102] The audio control unit 113 controls the system to output information in voice corresponding to the selected display area based on the swipe operation (ACT6). In ACT6, for example, the audio control unit 113 controls the system to output information in voice corresponding to the selected display area as the selected display area changes based on the swipe operation. For example, in the top image Ima, the display control unit 112 changes the selected display area from display area Aa to display area Ab based on the downward swipe operation. In this example, the audio control unit 113 controls the system to output "Copy setting selected" in voice as information corresponding to display area Ab, which is the selected display area.

[0103] The detection unit 111 detects whether the user operation is a double-tap operation or not (ACT7). If the user operation is a double-tap operation (ACT7, YES), the process transitions from ACT7 to ACT8. If the user operation is not a double-tap operation (ACT7, NO), the process transitions from ACT7 to ACT10. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0104] Based on the double-tap operation, the display control unit 112 displays an image on the touchscreen 21 corresponding to the selected display area in the top image Ima (ACT8).

[0105] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT9). In ACT9, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the image displayed on the touchscreen 21 in conjunction with the display of an image based on the double-tap operation.

[0106] The audio control unit 113 controls the system to output information in audio corresponding to the selected display area in the top image Ima based on the tap operation (ACT10).

[0107] Figure 10 is a flowchart showing an example of processing associated with user operations on the copy setting image Imb displayed on the touchscreen 21.

[0108] Here, we assume that in the top image Ima, the display area Ab that displays "Copy Settings" is selected, and the user performs a double-tap operation.

[0109] Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 as the selected display area Aba (ACT11).

[0110] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT12). In ACT12, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the copy setting image Imb when the copy setting image Imb is displayed based on the double-tap operation. For example, suppose the display area Aba displays "Number of Copies" and the number of copies "1", which indicate the number of copies setting item. In this example, the audio control unit 113 controls the system to output "Copy setting Number of copies setting Setting value 1" in voice as information corresponding to the selected display area Aba.

[0111] The detection unit 111 waits for user input (ACT13). If the detection unit 111 does not detect user input (ACT13, NO), the detection unit 111 continues processing ACT13. If the detection unit 111 detects user input (ACT13, YES), the process transitions from ACT13 to ACT14. The detection unit 111 detects whether the user input is a swipe operation or not (ACT14). If the user input is a swipe operation (ACT14, YES), the process transitions from ACT14 to ACT15. If the user input is not a swipe operation (ACT14, NO), the process transitions from ACT14 to ACT17.

[0112] The display control unit 112 changes the selected display area from the first display area to the second display area among the multiple display areas Aba to Abf based on the swipe operation and displays it (ACT 15). In ACT 15, for example, the display control unit 112 switches the selected display area one by one among the multiple display areas Aba to Abf with each swipe operation.

[0113] When the copy setting image Imb is displayed on the touchscreen 21, the processing of ACT15 based on a downward swipe or upward swipe operation is the same as the processing of ACT5. Based on the downward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. For example, based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Aba to the display area Abb adjacent to display area Aba along the first direction and displays it. Based on the downward swipe operation, the display control unit 112 changes the selected display area from the last display area, display area Abf, to the first display area, display area Aba and displays it. Based on the upward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the second direction and displays it. For example, based on an upward swipe operation, the display control unit 112 changes the selected display area from display area Abf to the adjacent display area Abe along the second direction and displays it. Based on an upward swipe operation, the display control unit 112 changes the selected display area from the first display area Aba to the last display area Abf and displays it.

[0114] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the swipe operation (ACT16). In ACT16, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area as the selected display area changes based on the swipe operation. For example, in the copy setting image Imb, the display control unit 112 changes the selected display area from display area Aba to display area Abb based on the downward swipe operation. Display area Abb displays "Color Mode" and "Full Color," which indicate the color mode setting items. In this example, the audio control unit 113 controls the system to output "Color Mode Setting Setting Value Full Color" in voice as information corresponding to display area Abb, which is the selected display area.

[0115] The detection unit 111 detects whether the user operation is a double-tap operation (ACT17). If the user operation is a double-tap operation (ACT17, YES), the process transitions from ACT17 to ACT18. If the user operation is not a double-tap operation (ACT17, NO), the process transitions from ACT17 to ACT20. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0116] Based on the double-tap operation, the display control unit 112 displays an image on the touchscreen 21 corresponding to the selected display area in the copy setting image Imb (ACT18).

[0117] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT19). In ACT19, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the image displayed on the touchscreen 21 in conjunction with the display of an image based on the double-tap operation.

[0118] The audio control unit 113 controls the system to output information in voice according to the selected display area in the copy setting image Imb, based on the tap operation (ACT20). In ACT20, for example, the audio control unit 113 controls the system to repeatedly output information in voice according to the same selected display area each time the user performs a tap operation. This allows the user to repeatedly check the display content in the selected display area with simple operations.

[0119] Figure 11 is a flowchart showing an example of processing associated with user operations on the copy count setting image Imd displayed on the touchscreen 21.

[0120] Here, we assume that the user double-tapped the image Imb used for copy settings, while the display area Aba was selected. We also assume that the display area Aba is showing the number of copies as "1".

[0121] Based on the double-tap operation, the display control unit 112 displays the copy count setting image Imd on the touchscreen 21 as the selected display area Abaa (ACT21). Before the display of the copy count setting image Imd, the display area Abaa displays the copy count "1" that is currently displayed in the display area Aba.

[0122] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT22). In ACT22, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the copy count setting image Imd when the copy count setting image Imd is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the copy count in voice as information according to the selected display area. For example, the audio control unit 113 controls the system to output "Copy count setting Copy count 1" in voice as information according to the display area Abaa, which is the selected display area.

[0123] The detection unit 111 waits for user input (ACT23). If the detection unit 111 does not detect user input (ACT23, NO), the detection unit 111 continues processing ACT23. If the detection unit 111 detects user input (ACT23, YES), the process transitions from ACT23 to ACT24. The detection unit 111 detects whether the user input is a swipe operation or not (ACT24). If the user input is a swipe operation (ACT24, YES), the process transitions from ACT24 to ACT25. If the user input is not a swipe operation (ACT24, NO), the process transitions from ACT24 to ACT27.

[0124] Based on the swipe operation, the display control unit 112 changes the number of copies in the display area Abaa without changing the selected display area from the display area Abaa and displays it (ACT25). In ACT25, for example, the display control unit 112 changes the number of copies in the display area Abaa by 1 each time a swipe operation is performed and displays it.

[0125] Let's take a downward swipe operation as an example when the copy count setting image Imd is displayed on the touchscreen 21. Based on the downward swipe operation, the display control unit 112 reduces the copy count by 1 in the display area Abaa and displays it. For example, suppose the copy count setting image Imd displays "5" in the display area Abaa. Based on the downward swipe operation, the display control unit 112 displays "4" as the copy count in the display area Abaa, which is "5" minus 1.

[0126] Let's take an example of an upward swipe operation when the copy count setting image Imd is displayed on the touchscreen 21. Based on the upward swipe operation, the display control unit 112 increases the copy count by 1 in the display area Abaa and displays it. For example, suppose the copy count setting image Imd displays copy count "1" in the display area Abaa. Based on the upward swipe operation, the display control unit 112 increases "1" by 1 and displays "2" as the copy count in the display area Abaa.

[0127] The audio control unit 113 controls the system to output information corresponding to the selected display area via voice based on the swipe operation (ACT26). In ACT26, for example, the audio control unit 113 controls the system to output information corresponding to the selected display area via voice when the number of copies in the display area Abaa changes based on the swipe operation. The audio control unit 113 controls the system to output the number of copies via voice as information corresponding to the selected display area. For example, suppose the display area Abaa displays "2" as the number of copies, which is one more than "1" based on the swipe operation. The selected display area remains Abaa before and after the swipe operation. In this example, the audio control unit 113 controls the system to output "Number of copies 2" via voice as information corresponding to the selected display area Abaa. In this way, the audio control unit 113 can control the system to output the changed number of copies via voice as information corresponding to the selected display area each time the number of copies changes.

[0128] The detection unit 111 detects whether the user operation is a double-tap operation (ACT27). If the user operation is a double-tap operation (ACT27, YES), the process transitions from ACT27 to ACT28. If the user operation is not a double-tap operation (ACT27, NO), the process transitions from ACT27 to ACT31. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0129] Based on the double-tap operation, the setting unit 114 sets the number of copies displayed in the display area Abaa to the copy count setting item (ACT28). For example, if the copy count setting image Imd is displayed on the touchscreen 21, the display area Abaa will display the copy count "2". In this example, based on the double-tap operation, the setting unit 114 sets the copy count "2" to the copy count setting item.

[0130] Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 as the selected display area Aba (ACT29). For example, the display area Aba of the copy setting image Imb displays the number of copies "2" set by the setting unit 114. The display area Aba updates the number of copies from "1" to "2" and displays it. In this way, the display area Aba can update and display the number of copies each time the number of copies is set by the setting unit 114.

[0131] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT30). In ACT30, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the copy setting image Imb when the copy setting image Imb is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the number of copies setting item in voice as information according to the selected display area. The audio control unit 113 controls the system to output the number of copies in voice as information according to the selected display area. When display area Aba displays the number of copies "2", the audio control unit 113 controls the system to output "Copy setting Number of copies setting Setting value 2" in voice as information according to display area Aba, which is the selected display area. In this way, the audio control unit 113 can control the system to output the set number of copies in voice as information according to the selected display area for each set of the number of copies.

[0132] The audio control unit 113 controls the system to output information in audio corresponding to the selected display area in the copy count setting image Imd, based on the tap operation (ACT31). The processing of ACT31 may be the same as the processing of ACT20.

[0133] Figure 12 is a flowchart showing an example of processing associated with user operation in the color mode setting image Ime displayed on the touchscreen 21.

[0134] Here, we assume that the user double-tapped the image Imb used for copy settings, while the display area Abb was selected. We also assume that the display area Abb is displaying in "Full Color" color mode.

[0135] Based on the double-tap operation, the display control unit 112 displays the color mode setting image Ime on the touchscreen 21 as a selected display area for displaying the set color mode (ACT41). For example, the display control unit 112 displays the color mode setting image Ime on the touchscreen 21 as a selected display area Abba for displaying the color mode "Full Color".

[0136] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT42). In ACT42, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the color mode setting image Ime when the color mode setting image Ime is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the color mode in voice as information according to the selected display area. For example, the audio control unit 113 controls the system to output "Color mode setting Full color selected" in voice as information according to the display area Abba, which is the selected display area.

[0137] The detection unit 111 waits for user input (ACT43). If the detection unit 111 does not detect user input (ACT43, NO), the detection unit 111 continues processing ACT43. If the detection unit 111 detects user input (ACT43, YES), the process transitions from ACT43 to ACT44. The detection unit 111 detects whether the user input is a swipe operation or not (ACT44). If the user input is a swipe operation (ACT44, YES), the process transitions from ACT44 to ACT45. If the user input is not a swipe operation (ACT44, NO), the process transitions from ACT44 to ACT47.

[0138] The display control unit 112 changes the selected display area from the first display area to the second display area among the multiple display areas Abba to Abbbd based on the swipe operation (ACT45). In ACT45, for example, the display control unit 112 switches the selected display area from the multiple display areas Abba to Abbbd one by one with each swipe operation.

[0139] When the color mode setting image Ime is displayed on the touchscreen 21, the processing of ACT45 based on a downward swipe or upward swipe operation is the same as the processing of ACT5. Based on the downward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. For example, based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Abba to display area Abbb adjacent to display area Abba along the first direction and displays it. Based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Abbbd, which is the last display area, to display area Abba, which is the first display area and displays it. Based on the upward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the second direction and displays it. For example, based on an upward swipe operation, the display control unit 112 changes the selected display area along the second direction from display area Abbbd to display area Abbc adjacent to display area Abbbd and displays it. Based on an upward swipe operation, the display control unit 112 changes the selected display area from the first display area Abba to the last display area Abbbd and displays it.

[0140] The audio control unit 113 controls the system to output information in voice corresponding to the selected display area based on the swipe operation (ACT46). In ACT46, for example, the audio control unit 113 controls the system to output information in voice corresponding to the selected display area as the selected display area changes based on the swipe operation. The audio control unit 113 controls the system to output the color mode in voice as information corresponding to the selected display area. For example, in the color mode setting image Ime, the display control unit 112 changes the selected display area from display area Abba to display area Abbb and displays it based on the downward swipe operation. In this example, the audio control unit 113 controls the system to output "Black and White Selected" in voice as information corresponding to display area Abbb, which is the selected display area.

[0141] The detection unit 111 detects whether the user operation is a double-tap operation (ACT47). If the user operation is a double-tap operation (ACT47, YES), the process transitions from ACT47 to ACT48. If the user operation is not a double-tap operation (ACT47, NO), the process transitions from ACT47 to ACT52. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0142] The detection unit 111 detects whether the selected display area is a color mode display area at the timing of the double-tap operation (ACT48). The color mode display areas are display area Abba, display area Abbb, or display area Abbc. If the selected display area is a color mode display area (ACT48, YES), the process transitions from ACT48 to ACT49. If the selected display area is not a color mode display area (ACT48, NO), the process transitions from ACT48 to ACT50. If the selected display area is not a color mode display area, it means that the selected display area is display area Abbbd, which displays "Cancel".

[0143] Based on the double-tap operation, the setting unit 114 sets the color mode displayed in one of the multiple display areas Abba to Abbc, which are the selected display areas, to the color mode setting item (ACT49). For example, suppose the display area Abbb that displays the color mode "black and white" is the selected display area. In this example, based on the double-tap operation, the setting unit 114 sets the color mode "black and white" to the color mode setting item.

[0144] Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 as the selected display area Abb (ACT50). For example, the display area Abb of the copy setting image Imb displays the color mode "black and white" set by the setting unit 114. The display area Abb updates the color mode from "full color" to "black and white" and displays it. In this way, the display area Abb can update and display the color mode each time the color mode is set by the setting unit 114.

[0145] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT51). In ACT51, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the copy setting image Imb when the copy setting image Imb is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the color mode setting item in voice as information according to the selected display area. The audio control unit 113 controls the system to output the color mode in voice as information according to the selected display area. When display area Abb displays the color mode "black and white", the audio control unit 113 controls the system to output "Copy setting Color mode setting Setting value Black and white" in voice as information according to display area Abb, which is the selected display area. In this way, the audio control unit 113 can control the system to output the set color mode in voice as information according to the selected display area for each color mode setting.

[0146] The audio control unit 113 controls the output of audio information corresponding to the selected display area in the color mode setting image Ime based on the tap operation (ACT52). The processing of ACT52 may be the same as the processing of ACT20.

[0147] Figure 13 is a flowchart showing an example of processing associated with user operations on the single-sided / double-sided setting image Imf displayed on the touchscreen 21.

[0148] Here, we assume that the user has performed a double-tap operation when display area Abc is selected in the copy settings image Imb. Display area Abc is assumed to be displaying the single-sided / double-sided mode "Single-sided original to single-sided copy".

[0149] Based on the double-tap operation, the display control unit 112 displays the single-sided / duplex setting image Imf on the touchscreen 21 as a selected display area for displaying the set single-sided / duplex mode (ACT61). For example, the display control unit 112 displays the single-sided / duplex setting image Imf on the touchscreen 21 as a selected display area for displaying the single-sided / duplex mode "copy a single-sided original on one side".

[0150] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT62). In ACT62, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the single-sided / double-sided setting image Imf when the single-sided / double-sided setting image Imf is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the single-sided / double-sided mode in voice as information according to the selected display area. For example, the audio control unit 113 controls the system to output "Single-sided / Duplex Setting Single-sided Original Copy Single-sided Selected" in voice as information according to the display area Abca, which is the selected display area.

[0151] The detection unit 111 waits for user input (ACT63). If the detection unit 111 does not detect user input (ACT63, NO), the detection unit 111 continues processing ACT63. If the detection unit 111 detects user input (ACT63, YES), the process transitions from ACT63 to ACT64. The detection unit 111 detects whether the user input is a swipe operation or not (ACT64). If the user input is a swipe operation (ACT64, YES), the process transitions from ACT64 to ACT65. If the user input is not a swipe operation (ACT64, NO), the process transitions from ACT64 to ACT67.

[0152] The display control unit 112 changes the selected display area from the first display area to the second display area among the multiple display areas Abca to Abcc based on the swipe operation and displays it (ACT65). In ACT65, for example, the display control unit 112 switches the selected display area one by one among the multiple display areas Abca to Abcc with each swipe operation.

[0153] When the single-sided / double-sided setting image Imf is displayed on the touchscreen 21, the processing of ACT65 based on a downward swipe or upward swipe operation is the same as the processing of ACT5. Based on the downward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. For example, based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Abca to display area Abbcb adjacent to display area Abca along the first direction and displays it. Based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Abcc, which is the last display area, to display area Abca, which is the first display area and displays it. Based on the upward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the second direction and displays it. For example, based on an upward swipe operation, the display control unit 112 changes the selected display area along the second direction from display area Abcc to display area Abbcb adjacent to display area Abcc and displays it. Based on an upward swipe operation, the display control unit 112 changes the selected display area from the first display area, display area Abca, to the last display area, display area Abcc and displays it.

[0154] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the swipe operation (ACT66). In ACT66, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area as the selected display area changes based on the swipe operation. The audio control unit 113 controls the system to output single-sided / double-sided mode in voice as information according to the selected display area. For example, in the single-sided / double-sided setting image Imf, the display control unit 112 changes the selected display area from display area Abca to display area Abbcb and displays it. In this example, the audio control unit 113 controls the system to output "Select double-sided copy of double-sided document" in voice as information according to display area Abbcb, which is the selected display area.

[0155] The detection unit 111 detects whether the user operation is a double-tap operation (ACT67). If the user operation is a double-tap operation (ACT67, YES), the process transitions from ACT67 to ACT68. If the user operation is not a double-tap operation (ACT67, NO), the process transitions from ACT67 to ACT72. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0156] The detection unit 111 detects whether the selected display area is a single-sided / double-sided display area at the timing of the double-tap operation (ACT68). The single-sided / double-sided display areas are display area Abca or display area Abbcb. If the selected display area is a single-sided / double-sided display area (ACT68, YES), the process transitions from ACT68 to ACT69. If the selected display area is not a single-sided / double-sided display area (ACT68, NO), the process transitions from ACT68 to ACT70. If the selected display area is not a single-sided / double-sided display area, it means that the selected display area is display area Abcc which displays "Cancel".

[0157] Based on the double-tap operation, the setting unit 114 sets the single-sided / double-sided mode displayed in one of the multiple display areas Abca to Abbcb, which are the selected display areas, to the single-sided / double-sided setting item (ACT69). For example, let's assume that the display area Abbcb, which displays the single-sided / double-sided mode "Double-sided copy of double-sided document," is the selected display area. In this example, based on the double-tap operation, the setting unit 114 sets the single-sided / double-sided mode "Double-sided copy of double-sided document" to the single-sided / double-sided setting item.

[0158] Based on the double-tap operation, the display control unit 112 displays the copy setting image Imb on the touchscreen 21 as the selected display area Abc (ACT70). For example, the display area Abc of the copy setting image Imb displays the single-sided / double-sided mode "double-sided copy of double-sided document" set by the setting unit 114. The display area Abc updates the single-sided / double-sided mode from "single-sided copy of single-sided document" to "double-sided copy of double-sided document" and displays it. In this way, the display area Abc can update and display the single-sided / double-sided mode each time the setting unit 114 sets the single-sided / double-sided mode.

[0159] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT71). In ACT71, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the copy setting image Imb when the copy setting image Imb is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the single-sided / double-sided setting item in voice as information according to the selected display area. The audio control unit 113 controls the system to output the single-sided / double-sided mode in voice as information according to the selected display area. When display area Abc displays the single-sided / double-sided mode "Double-sided copy of double-sided document", the audio control unit 113 controls the system to output "Copy setting Single-sided / double-sided setting Setting value Double-sided copy of double-sided document" in voice as information according to the selected display area Abc. In this way, the audio control unit 113 can control the system to output the set single-sided / double-sided mode in voice as information according to the selected display area for each single-sided / double-sided mode setting.

[0160] The audio control unit 113 controls the output of audio information corresponding to the selected state in the single-sided / double-sided setting image Imf based on the tap operation (ACT72). The processing of ACT72 may be the same as the processing of ACT20.

[0161] Figure 14 is a flowchart showing an example of processing associated with user operation in the voice guidance setting image Imc displayed on the touchscreen 21.

[0162] Here, we assume that in the top image Ima, the display area Ac that displays "Voice Guidance App Settings" is selected, and the user performs a double-tap operation.

[0163] Based on the double-tap operation, the display control unit 112 displays the voice guidance setting image Imc on the touchscreen 21 as the selected display area Aca (ACT81).

[0164] The voice control unit 113 controls the system to output information in voice corresponding to the selected display area based on the double-tap operation (ACT82). In ACT82, for example, the voice control unit 113 controls the system to output information in voice corresponding to the selected display area in the voice guidance setting image Imc when the voice guidance setting image Imc is displayed based on the double-tap operation. For example, suppose the display area Aca displays "Operation Guide Settings" and "Yes," which indicate the settings for the operation guide at startup. In this example, the voice control unit 113 controls the system to output "Voice Guidance App Settings Operation Guide Settings Setting Value Yes" in voice as information corresponding to the selected display area Aca.

[0165] The detection unit 111 waits for user input (ACT83). If the detection unit 111 does not detect user input (ACT83, NO), the detection unit 111 continues processing ACT83. If the detection unit 111 detects user input (ACT83, YES), the process transitions from ACT83 to ACT84. The detection unit 111 detects whether the user input is a swipe operation or not (ACT84). If the user input is a swipe operation (ACT84, YES), the process transitions from ACT84 to ACT85. If the user input is not a swipe operation (ACT84, NO), the process transitions from ACT84 to ACT87.

[0166] The display control unit 112 changes the selected display area from the first display area to the second display area among the multiple display areas Aca to Ace based on the swipe operation and displays it (ACT85). In ACT85, for example, the display control unit 112 switches the selected display area one by one among the multiple display areas Aca to Ace with each swipe operation.

[0167] When the voice guidance setting image Imc is displayed on the touchscreen 21, the processing of ACT85 based on a downward swipe or upward swipe operation is the same as the processing of ACT5. Based on the downward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. For example, based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Aca to display area Acb adjacent to display area Aca along the first direction and displays it. Based on the downward swipe operation, the display control unit 112 changes the selected display area from display area Ace, which is the last display area, to display area Aca, which is the first display area and displays it. Based on the upward swipe operation, the display control unit 112 changes the selected display area from the first display area to the second display area adjacent to the first display area along the second direction and displays it. For example, based on an upward swipe operation, the display control unit 112 changes the selected display area from display area Ace to the adjacent display area Acd along the second direction and displays it. Based on an upward swipe operation, the display control unit 112 changes the selected display area from the first display area, display area Aca, to the last display area, display area Ace and displays it.

[0168] The audio control unit 113 controls the system to output information in voice corresponding to the selected display area based on the swipe operation (ACT86). In ACT86, for example, the audio control unit 113 controls the system to output information in voice corresponding to the selected display area as the selected display area changes based on the swipe operation. For example, in the voice guidance setting image Imc, the display control unit 112 changes the selected display area from display area Aca to display area Acb based on the downward swipe operation. Display area Acb displays "Voice Speed ​​Setting" and the voice speed "3," which indicate the voice speed setting item. In this example, the audio control unit 113 controls the system to output "Voice Speed ​​Setting Setting Value 3" in voice as information corresponding to display area Acb, which is the selected display area.

[0169] The detection unit 111 detects whether the user operation is a double-tap operation (ACT87). If the user operation is a double-tap operation (ACT87, YES), the process transitions from ACT87 to ACT88. If the user operation is not a double-tap operation (ACT87, NO), the process transitions from ACT87 to ACT90. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0170] Based on the double-tap operation, the display control unit 112 displays an image on the touchscreen 21 corresponding to the display area of ​​the selected state in the voice guidance setting image Imc (ACT88).

[0171] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT89). In ACT89, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the image displayed on the touchscreen 21 in conjunction with the display of an image based on the double-tap operation.

[0172] The voice control unit 113 controls the system to output information in voice according to the selected state display area in the voice guidance setting image Imc based on the tap operation (ACT90). The processing of ACT90 may be the same as the processing of ACT20.

[0173] Figure 15 is a flowchart showing an example of processing associated with user interaction in the audio speed setting image (Img) displayed on the touchscreen 21.

[0174] Here, we assume that the user has performed a double-tap operation when the display area Acb is selected in the voice guidance setting image Imc. The display area Acb is assumed to be showing voice speed "3".

[0175] Based on the double-tap operation, the display control unit 112 displays the audio speed setting image Img on the touchscreen 21 as the selected display area Acba (ACT91). The display area Acba displays the audio speed "3" which is displayed in the display area Acb before the audio speed setting image Img is displayed.

[0176] The audio control unit 113 controls the system to output information in voice according to the selected display area based on the double-tap operation (ACT92). In ACT92, for example, the audio control unit 113 controls the system to output information in voice according to the selected display area in the audio speed setting image Img when the audio speed setting image Img is displayed based on the double-tap operation. The audio control unit 113 controls the system to output the audio speed as information according to the selected display area. For example, the audio control unit 113 controls the system to output "Audio speed setting Audio speed 3" as information according to the display area Acba, which is the selected display area.

[0177] The detection unit 111 waits for user input (ACT93). If the detection unit 111 does not detect user input (ACT93, NO), the detection unit 111 continues processing ACT93. If the detection unit 111 detects user input (ACT93, YES), the process transitions from ACT93 to ACT94. The detection unit 111 detects whether the user input is a swipe operation or not (ACT94). If the user input is a swipe operation (ACT94, YES), the process transitions from ACT94 to ACT95. If the user input is not a swipe operation (ACT94, NO), the process transitions from ACT94 to ACT97.

[0178] Based on the swipe operation, the display control unit 112 changes the audio speed in the display area Acba and displays it without changing the selected display area from the display area Acba (ACT95). In ACT95, for example, the display control unit 112 changes the audio speed in the display area Acba by 1 each time a swipe operation is performed.

[0179] Let's take a downward swipe operation as an example when the voice speed setting image Img is displayed on the touchscreen 21. Based on the downward swipe operation, the display control unit 112 reduces the voice speed by 1 and displays it in the display area Acba. For example, suppose the voice speed setting image Img displays a voice speed of "5" in the display area Acba. Based on the downward swipe operation, the display control unit 112 displays "4" as the voice speed in the display area Acba, which is "5" minus 1.

[0180] Let's take an example of an upward swipe operation when the voice speed setting image Img is displayed on the touchscreen 21. Based on the upward swipe operation, the display control unit 112 increases the voice speed by 1 in the display area Acba and displays it. For example, suppose the display area Acba in the voice speed setting image Img displays a voice speed of "3". Based on the upward swipe operation, the display control unit 112 increases "3" by 1 and displays "4" as the voice speed in the display area Acba.

[0181] The audio control unit 113 controls the system to output information corresponding to the selected display area in audio based on the swipe operation (ACT96). In ACT96, for example, the audio control unit 113 controls the system to output information corresponding to the selected display area in audio as the audio speed in the display area Acba changes based on the swipe operation. The audio control unit 113 controls the system to output the audio speed as information corresponding to the selected display area in audio. For example, suppose the display area Acba displays "4" as the audio speed, which is one higher than "3" based on the swipe operation. The selected display area remains the display area Acba before and after the swipe operation. In this example, the audio control unit 113 controls the system to output "audio speed 4" as information corresponding to the display area Acba, which is the selected display area.

[0182] The detection unit 111 detects whether the user operation is a double-tap operation (ACT97). If the user operation is a double-tap operation (ACT97, YES), the process transitions from ACT97 to ACT98. If the user operation is not a double-tap operation (ACT97, NO), the process transitions from ACT97 to ACT101. If the user operation is not a double-tap operation, it is treated as if the user operation was a tap operation.

[0183] Based on the double-tap operation, the setting unit 114 sets the voice speed displayed in the display area Acba to the voice speed setting item (ACT98). For example, if the voice speed setting image Img is displayed on the touchscreen 21, the display area Acba will display voice speed "2". In this example, based on the double-tap operation, the setting unit 114 sets voice speed "4" to the voice speed setting item.

[0184] Based on the double-tap operation, the display control unit 112 displays the voice guidance setting image Imc on the touchscreen 21 as the selected display area Acb (ACT99). For example, the display area Acb of the voice guidance setting image Imc displays the voice speed "4" set by the setting unit 114. The display area Acb updates the voice speed from "3" to "4" and displays it. In this way, the display area Acb can update and display the voice speed each time the voice speed is set by the setting unit 114.

[0185] The voice control unit 113 controls the system to output information in voice according to the selected display area based on a double-tap operation (ACT100). In ACT100, for example, the voice control unit 113 controls the system to output information in voice according to the selected display area in the voice guidance setting image Imc when the voice guidance setting image Imc is displayed based on a double-tap operation. The voice control unit 113 controls the system to output the voice speed setting item in voice as information according to the selected display area. The voice control unit 113 controls the system to output the voice speed in voice as information according to the selected display area. When the display area Acb displays voice speed "4", the voice control unit 113 controls the system to output "Voice Guidance App Settings Voice Speed ​​Setting Setting Value 4" in voice as information according to the selected display area Acb. In this way, the voice control unit 113 can control the system to output the set voice speed in voice as information according to the selected display area for each voice speed setting.

[0186] The audio control unit 113 controls the system to output information in audio corresponding to the selected display area in the audio speed setting image Img based on the tap operation (ACT101). The processing of ACT101 may be the same as the processing of ACT20.

[0187] Note that the processing of volume in response to user operations in the volume setting image Imh is the same as the processing of speech speed explained using Figure 15, so the explanation will be omitted. In the explanation using Figure 15, display area Acb, speech speed setting image Img, display area Acba, and speech speed can be read as display area Acc, volume setting image Imh, display area Acca, and volume, respectively.

[0188] [effect] In this embodiment, when a first image having a plurality of display areas including a display area for a copy count setting item is displayed on the touchscreen, the display control unit of the image forming apparatus changes the selected display area from the first display area to the second display area among the plurality of display areas based on a first user operation on the touchscreen and displays it. When a second image having a display area for the number of copies to be set for a copy count setting item is displayed on the touchscreen, the display control unit changes the number of copies in the display area for the number of copies based on a first user operation on the touchscreen without changing the selected display area from the display area for the number of copies and displays it. The audio control unit of the image forming apparatus controls the audio output device to output information corresponding to the selected display area as audio based on an operation on the touchscreen. Thus, the image forming apparatus can change the display area of ​​the selected state based on a first operation, and can also change the number of copies based on the first operation. This allows the user to change the display area of ​​the selected state and change the number of copies using the same operation method on the touchscreen. Since the operation for changing the display on the image displayed on the touchscreen is the same regardless of the image, the image forming apparatus enables screen operation that does not rely on vision. Furthermore, the image forming apparatus can display the display area of ​​the selected state and change and display the number of copies. This allows sighted users supporting visually impaired users or visually impaired users operating the image forming apparatus to easily grasp the operation status or settings visually. Furthermore, the image forming apparatus can be controlled to output information corresponding to the display area of ​​the selected state via sound. This allows the image forming apparatus to notify the user of the contents of the display area of ​​the selected state through both text display and sound output. Therefore, sighted users or visually impaired users can easily grasp the operation status or settings by looking at the display of the display area of ​​the selected state, without relying solely on sound.

[0189] In this embodiment, when the second image is displayed on the touchscreen, the setting unit of the image forming apparatus sets the number of copies displayed in the copy count display area to the copy count setting item based on a second user operation on the touchscreen. When the second image is displayed on the touchscreen, the display control unit displays the first image on the touchscreen as a selected display area for the copy count setting item based on the second user operation. In this way, the image forming apparatus can set the number of copies for the copy count setting item and display the first image on the touchscreen based on a second user operation. This allows the user to set the number of copies and switch the image display with a single user operation. Since operations for multiple processes are unified into a single operation, the image forming apparatus enables screen operation that does not rely on vision.

[0190] In this embodiment, the display control unit displays the number of copies set for a copy count setting item in the display area related to the copy count setting item, based on a second user operation. The audio control unit controls the audio output device to output the number of copies as audio information corresponding to the selected display area, based on the second user operation. In this way, the image forming apparatus can be controlled to output the number of copies set based on a second user operation via voice. The user can confirm the number of copies via voice without requiring any additional user operation after the second user operation to set the number of copies.

[0191] In this embodiment, the first user operation includes a third user operation and a fourth user operation. The first image displays a plurality of display areas arranged in a first direction. When the first image is displayed on the touchscreen, the display control unit, based on the third user operation, changes the selected display area from the first display area to the second display area adjacent to the first display area along the first direction and displays it. When the first image is displayed on the touchscreen, the display control unit, based on the fourth user operation, changes the selected display area from the first display area to the second display area adjacent to the first display area along a second direction opposite to the first direction and displays it. Thus, the image forming apparatus can change and display the selected display area along different directions in a third user operation and a fourth user operation. This allows the user to sequentially change the selected display area one by one along either the first or second direction. Since the selected display area changes sequentially one by one, the user can easily reach the desired display area by repeating the user operation. Therefore, the image forming apparatus enables screen operation that does not rely on vision. Furthermore, the image forming apparatus can display multiple display areas side by side in the first direction. This allows the image forming apparatus to display multiple display areas in a layout that can be visually efficiently grasped by sighted users supporting visually impaired users or by low-vision users operating the image forming apparatus.

[0192] In this embodiment, when the second image is displayed on the touchscreen, the display control unit, based on the third user operation, decreases the number of copies by 1 in the display area for the number of copies and displays it. When the second image is displayed on the touchscreen, the display control unit, based on the fourth user operation, increases the number of copies by 1 in the display area for the number of copies and displays it. Thus, the image forming apparatus can decrease or increase the number of copies displayed by a third or fourth user operation. This allows the user to change the number of copies one by one in sequence. Since the number of copies changes sequentially by one, the user can easily reach the desired number of copies by repeating the user operation. Therefore, the image forming apparatus enables screen operation that does not rely on vision.

[0193] In this embodiment, the third user operation is a swipe operation along a first direction from top to bottom. The fourth user operation is a swipe operation along a second direction from bottom to top. This allows the user to sequentially change the selected display area one by one in the same direction as the user's operation on the touchscreen. The user can also sequentially change the number of copies by one in a direction that intuitively corresponds to the user's operation on the touchscreen. For example, the user can sequentially change the number of copies by one in a decreasing direction that intuitively corresponds to the top-to-bottom direction. The user can also sequentially change the number of copies by one in an increasing direction that intuitively corresponds to the bottom-to-top direction. Since the direction of user operation corresponds to the direction of movement of the selected display area or the increase or decrease in the number of copies, it is easy for the user to operate intuitively. Therefore, the image forming apparatus enables screen operation that does not rely on vision. Furthermore, the image forming apparatus can display multiple display areas arranged in a direction that matches the direction of user operation for changing the selected display area. Therefore, sighted users supporting visually impaired users or low-vision users operating the image forming apparatus can easily follow the selected display area moving in the same direction as the user's operation. This allows sighted users or low-vision users to easily grasp the operation status or settings visually.

[0194] [Other embodiments] In the above embodiment, the image forming apparatus was described as an example of an input device that inputs instructions based on user operation, but the example of an input device is not limited to this. The above embodiment is applicable to various input devices that input instructions to select one item from a plurality of items, and instructions to change the numerical value set for one item. For example, the input device includes a POS terminal having at least one of a product registration function and a payment function. The input device may include a user terminal such as a smartphone or tablet terminal, or a terminal such as a ticket vending machine.

[0195] The program may be transferred while stored in the electronic device according to the embodiment, or it may be transferred without being stored in the electronic device. In the latter case, the program may be transferred via a network, or it may be transferred while recorded on a recording medium. The recording medium is a non-temporary tangible medium. The recording medium is a computer-readable medium. The recording medium may be any medium that is capable of storing a program and is readable by a computer, such as a CD-ROM or memory card, and its form is not limited.

[0196] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0197] 1…Image forming apparatus, 10…Control unit, 11…Control circuit, 12…Main memory, 13…Storage, 20…Control panel, 21…Touchscreen, 22…Input buttons, 30…Scanner unit, 40…Communication circuit, 50…Input / output interface, 60…Audio output device, 70…Printer unit, 71…Storage unit, 72…Transport unit, 73…Image forming unit, 74…Fuser, 111…Detection unit, 112…Display control unit, 113…Audio control unit, 114…Setting unit, Aa ~Ad...Display area, Aba~Abf...Display area, Aca~Ace...Display area, Abaa...Display area, Abba~Abbd...Display area, Abca~Abcc...Display area, Acba...Display area, Acca...Display area, Ima...Top image, Imb...Image for copy settings, Imc...Image for voice guidance settings, Imd...Image for number of copies setting, Ime...Image for color mode setting, Imf...Image for single-sided / double-sided setting, Img...Image for voice speed setting, Imh...Image for volume setting.

Claims

1. When a first image having multiple display areas, including a display area related to the number of copies setting item, is displayed on the touchscreen, based on a first user operation on the touchscreen, the selected display area is changed from the first display area to the second display area among the multiple display areas and displayed. When a second image having a display area for the number of copies to be set for the aforementioned copy count setting item is displayed on the touchscreen, a display control unit changes and displays the number of copies in the copy count display area without changing the display area for the selected state from the copy count display area, based on the first user operation on the touchscreen, A voice control unit controls the output of information corresponding to the selected display area from a voice output device based on the operation on the touchscreen, An image forming apparatus equipped with the following features.

2. When the second image is displayed on the touchscreen, the system further includes a setting unit that sets the number of copies displayed in the copy count display area to the copy count setting item based on a second user operation on the touchscreen. When the second image is displayed on the touchscreen, the display control unit displays the first image on the touchscreen as the display area for the selected state, based on the second user operation, with the display area for the copy count setting item set as the display area for the selected state. The image forming apparatus according to claim 1.

3. The first user operation includes the third user operation and the fourth user operation, The first image displays the plurality of display areas arranged in a first direction, When the first image is displayed on the touchscreen, the display control unit changes the display area of ​​the selected state from the first display area to the second display area adjacent to the first display area along the first direction, based on the third user operation, and when the first image is displayed on the touchscreen, the display control unit changes the display area of ​​the selected state from the first display area to the second display area adjacent to the first display area along the second direction opposite to the first direction, based on the fourth user operation. The image forming apparatus according to claim 1.

4. When the second image is displayed on the touchscreen, the display control unit, based on the third user operation, reduces the number of copies by 1 in the display area for the number of copies and displays it as such. When the second image is displayed on the touchscreen, the display control unit, based on the fourth user operation, increases the number of copies by 1 in the display area for the number of copies and displays it. The image forming apparatus according to claim 3.

5. When a first image having multiple display areas, including a display area for numerical setting items, is displayed on the touchscreen, based on a first user operation on the touchscreen, the selected display area is changed from the first display area to the second display area among the multiple display areas and displayed. When a second image having a display area for a numerical value to be set for the numerical setting item is displayed on the touchscreen, a display control unit, based on the first user operation on the touchscreen, changes and displays the numerical value in the numerical display area without changing the display area of ​​the selected state from the numerical display area, A voice control unit controls the output of information corresponding to the selected display area from a voice output device based on the operation on the touchscreen, An input device equipped with the following features.

Images