Information processing device, control method thereof, and program

Abstract

To provide an information processing apparatus that has a function to automatically rearrange buttons displayed on a menu screen and prevents a reduction in operability for a user who selects a desired button without seeing the menu screen, and a method for controlling the same, and a program.SOLUTION: An information processing apparatus has a plurality of functions, and has: first display control means that displays a plurality of softkeys for executing the plurality of functions on a screen; and rearrangement means that automatically rearranges the plurality of softkeys in response to the occurrence of an event. When at least one of universal functions related to visual recognition of the image processing apparatus is set to be effective, the first display control means displays the screen on which the softkeys are not rearranged to prevent the rearrangement means from rearranging buttons.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a display method for an information processing device. [Background technology]

[0002] Information processing devices such as smartphones and MFPs have various applications (hereinafter referred to as apps) and display multiple softkeys for executing the apps on a menu screen. For example, MFPs have apps for copying, faxing, and printing print data from a PC. When the number of softkeys displayed on the screen increases, it becomes difficult for users to find the desired softkey. Therefore, a technology has been proposed that automatically rearranges the softkeys displayed on the menu screen depending on the device status (Patent Document 1). For example, when a document of a specific paper size is placed on the MFP's scanner, the softkeys for processing that document are rearranged to the top of the menu screen. This makes it easier for users to find the desired softkey on the menu screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-117158 Summary of the Invention [Problem to be solved by the invention]

[0004] Automatically rearranging the softkeys improves operability for users, but for users who use the device without seeing the screen, such as the blind or visually impaired, automatically rearranging the softkeys actually reduces operability because users who use the device without seeing the screen memorize the positions and order of the softkeys and rely on their memory to select the desired softkey using a cursor or the like.

[0005] The present invention provides a method for automatically rearranging soft keys on a screen of a device, which prevents degradation of operability for a user who uses the device without visually checking the screen. [Means for solving the problem]

[0006] An information processing device having multiple functions, Display section a first display control means for displaying a plurality of soft keys for executing each of the plurality of functions on the display screen; and a first display control means for controlling the plurality of soft keys in accordance with a state of the information processing device. Order of Automatically Change Average Be and a replacement means, When an original is placed on an original reading unit of the information processing device and a print job is saved in the information processing device, the rearrangement means changes the order of the multiple softkeys so that softkeys corresponding to functions using the original reading unit and softkeys corresponding to functions related to the print job are arranged preferentially over other softkeys, and the first display control means displays the multiple softkeys in the order changed by the rearrangement means, and even when an original is placed on an original reading unit of the information processing device and a print job is saved in the information processing device, the rearrangement means does not change the order of the multiple softkeys based on a visibility-related function being enabled in the information processing device, The first display control means displays the plurality of soft keys. In a predetermined order 2. An information processing device comprising: [Effects of the Invention]

[0007] To provide a device that automatically rearranges soft keys on a screen without deteriorating the operability of a user who uses the device without visually checking the screen. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a hardware configuration of an image processing device 100 according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing a software configuration of the image processing device 100 according to the embodiment of the present invention. [Figure 3] FIG. 10 is a diagram illustrating an example of a button information table showing information associated with each button according to the embodiment of the present invention. [Figure 4] FIG. 4 is a diagram showing an example of an application selection screen 400 in which the buttons displayed on the display / operation unit 1009 of the image processing apparatus 100 according to the embodiment of the present invention have not been rearranged. [Figure 5] FIG. 4 is a diagram showing an example of an application selection screen 400 in which the order of buttons displayed on the display / operation unit 1009 of the image processing apparatus 100 according to the embodiment of the present invention has been rearranged. [Figure 6] 10 is a flowchart showing a process for rearranging application buttons on an application selection screen 400 in accordance with the state of an image processing device 100 according to an embodiment of the present invention. [Figure 7] 1 is a diagram showing states of an image processing device 100 according to an embodiment of the present invention and screens displayed on a display / operation unit 1009 of the image processing device 100 according to the states. [Figure 8] 1A and 1B are diagrams showing examples of screens displayed on a display / operation unit 1009 of an image processing apparatus 100 according to an embodiment of the present invention. [Figure 9] 10 is a flowchart showing processing depending on whether or not a text-to-speech function of the image processing device 100 according to the embodiment of the present invention is enabled. [Figure 10] FIG. 10 is a diagram showing an example of an application selection screen in which the buttons are not rearranged and are displayed on the display / operation unit 1009 of the image processing apparatus 100 according to the embodiment of the present invention. [Figure 11] 5 shows an application selection screen 500 displayed on the display / operation unit 1009 of the image processing device 100 when the text-to-speech function according to the embodiment of the present invention is started. [Figure 12] 10 is a flowchart showing a display screen switching process at the start of a text-to-speech function in the image processing device 100 that provides the application selection screen 400 and the application selection screen 500 according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In this embodiment, an image processing device will be used as an example of an information processing device, but this does not limit the scope of the present invention as claimed. Furthermore, not all of the combinations of features described in this embodiment are necessarily essential to the solution of the present invention.

[0010] (First Example) Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] 1 is a block diagram showing the hardware configuration of an image processing device 100 according to an embodiment of the present invention. A control unit 1000 including a CPU 1001 controls the overall operation of the image processing device 100.

[0012] The CPU 1001 reads out a control program stored in the ROM 1002 and performs various controls such as reading control and transmission control. The ROM 1002 is a boot ROM and stores the system boot program. The RAM 1003 is used as a temporary storage area such as the main memory and work area of ​​the CPU 1001. The HDD 1004 stores image data, various programs, and various information tables.

[0013] The operation unit I / F 1005 is an interface for connecting the display / operation unit 1009 and the control unit 1000. The display / operation unit 1009 is provided with a display having a touch panel function, a keyboard, etc. The operation unit 1009 also includes hard keys for operating the image processing device 100.

[0014] The printer I / F 1006 is an interface for connecting the printer 1010 and the control unit 1000. Image data to be printed by the printer 1010 is transferred from the control unit 1000 via the printer I / F 1006 and printed on a recording medium (paper) by the printer 1010.

[0015] The scanner I / F 1007 is an interface for connecting the scanner 1011 and the control unit 1000. The scanner 1011 reads an image on a document, generates image data, and inputs the image data to the control unit 1000 via the scanner I / F 1007.

[0016] The network I / F 1008 is an interface for connecting the control unit 1000 to the LAN 101. The network I / F 1008 transmits and receives information to and from external devices connected to the network via the LAN 101. The external devices refer to, for example, information processing devices, PCs, and mobile terminals. The form of the LAN 101 is specifically, but not limited to, a wired LAN or a wireless LAN.

[0017] Representative functions of the image processing device 100 are as follows. A "copy" function that prints image data generated by scanning an original with a scanner 1011 and then printing the image data with a printer 1010. A print function for printing image data on a printer 1010 based on a print job input from an external information processing device connected to a network via a network I / F 1008. "Scan and send" function that reads an image on a document using the scanner 1011 and sends the generated image data to an external device via the network I / F 1008 "Scan and save" function that reads an image on a document using the scan function provided by Scanner 1011 and saves the generated image data to HDD 1004 A "use of saved files" function that prints image data saved in the HDD 1004 using the printer 1010 or transmits the image data to an external device via the network I / F 1008. An app button for running applications (hereinafter referred to as apps) that implement these functions will be displayed on the app selection screen.

[0018] 2 is a block diagram showing the software configuration of the image processing apparatus 100 according to the embodiment of the present invention. Each piece of software is stored in the ROM 1002 and executed by the CPU 1001.

[0019] The document detection unit 201 holds a state of whether or not a document is placed on the scanner 1011 of the image processing device 100. The state in which a document is placed on the scanner 1011 refers to, for example, a state in which a document is placed on a feeder of the image processing device 100, a state in which a document is placed on the pressure plate of the image processing device 100, or a state in which the pressure plate is open. However, the state in which a document is placed on the scanner 1011 is not limited to this.

[0020] The print job detection unit 202 determines whether there is an unprinted print job input from an external device to the image processing device 100 via the LAN 101. Here, it does not have to be an unprinted print job, and it may also be determined whether there is a print job waiting to be executed. The determination of whether there is a print job is made by detecting whether the print job is stored in the image processing device 100 or an external server that can communicate with the image processing device 100.

[0021] The menu function unit 203 controls the display of an application selection screen, which is a menu screen on which buttons (soft keys, display objects) for executing applications are arranged. 400 in FIG. 4 is an example of the application selection screen. When a user presses a copy button 401, a copy setting screen opens. After the user makes settings on the setting screen, the image processing device 100 starts copy processing when the user issues an execution instruction. When the application selection screen is displayed, the button rearrangement execution unit 204 notifies the menu function unit 203 of information regarding the order of buttons to be displayed. If button rearrangement is necessary, the button rearrangement execution unit 204 notifies the menu function unit 203 of the display order of the application buttons after the rearrangement, and the menu function unit 203 displays the screen according to that order. If button rearrangement is not necessary, the button rearrangement execution unit 204 displays a screen in which the buttons are not rearranged according to the button display order stored in the button rearrangement execution unit 204 or the menu function unit 203. Even when the application selection screen 400 is being displayed, the button rearrangement execution unit 204 notifies the menu function unit 203 of information regarding the order of buttons as needed.

[0022] The button rearrangement execution unit 204 determines the order of buttons to be displayed on the application selection screen in accordance with the state of the image processing device 100 detected by the document detection unit 201 and the print job detection unit 202, the event that occurred, etc. Then, the button rearrangement execution unit 204 notifies the menu function unit 203 of the determined button order.

[0023] The application button information management unit 205 manages information about buttons (soft keys) displayed on the application selection screen. The button information may be stored in the HDD 1004 of the image processing device 100, or in an external storage device connected via the network I / F 1008.

[0024] An example of information managed by application button information management unit 205 is shown in the table of FIG. 3. Button table 300 is a table showing information about buttons to be displayed on the application selection screen, with one button defined per row. Button ID 301 column shows the identifier of each button. Display Order 302 column shows the display order of each button on the application selection screen. Button Name 303 column shows the text to be displayed above the button. Call Function 304 column shows the function to be called when each button is pressed. Setting Value 305 column shows the setting value to be called together with the function when the button is pressed. The application selection screen 400 displayed using the button information defined in button table 300 is shown in FIG. 4. Buttons are displayed from the left of application selection screen 400 in the display order defined in Display Order 302 column. It is not necessary for all buttons defined in the button table to be displayed on the application selection screen.

[0025] The button attribute table 310 defines the attributes of each button and is used to change the order of buttons on the application selection screen depending on the state of the image processing device 100. Buttons that perform processes using the scanner 1011 of the image processing device, such as the "Copy" button and the "Scan and Send" button, are associated with the "Scan" attribute. The "Print" button is associated with the "Print" attribute. For example, if a user places paper in the feeder of the image processing device 100, the document detection unit 201 detects the placement of the document, and the button rearrangement execution unit references the button attribute table 310 and controls the display order of buttons with the scan attribute to rise. In other words, simply by placing a document in the feeder of the image processing device 100, the button that uses the scanner is automatically rearranged to the front. The button table 330 shows the rearranged button order when a document is placed in the scanner from the button order shown in the button table 300. The display order of buttons with the "Scan" attribute, such as the "Copy" button and the "Scan and Send" button, rises, and the display order of other buttons accordingly drops. In this way, the buttons on the menu screen are automatically rearranged according to the device status, making it easier for the user to find the desired button. Similarly, when the user sends a print job to the image processing device 100, the "Print" button, whose attribute is "Print," is displayed first.

[0026] Here, an example has been shown in which buttons are rearranged according to the state of the image processing device 100, but the present invention is not limited to this. The buttons may be rearranged automatically according to the number of times the user has used the buttons so that buttons that have been used more frequently are displayed preferentially. In this case, the application button information management unit 205 stores the user's button use history as shown in the button use history table 320, and the button rearrangement execution unit rearranges the buttons based on the use history so that buttons that have been used more frequently are displayed preferentially.

[0027] When a predetermined operation is performed via the display / operation unit 1009, the audio mode management unit 206 displays an audio mode activation screen on the display / operation unit 1009 and stores information about the selected audio mode. The predetermined operation is, for example, pressing a predetermined button for a long time or pressing it multiple times.

[0028] The audio mode is a universal mode for screen display, designed for users who use the device without seeing the screen, such as the blind or those with low vision. It includes, for example, a setting for reading out the screen contents, a function for accepting audio instructions, and a function for selecting buttons by placing a cursor on the screen and operating the cursor with a hard key such as a numeric keypad. The audio mode management unit 206 notifies the button rearrangement execution unit 204 of the enabled audio mode setting. When the audio mode is terminated, the audio mode management unit 206 notifies the button rearrangement execution unit 204 that the audio mode is disabled. If at least one audio mode setting is enabled, the button rearrangement execution unit 204 does not perform the automatic button rearrangement described above.

[0029] 4 is a diagram showing an example of an application selection screen displayed on the display / operation unit 1009 of the image processing device 100 according to the embodiment of the present invention, in a default state (e.g., a factory default state or a state initially set by an administrator) in which the buttons have not been rearranged, based on the information defined in the button table 300.

[0030] A copy button 401 is a button for executing a copy application. When pressed, the screen transitions to a copy screen setting screen.

[0031] The saved file use button 402 is a button for executing a saved file use application. The user can select a file from the file list screen that is displayed when the button is pressed, select the process (print or send) for the selected file, and execute the selected process for the selected file.

[0032] A print application button 403 is a button for executing a print application. When pressed, the screen transitions to a print screen setting screen.

[0033] The above three buttons are displayed on the first page of the application selection screen 400. A scan and send button 404 and an easy copy button 405 are displayed on the second page of the application selection screen 400. The scan and send button 404 is a button for executing an application that sends a scanned image to a specified destination.

[0034] The easy copy button 405 is a button for executing copying with preset setting values. When pressed, the copy process may be started immediately without opening the setting screen.

[0035] 5(A), (B), and (C) are diagrams showing an example of an application selection screen 400 displayed on the display / operation unit 1009 of the image processing device 100 according to an embodiment of the present invention, after rearranging the application buttons from the default state.

[0036] First, Fig. 5(A) will be described. Fig. 5(A) shows a screen in which the buttons on the application selection screen 400 in Fig. 4 have been rearranged when the print job detection unit 202 detects an unprinted print job. The print button 403 has been rearranged to the front compared to the button order on the application selection screen 400 in Fig. 4.

[0037] Next, Fig. 5(B) will be described. Fig. 5(B) is a screen in which the order of application buttons is rearranged on the application selection screen 400 of Fig. 4 when the document detection unit 201 detects a document. Compared to the order of buttons on the application selection screen 400 of Fig. 4, the copy button 401, scan and send application button 404, and easy copy button 405 are displayed with priority over the other buttons.

[0038] Next, FIG. 5C will be described. FIG. 5C shows a screen in which the application buttons on the application selection screen 400 in FIG. 4 have been rearranged when the document detection unit 201 detects a document and the print job detection unit 202 detects an unprinted print job. The print button 403, copy button 401, scan and send application button 404, and easy copy button 405 are displayed with priority over other buttons. Here, the print button 403, i.e., a button with the button attribute "print," is displayed before a button with the button attribute "scan." However, the reverse may also be true. Hereinafter, two triggers for rearranging the buttons will be described: a document being placed on the scanner; and a job being held that has not yet been printed. However, these two states are not limiting. For example, when the image processing device 100 receives a fax, the button that performs fax-related processing may be rearranged to the front.

[0039] 7 is a diagram showing states of the image processing device 100 in this embodiment and application selection screens displayed on the display / operation unit 1009 of the image processing device 100 according to those states. Note that the states of the image processing device 100 for applying the present invention and the screens displayed on the display / operation unit 1009 according to those states are not limited to those shown here.

[0040] Reference numeral 700 denotes a list that organizes the status of the image processing device 100 and the screens that are displayed on the operation unit 1009 according to the status.

[0041] Column 701 indicates a screen to be displayed on the operation unit depending on the state of the image processing device 100. Column 702 indicates the state of a flag for moving the display order of the print attribute buttons to a higher position. When the print job detection unit 202 detects the existence of an unprinted print job, the flag is turned ON.

[0042] Column 703 indicates the state of a flag for moving the display order of the scan attribute button to a higher position. The flag is turned ON when the document detection unit 201 detects that a document is placed on the scanner. Line 704 indicates the application selection screen that is displayed when the above-mentioned two flags are OFF. The application selection screen that is displayed is the default screen shown in FIG. 4.

[0043] Line 705 shows the application selection screen that is displayed when only the flag for moving the print attribute button to the top of the display order is ON. Here, this is called the print priority application selection screen, and corresponds to the application selection screen shown in Figure 5(A).

[0044] Line 706 shows the application selection screen that is displayed when only the flag for moving the scan attribute button to a higher position is ON. Here, this is called the scan priority application selection screen, and corresponds to the application selection screen shown in FIG. 5(B). Line 707 shows the application selection screen that is displayed when both flags are ON. Here, this is called the scan print priority application selection screen, and corresponds to the application selection screen shown in FIG. 5(C).

[0045] 8 is a diagram showing an example of a setting screen on which the audio mode of the image processing device 100 according to the embodiment of the present invention can be set. A method for activating the audio mode according to this embodiment will be described below with reference to FIG.

[0046] FIG. 8A shows an audio mode setting screen that the audio mode management unit 206 displays on the display / operation unit 1009. This screen is displayed when a predetermined operation is performed via the display / operation unit 1009 and is always displayed when the audio mode is activated. For example, this screen is displayed when a user of the image processing device 100 presses and holds a predetermined hard key on the image processing device 100 or presses it multiple times. Note that FIG. 8A shows a state in which a button 801 is selected. The button 801 is a selection button for turning on both the voice readout function and the voice output operation function of the audio mode. Here, the voice readout function is a function that reads out the contents of the screen displayed on the display / operation unit 1009 aloud. This function is provided to users who do not operate the image processing device 100 by visually recognizing the screen, such as those with low vision or who are completely blind. This function allows the user to operate the image processing device 100 using the numeric keypad of the operation unit 1009 rather than the touch panel operation unit of the operation unit 1009 of the image processing device 100 while relying on audio guidance. A cursor is displayed on the screen, and the user can select a button by moving the cursor using a hard key such as a numeric keypad. The voice guidance that is read out includes, for example, the name of the button currently selected by the cursor and the currently set value.

[0047] The voice operation function is a function that recognizes the user's voice and operates the image processing device 100 accordingly. For example, the voice of the user "copy" is recognized and a copy application is launched. Button 802 is a selection button for turning on only the voice operation function. Button 803 is a selection button for turning on only the voice guidance function. Button 804 is a button for activating the voice mode selected by buttons 801, 802, and 803. Button 805 is a button for canceling activation of the voice mode. Note that the voice mode functions are not limited to those shown here. They may be universal functions provided to users who use the device without seeing the screen, such as those with low vision or who are totally blind. For example, a function that provides a cursor on the screen and allows buttons to be selected by operating the cursor with hard keys such as a numeric keypad is also possible.

[0048] Fig. 8(B) is the application selection screen 400 that is displayed when the text-to-speech function is started. Fig. 8(B) is displayed on the display / operation unit 1009 by pressing the button 804 after selecting the text-to-speech function in Fig. 8(A).

[0049] Reference numeral 806 denotes a selection cursor that indicates the currently selected button. The name of the button pointed to by the selection cursor 806 is read out loud. In FIG. 8(B), "Copy" is read out loud. The selection cursor 806 can be moved using the hard keys and numeric keypad of the operation unit 1009.

[0050] 9 is a flowchart showing processing for switching a flag indicating whether to permit automatic rearrangement of buttons on the application selection screen 400 depending on whether the text-to-speech function of the image processing device 100 according to the embodiment of the present invention is operating. This flowchart is assumed to be executed in a loop while the image processing device 100 is running. Each step in FIG. 9 is processed by the CPU 1001 of the image processing device 100 executing a program. The program to be executed is called from the ROM 1002 and executed.

[0051] In S901, the voice mode management unit determines whether the text-to-speech function of the image processing device 100 is ON. If 801 or 803 is selected in Fig. 8A, it is determined that the text-to-speech function is ON. If it is determined that the text-to-speech function is ON, the process proceeds to S902, and if not, the process proceeds to S903.

[0052] In S902, the button rearrangement execution unit 204 sets a prohibition flag that prohibits rearrangement of buttons on the application selection screen to ON, and then ends the process. This flag is stored in the RAM 1003.

[0053] In S903, the button rearrangement execution unit 204 sets the prohibition flag that prohibits rearrangement of buttons on the application selection screen to OFF, and then ends the process. This flag is stored in the RAM 1003.

[0054] Through the above processing, button rearrangement can be disabled when the text-to-speech function is enabled, and enabled when the text-to-speech function is disabled. Here, the flag that enables / disables button rearrangement is switched depending on whether the text-to-speech function is turned on or off, but the trigger for switching the flag is not limited to this. Any form is acceptable as long as the flag that enables / disables button rearrangement is switched when at least one of the universal functions related to screen display is enabled. For example, the flag that enables / disables button rearrangement could be switched depending on whether the voice operation function is turned on or off.

[0055] 6 is a flowchart showing the processing for rearranging the application buttons on the application selection screen 400 depending on the state of the image processing device 100 and the enabled / disabled state of the text-to-speech function in an embodiment of the present invention. This flowchart starts when the image processing device 100 displays the application selection screen, and is constantly executed in a loop while the application selection screen is displayed. The application selection screen is displayed when the presence of a user in front of the image processing device 100 is detected, when the user operates the display / operation unit 1009, when user authentication is performed, etc. Each step in FIG. 6 is processed by the CPU 1001 of the image processing device 100 executing a program. The program to be executed is called from the ROM 1002 and executed.

[0056] In S601, the button rearrangement execution unit 204 determines whether the automatic rearrangement prohibition flag is ON. If the text-to-speech function is enabled, the automatic rearrangement prohibition flag is ON by the processing of the flowchart in Fig. 9. If the automatic rearrangement prohibition flag is ON, proceed to S602; if not, proceed to S603.

[0057] In S602, the menu function unit 203 displays the default application selection screen (FIG. 4) with the buttons not rearranged. Even if the button order had been changed before this process, it returns to the default button order. The button rearrangement execution unit 204 does not change the button order here. In other words, the application selection screen in FIG. 4 is displayed here, and even if the user places a document and submits a print job, the button order remains as it is in FIG. 4.

[0058] In S603, the button rearrangement execution unit 204 determines whether a document has been placed on the scanner 1011 of the image processing device 100. To make this determination, the button rearrangement execution unit 204 acquires the status of whether a document has been placed from the document detection unit 201. If a document has been placed, the process proceeds to S604. If a document has not been placed, the process proceeds to S605.

[0059] In S604, the button rearrangement execution unit 204 turns on a flag for moving the display order of buttons with the button attribute "scan" to a higher position. This flag is stored in the RAM 1003, and is turned on and off by the button rearrangement execution unit 204.

[0060] In S605, the button rearrangement execution unit 204 turns off the flag for moving the button with the button attribute "scan" to a higher position in the display order.

[0061] In S606, the button rearrangement execution unit 204 determines whether or not a print job has been submitted to the image processing device 100. To make this determination, the button rearrangement execution unit 204 acquires a status indicating whether or not there is an unprinted print job from the print job detection unit 202. If there is an unprinted print job, the process proceeds to S607. If there is no unprinted print job, the process proceeds to S608.

[0062] In S607, the button rearrangement execution unit 204 turns on a flag for moving the display order of buttons with the button attribute "print" to the top. This flag is stored in the RAM 1003, and is turned on and off by the button rearrangement execution unit 204.

[0063] In S608, the button rearrangement execution unit 204 turns off the flag for moving the button with the button attribute "print" to a higher position in the display order.

[0064] In S609, the button rearrangement execution unit 204 determines the order of the buttons by referring to the flags operated in S604, S605, S607, and S608. Then, the menu function unit 203 displays the application selection screen in the determined button order.

[0065] Here, whether or not the automatic rearrangement prohibition flag is ON is determined at the timing of S602, but the timing is not limited to this. For example, the determination may be made at a timing before S609.

[0066] By performing the above process, rearranging the buttons makes it easier for users who search for the desired button while looking at the screen to find it. On the other hand, for users who search for the desired button without looking at the screen, such as the blind or those with low vision, a default app selection screen is displayed without further button rearrangement, thereby preventing a decrease in operability. Users who search for the desired button without looking at the screen are likely to memorize the button order. Even if the text-to-speech function is turned on, blind or low-vision users do not read out the names of all the buttons displayed on the app selection screen every time to understand their order. This is because reading out all the buttons takes time. Such users memorize the order and positions of the buttons over the course of using the device multiple times and select the desired button by operating the cursor based on their memory. For such users, it is better to provide a menu screen with a fixed order.

[0067] (Second Example) In the first embodiment, whether or not to automatically rearrange buttons was switched depending on whether the text-to-speech function was enabled or disabled. Some image processing devices are originally equipped with both a function for providing a menu screen that automatically rearranges buttons and a function for providing a menu screen that fixes the button order. A single image processing device may be capable of providing two modes: a mode for providing a menu screen that reduces the number of buttons displayed per page and automatically rearranges the buttons, allowing users to easily use the image processing device without confusion, as in the application selection screen of FIG. 4; and a mode for providing a menu screen that displays many buttons per page and fixes the button order, as in the application selection screen of FIG. 11. In this case, a method for switching to an appropriate menu screen depending on whether the text-to-speech function is enabled or disabled will be described. The basic configuration of this embodiment is the same as that of the first embodiment, so only the differences will be shown.

[0068] FIG. 10 is a diagram showing an example of an application selection screen in a mode in which the rearrangement of buttons displayed on the display / operation unit 1009 of the image processing apparatus 100 in this embodiment is not performed.

[0069] The arrangement of buttons on the application selection screen 500 does not change depending on the state of the device, etc. The menu function unit 203 switches between displaying the application selection screen 400 or the application selection screen 500 depending on the user and the environment. For example, an administrator of the image processing device 100 may be able to set whether to display the application selection screen 400 or the application selection screen 500. Furthermore, the user may be able to switch between the application selection screen 400 and the application selection screen 500 via a setting screen, etc.

[0070] Fig. 11 shows an application selection screen 500 that is displayed on the image processing device 100 when the text-to-speech function in this embodiment is started. Fig. 11 is displayed on the operation unit 1009 by pressing the button 804 after selecting the text-to-speech function in Fig. 8(A).

[0071] Reference numeral 807 denotes a selection cursor that indicates the currently selected button. The name of the button pointed to by the selection cursor 807 is read out loud. In FIG. 11, "Copy" is read out loud. The selection cursor 807 can be moved using the numeric keypad or the like of the operation unit 1009.

[0072] 12 is a flowchart showing the display screen switching process at the start of the text-to-speech function in the image processing device 100 having the application selection screen 400 and the application selection screen 500 according to the embodiment of the present invention. This flowchart is constantly executed in a loop while the image processing device 100 is running. Each step in FIG. 12 is processed by the CPU 1001 of the image processing device 100 executing a program. The program to be executed is called from the ROM 1002 and executed.

[0073] In S1001, the voice mode management unit 206 determines whether the text-to-speech function has been started. If the text-to-speech function has been started, the process proceeds to S1002. If the text-to-speech function has not been started, the process proceeds to S1001.

[0074] In S1002, the audio mode management unit 206 instructs the menu function unit 203 or the button rearrangement execution unit 204 to display the application selection screen 500.

[0075] In S1003, the audio mode management unit 206 instructs the menu function unit 203 or the button rearrangement execution unit 204 to display the application selection screen 400. When the application selection screen 400 is displayed, the buttons are automatically rearranged by the processing from 603 onward in the flowchart of FIG.

[0076] According to the above flowchart, an appropriate portal screen can be provided to the user depending on whether the text-to-speech function is enabled or disabled.

[0077] (Other Examples) In the above embodiment, the condition for rearranging the soft keys is a change in the state of the image processing device 100, but this is not limiting. For example, application buttons that are used more frequently by the user may be rearranged to a higher position using operation history information of the image processing device 100 by the user.

[0078] In the above embodiment, the image processing device 100 has been described as having multiple functions such as a copy function and a scanner function, but the present invention can also be applied to an image processing device having only some of these functions. The present invention may also be applied to other information processing devices such as personal computers, PDAs, mobile phones, fax machines, cameras, video cameras, and other image viewers.

[0079] The present invention can also be realized by executing the following process: software (program) that realizes the functions of the above-described embodiments is supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program. In this case, the computer program and the storage medium storing the computer program constitute the present invention. [Explanation of symbols]

[0080] 1001 CPU 1002 ROM 1003 RAM 1004 HDD 1005 Operation unit I / F 1006 Printer I / F 1007 Scanner I / F 1008 Network Interface 1009 Operation section 1010 Printer 1011 Scanner

Claims

1. An information processing device having multiple functions, a first display unit that displays a plurality of soft keys for executing each of the plurality of functions; a display control means for An arrangement that automatically changes the arrangement order of the plurality of soft keys according to the state of the information processing device. and a replacement means, A document is placed on a document reading unit of the information processing device, and the information processing device When a print job is stored in the document reader, the sorting unit sorts the print job by using the document reader. soft keys corresponding to functions used in the changing the order of the soft keys so that the soft keys are arranged with priority over other soft keys; The first display control means displays the plurality of soft keys in a manner changed by the rearrangement means. Display in sort order, A document is placed on a document reading unit of the information processing device, and the information processing device Even if a print job is stored in the information processing device, the information processing device may not be able to recognize the print job. The sorting means sorts the plurality of software based on the fact that the function to sort the plurality of software is enabled. The first display control means changes the order of the soft keys to a predetermined order. Display in sort order 1. An information processing device comprising:

2. The predetermined arrangement is the arrangement of the soft keys at the time of factory shipment or initial setting. be 2. The information processing apparatus according to claim 1, wherein:

3. The visual recognition function includes a voice reading function that reads out the contents displayed on the display unit. Includes a function 3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The visual recognition function includes one of the plurality of soft keys displayed on the display unit. Includes cursor selection of soft keys 4. The information processing device according to claim 1, wherein the information processing device is a computer.

5. A setting screen is displayed on which at least one of the functions relating to the visibility can be set to be enabled or disabled. a second display control means for displaying the Further having 5. The information processing device according to claim 1, wherein the information processing device is a computer.

6. The second display control means controls a first setting and a second setting related to the function related to the visibility. Displaying the setting screen including The first setting is a setting for the plurality of soft keys corresponding to the plurality of soft keys displayed on the display unit. This setting enables or disables the function that reads out information about the function. The second setting is a setting for the plurality of soft keys corresponding to the plurality of soft keys displayed on the display unit. It has the function of reading out information about the functions of the device aloud and recognizing the user's speech about the functions. and the function of activating the predetermined function.

6. The information processing apparatus according to claim 5,

7. The information processing device has at least one of a scanning function and a printing function. Processing equipment 7. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

8. The rearrangement means is configured to read a document when the document is placed on a document reading unit of the information processing device. and based on the detection of the above, pressing a soft key corresponding to a function that uses the document reading unit. Change the order of the soft keys so that the is displayed first.

8. The information processing device according to claim 1, wherein the information processing device is a computer.

9. The sorting unit, upon detecting that the information processing device has saved a print job, Based on this, soft keys corresponding to functions related to the print job are preferentially displayed. Change the order of the soft keys so that 9. The information processing device according to claim 1, wherein the information processing device is a computer.

10. A control method executed by an information processing device having multiple functions, a first display unit that displays a plurality of soft keys for executing each of the plurality of functions; A display control process of a rearrangement step of automatically changing the order of the soft keys according to the state of the information processing device; A document is placed on a document reading unit of the information processing device, and the information processing device If a print job is stored in the document reading unit, the document reading unit The softkeys corresponding to the functions using the printer and the softkeys corresponding to the functions related to the print job are changing the order of the soft keys so that the key is prioritized over other soft keys; In the first display control step, the plurality of soft keys are rearranged. and display them in the modified order, A document is placed on a document reading unit of the information processing device, and the information processing device Even if a print job is stored in the information processing device, the information processing device may not be able to recognize the print job. In the rearrangement step, the plurality of In the first display control step, the order of the soft keys is not changed, and Display keys in a given order A control method comprising:

11. A method for making a computer function as each of the means according to any one of claims 1 to 9. program.

Images