Information processing device, control method thereof, and storage medium

Abstract

The present invention discloses an information processing device, a control method thereof and a storage medium. When the accessibility function of the information processing device is enabled, the information processing device does not automatically rearrange buttons in a menu screen.

Description

Technical Field

[0001] The present invention relates to a display method for an information processing device. Background Art

[0002] Information processing devices such as smartphones and multifunction peripherals (MFPs) include various applications, and display a plurality of software buttons to execute respective applications on a menu screen. For example, the applications maintained by the MFP include a copy application, a fax application, and a print application for printing data from a personal computer (PC). When the number of software buttons displayed on the screen increases, it will be difficult for the user to find the desired software button. Therefore, a technology for automatically rearranging the software buttons displayed on the menu screen based on the state of the device is proposed (Japanese Patent Laid-Open No. 2016-117158). For example, in the case where a manuscript of a specific paper size is placed on the scanner of the MFP, the software buttons for processing the manuscript will be rearranged to the top position of the menu screen. Therefore, the user can easily find the desired software button in the menu screen.

[0003] Therefore, the automatic rearrangement of the software keys improves the operability of the user. However, the automatic rearrangement of the software keys reduces the operability for the user who uses the device without looking at the screen (for example, the blind and the low-vision person). This is because the user who uses the device without looking at the screen has memorized the positions and arrangement order of the software keys, and selects the desired software key by using a cursor or the like based on the memory. Summary of the invention

[0004] The present invention aims to provide a method for preventing the operability of a user who uses the device without looking at the screen from being reduced in a device that can automatically rearrange software keys on the screen.

[0005] According to an aspect of the present invention, there is provided an information processing device including multiple functions, the information processing device including: a first display control unit configured to display multiple software keys on a screen, each software key being used to execute one of the multiple functions; and a rearrangement unit configured to automatically rearrange the multiple software keys in response to an event that occurs. When at least one accessibility function for visual recognition of the information processing device is enabled, the first display control unit displays a screen in which the multiple software keys are not rearranged, and the rearrangement unit does not rearrange the multiple software keys.

[0006] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1is a block diagram illustrating a hardware configuration of an image processing apparatus according to an exemplary embodiment of the present invention.

[0008] Figure 2 is a block diagram illustrating a software configuration of an image processing apparatus according to an exemplary embodiment of the present invention.

[0009] Figure 3 is a diagram illustrating an example showing a button information table associated with buttons according to an exemplary embodiment of the present invention.

[0010] Figure 4 : is a diagram illustrating a screen example of an application selection screen displayed on the display / operation unit of the image processing apparatus according to the exemplary embodiment of the present invention, in which buttons are not rearranged.

[0011] Figures 5A to 5C are diagrams each illustrating a screen example of an application selection screen in which buttons are rearranged, which is displayed on the display / operation unit of the image processing apparatus according to the exemplary embodiment of the present invention.

[0012] Figure 6 is a flowchart illustrating a process of rearranging buttons in an application selection screen based on a state of an image processing apparatus according to an exemplary embodiment of the present invention.

[0013] Figure 7 is a diagram illustrating an association between a state of an image processing apparatus according to an exemplary embodiment of the present invention and a screen displayed on a display / operation unit of the image processing apparatus based on the state.

[0014] Fig. 8A and 8B are diagrams each illustrating an example of a screen displayed on the display / operation unit of the image processing apparatus according to the exemplary embodiment of the present invention.

[0015] Fig. 9 is a flowchart illustrating a process based on whether a voice reading function of an image processing apparatus is enabled according to an exemplary embodiment of the present invention.

[0016] Fig.10 : is a diagram illustrating a screen example of an application selection screen displayed on the display / operation unit of the image processing apparatus according to the exemplary embodiment of the present invention, in which buttons are not rearranged.

[0017] Fig.11 An application selection screen displayed on the display / operation unit of the image processing apparatus in a case where the voice reading function is activated according to an exemplary embodiment of the present invention is illustrated.

[0018] Fig.12is a flowchart illustrating a display screen switching process when starting a voice reading function in an image processing apparatus that can provide two application selection screens according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0019] The exemplary embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the exemplary embodiments, the image processing device will be described as an example of the information processing device; however, the exemplary embodiments do not limit the present invention claimed for protection by the claims. In addition, all feature combinations described in the exemplary embodiments are not necessarily necessary for the solution of the present invention.

[0020] Exemplary embodiments of the present invention will be described below with reference to the accompanying drawings.

[0021] Figure 1 1 is a block diagram illustrating a hardware configuration of the image processing apparatus 100 according to the first exemplary embodiment of the present invention. A control unit 1000 including a central processing unit (CPU) 1001 controls the operation of the entire image processing apparatus 100 .

[0022] The CPU 1001 reads out a control program stored in a read-only memory (ROM) 1002, and performs various controls such as reading control and transmission control. The ROM 1002 is a boot ROM, and stores a boot program of the system. A random access memory (RAM) 1003 is used as a temporary storage area such as a main memory and a work area of ​​the CPU 1001. A hard disk drive (HDD) 1004 stores image data, various programs, or various information tables.

[0023] The display / operation unit interface (I / F) 1005 is an interface for connecting the display / operation unit 1009 and the control unit 1000. The display / operation unit 1009 includes a display with a touch panel function and a keyboard. The display / operation unit 1009 also includes hardware keys for operating the image processing apparatus 100.

[0024] The printer I / F 1006 is an interface for connecting the printer 1010 and the control unit 1000. Image data to be printed by the printer 1010 is transferred from the control unit 1000 via the printer I / F 1006, and is printed by the printer 1010 onto a recording medium (sheet).

[0025] The scanner I / F 1007 is an interface for connecting the scanner 1011 and the control unit 1000. The scanner 1011 reads an image on a document to generate image data, and inputs the image data to the control unit 1000 via the scanner I / F 1007.

[0026] The network I / F 1008 is an interface for connecting the control unit 1000 to a local area network (LAN) 101. The network I / F 1008 sends information to and receives information from an external device connected to the network via the LAN 101. Examples of the external device include an information processing apparatus, a personal computer (PC), and a mobile terminal. The form of the LAN 101 is typically a wired LAN or a wireless LAN; however, the form of the LAN 101 is not limited thereto.

[0027] The representative functions of the image processing apparatus 100 are as follows.

[0028] - A "copy" function for printing, by the printer 1010, image data generated by reading an original by the scanner 1011

[0029] - A "print" function for printing, by the printer 1010, image data based on a print job input from an external device such as an information processing device connected to the network via the network I / F 1008

[0030] - A "scan and send" function for sending image data generated by reading an original by the scanner 1011 to the outside via the network I / F 1008

[0031] - "Scan and store" function for storing image data generated by reading an original by the scanner 1011 in the HDD 1004

[0032] - "Use of stored file" function for printing image data stored in the HDD 1004 by the printer 1010 or transmitting image data stored in the HDD 1004 to the outside via the network I / F 1008 Application buttons for executing each application configured to execute these functions are displayed on the application selection screen.

[0033] Figure 2 is a block diagram illustrating a software configuration of the image processing apparatus 100 according to an exemplary embodiment of the present invention.

[0034] The document detection unit 201 holds a state indicating whether a document is placed on the scanner 1011 of the image processing apparatus 100. The state in which the document is placed on the scanner 1011 indicates, for example, a state in which the document is placed on the feeder of the image processing apparatus 100, a state in which the document is placed on the platen of the image processing apparatus 100, and a state in which the platen is open. The state in which the document is placed on the scanner 1011 is not limited thereto.

[0035] The print job detection unit 202 determines whether there is a state of a print job that has been input from an external device to the image processing apparatus 100 via the LAN 101 and has not been executed. The print job is not limited to a print job that has not been executed, and the print job detection unit 202 can determine whether there is a print job waiting to be executed. The print job detection unit 202 makes this determination by detecting whether the print job is stored in the image processing apparatus 100 or in an external server that can communicate with the image processing apparatus 100.

[0036] The menu function unit 203 controls the display of an application selection screen, which is a menu screen on which buttons (software keys or display objects) for executing each application are arranged. Figure 4 An example of an application selection screen 400 is illustrated. When the user presses the copy button 401, the copy setting screen is displayed. When the user makes settings in the setting screen and then instructs execution, the image processing device 100 starts the copy process. When the application selection screen is displayed, arrangement information for buttons to be displayed is notified from the button rearrangement execution unit 204 to the menu function unit 203. In the case where rearrangement of buttons is necessary, the button rearrangement execution unit 204 notifies the menu function unit 203 of the display order of the rearranged application buttons, and the menu function unit 203 displays the screen based on the display order. In the case where rearrangement is not necessary, the menu function unit 203 displays a screen in which buttons are not rearranged based on the display order stored in the button rearrangement execution unit 204 or the menu function unit 203. Even when the application selection screen 400 is displayed, the menu function unit 203 receives arrangement information for buttons from the button rearrangement execution unit 204 when necessary.

[0037] The button rearrangement execution unit 204 determines the arrangement order of buttons displayed on the application selection screen based on, for example, the state of the image processing unit 100 detected by the document detection unit 201 or the print job detection unit 202 or the event that is occurring. Thereafter, the button rearrangement execution unit 204 notifies the menu function unit 203 of the determined arrangement order of buttons.

[0038] The application button information management unit 205 manages information of buttons (software keys) displayed on the application selection screen. The information of the buttons can be stored in the HDD 1004 of the image processing apparatus 100 or in an external storage device connected via the network I / F 1008.

[0039] The following will refer to Figure 3 The table in describes an example of information managed by the application button information management unit 205.

[0040] The button table 300 is a table illustrating information for buttons displayed on the application selection screen, and one button is defined by one row. The button identification (ID) column 301 indicates the identification code of each button. The display order column 302 indicates the display order of the buttons in the application selection screen. The button name column 303 indicates the text displayed on each button. The call function column 304 indicates the function called when each button is pressed. The setting value column 305 indicates the setting value called by the function when the corresponding button is pressed. Figure 4 The application selection screen 400 in FIG. 4 is displayed in order from the left side of the application selection screen 400 based on the display order defined in the display order column 302. At this time, it is not necessary to display all the buttons defined in the button table 300 on the application selection screen.

[0041] The button attribute table 310 is a table that defines the attributes of each button, and is a table for changing the arrangement order of buttons in the application selection screen based on the state of the image processing apparatus 100. Buttons that are processed using the scanner 1011 of the image processing apparatus 100, such as the "Copy" button and the "Scan and Send" button, are associated with the "Scan" attribute. The "Print" button is associated with the "Print" attribute. For example, when the user sets a sheet in the feeder of the image processing apparatus 100, the document detection unit 201 detects the position of the document, and the button rearrangement execution unit 204 refers to the button attribute table 310 and controls to advance the display order of each button with the scan attribute. In other words, when the user only sets the document in the feeder of the image processing apparatus 100, the buttons that are processed using the scanner 1011 will be automatically rearranged forward. The button table 330 is a table in which buttons are rearranged from the arrangement of buttons exemplified by the button table 300. This rearrangement occurs when a document is placed on the scanner 1011 and the arrangement order of the buttons is changed. The display order of each button with the "scan" attribute, such as the "copy" button and the "scan and send" button, is advanced, and the display order of the other buttons will be moved back accordingly. As described above, the automatic rearrangement of the buttons in the menu screen based on the state of the device can make it easy for the user to find the desired button. Similarly, in the case where the user sends a print job to the image processing device 100, the "print" button with the "print" attribute will also be displayed forward.

[0042] Here, an example of rearranging buttons based on the state of the image processing apparatus 100 is described; however, the rearrangement is not limited thereto. The buttons may be automatically rearranged so that frequently used buttons may be preferentially displayed based on the number of times the user uses the buttons. In this case, the application button information management unit 205 stores the user's button use history in the button use history table 320, and the button rearrangement execution unit 204 rearranges the buttons so that frequently used buttons may be preferentially displayed based on the button use history.

[0043] When a predetermined operation is performed through the display / operation unit 1009, the voice mode management unit 206 displays a voice mode start screen on the display / operation unit 1009 and holds information of the selected voice mode. The predetermined operation is, for example, long pressing or multiple pressing of a predetermined button.

[0044] The voice mode is a mode in which a user (e.g., a blind person or a person with low vision) uses the device without looking at the screen, and is an accessibility mode of the screen display. Examples of the functions of the voice mode include a function of receiving settings or voice instructions for reading out the contents of the screen, and a function of setting a cursor in the screen and selecting a button by performing cursor operations using hardware keys such as a numeric keypad. The voice mode management unit 206 notifies the button rearrangement execution unit 204 of the settings of the valid voice mode. At the end of the voice mode, the voice mode management unit 206 notifies the button rearrangement execution unit 204 that the voice mode is invalid. When the setting of at least one voice mode is valid, the button rearrangement execution unit 204 does not perform the above-mentioned automatic rearrangement of buttons.

[0045] Figure 4 3 is a diagram illustrating a screen example of an application selection screen displayed on the display / operation unit 1009 of the image processing apparatus 100 in a default state (e.g., a factory-shipped state, or a state initially set by an administrator) in which buttons are not rearranged according to an exemplary embodiment of the present invention. The application selection screen is displayed based on information defined in the button table 300.

[0046] The copy button 401 is a button for executing a copy application. When the copy button 401 is pressed, the screen changes to a copy setting screen.

[0047] The use button 402 of the stored file is a button for executing the application using the stored file. When the user presses the button, the user selects a file from the displayed file list screen and selects the processing (printing or generating) for the selected file. Therefore, the selected processing is performed on the selected file.

[0048] The print button 403 is a button for executing a print application. When the print button 403 is pressed, the screen changes to a print setting screen.

[0049] The above three buttons are displayed on the first page of the application selection screen 400. On the second page of the application selection screen 400, a scan and send button 404 and a simple copy button 405 are displayed. The scan and send button 404 is a button for executing an application that sends an image generated by scanning to a designated destination.

[0050] The simple copy button 405 is a button for making a copy with preset setting values. When the simple copy button 405 is pressed, the copy process can be started immediately without opening the setting screen.

[0051] Figure 5A , 5B 5C are diagrams respectively illustrating screen examples of an application selection screen 400 displayed on the display / operation unit 1009 of the image processing apparatus 100 according to the exemplary embodiment of the present invention after application buttons are rearranged from a default state.

[0052] First describe Figure 5A The screen in . Figure 5A In the case where the print job detection unit 202 detects an unexecuted print job, Figure 4 A screen in which buttons in the application selection screen 400 in FIG. 4 are rearranged. Figure 4 The print button 403 is rearranged forward compared to the arrangement of buttons in the illustrated application selection screen 400. In this specific exemplary embodiment, the print button 403 is displayed with a display order attribute of "1", and buttons 401 and 402 have their display order attributes each increased by a value of "1".

[0053] Next, describe Figure 5B The screen in . Figure 5B In the case where the document detection unit 201 detects the document, Figure 4 The illustrated application selection screen 400 is a screen in which application buttons are rearranged. Figure 4 , the copy button 401, the scan and send button 404, and the simple copy button 405 are displayed with higher priority than other buttons compared to the arrangement of buttons in the application selection screen 400 in FIG. That is, the scan and send button 404 and the simple copy button 405 are each moved to display a higher display order than their respective default positions (that is, their display order attributes are numerically decreased / moved toward the display order attribute "1").

[0054] Next, describe Figure 5C The screen in . Figure 5C In the case where the document detection unit 201 detects a document and the print job detection unit 202 detects an unexecuted print job, Figure 4 A screen in which application buttons in the illustrated application selection screen 400 are rearranged. The print button 403, the copy button 401, the scan and send button 404, and the simple copy button 405 are displayed with higher priority than other buttons. In this example, the print button 403 (i.e., the button with the "print" attribute) is displayed with higher priority than the button with the "scan" attribute; however, the buttons may be displayed in the reverse order. Hereinafter, a state in which an original is placed on the scanner and a state in which an unexecuted print job is held will be described as triggers for rearrangement of buttons; however, the states as triggers are not limited thereto. For example, in the case where the image processing apparatus 100 receives a fax (FAX) original, buttons for performing FAX-related processing may be rearranged forward.

[0055] Figure 7 1 is a diagram illustrating the association between the state of the image processing apparatus 100 according to the exemplary embodiment and the application selection screen displayed on the display / operation unit 1009 of the image processing apparatus 100 based on the state. The state of the image processing apparatus 100 applicable to the present invention and the screen displayed on the display / operation unit 1009 based on the state are not limited thereto.

[0056] Table 700 indicates the association between the state of the image processing apparatus 100 and the screen displayed on the display / operation unit 1009 based on the state.

[0057] Column 701 indicates a screen displayed on the display / operation unit 1009 based on the state of the image processing apparatus 100 .

[0058] Column 702 indicates the state of a flag that preferentially displays a button having a print attribute. When the print job detection unit 202 detects an unexecuted print job, the flag is turned on.

[0059] Column 703 indicates the state of the flag for preferentially displaying the button having the scan attribute. When the document detection unit 201 detects that the document is set on the scanner, the flag is turned on.

[0060] Line 704 shows the application selection screen displayed when the above two flags are off. The application selection screen to be displayed is Figure 4 Default screen shown.

[0061] Line 705 indicates an application selection screen that is displayed only when the flag for preferentially displaying buttons with print attributes is on. In this example, the screen is called an application selection screen with preferential printing, and corresponds to Figure 5A The application selection screen is shown.

[0062] Row 706 indicates an application selection screen that is displayed only when the flag for preferentially displaying buttons with scanning attributes is on. In this example, the screen is referred to as an application selection screen with preferential scanning, and corresponds to Figure 5B The application selection screen is shown.

[0063] Row 707 represents an application selection screen displayed when both flags are turned on. In this example, the screen is referred to as an application selection screen with priority scanning and printing, and corresponds to Figure 5C The application selection screen is shown.

[0064] Fig. 8A and 8B are diagrams respectively illustrating examples of setting screens for setting the voice mode of the image processing apparatus 100 according to an exemplary embodiment of the present invention. Fig. 8A and 8B A method of starting the voice mode according to the first exemplary embodiment is described.

[0065] Fig. 8A The voice mode setting screen displayed by the voice mode management unit 206 on the display / operation unit 1009 is illustrated. The voice mode setting screen is displayed when a predetermined operation is performed through the display / operation unit 1009, and is displayed every time the voice mode is activated. For example, when a user using the image processing device 100 long presses or presses a predetermined hardware key of the image processing device 100 multiple times, the screen is displayed. Fig. 8A The state of the selection button 801 is illustrated. Button 801 is a selection button for simultaneously turning on the voice reading function and the voice utterance operation function of the voice mode. The voice reading function is a function of reading out the content of the screen displayed on the display / operation unit 1009. This function is provided to users (for example, blind people and people with low vision) who may not be able to see the screen clearly while using the image processing device 100. This function enables the user to operate the image processing device 100 by using a numeric keypad that relies on voice navigation instead of using the display / operation unit 1009 touch panel operation unit of the image processing device 100. A cursor is displayed in the screen, and the user moves the cursor to select a button by using a hardware key such as a numeric keypad. Examples of the voice navigation read out include the name of the button currently selected by the cursor and the setting value currently set.

[0066] The voice utterance operation function is a function of recognizing the user's voice and the image processing device 100 operating based on the recognition. For example, the "copy" voice uttered by the user is recognized, and the copy application is started. Button 802 is a selection button that only turns on the voice utterance operation function. Button 803 is a selection button that only turns on the voice reading function. Button 804 is a button that starts the voice mode selected by any one of buttons 801, 802 and 803. Button 805 is a button that cancels the activation of the voice mode. The functions of the voice mode are not limited to the above-mentioned functions, as long as the functions provided to users who use the device without looking at the screen (for example, people with low vision and blind people) are accessibility functions. Examples of other functions include setting a cursor in the screen and using hardware keys such as a numeric keypad to operate the cursor to select a button.

[0067] Figure 8B The application selection screen 400 displayed when the voice reading function is started is shown as an example. Fig. 8A After the voice reading function in the screen is displayed, when the button 804 is pressed, the display / operation unit 1009 displays Figure 8B The illustrated screen.

[0068] Cursor 806 is a selection cursor indicating the currently selected button. The name of the button indicated by the selection cursor 806 is read out. Figure 8B In the illustrated example, “Copy” is read out. The selection cursor 806 can be moved by using the hardware keys or the numeric keypad of the display / operation unit 1009 .

[0069] Fig. 9 1 is a flowchart illustrating a process of switching a flag whether to allow automatic rearrangement of buttons in the application selection screen 400 based on whether the voice reading function of the image processing device 100 is operated according to an exemplary embodiment of the present invention. The process of the flowchart is continuously performed in a loop while the image processing device 100 is operating. The process is performed when the CPU 1001 of the image processing device 100 executes the corresponding program. Fig. 9 The program to be executed is loaded from ROM 1002 and executed.

[0070] In step S901, the speech mode management unit 206 determines whether the speech reading function of the image processing apparatus 100 is turned on. Fig. 8A If the button 801 or 803 in the screen is selected, it is determined that the voice reading function is turned on. If it is determined that the voice reading function is turned on ("Yes" in step S901), the process proceeds to step S902. Otherwise ("No" in step S901), the process proceeds to step S903.

[0071] In step S902, the button rearrangement execution unit 204 turns on a prohibition flag for prohibiting rearrangement of buttons in the application selection screen. Then, the process ends. The flag is stored in the RAM 1003.

[0072] In step S903, the button rearrangement execution unit 204 turns off the prohibition flag for prohibiting rearrangement of buttons in the application selection screen. Then, the process ends. The flag is stored in the RAM 1003.

[0073] According to the above-mentioned processing, when the voice reading function is enabled, the rearrangement of the buttons is prohibited. When the voice reading function is prohibited, the rearrangement of the buttons can be enabled. In this example, the enable / disable flag of the rearrangement of the buttons is switched on / off based on the voice reading function; however, the trigger of the switching flag is not limited to this. As long as the enable / disable flag of the rearrangement of the buttons is switched when at least one of the accessibility functions for the screen display is enabled, the method is not limited. For example, the enable / disable flag of the rearrangement of the buttons can be switched on / off based on the voice utterance operation function.

[0074] Figure 6 1 is a flowchart illustrating a process of rearranging application buttons in the application selection screen 400 based on the state of the image processing apparatus and the enable / disable state of the voice reading function according to an exemplary embodiment of the present invention. The flowchart is started when the image processing apparatus 100 displays the application selection screen, and the process is continuously performed in a loop while the application selection screen is displayed.

[0075] For example, when it is detected that a user appears in front of the image processing apparatus 100, when the user operates the display / operation unit 1009, and when user authentication is performed, the application selection screen is displayed. Figure 6 The program to be executed is loaded from ROM 1002 and executed.

[0076] In step S601, the button rearrangement execution unit 204 determines whether the automatic rearrangement prohibition flag is on. Fig. 9 The process in the flowchart of is turned on. In a case where the automatic rearrangement prohibition flag is on ("Yes" in step S601), the process proceeds to step S602. Otherwise ("No" in step S601), the process proceeds to step S603.

[0077] In step S602, the menu function unit 203 displays a default application selection screen ( Figure 4). Even if the arrangement order of the buttons is changed before the processing, the arrangement of the buttons will return to the default arrangement. Further, at this time, the button rearrangement execution unit 204 does not change the arrangement order of the buttons. In other words, at this time, the display Figure 4 Even if the user places a document or enters a print job, the button arrangement does not change. Figure 4 The illustrated arrangement changes.

[0078] In step S603, the button rearrangement execution unit 204 determines whether the document has been placed on the scanner 1011 of the image processing apparatus 100. To make the determination, the button rearrangement execution unit 204 acquires a status indicating whether the document has been placed from the document detection unit 201. In the case where the document has been placed ("Yes" in step S603), the process proceeds to step S604. In the case where the document has not been placed ("No" in step S603), the process proceeds to step S605.

[0079] In step S604, the button rearrangement execution unit 204 turns on a flag for preferentially displaying buttons having the "scan" attribute. This flag is stored in the RAM 1003 and is turned on or off by the button rearrangement execution unit 204.

[0080] In step S605 , the button rearrangement execution unit 204 turns off the flag for preferentially displaying buttons having the “scan” attribute.

[0081] In step S606, the button rearrangement execution unit 204 determines whether a print job has been input to the image processing apparatus 100. To make the determination, the button rearrangement execution unit 204 acquires a status indicating whether an unexecuted print job exists from the print job detection unit 202. In the case where an unexecuted print job exists ("Yes" in step S606), the process proceeds to step S607. In the case where an unexecuted print job does not exist ("No" in step S606), the process proceeds to step S608.

[0082] In step S607, the button rearrangement execution unit 204 turns on a flag for preferentially displaying buttons having the "Print" attribute. This flag is stored in the RAM 1003 and is turned on or off by the button rearrangement execution unit 204.

[0083] In step S608 , the button rearrangement execution unit 204 turns off the flag for preferentially displaying buttons having the “Print” attribute.

[0084] In step S609, the button rearrangement execution unit 204 determines the arrangement order of the buttons with reference to the flag operated in step S604, S605, S607 or S608. The menu function unit 203 displays the application selection screen based on the determined arrangement order of the buttons.

[0085] In this example, it is determined at the timing of step S602 whether the automatic rearrangement prohibition flag is on; however, the determination timing is not limited thereto. For example, the determination may be performed at a timing before step S609.

[0086] Through the above processing, buttons can be rearranged, which makes it easy for users who search for desired buttons while looking at the screen to find the desired buttons. On the contrary, for users who search for desired buttons without looking at the screen (for example, blind people and people with low vision), the default application selection screen will be displayed and the buttons will not be rearranged, which can prevent the reduction of operability. Users who search for desired buttons without looking at the screen usually remember the arrangement of buttons. Even if blind people and people with low vision turn on the voice reading function, it is unlikely that blind people and people with low vision will check the arrangement of buttons by making the device read out the names of all buttons displayed in the application selection screen every time they use the device. This is because it is a time-consuming process to read all buttons. Such users can remember the arrangement and position of buttons when they use the device many times, and select the desired button by operating the cursor based on memory. For such users, a menu screen with a fixed arrangement order will be provided preferentially.

[0087] In the first exemplary embodiment, the automatic rearrangement of buttons is determined based on the enable / disable state of the voice reading function. The image processing device may initially include a function of providing both a menu screen in which buttons can be automatically rearranged and a function of providing a menu screen in which the arrangement order of buttons is fixed. In the case where this is the case, an image processing device may provide (1) a mode of providing a menu screen in which buttons displayed on one page are displayed as follows: Figure 4 The image processing apparatus can be arranged in a manner that the number of buttons displayed on one page is reduced as in the application selection screen in FIG. 1 , and the buttons can be automatically rearranged so that the user can use the image processing apparatus easily without hesitation, and (2) a mode of providing a menu screen in which the number of buttons displayed on one page is reduced as in the application selection screen in FIG. 1 . Fig.11 , and the arrangement order of the buttons is fixed. In this case, a method of switching the menu screen to an appropriate menu screen based on the on / off of the voice reading function will be described. Since the basic configuration of the second exemplary embodiment is the same as that of the first exemplary embodiment, only the differences between the two embodiments will be described.

[0088] Fig.10: is a diagram illustrating a screen example of an application selection screen in a mode in which buttons displayed in the display / operation unit 1009 of the image processing apparatus 100 are not rearranged according to the second exemplary embodiment.

[0089] In the application selection screen 500, for example, buttons are not rearranged based on the state of the device. The menu function unit 203 switches whether the application selection screen 400 or the application selection screen 500 is displayed based on the user or the environment. For example, the administrator of the image processing device 100 can set whether the application selection screen 400 or the application selection screen 500 is displayed. In addition, the user can switch the application selection screen 400 and the application selection screen 500 through the setting screen, for example.

[0090] Fig.11 The application selection screen 500 displayed on the image processing device 100 when the voice reading function is started according to the present exemplary embodiment is illustrated. Fig. 8A When the voice reading function is selected in the screen of Fig.11 The screen shown in the example.

[0091] Cursor 807 is a selection cursor indicating the currently selected button. The name of the button indicated by the selection cursor 807 is read out. Fig.11 In the example of , “Copy” is read out. The selection cursor 807 can be moved by using the numeric keypad of the display / operation unit 1009, for example.

[0092] Fig.12 1 is a flowchart illustrating a display screen switching process when the voice reading function is started in the image processing device 100 provided with the application selection screen 400 and the application selection screen 500 according to an exemplary embodiment of the present invention. When the image processing device 100 is operated, this process is continuously performed in a loop. When the CPU 1001 of the image processing device 100 executes the corresponding program, the process Fig.12 The program to be executed is loaded from ROM 1002 and executed.

[0093] In step S1001, the voice mode management unit 206 determines whether the voice reading function has been started. If the voice reading function has been started ("Yes" in step S1001), the process proceeds to step S1002. If the voice reading function has not been started ("No" in step S1001), the process proceeds to step S1003.

[0094] In step S1002 , the voice mode management unit 206 instructs the menu function unit 203 or the button rearrangement execution unit 204 to display the application selection screen 500 .

[0095] In step S1003, the voice mode management unit 206 instructs the menu function unit 203 or the button rearrangement execution unit 204 to display the application selection screen 400. When the application selection screen 400 is displayed, Figure 6 The buttons are automatically rearranged by performing the processing after step S603 in the flowchart.

[0096] By using the processing in the above-described flowchart, an appropriate application selection screen can be provided to the user based on the enable / disable state of the voice reading function.

[0097] In the above exemplary embodiments, the change of the state of the image processing apparatus 100 is described as an example of a condition for rearranging the software keys; however, the condition is not limited thereto. For example, application buttons frequently used by the user can be preferentially rearranged by using the user operation history information of the image processing apparatus 100, for example.

[0098] In the above-described exemplary embodiments, the image processing apparatus 100 including multiple functions such as a copy function and a scanner function is described as an example; however, the present invention is also applicable to an image processing apparatus including a part of the functions. In addition, the present invention is also applicable to other information processing apparatuses such as personal computers, portable digital assistants (PDAs), mobile phones, facsimile machines (FAXs), cameras, video cameras, and image browsers.

[0099] Other implementation examples

[0100] Some embodiments may also be implemented by reading out and executing computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more completely referred to as a "non-transitory computer-readable storage medium") to perform the functions of one or more of the above-mentioned (one or more) embodiments and / or a system or device including one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing the functions of one or more of the above-mentioned (one or more) embodiments, and by a method performed by a computer of the system or device, for example, by reading out and executing computer executable instructions from a storage medium to perform the functions of one or more of the above-mentioned (one or more) embodiments and / or controlling one or more circuits to perform the functions of one or more of the above-mentioned (one or more) embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of separate computers or separate processors to read out and execute computer executable instructions. Computer executable instructions may be provided to the computer, for example, from a network or a storage medium. The storage medium may include, for example, a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage device of a distributed computing system, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD), or a Blu-ray disk (BD)) TM ), one or more of flash memory devices, memory cards, etc.

[0101] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0102] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the claims is to be accorded the broadest interpretation so as to encompass all such modifications, equivalent structures and functions.

Claims

1. An information processing device having multiple functions, the information processing device comprising: A first display control unit is configured to display a plurality of software buttons on the screen, each software button being used to execute one of the plurality of functions; as well as a rearrangement unit configured to automatically rearrange the plurality of software keys in response to an event occurring, Wherein, when a voice mode for the information processing device is enabled, the rearrangement unit does not rearrange the plurality of software keys.

2. The information processing device according to claim 1, in, In a case where a voice mode for the information processing apparatus is enabled, the first display control unit displays a screen in which the plurality of software keys are not rearranged, and The picture in which the plurality of software buttons are not rearranged is a picture in a default state.

3. The information processing device according to claim 1, wherein: The voice mode includes a voice reading function for reading out the content displayed on the screen.

4. The information processing device according to claim 1, wherein: The voice mode includes a function for selecting, by a cursor, any one of the plurality of software keys displayed on the screen.

5. The information processing device according to claim 1, further comprising: a second display control unit configured to display a setting screen to enable or disable the voice mode; as well as The storage unit is configured to store the settings received in the setting screen.

6. The information processing device according to claim 1, wherein: The rearrangement unit preferentially displays at least one of the plurality of software keys.

7. The information processing device according to claim 1, wherein: The rearrangement unit automatically rearranges the plurality of software keys based on a state of the information processing apparatus.

8. The information processing device according to claim 1, wherein: The information processing apparatus is an image processing apparatus including at least one of a scanning function and a printing function.

9. The information processing device according to claim 1, wherein: The rearrangement unit rearranges the plurality of software keys to preferentially display software keys satisfying a predetermined condition among the plurality of software keys based on detection of a document placed on a document reading unit of the information processing apparatus.

10. The information processing device according to claim 1, wherein: The rearrangement unit rearranges the plurality of software buttons to preferentially display software buttons satisfying a predetermined condition among the plurality of software buttons based on detection that the information processing apparatus holds a print job.

11. The information processing device according to claim 1, wherein: In a case where the voice mode is enabled, a screen is displayed in which the plurality of software keys are not rearranged by the rearrangement unit.

12. A control method for an information processing device including a plurality of functions, the method comprising: Displaying a plurality of software buttons on the screen, each software button being used to execute one of the plurality of functions; as well as automatically rearranging the plurality of software keys in response to an event occurring, Wherein, when the voice mode for the information processing device is enabled, the plurality of software keys are not rearranged.

13. A non-transitory computer-readable storage medium storing a computer program for causing a computer to perform a control method for an information processing device including a plurality of functions, the method comprising: Displaying a plurality of software buttons on the screen, each software button being used to execute one of the plurality of functions; as well as automatically rearranging the plurality of software keys in response to an event occurring, Wherein, when the voice mode for the information processing device is enabled, the plurality of software keys are not rearranged.

Images