Information processing device and information processing program

The information processing device addresses the uncertainty of process execution by using auditory feedback for slide operations on touch panels, enhancing user recognition through clear sound notifications for successful and unsuccessful attempts.

JP7604200B2Active Publication Date: 2024-12-23FUJIFILM CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2020200483
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-02
Publication Date
2024-12-23
Estimated Expiration
2040-12-02

AI Technical Summary

Technical Problem

Existing touch panel UI technologies do not provide clear feedback when a user releases a button before completing a slide operation, leading to uncertainty about the execution of the corresponding process.

Method used

An information processing device that provides auditory feedback indicating whether a process will be executed based on the completion of a slide operation, including sounds for successful execution, unsuccessful attempts, and error detection.

Benefits of technology

Enhances user recognition of process execution status by providing timely auditory cues, reducing uncertainty and improving user interaction with touch panel interfaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007604200000001
    Figure 0007604200000001
  • Figure 0007604200000002
    Figure 0007604200000002
  • Figure 0007604200000003
    Figure 0007604200000003
Patent Text Reader

Abstract

To provide an information processing apparatus and an information processing program for allowing a user to easily recognize the execution of processing.SOLUTION: An information processing apparatus includes a CPU that controls to display, on a display, an operation unit for receiving a moving operation performed by a user's drag or slide operation to instruct predetermined processing, when the moving operation is performed by the user on the operation unit, move the operation unit to follow the moving operation, move the operation unit according to the moving operation from one end of a movement area to before the other end to end the moving operation, and then moves the operation to the other end and causes a notification unit to notify a sound indicating that the CPU executes the predetermined processing after the operation unit moves to a position corresponding to the other end.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing program. [Background technology]

[0002] Patent Document 1 describes an information processing device including a display control means for displaying a window on a touch panel, and a detection means for detecting at least one of a touch down, a touch up, and a move as a touch operation on the touch panel. The display control means controls the window to be hidden when a touch down on a first area of ​​the window is detected and then a touch up is detected without a move being detected, and controls the window to be resized and displayed and / or the window to be displayed when a touch down on the first area of ​​the window is detected and then a move is detected.

[0003] Patent Document 2 describes an input device having a touch panel on which a user performs an input operation, a recording means for chronologically recording touch positions during a period from touch-down to touch-up on the touch panel by the input operation, a calculation means for calculating a variance of touch positions based on each touch position recorded in the recording means, and a discrimination means for discriminating whether the input operation is an operation not including a move or an operation including a move based on the variance calculated by the calculation means. If the calculated variance is smaller than a threshold, the discrimination means discriminates that the input operation is an operation not including the move, and if the calculated variance is not smaller than the threshold, discriminates that the input operation is an operation including the move. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-52787 A [Patent Document 2] JP 2011-134212 A Summary of the Invention [Problem to be solved by the invention]

[0005] There is a technology that allows users to slide buttons on a touch panel UI (User Interface), preventing users from making erroneous operations.

[0006] However, if the user releases a button before the end point of a slide operation, the slide operation is not completed and the user cannot recognize whether or not the process corresponding to that button will be executed.

[0007] The present invention aims to provide an information processing device and an information processing program that make it easier for a user to recognize that processing is being executed, compared to a case where a sound is heard when the operation unit is moved from one end of the operation unit's movement area to a position just before the other end and then the movement operation is ended. [Means for solving the problem]

[0008] An information processing device according to a first aspect includes a processor, and the processor displays on a display an operation unit for receiving a user's drag or slide movement operation and instructing a predetermined process, and when the user performs the movement operation on the operation unit, moves the operation unit to follow the movement operation, and when the movement operation causes the operation unit to move from one end of a movement area of ​​the operation unit to a position closer to the other end and then ends the movement operation, moves the operation unit to the other end, and controls an alarm unit to issue a sound indicating that the predetermined process will be executed after the operation unit has moved to a position corresponding to the other end.

[0009] In addition, in an information processing device according to a second aspect, in the information processing device according to the first aspect, when the processor moves the operation unit from the one end to a predetermined threshold point and then ends the movement operation before the other end, the processor moves the operation unit to the other end and causes the notification unit to make a sound to indicate that the specified processing will be executed after the operation unit has moved to a position corresponding to the other end, and when the movement operation ends without moving from the one end to the threshold point, the processor moves the operation unit to the one end and causes the notification unit to make a sound to indicate that the specified processing will not be executed after the operation unit has moved to the position short of the one end.

[0010] In addition, in an information processing device according to a third aspect, in the information processing device according to the first or second aspect, when an error occurs in the specified processing after the processor starts execution of the specified processing, the processor causes the notification unit to make a sound indicating that the error has occurred and moves the operation unit to the one end.

[0011] In addition, in an information processing device according to a fourth aspect, in the information processing device according to the third aspect, when an error occurs in the specified processing after starting execution of the specified processing, the processor causes the notification unit to make a sound to notify the user of the occurrence of the error, and then moves the operation unit to the one end.

[0012] In addition, in an information processing device according to a fifth aspect, in the information processing device according to the third aspect, when an error occurs while the processor is causing the notification unit to notify the user of a sound indicating that the specified processing is being executed and a sound indicating that the error has occurred, the processor causes the notification unit to notify the user of the sound indicating that the specified processing is being executed and the sound indicating that the error has occurred separately.

[0013] In addition, in an information processing device according to a sixth aspect, in the information processing device according to the fifth aspect, if an error occurs while the processor is causing the alarm unit to make a sound indicating that the specified processing is being executed, the processor causes the alarm unit to make a sound indicating that the error has occurred after causing the alarm unit to make a sound indicating that the specified processing is being executed.

[0014] In addition, an information processing device according to a seventh aspect is an information processing device according to the fifth aspect, wherein, when an error occurs while the processor is causing the notification unit to sound an indication that the specified processing is being executed, the processor stops sounding the sound indicating that the specified processing is being executed and then causes the notification unit to sound an indication that the error has occurred.

[0015] In addition, an information processing device according to an eighth aspect is an information processing device according to any one of the first to seventh aspects, wherein the processor controls the operation unit to move to the other end when the operation is terminated after the operation has been moved from the one end to a position closer to the other end, and when a user operates the operation unit while the operation unit is being moved to the other end, the processor stops the movement of the operation unit and stops the sound notification indicating that the specified process is to be executed.

[0016] In addition, in an information processing device according to a ninth aspect, in the information processing device according to the second aspect, the processor causes the notification unit to notify that the operation unit has moved beyond the threshold point when the operation unit passes beyond the threshold point due to the movement operation.

[0017] In addition, in an information processing device according to a tenth aspect, in the information processing device according to the ninth aspect, when the operation unit passes over the threshold point due to the movement operation and then the operation unit returns to a position closer to the threshold point due to the movement operation by the user, the processor causes the notification unit to notify that the operation unit has returned to a position closer to the threshold point.

[0018] In addition, an information processing device according to an eleventh aspect is an information processing device according to any one of the first to tenth aspects, wherein the processor controls the information processing device to stop making a sound notification indicating that the specified processing is to be executed when the movement operation is being performed on the operation unit.

[0019] In addition, in an information processing device according to a 12th aspect, in the information processing device according to the 11th aspect, when the processor moves the operation unit to the other end by the moving operation and then ends the moving operation, the processor controls the notification unit to make a sound indicating that the specified processing will be executed after the moving operation is ended.

[0020] In addition, an information processing program according to a thirteenth aspect causes a computer to execute the following operations: display on a display an operation unit for receiving a user's drag or slide movement operation and instructing a specified process; when the user performs the movement operation on the operation unit, move the operation unit to follow the movement operation; when the movement operation causes the operation unit to move from one end of the movement area of ​​the operation unit to a position closer to the other end and then the movement operation is terminated, move the operation unit to the other end; and control an alarm unit to sound an indication that the specified process will be executed after the operation unit has moved to a position corresponding to the other end. Effect of the Invention

[0021] According to the first aspect, it is easier for the user to recognize that processing is being executed, compared to a case where a sound is generated when the operation part is moved from one end of the movement area of ​​the operation part to just before the other end and then the movement operation is ended.

[0022] According to the second aspect, the user can recognize that the processing will not be executed at an earlier stage than when the movement operation is ended without passing the threshold point and a sound is then issued after the operation part is moved to one end from just before the threshold point of the operation part.

[0023] According to the third aspect, the user can recognize that an error has occurred in a predetermined process and that the state has returned to the state before the process.

[0024] According to the fourth aspect, an error can be recognized by a predetermined process at an earlier stage, compared to a case in which a sound indicating the occurrence of an error is issued after the operation unit is moved to one end.

[0025] According to the fifth aspect, compared to a case in which the alarm unit is configured to issue a sound indicating that a specified process has been executed and a sound indicating that an error has occurred without distinguishing between these two sounds, the user can more easily recognize whether the specified process has been executed or whether an error has occurred during the specified process.

[0026] According to the sixth aspect, the user can recognize that an error has occurred in a predetermined process.

[0027] According to the seventh aspect, it is easier for a user to recognize that an error has occurred during a specified process, compared to a case in which the notification unit is caused to issue a sound indicating that an error has occurred without stopping the notification of the sound indicating that a specified process is being executed.

[0028] According to the eighth aspect, when the user performs an erroneous operation, the user can recognize that a predetermined process has not been executed.

[0029] According to the ninth aspect, the user can recognize that the operation unit has passed the threshold point due to the movement operation.

[0030] According to the tenth aspect, the user can recognize that the operation unit has returned to a position just before the threshold point by the movement operation.

[0031] According to the eleventh aspect, the user can recognize that a predetermined process will not be executed while the operation unit is being operated.

[0032] According to the twelfth aspect, even when the operation unit is moved to the other end, the user can recognize that a predetermined process will not be executed while the operation unit is being operated.

[0033] According to the thirteenth aspect, it is easier for the user to recognize that processing is being executed, compared to a case in which a sound is generated when the operation unit is moved from one end of the movement area of ​​the operation unit to just before the other end and then the movement operation is ended. [Brief description of the drawings]

[0034] [Figure 1] 1 is a block diagram showing a hardware configuration of an image forming apparatus according to an embodiment of the present invention; [Diagram 2] 1 is a functional block diagram of an image forming apparatus according to an embodiment of the present invention. [Diagram 3] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Figure 4] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Diagram 5] 13A and 13B are diagrams illustrating examples of how a disabled button is displayed in a user interface component. [Figure 6] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Figure 7] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Figure 8] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Figure 9] 13A and 13B are diagrams illustrating an example of an operation performed when a disabled button in a user interface component is pressed. [Figure 10] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is pressed and then released. [Figure 11] 13A to 13C are diagrams illustrating an example of an operation performed when a text display section in a user interface component is operated. [Figure 12] 13A and 13B are diagrams illustrating an example of the operation of user interface components when an occurrence of an error is detected. [Figure 13] FIG. 13 is a diagram showing an example of an instruction screen displayed when it is detected that an error has occurred. [Figure 14]13A and 13B are diagrams illustrating an example of the operation of user interface components when an occurrence of an error is detected. [Figure 15] 6 is a flowchart showing an example of a specific process flow performed by the image forming apparatus according to the present embodiment. [Figure 16] 6 is a flowchart showing an example of a specific process flow performed by the image forming apparatus according to the present embodiment. [Figure 17] 11A and 11B are diagrams illustrating an example of an operation performed when a button in a user interface component is pressed. [Figure 18] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Figure 19] 13A to 13C are diagrams illustrating an example of an operation performed when a button in a user interface component is moved. [Figure 20] FIG. 13 is a diagram illustrating another example of the configuration of user interface components. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0035] An example of an embodiment of the present invention will be described in detail below with reference to the drawings. In each drawing, the same or equivalent components and parts are given the same reference numerals. Also, the dimensional ratios of the drawings are exaggerated for the convenience of explanation and may differ from the actual ratios. Figure 1 is a block diagram showing the hardware configuration of an image forming apparatus as an information processing apparatus according to this embodiment.

[0036] The predetermined processes performed by the image forming apparatus 10 include, for example, a process of printing a document file or an image file, a process of editing a file, a process of generating or processing information using the facilities of the image forming apparatus 10, a process of sending and receiving information between the image forming apparatus 10 and other devices, etc. The output of a file is not limited to printing, and also includes conversion of a file format, etc.

[0037] The image forming apparatus 10 is an apparatus that forms an image on a recording medium such as paper based on a print job, and may be any apparatus such as a printer or a multifunction machine.

[0038] The image forming apparatus 10 of this embodiment includes a CPU (Central Processing Unit) 10A as an example of a processor, a ROM (Read Only Memory) 10B, a RAM (Random Access Memory) 10C, an HDD (hard disk drive) 10D, a display 10F, a communication line I / F (interface) unit 10G, an output unit 10H, and an alarm unit 10I.

[0039] The CPU 10A controls the overall operation of the image forming apparatus 10. The ROM 10B stores various control programs and various parameters in advance. The RAM 10C is used as a work area when the CPU 10A executes various programs. The HDD 10D stores various data and application programs. The display 10F is a touch panel display and is used to input and display various information.

[0040] The communication line I / F unit 10G is connected to a communication line (not shown) and transmits and receives various data to and from other devices connected to the communication line. The notification unit 10I includes a speaker.

[0041] The above-described components of the image forming apparatus 10 are electrically connected to each other via a system bus 10J. In the image forming apparatus 10 according to the present embodiment, the HDD 10D is used as a storage unit, but this is not limiting and other non-volatile storage units such as flash memory may be used.

[0042] With the above configuration, the image forming apparatus 10 according to this embodiment uses the CPU 10A to access the ROM 10B, the RAM 10C, and the HDD 10D, to obtain various data via the display 10F, and to display various information on the display 10F. In addition, the image forming apparatus 10 uses the CPU 10A to control the transmission and reception of communication data via the communication line I / F unit 10G.

[0043] In the image forming apparatus 10 according to this embodiment, the CPU 10A executes a program stored in advance in the ROM 10B or the HDD 10D, thereby accepting an operation from a user instructing a predetermined process and executing the predetermined process.

[0044] Next, the functional configuration of the image forming apparatus 10 according to the present embodiment configured as described above will be described. Fig. 2 is a functional block diagram of the image forming apparatus 10 according to the present embodiment. Each functional unit is realized by the CPU 10A executing a program prestored in the ROM 10B or the HDD 10D.

[0045] The image forming apparatus 10 has the functions of a reception unit 12, an operation control unit 14, a process execution unit 16, and an error detection unit 18.

[0046] The reception unit 12 displays an instruction screen for instructing a predetermined process on the display 10F. On this instruction screen, a user interface component 20 is arranged as shown in Fig. 3(A). The user interface component 20 includes a base 22 as a movement area, and a button 24 for instructing a predetermined process and a text display unit 26, which are arranged on the base 22. The button 24 is an example of an operation unit for instructing a predetermined process by receiving a movement operation by a user's drag or slide.

[0047] As shown in Fig. 3(B) to Fig. 3(E), the button 24 can move from a starting point 22A, which is one end of the base 22, to an ending point 22B, which is the other end, and the reception unit 12 receives a movement operation by a user sliding. Specifically, the reception unit 12 receives a movement operation in which the user slides the button 24 in the direction of the arrow while pressing the button 24. While the button 24 is being pressed, a display indicating that the button 24 is pressed is displayed, for example, the color of the button 24 changes. Furthermore, when a movement operation of the button 24 is received, the portion of the text display unit 26 through which the button 24 has passed becomes invisible (see Fig. 3(C) to Fig. 3(E)).

[0048] Fig. 3(B) shows an example in which the color of button 24 changes while it is being pressed. Fig. 3(D) shows an example in which the x-coordinate position (solid line) of button 24 passes a threshold point (dashed line) in the X-axis direction, which is the movement direction of button 24. Here, the threshold point is a predetermined point for determining whether or not to enable the execution of a predetermined process.

[0049] The instruction screen may include a user interface component 20A as shown in FIG. 4A. The user interface component 20A includes a text display section 26 and a text display section 26A at a position different from the base 22. The button 24 can move from the start point 22A to the end point 22B of the base 22 as shown in FIG. 4B to FIG. 4E. The part of the text display section 26 through which the button 24 passes becomes invisible, but the text display section 26A does not become invisible. The part of the text display section 26 through which the button 24 passes displays content corresponding to a predetermined process. For example, when copying or printing is performed, the number of copies is displayed, and when faxing or e-mailing is performed, the number of destinations is displayed. By displaying content corresponding to a predetermined process in the part through which the button 24 passes, the user can recognize the content during the movement operation by sliding.

[0050] Furthermore, the configuration of the user interface components is not limited to the configurations shown in FIGS. 3 and 4, and other configurations may be used as long as they include movable buttons.

[0051] Furthermore, when execution of a predetermined process corresponding to a button 24 is prohibited, the color of the button 24 and the text display section 26 are changed to a color indicating that the button is in an unusable state, as shown in Fig. 5, and even if the button 24 is pressed, the display of the button 24 is not changed. Indicating that the button is in an unusable state is not limited to changing the color, as long as the unusable state can be visually recognized. For example, the text display section 26 may display "unusable".

[0052] When a user performs a movement operation on the button 24, the operation control unit 14 moves the button 24 to follow the movement operation. Specifically, the operation control unit 14 moves the button 24 in the X-axis direction according to the X-coordinate of the position where the user's finger is in contact with the display 10F.

[0053] When the button 24 is moved from the starting point 22A to the ending point 22B of the base 22 by the moving operation and then released to end the moving operation, the operation control unit 14 controls the notification unit 10I to issue a notification of successful operation sound indicating that a predetermined process corresponding to the button 24 will be executed, and also controls the process execution unit 16 to execute the predetermined process corresponding to the button 24 (see Figs. 6(A) to 6(C)). Here, "release" refers to the removal of the user U's finger from the display 10F. Note that in the case of operation with a stylus pen or the like instead of the user's finger, "release" refers to the removal of the stylus pen from the display 10F.

[0054] Fig. 6(B) shows an example in which the x-coordinate position (solid line) of the button 24 exceeds the threshold point (dashed line) by moving the button 24. Fig. 6(C) shows an example in which the notification unit 10I issues a notification of successful operation sound when the button 24 is moved to the end point 22B and then released.

[0055] While the predetermined process corresponding to the button 24 is being executed, the user interface component 20 may be switched to a configuration indicating that the predetermined process is to be stopped, as shown in FIG. 20. For example, the button 24 is hidden, and the text display section 26 displays the word "Stop." If the user presses the base 22, the predetermined process is stopped even if it is in the middle of being executed. For example, if a copy process is being executed, the copy process is stopped even if the number of copies input by the user in advance is not completed. The color of the base 22 or the text display section 26 may be changed to a color indicating that the predetermined process is to be stopped. After the predetermined process is stopped, the display of the user interface component 20 may be returned to the display shown in FIG. 3(A). Alternatively, the text display section 26 may display the word "Restart" so that the stopped predetermined process can be restarted, and the process may be restarted when the user presses the base 22.

[0056] Furthermore, when button 24 is moved from starting point 22A of base 22 to just before a predetermined threshold point by a moving operation and then released to end the moving operation, operation control unit 14 moves button 24 to starting point 22A without issuing an operation success sound and without executing a predetermined process corresponding to that button 24 (see Figs. 7(A) to 7(C)). At this time, after button 24 is moved beyond starting point 22A, notification unit 10I may issue an operation failure sound indicating that the predetermined process will not be executed.

[0057] Fig. 7(B) shows an example in which the button 24 is released before the button 24 passes the threshold point (dashed line) due to a moving operation of the button 24. Fig. 7(C) shows an example in which the button 24 is moved to the starting point 22A.

[0058] Furthermore, when the button 24 is moved from the starting point 22A of the base 22 to beyond the threshold point by a movement operation and then released just before the end point 22B to end the movement operation, the operation control unit 14 controls the button 24 to move to the end point 22B, and controls the notification unit 10I to issue an operation success sound after the button 24 moves to the end point 22B, and also controls the process execution unit 16 to execute a predetermined process corresponding to the button 24 (see Figures 8(A) to 8(C)).

[0059] Fig. 8(B) shows an example in which the button 24 is released after passing the threshold point (dashed line) due to a movement operation of the button 24. Fig. 8(C) shows an example in which the button 24 is moved to the end point 22B and then the notification unit 10I is caused to issue a sound indicating successful operation.

[0060] Furthermore, when execution of a predetermined process corresponding to a button 24 is prohibited, and the button 24 is pressed and released, the operation control unit 14 causes the notification unit 10I to emit an operation failure sound indicating that the predetermined process will not be executed (see Figs. 9(A) and (B)). Fig. 9(A) shows an example in which an unavailable button 24 is pressed. Fig. 9(B) shows an example in which the notification unit 10I emits an operation failure sound when the button 24 is released.

[0061] 10, when the button is pressed and released without being moved, the operation control unit 14 does not execute a predetermined process corresponding to the button 24 (see FIG. 10). At this time, it is clear to the user that the predetermined process will not be executed, and since it is annoying for the user if an operation failure sound is issued to indicate that the predetermined process will not be executed, it is preferable not to issue an operation failure sound from the notification unit 10I.

[0062] Furthermore, even if the text display section 26 is pressed as shown in FIG. 11 or a movement operation on the text display section 26 is received, the operation control section 14 does not execute a predetermined process corresponding to the button 24 (see FIG. 11).

[0063] Furthermore, when the operation control unit 14 detects, by the error detection unit 18, that an error has occurred in the predetermined process after starting the execution of the predetermined process, the operation control unit 14 causes the notification unit 10I to emit an error sound to notify the occurrence of the error (see Figs. 12(A) to 12(D)), and moves the button 24 to the starting point 22A as shown in Fig. 13. At this time, a message indicating that an error has occurred may be displayed.

[0064] Fig. 12(B) shows an example in which the button 24 has crossed the threshold point (dashed line) due to a movement operation of the button 24. Fig. 12(C) shows an example in which, after the button 24 is released, the button 24 is moved to the end point 22B and an operation success sound is issued by the notification unit 10I. Fig. 12(D) shows an example in which the button 24 is moved to the start point 22A and a message is displayed stating "The slide operation was successful, but an error occurred during the operation process." Fig. 13 shows an example in which the button 24 is moved to the start point 22A and a message is displayed stating "The slide operation was successful, but an error occurred during the operation process."

[0065] At this time, if the operation control unit 14 detects, after starting execution of a specified process, by the error detection unit 18 that an error has occurred in the specified process, the operation control unit 14 may cause the notification unit 10I to sound an error sound and then move the button 24 to the starting point 22A.

[0066] Furthermore, the operation success sound, operation failure sound, and error sound may be any sound that the user can recognize as different. For example, each sound may have a different wavelength, volume, or duration.

[0067] In addition, when the error detection unit 18 detects that an error has occurred in the predetermined process while the operation control unit 14 is causing the notification unit 10I to notify the operation success sound, the operation control unit 14 causes the notification unit 10I to notify the operation success sound and the error sound separately (see FIG. 14(A) to FIG. 14(C)). For example, when the error detection unit 18 detects that an error has occurred in the predetermined process while the operation control unit 14 is causing the notification unit 10I to notify the operation success sound, the operation control unit 14 causes the notification unit 10I to notify the error sound after the notification of the operation success sound is completed. Alternatively, when the error detection unit 18 detects that an error has occurred in the predetermined process while the operation control unit 14 is causing the notification unit 10I to notify the operation success sound, the operation control unit 14 causes the notification unit 10I to notify the error sound after stopping the notification of the operation success sound. The operation success sound and the error sound may be notified in an overlapping manner, but by controlling as described above, it becomes easier for the user to recognize that an error has occurred as a result of performing the predetermined process.

[0068] Fig. 14(B) shows an example in which the button 24 has crossed the threshold point (dashed line) due to a movement operation of the button 24. Fig. 14(C) shows an example in which, after the button 24 is released, the button 24 is moved to the end point 22B, and then the notification unit 10I issues separate notification sounds indicating a successful operation and an error sound.

[0069] In response to the movement of the button 24, the process execution unit 16 executes a predetermined process corresponding to the button 24.

[0070] The error detection unit 18 detects the occurrence of an error in a predetermined process executed by the process execution unit 16. For example, the error detection unit 18 detects an out-of-paper error in a process for printing a document file, an image file, or the like, or an error in which the destination of another device is not set in a process for transmitting and receiving information between the image forming device 10 and the other device.

[0071] Next, a process performed in the image forming apparatus 10 according to the present embodiment configured as described above will be described. Fig. 15 is a flow chart showing an example of a specific process flow performed in the image forming apparatus 10 according to the present embodiment. The process in Fig. 15 starts when the image forming apparatus 10 is powered on.

[0072] In step S100, the reception unit 12 displays, on the display 10F, an instruction screen for instructing a predetermined process.

[0073] In step S102, the receiving unit 12 determines whether or not the receiving unit 12 has received a release after the operation of the button 24 in the user interface component 20 of the instruction screen. If the receiving unit 12 has received a release after the operation of the button 24 in the user interface component 20, the process proceeds to step S104.

[0074] In step S104, the operation control unit 14 controls the operation of the user interface component 20. Specifically, this is realized by the processing of Fig. 16. Fig. 16 is a flowchart showing an example of the flow of a specific process performed by the image forming apparatus 10 when accepting the release of the button 24 after it has been operated.

[0075] In step S120, the operation control unit 14 determines whether or not the button 24 is in a usable state. If the predetermined process corresponding to the button 24 is prohibited, the operation control unit 14 determines that the button 24 is not in a usable state, and proceeds to step S122. On the other hand, if the predetermined process corresponding to the button 24 is not prohibited, the operation control unit 14 determines that the button 24 is in a usable state, and proceeds to step S124.

[0076] In step S122, the operation control unit 14 controls the notification unit 10I to emit an operation failure sound. Then, in step S126, the operation control unit 14 determines not to execute a predetermined process corresponding to the button 24.

[0077] In step S124, the motion control unit 14 determines whether the release point, which is the position of the button 24 when it is released, has passed the threshold point. If the release point is before the threshold point, the process proceeds to step S128. On the other hand, if the release point has passed the threshold point, the process proceeds to step S132.

[0078] In step S128, it is determined whether or not the release point is the start point 22A. If the release point is the start point 22A, the process proceeds to step S126. On the other hand, if the release point is not the start point 22A, the process proceeds to step S130.

[0079] In step S130, the operation control unit 14 moves the button 24 to the starting point 22A, and then proceeds to step S126.

[0080] In step S132, the motion control unit 14 determines whether the release point is the end point 22B. If the release point is the end point 22B, the process proceeds to step S136. On the other hand, if the release point is not the end point 22B, the process proceeds to step S134.

[0081] In step S134, the operation control unit 14 moves the button 24 to the end point 22B, and proceeds to step S136.

[0082] In step S136, the operation control unit 14 controls the notification unit 10I to emit an operation success sound. Then, in step S138, the operation control unit 14 determines to execute a predetermined process corresponding to the button 24.

[0083] 15, the operation control unit 14 judges whether or not it was determined in step S104 that the predetermined process corresponding to the button 24 should be executed. If it is determined that the predetermined process corresponding to the button 24 should not be executed, the process ends. On the other hand, if it is determined that the predetermined process corresponding to the button 24 should be executed, the process proceeds to step S108.

[0084] In step S108, the process execution unit 16 executes a predetermined process in response to the movement of the button 24.

[0085] In step S110, the operation control unit 14 determines whether or not the error detection unit 18 has detected the occurrence of an error in a predetermined process executed by the process execution unit 16. If the error detection unit 18 has not detected the occurrence of the error, the process ends. On the other hand, if the error detection unit 18 has detected the occurrence of the error, the process proceeds to step S112.

[0086] In step S112, after starting execution of a specified process, if the error detection unit 18 detects that an error has occurred in the specified process, the operation control unit 14 causes the notification unit 10I to sound an error sound indicating that an error has occurred, and moves the button 24 to the starting point 22A, thereby terminating the process.

[0087] As described above, when button 24 is released after passing the threshold point due to a movement operation, button 24 is moved to end point 22B and then a sound indicating successful operation is sounded, making it easier for the user to recognize that a specified process corresponding to button 24 will be executed.

[0088] In the above embodiment, the case where a movement operation of sliding a button of a user interface component is accepted has been described as an example, but the present invention is not limited to this. A drag operation on a button of a user interface component may also be accepted as a movement operation.

[0089] Also, a notification may be given for each point of the button movement operation. Even for a user who is not good at sliding the button or who is visually impaired, the button movement operation can be assisted by notifying each point of the movement operation. For example, as shown in Fig. 17(A) and Fig. 17(B), a pressing sound may be given when the button 24 is pressed.

[0090] 18(A) and 18(B), when the button 24 crosses over from just before the threshold point to the other side by moving the button 24, a threshold reaching sound may be generated when the threshold point is crossed. Instead of generating a threshold reaching sound, the color of the button 24 may be changed or a message may be displayed.

[0091] 19(A) and 19(B), when the button 24 crosses over from the other side of the threshold point to the near side by moving the button 24, a threshold not reached sound may be issued at the point when the threshold point is crossed. Also, instead of issuing a threshold not reached sound, the color of the button 24 may be changed or a message may be displayed.

[0092] In addition, whether or not to notify each of the above-mentioned operation success sound, operation failure sound, error sound, threshold reached sound, and threshold not reached sound may be switched by a user's setting, or may be switched automatically. In the case of automatic switching, for example, when the number of erroneous operations of the button 24 exceeds a certain number, each of the operation success sound, operation failure sound, error sound, threshold reached sound, and threshold not reached sound related to the button 24 may be notified. In addition, each of the operation success sound, operation failure sound, error sound, threshold reached sound, and threshold not reached sound related to the button 24 may be notified in conjunction with a setting related to a predetermined operation. For example, when a setting is made to prevent erroneous facsimile transmission, each of the operation success sound, operation failure sound, error sound, threshold reached sound, and threshold not reached sound related to the button 24 that instructs facsimile transmission may be notified. In addition, for the button 24 which instructs a predetermined process with high security, a sound indicating a successful operation, a sound indicating a failed operation, an error sound, a sound indicating that a threshold has been reached, and a sound indicating that a threshold has not been reached may be issued. In addition, the manner in which the sound is issued may be changed by a user's setting.

[0093] Also, the case where the operation success sound is notified after the button 24 is moved to the end point 22B has been described as an example, but the present invention is not limited to this. The operation success sound may be notified at the timing when the button 24 is moved to just before the end point 22B. Also, the operation success sound at the end point 22B and the operation success sound just before the end point 22B may be different sounds. Also, the timing for notifying the operation success sound just before the end point 22B may be the timing of release, depending on the user's settings.

[0094] In addition, the operation control unit 14 may control so that, in the case where the button 24 is moved beyond a threshold point by a moving operation and then released just before the end point 22B, if the user performs a touch operation or a moving operation on the button 24 while the button 24 is being moved to the end point 22B, the movement of the button 24 is stopped and the notification of the operation success sound is stopped. Note that the target of the touch operation performed to stop the movement of the button 24 while the button 24 is being moved to the end point 22B does not have to be limited to the button 24. For example, it may include the base 22 or the text display unit 26. Alternatively, it may be the entire screen displayed on the display 10F. By targeting a wider area than only the button 24, the user can more reliably stop the movement of the button 24.

[0095] Furthermore, the operation control unit 14 may perform control so as to stop the notification of the operation success sound while the movement operation on the button 24 is being performed, even if the button 24 has moved to the end point 22B.

[0096] Although the example has been described in which the button 24 is moved in the X-axis direction, the present invention is not limited to this. The button 24 may be moved in an oblique direction inclined from the X-axis direction. Even in this case, the button 24 may be moved in the X-axis direction according to the X coordinate of the position where the user's finger is in contact with the display 10F.

[0097] Although the present invention has been described with reference to an image forming apparatus, the present invention is not limited thereto. The present invention may be applied to an information processing apparatus such as a smartphone or a computer. For example, the present invention may be applied to an operation in an application of a smartphone or a computer.

[0098] In addition, in the above embodiment, CPU10A has been described as an example of a processor, but the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0099] In addition, the operations of the processor in each of the above embodiments may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

[0100] The processes performed by the image forming apparatus 10 according to the above embodiment may be processes performed by software, hardware, or a combination of both. The processes performed by the image forming apparatus 10 may be stored as a program in a storage medium and distributed.

[0101] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0102] 10 Image forming device 10A CPU 10F Display 10H Output section 10I Notification Department 12 Reception 14 Motion control section 16 Processing Execution Unit 18 Error detection section 20, 20A User Interface Components 22 Pedestal 22A Start point 22B End point 24 Buttons 26 Text display section

Claims

1. A processor is provided. The processor, displaying an operation section on the display for receiving a user's drag or slide movement operation and instructing a predetermined process; When the user performs the moving operation on the operation unit, the operation unit is moved so as to follow the moving operation; When the operation unit is moved from one end of a movement area of ​​the operation unit to a position in front of the other end by the movement operation and then the movement operation is terminated, the operation unit is moved to the other end, and the operation unit is controlled so as to make a notification unit issue a sound indicating that the predetermined process will be executed after the operation unit moves to a position corresponding to the other end. An information processing device, The processor, When the operation unit is moved from the one end to a point between the one end and the other end beyond a predetermined threshold point by the movement operation, and then the movement operation is ended before the other end, moving the operation unit to the other end, and causing the notification unit to notify the user of a sound indicating that the predetermined process will be executed after the operation unit has moved to a position corresponding to the other end; When the moving operation is ended without passing the threshold point from the one end by the moving operation, The information processing device causes the operation unit to move to the one end portion, and causes the notification unit to emit a sound indicating that the predetermined process will not be executed after the operation unit has moved forward from the one end portion.

2. The processor, 2. An information processing device as described in claim 1, wherein if an error occurs in the specified processing after execution of the specified processing has begun, a sound indicating the occurrence of the error is made to be heard by the notification unit, and the operation unit is moved to the one end portion.

3. The processor, 3. The information processing device according to claim 2, wherein if an error occurs in the specified processing after execution of the specified processing has been started, the operation unit is moved to the one end after the notification unit issues a sound indicating that the error has occurred.

4. The processor, 3. The information processing device according to claim 2, wherein if the error occurs while the notification unit is notifying the user of a sound indicating that the specified processing is to be executed, the notification unit is caused to notify the user of the sound indicating that the specified processing is to be executed and the sound indicating that the error has occurred separately.

5. The processor, 5. An information processing device as described in claim 4, wherein if the error occurs while the notification unit is making an alert to sound that the specified processing is being executed, the notification unit is made to make an alert to sound that the error has occurred after making the alert to sound that the specified processing is being executed.

6. The processor, 5. An information processing device as described in claim 4, wherein if the error occurs while the notification unit is making a sound indicating that the specified processing is to be executed, the notification unit stops making a sound indicating that the specified processing is to be executed and then makes the notification unit make a sound indicating that the error has occurred.

7. The processor, An information processing device as described in any one of claims 1 to 6, wherein when the operation unit is moved from the one end to a position closer to the other end by the movement operation and then the movement operation is terminated, the operation unit is moved to the other end, and when a user operates the operation unit while the operation unit is being moved to the other end, the movement of the operation unit is stopped and the sound notification indicating that the specified processing will be executed is stopped.

8. The processor, The information processing apparatus according to claim 1 , wherein, when the operation portion passes over the threshold point due to the movement operation, the notification portion notifies the user that the operation portion has been moved beyond the threshold point.

9. The processor, An information processing device as described in claim 8, wherein when the operation unit moves beyond the threshold point by the movement operation of the user and then the operation unit moves back to a point just before the threshold point, the notification unit is caused to notify the user that the operation unit has moved back to a point just before the threshold point.

10. The processor, 10. The information processing apparatus according to claim 1, further comprising: a control unit that controls the notification of a sound indicating that the predetermined process is to be executed to stop when the moving operation on the operation unit is being performed.

11. The processor, The information processing device according to claim 10, wherein when the operation unit is moved to the other end by the moving operation and then the moving operation is ended, the notification unit is controlled to make a sound indicating that the specified processing will be executed after the moving operation is ended.

12. displaying an operation section on the display for receiving a user's drag or slide movement operation and instructing a predetermined process; When the user performs the moving operation on the operation unit, the operation unit is moved so as to follow the moving operation; When the operation unit is moved from one end of a movement area of ​​the operation unit to a position in front of the other end by the movement operation and then the movement operation is terminated, the operation unit is moved to the other end, and the operation unit is controlled so as to make a notification unit issue a sound indicating that the predetermined process will be executed after the operation unit moves to a position corresponding to the other end. An information processing program for causing a computer to execute the following: When the operation unit is moved from the one end to a point between the one end and the other end beyond a predetermined threshold point by the movement operation, and then the movement operation is ended before the other end, moving the operation unit to the other end, and causing the notification unit to notify the user of a sound indicating that the predetermined process will be executed after the operation unit has moved to a position corresponding to the other end; When the moving operation is ended without passing the threshold point from the one end by the moving operation, an information processing program that causes the operation unit to move to the one end portion and the notification unit to emit a sound indicating that the predetermined process will not be executed after the operation unit has moved forward from the one end portion;

Citation Information

Patent Citations

  • Program and information processing apparatus

    JP2009230391A

  • Input device, control method of input device, program, and storage medium

    JP2011134212A

  • User interface device emulating parameter setting part, display method for parameter setting, and program

    JP2015215926A

  • Program, control method, and information processing device

    JP2018057801A

  • Device for providing palpating feedback, method and graphical user interface

    JP2019164819A