Information processing system and program
The system enhances non-contact operation detection on touch panels by setting operation areas and enlarging operators based on specific conditions, ensuring accurate and user-friendly interaction for both experienced and inexperienced users.
Patent Information
- Application Number
- JP2023076159
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-02
- Publication Date
- 2024-11-15
AI Technical Summary
Existing information processing systems fail to accurately detect and respond to non-contact operations on touch panels, leading to unintended or erroneous actions, particularly for users unfamiliar with such interactions.
The system includes a processor that sets operation detection areas for each operator on a display screen, detecting indicators close to the screen without contact, and enlarges the operator on the screen only when specific conditions are met, such as repeated entry into the detection area or proximity to adjacent operators.
This approach allows for accurate detection and display of intended operations without constant enlargement, reducing user confusion and improving usability for those unaccustomed to non-contact interactions.
Smart Images

Figure 2024160793000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing system and a program. [Background technology]
[0002] Patent document 1 discloses a coordinate detection method in which, when accepting an operation at a position away from the touch panel, the effective area for validating two-dimensional coordinates for detecting a finger as a pointer becomes narrower as the vertical distance between the finger and the touch panel increases, thereby preventing unintended operation by the user.
[0003] Patent Document 2 discloses a user interface device that, when a proximity operation is detected to point to an object among objects that can be selected by bringing a finger close to a display surface without touching it, prevents erroneous operation by the user by enlarging and displaying the object if the size of the object is less than a threshold value. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 5542224 [Patent Document 2] Patent No. 5972692 Summary of the Invention [Problem to be solved by the invention]
[0005] The object of the present invention is to provide an information processing system and program that, when accepting non-contact operations on an operator by detecting an indicator that has entered an operation detection area set for each operator, can enlarge the operator for users who are unfamiliar with non-contact operations without always enlarging the operator whose indicator has entered the operation detection area. [Means for solving the problem]
[0006] The information processing system of the first aspect includes a processor, wherein an operation detection area for detecting an operation on an operator displayed on a display screen having a stacked operation surface is set for each of the plurality of operators, and when the processor detects an indicator close to the display screen and receives a non-contact operation performed on the operator displayed on the display screen while the indicator is not in contact with the operation surface, When the coordinates of a detected pointer enter within an operation detection area of a certain one of a plurality of operators displayed on the display screen a set number of times or more within a preset time period, the certain one is enlarged and displayed on the display screen.
[0007] In a second aspect of the information processing system, in the information processing system of the first aspect, the processor sets a predetermined area wider than the operation detection area, and when the coordinates of a detected indicator within the predetermined area enter the operation detection area set for a certain operator a set number of times or more within a preset time period, the processor causes the operator to be enlarged and displayed on the display screen.
[0008] In a third aspect of the information processing system, in the information processing system of the first aspect, the processor increases the number of times the operator is enlarged when the user performs an operation that is determined to not require an enlarged display of the operator.
[0009] In a fourth aspect of the information processing system, in the information processing system of the third aspect, when an operation to select and confirm a certain operator is performed without enlarging the operator, the processor increases the number of times for enlarging the operator.
[0010] An information processing system of a fifth aspect is the information processing system of the third aspect, wherein the processor increases the number of times an operator is enlarged when no operation is performed to confirm the selection of the operator after the operator is enlarged.
[0011] In a sixth aspect of the information processing system, in the information processing system of the fifth aspect, even if an operation to confirm the selection of a certain operator is not performed after the operator is enlarged, if the area of the operator is equal to or smaller than a preset value or the distance between the operator and an adjacent operator is equal to or smaller than a preset value, the processor does not increase the number of times to enlarge the operator.
[0012] In a seventh aspect of the information processing system, in the information processing system of the first aspect, when the coordinates of a detected indicator enter within an operation detection area of a certain operator a set number of times or more within a preset time period, the processor enlarges and displays multiple operators including the certain operator on the display screen.
[0013] An information processing system of an eighth aspect is the information processing system of the seventh aspect, wherein the processor, when the coordinates of a detected indicator enter within an operation detection area of a plurality of operators a set number of times or more within a preset time period, enlarges and displays the plurality of operators on the display screen.
[0014] In a ninth aspect of the information processing system, in the information processing system of the seventh aspect, when the coordinates of a detected indicator enter within the operation detection area of a certain operator a set number of times or more within a preset time period, the processor enlarges and displays a number of operators that are arranged in close proximity to the certain operator on the display screen.
[0015] A tenth aspect of the program includes a step of: setting an operation detection area for detecting an operation on an operator displayed on a display screen having a stacked operation surface for each of the plurality of operators; detecting an indicator close to the display screen, and accepting a non-contact operation performed on the operator displayed on the display screen while the indicator is not in contact with the operation surface; The computer is caused to execute a step of enlarging and displaying an operator on the display screen when the coordinates of a detected indicator enter within an operation detection area of an operator among a plurality of operators displayed on the display screen a set number of times or more within a preset time period. Effect of the Invention
[0016] According to the first aspect of the information processing system, when accepting contactless operations for an operator by detecting an indicator that has entered an operation detection area set for each operator, it is possible to enlarge the operator for a user who is unfamiliar with contactless operations and who may cause the indicator to enter and leave the operation detection area multiple times, without always enlarging the operator when the indicator has entered the operation detection area.
[0017] According to the information processing system of the second aspect, when the user intentionally moves the indicator into or out of the operation detection area, it is possible to prevent the operation button from being enlarged.
[0018] According to the information processing system of the third aspect, it is possible to prevent the enlarged display of the operators from being displayed for a user who does not need the enlarged display of the operators.
[0019] According to the information processing system of the fourth aspect, it is possible to prevent the enlarged display of the operators from being displayed for a user who does not need the enlarged display of the operators.
[0020] According to the information processing system of the fifth aspect, it is possible to prevent the display of enlarged controls from being displayed for a user who does not need the enlarged display of controls.
[0021] According to the information processing system of the sixth aspect, even in cases where an enlarged display of an operator is required, it is possible to prevent a situation in which it becomes difficult to enlarge the display of an operator in subsequent operations.
[0022] According to the information processing system of the seventh aspect, even if the indicator enters the operation detection area of another operator adjacent to the operator that the user is attempting to operate, the operator that the user is attempting to operate can be enlarged and displayed.
[0023] According to the information processing system of the eighth aspect, even if the indicator enters the operation detection area of another operator adjacent to the operator that the user is attempting to operate, the operator that the user is attempting to operate can be enlarged and displayed.
[0024] According to the information processing system of the ninth aspect, even if the indicator enters the operation detection area of another operator adjacent to the operator that the user is attempting to operate, the operator that the user is attempting to operate can be enlarged and displayed.
[0025] According to the program of the tenth aspect, when accepting a non-contact operation for an operator by detecting an indicator that has entered an operation detection area set for each operator, it is possible to enlarge the operator for a user who is unfamiliar with non-contact operations and who tends to move the indicator in and out of the operation detection area multiple times, without always enlarging the operator whose indicator has entered the operation detection area. [Brief description of the drawings]
[0026] [Figure 1] 1 is a diagram illustrating a system configuration of an image forming system according to an embodiment of the present disclosure. [Diagram 2] 11 is a diagram showing how a non-contact operation is accepted on a touch panel 40. FIG. [Diagram 3] 1 is a diagram showing an example of an operation detection area 60 set in the operation button 50. FIG. [Figure 4] 13 is a diagram for explaining how an operation on a certain operation button 50 is confirmed when a finger or the like remains within an operation detection area 60 set for that operation button 50 for a predetermined period of time or longer. [Diagram 5] 1 is a block diagram showing a hardware configuration of an image forming apparatus 10 according to an embodiment of the present disclosure. [Figure 6]1 is a block diagram showing a functional configuration of an image forming apparatus 10 according to an embodiment of the present disclosure. [Figure 7] 5 is a flowchart for explaining a detection operation of a non-contact operation on a touch panel 40 of an image forming apparatus 10 according to an embodiment of the present disclosure. [Figure 8] 13 is a diagram showing how a user's finger enters and leaves an operation detection area 60 a predetermined number of times. [Figure 9] 11 is a diagram showing a state in which an operation button 50 is displayed enlarged on a touch panel 40. FIG. [Figure 10] 13 is a diagram showing how an enlarged display of an operation button 50 is confirmed. FIG. [Figure 11] 13 is a diagram showing how a predetermined area 41, which is wider than an operation detection area 60, is set around an operation button 50 in the first modification. FIG. [Figure 12] 11 is a flowchart for explaining a detection operation of a non-contact operation on a touch panel 40 of an image forming apparatus 10 according to a first modified example of an embodiment of the present disclosure. [Figure 13] 13 is a diagram for explaining a state in which the user's finger goes beyond the predetermined area 41 and enters and leaves the operation detection area 60 of the operation button 50 a predetermined number of times. [Figure 14] 13 is a diagram for explaining a state in which a user's finger enters and leaves an operation detection area 60 of an operation button 50 within a predetermined area 41 a predetermined number of times. [Figure 15] 11 is a flowchart for explaining a detection operation of a non-contact operation on a touch panel 40 of an image forming apparatus 10 in a second modified example of an embodiment of the present disclosure. [Figure 16] FIG. 13 is a diagram for explaining a specific operation example when the predetermined number of times for enlarging and displaying the operation button 50 is increased from once to twice in the second modified example of the embodiment of the present disclosure. [Figure 17] FIG. 13 is a diagram for explaining another specific operation example in which the predetermined number of times for enlarging and displaying the operation button 50 is increased from once to twice in the second modification of the embodiment of the present disclosure. [Figure 18]13 is a flowchart for explaining a detection operation of a non-contact operation on a touch panel 40 of an image forming apparatus 10 in a third modified example of an embodiment of the present disclosure. [Figure 19] FIG. 11 is a diagram for explaining a state in which the operation button 50 is not enlarged even when a finger repeatedly enters and leaves the operation detection area 60, due to the large size of the operation button 50, in a third modified example of the embodiment of the present disclosure. [Figure 20] 13 is a flowchart for explaining a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 4 of the present embodiment. [Figure 21] 13 is a diagram showing how, when many operation buttons 50 are arranged on the display screen of a touch panel 40, a finger is inserted and removed from operation detection areas 60 of the operation buttons 50 a predetermined number of times or more. [Figure 22] 13 is a diagram showing two operation buttons 50, one labeled "G" and the other labeled "H," being simultaneously displayed in an enlarged manner. [Figure 23] 13 is a flowchart for explaining a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 5 of the present embodiment. [Figure 24] FIG. 24(A) is a diagram for explaining how a predetermined area 42 is set around each of a plurality of operation buttons 50, and FIG. 24(B) is a diagram showing operation buttons 50 (R, T, Y, F, H, V, B, N) whose predetermined areas 42 overlap with a certain operation button 50 (G). [Diagram 25] 13 is a diagram showing a case where the user's finger enters and leaves the operation detection area 60 of the operation button 50 marked with "G" a predetermined number of times. [Figure 26] This figure shows an enlarged view of not only the operation button 50 marked "G," but also eight operation buttons 50 marked "R, T, Y, F, H, V, B, N" that are located in close proximity to the operation button 50 marked "G." DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0027] Next, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0028] FIG. 1 is a diagram showing a system configuration of an image forming system according to an embodiment of the present disclosure.
[0029] 1, an image forming system according to an embodiment of the present disclosure is an information processing system including an image forming apparatus 10 and a terminal apparatus 20 connected to each other via a network 30. The terminal apparatus 20 generates print data and transmits the generated print data to the image forming apparatus 10 via the network 30. The image forming apparatus 10 receives the print data transmitted from the terminal apparatus 20 and outputs an image on paper according to the print data. The image forming apparatus 10 is an information processing apparatus having multiple functions such as a print function, a scan function, a copy function, and a facsimile function, and is called a multifunction device.
[0030] The image forming apparatus 10 is provided with a touch panel 40 at the upper part of the front surface for displaying various information to the user and accepting operations from the user.
[0031] The touch panel 40 has a display screen with a laminated operation surface. On the display screen, operators such as operation buttons for receiving operations from a user are displayed. On the touch panel 40, an operation detection area for detecting an operation on the operation button displayed on the display screen is set for each of the multiple operation buttons. A general touch panel detects that a pointing object such as a finger has come into contact with the operation detection area, and detects which operation button the user has operated.
[0032] In the image forming device 10 of this embodiment, in addition to such contact operations on the touch panel 40, by detecting an indicator such as a finger approaching the display screen of the touch panel 40, it is possible to accept non-touch operations performed on operation buttons displayed on the display screen when the indicator is not in contact with the operation surface.
[0033] Fig. 2 shows how such a touch panel 40 accepts a non-contact operation. Referring to Fig. 2, there is shown how a user's finger present at a height distance h from an operation button 50 displayed on the surface of the touch panel 40 is detected. Fig. 3 shows an example of an operation detection area 60 set in this operation button 50. As shown in Fig. 3, an area capable of detecting a pointing body such as a finger is set as the operation detection area 60 above the operation button 50, and when a finger or the like entering this operation detection area 60 is detected, it means that the operation button 50 has been operated.
[0034] Then, when a finger or the like remains for a predetermined period of time or more within the operation detection area 60 set for a certain operation button 50, the operation of that operation button 50 is confirmed. For example, as shown in Fig. 4, when a finger remains for, for example, two seconds or more within the operation detection area 60 of the operation button 50 displaying "1," the selection of that operation button 50 is confirmed.
[0035] In the case where such non-contact operations are accepted, when a pointing object such as a finger enters an operation detection area set for each operation button, the operation button may be enlarged to prevent erroneous operation. However, for users who are accustomed to non-contact operations, it is annoying to have the operation button always enlarged just because a finger enters the operation detection area.
[0036] Therefore, in the image forming apparatus 10 of this embodiment, the control described below is performed so that when a pointer such as a finger enters an operation detection area set for each operation button and a non-contact operation is accepted for the operation button, the operation button with the pointer entering the operation detection area is not always enlarged, but is only enlarged for users who are unfamiliar with non-contact operations.
[0037] Next, the hardware configuration of the image forming apparatus 10 in the image forming system of this embodiment is shown in FIG.
[0038] 5, the image forming apparatus 10 has a CPU 11, a memory 12, a storage device 13 such as a hard disk drive, a communication interface (abbreviated as IF) 14 for transmitting and receiving data to and from external devices via a network 30, a user interface (abbreviated as UI) device 15 configured by a touch panel having a proximity sensor 19, a scan unit 16, and an image forming unit 17. These components are connected to each other via a control bus 18.
[0039] The image forming unit 17 prints an image on a recording medium such as printing paper through processes such as charging, exposure, development, transfer, and fixing.
[0040] Also, the proximity sensor 19 detects the coordinates of a pointer, such as a finger, approaching the operation surface, for example, by a capacitance method. However, the detection method of the proximity sensor 19 is not limited to the capacitance method, and may be a method of irradiating the pointer with measurement light, such as infrared light or laser light, and detecting the reflected light, or a method of detecting the approach of the pointer to the operation button from an image captured by a camera or the like.
[0041] The indicator for operating the touch panel 40 is not limited to the user's hand or finger, and may be anything, such as a stylus pen, that can operate the touch panel 40. However, in the following description, the indicator will be described as being the user's finger.
[0042] The CPU 11 is a processor that executes a predetermined process based on a control program stored in the memory 12 or the storage device 13 to control the operation of the image forming apparatus 10. In the present embodiment, the CPU 11 is described as reading and executing the control program stored in the memory 12 or the storage device 13, but is not limited to this. The control program may be provided in a form recorded on a computer-readable recording medium. For example, the program may be provided in a form recorded on an optical disc such as a CD (Compact Disc)-ROM or a DVD (Digital Versatile Disc)-ROM, or in a form recorded on a semiconductor memory such as a USB (Universal Serial Bus) memory or a memory card. The control program may also be obtained from an external device via a communication line connected to the communication interface 14.
[0043] FIG. 6 is a block diagram showing the functional configuration of the image forming apparatus 10 realized by executing the above control program.
[0044] As shown in FIG. 6, the image forming apparatus 10 of this embodiment includes an operation detection unit 32, a display unit 33, a data transmission / reception unit 34, a control unit 35, an image reading unit 36, a data storage unit 37, and an image output unit 38.
[0045] The data transmission / reception unit 34 transmits and receives data to and from external devices such as the terminal device 20. The control unit 35 generates print data based on a print job received from the terminal device 20 via the data transmission / reception unit 34, and controls output of the generated print data from the image output unit 38. The data storage unit 37 stores various data such as the print data generated by the control unit 35.
[0046] The image output unit 38 outputs an image onto a recording medium such as printing paper under the control of the control unit 35. The image reading unit 36 reads an original image from a set original under the control of the control unit 35.
[0047] The display unit 33 is controlled by the control unit 35 and displays various information to the user. The operation detection unit 32 detects various operations performed by the user on the display unit 33. The display unit 33 and the operation detection unit 32 form a touch panel 40.
[0048] When the control unit 35 receives a non-contact operation performed on an operation button displayed on the display screen of the touch panel 40, if the operation detection unit 32 detects that the coordinates of a detected indicator such as a finger have entered within the operation detection area of a certain operation button among the multiple operation buttons displayed on the display screen a set number of times or more within a preset time period, the control unit 35 causes the operation button to be enlarged on the display screen displayed on the display unit 33.
[0049] Here, it is considered that a user who is not familiar with non-contact operation often performs an operation in which the finger enters and leaves the operation detection area many times. Therefore, in this embodiment, when the coordinates of the finger enter and leave the operation detection area set for the operation button many times, the control unit 35 determines that the user is not familiar with non-contact operation and enlarges and displays the operation button on the operation screen.
[0050] Next, a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in this embodiment will be described with reference to the flowchart of FIG.
[0051] First, the control unit 35 determines whether the operation detection unit 32 has detected a user's finger within the operation detection area 60 in step S101.
[0052] Then, in step S101, if the operation detection unit 32 determines that a finger has been detected in the operation detection area 60, the control unit 35 determines in step S102 whether the finger has entered and exited the operation detection area 60 a predetermined number of times.
[0053] Here, Fig. 8 shows how the user's finger enters and exits the operation detection area 60 a predetermined number of times. Fig. 8 shows how the user's finger enters the operation detection area 60 set for the operation button 50, goes out, and then enters again.
[0054] Then, in step S102, if it is determined that the finger has entered and exited the operation detection area 60 a predetermined number of times, the control unit 35, in step S103, enlarges and displays on the touch panel 40 the operation button 50 corresponding to the operation detection area 60 through which the finger has entered and exited the predetermined number of times.
[0055] Fig. 9 shows the operation button 50 thus enlarged and displayed on the touch panel 40. Fig. 9 shows the operation button 50 with the character "1" affixed thereto being enlarged and displayed.
[0056] Then, after the operation button 50 is enlarged and displayed, the control unit 35 determines in step S104 whether or not the finger has moved out of the operation detection area 60 of the enlarged operation button 50.
[0057] Then, if it is determined in step S104 that the finger has moved out of the operation detection area 60 of the enlarged operation button 50, the control unit 35 cancels the enlarged display of the operation button 50 and returns the operation button 50 to its normal size in step S105.
[0058] In addition, if it is determined in step S104 that the finger has not left the operation detection area 60 of the enlarged operation button 50, the control unit 35 determines in step S108 whether or not the finger has remained within the operation detection area 60 of the enlarged operation button 50 for longer than the selection confirmation time, for example, longer than two seconds.
[0059] Then, if it is determined in step S108 that the finger has remained within the operation detection area 60 of the enlarged operation button 50 for the selection confirmation time or longer, the control unit 35 executes a process of confirming the operation button 50 in step S109.
[0060] In this manner, the manner in which the enlarged operation button 50 is confirmed is shown in Fig. 10. Fig. 10 shows the manner in which the operation button 50 with the character "1" added thereto is confirmed in an enlarged state.
[0061] If it is determined in step S108 that the finger has not remained within the operation detection area 60 of the enlarged operation button 50 for the selection confirmation time or longer, the control unit 35 returns to the process of step S104.
[0062] Furthermore, if it is determined in step S102 that the user's finger has not entered and left the operation detection area 60 a predetermined number of times, the control unit 35 determines in step S106 whether the finger has remained in the operation detection area 60 of the operation button 50 for longer than the selection confirmation time, for example, longer than two seconds.
[0063] Then, if it is determined in step S106 that the finger has remained within the operation detection area 60 of the operation button 50 for the selection confirmation time or longer, the control unit 35 executes a process of confirming the operation button 50 in step S107.
[0064] If it is determined in step S106 that the finger has not remained within the operation detection area 60 of the operation button 50 for the selection confirmation time or longer, the control unit 35 returns to the process of step S102.
[0065] By carrying out the above-mentioned processing, for a user who is accustomed to non-contact operation, control is performed to confirm the operation button 50 without enlarging the display of the operation button 50. For a user who is not accustomed to non-contact operation, control is performed to confirm the operation button 50 after enlarging the display of the operation button 50.
[0066] [Variation 1] In the embodiment described above, the operation button 50 is enlarged when the user's finger enters and leaves the operation detection area 60 of the operation button 50 a predetermined number of times. However, even if the user does not intend to enlarge the operation button 50, the operation button 50 may be enlarged simply by the user's finger entering and leaving the operation detection area 60 of the operation button 50 a predetermined number of times. For example, even in a normal finger movement such as when the user is unsure which operation button 50 to operate and moves between the operation detection areas 60 of multiple operation buttons 50, the operation button 50 may be unintentionally enlarged.
[0067] Therefore, in the first modified example of this embodiment, the control unit 35 sets a predetermined area wider than the operation detection area 60 around the operation button 50, and when the coordinates of a detected finger within this predetermined area enter the operation detection area 60 set for a certain operation button 50 a set number of times or more within a preset time period, the control unit 35 causes the operation button 50 to be enlarged and displayed on the display screen of the touch panel 40.
[0068] For example, the control unit 35 sets a predetermined area 41 around the operation button 50, the predetermined area 41 being larger than the operation detection area 60, as shown in FIG.
[0069] Next, a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 1 of the present embodiment will be described with reference to the flowchart of FIG.
[0070] The flowchart in Fig. 12 is the same as the flowchart in Fig. 7 except that the process of step S102 is replaced with the process of step S102A. Therefore, the description of the processes other than step S102A in the flowchart in Fig. 12 will be omitted.
[0071] In this variant example 1, if the operation detection unit 32 determines in step S101 that it has detected a finger within the operation detection area 60, the control unit 35 determines in step S102A whether the finger has entered and exited the operation detection area 60 within the specified area 41 a specified number of times.
[0072] Then, in step S102A, if it is determined that the finger has entered and exited the operation detection area 60 within the specified area 41 a predetermined number of times, the control unit 35, in step S103, enlarges and displays on the touch panel 40 the operation button 50 corresponding to the operation detection area 60 through which the finger has entered and exited the predetermined number of times.
[0073] That is, in the first modification, as shown in FIG. 13, when the user's finger goes beyond the predetermined area 41 and enters and leaves the operation detection area 60 of the operation button 50 a predetermined number of times, the enlarged display of the operation button 50 is not performed.
[0074] In the first modification, as shown in FIG. 14, when the user's finger enters and leaves the operation detection area 60 of the operation button 50 within the predetermined area 41 a predetermined number of times, the operation button 50 is displayed in an enlarged scale.
[0075] The reason for providing the predetermined area 41 and making the judgment in this manner is that, even if a user is trying to operate a certain operation button 50 and tries to keep their finger within the operation detection area 60 of that operation button 50, but their finger moves because they are unfamiliar with non-contact operation, it is considered that the user's finger will not move significantly outside the operation detection area 60. Conversely, if the user's finger moves significantly outside the operation detection area 60 of a certain operation button 50, it is considered that the user is not trying to operate that operation button 50, even if, for example, the user's finger moves back into the operation detection area 60 of that operation button 50.
[0076] [Variation 2] Next, a second modified example of the present embodiment will be described, in which the operation button 50 is made less likely to be enlarged by normal movement of the user's finger.
[0077] In the second variant of this embodiment, when the user performs an operation that is determined to not require an enlarged display of the operation button 50, the control unit 35 increases the number of times to enlarge the operation button 50.
[0078] Specifically, when an operation to select and confirm a certain operation button 50 is performed without enlarging the display of that operation button 50, the control unit 35 determines that the user is accustomed to touch operations and does not require the enlarged display of the operation button 50, and increases the number of times to enlarge the display of the operation button 50.
[0079] Furthermore, if an operation to confirm the selection of a certain operation button 50 is not performed after the enlarged display of the operation button 50, the control unit 35 determines that the user did not need the enlarged display of the operation button 50, and increases the number of times to enlarge the display of the operation button 50.
[0080] In the following explanation, as an example of increasing the number of times to enlarge the operation button 50, a case will be explained in which the operation button 50 is enlarged when the operation button 50 is entered and exited from the operation detection area 60 once, but is enlarged when the operation button 50 is entered and exited from the operation detection area 60 twice.
[0081] It should be noted that, after a certain operation button 50 is enlarged and then an operation for confirming the selection of that operation button 50 is performed, the control unit 35 resets the number of times for enlarging and displaying the operation button 50 to the original initial value.
[0082] Next, a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 2 of the present embodiment will be described with reference to the flowchart of FIG.
[0083] The flowchart in Fig. 15 is the same as the flowchart in Fig. 7 except that steps S201 to S203 have been added, so a description of the processes other than steps S201 to S203 in the flowchart in Fig. 15 will be omitted.
[0084] In this variant example 2, if it is determined in step S104 that the finger has moved outside the operation detection area 60 of the enlarged operation button 50, the control unit 35 increases the specified number of times for enlarging the display of the operation button 50 in step S201, and then cancels the enlarged display of the operation button 50 and returns the operation button 50 to its normal size in step S105.
[0085] 16, if the operation button 50 is enlarged as a result of a finger being inserted or removed once in the operation detection area 60 of the operation button 50, but the enlarged display is cancelled as the finger leaves the operation detection area 60 of the operation button 50, the predetermined number of times is increased from one to two. As a result, from that point on, the operation button 50 is enlarged only when the finger is inserted or removed two or more times in the operation detection area 60 of the operation button 50. In other words, it becomes more difficult to enlarge the operation button 50 than if the predetermined number of times is not increased.
[0086] In addition, in this variant example 2, the control unit 35 executes a process of confirming the operation button 50 that was not enlarged in step S107, and then, in step S202, increases the specified number of times for enlarging and displaying the operation button 50.
[0087] 17, when a process of confirming the operation button 50 is performed without enlarging the operation button 50, the predetermined number of times is increased from 1 to 2. As a result, from then on, the enlarged display of the operation button 50 is performed only when a finger is inserted or removed from the operation detection area 60 of the operation button 50 two or more times. In other words, it becomes more difficult to enlarge the display of the operation button 50 than when the predetermined number of times is not increased.
[0088] Furthermore, in this variant example 2, the control unit 35 executes a process of confirming the enlarged display of the operation button 50 in step S109, and then executes a process of resetting the predetermined number of times for enlarging and displaying the operation button 50 to the initial value in step S203.
[0089] In addition, if the area of the operation button 50 is narrow and small, or if the distance between adjacent operation buttons 50 is short, it is considered that if it is difficult to enlarge the operation button 50, it may become difficult for the user to operate it.
[0090] Therefore, even if an operation to confirm the selection of a certain operation button 50 is not performed after the enlarged display of the operation button 50, if the area of the operation button 50 is equal to or smaller than a preset value, or if the distance between the certain operation button 50 and another adjacent operation button 50 is equal to or smaller than a preset value, the control unit 35 may not increase the number of times to enlarge the display of the operation button 50.
[0091] [Variation 3] Next, a third modified example of the present embodiment will be described, in which the operation button 50 is not enlarged when the user moves the finger in a normal manner.
[0092] In the embodiment described above, the operation button 50 is enlarged when the user's finger enters and leaves the operation detection area 60 of the operation button 50 a predetermined number of times. However, in a case where only a few large operation buttons 50 with wide areas are arranged on the display screen of the touch panel 40, it is considered that there is no need to further enlarge the operation buttons 50.
[0093] Therefore, in the third variant of this embodiment, when the area of the operation buttons 50 displayed on the touch panel 40 is equal to or larger than a preset value, it is determined that the screen does not require enlarged display, and the operation buttons 50 are not enlarged no matter how many times the finger enters and leaves the operation detection area 60.
[0094] The operation of detecting a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 3 of the present embodiment will be described with reference to the flowchart of FIG.
[0095] The flowchart in Fig. 18 is the same as the flowchart in Fig. 7 except that step S301 is added between step S101 and step S102. Therefore, the description of the processes other than step S301 in the flowchart in Fig. 18 will be omitted.
[0096] In this third modification, when it is determined in step S101 that the operation detection unit 32 has detected a finger within the operation detection area 60, the control unit 35 determines in step S301 whether or not the display screen is a screen that requires enlarged display of the operation buttons 50. For example, when the sizes of all the operation buttons 50 on the display screen are equal to or larger than a certain value, the control unit 35 determines that the screen does not require enlarged display.
[0097] Then, in step S301, if it is determined that the display screen does not require enlarged display of the operation buttons 50, the control unit 35 does not proceed to the determination process of step S102, but proceeds to the determination process of step S106.
[0098] Furthermore, in step S301, if it is determined that the display screen is a screen requiring enlarged display of the operation buttons 50, the control unit 35 proceeds to the determination process of step S102.
[0099] By performing this type of control, as shown in FIG. 19, even if a finger repeatedly enters and leaves the operation detection area 60 of an operation button 50 displayed on the display screen of the touch panel 40, if the operation button 50 is large, the operation button 50 is not enlarged.
[0100] [Variation 4] In the embodiment described above, the operation button 50 is enlarged when the user's finger enters and leaves the operation detection area 60 of the operation button 50 a predetermined number of times. However, when the size of the operation button 50 is very small and the distance between adjacent operation buttons 50 is short, that is, when multiple operation buttons 50 are arranged closely together, even if one operation button 50 is enlarged, it is possible that the operation button 50 is not the one intended by the user.
[0101] Therefore, in the fourth variant of this embodiment, when the coordinates of the detected finger enter within the operation detection area 60 of the multiple operation buttons 50 a set number of times or more within a preset time period, the control unit 35 enlarges and displays the multiple operation buttons 50 on the display screen of the touch panel 40.
[0102] Next, a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 4 of the present embodiment will be described with reference to the flowchart of FIG.
[0103] The flowchart in Fig. 20 is the same as the flowchart in Fig. 7 except that the processes of steps S102 and S103 are replaced with the processes of steps S102B and S103B, respectively. Therefore, the description of the processes other than steps S102B and S103B in the flowchart in Fig. 20 will be omitted.
[0104] In this fourth variant, if the operation detection unit 32 determines in step S101 that a finger has been detected within the operation detection area 60, the control unit 35 determines in step S102B whether the finger has entered and exited multiple operation detection areas 60 a predetermined number of times.
[0105] Then, in step S102B, if it is determined that the finger has entered and exited multiple operation detection areas 60 a predetermined number of times, in step S103B, the control unit 35 enlarges and displays on the touch panel 40 multiple operation buttons 50 corresponding to the multiple operation detection areas 60 through which the finger has entered and exited the predetermined number of times.
[0106] For example, a case will be described in which many operation buttons 50 are arranged on the display screen of the touch panel 40 as shown in Fig. 21. In this state, it is assumed that the user moves his / her finger in and out of both the operation detection area 60 of the operation button 50 marked with "G" and the operation detection area 60 of the operation button 50 marked with "H" a predetermined number of times or more. Then, as shown in Fig. 22, the two operation buttons 50 marked with "G" and the operation button 50 marked with "H" are simultaneously enlarged and displayed.
[0107] By performing such control, the operation button 50 that the user is attempting to operate is enlarged and displayed, regardless of whether the operation button 50 is the operation button 50 displayed as "G" or the operation button 50 displayed as "H."
[0108] [Variation 5] In the fourth modified example of the embodiment described above, when a finger moves in and out of the operation detection area 60 of the multiple operation buttons 50, the multiple operation buttons 50 are enlarged and displayed. However, when the operation buttons 50 are small, even if a finger moves in and out of the operation detection area 60 of one operation button 50, it is possible that the user actually intended to operate another operation button 50 adjacent to that operation button 50.
[0109] Therefore, in variant example 5 of this embodiment, when the coordinates of the detected finger enter within the operation detection area 60 of a certain operation button 50 a set number of times or more within a preset time period, the control unit 35 enlarges and displays multiple operation buttons 50 including that operation button 50 on the display screen of the touch panel 40.
[0110] Specifically, when the coordinates of the detected finger enter within the operation detection area 60 of a certain operation button 50 a set number of times or more within a preset time period, the control unit 35 enlarges and displays multiple operation buttons 50 arranged in close proximity to that operation button 50 on the display screen of the touch panel 40.
[0111] Next, a detection operation of a non-contact operation on touch panel 40 of image forming apparatus 10 in Modification 5 of the present embodiment will be described with reference to a flowchart of FIG.
[0112] The flowchart in Fig. 23 is the same as the flowchart in Fig. 7 except that step S501 is added between step S103 and step S104, so the description of the processes other than step S501 in the flowchart in Fig. 23 will be omitted.
[0113] In variant example 5 of this embodiment, if it is determined in step S102 that the user's finger has entered and exited the operation detection area 60 a predetermined number of times, the control unit 35, in step S103, enlarges and displays on the touch panel 40 the operation button 50 corresponding to the operation detection area 60 through which the finger has entered and exited the predetermined number of times.
[0114] In the fifth modified example of this embodiment, as shown in Fig. 24(A), a predetermined area 42 is set around each of the multiple operation buttons 50. The control unit 35 then determines that the operation buttons 50 whose predetermined areas 42 overlap are adjacent to each other. Specifically, as shown in Fig. 24(B), the control unit 35 determines that the operation buttons 50 (R, T, Y, F, H, V, B, N) whose predetermined areas 42 overlap with a certain operation button 50(G) are the operation buttons 50 arranged adjacent to the operation button 50(G).
[0115] When the control unit 35 enlarges and displays a certain operation button 50 in step S103, the control unit 35 also enlarges and displays adjacent operation buttons 50 whose predetermined areas 42 overlap with the enlarged operation button 50 in step S501.
[0116] For example, a case will be described where the user's finger enters and leaves the operation detection area 60 of the operation button 50 marked with "G" a predetermined number of times as shown in Fig. 25. When an operation as shown in Fig. 25 is performed, in Modification 5 of this embodiment, as shown in Fig. 26, not only the operation button 50 marked with "G", but also the eight operation buttons 50 marked with "R, T, Y, F, H, V, B, N" that are arranged in close proximity to the operation button 50 marked with "G" are enlarged and displayed.
[0117] By performing such control, even if the operation button that the user wanted to operate is actually the operation button 50 displayed as "F," the operation button that the user wanted to operate is enlarged and displayed.
[0118] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, including general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).
[0119] In addition, the operations of the processor in each of the above embodiments may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate.
[0120] In this embodiment, the term "system" includes both a system made up of multiple devices and a system made up of a single device.
[0121] [Variations] In the above embodiment, a case has been described in which non-contact operations are accepted on a touch panel of an image forming device such as a multifunction peripheral, but the present disclosure is not limited to this, and the present disclosure can be similarly applied to a case in which non-contact operations are accepted on a touch panel of an information processing system including various information processing devices such as ticket vending machines, ATM (Automatic Teller Machine) terminal devices, ticket issuing devices, etc.
[0122] [Note] Preferred embodiments of the present disclosure will be described below.
[0123] (((1))) A processor is provided. The processor, An operation detection area for detecting an operation on an operator displayed on a display screen on which an operation surface is laminated is set for each of the plurality of operators, and a non-contact operation performed on the operator displayed on the display screen while the indicator is not in contact with the operation surface is accepted by detecting an indicator approaching the display screen, when the coordinates of a detected pointer enter an operation detection area of a certain operator among a plurality of operators displayed on the display screen a set number of times or more within a preset time period, the operator is enlarged and displayed on the display screen; Information processing system.
[0124] (((2))) the processor sets a predetermined area wider than the operation detection area, and when coordinates of a detected indicator within the predetermined area enter the operation detection area set for a certain operator a set number of times or more within a preset time period, causes the display screen to enlarge and display the operator. An information processing system according to (((1))).
[0125] (((3))) The information processing system described in (((1))) or (((2))), wherein the processor increases the number of times to enlarge the operator when the user performs an operation that is determined to not require an enlarged display of the operator.
[0126] (((4))) The information processing system according to ((3))), wherein when an operation for selecting and confirming a certain operator is performed without enlarging the operator, the processor increases the number of times for enlarging the operator.
[0127] (((5))) The information processing system described in (((3))) further comprises: the processor increasing the number of times to enlarge and display an operator if no operation is performed to confirm the selection of the operator after the operator is enlarged and displayed.
[0128] (((6))) The information processing system described in ((5))) in which the processor does not increase the number of times to enlarge an operator even if an operation to confirm the selection of the operator is not performed after the operator is enlarged, if the area of the operator is equal to or smaller than a preset value, or if the distance between the operator and an adjacent operator is equal to or smaller than a preset value.
[0129] (((7))) when the coordinates of the detected pointer enter within an operation detection area of a certain operator a set number of times or more within a preset time period, the processor causes a plurality of operators including the certain operator to be enlarged and displayed on the display screen. 1. An information processing system according to any one of ((1))) to (((6))).
[0130] (((8))) when the coordinates of the detected pointer enter within an operation detection area of a plurality of operators a set number of times or more within a preset time period, the processor causes the plurality of operators to be enlarged and displayed on the display screen. An information processing system according to (((7))).
[0131] (((9))) when the coordinates of the detected pointer enter within an operation detection area of a certain operator a set number of times or more within a preset time period, the processor enlarges and displays a plurality of operators arranged in close proximity to the certain operator on the display screen. An information processing system according to (((7))).
[0132] (((10))) a step of setting an operation detection area for each of the plurality of operators on a display screen on which operation surfaces are stacked, and detecting an indicator close to the display screen to accept a non-contact operation performed on the operator displayed on the display screen while the indicator is not in contact with the operation surface; a step of enlarging and displaying a certain operator on the display screen when coordinates of a detected pointer enter within an operation detection area of a certain operator among a plurality of operators displayed on the display screen a set number of times or more within a preset time period; A program for causing a computer to execute the following.
[0133] The effects of the above configuration are described below.
[0134] According to the information processing system of (((1))), when a non-contact operation for an operator is accepted by detecting an indicator that has entered an operation detection area set for each operator, it is possible to enlarge the operator for a user who is unfamiliar with non-contact operations and who tends to have the indicator enter and leave the operation detection area multiple times, without always enlarging the operator when the indicator has entered the operation detection area.
[0135] According to the information processing system of (((2))), when the user intentionally moves the indicator into or out of the operation detection area, it is possible to prevent the operation button from being enlarged.
[0136] According to the information processing system of (((3))), it is possible to prevent the display of enlarged controls from being displayed for a user who does not need the display of enlarged controls.
[0137] According to the information processing system of (((4))), it is possible to prevent the display of enlarged controls from being displayed for a user who does not need the display of enlarged controls.
[0138] According to the information processing system of (((5))), it is possible to prevent the display of enlarged controls from being displayed for a user who does not need the display of enlarged controls.
[0139] According to the information processing system (((6))), it is possible to prevent a situation in which it becomes difficult to enlarge the display of the controls in the next or subsequent operations, even when an enlarged display of the controls is required.
[0140] According to the information processing system (((7))), even if an indicator enters the operation detection area of another operator adjacent to the operator that the user is attempting to operate, the operator that the user is attempting to operate can be enlarged and displayed.
[0141] According to the information processing system (((8))), even if an indicator enters the operation detection area of another operator adjacent to the operator that the user is attempting to operate, the operator that the user is attempting to operate can be enlarged and displayed.
[0142] According to the information processing system (((9))), even if an indicator enters the operation detection area of another operator adjacent to the operator that the user is attempting to operate, the operator that the user is attempting to operate can be enlarged and displayed.
[0143] According to the program (((10))), when a non-contact operation for an operator is accepted by detecting an indicator that has entered an operation detection area set for each operator, it is possible to enlarge the operator for a user who is unfamiliar with non-contact operation and who tends to have the indicator enter and leave the operation detection area multiple times, without always enlarging the operator when the indicator has entered the operation detection area. [Explanation of symbols]
[0144] 10 Image forming device 11 CPU 12. Memory 13 Storage device 14 Communication Interface 15 User Interface Device 16 Scan Unit 17 Image forming unit 18 Control Bus 19 Proximity Sensor 20 Terminal Equipment 30 Network 32 Operation detection unit 33 Display section 34 Data transmission and reception unit 35 Control section 36 Image reading unit 37 Data storage section 38 Image output section 40 Touch Panel 41 Predetermined area 42 Predetermined area 50 Operation Buttons 60 Operation detection area
Claims
1. A processor is provided. The processor, An operation detection area for detecting an operation on an operator displayed on a display screen on which an operation surface is laminated is set for each of the plurality of operators, and a non-contact operation performed on the operator displayed on the display screen while the indicator is not in contact with the operation surface is accepted by detecting an indicator approaching the display screen, when the coordinates of a detected pointer enter an operation detection area of a certain operator among a plurality of operators displayed on the display screen a set number of times or more within a preset time period, the operator is enlarged and displayed on the display screen. Information processing system.
2. the processor sets a predetermined area wider than the operation detection area, and when coordinates of a detected indicator within the predetermined area enter the operation detection area set for a certain operator a set number of times or more within a preset time period, causes the display screen to enlarge and display the operator.
2. The information processing system according to claim 1.
3. 2. The information processing system according to claim 1, wherein the processor increases the number of times to enlarge the control when the user performs an operation that is determined not to require enlargement of the control.
4. 4. The information processing system according to claim 3, wherein when an operation for selecting and confirming a certain operator is performed without enlarging the operator, the processor increases the number of times for enlarging the operator.
5. 4. The information processing system according to claim 3, wherein the processor increases the number of times to enlarge and display a certain operator if an operation for selecting and confirming the operator is not performed after the operator has been enlarged and displayed.
6. The information processing system of claim 5, wherein the processor does not increase the number of times an operator is enlarged and displayed, even if no operation is performed to confirm the selection of the operator after the operator is enlarged and displayed, if the area of the operator is equal to or smaller than a predetermined value, or if the distance between the operator and an adjacent operator is equal to or smaller than a predetermined value.
7. when the coordinates of the detected pointer enter within an operation detection area of a certain operator a set number of times or more within a preset time period, the processor causes a plurality of operators including the certain operator to be enlarged and displayed on the display screen.
2. The information processing system according to claim 1.
8. when the coordinates of the detected pointer enter within an operation detection area of a plurality of operators a set number of times or more within a preset time period, the processor causes the plurality of operators to be enlarged and displayed on the display screen.
8. The information processing system according to claim 7.
9. when the coordinates of the detected pointer enter within an operation detection area of a certain operator a set number of times or more within a preset time period, the processor enlarges and displays a plurality of operators arranged in close proximity to the certain operator on the display screen.
8. The information processing system according to claim 7.
10. a step of setting an operation detection area for each of the plurality of operators on a display screen on which operation surfaces are stacked, and detecting an indicator close to the display screen to accept a non-contact operation performed on the operator displayed on the display screen while the indicator is not in contact with the operation surface; a step of enlarging and displaying a certain operator on the display screen when coordinates of a detected pointer enter within an operation detection area of a certain operator among a plurality of operators displayed on the display screen a set number of times or more within a preset time period; A program for causing a computer to execute the following.
Citation Information
Patent Citations
Method of crushing cement clinker
JP1980042224A
Controller of picture signal reproducer
JP1984072692A
Cited By
Threshold voltage adjusting circuit and semiconductor integrated circuit
CN121704630A
