Information processing device and information processing program

Abstract

To provide an information processor and an information processing program which can determine a contactless mode and a contact mode.SOLUTION: In an information processor 10, a host CPU 14 performs processing of causing a light-emitting unit 40 to emit light when a touch panel 34 capable of performing a contact operation and a contactless operation detects a contactless operation of a user in a contactless mode.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and an information processing program.

Background Art

[0002] Patent Document 1 proposes an electronic device provided with a light emitter composed of a plurality of light sources arranged so as to surround the periphery of a touch panel operation unit, in which when a user touches the touch panel operation unit with a finger and further moves the finger in a predetermined movement manner to perform a gesture input, the light emission of the light emitter is controlled with a light emission pattern corresponding to the type of this gesture input.

[0003] Moreover, Patent Document 2 proposes an information processing apparatus provided with a display unit that displays an image, a touch sensor that detects a touch operation and a hover operation on the display area of the display unit, and a control unit that performs control to display a hover mark at a position on the display area corresponding to the detected position when a hover operation is detected by the touch sensor, and when a hover operation is detected above an icon displayed in the display area, the control unit performs change control to change the display size of the hover mark according to the size of the icon.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the case of an operation panel having a non-contact mode and a contact mode, it is difficult to determine which mode is currently selected. Further, in the non-contact mode operation, since a feeling of touching the screen like a touch operation cannot be obtained, it has been difficult to know whether the non-contact operation is correctly recognized.

[0006] Therefore, the purpose of this disclosure is to provide an information processing device and an information processing program capable of distinguishing between non-contact mode and contact mode. [Means for solving the problem]

[0007] To achieve the above objective, the information processing device according to the first embodiment includes a processor, and the processor performs a process to illuminate a light-emitting unit when an operation panel having a non-contact mode for detecting non-contact operations and a contact mode for detecting contact operations detects a non-contact operation by a user in the non-contact mode.

[0008] In the information processing apparatus according to the second embodiment, the processor causes the light-emitting unit to emit light with a different light-emitting pattern for each type of non-contact operation.

[0009] The information processing device according to the third embodiment is an information processing device according to the first embodiment, wherein the processor causes the light-emitting part to emit light at different light-emitting intensities depending on the distance between the operation panel and the object to be operated.

[0010] The information processing device according to the fourth embodiment is an information processing device according to the third embodiment in which the processor emits light with a weaker light intensity as the distance between the operation panel and the object increases, and turns off the light outside of a predetermined detection distance.

[0011] The information processing device according to the fifth embodiment is an information processing device according to the first embodiment, wherein the processor changes the light emission pattern of the light emission unit according to the maintenance time for which the object is maintained without moving within a predetermined range.

[0012] The information processing apparatus according to the sixth embodiment has a plurality of light-emitting units in the information processing apparatus according to the fifth embodiment, and the processor emits light from the light-emitting units when a maintenance operation starts, which is an operation to maintain an object without moving it within a predetermined range, and emits light from different light-emitting units according to the maintenance time.

[0013] The information processing device according to the seventh embodiment is an information processing device according to the sixth embodiment in which a plurality of light-emitting units are arranged in a row, and the processor causes the light-emitting units to emit light in a light-emitting pattern that moves from the end to the center or from the center to the end when the hold starts.

[0014] The information processing device according to the eighth embodiment is an information processing device according to the first embodiment, wherein the processor causes the light-emitting part to emit light with a different light-emitting pattern for each predetermined gesture operation.

[0015] The information processing apparatus according to the ninth embodiment is an information processing apparatus according to the first embodiment, wherein the processor does not emit light from the light-emitting part in the contact mode.

[0016] The information processing apparatus according to the tenth embodiment is an information processing apparatus according to the first embodiment in which, when the processor transitions from the non-contact mode to the contact mode, the light-emitting part does not emit light during a contact operation.

[0017] The information processing device according to the 11th embodiment, in the information processing device according to the first embodiment, the processor causes the light-emitting part to emit light in a color predetermined by the user when in the non-contact mode.

[0018] The information processing apparatus according to the 12th embodiment is an information processing apparatus according to the first embodiment in which the processor detects a person, and when a person is detected, the light-emitting unit is made to emit light in the non-contact mode, and the light-emitting unit is made to not emit light in the contact mode.

[0019] In the information processing device according to the 13th embodiment, in the information processing device according to the 12th embodiment, the processor turns off the light emitted by the light-emitting part indicating the contactless mode when authentication is completed.

[0020] The information processing program according to the 14th aspect causes a computer to execute a process of causing a light emitting unit to emit light when a touch panel having a non-contact mode for detecting a non-contact operation and a contact mode for detecting a contact operation detects the non-contact operation of the user in the non-contact mode.

Effect of the Invention

[0021] According to the 1st aspect, it is possible to provide an information processing apparatus capable of discriminating between a non-contact mode and a contact mode.

[0022] According to the 2nd aspect, it becomes easier for the user to determine whether the non-contact operation is correctly recognized.

[0023] According to the 3rd aspect, the user can visually confirm whether the non-contact operation is recognized.

[0024] According to the 4th aspect, the user can recognize the distance at which the non-contact operation can be recognized.

[0025] According to the 5th aspect, the user can visually confirm that the holding operation is recognized.

[0026] [ According to the 6th aspect, the user can visually confirm that the holding operation has been started and is being continued.

[0027] According to the 7th aspect, the user can visually confirm from the start to the end of the holding operation.

[0028] According to the 8th aspect, the user can visually confirm whether the gesture operation is correctly recognized.

[0029] According to the 9th aspect, power consumption can be suppressed as compared with the case where the light emitting unit emits light even in the contact mode.

[0030] According to the 10th aspect, power consumption can be suppressed as compared with the case where the light emitting unit emits light by the contact operation in the contact mode.

[0031] According to the 11th embodiment, the light-emitting part can be illuminated in a color that is easy for the user to understand.

[0032] According to the 12th embodiment, the user operating the device can be notified whether it is in contactless mode or contact mode.

[0033] According to the 13th embodiment, power consumption can be reduced compared to the case where the light-emitting part is always illuminated in non-contact mode.

[0034] According to the 14th embodiment, an information processing program capable of distinguishing between non-contact mode and contact mode can be provided. [Brief explanation of the drawing]

[0035] [Figure 1] This is a block diagram showing the schematic configuration of the information processing device according to this embodiment. [Figure 2] This figure shows an example where a light-emitting element is provided around the touch panel operating area. [Figure 3] This is a cross-sectional view showing what happens when a finger is brought close to the touch panel operation area. The view illustrates how the touch panel recognizes the finger as being in contactless mode and the light-emitting part illuminates. [Figure 4] This diagram shows the normal mode when a finger is placed on the touch panel operation area, and is a cross-sectional view illustrating how the operation is detected by directly touching the touch panel 34. [Figure 5] This diagram shows a pattern where, as the hold begins, the light from the right and left sides moves towards the center, and then converges at the completion of the hold. [Figure 6] This flowchart shows an example of the processing flow when the light emission intensity of the light-emitting part is changed according to the distance between the finger and the touch panel in the information processing device according to this embodiment. [Figure 7] This flowchart shows an example of the processing flow when the information processing device according to this embodiment changes the light emission pattern of the light-emitting unit when it recognizes a user's hover operation, and changes the light emission pattern of the light-emitting unit according to the hold time. [Figure 8]This diagram shows an example of an upward flick gesture and the corresponding light emission pattern. [Figure 9] This figure shows an example of a downward flick gesture operation and the corresponding light emission pattern of the light-emitting part. [Figure 10] This figure shows an example of a right flick gesture operation and the corresponding light emission pattern of the light-emitting part. [Figure 11] This figure shows an example of a left flick gesture operation and the corresponding light emission pattern of the light-emitting part. [Figure 12] This figure shows an example of a gesture operation for right rotation and an example of the light emission pattern of the light-emitting part. [Figure 13] This figure shows an example of left rotation gesture operation and light emission pattern of the light-emitting part. [Figure 14] This flowchart shows an example of the processing flow when changing the light emission pattern of the light-emitting unit in response to a gesture operation in non-contact mode in the information processing device according to this embodiment. [Figure 15] This flowchart shows the process of turning off the light-emitting part when the mode is changed to normal mode. [Figure 16] This is a schematic diagram showing the schematic configuration of a modified information processing device. [Figure 17] This flowchart shows an example of the processing flow performed in the information processing device used in the modified example. [Modes for carrying out the invention]

[0036] Hereinafter, an example of an embodiment of the present disclosure will be described in detail with reference to the drawings. Figure 1 is a block diagram showing the schematic configuration of the information processing device according to this embodiment.

[0037] In this embodiment, an example is described in which the information processing device 10 is provided in an image forming apparatus 12 having multiple functions. Examples of the multiple functions of the image forming apparatus 12 include an image forming function that receives various data and performs image forming processing based on the received data, a reading function that reads a document and obtains image information representing the document, a copying function that copies the image recorded on the document onto paper, a facsimile function that sends and receives various data via a telephone line (not shown), a transfer function that transfers document information such as image information read by the reading function, etc., and a storage function that stores document information such as image information that has been read.

[0038] In the following explanation, a process or set of processes performed by the image forming apparatus 12 to achieve a predetermined function is referred to as a "job." Furthermore, in the following explanation, image formation by the image forming apparatus 12 may be referred to as "printing."

[0039] As shown in Figure 1, the information processing device 10 according to this embodiment includes a host CPU (Central Processing Unit) 14, ROM (Read Only Memory) 16, RAM (Random Access Memory) 18, and flash memory 20.

[0040] The host CPU 14 controls the overall operation of the device. The ROM 16 stores various control programs and parameters in advance. The RAM 18 is used as a work area when the host CPU 14 executes various programs. The flash memory 20 stores various data and application programs. All of the above parts are electrically interconnected by a system bus. In this embodiment, flash memory 20 is used as the storage unit, but it is not limited to this, and other non-volatile storage units such as HDD (hard disk drive) may be used.

[0041] Furthermore, the host CPU 14 is connected to a touch panel control unit 22, a display drive unit 24, a light-emitting element drive unit 26, and a wireless communication unit 30.

[0042] The touch panel control unit 22 controls the touch panel 34 of the touch panel operation unit 32 for operating the image forming apparatus 12, and detects user operations on the touch panel 34. In this embodiment, the touch panel 34 corresponds to the operation panel, and as an example, a capacitive type is used, enabling both contact and contactless operation. In the following description, the operation of the touch panel 34 will be explained assuming that it is performed with a finger, but it may also be operated with an object other than a finger, such as a pen.

[0043] The display drive unit 24 drives the display panel 36 of the touch panel operation unit 32 and controls the display on the display panel 36.

[0044] The light-emitting element drive unit 26 drives the emission of light from each light-emitting element 40 of the light-emitting element 38, which has multiple light-emitting elements 40 such as LEDs (Light Emitting Diodes), ELs (Electroluminescence), and light bulbs. In this embodiment, as an example, the light-emitting elements 38 are arranged in a single row around the touch panel 34, such as below the touch panel operation unit 32, as shown in Figure 2, and the light-emitting elements 40 emit light in response to non-contact operation in non-contact mode. Note that the light-emitting elements 38 are not limited to a single row, but may be arranged in two or more rows. Also, they may be arranged in places other than around the touch panel 34.

[0045] The wireless communication unit 30 exchanges information wirelessly with external devices such as portable terminal devices carried by the user.

[0046] As described above, the information processing device 10 according to this embodiment has two operating modes: a normal mode for contact operations and a non-contact operation mode for non-contact operations. For example, the mode is selected by displaying a mode selection icon on the display panel 36 and operating the touch panel 34. Alternatively, the mode may be selected by operating a mechanical switch or the like.

[0047] In this embodiment, since there are two operating modes, it is difficult to determine which mode is currently selected. Also, when the non-contact mode is selected, it is difficult to determine whether gesture operations are being recognized correctly because the screen is not touched.

[0048] Therefore, in the information processing device 10 according to this embodiment, when a non-contact operation by the user is detected in non-contact mode, the light-emitting unit 40 is illuminated, thereby enabling determination of the currently selected mode.

[0049] For example, Figure 3 is a cross-sectional view showing the state when a finger is brought close to the touch panel operation unit 32, and how the touch panel 34 recognizes the finger as being in contactless mode and the light-emitting unit 40 lights up. Note that the position of the light-emitting unit 40 does not have to be below the touch panel 34, as long as it is in a position that is easily visible to the user.

[0050] Figure 4 is a cross-sectional view showing the situation when a finger is in contact with the touch panel operation unit 32 in normal mode, illustrating how the operation is detected by directly touching the touch panel 34. In normal mode, since there is actual contact, feedback is unnecessary and the light-emitting unit 40 does not light up. If a non-contact operation is performed during normal mode, the non-contact operation itself may be detected, but the operation may not be accepted, and it may not be displayed on the screen or elsewhere, nor may the light-emitting unit 40 light up.

[0051] Furthermore, in non-contact mode, it is difficult to determine whether gesture operations are being correctly recognized, so the illumination pattern of the light-emitting unit 40 is changed when a user's hover operation is detected. For example, when a finger or stylus pen approaches within a predetermined distance from the touch panel 34, the touch panel 34 detects a non-contact operation. When a non-contact operation is detected, the illumination pattern of the light-emitting unit 40 is changed. Specifically, when a user's hover operation is detected, the illumination pattern of the light-emitting unit 40 changes, emitting different light-emitting units 40, and as shown in Figure 5, the light-emitting units 40 emit light in a pattern where the light moves from the right and left sides towards the center as the hold begins, and merges at the time of completion. In addition, the illumination intensity of the light-emitting unit 40 may be changed according to the distance between the touch panel 34 and the finger, or at least one of the illumination intensity, illumination, and illumination pattern may be changed. Furthermore, the illumination pattern may be changed according to gesture operations in non-contact mode, or at least one of the illumination color and illumination pattern may be changed, in addition to the illumination pattern.

[0052] Hover operation refers to an operation method in which input is performed with the finger floating without directly touching the touch panel 34, and is also called floating touch. Lighting pattern refers to a pattern in which two or more light-emitting parts 40 are arranged side by side, and the lighting of the light-emitting parts 40 in a chain reaction makes the light appear to flow, or a combination of lighting and flashing of one or more light-emitting parts. Hold refers to an operation in which the finger is kept still within a predetermined range for a predetermined period of time. Hold time refers to the duration for which the finger is kept still within a predetermined range. Gesture operation refers to an operation performed by a specific combination of finger movements on the touch panel 34 using hover operation. Furthermore, the light intensity of the light-emitting parts 40 may be changed by changing the brightness, changing the number of lights, or changing both the brightness and the number of lights.

[0053] Furthermore, in this embodiment, the color of the light-emitting unit 40 when in contactless mode may differ for each user. For example, the color of the light-emitting unit 40 when in contactless mode may be set, allowing the user to select the color of the light emitted.

[0054] Here, we will describe the specific processing performed by the information processing device 10 according to this embodiment, which is configured as described above.

[0055] First, we will explain the process for changing the light intensity of the light-emitting unit 40 according to the distance between the finger and the touch panel 34. Figure 6 is a flowchart showing an example of the processing flow when the light intensity of the light-emitting unit 40 is changed according to the distance between the finger and the touch panel 34 in the information processing device 10 according to this embodiment. Note that the processing in Figure 6 starts, for example, when the non-contact mode is selected.

[0056] In step 100, the host CPU 14 determines whether or not it has detected a finger. The system waits until this determination is confirmed, and then proceeds to step 102.

[0057] In step 102, the host CPU 14 reads the Z-axis information and proceeds to step 104. That is, it detects the distance between the finger and the touch panel 34 as Z-axis information.

[0058] In step 104, the host CPU 14 reads the brightness table and proceeds to step 106. In this embodiment, the light emission intensity of the light emission unit 40 is set by reading a predetermined brightness corresponding to the Z-axis information from the brightness table.

[0059] In step 106, the host CPU 14 illuminates the light-emitting unit 40 and proceeds to step 108. That is, by illuminating the light-emitting unit 40 with a light intensity read from the brightness table, the light-emitting unit 40 is illuminated with a light intensity corresponding to the distance between the finger and the touch panel 34. The brightness table may be, for example, one in which different light intensities are set for each distance, with weaker light intensity illuminating as the distance increases and turning off outside a predetermined detection distance. In this embodiment, the light intensity is changed by changing the brightness, but the change in light intensity is not limited to this, and the number of light-emitting units 40 that emit light may also be changed.

[0060] In step 108, the host CPU 14 determines whether there is no change in the Z-axis information within a predetermined range. If this determination is negative, the process returns to step 100 and the above process is repeated. If the determination is positive, the series of processes ends.

[0061] Next, we will describe the process in which, in non-contact mode, the light emission pattern of the light emission unit 40 is changed when the user's hover operation is recognized, and the light emission pattern of the light emission unit 40 is changed according to the duration of the hold operation in which the finger remains within a certain range of the touch panel 34. Figure 7 is a flowchart showing an example of the processing flow in the information processing device 10 according to this embodiment, in which the light emission pattern of the light emission unit 40 is changed when the user's hover operation is recognized, and the light emission pattern of the light emission unit 40 is changed according to the hold time. Note that the processing in Figure 7 starts, for example, when non-contact mode is selected.

[0062] In step 200, the host CPU 14 determines whether or not it has detected a finger. The system waits until this determination is confirmed, and then proceeds to step 202.

[0063] In step 202, the host CPU 14 reads the XY coordinate information and proceeds to step 204. That is, it detects the position of the finger on the touch panel 34 as XY coordinate information.

[0064] In step 204, the host CPU 14 determines whether the XY coordinate information remains unchanged within a predetermined range. If this determination is negative, the process returns to step 200 and the above processing is repeated. If the determination is positive, the process proceeds to step 206.

[0065] In step 206, the host CPU 14 starts measuring the hold time and proceeds to step 208.

[0066] In step 208, the host CPU 14 illuminates the light-emitting unit 40 and proceeds to step 210. For example, as shown in Figure 5, the light-emitting unit 40 may illuminate so that the light moves from the right and left sides towards the center as soon as the hold starts, or the light-emitting unit 40 may simply illuminate.

[0067] In step 210, the host CPU 14 determines whether or not the XY coordinate information has remained unchanged within a predetermined range for a predetermined period of time. If the determination is negative, the process proceeds to step 212; if the determination is positive, the process proceeds to step 214.

[0068] In step 212, the host CPU 14 turns off the light-emitting unit 40 and returns to step 200 to repeat the process described above.

[0069] Meanwhile, in step 214, the host CPU 14 finishes measuring the hold time and proceeds to step 216.

[0070] In step 216, the host CPU 14 turns off the light-emitting unit 40 to end the series of processes and proceeds to the process corresponding to the object that was selected as the object displayed on the display panel 36.

[0071] Next, we will explain the processing performed by the information processing device 10 when the light emission pattern of the light emission unit 40 is changed in response to a gesture operation in non-contact mode. Note that if the light emission pattern ends while a first gesture operation is being performed, such as when the gesture continues after the light emission pattern has finished, the light emission pattern corresponding to the first gesture operation may be repeated.

[0072] In this embodiment, examples of gesture operations include upward flick, downward flick, right flick, left flick, right rotation, and left rotation.

[0073] Figure 8 shows an example of an upward flick gesture operation and the illumination pattern of the light-emitting unit 40. An upward flick is a gesture operation in which the finger is moved upwards on the touch panel 34 towards the top of Figure 8, and the light-emitting unit 40 lights up in an illumination pattern that moves from the left and right towards the center.

[0074] Figure 9 shows an example of a downward flick gesture operation and the illumination pattern of the light-emitting unit 40. A downward flick is a gesture operation in which the finger is moved downwards on the touch panel 34 towards the bottom of Figure 9, and the light-emitting unit 40 lights up in an illumination pattern that moves from the center outwards to the left and right.

[0075] Figure 10 shows an example of a right flick gesture operation and the illumination pattern of the light-emitting unit 40. A right flick is a gesture operation in which the finger is moved from left to right on the touch panel 34 in Figure 10, and the light-emitting unit 40 lights up in an illumination pattern that moves from left to right.

[0076] Figure 11 shows an example of a left flick gesture operation and the illumination pattern of the light-emitting unit 40. A left flick is a gesture operation in which the finger is moved from the right to the left side of the touch panel 34 in Figure 11, and the light-emitting unit 40 lights up in an illumination pattern that moves from the right to the left side.

[0077] Figure 12 shows an example of a right rotation gesture operation and the light emission pattern of the light emission unit 40. Right rotation is a gesture operation in which the finger is moved to rotate to the right on the touch panel 34 as indicated by the arrow in Figure 12, and the light emission unit 40 lights up with a light emission pattern in which continuous light flows intermittently from left to right.

[0078] Figure 13 shows an example of a left rotation gesture operation and the light emission pattern of the light emission unit 40. Left rotation is a gesture operation in which the finger is moved to rotate to the left on the touch panel 34 as indicated by the arrow in Figure 13, and the light emission unit 40 lights up with a light emission pattern in which continuous light flows intermittently from right to left.

[0079] Figure 14 is a flowchart showing an example of the processing flow when the light emission pattern of the light emission unit 40 is changed in response to a gesture operation in non-contact mode in the information processing device 10 according to this embodiment. Note that the processing in Figure 14 starts, for example, when non-contact mode is selected.

[0080] In step 300, the host CPU 14 determines whether or not it has detected a finger. The system waits until this determination is confirmed, and then proceeds to step 302.

[0081] In step 302, the host CPU 14 reads the XYZ coordinates and motion and proceeds to step 304.

[0082] In step 304, the host CPU 14 determines the type of gesture operation and proceeds to step 306. In this embodiment, it determines one of the gesture operations described above: up flick, down flick, right flick, left flick, right rotate, and left rotate.

[0083] In step 306, the host CPU 14 lights up the light-emitting unit 40 with a light-emitting pattern corresponding to the gesture operation, and completes the series of processes. That is, the light-emitting unit 40 lights up with a light-emitting pattern corresponding to the gesture operation shown in Figures 8 to 13. At this time, the light-emitting intensity may be changed depending on the distance between the finger and the touch panel 34.

[0084] Furthermore, in the information processing device 10 according to this embodiment, when the non-contact mode is selected, the light-emitting unit 40 emits light when it recognizes a user operation. However, when the normal mode is selected, the light-emitting unit 40 does not emit light in response to a user operation, so the following processing is performed.

[0085] Figure 15 is a flowchart showing the process of turning off the light emission of the light-emitting unit 40 when the mode is changed to normal mode.

[0086] In step 400, the host CPU 14 determines whether normal mode has been selected. This determination is based on whether the operation to select normal mode has been performed using the touch panel operation unit 32. The system waits until this determination is confirmed and then proceeds to step 402.

[0087] In step 402, the host CPU 14 terminates the series of processes by setting the light-emitting unit 40 to off-light. As a result, when normal mode is selected, the light-emitting unit 40 will not light up due to user operation. Alternatively, the system may determine whether a contact operation has been performed and set the light-emitting unit 40 to off-light if a contact operation has been performed. Furthermore, if a finger touches the screen, the light-emitting unit may be temporarily set to off-light, and then, if there is no instruction to switch modes and a predetermined time has elapsed, light emission by non-contact operation may be resumed.

[0088] (modified version) Next, we will describe the modified information processing device 11. Figure 16 is a block diagram showing the schematic configuration of the modified information processing device. Note that components identical to those in Figure 1 are denoted by the same reference numerals, and detailed explanations are omitted.

[0089] In the modified information processing device 11, the detection control unit 28 is further connected to the host CPU 14 compared to the above embodiment.

[0090] The detection control unit 28 controls a user detection unit 42, which is an example of a detection unit that detects whether a user of the image forming apparatus 12 is in the vicinity of the image forming apparatus 12. The user detection unit 42 outputs the detection result to the host CPU 14. The user detection unit 42 detects users of the image forming apparatus 12 within a predetermined detection range. An example of the user detection unit 42 is a human presence sensor or a sensor camera that detects the approach of a person. Alternatively, it may detect operation by a mobile terminal or the approach of a mobile terminal using short-range wireless communication such as Wi-Fi® or Bluetooth®. Alternatively, it may detect the approach of a person using various sensors such as a voice recognition sensor, an infrared sensor, or a vibration sensor.

[0091] In a modified example, since a user detection unit 42 is provided, the light-emitting unit 40 may be illuminated when a user is detected by the user detection unit in the non-contact mode.

[0092] Alternatively, when non-contact mode is selected, the light-emitting unit 40 may illuminate in a display manner indicating that non-contact mode is being used when a user is detected by the user detection unit 42. For example, the light-emitting unit 40 may illuminate in a predetermined color or a predetermined display pattern such as a soft blinking pattern as a display manner indicating non-contact mode.

[0093] Alternatively, if contactless mode is selected, and the user detection unit 42 detects a user, the light-emitting unit 40 may be illuminated in a predetermined display mode indicating contactless mode, and then the predetermined display mode may be turned off when personal authentication is completed.

[0094] Here, we will describe the specific processing performed in the modified information processing device 11. As an example, we will describe the process when, in the case where contactless mode is selected, a user is detected, the light-emitting unit 40 is illuminated in a predetermined display mode indicating contactless mode, and after personal authentication is completed, the predetermined display mode is turned off. Figure 17 is a flowchart showing an example of the processing flow performed in the modified information processing device 11.

[0095] In step 500, the host CPU 14 determines whether or not a person has been detected. This determination is made by the user detection unit 42 determining whether or not a user has been detected. The system waits until this determination is affirmative and then proceeds to step 502.

[0096] In step 502, the host CPU 14 determines whether or not contactless mode is selected. If the determination is positive, the process proceeds to step 504; otherwise, the series of processes ends.

[0097] In step 504, the host CPU 14 illuminates the light-emitting unit 40 in a display mode indicating non-contact mode and proceeds to step 506. For example, the light-emitting unit 40 is illuminated in a predetermined display pattern, such as a predetermined color or a soft blinking pattern, to inform the user that non-contact mode is in operation.

[0098] In step 506, the host CPU 14 determines whether or not a person is still present. This determination determines whether or not the user detection unit 42 has continued to detect a user. If the determination is negative, the system proceeds to step 508; if it is positive, the system proceeds to step 510.

[0099] In step 508, the host CPU 14 turns off the light-emitting unit 40 and returns to step 500 to repeat the process described above.

[0100] On the other hand, in step 510, the host CPU 14 determines whether authentication has been completed. For example, it determines whether user authentication has been completed by card authentication or the like. If the determination is negative, the process returns to step 506 and the above processing is repeated, and if the determination is positive, the process proceeds to step 512. The determination in step 510 may be whether a predetermined amount of time has elapsed that allows the user to recognize that it is in contactless mode by the illumination of the light-emitting unit 40. Alternatively, it may be determined whether contactless operation has been initiated.

[0101] In step 512, the host CPU 14 turns off the light-emitting unit 40 and terminates the series of processes. Since the light-emitting unit 40 illuminates in a display mode indicating contactless mode until authentication is complete, the user can recognize that they are in contactless mode by the time authentication is complete, so turning off the light-emitting unit 40 suppresses unnecessary illumination.

[0102] In the modified information processing device 11, after authentication is complete, in contactless mode, the light-emitting unit 40 is illuminated with a display pattern corresponding to the gesture operation, providing feedback to the user. That is, until authentication is complete, the device emits light to indicate contactless mode, and after authentication is complete, the light-emitting unit 40 emits light with a display pattern corresponding to the contactless operation. For example, as described above, until authentication is complete, the light-emitting unit 40 emits light with a predetermined soft blinking pattern as a display mode indicating contactless mode. After authentication is complete, the light-emitting unit 40 emits light with the display patterns shown in Figures 8 to 13 in response to the gesture operation, providing feedback to the user corresponding to the gesture operation.

[0103] In this embodiment, the light emission pattern indicating non-contact mode and the light emission pattern corresponding to non-contact operation are different. However, the light emission pattern indicating non-contact mode and the light emission pattern corresponding to non-contact operation may be the same. Furthermore, in the above embodiment, only one example of the light emission pattern of the light emission unit 40 was given for explanation, but the light emission pattern is not limited to the above. For example, as the light emission pattern until the hold operation shown in Figure 5 is determined, the light emission unit 40 may be illuminated in a pattern in which light moves from the center to the left and right when the hold starts, and the light emission unit 40 at the end of the light emission body 38 lights up at the timing of completion. Also, the light emission patterns for the upward flick in Figure 8 and the downward flick in Figure 9 may be reversed, with the light emission pattern shown in Figure 8 being the downward flick and the light emission pattern shown in Figure 9 being the upward flick. Another example of the light emission pattern for the right flick shown in Figure 10 is a light emission pattern in which one or more light emission units 40 located on the right side light up. Similarly, another example of the light emission pattern for the left flick shown in Figure 11 is a light emission pattern in which one or more light emission units 40 located on the left side light up. Furthermore, another example of the right-rotating light emission pattern shown in Figure 12 is a pattern in which light moves from left to right, and then from right to left. Similarly, another example of the left-rotating light emission pattern shown in Figure 13 is a pattern in which light moves from right to left, and then from left to right.

[0104] Furthermore, although the above embodiment describes an example in which there are multiple light-emitting units 40, it is not limited to this, and for example, a single light-emitting unit 40 may be used, and the light-emitting pattern may be changed by a combination of light-emitting color, illumination, flashing, etc.

[0105] Furthermore, although the above embodiment describes an example using an operation panel that allows both contact and non-contact operation, it is not limited to this, and any operation panel that allows non-contact operation is acceptable. For example, an operation panel that allows only non-contact operation may be used.

[0106] Furthermore, although the above embodiment describes an example in which the information processing device 10 is provided in the image forming apparatus 12, it is not limited to this. For example, it may be provided in other devices such as an image processing apparatus.

[0107] Furthermore, although the CPU was described as an example of a processor in the above embodiment, the term "processor" refers to a broader term that includes general-purpose processors (such as CPUs) and specialized processors (such as GPUs: Graphics Processing Units, ASICs: Application Specific Integrated Circuits, FPGAs: Field Programmable Gate Arrays, and programmable logic devices).

[0108] Furthermore, the operation of the processor in the above embodiments may not be performed by a single processor, but may be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, but may be changed as appropriate.

[0109] Furthermore, the processing performed in the information processing according to the above embodiment may be software-based processing, hardware-based processing, or a combination of both. Additionally, the processing performed in the information processing device may be stored as a program on a storage medium and distributed.

[0110] Furthermore, this disclosure is not limited to the foregoing, and it is of course possible to implement it in various modified forms without departing from its intent.

[0111] The following additional information is disclosed regarding the embodiments described above. (((1))) The processor comprises, An information processing device that performs a process of illuminating a light-emitting unit when an operation panel having a non-contact mode for detecting non-contact operations and a contact mode for detecting contact operations detects a non-contact operation by a user in the non-contact mode.

[0112] (((2))) The information processing apparatus according to (((1))), wherein the processor causes the light-emitting part to emit light with a different light-emitting pattern for each type of non-contact operation.

[0113] (((3))) The information processing apparatus according to (((1))) or (((2))), wherein the processor causes the light-emitting part to emit light at different light-emitting intensities depending on the distance between the operation panel and the object to be operated.

[0114] (((4))) The information processing apparatus according to (((3))), wherein the processor emits light with a weaker light intensity as the distance between the operation panel and the object increases, and turns off the light outside a predetermined detection distance.

[0115] (((5))) The information processing apparatus according to any one of (((1))) to (((4))), wherein the processor changes the light emission pattern of the light-emitting part according to the maintenance time for which the object is maintained without moving within a predetermined range.

[0116] (((6))) Having a plurality of the aforementioned light-emitting units, The information processing apparatus according to (((5))), wherein the processor is an operation to maintain an object without moving it within a predetermined range, and emits light from a light-emitting unit when the maintenance operation starts, and emits light from different light-emitting units according to the maintenance time.

[0117] (((7))) Multiple of the aforementioned light-emitting units are arranged in a line, The information processing apparatus according to (((6))), wherein the processor causes the light-emitting part to emit light in a light-emitting pattern that emits light from the edge to the center or from the center to the edge when the hold starts.

[0118] (((8))) The processor is an information processing device according to any one of (((1))) to (7))) which causes the light-emitting part to emit light in a different light-emitting pattern for each predetermined gesture operation.

[0119] (((9))) The processor, in the case of the contact mode, does not emit light from the light-emitting part. Information processing device as described in any one of (((1))) to (((8))).

[0120] (((10))) The information processing apparatus according to any one of (((1))) to (((9))), wherein the processor, when transitioning from the non-contact mode to the contact mode, does not emit light in the light-emitting part during contact operation.

[0121] (((11))) The information processing device described in any one of (((1))) to (((10))) causes the processor to emit light in a color predetermined by the user in the non-contact mode.

[0122] (((12))) The information processing apparatus according to any one of (((1))) to (((11))), wherein the processor detects a person, and when a person is detected, the light-emitting part is made to emit light in the non-contact mode, and the light-emitting part is made to not emit light in the contact mode.

[0123] (((13))) The information processing apparatus according to (((12))), wherein the processor turns off the light emitted by the light-emitting part indicating the contactless mode when authentication is completed.

[0124] (((14))) On the computer, An information processing program for causing an operation panel having a non-contact mode for detecting non-contact operations and a contact mode for detecting contact operations to illuminate a light-emitting part when it detects a non-contact operation by a user in the non-contact mode. [Explanation of symbols]

[0125] 10 Information Processing Devices 12 Image forming apparatus 14 Host CPU 28 Detection and Control Unit 32 Touch panel operation section 34 Touch Panel 36. Luminous element 40 Light-emitting part 42 User detection unit

Claims

1. The processor comprises, An operation panel having a non-contact mode for detecting non-contact operations and a contact mode for detecting contact operations performs a process to illuminate a light-emitting part when it detects a non-contact operation by a user in the non-contact mode. When a person is detected, if the non-contact mode is selected, the light-emitting unit illuminates in a display mode indicating that the non-contact mode is selected; if the contact mode is selected, the light-emitting unit is de-illuminated; and when authentication is completed, the light-emitting unit that indicates the non-contact mode in the display mode is turned off. An information processing device in which, when the non-contact operation is detected in the non-contact mode, the light-emitting unit emits light in a different light emission pattern than the display mode.

2. The information processing apparatus according to claim 1, wherein the processor causes the light-emitting part to emit light with a different light-emitting pattern for each type of non-contact operation.

3. The information processing apparatus according to claim 1, wherein the processor causes the light-emitting part to emit light at different light-emitting intensities depending on the distance between the operation panel and the object to be operated on.

4. The information processing apparatus according to claim 3, wherein the processor emits light with a weaker light intensity as the distance between the operation panel and the object increases, and turns off the light outside a predetermined detection distance.

5. The information processing apparatus according to claim 1, wherein the processor changes the light emission pattern of the light emission unit according to the maintenance time for which the object is maintained without moving within a predetermined range.

6. Having a plurality of the aforementioned light-emitting units, The information processing apparatus according to claim 5, wherein the processor is an operation to maintain an object without moving it within a predetermined range, and the light-emitting unit emits light when the maintenance operation starts, and the light-emitting unit emits light differently depending on the maintenance time.

7. Multiple of the aforementioned light-emitting units are arranged in a line, The information processing apparatus according to claim 6, wherein the processor causes the light-emitting unit to emit light in a light-emitting pattern that emits light from the edge to the center, or from the center to the edge, when the maintenance operation is started.

8. The information processing apparatus according to claim 1, wherein the processor causes the light-emitting unit to emit light in a different light-emitting pattern for each predetermined gesture operation.

9. The information processing apparatus according to claim 1, wherein the processor does not emit light from the light-emitting part in the contact mode.

10. The information processing apparatus according to claim 1, wherein when the processor transitions from the non-contact mode to the contact mode, the light-emitting part does not emit light during a contact operation.

11. The information processing apparatus according to claim 1, wherein the processor causes the light-emitting part to emit light in a color predetermined by the user in the non-contact mode.

12. On the computer, An operation panel having a non-contact mode for detecting non-contact operations and a contact mode for detecting contact operations performs a process to illuminate a light-emitting part when it detects a non-contact operation by a user in the non-contact mode. When a person is detected, if the non-contact mode is selected, the light-emitting unit illuminates in a display mode indicating that the non-contact mode is selected; if the contact mode is selected, the light-emitting unit is de-illuminated; and when authentication is completed, the light-emitting unit that indicates the non-contact mode in the display mode is turned off. An information processing program for causing the light-emitting unit to emit light in a different light-emitting pattern than the display mode when the non-contact operation is detected in the non-contact mode.

Images