Information processing apparatus

Abstract

To solve the problem in which: a user who is not familiar with the operations of a device using a non-contact touch panel may bring the user's finger closer than necessary to a display when performing the operations and touch the non-contact touch panel; the occurrence of such a situation causes the risk of infection with viruses.SOLUTION: An apparatus is used for an operation unit including a touch panel and a detector that detects the position of an object located in the vertical direction to the panel. When the position of the object satisfies a first condition in the vertical direction with respect to the touch panel, the operation unit performs display based on the position of the object, and when the position of the object satisfies a second condition closer to the non-contact touch panel than the first condition in the vertical direction with respect to the non-contact panel, issues a warning.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device. [Background technology]

[0002] In recent years, the ease of movement of people and goods has allowed the emergence of new and mutated viruses to spread rapidly around the world, frequently resulting in large numbers of infected people. It is known that many of these infectious diseases are transmitted by ingesting viruses contained in droplets emitted by an infected person. Research has also shown that these viruses can remain infectious for days on glass, plastic, and other surfaces. Therefore, in order to minimize contact with viruses, it will be necessary to develop various devices that can be operated without contact.

[0003] The same is true for operating electronic devices used by an unspecified number of people. Electronic devices that previously accepted operations through touch are now required to be contactless. For example, an MFP (Multi Function Peripheral), which is an image forming device, is a single device used by many users and is equipped with a contact-type touch panel display that accepts touch operations from users.

[0004] For example, Patent Document 1 proposes a capacitive touch panel having detection areas of area R1, which is an area away from the touch panel, and area R2, which is an area even further away than area R1. Area R2 determines the position of the user's finger, and area R1 determines the user's selection. This proposes an image forming device that can realize operations and instructions to search for a desired button using only non-contact operations. Another example is Patent Document 2, which proposes a non-contact touch panel that realizes multi-touch operation during non-contact operations on an infrared display. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-062410 [Patent Document 2] Special Publication No. 2016-520906 Summary of the Invention [Problem to be solved by the invention]

[0006] However, users who are not accustomed to operating devices with non-contact touch panels may move their fingers closer to the display than necessary and end up touching the non-contact touch panel, which poses a risk of virus infection. [Means for solving the problem]

[0007] The present invention is a device that uses a detection device capable of detecting the position of an object that is vertically positioned relative to a panel and an operation unit that includes a touch panel, and is characterized in that the operation unit displays a display based on the position of the object when the position of the object vertically relative to the touch panel satisfies a first condition, and issues a warning when the position of the object vertically relative to the non-contact panel satisfies a second condition that is closer to the non-contact touch panel than the first condition. [Effects of the Invention]

[0008] According to the present invention, it is possible to reduce the possibility that the user's fingers will come into contact with the display during non-contact operation. [Brief explanation of the drawings]

[0009] [Figure 1] A block diagram showing the configuration of an operation unit having a non-contact touch panel. [Figure 2] Block diagram showing the configuration of an operation unit having an infrared touch panel [Figure 3] A bird's-eye view of an infrared touch panel when a user blocks invisible light with an object in order to select an operation key. [Figure 4] Configuration diagram of an infrared touch panel with three layers of non-contact sensors [Figure 5] An infrared touch panel equipped with three layers of non-contact sensors, showing what happens when an object blocks invisible light at each layer. [Figure 6] An infrared touch panel equipped with three layers of non-contact sensors, showing what is displayed on the display when an object blocks invisible light. [Figure 7] Flowchart for an infrared touch panel with three layers of non-contact sensors [Figure 8] A block diagram showing the configuration of an operation unit having a capacitive touch panel. [Figure 9] A bird's-eye view of a capacitive touch panel when a user approaches an object to select an operation key. [Figure 10] A diagram showing how the capacitance of the sensor element of a capacitive touch panel increases or decreases when an object approaches the operation panel. [Figure 11] A diagram showing the increase / decrease in capacitance of the sensor element and the threshold when an object approaches the operation panel of a capacitive touch panel. [Figure 12] A diagram showing what is displayed on the display when the capacitance threshold is exceeded on a capacitive touch panel. [Figure 13] Flowchart for capacitive touch panel with capacitance threshold [Figure 14] Block diagram of an image forming apparatus DETAILED DESCRIPTION OF THE INVENTION

[0010] Each embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention as claimed, and not all of the combinations of features described in each embodiment are necessarily essential to the solution of the present invention. In this embodiment, an image processing device will be used as an example of an information processing device, but the present invention is not limited to this.

[0011] Example 1 Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0012] FIG. 14 is a block diagram of the image forming apparatus 10 in this embodiment.

[0013] The CPU 105 executes software programs stored in the RAM 104 and controls the entire device.

[0014] The ROM 103 stores, for example, programs for executing configurations related to the startup of the controller 100, fixed parameters, and the like.

[0015] The RAM 104 is used to store programs and temporary data when the CPU 105 controls the image forming apparatus 10. The programs and temporary data stored in the RAM 104 are read from the ROM 103 or a storage 502 (described later).

[0016] The BIOS 107 is a non-volatile memory that stores a boot program (BIOS). The printer control unit 122 receives setting information set by the user when performing print processing via the printer I / F 121 through communication with the CPU 105, and controls the operation of the printer unit 120 based on the setting information.

[0017] The scanner control unit 132 receives setting information set by the user when performing scanner processing via the scanner I / F 131 through communication with the CPU 105, and controls the operation of the scanner unit 130 based on the setting information.

[0018] The network I / F 106 transmits and receives data to and from the network 118. Specifically, the network I / F 106 receives data sent from the network 118, and transmits image data read by the scanner unit 130 and image data stored in the storage 502 to a predetermined destination via the network 118.

[0019] The FAX I / F 161 is capable of transmitting and receiving digital images to and from the telephone line 163 via the FAX unit 160. Specifically, it receives image data sent from the telephone line 163 via the FAX unit 160. It also transmits image data read by the scanner unit 130 and image data stored in the storage 502 to a predetermined destination via the FAX unit 160 and the telephone line 163.

[0020] The storage 502 serves as main storage and stores programs executed by the CPU 105, program management tables, and various data. The program to be executed is a boot program executed by the CPU 105 to start the OS when the image forming apparatus 10 is started. Examples of the storage 502 include an HDD, an SSD, an eMMC, a NAND flash memory, and a NOR flash memory. When a user logs in, the storage 502 stores whether the input method of the operation unit 200 is contactless or contact, in association with the user.

[0021] The controller 100 is connected to an operation unit 200 via an operation unit I / F 199. Details of the operation unit 200 and its behavior when a user logs in will be described later.

[0022] 1 is a diagram showing an example of the hardware configuration of an operation unit having a non-contact touch panel. The information processing apparatus in this embodiment will be described as an image forming apparatus having an operation unit.

[0023] The operation unit 200 includes a control board 201, a display unit 209, and a non-contact touch panel 210. An image processing unit 203 generates image data to be displayed on the display unit 209 and transmits the image data to the display unit 209 via a display unit I / F 206. A touch panel control unit 204 acquires coordinate data from the non-contact touch panel 210 via a non-contact touch panel I / F 207. The microcomputer 202 acquires information from the touch panel control unit 204 and communicates the acquired information with the controller unit via a controller I / F 205 and an operation unit I / F 199.

[0024] The controller unit is a device that communicates with the operation unit 200. The controller I / F 205 is connected to the controller unit, and is connected to each unit via a system bus 208. The non-contact touch panel 210 is disposed on top of the display unit 209. When a user selects an operation key displayed on the display unit 209, the non-contact touch panel 210 accepts the input. The non-contact touch panel 210 can be of various types, such as an optical type or an ultrasonic type, and the non-contact touch panel I / F 207 also conforms to these types. In addition, in the embodiment of this patent, an infrared type and a capacitive type are used.

[0025] 2(a) is a diagram showing an example of the hardware configuration of an operation unit having an infrared touch panel 211. In the example shown in FIG.

[0026] The operation unit 200 includes a control board 201, a display unit 209, and an infrared touch panel 211. An image processing unit 203 generates image data to be displayed on the display unit 209 and transmits the image data to the display unit 209 via a display unit I / F 206. A touch panel control unit 204 acquires coordinate data from the infrared touch panel 211 and communicates with a controller unit via a controller I / F 205. The controller unit is a device that communicates with the operation unit 200.

[0027] The controller I / F 205 is connected to the controller unit, and is connected to each unit via a system bus 208. The infrared touch panel 211 is disposed on top of the display unit 209. When the user selects an operation key displayed on the display unit 209, the infrared touch panel 211 accepts the input.

[0028] 2(b) is a block diagram of an infrared touch panel. The infrared touch panel 211 has a control unit 212, a light emitting element 158, and a light receiving element 159. The control unit 212 has a detection unit 213, a determination unit 214, and a storage unit 215.

[0029] The detection unit 213 controls the light emitting element 158 ​​and the light receiving element 159 based on the determination result of the determination unit 214. The detection unit 213 switches the ON / OFF of the light emitting element 158 ​​in accordance with an instruction from the determination unit 214. The ON / OFF switching of the light emitting element 158 ​​is realized by controlling the supply of drive power to the light emitting element 158, for example.

[0030] The detection unit 213 detects the intensity of received light input to the light receiving element 159 and sends the detected intensity of received light to the control unit 212. The control unit 212 receives the intensity of received light at the detection unit 213 and sends it to the determination unit 214. The detection unit 213 switches the light receiving element 159 ON / OFF in accordance with an instruction from the determination unit 214. The ON / OFF switching of the light receiving element 159 is similar to that of the light emitting element 158.

[0031] The determination unit 214 stores the received light intensity of the light receiving element 159 sent from the detection unit 213 in the memory unit 215. The memory unit 215 stores reference value data indicating the coordinates of the light receiving element and the received light intensity. The determination unit 214 displays a pointer, touches (confirms), or displays a warning according to the coordinates of the light receiving element and the reference value data stored in the memory unit 215. The determination unit 214 sends information regarding the coordinates of the light receiving element 159 whose received light intensity has changed and the reference value data to the control board 201 via the non-contact touch panel I / F 207. The light emitting element 158 ​​is, for example, an infrared LED, and a plurality of light emitting elements 158 are arranged around the display unit 209 (see FIG. 3).

[0032] The light-emitting element 158 ​​emits inspection light in accordance with instructions from the detection unit 213. The inspection light emitted from the light-emitting element 158 ​​is diffracted, blocked, or reflected by the object 301. The light-receiving element 159 is configured with, for example, a photodiode, and a plurality of light-receiving elements 159 are arranged around the display unit 209 (see FIG. 3). The light-receiving element 159 sends the intensity of the received light to the detection unit 213.

[0033] 3 is a diagram showing the configuration of infrared touch panel 211 when a user selects operation key 300 displayed on display unit 209. When a user's finger, which is object 301, approaches operation key 300, a plurality of light-emitting elements 158, 168 such as infrared LEDs and light-receiving elements 159, 169 such as photodiodes are arranged on the outer frame of the infrared touch panel so as to face each other.

[0034] For example, light-emitting element 158 ​​and light-receiving element 159 are arranged in the X direction (horizontal direction), and light-emitting element 168 and light-receiving element 169 are arranged in the Y direction (vertical direction). The touch detection area is an area where operation keys 300 are arranged. Operation keys 300 include, for example, a power saving key, a home button, a copy start key, a stop key, color settings, paper size, etc. When invisible light such as infrared rays from light-emitting element 158 ​​to light-receiving element 159 is blocked by a target object 301 such as a finger, control board 201 detects the coordinates. Display unit 209 outputs image data sent from control board 201.

[0035] Using Figure 4, we will explain the case where the operating unit of an information processing device equipped with an infrared touch panel 211 is equipped with three layers (three rows in the Z direction) of light-emitting elements and light-receiving elements in the Z direction (vertical direction) that detect the blocking of invisible light rays by an object 301.

[0036] For example, the first layer has light-emitting element 158 ​​in the X direction and light-emitting element 1580 in the Y direction. The second layer has light-emitting element 258 in the X direction and light-emitting element 2580 in the Y direction. The third layer has light-emitting element 358 in the X direction and light-emitting element 3580 in the Y direction. Opposite each light-emitting element is a light-receiving element, and these light-receiving elements send the intensity of the received light to control unit 212.

[0037] 5, operations related to pointer display, touch (decision), and warning display when infrared rays are blocked will be described with reference to the configuration of the infrared touch panel 211. Note that the X and Z directions will be described as examples here.

[0038] The figures show light-emitting elements 158, 258, and 358 and light-receiving elements 159, 259, and 359 arranged in the Z direction. For example, as shown in FIG. 5B, when a finger, which is the object 301, blocks invisible light from the light-emitting element 158, which is the first layer, to the light-receiving element 159, the control unit 212 detects that the invisible light has been blocked based on the intensity of received light transmitted from the light-receiving element 159. The determination unit 214 stores the intensity of received light transmitted by the light-receiving element 159 via the detection unit 213 in the memory unit 215. The determination unit 214 determines that the first layer has been blocked based on the stored coordinates, and issues a notification to the control board 201 to prompt the display of a pointer. The touch panel control unit 204 receives the notification and instructs the display unit 209 to display a pointer at the corresponding coordinates.

[0039] Next, as shown in FIG. 5( c), when the finger blocks invisible light rays from the light-emitting element 258, which is the second layer, to the light-receiving element 259, the control unit 212 executes the same processing as for the light-receiving element 159. The determination unit 214 determines that the stored coordinates indicate that the second layer has been blocked, and issues a notification to the control board 201 to prompt a touch instruction to the coordinates displayed by the pointer. The microcomputer 202 receives the notification via the touch panel control unit 204 and executes the touch. Note that when the invisible light rays to the light-receiving element 159 are blocked and the invisible light rays to the light-receiving element 259 are also blocked, the stored coordinates may be determined to indicate that the second layer has been blocked.

[0040] Next, as shown in FIG. 5(d), when the finger blocks invisible light rays from light-emitting element 358, which is the third layer, to light-receiving element 359, control unit 212 executes the same processing as for light-receiving elements 159 and 259. When determination unit 214 determines that the stored coordinates indicate that the third layer has been blocked, it issues a notification to control board 201 to prompt the control board 201 to display a warning. Upon receiving the notification, touch panel control unit 204 executes operations such as issuing an instruction to display a warning color or a warning message to discourage contact with the touch panel to display a warning color or a warning message to microcomputer 202 to output a warning sound. Note that when the invisible light rays to light-receiving element 159 are blocked, the invisible light rays to light-receiving element 259 are blocked, and the invisible light rays to light-receiving element 359 are blocked, it may be determined that the stored coordinates indicate that the third layer has been blocked.

[0041] The operation of the display unit 209 synchronized with the pointer display, touch (decision), and warning display when infrared rays are blocked in the configuration of the infrared touch panel 211 will be described with reference to FIG.

[0042] 6(a) shows a state before the object 301 blocks the invisible light. The display unit 209 shows a copy screen as an example.

[0043] FIG. 6(b) shows a state in which a finger, which is the object 301, blocks invisible light from the light-emitting element 158, which is the first layer, to the light-receiving element 159. The display unit 209 displays a pointer 318, which moves according to the coordinates of the blocked point. Note that the pointer 318 may be displayed at the time of FIG. 6(a). In that case, the pointer 318 does not move in FIG. 6(a).

[0044] 6(c) illustrates a case where a finger blocks invisible light from the light-emitting element 258 on the second layer to the light-receiving element 259. The display unit 209 displays a pointer 318, indicating that a touch has been performed on the operation key 300. For example, the operation key 300 is displayed in black and white inversion.

[0045] 6(d) illustrates a case where a finger blocks invisible light from the light-emitting element 358 in the third layer to the light-receiving element 359. The display unit 209 performs various operations, such as changing the background color to a color different from the standard color (e.g., red), outputting a warning sound from the operation unit 200, and displaying warning text, such as a message indicating that the finger is approaching the touch panel. This makes it possible to warn the user not to touch the touch panel. Note that each warning operation may be combined.

[0046] 7 is a flowchart of a series of operations in the operation unit equipped with the infrared touch panel 211, and explains the operation contents and operating conditions. This flowchart is controlled by the touch panel control unit 204.

[0047] When the information processing device is powered on and an image (for example, a user authentication screen or a home screen) is displayed on the display unit 209, the flow of FIG. 7 starts.

[0048] In S101, when touch panel control unit 204 receives a notification that detection unit 213 has detected that object 301 has blocked invisible light rays from the light emitting elements to the light receiving elements of the first layer, the process proceeds to step S103.

[0049] In step S103, the touch panel control unit 204 instructs the display unit 209 to display a pointer, and the process proceeds to S104.

[0050] If the first layer is not blocked, the process proceeds to step S102. The touch panel control unit 204 does not display a pointer on the display unit 209. Not displaying a pointer means maintaining a state in which the pointer is not displayed, or transitioning from a state in which the pointer is displayed to a state in which it is not displayed.

[0051] In S104, the display unit 209 receives the instruction to display the pointer, displays the pointer 318, and the process proceeds to S105. If the pointer is already being displayed, the display of the pointer is maintained.

[0052] In S105, when the detection unit 213 detects that the object 301 has blocked invisible light rays from the light-emitting elements of the second layer to the light-receiving elements, the touch panel control unit 204 transitions to step S106. Note that in S105, if the touch panel control unit 204 does not receive a notification that the detection unit 213 has detected that the object 301 has blocked invisible light rays from the light-emitting elements of the second layer to the light-receiving elements, the touch panel control unit 204 transitions to S101.

[0053] In step S106, the touch panel control unit 204 acquires the coordinates of the blocked light receiving element from the storage unit 215, issues an instruction to the display unit 209 to invert black and white for the coordinates, and proceeds to S107.

[0054] In S107, the display unit 209 displays the target coordinates in reverse video on the display unit 209, and the process proceeds to S108.

[0055] The touch panel control unit 204 determines that the coordinates of the inverted black and white are the location determined by the user, that is, the location touched, and proceeds to S109.

[0056] In S109, when the detection unit 213 detects that the object 301 has blocked the invisible light rays from the light-emitting elements of the third layer to the light-receiving elements, the touch panel control unit 204 transitions to step S110. Note that in S109, when the detection unit 213 does not detect that the object 301 has blocked the invisible light rays from the light-emitting elements of the third layer to the light-receiving elements, the touch panel control unit 204 transitions to S101.

[0057] In step S110, the touch panel control unit 204 issues an instruction to the display unit 209 and the microcomputer 202 to display a warning, and the process proceeds to S111.

[0058] In S111, the display unit 209 displays a warning message or changes the background color as a warning display, and the microcomputer 202 outputs a warning sound.

[0059] In S112, if the touch panel control unit 204 detects that the display unit 209 has come into contact with the object 309, the process proceeds to step S113. If the touch panel control unit 204 does not detect that the display unit 209 has come into contact with the object 309, the process proceeds to step S111.

[0060] In step S113, the touch panel control unit 204 tracks and registers the ID of the logged-in user in an information network linked to coronaviruses such as Cocoa, and proceeds to S114. In S114, the display unit 209 causes the microcomputer 202 to notify the user of disinfection. The disinfection notification may be displayed on the display unit 209.

[0061] According to this embodiment, the operation unit 200 executes control according to the position of the user's fingers, thereby making it possible to prevent erroneous input by the user.

[0062] 7 shows an example in which the touch panel control unit 204 executes each operation, but this is not limiting. For example, the CPU 105 of the controller 100 shown in FIG. 14 may be used. When the CPU 105 is used, FIG. 7 will look like the following. In this case, the operation unit 200 will internally perform the operations performed by the touch panel control unit 204 described above.

[0063] In S101, when the CPU 105 receives from the operation unit 200 a notification that the detection unit 213 has detected that the object 301 has blocked invisible light rays from the light emitting elements to the light receiving elements in the first layer, the process proceeds to step S103.

[0064] In step S103, the CPU 105 issues an instruction to the operation unit 200 to display a pointer, and the process proceeds to S104.

[0065] If the first layer is not blocked, the process proceeds to step S102. The CPU 105 does not cause the operation unit 200 to display a pointer. Not displaying a pointer means maintaining a state in which the pointer is not displayed, or transitioning from a state in which the pointer is displayed to a state in which it is not displayed.

[0066] In S104, the CPU 105 receives the instruction to display the pointer and causes the pointer 318 to be displayed on the operation unit 200, and the process proceeds to S105. If the pointer is already being displayed, the display of the pointer is maintained.

[0067] In S105, when CPU 105 receives a notification that detection unit 213 has detected that object 301 has blocked invisible light rays from the light-emitting elements of the second layer to the light-receiving elements, CPU 105 transitions to step S106. Note that in S105, if CPU 105 does not receive a notification that detection unit 213 has detected that object 301 has blocked invisible light rays from the light-emitting elements of the second layer to the light-receiving elements, CPU 105 transitions to S101.

[0068] In step S106, the CPU 105 acquires the coordinates of the blocked light receiving element from the operation unit 200, issues a black / white inversion instruction to the operation unit 200 for the coordinates, and proceeds to S107.

[0069] In S107, the CPU 105 displays the target coordinates in reverse video on the operation unit 200, and proceeds to S108. The CPU 105 determines that the reversed video coordinates are the location determined by the user, that is, the location that has been touched, and proceeds to S109.

[0070] In S109, when CPU 105 receives a notification that operation unit 200 has detected that object 301 has blocked invisible light rays from the light-emitting elements of the third layer to the light-receiving elements, CPU 105 transitions to step S110. Note that in S109, if CPU 105 does not receive a notification that operation unit 200 has detected that object 301 has blocked invisible light rays from the light-emitting elements of the third layer to the light-receiving elements, CPU 105 transitions to S101.

[0071] In step S110, the CPU 105 issues an instruction to display a warning to the display unit 209 and the microcomputer 202, and the process proceeds to S111.

[0072] In S111, the touch panel control unit 204 causes the display unit 209 to change the background color and display a warning message as a warning display, and causes the microcomputer 202 to output a warning sound.

[0073] In S112, if the CPU 105 detects that the display unit 209 of the operation unit 200 has come into contact with the object 309, the process proceeds to step S113. If the CPU 105 does not detect that the display unit 209 has come into contact with the object 309, the process proceeds to step S111.

[0074] In step S113, the CPU 105 tracks and registers the ID of the logged-in user in an information network linked to coronaviruses such as Cocoa, and proceeds to S114. In S114, the CPU 105 causes the operation unit 200 to notify the user of disinfection. The disinfection notification may be displayed on the display unit 209.

[0075] Example 2 In Example 2, a case where a capacitive touch panel is used as the non-contact touch panel will be described. The same components as those in Example 1 will be assigned the same reference numerals and descriptions thereof will be omitted.

[0076] 8(a) and 8(b) are diagrams showing an example of the hardware configuration of an operation unit having a capacitive touch panel 216. Since the components other than the capacitive touch panel 216 are the same as those in FIG. 2, a description of each component will be omitted.

[0077] 8(a) will be described first. The operation unit 200 includes a capacitive touch panel 216. The touch panel control unit 204 acquires coordinate data from the capacitive touch panel 216 and communicates with the controller unit via the controller I / F 205.

[0078] Capacitive touch panel 216 is disposed over display unit 209. When a user selects an operation key displayed on display unit 209, the input is received by capacitive touch panel 216. Capacitive touch panel 216 has control unit 217 and sensor unit 221. Control unit 217 has detection unit 218, determination unit 219, and storage unit 220.

[0079] The sensor unit 221 has a drive unit 222, a detection data generation unit 223, and an operation panel 224. The detection unit 218 controls the sensor unit 221 so that detection is performed periodically at each detection position (the intersection where the capacitive sensor element 227 is formed) on the operation panel 224. This control includes control of the timing and voltage level of voltage application to the electrode Ey226 by the drive unit 222, and control of the timing of reading detection data from the electrode Ey226 by the detection data generation unit 223.

[0080] Based on the detection data received from the sensor unit 221 via the detection unit 218, the determination unit 219 stores the amount of change in capacitance at each detection position on the operation panel 224 in the storage unit 220. The storage unit 220 stores reference value data indicating the coordinates and capacitance of the sensor element, and threshold values, and in particular the threshold values ​​include a threshold value T1 for displaying a pointer, a threshold value T2 for touch (decision), and a threshold value T3 for displaying a warning.

[0081] The operation panel 224 will be described using Figure 8 (b). The operation panel 224 is used as a user interface for input. The operation panel 224 has a plurality of electrodes Ex225 extending in a first direction (e.g., X direction) and a plurality of electrodes Ey226 extending in a second direction (e.g., Y direction) perpendicular to the first direction. The electrodes Ex225 and the electrodes Ey226 intersect while being insulated from each other, and a capacitive sensor element 227 is formed near the intersection.

[0082] Furthermore, the electrode Ex225 and the electrode Ey226 are not limited to a striped shape, and any shape that allows for intersections, such as a diamond pattern (rhombic pattern), can be used. The driver 222 applies a drive voltage to each sensor element 227. The driver 222 sequentially selects the multiple electrodes Ex225 under the control of the detector 218, for example, and applies a periodically changing voltage to the selected electrode Ey226.

[0083] The application of the voltage changes the potential of the sensor element 227, causing charging and discharging. The capacitance of the sensor element 227 is detected by detecting the amount of charge at the electrode Ey226. The electrode Ey226 supplies the capacitance detected at each intersection of the corresponding row to the detection data generation unit 223. The detection data is, for example, digital data obtained by digitally sampling a voltage value corresponding to the capacitance at each intersection. The detection data is supplied to the detection unit 218.

[0084] 9 is a diagram showing the configuration of the capacitive touch panel 216 when a user selects an operation key 300 displayed on the display unit 209. When a user's finger, which is an object 301, approaches the operation key 300, the electrode Ey 226 detects the capacitance of the sensor element 227 in the area where the operation key 300 is arranged. The detected data is supplied to the control board 201. The operation key 300 is the same as described above.

[0085] 10 is a diagram illustrating a change in capacitance in the sensor element 227 of the capacitive touch panel 216. In the capacitive touch panel 216, at an intersection of an electrode Ex225 extending in the X direction and an electrode Ey226 extending in the Y direction, capacitance is generated between the electrode Ex225 and the electrode Ey226, changing the capacitance of the capacitive sensor element 227. For example, the electrode Ex225 can be used as a drive electrode, and the other electrode Ey226 can be used as a detection electrode.

[0086] In the capacitive touch panel 216, the potential of the sensor element 227 changes when a periodically changing voltage is applied to the electrode Ex225, causing charging and discharging. The capacitance of the sensor element 227 is detected by detecting the capacitance at the electrode Ey226. For example, when a finger is brought close to the operation panel 224 as the object 301, the capacitance of the sensor element 227 changes (increases) significantly due to capacitive coupling between the object 301 and the electrode Ey226. In contrast, when the object 301 moves away from the operation panel 224, no capacitive coupling occurs between the object 301 and the electrode Ey226, and the capacitance of the sensor element 227 changes (decreases).

[0087] 11, the detection operations of threshold value T1 for displaying a pointer, threshold value T2 for touch (decision), and threshold value T3 for displaying a warning will be described for the configuration of capacitive touch panel 216. For example, when moving from FIG. 11(a) to FIG. 11(b), a finger, which is object 301, approaches operation panel 224. If the capacitance of sensor element 227 detected by determination unit 219 exceeds threshold value T1 stored in memory unit 220, control unit 217 issues a notification to control board 201 prompting it to display a pointer. Upon receiving the notification, touch panel control unit 204 sends an instruction to display a pointer at the corresponding coordinates to display unit 209.

[0088] Next, when the finger moves from Fig. 11(b) to Fig. 11(c), the target object 301 approaches further to the operation panel 224. If the capacitance of the sensor element 227 detected by the determination unit 219 exceeds the threshold T2 stored in the memory unit 220, the control unit 217 issues a notification to the control board 201 urging the user to give a touch instruction to the coordinates displayed by the pointer. The microcomputer 202 receives the notification via the touch panel control unit 204 and executes the touch.

[0089] 11(c) to 11(d), the finger, which is the object 301, approaches further to the operation panel 224. If the capacitance of the sensor element 227 detected by the determination unit 219 exceeds the threshold T3 stored in the memory unit 220, the control unit 217 issues a notification to the control board 201 to prompt the control board 201 to display a warning.

[0090] Upon receiving the notification, the touch panel control unit 204 causes the display unit 209 to display a warning message.

[0091] 12, the detection operation of the threshold T1 for pointer display, the threshold T2 for touch (decision), and the threshold T3 for warning display in the configuration of the capacitive touch panel 216 will be described. Fig. 12(a) shows a state where the position of the object 301 is such that the capacitance of the sensor element 227 does not reach the threshold T1.

[0092] 12(b) shows a case where a finger, which is the object 301, approaches the operation panel 224 and the capacitance of the sensor element 227 detected by the determination unit 219 exceeds the threshold T1 stored in the memory unit 220. The display unit 209 displays a pointer 318, which moves according to the coordinates.

[0093] 12(c) illustrates a case where the capacitance of the sensor element 227 detected by the determination unit 219 exceeds the threshold T2 stored in the storage unit 220. The display unit 209 displays a pointer 318, indicating that a touch has been performed on the operation key 300. For example, the operation key 300 is displayed in black and white inversely.

[0094] 12(d) illustrates a case where the capacitance of the sensor element 227 detected by the determination unit 219 exceeds the threshold T3 stored in the storage unit 220. The display unit 209 performs operations such as changing the background color to a color (e.g., red) different from the reference color and outputting a warning sound from the operation unit 200.

[0095] 13 is a flowchart of a series of operations in the operation unit equipped with the capacitive touch panel 216, and explains the operation contents and operating conditions. This flowchart is controlled by the touch panel control unit 204.

[0096] When the information processing device is powered on and an image (for example, a user authentication screen or a home screen) is displayed on the display unit 209, the flow of FIG. 7 starts.

[0097] In S201, the touch panel control unit 204 determines whether or not the capacitance of the sensor element 227 exceeds the threshold T1 when the object 301 approaches the operation panel 224. If the capacitance exceeds the threshold T1, the process proceeds to step S203. If the capacitance does not exceed the threshold T1 in S201, the process proceeds to step S202.

[0098] In step S202, the touch panel control unit 204 does not display a pointer on the display unit 209. After step S202 is completed, the process returns to step S201. Note that the determination in step S201 may be made by the microcomputer 202.

[0099] In step S203, the touch panel control unit 204 issues an instruction to display a pointer to the display unit 209. Then, the process proceeds to S204.

[0100] In S204, the display unit 209 receives the instruction to display the pointer and displays the pointer 318 on the display unit 209, and the process proceeds to S205.

[0101] In S205, the touch panel control unit 204 determines whether the capacitance of the sensor element 227 exceeds the threshold T2. If the capacitance exceeds the threshold T2, the process proceeds to S206. If the capacitance of the sensor element 227 does not exceed the threshold T2 in S205, the process returns to S201. Note that the determination in S205 may be made by the microcomputer 202.

[0102] In S206, the touch panel control unit 204 acquires the coordinates of the sensor element 227 from the storage unit 220, issues an instruction to the display unit 209 to invert black and white for those coordinates, and proceeds to S207.

[0103] In S207, the display unit 209 receives the instruction to invert black and white and displays the target coordinates in inverted black and white, and the process proceeds to S208.

[0104] In S208, the touch panel control unit 204 determines that the coordinates of the inverted black and white are the location determined by the user, that is, the location touched, and proceeds to S209. Note that the determination in S208 may be made by the microcomputer 202.

[0105] In S209, the touch panel control unit 204 determines whether the capacitance of the sensor element 227 has exceeded the threshold T3. If it has exceeded the threshold, the process proceeds to step S210. After S210 is completed, the process proceeds to S211. On the other hand, if the capacitance does not exceed the threshold T3, the process proceeds to S201. The determination in S208 may be made by the microcomputer 202.

[0106] In step S210, the touch panel control unit 204 instructs the display unit 209 and the microcomputer 202 to display a warning. In S211, the display unit 209 displays a warning message or changes the background color. Furthermore, the touch panel control unit 204 causes the microcomputer 202 to output a warning sound. After S211 is completed, the process proceeds to S212.

[0107] In S212, the touch panel control unit 204 determines whether the object 301 has come into contact with the display unit 209. If it has come into contact, the process proceeds to S213. In S214, the touch panel control unit 204 tracks and registers the ID of the logged-in user in an information network linked to coronaviruses such as Cocoa, and the process proceeds to S214. In S214, the touch panel control unit 204 executes a disinfection notification to the user. The disinfection notification may be displayed on the display unit 209.

[0108] 13 shows an example in which the touch panel control unit 204 executes each operation, but this is not limiting. For example, the CPU 105 of the controller 100 shown in FIG. 14 may be used. When the CPU 105 is used, FIG. 14 will look like the following. In this case, the operation unit 200 will internally perform the operations performed by the touch panel control unit 204 described above.

[0109] In S201, CPU 105 determines whether or not the capacitance of sensor element 227 exceeds threshold value T1 as object 301 approaches operation panel 224. If threshold value T1 is exceeded, the process proceeds to step S203. If the capacitance does not exceed threshold value T1 in S201, the process proceeds to step S202.

[0110] In step S202, the CPU 105 does not display a pointer on the operation unit 200. After step S202 is completed, the process returns to step S201.

[0111] In step S203, the CPU 105 issues a pointer display instruction to the operation unit 200. Then, the process proceeds to S204.

[0112] In S204, the operation unit 200 displays the pointer 318 on the display unit 209. The process proceeds to S205.

[0113] In S205, the CPU 105 determines whether the capacitance of the sensor element 227 exceeds the threshold T2. If the capacitance exceeds the threshold T2, the process proceeds to S206. If the capacitance of the sensor element 227 does not exceed the threshold T2 in S205, the process returns to S201.

[0114] In S206, the CPU 105 acquires the coordinates of the sensor element 227 from the storage unit 220, issues a black / white inversion instruction to the operation unit 200 for the coordinates, and proceeds to S207.

[0115] In S207, the CPU 105 receives the instruction to invert black and white and causes the display unit 209 to display the target coordinates in inverted black and white, and then the process proceeds to S208.

[0116] In S208, the CPU 105 determines that the coordinates of the inverted black and white are the location determined by the user, that is, the location touched, and the process proceeds to S209.

[0117] In S209, the CPU 105 determines whether the capacitance of the sensor element 227 exceeds the threshold T3. If it does exceed the threshold, the process proceeds to step S210. After S210 is completed, the process proceeds to S211. On the other hand, if the capacitance does not exceed the threshold T3, the process proceeds to S201.

[0118] In step S210, the CPU 105 issues a warning display instruction to the operation unit 200. In S211, the operation unit 200 changes the background color and displays a warning message as a warning display, and outputs a warning sound. After S211 ends, the process proceeds to S212.

[0119] In S212, the CPU 105 determines whether the object 301 has come into contact with the operation unit 200. If it has come into contact, the process proceeds to S213. In S214, the CPU 105 tracks and registers the ID of the logged-in user in an information network linked to coronaviruses such as Cocoa, and then proceeds to S214. In S214, the CPU 105 executes a disinfection notification to the user. The disinfection notification may be displayed on the operation unit 200.

[0120] (Other embodiments) While various examples and embodiments of the present invention have been shown and described, the spirit and scope of the present invention is not limited to the specific descriptions within this specification.

[0121] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0122] 105 CPU 200 Operation section

Claims

1. A device using a detection device for detecting the position of an object in a direction perpendicular to a touch panel and an operation unit including the touch panel, The operation unit includes: a display based on the position of the object when the position of the object satisfies a first condition in a vertical direction with respect to the touch panel; a device that issues a warning when a second condition is satisfied that the position of the object is closer to the touch panel in the vertical direction than the first condition is satisfied;

2. The device according to claim 1 , wherein the warning is displayed on the touch panel of the operation unit.

3. 3. The device according to claim 1, wherein the warning is a warning sound output by the operation unit.

4. 4. The device according to claim 1, wherein the warning is issued by changing the background color of the display on the operation unit.

5. The device according to any one of claims 1 to 4, characterized in that the operation unit detects contact of the object with the touch panel, and displays a disinfection notice on the touch panel, encouraging disinfection of the touch panel.

6. an authentication means for authenticating a user; The device according to any one of claims 1 to 5, further comprising: a storage means for storing information of the authenticated user when the operation unit detects contact of an object with the touch panel while the user is authenticated by the authentication means.

7. a control unit for controlling the device based on an operation instructed to be performed by the operation unit; The operation unit includes: When one of the first conditions is satisfied, a pointer according to the position of the object is displayed; The control means 7. The device according to claim 1, wherein an operation based on the position of the pointer is executed by satisfying two of the first conditions.

8. the detection device is an infrared type having three rows of infrared sensor elements arranged in a vertical direction from the touch panel, One of the first conditions is that detection is performed by a sensor element that is farthest from the touch panel in a vertical direction among the three rows of sensor elements, The second condition of the first condition is that detection is performed by the sensor elements in the middle row among the three rows of sensor elements, 8. The device according to claim 7, wherein the second condition is that detection is performed by a sensor element of the three rows of sensor elements that is closest in the vertical direction to the touch panel.

9. the detection device is a capacitive type that detects the position of the object from the touch panel based on capacitance generated between the touch panel and the object, One of the first conditions is that the capacitance satisfies a condition with respect to a first threshold value; The second condition of the first condition is that the capacitance satisfies a condition for a second threshold value that is greater than the first threshold value; 8. The apparatus of claim 7, wherein the second condition is that the capacitance satisfies a third threshold value that is greater than the second threshold value.

10. A method for controlling a device using a detection device that detects the position of an object in a direction perpendicular to a touch panel and an operation unit that includes the touch panel, a step of causing the operation unit to display based on the position of the object when the position of the object on the touch panel satisfies a first condition in a vertical direction; a step of the operation unit issuing a warning when a second condition is satisfied in which the position of the object is closer to the touch panel in the vertical direction than the first condition is satisfied.

11. A program for causing a computer to execute the control method according to claim 10.

12. A computer-readable storage medium storing the program according to claim 11.

Images