Operating device, its control method, and control program

The integration of capacitance-sensitive display panels with varying sensitivity levels for physical operation units addresses the challenge of accurately detecting user inputs on display panels, enhancing control and detection precision.

JP7948810B2Active Publication Date: 2026-11-11RESTAR CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2022164982
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-10-13
Publication Date
2026-11-11
Estimated Expiration
2042-06-30

AI Technical Summary

Technical Problem

Existing technologies fail to effectively control the region on a display panel where a physical operation unit is attached and distinguish it from other regions, leading to inaccurate detection of user inputs.

Method used

A display panel with integrated capacitance detection and image display functions, equipped with a physical operation unit that changes position or orientation, and a control unit that differentiates capacitance sensitivity levels in operation and non-operation areas to accurately detect user inputs.

Benefits of technology

Enables precise control and detection of user operations on the display panel, distinguishing between different types of physical operation units such as dials and push switches, improving input accuracy and responsiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007948810000001
    Figure 0007948810000001
  • Figure 0007948810000002
    Figure 0007948810000002
  • Figure 0007948810000003
    Figure 0007948810000003
Patent Text Reader

Abstract

To effectively control a display panel equipped with a physical operation part.SOLUTION: An operation device comprises: a display panel having an operation sensing function and an image display function that use changes in capacitance; a physical operating part which is attached to a surface of the display panel and of which at least one of a position and an orientation is changed by operation of a user; and a control unit that uses capacitance values to detect a change in at least one of the position and the orientation of the physical operating part. The operation device includes, on the display panel, a physical operation region equipped with a dial or a push switch serving as the physical operation part, and a touch region not equipped with the physical operation part. The physical operation region has static sensitivity higher than static sensitivity of the touch region.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present invention relates to an operation device, a control method therefor, and a control program.

BACKGROUND ART

[0002] In the above technical field, Patent Document 1 discloses a technique of configuring an input control device by placing mechanical actuators such as switches, dials, and sliders on a touch sensing device. Non-contact touch sensing using capacitance is also suggested.

PRIOR ART DOCUMENTS

PATENT DOCUMENTS

[0003]

PATENT DOCUMENT 1

SUMMARY OF THE INVENTION

PROBLEMS TO BE SOLVED BY THE INVENTION

[0004] However, with the technique described in the above document, it was not possible to effectively control the region on the display panel where the physical operation unit is attached and the other regions.

[0005] An object of the present invention is to provide a technique that solves the above-mentioned problems.

MEANS FOR SOLVING THE PROBLEMS

[0006] To achieve the above object, a device according to the present invention comprises: a display panel having an operation detection function using a change in capacitance and an image display function; a physical operation unit attached to the surface of the display panel, at least one of the position and orientation of which changes according to a user operation; A control unit that detects a change in at least one of the position and orientation of the physical operating unit using the capacitance value, An operating device equipped with, The display panel includes a physical operation area on which a dial or push switch serving as a physical operation unit is attached, and a touch area on which the physical operation unit is not attached. The capacitive sensitivity of the physical operation area is higher than that of the touch area in this operating device.

[0007] To achieve the above objective, the method according to the present invention is A display panel having an operation detection function and an image display function using changes in capacitance, A physical operating unit attached to the surface of the display panel, the position and orientation of which can be changed by user operation, A control unit that detects a change in at least one of the position and orientation of the physical operating unit using the capacitance value, A control method for an operating device equipped with, A first detection step in which a change in capacitance is detected with a first capacitance sensitivity in a physical operation area on the display panel where the dial or push switch serving as the physical operation unit is attached, A second detection step in which a change in capacitance is detected in a touch area other than the physical operation area with a second capacitance sensitivity lower than the first capacitance sensitivity, This is a method for controlling an operating device that includes [a specific component].

[0008] To achieve the above objective, the program according to the present invention A display panel having an operation detection function and an image display function using changes in capacitance, A physical operating unit attached to the surface of the display panel, the position and orientation of which can be changed by user operation, A control unit that detects a change in at least one of the position and orientation of the physical operating unit using the capacitance value, A control program for an operating device equipped with, A first detection step in which a change in capacitance is detected with a first capacitance sensitivity in a physical operation area on the display panel where the dial or push switch serving as the physical operation unit is attached, A second detection step in which a change in capacitance is detected in a touch area other than the physical operation area with a second capacitance sensitivity lower than the first capacitance sensitivity, This is a control program for an operating device that causes a computer to execute a command. [Effects of the Invention]

[0009] According to the present invention, a display panel to which a physical control unit is attached can be effectively controlled. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing the configuration of the operation device according to the first embodiment. [Figure 2] This is a block diagram showing the configuration of the operation device according to the second embodiment. [Figure 3A] This figure illustrates the different capacitance sensitivities between the region of the physical operation unit and the region outside the physical operation unit according to the second embodiment. [Figure 3B] This diagram illustrates the dial in the area of ​​the physical operation unit according to the second embodiment. [Figure 4A] This figure shows the configuration of the domain database according to the second embodiment. [Figure 4B] This diagram shows the configuration of the physical operation unit database according to the second embodiment. [Figure 5] This is a block diagram showing the hardware configuration of the control unit according to the second embodiment. [Figure 6] This is a flowchart showing the processing procedure of the control unit according to the second embodiment. [Figure 7A] This is a flowchart showing the procedure of panel setting processing according to the second embodiment. [Figure 7B] This is a flowchart showing the procedure of input determination processing according to the second embodiment. [Figure 7C] This is a flowchart showing the procedure of operation instruction / display processing according to the second embodiment. [Figure 8A] This is a diagram for explaining contact and pressing of a push switch according to the third embodiment. [Figure 8B] This is a diagram for explaining contact and pressing of a push switch according to the third embodiment. [Figure 8C] This is a diagram for explaining a slider in the region of a physical operation unit according to the third embodiment. [Figure 8D] This is a diagram for explaining a rocker switch in the region of a physical operation unit according to the third embodiment. [Figure 9A] This is a diagram showing the configuration of a region database according to the third embodiment. [Figure 9B] This is a diagram showing the configuration of a physical operation unit database according to the third embodiment. [Figure 10A] This is a flowchart showing the procedure of panel setting processing according to the third embodiment. [Figure 10B] This is a flowchart showing the procedure of input determination processing according to the third embodiment. [Figure 10C] This is a flowchart showing the procedure of operation instruction / display processing according to the third embodiment. [Figure 11A] This is a diagram for explaining approach, contact and pressing of a push switch according to the fourth embodiment. [Figure 11B] This is a diagram for explaining approach, contact and pressing of a push switch according to the fourth embodiment. [Figure 12A] This is a diagram showing the configuration of a region database according to the fourth embodiment. [Figure 12B] This is a diagram showing the configuration of a physical operation unit database according to the fourth embodiment. [Figure 13]This flowchart shows the procedures for input determination processing and operation instruction / display processing according to the fourth embodiment. [Figure 14A] This diagram illustrates the operation during calibration of the operation device according to the fifth embodiment. [Figure 14B] This diagram shows the configuration of the domain database according to the fifth embodiment. [Figure 14C] This is a flowchart showing the procedure for the panel setting process according to the fifth embodiment. [Figure 15A] This flowchart shows the procedure for calibration processing in areas other than the physical operation unit according to the fifth embodiment. [Figure 15B] This flowchart shows the procedure for calibration processing of the area of ​​the physical operation unit according to the fifth embodiment. [Figure 16] This is a block diagram showing the system configuration using the operation device according to the sixth embodiment. [Figure 17] This figure shows the configuration of a physical operation unit database for use in multiple fields according to the sixth embodiment. [Figure 18A] This figure shows a system configuration in which the operation device according to the sixth embodiment is mounted on an automobile. [Figure 18B] This figure shows a system configuration in which the operation device according to the sixth embodiment is used in the medical field. [Figure 18C] This figure shows a system configuration in which the operation device according to the sixth embodiment is embedded in the wall. [Modes for carrying out the invention]

[0011] Embodiments of the present invention will be described in detail below with reference to the drawings. However, the components described in the following embodiments are merely illustrative and are not intended to limit the technical scope of the present invention to them alone.

[0012] [First Embodiment] An operation device 100 as a first embodiment of the present invention will be described with reference to Figure 1. The operation device 100 is a device on which a user performs operation input.

[0013] As shown in Figure 1, the operation device 100 includes a display panel 101, a physical operation unit 102, and a control unit 103. The display panel 101 has an operation detection function and an image display function using changes in capacitance. The physical operation unit 102 is mounted on the surface of the display panel 101, and at least one of its position and orientation changes due to user operation. The control unit 103 detects the change in at least one of the position and orientation of the physical operation unit 102 using the capacitance value. The control unit 103 then detects the change in capacitance with different capacitance sensitivities in a first region 111 on the display panel 101 where the physical operation unit 102 is mounted, and in a second region 112 other than the first region 111.

[0014] According to this embodiment, the area to which the physical operating unit is attached and the other areas can be effectively controlled.

[0015] [Second Embodiment] Next, an operation device 200 according to the second embodiment of the present invention will be described with reference to Figure 2 and subsequent figures.

[0016] Figure 2 is a block diagram showing the functional configuration of the operation device 200 according to this embodiment. The operation device 200 according to this embodiment includes a display panel 210, a dial 250 and a push switch 260 as physical operating parts attached to the surface of the display panel 210, and a control unit 220.

[0017] The control unit 220 controls the threshold and / or amplification of the detected capacitance for converting changes in capacitance on the display panel 210 into on / off digital signals, depending on the area on the display panel 210. Specifically, different thresholds and / or amplifications are used in different areas to recognize various user operations.

[0018] The area on the display panel 210 can be divided into three types: the dial area, which is the surface on which the dial 250 is mounted; the push switch area, which is the surface on which the push switch 260 is mounted; and the touch area (an area without physical operation parts). Here, for example, the capacitance sensitivity in the dial area is lower than that of the push switch area. Furthermore, the capacitance sensitivity of the touch area is even lower than that of the dial area. In other words, in the touch area, a predetermined change in capacitance can be detected to accurately detect touch operations by the user. In the dial area, a smaller change in capacitance than that of the touch area can be detected to accurately detect dial operations. Furthermore, in the push switch area, an even smaller change in capacitance than that of the dial area can be detected to accurately detect the on / off state of the push switch. Note that the dial may be a rotary knob with a push switch in the center, in which case the capacitance sensitivity of the dial area and the push switch area may be equal.

[0019] <Functional Configuration of Operation Devices> The display panel 210 includes a surface cover 211, a dielectric layer 213 for detecting capacitance values, and an LCE layer (or LED layer) 214 for display. The physical operation unit 212 includes a push switch and a dial. A slider may also be included in the physical operation unit 212. The control unit 220 determines user input based on the potential detected from the dielectric layer 213, instructs the execution of an operation according to the input, and displays the operation content and result on the LCE layer 214 of the display panel 210.

[0020] The control unit 220 includes a region database 221, a physical operation unit database 222, a determination region separation unit 223, a physical operation region operation determination unit 224, an operation outside the physical operation region determination unit 225, an operation instruction unit 226, and a display instruction unit 227. The region database 221 stores information on the display panel 210 regarding the region where a physical operation unit is installed and the region where a physical operation unit is not installed. The physical operation unit database 222 stores the operation content corresponding to the position of the physical operation unit in the region. The region database 221 and the physical operation unit database 222 may be stored in advance, or they may be stored by user settings from the setting unit 230. Furthermore, the region database 221 and the physical operation unit database 222 may store information together rather than separately.

[0021] The determination area separation unit 223 acquires the current detected from the dielectric layer 213 along with the XY coordinates of the display panel 210, and separates whether an area is equipped with a physical operation unit or not based on information from the area database 221. The physical operation area operation determination unit 224 detects operations on the physical operation unit based on information from the physical operation unit database 222. The physical operation area outside operation determination unit 225 detects operations outside the physical operation area. Note that the detection of changes in capacitance from the dielectric layer 213 may be performed by the control unit 220, or the control unit 220 may acquire output data from a detection unit separate from the control unit 220.

[0022] The operation instruction unit 226 instructs the operation execution unit 240 to execute an operation according to the determination results of the physical operation area operation determination unit 224 and the operation outside the physical operation area determination unit 225. The display instruction unit 227 instructs the LCE layer 214 to display an operation according to the determination results of the physical operation area operation determination unit 224 and the operation outside the physical operation area determination unit 225, or to display the operation result.

[0023] (Explanation of different capacitance sensitivities) Figure 3A illustrates the difference in capacitance sensitivity between areas with and without physical controls. To achieve different capacitance sensitivities, the control unit 220 adjusts at least one of the amplification and threshold values ​​related to capacitance sensitivity used in the physical control area where the physical controls are installed to a different value from at least one of the amplification and threshold values ​​used in the area outside the physical control area. For example, the sensitivity of the dial area is less than or equal to the sensitivity of the push switch area, but higher than the sensitivity of the touch area.

[0024] Figure 3A shows the capacitance detection results 311 in the push switch area and 321 in the dial area, as well as the capacitance detection results 331 in the area without physical controls (i.e., the area that directly touches the display panel, also referred to as the area outside the physical controls). The position of the user's finger during operation (distance from the dielectric, height) differs for the push switch 260, the dial 250, and the panel surface 211.

[0025] Distance between the user's finger and the dielectric layer 213 when operating the push switch 260. > Distance between the user's finger and the dielectric layer 213 when operating dial 250 > Distance between the user's finger and the dielectric layer 213 when directly operating the display panel. That is the case. Therefore, the capacitance detection result is, conversely, Push switch area detection result 311 < Dial area detection result 321 < The detection result for being outside the physical operation area is 331.

[0026] Therefore, in order to improve the detection accuracy of operations on push switches and dials, it is necessary to increase the sensitivity to detecting changes in capacitance in those regions. For this purpose, the amplification of the detected capacitance is set such that push switch region ≥ dial region > outside the physical operation region. The correspondence between the amplified operation position and the output corresponding to the capacitance is shown in graph 313 for the push switch position, graph 323 for the dial position, and graph 332 for the area outside the physical operation region (no amplification outside the physical operation region). In this case, it is desirable that the threshold values ​​for the push switch region (Sh1a), the dial region (Sh1b), and the area outside the physical operation region (Sh2) be set to values ​​that allow for accurate determination of the presence or absence of operation from the amplified output, and that are less affected by noise. Threshold values ​​(Sh1a), (Sh1b), and (Sh2) may be the same.

[0027] Furthermore, if sensitivity is adjusted only by a threshold value without adjusting the amplification level, the threshold value used to determine whether or not user operation has occurred is: Threshold in the push switch area (Sh1a) < Dial area threshold (Sh1b) < Threshold outside the physical operation area (Sh2) It is set to that. In other words, the capacitance sensitivity is the opposite of the threshold. Push switch area sensitivity > Dial area sensitivity > Sensitivity outside the physical control area This is the result.

[0028] The combination of amplification and threshold for each region is set according to the position of the user's finger during operation. For example, it is desirable to set it so that the sensitivity of the push switch region ≥ the sensitivity of the dial region > the sensitivity outside the physical operation area.

[0029] Figure 3B illustrates the operation of the dial 250. The dial 250 has a non-dielectric dial base 351 fixed to the panel surface 211 of the display panel 210, and a non-dielectric dial upper part 352 rotatably positioned on the dial base 351. When the user rotates the dial upper part 352 with their finger, the positions of two peaks (above a threshold) corresponding to the approach of the finger change, as shown in the detection result 321 on the right. The amount of operation of the dial 250 is detected from the rotation angle. Alternatively, the operating speed may be detected from the rotation speed of the peaks.

[0030] (Regional Database) Figure 4A shows the configuration of the region database 221 according to this embodiment. The region database 221 stores the amplification and threshold values ​​used by the determination region separation unit 223, the physical operation region operation determination unit 224, and the physical operation region outside operation determination unit 225 in order to detect user operations with different capacitance sensitivities in the region where the physical operation unit is installed and the region where the physical operation unit is not installed.

[0031] The region database 221 stores operation types 412 associated with region 411. In this embodiment, push switches and dials are stored as operation types 412 in the physical operation region. For each region 411 or operation type 412, pairs of amplification 413 and thresholds 414 with different capacitance sensitivities are stored. For example, the amplification 413 is stored as "2.0" in the push switch region where the output corresponding to the change in capacitance is small, "1.5" in the dial region where the output corresponding to the change in capacitance is moderate, and "1.0" outside the physical operation region where the output corresponding to the change in capacitance is large. The thresholds 414 store threshold Th1a for push switch detection, threshold Th1b for dial detection, and threshold Th2 for detection outside the physical operation region. Note that when the sensitivity is changed using only the thresholds, threshold Th1a < threshold Th1b < threshold Th2.

[0032] (Physical Control Unit Database) Figure 4B shows the configuration of the physical operation unit database 222 according to this embodiment. The area database 221 stores information used by the physical operation area operation determination unit 224 to determine the type of physical operation (push switch or dial) attached to the physical operation unit based on the location where a change in capacitance is detected. In Figure 4B, the last letter of each physical operation type is added to distinguish cases where the same physical operation type has different corresponding processing content. The same applies to subsequent physical operation unit databases.

[0033] The physical operation unit database 222 stores physical operation types 422 in association with area 421. In this embodiment, push switches and dials are stored as physical operation types 422. For each push switch or dial of physical operation type 422, the database stores position information 432 of the physical operation unit indicated by the XY coordinates of the display panel 210, information 424 indicating whether the operation is a stationary operation such as a push switch or a moving operation such as a dial, processing content 425 corresponding to the physical operation type 422 and position information 432, and device operation content 426. Device operation content 426 is information indicating what operation the connected device will perform when each of the physical operation units is operated.

[0034] <Hardware configuration of the control unit> Figure 5 is a block diagram showing the hardware configuration of the control unit 220 according to this embodiment. Figure 5 also shows the display panel 210, the setting unit 230, and the operation execution unit 240. In Figure 5, components similar to those in Figure 2 are given the same reference numerals, and redundant explanations are omitted.

[0035] In Figure 5, the CPU (Central Processing Unit) 510 is a processor for arithmetic control, and it realizes the functional configuration shown in Figure 5 by executing a program. There may be one or more CPUs 510. The ROM (Read Only Memory) 520 stores fixed data such as initial data and programs, as well as the program itself.

[0036] The RAM (Random Access Memory) 540 is a random access memory used by the CPU 510 as a temporary storage work area. The RAM 540 has an area reserved for storing the data necessary for realizing this embodiment. The capacitance acquisition information 541 is information about capacitance acquired from the dielectric layer (capacitance detection unit) 213 of the display panel 210, and includes the XY coordinates on the display panel 210. The parameters for the physical operation area 542 are parameters used in the area where the physical operation unit is installed, and include the area coordinates of the physical operation area and the amplification and threshold values ​​used. The physical operation determination result 543 is the determination result determined by the threshold within the physical operation area. The physical operation instruction / display data 544 is data that instructs the physical operation corresponding to the physical operation determination result 543 determined by the threshold within the physical operation area, and the corresponding display data. The parameters for areas outside the physical operation area 545 are parameters used in areas where the physical operation unit is not installed, and include the area coordinates outside the physical operation area and the amplification and threshold values ​​used. The physical operation exclusion determination result 546 is the determination result determined by a threshold outside the physical operation area. The physical operation exclusion instruction / display data 544 is data that instructs a physical operation corresponding to the physical operation exclusion determination result 546 determined by a threshold outside the physical operation area, and the corresponding display data.

[0037] The storage 550 stores the following data or programs used by the CPU 510, such as databases, various parameters, or data necessary for realizing this embodiment. The area database 221 stores data having the configuration shown in Figure 4A. The physical operation unit database 222 stores data having the configuration shown in Figure 4B.

[0038] The following programs are stored in storage 550: The operation device control program 551 is a program that controls the entire operation device 200. The panel setting module 552 is a module for setting the operation area on the display panel 210. The input determination module 553 is a module that determines user operation input on the display panel 210. The operation instruction / display module 554 is a module that instructs the execution of the operation corresponding to the determined user operation input and controls the display of the operation or the display of the execution result.

[0039] The input / output interface 560 interfaces the control unit 220 with external devices and peripherals. In this embodiment, the setting unit 230 and the operation execution unit 240 (which may be located in another device) are connected. The display panel interface 570 connects the control unit 220 to the capacitance detection unit (dielectric layer) 213 and the display unit (LCE layer or LED layer) 214 of the display panel 210.

[0040] Note that the RAM 540 and storage 550 in Figure 5 do not show programs or data related to general-purpose functions as operating devices or other feasible functions.

[0041] <Processing Procedures of the Control Unit> Figure 6 is a flowchart showing the processing procedure of the control unit 220 according to this embodiment. This flowchart is executed by the CPU 510 in Figure 5 using the RAM 540, and realizes the components of the control unit 220 in Figure 2.

[0042] In step S601, the control unit 220 performs a panel setting process to set the operation area on the display panel 210. In step S603, the control unit 220 performs an input determination process to determine user operation input on the display panel 210. In step S605, the control unit 220 performs an operation instruction / display process to instruct the execution of the operation corresponding to the determined user operation input and to control the display of the operation or the execution result.

[0043] (Panel setting process) Figure 7A is a flowchart showing the procedure for the panel setting process S601 according to this embodiment.

[0044] In step S711, the control unit 220 acquires and sets (stores) the area arrangement on the display panel 210. In step S713, the control unit 220 acquires the area (XY coordinates) on the display panel 210 other than the physical operation area and stores it along with the amplification factor and threshold. Note that if the area other than the physical operation area is to be treated as an existing process, the amplification factor does not need to be set. In step S715, the control unit 220 acquires the position (XY coordinates) and operation type of the physical operation area on the display panel 210 and stores it along with the amplification factor and threshold.

[0045] (Input detection process) Figure 7B is a flowchart showing the procedure of the input determination process S603 according to this embodiment.

[0046] In step S721, the control unit 220 acquires the capacitance of each position (XY coordinate) on the display panel 210. In step S723, the control unit 220 waits to see if a change in capacitance has occurred. If a change in capacitance has occurred, in step S724, the control unit 220 determines whether the location where the change in capacitance occurred is within the area of ​​the physical operation unit. If it is determined to be within the area of ​​the physical operation unit, in step S725, the control unit 220 determines whether the location where the change in capacitance occurred is within the area of ​​the push switch or the area of ​​the dial. If it is within the area of ​​the push switch, in step S726, the control unit 220 amplifies the output corresponding to the change in capacitance. Then, in step S728, the control unit 220 determines whether the change in capacitance is greater than or equal to the threshold Th1a. If the change in capacitance is less than the threshold Th1a, in step S732, the control unit 220 determines that "there was no physical operation by the user". On the other hand, if the change in capacitance is greater than or equal to the threshold Th1a, the control unit 220 determines in step S729 that there has been a physical operation by the user and stores the operation execution instruction and operation display instruction corresponding to the push switch position.

[0047] If the determination in step S725 is within the dial range, the control unit 220 amplifies the output corresponding to the change in capacitance in step S727. Then, in step S730, the control unit 220 determines whether the change in capacitance is greater than or equal to the threshold Th1b (if there is no amplification, Th2 > Th1b > Th1a). If the change in capacitance is less than the threshold Th1b, the control unit 220 determines in step S732 that there was no physical operation by the user. On the other hand, if the change in capacitance is greater than or equal to the threshold Th1b, the control unit 220 determines in step S731 that there was a physical operation by the user and stores the operation execution instruction and operation display instruction corresponding to the dial rotation angle.

[0048] If the determination in step S725 is that the area is outside the physical operation area, the control unit 220 determines in step S733 whether the change in capacitance is greater than or equal to the threshold Th2 (if there is no amplification, Th2 > Th1b > Th1a). If the change in capacitance is less than the threshold Th2, the control unit 220 determines in step S737 that "there was no operation by the user outside the physical operation area." On the other hand, if the change in capacitance is greater than or equal to the threshold Th2, the control unit 220 determines in step S735 that "there was an operation by the user outside the physical operation area" and stores this determination along with the location.

[0049] (Operation instructions / display processing) Figure 7C is a flowchart showing the procedure for the operation instruction / display process S605 according to this embodiment.

[0050] In step S751, the control unit 220 determines from the determination result in input determination process S603 whether the operating area is the area of ​​the physical operating unit or an area other than the physical operating unit. If it is determined to be the area of ​​the physical operating unit, in step S752, the control unit 220 determines whether it is a push switch position or a dial area using the determination result stored in input determination process S603. If it is the push switch area, in step S753, the control unit 220 obtains the operating position from the determination result stored in input determination process S603. Then, in step S755, the control unit 220 issues an execution instruction and a display instruction for the operation corresponding to the operating position.

[0051] If the determination in step S752 is that the dial area is selected, the control unit 220 obtains the operation position and rotation angle from the determination result stored in the input determination process S603 in step S757. Then, it issues an operation execution instruction and a display instruction corresponding to the operation position and rotation angle.

[0052] If the determination in step S751 determines that the area is not a physical operation area, the control unit 220 obtains the operation position from the determination result stored in the input determination process S603 in step S781. Then, it issues an execution instruction and a display instruction for the operation corresponding to the operation position.

[0053] In this embodiment, the input judgment process and the operation instruction / display process are explained separately to avoid complicating the explanation, but they could also be presented as a single flowchart.

[0054] According to this embodiment, the area where the physical operating unit is installed and the other areas can be effectively controlled. In this embodiment, within the area where the physical operating unit is installed, different physical operating units, such as a push switch and a dial, can be effectively controlled.

[0055] [Third Embodiment] Next, an operation device according to the third embodiment of the present invention will be described. Compared to the second embodiment described above, the operation device according to this embodiment has two levels of operation input in the same physical operation unit (push switch) and includes a slider as the physical operation unit. The two levels of operation input distinguish between a contact state where the push switch is in contact with the surface and a pressed state where the push switch is pressed, using capacitance. Furthermore, when the user's finger slides above the multiple push switches and when the user's finger slides while pressing the multiple push switches, the multiple push switches function as different sliders that continuously change predetermined parameters. Other configurations and operations are the same as in the second embodiment, so the same components and operations are denoted by the same reference numerals and their detailed descriptions are omitted.

[0056] (Contact and pressing of the push switch) Figures 8A and 8B illustrate the contact and depression states of the push switch according to this embodiment. In the push switch, the contact state (when the push switch is in contact with the surface) and the depressed state (when the push switch is pressed) are distinguished by the difference in the detected capacitance. In Figure 8A, the same reference numerals are used for components similar to those in Figure 3A, and redundant explanations are omitted.

[0057] Figure 8A shows the capacitance detection results 311 when a finger is in contact with the push switch and the capacitance detection results 811 when the push switch is pressed, in the push switch area of ​​the physical operation area corresponding to user operation. As is clear from Figure 8A, the distance from the surface of the dielectric layer 213 is greater when the finger is in contact with the push switch than when the push switch is pressed, and conversely, the detection output is less when the finger is in contact with the push switch than when the push switch is pressed.

[0058] Therefore, the threshold 813 used to determine the level of user operation on the push switch from the amplified output is: Threshold for contact with the push switch (Sh1a) < Threshold for pressing the push switch (Sh1c) It is set to be such that, in other words, the capacitance sensitivity between the contact and pressing of the push switch is the opposite of the threshold. Sensitivity of contact with the push switch > Sensitivity of pressing the push switch This is the result.

[0059] Figure 8B illustrates the operation determination process, with the change in capacitance during contact and pressing of the push switch on the horizontal axis and the output from the dielectric layer 213 corresponding to the change in capacitance on the vertical axis. In Figure 8B, the dashed line represents the output before amplification, and the solid line represents the output after amplification with an amplification factor of 2.0.

[0060] As shown in Figure 8B, the change in capacitance and the output from the dielectric layer 213 are proportional, and it is clear that a threshold (Sh1a) is set at the output level at which the point 821 where the user's finger touches the push switch is detected, and a threshold (Sh1c) is set at the output level at which the point 822 where the user's finger presses the push switch is detected. The range below threshold (Sh1a) is recognized as no contact, the range between threshold (Sh1a) and threshold (Sh1c) is recognized as contact, and the range above threshold (Sh1c) is recognized as a press.

[0061] (Type of slider) Figure 8C is a diagram illustrating the sliders 831 to 833 in the area of ​​the physical operation unit according to this embodiment.

[0062] The slider 831 has multiple transparent push switches. When the user's finger slides over the multiple transparent push switches, the entire system functions as a slider. Furthermore, because these push switches are transparent (made of transparent material), the display screen of the display panel 210 can be viewed. Here, a predetermined parameter may be continuously changed in different steps depending on whether the user's finger simply touches and slides over the multiple transparent push switches, or whether the user's finger slides while sequentially pressing the multiple transparent push switches. Alternatively, the slider amount may be detected by sliding a finger while in contact with the multiple transparent push switches to control the volume of audio playback, etc. Furthermore, by pressing the transparent push switches, a value corresponding to the detected slider amount may be set or determined.

[0063] The slider 832 functions as a slider when the user's finger slides along a transparent bar, either non-contact or in contact with it, allowing the display screen of the display panel 210 to be seen through it. In the slider 832, when the finger leaves the transparent bar, or when the finger remains in the same position for a predetermined time or longer, a value corresponding to the slider amount is set or determined, and further processing related to the slider is performed.

[0064] Slider 833 is a slider configured to slide an acrylic slider with an acrylic button on a rubber hinge, allowing the user to directly view the display screen of the display panel 210. In slider 833 as well, when the finger leaves the acrylic slider, or when the acrylic slider remains in the same position for a predetermined time or longer, a value corresponding to the slider amount is set or determined, and further processing related to the slider is performed.

[0065] (Rocker switch) Figure 8D illustrates a rocker switch in the area of ​​the physical operation unit according to this embodiment. When the physical operation unit is a rocker switch, the sensitivity is set to detect the change in capacitance when the finger presses the operation button surface and moves from a position far from the display panel to a position close to the display panel. That is, the capacitance threshold is set midway between the capacitance when the finger on the operation button surface is far from the display panel and the capacitance when the finger presses the operation button surface and moves to a position close to the display panel.

[0066] The top surface 841 of the rocker switch in Figure 8D shows the setting operation for the rocker switch ON and OFF. The cross-section 842 of the rocker switch in Figure 8D is a side view of the rocker switch, with a rubber binge sandwiched between the acrylic button that the finger contacts and the cover lens of the capacitive touch sensor. When the finger contacts and presses the acrylic button, the rubber binge is compressed, bringing the finger closer to the capacitive touch sensor. When the capacitance increases and exceeds a threshold, a detection signal is input to a hard or soft flip-flop (not shown), and the ON / OFF state of the rocker switch is stored corresponding to the pressed position.

[0067] Figure 8D shows the relationship between the capacitance detection 843, which detects the ON / OFF state of the rocker switch, and the capacitance output. The threshold Sh1f can be adjusted to accommodate the size and shape of the rocker switch, allowing existing rocker switches to be used as is.

[0068] (Regional Database) Figure 9A shows the configuration of the region database 921 according to this embodiment. In this embodiment, the region database 921 is replaced by the region database 221 in Figure 2. In Figure 9A, the same reference numerals are used for components similar to those in Figure 4A, and redundant explanations are omitted.

[0069] The domain database 921 stores multiple operating levels 913 and amplification levels 914 corresponding to the type of physical operating part, particularly each push switch. It also stores different thresholds 915 corresponding to each operating level 913. In Figure 9A, in addition to the threshold (Th1a) for determining a contact operation, a threshold (TH1c: Th1c > Th1a) for determining a push operation is stored. Furthermore, for rocker switches, a threshold Th1f between contact and push is stored. In addition, sliders 832 and 833 in Figure 8C store thresholds Th1a, Th1b, or other appropriate thresholds depending on the distance of the sliding finger from the dielectric layer surface. Furthermore, slider 831 in Figure 8C stores the threshold Th1a for contact with the push switch and the threshold Th1c for pushing the push switch.

[0070] (Physical Control Unit Database) Figure 9B shows the configuration of the physical operation unit database 922 according to this embodiment. In this embodiment, the physical operation unit database 922 is replaced by the physical operation unit database 222 in Figure 2. In Figure 9B, the same reference numerals are used for components that are the same as those in Figure 4B, and redundant explanations are omitted.

[0071] The physical operation unit database 922 stores multiple operation levels 925 for each operation type, particularly for each push switch. It also stores different corresponding processing content 926 for each operation level. Figure 9B shows that the corresponding processing content 926 stores a selection or notification of processing in response to a contact, and a setting (decide and execute) of processing in response to a push operation. Furthermore, in the case of a rocker switch, the corresponding processing content 926 turns ON or OFF in response to the position where the operation level 925 changes from contact to push.

[0072] Furthermore, the physical operation unit database 922 is a rotary knob with a push switch in the center, and in dial operation, it stores the push switch within the dial. In this case, the corresponding processing content 926 is such that the rotation angle of the dial corresponds to the input value, and the push switch within the input dial corresponds to setting the input value or executing using it. Also, in the operation of the slider 831, the operation level 925 stores contact and pressing, and the corresponding processing content 926 stores the set value (amount of movement) and setting (execution) respectively. In addition, the device operation content 927 stores what operation the connected device performs when each of the physical operation units is operated.

[0073] The combinations of the 422 types of physical operations and the multiple operation levels 925 are not limited to those shown in Figure 9B, and various combinations can be realized.

[0074] <Processing Procedures of the Control Unit> The processing procedure of the control unit 220 is the same as that shown in the flowchart in Figure 6, so redundant explanations will be omitted.

[0075] (Panel setting process) Figure 10A is a flowchart showing the procedure for the panel setting process S601 according to this embodiment, which replaces Figure 7A. In Figure 10A, steps that are the same as in Figure 7A are given the same step numbers, and redundant explanations are omitted.

[0076] In step S1015, the control unit 220 acquires the position (XY coordinates) and operation type of the physical operation unit on the display panel, and stores them together with the amplification factor corresponding to the operation type and the threshold value corresponding to the operation level.

[0077] (Input detection process) Figure 10B is a flowchart of the procedure for the input determination process S603 according to this embodiment, which replaces Figure 7B. In Figure 10B, the same step numbers are used for steps that are the same as in Figure 7B, and redundant explanations are omitted.

[0078] In step S1027, the control unit 220 determines whether the change in the area of ​​the physical operation unit is in the push switch area, the dial area, or the slider area. If it is in the push switch area and the change in capacitance is greater than or equal to a threshold (Th1a), the control unit 220 determines in step S1029 whether the capacitance is greater than or equal to a threshold (Th1c) which is greater than the threshold (Th1a). If the change in capacitance is greater than or equal to a threshold (Th1c), the control unit 220 determines in step S1030 that the push switch has been pressed and stores the push switch position and the press. On the other hand, if the change in capacitance is less than a threshold (Th1c), the control unit 220 determines in step S1031 that the push switch has been contacted and stores the push switch position and the contact operation.

[0079] If the determination in step S1027 determines that the area is within the range of slider 831, the control unit 220 amplifies the output corresponding to the change in capacitance in step S1032. Then, in step S1033, the control unit 220 determines whether the change in capacitance is greater than or equal to a threshold (Th1a). If the change in capacitance is less than the threshold (Th1a), the control unit 220 proceeds to step S732 and determines that there is no physical operation. If the change in capacitance is greater than or equal to the threshold (Th1a), the control unit 220 stores the position and distance moved of the slider in step S1035. In step S1037, the control unit 220 determines whether the change in capacitance is greater than or equal to a threshold (Th1c). If the change in capacitance is less than the threshold (Th1c), the control unit 220 returns to step S1033 and tracks the movement of the slider. When the change in capacitance exceeds a threshold (Th1c), the control unit 220 determines in step S1039 that the slider has finished moving and stores the pressed position. Note that only slider 831 is explained in Figure 10B to avoid complexity. Sliders 832 and 833 can be implemented by setting the thresholds in steps S1033 and S1039 to corresponding values. Furthermore, if the movement speed is to affect the operation, the movement speed is also derived and stored.

[0080] (Operation instructions / display processing) Figure 10C is a flowchart showing the procedure for the operation instruction / display process S605 according to this embodiment, which replaces Figure 7C. In Figure 10C, steps similar to those in Figure 7BC are given the same step numbers, and redundant explanations are omitted.

[0081] In step S1052, the control unit 220 reads the result of the input determination process shown in Figure 10B and determines whether the physical operation is a push switch, a dial, or a slider. If it is determined to be a push switch, in step S1054, the control unit 220 reads the result of the input determination process shown in Figure 10B and determines whether the user's operation is a contact or a press. If the user's operation is a contact, in step S1055, the control unit 220 issues an operation selection instruction and display instruction for the operation corresponding to the operation position. On the other hand, if the user's operation is a press, in step S1056, the control unit 220 issues an operation execution instruction and display instruction for the operation corresponding to the operation position. Note that while contact is described as operation selection or notification, and press is described as execution of the selected operation, the setting of the operation content is not limited to this.

[0082] If it is determined in step S1052 that it is a slider, the control unit 220 obtains the operation position and movement distance from the determination result of the input determination process in Figure 10B in step S1057. Then, in step S1059, the control unit 220 issues an operation execution instruction and a display instruction corresponding to the operation position and movement distance. Note that operations such as sliding a finger upwards on a slider or pressing and sliding multiple push switches are omitted from the flowchart as it would make it too complicated.

[0083] According to this embodiment, multiple operation instructions can be generated by a single physical operation. For example, different operation instructions can be generated depending on whether a push switch is touched or pressed. Furthermore, sliders of various configurations can be set in the physical operation unit. Even with a slider, different operation instructions can be generated depending on whether the user's finger slides upwards or touches or presses and then slides.

[0084] [Fourth Embodiment] Next, an operation device according to the fourth embodiment of the present invention will be described. The operation device according to this embodiment differs from the second and third embodiments in that it has three or more levels of operation input in the same physical operation unit (push switch). The three or more levels of operation input include a state in which a finger is close to the top of the push switch, a state in which a finger is in contact with the push switch, and a state in which the push switch is pressed. Furthermore, it may also include a state in which the push switch is attached to the display panel. Other configurations and operations are the same as in the second or third embodiment, so the same components and operations are denoted by the same reference numerals and their detailed descriptions are omitted.

[0085] (Approaching, contacting, and pressing the push switch) Figures 11A and 11B illustrate the approach, contact, and pressing of the push switch according to this fourth embodiment. In Figure 11A, the same reference numerals are used for components similar to those in Figures 3A and 8A, and redundant explanations are omitted.

[0086] Figure 11A shows an additional capacitance detection point 1111 at the push switch position in the physical operation area corresponding to user operation, when a finger approaches the push switch. As is clear from Figure 11A, the influence of the user's finger on the dielectric layer 213 is such that the distance from the surface of the dielectric layer 213 is: distance when approaching the push switch > distance when touching the push switch > distance when pressing the push switch. Therefore, the magnitude of the detection output is, conversely, output when approaching the push switch < output when touching the push switch < output when pressing the push switch.

[0087] Therefore, the threshold 1113 used to determine the level of user operation on the push switch from the amplified output is set as follows: approach threshold (Sh1d) < contact threshold (Sh1a) < push switch pressing threshold (Sh1c). In other words, the capacitance sensitivity for approach, contact, and pressing the push switch is considered to be the opposite of the thresholds: sensitivity for approach > sensitivity for contact > sensitivity for pressing.

[0088] Figure 11B illustrates the operation determination process, with the change in capacitance during approach, contact, and pressing of the push switch on the horizontal axis and the output from the dielectric layer 213 on the vertical axis. In Figure 11B, components identical to those in Figure 8B are given the same reference numerals, and redundant explanations are omitted. In Figure 11B, the dashed line represents the output before amplification, and the solid line represents the output after amplification with an amplification factor of 3.0.

[0089] As shown in Figure 11B, the change in capacitance and the output from the dielectric layer 213 are proportional, and a threshold (Sh1d) is set at the output level at which the state 1123 in which the user's finger is close to the push switch is detected. It is also clear that a threshold (Sh1e) is set at the output level at which the point 1124 in which the push switch is attached to the surface of the display panel 210 is detected. The range below threshold (Sh1d) is recognized as OFF, the range between threshold (Sh1d) and threshold (Sh1a) is recognized as approach, and the range between threshold (Sh1a) and threshold (Sh1c) is recognized as contact. Furthermore, the range between threshold (Sh1c) and threshold (Sh1e) is recognized as pressing, and the range above threshold (Sh1e) is recognized as ON. Furthermore, Figure 11B also shows that it is possible to have a continuous analog input where the range (822) between the threshold (Sh1a) and the threshold (Sh1e) is treated as a pressed state rather than a pressed event.In addition, in the operation of the slider in the third embodiment in which the user's finger slides upward, the sliding operation can be realized by setting the amplification and threshold, similar to the state in which the user's finger approaches the push switch.

[0090] (Regional Database) Figure 12A shows the configuration of the region database 1221 according to this embodiment. In this embodiment, the region database 1221 is replaced by the region database 221 in Figure 2. In Figure 12A, the same reference numerals are used for components similar to those in Figure 4A, and redundant explanations are omitted.

[0091] The domain database 1221 stores multiple operation levels 1213 for each operation type, particularly for each push switch. It stores amplification levels 1214 corresponding to the magnitude of capacitance in each operation type. It also stores different thresholds 1215 corresponding to each operation level. In Figure 12A, in addition to the threshold (Th1a) for determining contact operation and the threshold (TH1c: Th1c > Th1a) for determining push operation, a threshold (Th1d: Th1c > Th1a > Th1d) for determining approach operation is stored. Although not shown in Figure 12A, a threshold (Th1e: Th1e > Th1c > Th1a > Th1d) for determining ON (adhesion) of the fourth push switch to the display panel may also be stored. Furthermore, in the case of a slider, if input is by approach rather than contact, Th1d is stored as the threshold 1215 corresponding to the approach operation level 1213. Furthermore, when a slider is used to input a setting value by approaching and sliding a finger, and when the setting or confirmation is made by contact or pressing, the approach and contact / press are stored in the operation level 1213, and the corresponding thresholds 1215, Th1d and Th1a / Th1c, are stored.

[0092] (Physical Control Unit Database) Figure 12B shows the configuration of the physical operation unit database 1222 according to this embodiment. In this embodiment, the physical operation unit database 1222 is replaced by the physical operation unit database 222 in Figure 2. In Figure 12B, the same reference numerals are used for components similar to those in Figure 4B, and redundant explanations are omitted.

[0093] The physical operation unit database 1222 stores multiple operation levels 1225 for each operation type, particularly for each push switch. It also stores different identifiable display colors and brightness levels 1226 and corresponding processing content 1227 that change in accordance with each operation level. Figure 12B shows that the display colors and brightness levels 1226 may include, for example, yellow or low brightness for approach, green or medium brightness for contact, and red or high brightness for pressing. The corresponding processing content 1227 may include processing for preparation for selection in response to approach, processing selection or notification in response to contact, and processing setting (decision and execution) in response to pressing.

[0094] Furthermore, the setting value is entered by bringing a finger close and sliding it. In the case of a slider that is set or confirmed by contact or pressing, in response to the approach of operation level 1225, yellow / low brightness is stored in the display color / brightness 1226 and the input of the setting value (amount of movement) is stored in the corresponding processing content 1227. Then, in response to the contact / press of operation level 1225, red / high brightness is stored in the display color / brightness 1226 and the setting (execution) using the setting value is stored in the corresponding processing content 1227. In addition, the device operation content 1228, which indicates what operation the connected device will perform when each physical operation part is operated, is stored.

[0095] Furthermore, the combinations of the 422 types of physical operations and the multiple operation levels 1225 are not limited to those shown in Figure 12B, and various combinations can be realized.

[0096] <Processing Procedures of the Control Unit> The processing procedure of the control unit 220 is the same as the flowchart shown in Figure 6, so redundant explanations will be omitted. Also, the panel setting process in this embodiment can be inferred from Figures 7A and 10A, so details will be omitted.

[0097] (Input detection processing and operation instruction / display processing) Figure 13 is a flowchart showing the procedures for the input determination process S603 and the operation instruction / display process S605 according to this embodiment, which can be replaced by Figures 7B and 10B or 7C and 10C. In Figure 13, steps similar to those in Figures 7B and 10B or 7C and 10C have been omitted from the drawing to avoid complexity, but the same processing is performed. Also, Figure 13 only shows the flowchart of the processing procedure related to the push switch, but the processing procedures for other physical operation units are omitted as they can be easily conceived by setting the threshold value to an appropriate value for that physical operation unit.

[0098] The left diagram in Figure 13 is a flowchart following step S726 in Figure 10B. In step S1327, the control unit 220 determines whether the change in capacitance is greater than or equal to the threshold (Th1d). If it is determined that the change in capacitance is less than the threshold (Th1d), the control unit 220 proceeds to step S732 and determines that no physical operation is required.

[0099] Furthermore, if the change in capacitance is determined to be greater than or equal to a threshold (Th1d), the control unit 220 determines in step S728 whether the change in capacitance is greater than or equal to a threshold (Th1a). If the change in capacitance is less than a threshold (Th1a), the control unit 220 determines in step S1332 that the push switch has been approached and stores the push switch position and the approach.

[0100] The right-hand diagram in Figure 13 is a flowchart of this embodiment from step S753 onwards in Figure 10C. In step S1354, the control unit 220 determines from the determination result of input determination process S603 of this embodiment whether the push switch is being approached, touched, or pressed. If the determination result is approaching, the control unit 220 issues an operation preparation instruction and a display instruction corresponding to the operation position in step S1357.

[0101] Furthermore, when using a threshold value (Th1e) to determine the adhesion of the push switch to the display panel, a more diverse range of inputs can be enabled by adding a branching step for the determination.

[0102] According to this embodiment, multiple operation instructions can be generated by a single physical operation. For example, three or more different operation instructions can be generated by approaching, touching, and pressing a push switch.

[0103] [Fifth Embodiment] Next, an operation device according to the fifth embodiment of the present invention will be described. Compared to the second and fourth embodiments described above, the operation device according to this embodiment differs in that, before using the operation device, the capacitance sensitivity for detecting changes in the dielectric capacitance of each region or physical operating part is calibrated. That is, the type of physical operating part attached to the physical operating part region and the capacitance sensitivity for detecting changes in capacitance in at least one of the areas outside the physical operating part region are adjusted by input from the user. The amplification and / or threshold, which are parameters related to capacitance sensitivity, are calibrated to enable stable and accurate operation from the operation device. Other configurations and operations are the same as in the second or fourth embodiment, so the same reference numerals are used for the same configurations and operations and their detailed descriptions are omitted.

[0104] <Operation of the calibration section of the operation device> Figure 14A illustrates the operation of the operation device during calibration according to this embodiment. Figure 14A shows the user interface for the operation of the operation device 200 on the display panel 210 during calibration in Figure 2. In Figure 14A, the same reference numerals are used for components that are the same as in Figure 2, and redundant explanations are omitted.

[0105] The screen 1400 of the display panel 210 displays a message indicating that calibration has started, along with buttons to select the calibration area or the target physical operating part. The buttons include a button 1401 that instructs calibration outside the physical operating part area, and a button 1405 that instructs calibration of the three-stage input (approach, contact, press) push switches within the physical operating part area.

[0106] When the user touches button 1401 outside the physical control area on screen 1400, the display screen transitions to screen 1410, and a comment or voice instruction such as "Please touch outside the physical control area" is output. At this time, if the area outside the physical control area 1411 to be operated on is displayed in a distinguishable color, the user will be able to clearly see the touch location and prevent operation errors. When the user touches the surface of the area outside the physical control area 1411 on screen 1410, the display screen transitions to screen 1420, which displays a graph showing the change in detected capacitance and buttons for inputting an increase or decrease in amplification and threshold, which are parameters for calibration. The user can set the amplification and threshold to a level that allows for stable and accurate detection of the user's touch on the area outside the physical control area 1411 by repeatedly touching the surface of the area outside the physical control area 1411 while inputting an increase or decrease in amplification and threshold while viewing the graph. Once the appropriate setting of amplification and threshold is complete, a comment or voice instruction such as "Adjustment of the area outside the physical control area is complete" is output. At this time, if the color of the area outside the physical control unit 1430 is displayed as a different color from that of the area outside the physical control unit 1411, the user can be clearly informed that the adjustment is complete. In Figure 14A, the example of user touch on the area outside the physical control unit 1411 was used, but if different input operations are set for approach and contact on the area outside the physical control unit 1411, the amplification and threshold values ​​should be set so that the approach and contact operations can be detected stably and accurately.

[0107] On the other hand, when the user touches button 1405 of the three-stage push switch in the physical operation area on screen 1400, the display screen transitions to screen 1450, and if the user touches the surface of the three-stage push switch, a comment or voice instruction such as "Please touch the target push button" is output. At this time, if the color of the push switch 1451 to be operated and the surrounding area are displayed in a color that can be distinguished, the user can easily understand the contact position and prevent operational errors. When the user touches the surface of the push switch 1451, the display screen transitions to screen 1460, which displays a graph showing the change in detected capacitance and buttons for inputting an increase or decrease in amplification and threshold values, which are parameters for calibration. In Figure 14A, since it is a three-stage push switch, the threshold values ​​can be adjusted for approach, contact, and press. The user can repeatedly perform approach, contact, and press operations on the three-stage push switch while inputting increases or decreases in amplification and threshold values ​​while viewing the graph, and set the amplification and each threshold value so that the user's operation input to the three-stage push switch can be stably and accurately detected. Once the amplification level and threshold values ​​are set appropriately, a comment or voice command stating "The adjustment of the target push switch is complete" will be output. At this time, if the color of the push switch 1451 is displayed in a different color than before the adjustment, the user can be clearly informed that the adjustment is complete. In Figure 14A, the approach, contact, and pressing of a three-stage push switch were used as examples, but when setting different input operations for other physical operating parts, the amplification level and threshold values ​​should be set so that stable and accurate detection is possible for each operation.

[0108] (Regional Database) Figure 14B shows the configuration of the domain database 1421 according to this embodiment. The domain database 1421 is used interchangeably with Figures 4A, 9A, and 12A. In Figure 14B, steps similar to those in Figures 4A, 9A, and 12A are given the same reference numbers for the same components, and redundant explanations are omitted.

[0109] The domain database 1421 stores the appropriate calibrated amplification 1414 and threshold 1415 associated with the operation level 913 of each type of operation unit. For example, the appropriate calibrated amplification for push switch i is "3.1" and the threshold is "Th1a-δ". The appropriate calibrated amplification for push switch n is "2.9". The threshold for detecting approach is "Th1d-α", the threshold for detecting contact is "Th1a+β", and the threshold for detecting approach is "Th1d±0".

[0110] Furthermore, the appropriate calibrated amplification for the touch panel area outside the physical operation area is "0.8" and the threshold is "Th2-c".

[0111] (Panel setting process) Figure 14C is a flowchart showing the procedure for the panel setting process S601 according to this embodiment. Figure 14C is executed interchangeably with Figure 7A. In Figure 14C, steps similar to those in Figure 7A are given the same step numbers, and redundant explanations are omitted.

[0112] In step S1412, the control unit 220 performs calibration processing of the amplification and threshold in areas other than the physical operation unit. In step S1414, the control unit 220 also performs calibration processing of the amplification and threshold in the physical operation unit area.

[0113] (Calibration process for areas outside the physical control unit) Figure 15A is a flowchart showing the procedure for the calibration process S1412 of the area outside the physical operation unit according to this embodiment.

[0114] In step S1510, the control unit 220 sets default parameters (amplification value and threshold). These default parameters are set to values ​​that allow operation input from the display panel 210 to the operation device 200, based on the physical properties of the display panel 210.

[0115] In step S1511, the control unit 220 determines whether or not the user will adjust the parameters. If it is determined that the user will adjust the parameters, the process proceeds to step S1513. If it is determined that the user will not adjust the parameters, the process proceeds to step S1531 to determine whether or not the device (control unit) will adjust the parameters. If it is determined that the device will adjust the parameters, the process proceeds to step S1533. The information regarding whether or not to adjust the parameters may be stored in the control unit in advance, or it may be selected by the user.

[0116] In step S1513, the control unit 220 clearly indicates areas other than the physical operation area and instructs the user to perform an operation. Then, in step S1515, the control unit 220 waits for user input to the areas other than the physical operation area. If user input is received from the user to the areas other than the physical operation area, in step S1517, the control unit 220 acquires and displays the change in capacitance due to the operation input and outputs the result of the input operation determination based on the retained parameters, initially the default parameters. In step S1519, the control unit 220 determines whether or not the user has entered an update to the parameters. If the user has entered an update to the parameters, the control unit 220 returns to step S1513 and repeats the process. On the other hand, if the user has not entered an update to the parameters, the control unit 220 determines that the appropriate parameters have been set and registers the latest updated parameters in the area database 221 in step S1521. Then, in step S1523, the control unit 220 determines whether there are any other operations in areas other than the physical operation unit for which the parameters are to be adjusted. If there are other operations, the control unit 220 returns to step S1513 and repeats the process.

[0117] In step S1533, the control unit 220 identifies the target operation unit (such as a push switch or dial) in the physical operation unit area and instructs the user to perform an operation. Then, in step S1535, the control unit 220 waits for the user to input an operation to the target operation unit in the physical operation unit area. If the user inputs an operation to the target operation unit in the physical operation unit area, in step S1537, the control unit 220 acquires the change in capacitance due to the operation input, outputs a judgment result of the input operation using the stored parameters, initially default parameters, and derives parameters by analyzing the judgment result. In step S1539, the control unit 220 determines whether appropriate parameters have been derived. If appropriate parameters are not derived, the control unit 220 returns to step S1533 and repeats the process. On the other hand, if appropriate parameters are derived, the control unit 220 registers the derived appropriate parameters in the area database 221 in step S1541. Then, in step S1543, the control unit 220 determines whether there are any other operations in areas other than the physical operation unit for which the parameters are to be adjusted. If there are other operations, the control unit 220 returns to step S1533 and repeats the process.

[0118] (Calibration process for the physical control area) Figure 15B is a flowchart showing the procedure for the calibration process S1414 of the physical operation area according to this embodiment.

[0119] In step S1551, the control unit 220 waits for input regarding the type of operation unit (such as the type of push switch or slider) in the physical operation unit. If input regarding the type of operation unit is received, the control unit 220 sets the default parameters (amplification value and threshold) for the target type of operation unit in step S1553.

[0120] In step S1561, the control unit 220 determines whether or not the user will adjust the parameters. If it is determined that the user will adjust the parameters, the process proceeds to step S1563. If it is determined that the user will not adjust the parameters, the process proceeds to step S1581 to determine whether or not the device (control unit) will adjust the parameters. If it is determined that the device will adjust the parameters, the process proceeds to step S1583. The information regarding whether or not to adjust the parameters may be stored in the control unit in advance, or it may be selected by the user.

[0121] In step S1563, the control unit 220 identifies the target operating unit in the physical operating unit area and instructs the user to perform an operation. Then, in step S1565, the control unit 220 waits for user input to the target operating unit. If user input is received, in step S1567, the control unit 220 acquires and displays the change in capacitance due to the input and outputs the result of the input operation determination based on the retained parameters, initially the default parameters. In step S1569, the control unit 220 determines whether the user has entered a parameter update. If the user has entered a parameter update, the control unit 220 returns to step S1563 and repeats the process. On the other hand, if the user has not entered a parameter update, the control unit 220 determines that the appropriate parameter settings have been made and registers the latest updated parameters in the area database 221 in step S1571. Then, in step S1573, the control unit 220 determines whether the same type of operating unit has other states. For example, in the case of a three-stage push switch, parameters are adjusted for three states: approach state, contact state, and pressed state. If there are other states, the control unit 220 returns to step S1563 and repeats the process. If there are no other states, the control unit 220 determines in step S1575 whether there are other types of operating parts for which parameters are adjusted. If there are other types of operating parts, the control unit 220 returns to step S1551 and waits for input of the type of other operating part.

[0122] In step S1583, the control unit 220 identifies the target operation unit (such as a push switch or dial) in the physical operation unit area and instructs the user to perform an operation. Then, in step S1585, the control unit 220 waits for the user to input an operation to the target operation unit in the physical operation unit area. If the user inputs an operation to the target operation unit in the physical operation unit area, in step S1587, the control unit 220 acquires the change in capacitance due to the operation input, outputs the judgment result of the input operation using the stored parameters, initially default parameters, and derives parameters by analyzing the judgment result. In step S1589, the control unit 220 determines whether appropriate parameters have been derived. If appropriate parameters are not derived, the control unit 220 returns to step S1583 and repeats the process. On the other hand, if appropriate parameters are derived, the control unit 220 registers the derived appropriate parameters in the area database 221 in step S1591. Then, in step S1593, the control unit 220 determines whether there are other states for the same type of operating unit. For example, for a three-stage push switch, parameters are adjusted for three states: approach state, contact state, and pressed state. If there are other states, the control unit 220 returns to step S1583 and repeats the process. If there are no other states, the control unit 220 determines in step S1595 whether there are other types of operating units for which parameters are adjusted. If there are other types of operating units, the control unit 220 returns to step S1551 and waits for input of the type of other operating unit.

[0123] According to this embodiment, stable and accurate operation input can be obtained from an operation device using capacitance.

[0124] [Industrial application fields] The application fields of the operation device described above will now be explained. In this embodiment, a configuration in which the operation device described in the first to fifth embodiments is applied to systems in various fields will be described. The aforementioned operation device can be applied to, for example, audio mixers, automobile control panels, monitors for viewing medical information, machine tool control units, construction machinery and ship control units, amusement equipment control units such as game machines, computer and computer peripheral control units, and ticket vending machines for railways and ships. According to this embodiment, the necessary types of control units, such as dials and switches, can be freely arranged at desired positions on the display panel, and the operating precision and role of each control unit can be set by software.

[0125] For example, when this embodiment is applied to an audio mixer, the push switches mounted as physical controls would be used for selecting songs (melodies) and rhythms, the dials for setting the overall volume and tempo of the song, and the sliders for setting the volume and rhythm of each part. They would also be used for cutting, connecting, and combining melodies, volumes, and rhythms. On the other hand, when this embodiment is applied to an in-vehicle unit, the push switches become the controls for turning the speaker and air conditioner on and off, while the dials and sliders become the controls for adjusting the air conditioner temperature and airflow, selecting and scrolling the car navigation map, and so on.

[0126] <System using an operating device> Figure 16 is a block diagram showing the configuration of system 1600 using the operation device according to this embodiment. In Figure 16, the same reference numerals are used for components similar to those in Figure 2, and redundant explanations are omitted.

[0127] Figure 16 shows a configuration in which the operation execution unit 240 receives operation instructions from the control unit 220, and the results of the instruction operation are output to various peripheral devices via the input / output interface 1610. For example, peripheral devices such as the audio output unit 1611, the sprint glasses (HMD) 1612, and the head-up display 1613 are connected to realize audio output and screen display of the operation instruction results.

[0128] (Physical Control Unit Database) Figure 17 shows the configuration of the physical operation unit database 1722 for use in multiple fields according to this embodiment. In Figure 17, components similar to those in Figure 4B are given the same reference numerals, and redundant explanations are omitted.

[0129] Figure 17 shows that physical control unit databases 1723 and 1724 are prepared for each application field 1711. For example, if the application field 1711 is automobiles, physical control unit database 1723 is used, and the operation device is controlled so that operation instructions related to car navigation are possible in the corresponding processing content 1727. If the application field 1711 is the medical field, physical control unit database 1724 is used, and the operation device is controlled so that operation instructions related to medical care by nurses and doctors are possible in the corresponding processing content 1728.

[0130] (Example of application to car navigation systems) Figure 18A shows an example configuration in which the operation device according to this embodiment is applied to a car navigation system 1810 mounted in an automobile.

[0131] (Examples of application in the medical field) Figure 18B shows an example configuration in which the operation device according to this embodiment is applied to a medical processing system 1820 that utilizes the device in the medical field. Figure 18B shows the operation device 1821 according to this embodiment for operation and the main display 1822 for displaying the operation results. The application fields of the operation device according to this embodiment are not limited to the above example, and other possibilities include application to the control units of industrial equipment, control units for construction machinery and marine equipment, control units for amusement equipment such as game machines, and control units for computers (PCs) and computer peripherals (HID devices).

[0132] (Wall-mounted display) Figure 18C shows system configurations 1830 and 1840 in which the operation device according to this embodiment is embedded in a wall.

[0133] System configuration 1830 is an example in which the operation device of this embodiment is embedded in the wall and used, for example, in a digital signage display. System configuration 1840 is an example in which the operation device of this embodiment is embedded in the wall and used for indoor environmental adjustment or adjustment of home appliances. It may also be used as a communication screen with the outside.

[0134] (Ticket vending machine at the station) The operation device according to this embodiment can be applied to station ticket vending machines and the like, and is highly effective. For example, by attaching a transparent push switch as a physical operation unit to a single display panel and displaying the fare and destination on the display at the mounting position of the transparent push switch, changes and updates to fares in ticket vending machines can be easily achieved by attaching the transparent push switch and changing or updating the software.

[0135] As described above, the operation device according to this embodiment can be applied to operating units in various fields.

[0136] [Other embodiments] In the above embodiment, the specific configuration of the detection unit for detecting changes in capacitance is not shown. However, even if the detection unit is configured to be detected by the control unit using known technology, it may also be configured such that a detection unit (e.g., an IC chip) for detecting changes in capacitance is provided between the display panel and the control unit, and the control unit acquires its digital output. While changes in capacitance are usually detected by applying a waveform or rectangular pulse of a predetermined frequency and detecting the current change associated with the change in capacitance, there are no restrictions on the detection method used in this embodiment.

[0137] Furthermore, in the above embodiment, push switches, rocker switches, dials, and sliders were described as examples of physical operation units mounted on the display panel. However, the mounted physical operation unit can be any physical operation component capable of detecting the user's finger movements during physical operation as changes in capacitance or movement of the change position. Differences in size and shape of the physical operation unit can also be absorbed by adjusting the amplification and threshold (sensitivity) in this embodiment, so existing physical operation units can be used as is.

[0138] Furthermore, although the surface of the display panel was described as a flat surface in the above embodiment, it may also be a convex or concave curved surface. It is also possible to bend the area where the physical control unit is attached and the area where the physical control unit is not attached at a predetermined angle.

[0139] Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments. Various modifications to the structure and details of the present invention can be made, as can be understood by those skilled in the art within the technical scope of the present invention. Furthermore, any system or apparatus that combines the separate features included in each embodiment is also within the technical scope of the present invention.

[0140] Furthermore, the present invention may be applied to a system composed of multiple devices or to a single device. Moreover, the present invention is also applicable when an information processing program that realizes the functions of the embodiment is supplied to a system or device and executed by a built-in processor. The technical scope of the present invention includes programs installed on a computer to realize the functions of the present invention on a computer, or a medium storing such a program, a server that downloads such a program, and a processor that executes such a program. In particular, at least a non-transitory computer-readable medium storing a program that causes a computer to execute the processing steps included in the embodiments described above is included in the technical scope of the present invention.

Claims

1. A display panel having an operation detection function and an image display function using changes in capacitance, A physical operating unit attached to the surface of the display panel, the position and orientation of which can be changed by user operation, A control unit that detects a change in at least one of the position and orientation of the physical operating unit using the capacitance value, An operating device equipped with, The display panel includes a physical operation area on which a dial or push switch serving as a physical operation unit is attached, and a touch area on which the physical operation unit is not attached. An operating device in which the capacitance sensitivity of the physical operation area is higher than that of the touch area.

2. The operation device according to claim 1, wherein at least one of the first amplification and first threshold used in the physical operation area and at least one of the second amplification and second threshold used in the touch area are adjusted to different values.

3. The operation device according to claim 1, wherein the physical operation unit has a plurality of push switches, and distinguishes between a contact state in which the surfaces of the plurality of push switches are in sliding contact and a pressed state in which any of the plurality of push switches are pressed, based on the difference in capacitance detected.

4. The physical operation unit has a plurality of transmissive push switches, The control unit, A first state in which a finger approaches the upper part of the push switch, The second state in which a finger is in contact with the aforementioned push switch, The third state in which the push switch is pressed, Identify, The operation device according to claim 3, which changes the display of the display panel in the area where the transmissive push switch is attached in the first, second, and third states.

5. The operation device according to claim 1, wherein the physical operation unit is a rotary knob equipped with a push switch in the center.

6. A display panel having an operation detection function and an image display function using changes in capacitance, A physical operating unit attached to the surface of the display panel, the position and orientation of which can be changed by user operation, A control unit that detects a change in at least one of the position and orientation of the physical operating unit using the capacitance value, A control method for an operating device equipped with, A first detection step in which a change in capacitance is detected with a first capacitance sensitivity in a physical operation area on the display panel where the dial or push switch serving as the physical operation unit is attached, A second detection step in which a change in capacitance is detected in a touch area other than the physical operation area with a second capacitance sensitivity lower than the first capacitance sensitivity, A method for controlling an operating device, including an operating device.

7. A display panel having an operation detection function and an image display function using changes in capacitance, A physical operating unit attached to the surface of the display panel, the position and orientation of which can be changed by user operation, A control unit that detects a change in at least one of the position and orientation of the physical operating unit using the capacitance value, A control program for an operating device equipped with, A first detection step in which a change in capacitance is detected with a first capacitance sensitivity in a physical operation area on the display panel where the dial or push switch serving as the physical operation unit is attached, A second detection step in which a change in capacitance is detected in a touch area other than the physical operation area with a second capacitance sensitivity lower than the first capacitance sensitivity, A control program for an operating device that causes a computer to execute a command.

Citation Information

Patent Citations

  • Touch panel device and method for controlling touch panel device

    JP2012242924A

  • Electronic apparatus with toggle switch

    JP2018073731A

  • Touch panel device

    JP2020077223A

  • Electronic apparatus, sensing system, and method

    JP2021034014A

  • Operation knob device

    JP2021158048A