User interface device, processing device and computer program
The user interface device detects malfunctions by simulating state changes in sensors, allowing for malfunction detection without operational inputs, ensuring safe operation.
Patent Information
- Application Number
- JP2024089215
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-05-31
- Publication Date
- 2025-12-11
Smart Images

Figure 2025181307000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a user interface device that accepts operation inputs for controlling the operation of a controlled device, a processing device installed in the user interface device, and a computer program executable by a processor installed in the processing device. [Background technology]
[0002] Patent Document 1 discloses a user interface device for inputting operations to control the operation of a controlled device. The device is equipped with a rotatable cylindrical knob. A plurality of light-shielding walls and a plurality of slits are formed on the periphery of the knob. The plurality of light-shielding walls and slits are arranged alternately and at equal intervals around the periphery of the knob. The device is equipped with a light-emitting element and a light-receiving element. The light-emitting surface of the light-emitting element and the light-receiving surface of the light-receiving element face each other. The periphery of the knob is positioned between the light-emitting surface and the light-receiving surface.
[0003] When the knob is rotated, the light-shielding wall and the slit alternately pass between the light-emitting surface and the light-receiving surface. This alternates between a light-receiving state, in which light emitted from the light-emitting surface reaches the light-receiving surface, and a light-blocking state, in which the light is blocked by the light-blocking wall. The light-receiving element is configured to output signals of different levels in the light-receiving state and the light-blocking state. The amount of rotation of the knob corresponding to the user's operation is detected by counting the number of changes in the level of the signal output from the light-receiving element. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-251118 Summary of the Invention [Problem to be solved by the invention]
[0005] There is a demand for a system that makes it possible to determine whether or not a malfunction has occurred in a user interface device without requiring any operational input. [Means for solving the problem]
[0006] One example of an aspect provided by the present disclosure is a user interface device that accepts an operation input for controlling an operation of a controlled device, the user interface device comprising: a movable member that is displaced in response to the operation input; a first sensor that outputs a first detection signal corresponding to a state change caused by displacement of the movable member; a processing device that detects a displacement of the movable member based on the first detection signal; It is equipped with The processing device includes: inputting an inspection signal simulating the state change to the first sensor while the operation input is absent; The presence or absence of an abnormality is determined based on the first detection signal output from the first sensor in response to the inspection signal.
[0007] One example of an aspect provided by the present disclosure is a processing device mounted on a user interface device that receives an operation input for controlling an operation of a controlled device, the processing device comprising: an interface that receives, from a sensor, a detection signal corresponding to a state change that accompanies the displacement of the movable member due to the operation input; a processor that detects a displacement of the movable member based on the detection signal; It is equipped with The processor: inputting an inspection signal simulating the state change to the sensor while the operation input is absent; The presence or absence of an abnormality in the user interface device is determined based on the detection signal output from the sensor in response to the inspection signal.
[0008] One example of an aspect provided by the present disclosure is a computer program executable by a processor of a processing device mounted on a user interface device that receives an operation input for controlling an operation of a controlled device, the computer program comprising: When executed, the processing device: receiving a detection signal from a sensor corresponding to a state change caused by the displacement of the movable member due to the operation input; detecting a displacement of the movable member based on the detection signal; inputting an inspection signal simulating the state change to the sensor while the operation input is absent; The presence or absence of an abnormality in the user interface device is determined based on the detection signal output from the sensor in response to the inspection signal.
[0009] According to the configurations of the above-described embodiments, a state change caused by displacement of the movable body in response to an operation input for controlling the operation of the controlled device is detected by the first sensor, and a first detection signal is output. By inputting an inspection signal simulating the state change to the first sensor in the absence of the operation input, it is possible to determine whether the first detection signal output in response to the state change corresponds to the inspection signal. Therefore, it is possible to determine whether or not there is an abnormality in the user interface device without requiring an operation input to the movable body. Since the inspection is performed when the movable body is not in use, it is also possible to prevent a situation in which the movable body is used in a situation where an abnormality exists. [Brief explanation of the drawings]
[0010] [Figure 1] 1 illustrates the configuration of a user interface device according to an embodiment; [Figure 2] 2 illustrates a cross section taken along line II-II in FIG. 1 as viewed in the direction of the arrows. [Figure 3] 2 illustrates an example of the operation of the user interface device of FIG. 1; [Figure 4] 10 illustrates another example of the operation of the user interface device of FIG. [Figure 5]2 illustrates an example of a process flow executed by the processing device of FIG. 1. DETAILED DESCRIPTION OF THE INVENTION
[0011] The following detailed description of exemplary embodiments will be given with reference to the accompanying drawings. In the drawings used in the following description, the scale has been appropriately changed so that the illustrated elements can be clearly seen.
[0012] Fig. 1 illustrates a functional configuration of a user interface device 10 according to an embodiment. Fig. 2 illustrates a cross section taken along line II-II in Fig. 1 as viewed in the direction of the arrows.
[0013] The user interface device 10 is a device for receiving operation input from a user to control the operation of a controlled device. The user interface device 10 includes a substrate 11, a knob 12, and a first sensor 13. The knob 12 and the first sensor 13 are supported by the substrate 11.
[0014] The knob 12 has a rotation axis 121. The knob 12 is supported by the substrate 11 so as to be rotatable around the rotation axis 121. The knob 12 is an example of a movable member. Rotation is an example of displacement.
[0015] The knob 12 has a peripheral wall 122. The peripheral wall 122 has a cylindrical shape. A plurality of light-shielding walls 123 and a plurality of slits 124 are formed in the lower part of the peripheral wall 122. The plurality of light-shielding walls 123 and the plurality of slits 124 are arranged alternately along the circumferential direction of the peripheral wall 122.
[0016] The first sensor 13 includes a first light-emitting element 131a and a second light-emitting element 132a. Each of the first light-emitting element 131a and the second light-emitting element 132a is an element that emits light having a predetermined wavelength when supplied with power. Examples of such elements include a light-emitting diode (LED), a laser diode (LD), and an electroluminescence (EL) element.
[0017] The first sensor 13 includes a first light receiving element 131b and a second light receiving element 132b. The first light receiving element 131b and the second light receiving element 132b are elements that are sensitive to the wavelengths of light emitted from the first light emitting element 131a and the second light emitting element 132a, respectively, and output detection signals corresponding to the intensity of the received light. Examples of such elements include a photodiode, a phototransistor, and a photoresistor.
[0018] The first light-emitting element 131a and the first light-receiving element 131b are arranged so that light emitted from the light-emitting surface of the first light-emitting element 131a is incident on the light-receiving surface of the first light-receiving element 131b. In this example, the first light-emitting element 131a and the first light-receiving element 131b are arranged so that the light-emitting surface and the light-receiving surface directly face each other. However, by arranging an appropriate optical element (such as a mirror, prism, or lens) on the optical path from the light-emitting surface to the light-receiving surface, the positional relationship between the first light-emitting element 131a and the first light-receiving element 131b can be changed as appropriate. The same applies to the second light-emitting element 132a and the second light-receiving element 132b.
[0019] The knob 12 is positioned such that the peripheral wall 122 is located on the path along which light emitted from the first light-emitting element 131a reaches the first light-receiving element 131b and on the path along which light emitted from the second light-emitting element 132a reaches the second light-receiving element 132b. The first light-emitting element 131a and the first light-receiving element 131b are located on the upstream side when the knob 12 is rotated clockwise. The second light-emitting element 132a and the second light-receiving element 132b are located on the upstream side when the knob 12 is rotated counterclockwise.
[0020] When the knob 12 is rotated in response to a user's operation input, the light passes alternately through both paths through the light-shielding wall 123 and the slit 124. Therefore, a light-receiving state in which light emitted from the first light-emitting element 131a passes through the slit 124 and reaches the first light-receiving element 131b and a light-blocking state in which the light emitted from the first light-emitting element 131a is blocked by the light-blocking wall 123 are alternately obtained. Similarly, a light-receiving state in which light emitted from the second light-emitting element 132a passes through the slit 124 and reaches the second light-receiving element 132b and a light-blocking state in which the light emitted from the second light-emitting element 132a is blocked by the light-blocking wall 123 are alternately obtained.
[0021] The positional relationship between the multiple light-shielding walls 123, the multiple slits 124, and the first sensor 13 is determined so that a light receiving state is established for at least one of the first light receiving element 131b and the second light receiving element 132b regardless of the rotational angle position of the knob 12.
[0022] 1, the user interface device 10 includes a processing device 14. The processing device 14 is communicatively connected to the first sensor 13. The processing device 14 includes an input interface 141, a processor 142, and an output interface 143.
[0023] The processor 142 is configured to output a light emission control signal EC that causes the first light emitting element 131a and the second light emitting element 132a to emit light from the output interface 143. The light emission control signal EC may be an analog signal or a digital signal depending on the specifications of the first light emitting element 131a and the second light emitting element 132a.
[0024] The output interface 143 is configured as a hardware interface capable of outputting the light emission control signal EC. If the light emission control signal EC is an analog signal, the output interface 143 includes an appropriate conversion circuit including a D / A converter. This description also applies to other signals that can be output by the output interface 143, which will be described later.
[0025] As the knob 12 rotates, the first light receiving element 131b and the second light receiving element 132b each output a first detection signal DT1 that alternates between a signal level corresponding to a light receiving state and a signal level corresponding to a light blocking state. As used herein, the term "signal level" refers to the voltage or current value of a signal. The first detection signal DT1 may be an analog signal or a digital signal depending on the specifications of the first light receiving element 131b and the second light receiving element 132b.
[0026] FIG. 3 illustrates the changes over time of the light emission control signal EC and the first detection signal DT1 configured as described above.
[0027] In this example, a high level of the light emission control signal EC corresponds to the light-emitting element being turned on, and a low level corresponds to the light-emitting element being turned off. At time t1, the light emission control signal EC transitions from low level to high level, turning on the light-emitting element.
[0028] In this example, a high level of the first detection signal DT1 corresponds to a light-receiving state, and a low level corresponds to a light-blocking state. The light-blocking state remains unchanged from time t1 to time t2, indicating that the knob 12 is stationary. At time t2, the first detection signal DT1 transitions from a low level to a high level, and thereafter repeatedly transitions between the high level and low level, indicating that the knob 12 is rotating.
[0029] The input interface 141 is configured as a hardware interface capable of receiving the first detection signal DT1. If the first detection signal DT1 is an analog signal, the input interface 141 includes an appropriate conversion circuit including an A / D converter. This description also applies to other signals that can be received by the input interface 141, which will be described later.
[0030] The processor 142 detects the rotation of the knob 12 based on at least one of the first detection signal DT1 output from the first light receiving element 131b and the second detection signal DT1 output from the second light receiving element 132b. Specifically, the processor 142 detects the rotation of the knob 12 based on the fact that at least one of the signal levels of the first detection signal DT1 output from the first light receiving element 131b and the second light receiving element 132b has changed. In other words, the processor 142 determines that an operation input has been made to the knob 12 based on this fact.
[0031] When the knob 12 is rotated clockwise, a change in signal level accompanying passage through the light-shielding wall 123 and the slit 124 occurs first in the first detection signal DT1 output from the first light-receiving element 131b, and then in the first detection signal DT1 output from the second light-receiving element 132b. Therefore, based on this fact, the processor 142 can detect that the knob 12 is rotating clockwise.
[0032] When the knob 12 is rotated counterclockwise, a change in signal level caused by passage through the light-shielding wall 123 and the slit 124 occurs first in the first detection signal DT1 output from the second light-receiving element 132b, and then in the first detection signal DT1 output from the first light-receiving element 131b. Therefore, based on this fact, the processor 142 can detect that the knob 12 is rotating counterclockwise.
[0033] The processor 142 can detect the amount of rotation of the knob 12 based on the number of changes in the signal level that occur in the first detection signal DT1.
[0034] The processor 142 is configured to output, from the output interface 143, an operation control signal OC for causing the controlled device 20 to perform a corresponding operation based on the detected rotation direction and amount of the knob 12. The operation control signal OC may be an analog signal or a digital signal depending on the specifications of the controlled device 20.
[0035] As an example, the user interface device 10 may be installed at an appropriate location in the vehicle cabin. In this case, examples of the controlled device 20 include audiovisual equipment, air conditioning equipment, lighting equipment, and position adjustment devices for various facilities mounted on the vehicle. A vehicle is an example of a mobile body. Other examples of mobile bodies include trains, ships, and airplanes. The mobile body may not require a driver.
[0036] The processor 142 is configured to detect the presence or absence of an abnormality in the first sensor 13 while there is no operational input to the knob 12. Specifically, the processor 142 is configured to output, from the output interface 143, an inspection signal IS that simulates a state change that accompanies the rotation of the knob 12.
[0037] 4, the inspection signal IS is configured to cause at least one of the first light-emitting element 131a and the second light-emitting element 132a to alternate between an on state and an off state starting from time t3. In other words, the inspection signal IS exhibits a change over time that simulates a change in state that accompanies displacement of the knob 12. By turning the first light-emitting element 131a and the second light-emitting element 132a on and off based on the inspection signal IS, a state in which the first light-receiving element 131b and the second light-receiving element 132b alternate between a light-receiving state and a light-blocking state due to the light-blocking wall 123 and the slit 124 of the knob 12 repeatedly passing through the optical path is simulated.
[0038] The processor 142 is configured to determine whether or not an abnormality exists in the user interface device 10 based on the response of the first detection signal DT1 to the inspection signal IS. For example, if the inspection signal IS illustrated in FIG. 4 is input to the first light-emitting element 131a of the first sensor 13 and no change over time in the first detection signal DT1 illustrated in the same figure is obtained, it is estimated that at least one of the following abnormalities exists: the first light-emitting element 131a is not properly emitting light, or the first light-receiving element 131b is not properly receiving light. The same applies to the second light-emitting element 132a and the second light-receiving element 132b. Alternatively, in either case, it is suspected that some structural defect has occurred in the knob 12.
[0039] An example of the flow of processing executed by the processor 142 of the processing device 14 configured as above will be described with reference to FIG.
[0040] The processor 142 determines whether an operation input has been made to the knob 12, for example, based on the level transition of the first detection signal DT1 described above (STEP 11). If it is determined that an operation input has been made (YES in STEP 11), the processor 142 outputs an operation control signal OC, which causes the controlled device 20 to perform an operation corresponding to the operation input to the knob 12, from the output interface 143 (STEP 12). Thereafter, the process returns to STEP 11.
[0041] If it is determined that no operation input has been made to knob 12 (NO in STEP 11), processor 142 determines whether a predetermined time has elapsed (STEP 13). The start point of timing can be determined appropriately, such as when processing begins or when an operation control signal OC is output. If it is determined that the predetermined time has not elapsed (NO in STEP 13), the process returns to STEP 11.
[0042] If it is determined that the predetermined time has elapsed (YES in STEP 13), the processor 142 outputs the above-mentioned inspection signal IS from the output interface 143 (STEP 14).
[0043] Next, the processor 142 determines whether or not there is an abnormality in the user interface device 10 (STEP 15). Specifically, the processor 142 determines whether the change over time in the first detection signal DT1 output from the first sensor 13 in response to the input of the inspection signal IS corresponds to the change over time in the inspection signal IS. If the change over time in the first detection signal DT1 corresponds to the change over time in the inspection signal IS, it is determined that there is no abnormality in the user interface device 10.
[0044] If it is determined that there is no abnormality in the user interface device 10 (NO in STEP 15), the process returns to STEP 11. If it is determined that there is an abnormality in the user interface device 10 (YES in STEP 15), the processor 142 executes an abnormality notification process (STEP 16).
[0045] Specifically, the output interface 143 outputs a notification control signal NC that causes the notification device 30 shown in Fig. 1 to notify the user of an abnormality in the user interface device 10. The notification is performed through at least one of a visual notification, an auditory notification, and a tactile notification. The notification device 30 may be a device installed in a vehicle or a mobile device that can be carried by the user.
[0046] According to the user interface device 10 of this embodiment, an optical state change caused by rotation of the knob 12 in response to an operational input for controlling the operation of the controlled device 20 is detected by the first sensor 13, and a first detection signal DT1 is output. When the operational input is not being made, an inspection signal IS simulating the state change is input to the first sensor 13, and it can be determined whether the first detection signal DT1 output in response thereto corresponds to the inspection signal IS. Therefore, it is possible to determine whether or not there is an abnormality in the user interface device 10 without an operational input to the knob 12. Since the inspection is performed when the knob 12 is not being used, it is also possible to prevent situations in which the knob 12 is used in a situation where an abnormality exists.
[0047] 1 , the user interface device 10 may include a second sensor 15. The second sensor 15 is configured to detect contact of a user's hand with the knob 12. As an example, the second sensor 15 may be configured to output a second detection signal DT2 corresponding to a change in capacitance associated with the approach or contact of the user's hand with the knob 12. The second detection signal DT2 may be an analog signal or a digital signal depending on the specifications of the second sensor 15.
[0048] The second detection signal DT2 is received by the input interface 141 of the processing device 14. The processor 142 can be configured to determine that an operational input has been made to the knob 12 when the change in capacitance indicated by the second detection signal DT2 exceeds a threshold value.
[0049] With this configuration, the inspection mode can be cancelled before the knob 12 is rotated, and the device can immediately transition to the normal operation mode in which the rotation of the knob 12 is detected.
[0050] As long as the second sensor 15 can detect at least a touch of the user to the knob 12, the second sensor 15 can take the form of a pressure-sensitive sensor or a mechanical switch.
[0051] In this embodiment, the inspection signal IS is generated so as to simulate an optical state change in the first sensor 13 by changing the duty ratio of the light emission control signal EC. The duty ratio can be determined so as to correspond to the dimensional ratio between the light-shielding wall 123 and the slit 124 of the knob 12. With this configuration, the inspection signal IS can be generated easily without complicating the device.
[0052] Note that, from the viewpoint of determining whether the correspondence between the input and output of first sensor 13 is appropriate, the optical state change corresponding to inspection signal IS may differ from the optical state change caused by the actual rotation of knob 12. For example, the duty ratio may be set so that the period corresponding to the light-receiving state is shorter than the actual period. With this configuration, the period during which the light-emitting element is lit for inspection can be shortened, thereby reducing power consumption during inspection.
[0053] The processor 142 of the processing device 14 having the various functions described above may be realized by at least one dedicated integrated circuit having a storage element in which a computer program for realizing the functions is pre-installed. Examples of the dedicated integrated circuit include a microcontroller, an ASIC, an FPGA, etc. The storage element is an example of a non-transitory computer-readable medium on which a computer program is stored.
[0054] The processor 142 may be realized by at least one general-purpose microprocessor operating in cooperation with at least one general-purpose memory. Examples of a general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of a general-purpose memory include a ROM and a RAM. In this case, a computer program for implementing the relevant functions may be stored in the ROM. The general-purpose memory is an example of a non-transitory computer-readable medium on which a computer program is stored. The general-purpose microprocessor specifies at least a portion of the program stored in the ROM, expands it in the RAM, and executes the above-described processing in cooperation with the RAM. The processor 142 may be realized by a combination of a dedicated integrated circuit and a general-purpose microprocessor.
[0055] The configurations referred to above are merely examples for facilitating understanding of the present disclosure. Each configuration example can be appropriately modified or combined with other configuration examples within the scope of the present disclosure.
[0056] In the above embodiment, the absence of an operational input to the knob 12 is determined when the time during which the level of the first detection signal DT1 or the second detection signal DT2 remains unchanged exceeds a threshold. However, for example, the user interface device 10 may transition to an operation mode in which the inspection signal IS is output when it is detected that the main power supply of the vehicle in which it is installed is turned off. In this case, the processing device 14 is driven by the vehicle's backup power supply.
[0057] In the above embodiment, the first sensor 13 detects an optical state change that accompanies the rotation of the knob 12. However, the first sensor 13 may also detect a magnetic state change that accompanies the rotation of the knob 12. Such a first sensor 13 may be realized by a Hall element, an MR sensor, or the like.
[0058] The state change detected by the first sensor 13 does not necessarily have to be caused by rotation of the knob 12. As long as the desired state change can be caused, the knob 12 can be a movable body that is linearly displaced, such as a slider or a push button.
[0059] The user interface device 10 does not necessarily need to be mounted on a mobile object such as a vehicle. The user interface device 10 can be used to control the operation of a monitoring device, a locking device, an air conditioning device, a lighting device, an audiovisual equipment, and the like in a home or facility.
[0060] The configurations listed below also form part of this disclosure. Item 1: A user interface device that accepts an operation input for controlling an operation of a controlled device, a movable member that is displaced in response to the operation input; a first sensor that outputs a first detection signal corresponding to a state change caused by displacement of the movable member; a processing device that detects a displacement of the movable member based on the first detection signal; It is equipped with The processing device includes: inputting an inspection signal simulating the state change to the first sensor while the operation input is absent; determining whether or not there is an abnormality in the first sensor based on the first detection signal output from the first sensor in response to the inspection signal; User interface device. Item 2: a second sensor that outputs a second detection signal corresponding to at least a touch of the user on the movable member; the processing device determines that the operation input has been made based on the second detection signal. Item 1. A user interface device according to item 1. Item 3: the state change corresponding to the test signal is different from the state change caused by the actual displacement of the movable member; Item 3. A user interface device according to item 1 or 2. Item 4: the processing device outputs a control signal to cause an alarm device to notify the abnormality. 4. A user interface device according to any one of items 1 to 3. Item 5: The state change is an optical state change. 5. A user interface device according to any one of items 1 to 4. Item 6: The movable member is rotatable about an axis. 6. A user interface device according to any one of items 1 to 5. Item 7: The controlled device is mounted on a moving body. 7. A user interface device according to any one of items 1 to 6. [Explanation of symbols]
[0061] 10: User interface device, 12: Knob, 13: First sensor, 14: Processing device, 141: Input interface, 142: Processor, 15: Second sensor, 20: Controlled device, 30: Notification device, DT1: First detection signal, DT2: Second detection signal, IS: Inspection signal, NC: Notification control signal
Claims
1. A user interface device that accepts an operation input for controlling an operation of a controlled device, a movable member that is displaced in response to the operation input; a first sensor that outputs a first detection signal corresponding to a state change caused by displacement of the movable member; a processing device that detects a displacement of the movable member based on the first detection signal; It is equipped with The processing device includes: inputting an inspection signal simulating the state change to the first sensor while the operation input is absent; determining whether or not there is an abnormality based on the first detection signal output from the first sensor in response to the inspection signal; User interface device.
2. a second sensor that outputs a second detection signal corresponding to at least a touch of the user on the movable member; the processing device determines that the operation input has been made based on the second detection signal. The user interface device according to claim 1 .
3. the state change corresponding to the test signal is different from the state change caused by the actual displacement of the movable member; The user interface device according to claim 1 .
4. the processing device outputs a control signal to cause an alarm device to notify the abnormality. The user interface device according to claim 1 .
5. The state change is an optical state change. The user interface device according to claim 1 .
6. The movable member is rotatable about an axis. The user interface device according to claim 1 .
7. The controlled device is mounted on a moving body. The user interface device according to claim 1 .
8. A processing device mounted on a user interface device that receives an operation input for controlling an operation of a controlled device, an interface that receives, from a sensor, a detection signal corresponding to a state change that accompanies the displacement of the movable member due to the operation input; a processor that detects a displacement of the movable member based on the detection signal; It is equipped with The processor: inputting an inspection signal simulating the state change to the sensor while the operation input is absent; determining whether or not there is an abnormality in the user interface device based on the detection signal output from the sensor in response to the inspection signal; Processing equipment.
9. A computer program executable by a processor of a processing device mounted on a user interface device that receives an operation input for controlling an operation of a controlled device, When executed, the processing device: receiving a detection signal from a sensor corresponding to a state change caused by the displacement of the movable member due to the operation input; detecting a displacement of the movable member based on the detection signal; inputting an inspection signal simulating the state change to the sensor while the operation input is absent; determining whether or not there is an abnormality in the user interface device based on the detection signal output from the sensor in response to the inspection signal; Computer program.
Citation Information
Patent Citations
Dial switch, and device for operation of air-conditioning system for vehicle using the same
JP2010251118A