User interface systems, control devices, and computer programs

Abstract

This enhances the usability of a user interface system where suggested information, including options, is provided via a display device. [Solution] The control device causes the display device to display a screen 40 which includes a first area 41 that provides first information and a second area 42 that provides information that is less frequently referenced than the first information. The control device causes the display device to display an image 50 which includes suggestion information including choices in the second area 42. The control device accepts the movement of a part of the user's body in different directions D1 and D2 as a response to the choices.

Description

Technical Field

[0001] The present disclosure relates to a user interface system in which proposal information allowing different answers is provided through a display device. The present disclosure also relates to a control device that may be included in the user interface system and a computer program executable by a processor mounted on the control device.

Background Art

[0002] Patent Document 1 discloses a user interface system for controlling the operation of a controlled device mounted on a vehicle as an example of a moving body. The system includes a display device and a switch device. An image including proposal information allowing different answers is displayed on the screen of the display device. The user selects one of the different answers through an input to the switch device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a need to improve the operability of a user interface system in which proposal information allowing different answers is provided through a display device.

Means for Solving the Problems

[0005] One exemplary aspect provided by the present disclosure is a user interface system, a display device, a control device that causes the display device to display a screen including a first area for providing first information and a second area for providing information with a lower reference frequency than the first information, and The control device is An image containing suggestion information including options is displayed in the second area. The system accepts responses to the aforementioned options that describe the movement of different parts of the user's body in different directions.

[0006] One embodiment provided herein is a control device, A processor that causes a display device to display a screen including a first area that provides primary information and a second area that provides information that is less frequently accessed than the primary information, An interface that receives detection signals corresponding to the movement of a part of the user's body, It is equipped with, The aforementioned processor, An image containing suggestion information including options is displayed in the second area. Based on the detection signal, the system accepts the movement of the body part in a different direction as the answer to the given option.

[0007] One example of an embodiment provided herein is a computer program executable by a processor mounted on a control device, By being executed, the control device will A display device is shown a screen that includes a first area providing primary information and a second area providing information that is less frequently referenced than the primary information. It receives detection signals corresponding to the movement of a part of the user's body, An image containing suggestion information including options is displayed in the second area. Based on the detection signal, the system accepts the movement of the body part in a different direction as the answer to the given option.

[0008] According to the configurations described in each of the above examples, when suggestion information including choices is displayed, the user can respond to the choices simply by moving a part of their body in either of the different directions. This eliminates the need to display the choices within the image containing the suggestion information, and also eliminates the need to visually select one of the choices. Therefore, the operability of a user interface system in which suggestion information including choices is provided through a display device can be improved. [Brief explanation of the drawing]

[0009] [Figure 1] This shows a user interface system according to one embodiment. [Figure 2] Figure 1 illustrates a steering system on which the controlled object is mounted. [Figure 3] Figure 1 shows an example of the screen displayed on the display device. [Figure 4] Another example of the screen displayed on the display device shown in Figure 1 is shown. [Figure 5] This shows a user interface system according to another embodiment. [Modes for carrying out the invention]

[0010] The embodiments will be described in detail below with reference to the attached drawings. In the drawings used in the following description, the scale has been appropriately changed in order to make the illustrated elements recognizable.

[0011] Figure 1 illustrates the functional configuration of a user interface system 10 according to one embodiment. The user interface system 10 is configured to be mounted on a vehicle. The vehicle is an example of a mobile object.

[0012] The user interface system 10 includes a display device 11 and an operated object 12. The operated object 12 is arranged at a distance from the display device 11. In this example, as illustrated in FIG. 2, the operated object 12 is mounted on a steering device 20 that causes a vehicle to perform an operation (steering) for changing the traveling direction. The display device 11 can be arranged, for example, in front of or on the side of the steering device 20.

[0013] The operated object 12 is configured to receive an operation for causing a controlled device 30 mounted on the vehicle to perform an operation different from steering. The operation is performed by the fingers of a driver who is gripping the steering device 20. The fingers of the driver are an example of a part of the user's body.

[0014] Examples of the controlled device 30 include audio-visual equipment, air conditioning equipment, lighting devices (headlights, direction indicators, fog lights, interior lights, etc.), vision improvement devices (wipers, cleaners, etc.), devices for adjusting the position of steering members and seats, power window devices, locking and unlocking devices, and the like.

[0015] The operated object 12 has a detection surface. The operated object 12 is configured to detect contact or approach of the driver's fingers to the detection surface.

[0016] As illustrated in FIG. 1, the operated object 12 can be configured to detect a change in capacitance on the detection surface accompanying contact or approach of the driver's fingers, and based on the change, output a detection signal DT indicating the position (operated position) where the driver's fingers have contacted or approached.

[0017] As another example, the operated object 12 can be configured to detect a pressure change or displacement on the detection surface accompanying contact of the driver's fingers, and based on the change or displacement, output a detection signal DT indicating the operated position.

[0018] The detection signal DT may be an analog signal or a digital signal depending on the specifications of the operated object 12.

[0019] The user interface system 10 includes a control device 13. The control device 13 is installed in an appropriate location in the vehicle.

[0020] The control device 13 is equipped with an input interface 131. The input interface 131 is configured as a hardware interface capable of receiving a detection signal DT. If the detection signal DT is an analog signal, the input interface 131 is equipped with an appropriate conversion circuit including an A / D converter that converts the analog signal into a digital signal.

[0021] The control device 13 includes a processor 132 and an output interface 133. The processor 132 is configured to output a display control signal DC from the output interface 133 that changes the screen displayed on the display device 11 based on the operated position indicated by the detection signal DT received by the input interface 131.

[0022] The output interface 133 is configured as a hardware interface capable of outputting a display control signal DC. The display control signal DC may be an analog signal or a digital signal, depending on the specifications of the display device 11.

[0023] If the display control signal DC is an analog signal, the output interface 133 includes an appropriate conversion circuit, including a D / A converter, which converts the digital signal output from the processor 132 into an analog signal. This description also applies to other signals that the output interface 133 can output, as described later.

[0024] Figure 3 shows an example of a screen 40 displayed on the display device 11. The screen 40 includes a first area 41 and a second area 42. The first area 41 is configured to provide primary information. The second area 42 is configured to provide secondary information that is referenced less frequently than the primary information.

[0025] Examples of primary information include driving speed, driving mode, mileage, turn signals, power source status, and navigation information. Examples of secondary information include outside temperature, traffic information, and content being played on audio-visual equipment.

[0026] In this example, the screen 40 displayed on a single display device 11 includes a first area 41 and a second area 42. However, the display device that displays the screen corresponding to the first area 41 and the display device that displays the screen corresponding to the second area 42 may be independent of each other.

[0027] The processor 132 of the control device 13 is configured to output a display control signal DC from the output interface 133 that causes an image 50 containing the proposed information illustrated in Figure 4 to be displayed in the second region 42.

[0028] The suggested information includes suggestions with choices. Examples of such suggestions include taking a break, stopping at a place preferred by the occupants, and changing the driving mode due to weather changes, etc. In this example, both positive and negative responses are allowed for each suggestion. For example, image 50 may contain the text, "Shall we take a break?" For this suggestion, both a positive response, "Yes, take a break," and a negative response, "No, do not take a break," are allowed.

[0029] The driver inputs a response to the suggestion through the operation of the manipulated device 12. If giving a positive response, the driver moves their fingers along the direction D1 that moves the image 50 closer to the first region 41. If giving a negative response, the driver moves their fingers along the direction D2 that moves the image 50 away from the first region 41.

[0030] When the detection signal DT, which is output in response to the movement of the driver's fingers detected by the operated object 12, is received by the input interface 131 of the control device 13, the processor 132 receives a response corresponding to the movement that corresponds to the detection signal DT. That is, the processor 132 receives the movement of the driver's fingers in different directions relative to the operated object 12 as a response to the choices included in the suggestion information. As illustrated in Figure 1, the processor 132 outputs an operation control signal OC from the output interface 133 to control the operation of the controlled object 30 as needed.

[0031] According to the configuration of this embodiment, when suggestion information including choices is displayed, a response to the choices can be completed simply by moving a finger in either of the different directions. This eliminates the need to display the choices within the image containing the suggestion information, and also eliminates the need to visually select one of the choices. Therefore, the operability of the user interface system 10, which provides suggestion information including choices through the display device 11, can be improved.

[0032] In this particular example, the options include both positive and negative responses, and the movement of the fingers in the direction D1 towards the first region 41 and the direction D2 away from the first region 41 are associated with the positive and negative responses, respectively. In other words, the movement of moving image 50 to a region that provides more frequently referenced information is associated with the positive response, and the movement of moving image 50 away from that region is associated with the negative response. This configuration allows drivers to intuitively understand the operation of inputting a response to the options.

[0033] As illustrated in Figure 4, image 50 can be animated to enter the second region 42 along arrow D3. The direction along arrow D3 is different from both direction D1, which corresponds to an affirmative response, and direction D2, which corresponds to a negative response.

[0034] This configuration enhances the driver's awareness of the provision of suggested information compared to the case where image 50 simply appears in the second region 42. In addition, since the direction in which image 50 enters the second region 42 is different from any of the multiple operation directions related to answering the choices, conflict with operation directions is avoided, and driver confusion during operation input can be suppressed.

[0035] The processor 132 of the control device 13, which has the various functions described above, can be realized by at least one dedicated integrated circuit equipped with a memory element on which a computer program for realizing said functions is pre-installed. Examples of dedicated integrated circuits include microcontrollers, ASICs, FPGAs, etc. The memory element is an example of a non-temporary computer-readable medium on which the computer program is stored.

[0036] The processor 132 may be implemented by at least one general-purpose microprocessor operating in cooperation with at least one general-purpose memory. Examples of general-purpose microprocessors include CPUs, MPUs, and GPUs. Examples of general-purpose memory include ROMs and RAMs. In this case, the ROM may store computer programs for implementing the above functions. ROM is an example of a non-temporary computer-readable medium in which computer programs are stored. The general-purpose microprocessor selects at least a portion of the program stored in the ROM and loads it onto the RAM, and then works with the RAM to execute the above-described processes. The processor 132 may also be implemented by a combination of a dedicated integrated circuit and a general-purpose microprocessor.

[0037] The configurations referenced herein are merely examples to facilitate understanding of this disclosure. Each configuration example may be modified or combined with other configuration examples as appropriate within the scope of the intent of this disclosure.

[0038] If the direction of the driver's hand movements can be associated with the answer, the suggested information provided may include three or more options. In this case, it is preferable that image 50 includes information that associates the options with the direction.

[0039] In the above embodiment, the operable body 12 is positioned so that it can be operated by the right fingers of the driver who is gripping the steering device 20. However, as illustrated in Figure 5, the operable body 12A may be positioned so that it can be operated by the left fingers of the driver who is gripping the steering device 20.

[0040] In this case, the screen 40 displayed on the display device 11 may include a third area 43 located to the left of the first area 41. The third area 43 is also used to provide information that is viewed less frequently than the information displayed in the first area 41. Images containing suggested information may also be displayed in the third area 43. In this case, responses to the choices included in the suggested information are made through operational input to the operated body 12A. If the choices include both positive and negative responses, the movement of the fingers in the direction the image moves towards the first area 41 (to the right) and the direction away from the first area 41 (to the left) are associated with the positive and negative responses, respectively.

[0041] In the illustrated example, the screen 40 displayed on a single display device 11 includes a first region 41, a second region 42, and a third region 43. However, the display device that displays the screen corresponding to the third region 43 may be independent of at least one of the display devices that displays the screen corresponding to the first region 41 and the display device that displays the screen corresponding to the second region 42.

[0042] In the above embodiment, an operator 12 located on the steering device 20 is used to input a response to one of the options included in the suggested information displayed on the display device 11. With this configuration, the movement of the driver's fingers and gaze associated with inputting a response can be minimized.

[0043] However, the operated object 12 does not necessarily have to be located on the steering device 20. The operated object 12 can be located in a suitable location within the vehicle's passenger compartment. In this case, the operation input to the operated object 12 does not necessarily have to be made by the user's fingers. Depending on where the operated object 12 is located, the operation input may be made by other body parts.

[0044] If the movement of a part of the user's body can be associated with a response to a choice included in the suggested information, the operated body 12 does not necessarily have to be used for response input. For example, as illustrated in Figure 1, the user interface system 10 may include other user interfaces 14. The other user interface 14 may be configured to output a detection signal DT corresponding to the driver's gesture. When the detection signal DT corresponding to a gesture in a predetermined direction is received by the input interface 131 of the control device 13, the processor 132 determines that a response corresponding to that direction has been given.

[0045] The user interface system 10 can be installed on mobile devices other than vehicles. Examples of other mobile devices include trains, aircraft, and ships. Such mobile devices do not necessarily require a driver.

[0046] The moving object does not necessarily have to be a physical entity. The user interface system 10 may be mounted on a simulator that simulates the movement of the moving object. In this case, the steering device 20 is used to change the direction of travel of the virtual moving object simulated by the simulator. The operated object 12 is used to input operations that control the movement of the virtual controlled object simulated by the simulator.

[0047] The user interface system 10 does not need to be mounted on a mobile device. The user interface system 10 can be used to control the operation of appropriate controlled devices installed in homes or facilities.

[0048] The configurations listed below also constitute part of this disclosure. Item 1: Display device and A control device that causes the display device to display a screen including a first area for providing primary information and a second area for providing information that is less frequently referenced than the primary information, It is equipped with, The control device is An image containing suggestion information including options is displayed in the second area. The system accepts the movement of a part of the user's body in different directions as a response to the aforementioned options. User interface system. Item 2: The aforementioned options include both positive and negative responses. The control device is The movement of a part of the body in the direction that the image approaches the first region is accepted as the affirmative response. The negative response is received when the image moves away from the first region, The user interface system described in item 1. Item 3: The aforementioned image is displayed so as to enter the second region along a direction that is even different from the aforementioned different direction. The user interface system described in item 1 or 2. Item 4: It includes an operable object that is positioned at a distance from the display device, The movement of the aforementioned body part is detected as an input to the manipulated body. A user interface system as described in any one of items 1 through 3. Item 5: The operated object is located in the steering device of the moving body. The user interface system described in item 4. [Explanation of symbols]

[0049] 10: User interface system, 11: Display device, 12: Operated object, 13: Control device, 131: Input interface, 132: Processor, 20: Steering device, 40: Screen, 41: First area, 42: Second area, 50: Image, D1: Direction approaching the first area, D2: Direction away from the first area, DT: Detection signal

Claims

1. Display device and A control device that causes the display device to display a screen including a first area for providing primary information and a second area for providing information that is less frequently referenced than the primary information, It is equipped with, The control device is An image containing suggestion information including options is displayed in the second area. The system accepts the movement of a part of the user's body in different directions as a response to the aforementioned options. User interface system.

2. The aforementioned options include both positive and negative responses. The control device is The movement of a part of the body in the direction that the image approaches the first region is accepted as the affirmative response. The negative response is received when the image moves away from the first region, The user interface system according to claim 1.

3. The aforementioned image is displayed so as to enter the second region along a direction that is even different from the aforementioned different direction. The user interface system according to claim 1.

4. It includes an operable object that is positioned at a distance from the display device, The movement of the aforementioned body part is detected as an input to the manipulated body. The user interface system according to claim 1.

5. The operated object is located in the steering device of the moving body. The user interface system according to claim 4.

6. A processor that causes a display device to display a screen including a first area that provides primary information and a second area that provides information that is less frequently accessed than the primary information, An interface that receives detection signals corresponding to the movement of a part of the user's body, It is equipped with, The aforementioned processor, An image containing suggestion information including options is displayed in the second area. Based on the detection signal, the system accepts the movement of the body part in a different direction as the answer to the selection. Control device.

7. A computer program that can be executed by a processor mounted on a control device, By being executed, the control device will A display device is shown a screen that includes a first area providing primary information and a second area providing information that is less frequently referenced than the primary information. It receives detection signals corresponding to the movement of a part of the user's body, An image containing suggestion information including options is displayed in the second area. Based on the detection signal, the system accepts the movement of the body part in a different direction as the answer to the selection. Computer program.

Images