User interface system, control device, and non-transitory computer-readable medium

The user interface system improves airflow control convenience by displaying a front-view image of the vehicle interior for precise airflow direction adjustment and strength modification, addressing the limitations of existing systems with intuitive input devices and enhanced visual feedback.

WO2024237200A1PCT designated stage expired Publication Date: 2024-11-21KK TOKAI RIKA DENKI SEISAKUSHO
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/017424
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-12
Filing Date
2024-05-10
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Current user interface systems for controlling air conditioning equipment on mobile objects, such as vehicles, lack convenience in accurately directing and adjusting airflow, making it difficult for occupants to precisely control the airflow distribution within the vehicle compartment.

Method used

A user interface system that displays a front-view image of the vehicle interior, allowing occupants to visually adjust the direction of airflow by moving target images on a display to indicate the airflow's position, and optionally changing the airflow strength by modifying route images, with input devices like touch panels or mechanical switches for intuitive operation.

Benefits of technology

Enhances the accuracy and convenience of controlling airflow distribution by providing a detailed and intuitive interface for occupants to adjust airflow direction and strength, particularly in left and right directions, reducing operational errors and improving overall user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024017424_21112024_PF_FP_ABST
    Figure JP2024017424_21112024_PF_FP_ABST
Patent Text Reader

Abstract

This control device causes a display device (23) to display a vehicle interior image (C) corresponding to a state in which the vehicle interior of a vehicle is viewed from the front. An input device receives a first operation for changing the direction of an air flow generated by an air conditioner mounted on the vehicle. The control device causes target images (T1 to T3) indicating positions at which the air flow arrives to be displayed in the vehicle interior image (C), and changes the position of at least one of the target images (T1 to T3) in the vehicle interior image (C) on the basis of the first operation.
Need to check novelty before this filing date? Find Prior Art

Description

User interface system, controller, and non-transitory computer-readable medium

[0001] The present disclosure relates to a user interface system mounted on a vehicle, a control device that may be mounted on the system, and a non-transitory computer-readable medium having stored thereon a computer program executable by a processor mounted on the control device.

[0002] Japanese Patent Application Publication No. 2012-166669 discloses a user interface system for controlling the operation of an air conditioner mounted on a vehicle, which is an example of a moving object. The system includes a display device that displays from which outlet the airflow generated by the air conditioner is being blown out.

[0003] There is a demand for improving the convenience of controlling the operation of air conditioning equipment mounted on a vehicle.

[0004] One example aspect provided by the present disclosure is a user interface system mounted on a mobile body, comprising: a control device that causes a display device to display a room image corresponding to a state in which a room of the mobile body is viewed from the front; and an input device that accepts a first operation to change the direction of the airflow generated by air conditioning equipment mounted on the mobile body, wherein the control device displays a target image within the room image indicating the position where the airflow will reach, and changes the position of the target image within the room image based on the first operation.

[0005] One example aspect provided by the present disclosure is a control device mounted on a mobile body, comprising: a processor that causes a display device to display a room image corresponding to a state in which a room of the mobile body is viewed from the front; and an interface that receives an operation signal corresponding to an operation to change the direction of the airflow generated by an air conditioning device mounted on the mobile body, wherein the processor displays a target image within the room image indicating the position where the airflow will reach, and changes the position of the target image within the room image based on the operation.

[0006] One example aspect provided by the present disclosure is a non-transitory computer-readable medium storing a computer program executable by a processor of a control device mounted on a mobile body, wherein execution of the computer program causes the control device to: display on a display device an image of a room in the mobile body as viewed from the front; accept an operation signal corresponding to an operation to change the direction of an airflow generated by an air conditioning device mounted on the mobile body; display within the room image a target image indicating the position where the airflow will reach; and change the position of the target image within the room image based on the operation.

[0007] According to the configurations of the above-described embodiments, a cabin image corresponding to a front view of the cabin of the vehicle is provided, allowing the occupants of the vehicle to confirm the arrival position of the airflow generated by the air conditioning equipment from a front-viewpoint of the vehicle. This allows for more detailed and accurate understanding of the arrival position of the airflow, particularly in the left and right directions of the vehicle, making it easier for the occupants to reflect their intentions in changing the arrival position. Therefore, the convenience of controlling the operation of the air conditioning equipment installed in the vehicle can be improved.

[0008] 1 illustrates an example of the configuration of a user interface system according to an embodiment. FIG. 2 illustrates an example of a vehicle equipped with the user interface system of FIG. 1. FIG. 3 illustrates an example of a vehicle interior image displayed on the display device of FIG. 1. FIG. 4 illustrates another example of a vehicle interior image displayed on the display device of FIG. 1. FIG. 5 illustrates another example of a vehicle interior image displayed on the display device of FIG. 1. FIG. 6 illustrates another example of a vehicle interior image displayed on the display device of FIG. 1. FIG. 7 illustrates another example of a vehicle interior image displayed on the display device of FIG. 1.

[0009] The following detailed description of exemplary embodiments will be given with reference to the accompanying drawings. In the drawings used in the following description, the scale has been changed appropriately so that each element can be clearly seen.

[0010] Fig. 1 illustrates an example of the functional configuration of a user interface system 10 according to one embodiment. The user interface system 10 according to this example is configured to be mounted on a vehicle 20 illustrated in Fig. 2. The user interface system 10 is used to control the operation of an air conditioning device mounted on the vehicle 20. The vehicle 20 is an example of a moving object.

[0011] A plurality of air outlets 22 are provided in a passenger compartment 21 of the vehicle 20. An airflow generated by an air conditioning device is sent into the passenger compartment 21 from at least one of the plurality of air outlets 22.

[0012] A display device 23 is installed in the passenger compartment 21. The display device 23 is configured to display a passenger compartment image C as shown in FIG. 3. The passenger compartment image C corresponds to the passenger compartment 21 as viewed from the front of the vehicle 20. The passenger compartment image C includes a driver's seat image D representing the driver's seat and a passenger seat image P representing the passenger seat. The passenger compartment 21 is an example of a passenger compartment. The passenger compartment image C is an example of a passenger compartment image.

[0013] Additionally, the vehicle interior image C includes three target images T1 to T3 that indicate the positions where the airflow generated by the air conditioning equipment will reach. Each of the target images T1 to T3 indicates the position where the airflow delivered from a corresponding one of the plurality of air outlets 22 will reach.

[0014] 1, the user interface system 10 includes an input device 11. The input device 11 is configured to receive a first operation for changing the direction of the airflow generated by the air conditioner.

[0015] The input device 11 may be configured to include a touch panel device that functions as part of the display device 23. Alternatively, as illustrated in Fig. 2, the input device 11, which is independent of the display device 23, may be disposed in the center cluster 24 of the vehicle 20. In this case, the input device 11 may be realized by a mechanical switch such as a lever switch or a dial switch, or may be realized by a switch that detects a change in capacitance due to the approach or contact of a passenger's finger.

[0016] The input device 11 is configured to output a first operation signal S1 corresponding to a first operation. The first operation signal S1 may be an analog signal or a digital signal depending on the specifications of the input device 11.

[0017] 1, the user interface system 10 includes a control device 12. The control device 12 includes an input interface 121, a processor 122, and an output interface 123.

[0018] The input interface 121 is configured as a hardware interface that accepts the first operation signal S1. If the first operation signal S1 is an analog signal, the input interface 121 includes an appropriate conversion circuit including an A / D converter. This description also applies to other signals that can be accepted by the input interface 121, which will be described later.

[0019] The processor 122 is configured to output a display control signal DC, which causes the above-mentioned target images T1 to T3 to be displayed on the display device 23, from an output interface 123 configured as a hardware interface. The display control signal DC may be an analog signal or a digital signal depending on the specifications of the display device 23. When the display control signal DC is an analog signal, the output interface 123 includes an appropriate conversion circuit including a D / A converter.

[0020] The processor 122 is configured to output a display control signal DC from the output interface 123 when the input interface 121 receives the first operation signal S1, causing the display device 23 to change the position of at least one of the target images T1 to T3 within the vehicle interior image C.

[0021] A specific processing flow will be described using an example in which an occupant of the vehicle 20 desires to change the position of the target image T3 displayed in the vehicle interior image C illustrated in Fig. 3. In this example, the input device 11 includes a touch panel device that functions as part of the display device 23.

[0022] 4, the occupant brings a finger close to or into contact with the target image T3 and moves the finger to a desired position. This touch operation as a first operation generates a first operation signal S1 that specifies the position of the target image T3 after movement.

[0023] When the first operation signal S1 output from the touch panel device serving as the input device 11 is received by the input interface 121 of the control device 12, the processor 122 outputs a display control signal DC for moving the target image T3 to the position specified by the first operation signal S1 from the output interface 123. As a result, the target image T3 moves in accordance with the touch operation of the occupant.

[0024] Although not shown in the drawings, the same operation can be performed on the other target images T1 and T2 to change the arrival positions of the airflows blown out from the corresponding air outlets 22.

[0025] According to the configuration of this embodiment, a cabin image C corresponding to a front view of the cabin 21 of the vehicle 20 is provided, allowing the occupants of the vehicle 20 to confirm the arrival position of the airflow generated by the air conditioning equipment from a frontal perspective of the cabin 21. This allows for a more detailed and accurate understanding of the arrival position of the airflow, particularly in the left and right directions of the vehicle 20, making it easier to reflect the occupants' wishes in changing the arrival position. This therefore improves the convenience of controlling the operation of the air conditioning equipment installed in the vehicle 20.

[0026] Additionally, in this embodiment, the input device 11 for receiving the first operation to change the arrival position of the airflow is configured to include a touch panel device that functions as part of the display device 23, providing the occupant with a more intuitive operational feel. This further improves the convenience of controlling the operation of the air conditioning equipment installed in the vehicle 20.

[0027] 5 shows another example of a vehicle interior image C displayed on the display device 23. The vehicle interior image C in this example includes three path images F1 to F3 that represent the paths of airflow generated by the air conditioning equipment. Each of the path images F1 to F3 represents the path of the airflow discharged from a corresponding one of the multiple air outlets 22 until it reaches a position corresponding to each of the target images T1 to T3.

[0028] 1 , the input device 11 can be configured to output a second operation signal S2 corresponding to an operation to change the strength of the airflow generated by the air conditioner. The second operation signal S2 is received by the input interface 121 of the control device 12.

[0029] In this case, the processor 122 of the control device 12 is configured to display the route images F1 to F3 within the vehicle interior image C and to output a display control signal DC from the output interface 123 to change the display mode of at least one of the route images F1 to F3 based on the second operation signal S2.

[0030] A specific processing flow will be described using an example in which an occupant of the vehicle 20 desires to change the strength of the airflow associated with the target image T3 displayed in the vehicle interior image C illustrated in Fig. 5. In this example, a second operation is input to the input device 11 separate from the touch panel device.

[0031] When the input device 11 receives a second operation for increasing the airflow associated with the target image T3, a second operation signal S2 corresponding to the operation is output. Based on the second operation signal S2, the processor 122 outputs a display control signal DC from the output interface 123 to cause the display device 23 to make a change to increase the width of the route image F3. As a result, the width of the route image F3 displayed within the vehicle interior image C increases, as illustrated in FIG. 6 .

[0032] Conversely, when the input device 11 receives a second operation to weaken the airflow associated with the target image T3, a second operation signal S2 corresponding to the operation is output. Based on the second operation signal S2, the processor 122 outputs a display control signal DC from the output interface 123 to cause the display device 23 to make a change to narrow the width of the route image F3. As a result, the width of the route image F3 displayed within the vehicle interior image C becomes narrower.

[0033] Although not shown, the strength of the airflows blown out from the corresponding air outlets 22 can be changed in the same manner for the other path images F1 and F2.

[0034] The display mode that is changed based on the second operation is not limited to the width of each route image, but may also be changed based on the second operation for the length or color of each route image.

[0035] With this configuration, the occupants of the vehicle 20 can check the strength of the airflow generated by the air conditioning equipment from a viewpoint looking directly at the passenger compartment 21. This allows for a more detailed and accurate understanding of the strength of the airflow, particularly in the left-right direction of the vehicle 20, making it easier to reflect the occupants' wishes in changes to the strength. This further improves the convenience of controlling the operation of the air conditioning equipment installed in the vehicle 20.

[0036] The second operation may be accepted by a touch panel device that functions as a part of the display device 23 .

[0037] 7 shows another example of a vehicle interior image C displayed on the display device 23. In this example, the vehicle interior image C includes a mark image M representing the driver's seat. The mark image M is displayed so as to overlap the driver's seat image D. Although the shapes of the driver's seat and the passenger seat are the same, the display of the mark image M emphasizes the driver's seat image D, making it possible to distinguish it from the passenger seat image P.

[0038] As an example, in a vehicle in which the driver's seat is located on the right side of the passenger compartment 21, the driver's seat image D is located on the left side of the passenger compartment image C, which corresponds to the passenger compartment 21 as seen from the front. A driver who is strongly aware that he or she is sitting on the right side of the vehicle may feel uncomfortable when the driver's seat image D is located on the left side of the screen as the viewpoint changes. The configuration of this example can help the driver understand which of the two seat images lined up in the left-right direction in the passenger compartment image C corresponds to the driver's seat. This can prevent errors from occurring when changing the airflow arrival position, etc. Therefore, the convenience of controlling the operation of the air conditioning equipment installed in the vehicle 20 can be further improved.

[0039] A display mode for emphasizing the driver's seat can be appropriately selected as long as the driver's seat image D can be distinguished from the passenger seat image P. As one example, the color of the driver's seat image D may be made different from that of the passenger seat image P. As another example, an icon image or an avatar image representing the driver may be displayed so as to overlap the driver's seat image D.

[0040] 8 shows another example of a vehicle interior image C displayed on the display device 23. In this example, the vehicle interior image C corresponds to a mirror image of the vehicle interior 21. Therefore, the driver's seat image D is located on the right side of the vehicle interior image C, and the passenger seat image P is located on the left side of the vehicle interior image C.

[0041] With the configuration of this example, there is no need to consciously flip the left and right sides of the vehicle interior image C when switching viewpoints, which helps to understand which of the two seat images lined up left and right in the vehicle interior image C corresponds to the driver's seat.

[0042] Fig. 9 shows another example of a vehicle interior image C displayed on the display device 23. The vehicle interior image C in this example includes a viewpoint change button image V. When the viewpoint change button image V is selected, a vehicle interior image C' in which the viewpoint from which the vehicle interior 21 is viewed is changed is displayed, as shown in Fig. 10. The viewpoint change button image V may be selected by a touch operation on the touch panel device, or may be selected by an appropriate operation input on the input device 11 independent of the touch panel device.

[0043] 1 , the input device 11 can be configured to output a third operation signal S3 when receiving a third operation to change the viewpoint from which the vehicle interior 21 is viewed. In this case, the processor 122 of the control device 12 is configured to output, from the output interface 123, a display control signal DC that causes the display device 23 to display a vehicle interior image C′ when the input interface 121 receives the third operation signal S3.

[0044] As illustrated in FIG. 10, the vehicle interior image C' also includes target images T1 to T3. Therefore, the occupants of the vehicle 20 can confirm the arrival position of the airflow generated by the air conditioning equipment from a different angle. This makes it possible to accurately grasp and change the arrival position of the airflow. The number of different viewpoints provided by the third operation may be multiple.

[0045] The processor 122 of the control device 12 having the various functions described above can be realized by a dedicated integrated circuit such as a microcontroller, ASIC, FPGA, or the like, which includes a storage element in which a computer program for realizing the functions is pre-installed. In this case, the storage element is an example of a non-transitory computer-readable medium on which a computer program is stored.

[0046] Alternatively, the processor 122 may be realized by a general-purpose microprocessor operating in cooperation with general-purpose memory. Examples of the general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of the general-purpose memory include a ROM and a RAM. In this case, a computer program for realizing the function may be stored in the ROM. The general-purpose microprocessor specifies at least a portion of the program stored in the ROM, expands it on the RAM, and executes the above-described processing in cooperation with the RAM. In this case, the general-purpose memory is an example of a non-transitory computer-readable medium on which a computer program is stored.

[0047] Processor 122 may be implemented by a combination of a general-purpose microprocessor and a dedicated integrated circuit.

[0048] The configurations described above are merely examples to facilitate understanding of the present disclosure. Each configuration example can be appropriately modified and combined with other configuration examples without departing from the spirit of the present disclosure.

[0049] In the above embodiment, the input device 11 is disposed in the center cluster 24 of the vehicle 20. That is, the input device 11 is disposed between the driver's seat and the passenger seat in the left-right direction of the vehicle 20. With this configuration, the input device 11 can be easily accessed not only by the driver but also by a passenger sitting in the passenger seat, thereby improving the operability of the user interface system 10.

[0050] However, in addition to or instead of the above-described input device 11, an input device 11 having a similar function may be provided at an appropriate location in the vehicle interior 21. For example, as shown in FIG. 2 , the input device 11 may be provided on a steering wheel 25 or the like.

[0051] The user interface system 10 may be installed in a moving body other than the vehicle 20. Examples of such moving bodies include trains, airplanes, and ships. The moving body may not require a driver. The moving body may have only one seat for the passengers.

[0052] The contents of Japanese Patent Application No. 2023-079599 filed on May 12, 2023 are incorporated by reference as part of this disclosure.

Claims

1. A user interface system mounted on a moving body, comprising: a control device that causes a display device to display a room image corresponding to a state in which a room in the moving body is viewed from the front; and an input device that accepts a first operation to change the direction of an airflow generated by an air conditioning device mounted on the moving body, wherein the control device displays a target image indicating the position where the airflow will reach within the room image, and changes the position of the target image within the room image based on the first operation.

2. The user interface system according to claim 1, wherein the interior image includes images representing a driver's seat and a passenger seat, and the image representing the driver's seat is displayed in a manner distinguishable from the image representing the passenger seat.

3. The user interface system according to claim 1 or 2, wherein the room image corresponds to a mirror image of the room.

4. A user interface system as described in any one of claims 1 to 3, wherein the input device is capable of accepting a second operation for changing the strength of the air flow, and the control device displays a path image representing the path of the air flow within the room image and changes the display mode of the path image based on the second operation.

5. A user interface system according to any one of claims 1 to 4, wherein the input device includes a touch panel device that functions as part of the display device, and the first operation is a touch operation on the room image.

6. A user interface system as described in any one of claims 1 to 5, wherein the input device is capable of accepting a third operation for changing the position of a viewpoint from which the room is viewed, and the control device causes the display device to display an image of the room viewed from a viewpoint other than the front.

7. The user interface system according to claim 1, wherein the input device is disposed between a driver's seat and a passenger seat in the left-right direction of the moving body.

8. A control device mounted on a moving body, comprising: a processor that causes a display device to display a room image corresponding to a state in which a room in the moving body is viewed from the front; and an interface that receives an operation signal corresponding to an operation to change the direction of an airflow generated by an air conditioning device mounted on the moving body, wherein the processor displays a target image indicating the position where the airflow will reach within the room image, and changes the position of the target image within the room image based on the operation.

9. A non-transitory computer-readable medium storing a computer program executable by a processor of a control device mounted on a mobile body, wherein, when the computer program is executed, the control device: displays on a display device a room image corresponding to a state in which a room of the mobile body is viewed from the front; accepts an operation signal corresponding to an operation to change the direction of an airflow generated by an air conditioning device mounted on the mobile body; displays within the room image a target image indicating the position where the airflow will reach; and changes the position of the target image within the room image based on the operation.

Citation Information

Patent Citations

  • Environmental control device

    JP2009255838A

  • Air conditioner control terminal and method of setting operation for air conditioning control

    JP2013076493A