Display devices, in-vehicle systems, and vehicles

By providing tactile or auditory feedback in the display device to differentiate interface switching, the problem of users finding it difficult to perceive interface loops is solved, and the convenience of multi-interface display is improved.

CN123061133APending Publication Date: 2026-11-10TOYOTA JIDOSHA KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202610552426.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2025-05-08
Filing Date
2026-04-24
Publication Date
2026-11-10

AI Technical Summary

Technical Problem

In multi-interface display devices, users may find it difficult to perceive whether the interface cycle has completed a full cycle, leading to reduced convenience.

Method used

By outputting tactile or auditory feedback in the display device, perceptual differences during interface switching can be distinguished. For example, specific feedback can be provided when switching between interface number one and interface number n, while no feedback can be provided when switching between other interfaces.

Benefits of technology

It improves user convenience on multi-interface display devices, making it easier for users to grasp the interface cycle state and reduce unnecessary operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123061133A_ABST
    Figure CN123061133A_ABST
Patent Text Reader

Abstract

This disclosure relates to display devices, in-vehicle systems, and vehicles. The display unit of the display device is configured to sequentially switch between a first interface and an nth interface in response to a predetermined touch operation performed by a user. n is an integer greater than or equal to 3. Furthermore, when switching between the first interface and the nth interface is displayed on the display unit, feedback is output to the user that is perceptually different from the feedback when switching between interfaces other than those displayed on the display unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to display devices, in-vehicle systems, and vehicles. Background Technology

[0002] Japanese Patent Application Publication No. 2023-152459 discloses a technology related to automotive displays. In the automotive displays disclosed in Japanese Patent Application Publication No. 2023-152459, multiple buttons are displayed in a rotating manner in a designated area on the screen.

[0003] Japanese Patent Application Publication No. 2018-51365 discloses a technology related to a gaming device. In the gaming device disclosed in Japanese Patent Application Publication No. 2018-51365, at least one of a plurality of selectable objects set in a predetermined order is displayed on a display unit. Furthermore, a switching unit switches the selected objects displayed on the display unit in the predetermined order based on a first operation performed by the user. Moreover, if the first or last selected object in the predetermined order is displayed on the display unit, the switching unit switches from the first selected object to the last selected object or from the last selected object to the first selected object based on a second operation performed by the user. Here, the first operation is a movement operation that moves the operation point in a specific direction. Furthermore, the second operation is an operation on the first or last selected object whose operation time is longer than a predetermined threshold.

[0004] Japanese Patent Application Publication No. 2006-252366 discloses a technology related to a display device. In the display device disclosed in Japanese Patent Application Publication No. 2006-252366, the menu display is scrolled sequentially in response to the operation of an operating element. Furthermore, in the display device, when scrolling from the beginning to the end of the menu and when scrolling from the end to the beginning of the menu, the scrolling is temporarily stopped for a longer period of time compared to the case where the menu is scrolled continuously. Summary of the Invention

[0005] This disclosure provides a display device, an in-vehicle system, and a vehicle, wherein the display device, in-vehicle system, and vehicle improve the convenience for users when using a display device that sequentially displays multiple interfaces in a display section having a touch panel.

[0006] The first embodiment of this disclosure provides a display device comprising a display section having a touch panel. In this display section, in response to a predetermined touch operation performed by a user, a first interface to an nth interface (n≥3) are sequentially displayed and switched. Furthermore, when switching between the first interface and the nth interface is displayed on the display section, feedback is output to the user that is perceptually different from the feedback when switching between interfaces other than the first interface and the nth interface.

[0007] Alternatively, the display device of the first embodiment of this disclosure may also include a sound output device. Alternatively, the feedback may be sound output from the sound output device.

[0008] In the display device of the first embodiment of this disclosure, a predetermined sound may be output from the sound output device when switching between the first interface and the nth interface on the display unit. Alternatively, when switching between interfaces other than the first interface and the nth interface on the display unit, no sound may be output from the sound output device.

[0009] Alternatively, the display device of the first embodiment of this disclosure may also include a haptic feedback device. Alternatively, the feedback may be haptic feedback output through the haptic feedback device.

[0010] In the display device of the first embodiment of this disclosure, when switching between the first interface and the nth interface displayed on the display unit, a predetermined haptic feedback may be output through the haptic feedback device. Alternatively, when switching between interfaces other than the first interface and the nth interface displayed on the display unit, haptic feedback may not be output through the haptic feedback device.

[0011] In the display device of the first embodiment of this disclosure, the specified touch operation may also be scrolling or sliding in the horizontal or vertical direction.

[0012] The second embodiment of this disclosure provides an in-vehicle system comprising: a display device having a plurality of display units including at least a pair of display units; and an information processing device for controlling the display device, wherein the pair of display units are respectively positioned on both sides of the steering wheel in front of the driver's seat within the vehicle compartment, protruding towards the rear of the vehicle than an instrument panel disposed on the front of the steering wheel. The pair of display units has a touch panel, and the information processing device has a processor configured to perform the following actions: in each of the pair of display units, in response to a predetermined touch operation performed by a user, sequentially switching between a first interface and an nth interface (n≥3); and when switching between the first interface and the nth interface in each of the pair of display units, providing feedback to the user that is perceptually different from the feedback when switching between interfaces other than the first interface and the nth interface in each of the pair of display units.

[0013] In the second embodiment of the in-vehicle system disclosed herein, the display device may also include a sound output device. Alternatively, the processor may output sound as feedback from the sound output device.

[0014] In the vehicle system of the second embodiment of this disclosure, the processor may output a predetermined sound from the sound output device when switching between the first interface and the nth interface in each of the pair of display units. Alternatively, the processor may not output sound from the sound output device when switching between interfaces other than the first interface and the nth interface in each of the pair of display units.

[0015] In the second embodiment of the in-vehicle system disclosed herein, the display device may also include a haptic feedback device. Alternatively, the processor may use the haptic feedback device to output haptic feedback.

[0016] In the vehicle system of the second embodiment of this disclosure, when switching between the first interface and the nth interface in each of the pair of displays, the processor outputs predetermined haptic feedback through the haptic feedback device. Alternatively, when switching between interfaces other than the first interface and the nth interface in each of the pair of displays, the processor does not output haptic feedback through the haptic feedback device.

[0017] In the vehicle system of the second embodiment of this disclosure, the specified touch operation may also be scrolling or swiping in the horizontal or vertical direction.

[0018] The vehicle of the third embodiment of this disclosure has the vehicle-mounted system of the second embodiment of this disclosure.

[0019] In addition, as other options, the information processing method executed by the aforementioned information processing apparatus, the program for causing a computer to execute the information processing method, or the computer-readable storage medium that non-temporarily stores the program are examples.

[0020] According to the present disclosure, the convenience of a display device that allows users to sequentially switch between multiple interfaces in a display section with a touch panel is improved. Attached Figure Description

[0021] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, wherein the same reference numerals denote the same elements, wherein: Figure 1 This is a diagram showing the front portion of the vehicle's interior according to the embodiment.

[0022] Figure 2 It is a diagram showing the general layout of the display device and its surroundings.

[0023] Figure 3This is a block diagram schematically illustrating an example of the hardware configuration of a system mounted on a vehicle according to the first embodiment.

[0024] Figure 4 This is a block diagram that schematically represents an example of the functional configuration of an ECU.

[0025] Figure 5 This is an example of a main screen displayed on an external monitor.

[0026] Figure 6A This is an example diagram showing a user interface displayed on an external monitor.

[0027] Figure 6B This is an example diagram showing a user interface displayed on an external monitor.

[0028] Figure 6C This is an example diagram showing a user interface displayed on an external monitor.

[0029] Figure 6D This is an example diagram showing a user interface displayed on an external monitor.

[0030] Figure 7 This is an example of a main screen displayed on an internal monitor.

[0031] Figure 8A This is an example diagram showing an interface displayed on an internal monitor.

[0032] Figure 8B This is an example diagram showing an interface displayed on an internal monitor.

[0033] Figure 8C This is an example diagram showing an interface displayed on an internal monitor.

[0034] Figure 8D This is an example diagram showing an interface displayed on an internal monitor.

[0035] Figure 9 It is a diagram showing the switching order of the interface screens on the external monitor.

[0036] Figure 10 It is a diagram showing the switching order of the interface screens on the internal display.

[0037] Figure 11 This is a flowchart illustrating the process of controlling the display switching of the interface screen in the first embodiment.

[0038] Figure 12 This is a block diagram schematically illustrating an example of the hardware configuration of a system mounted on a vehicle according to the second embodiment.

[0039] Figure 13This is a flowchart illustrating the process of controlling the display switching of the interface screen in the second embodiment. Detailed Implementation

[0040] A display device is known that is configured to switch between displaying multiple interfaces on a single display. In such a display device, when switching between interfaces displayed on the display, a user performs a prescribed touch operation on the display. Furthermore, in response to the prescribed touch operation performed by the user, multiple interfaces are sequentially displayed on the display in a preset order. Thus, the user can selectively utilize multiple interfaces on a single display.

[0041] However, when a large number of interfaces can be displayed on a screen, it becomes difficult to determine whether all interfaces that can be cycled through have been displayed when the user repeatedly performs prescribed touch operations on the screen to switch between them. In other words, users sometimes find it difficult to perceive whether the cycle of multiple interfaces on the screen has completed a full cycle or is still in the middle. Therefore, users may sometimes need to spend time and effort to display the desired interface. Thus, there is room for improvement in the convenience of display devices that allow users to sequentially switch between multiple interfaces using a touch panel display.

[0042] In response to this, one of the solutions disclosed herein is a display device having a display section with a touch panel, wherein, in response to a predetermined touch operation performed by a user, a first interface to an nth (n≥3) interface are sequentially switched on and off, and when switching between the first interface and the nth interface on the display section, feedback is output to the user that is perceptually different from the feedback when switching between interfaces other than the first interface and the nth interface on the display section.

[0043] The display device includes a display section with a touch panel. Therefore, when a user performs a touch operation on the display section, the operation is detected by the touch panel. Furthermore, in response to a specified touch operation performed by the user, interfaces numbered from the first to the nth are displayed sequentially on the display section. Here, n ≥ 3. That is, in the display device, three or more n interfaces can be displayed on the display section in a cyclical manner.

[0044] Furthermore, the display device is configured to output perceptible feedback to a user who has performed a prescribed touch operation on the display unit. Moreover, in the display device, when the display of the interface on the display unit is switched in response to a prescribed touch operation performed by the user, feedback is output to the user. Here, the feedback to the user can be output as, for example, sound or tactile feedback.

[0045] Here, as described above, in the display unit, the first to nth interfaces are displayed sequentially in a cyclical manner. When the display is switched forward in response to a predetermined touch operation performed by the user, the first interface is displayed immediately following the nth interface. Furthermore, when the display is switched backward in response to a predetermined touch operation performed by the user, the nth interface is displayed immediately following the first interface. That is, in the display unit, the display can switch not only between sequentially adjacent interfaces from the first to the nth interface, but also between the first and nth interfaces.

[0046] Furthermore, in the display device, when switching between the first interface and the nth interface on the display unit, the feedback provided to the user is different from the feedback when switching between interfaces other than the first interface and the nth interface on the display unit. Therefore, when the user repeatedly performs a prescribed touch operation to continuously switch the displays on the display unit, and a switch is made between the first interface and the nth interface, the user can perceive the switch. Thus, the user can perceive whether the cycle of the n interfaces displayed on the display has completed a full cycle or is still in the middle of a cycle. This helps the user to display the desired interface on the display. Therefore, according to this disclosure, the convenience for users when using a display device that sequentially displays multiple interfaces on a display unit with a touch panel is improved.

[0047] Hereinafter, specific embodiments of the present disclosure will be described based on the accompanying drawings. Unless otherwise specified, the dimensions, materials, shapes, and relative arrangements of the constituent components described in this embodiment are not intended to limit the technical scope of the present disclosure.

[0048] <First Implementation> (Overall structure of the system) Figure 1 This diagram shows the front portion of the passenger compartment of the vehicle according to this embodiment. A driver's seat 2 and a passenger seat 3 are provided inside the passenger compartment of vehicle 1. It should be noted that vehicle 1 in this embodiment is a right-hand drive vehicle, and the driver's seat 2 is located on the right side of the vehicle 1 in the direction of travel. A steering wheel 4 is provided in front of the driver's seat 2. The steering wheel 4 can be circular or U-shaped (a so-called irregular steering wheel). The steering wheel 4 is connected to the steering system of vehicle 1 via a steering column. The steering column is covered by a column cover. Furthermore, inside the passenger compartment of vehicle 1, the passenger seat 3 is located to the left of the driver's seat 2 (on the left side of the vehicle 1 in the direction of travel).

[0049] A display device 20 is provided at the front of the passenger compartment of vehicle 1. The display device 20 has multiple displays 21, 22, 23, and 26. Specifically, the display device 20 includes an instrument panel display 21, an inner display 22, an outer display 23, and a central display 26. The instrument panel display 21 is located in front of the steering wheel 4 (approximately at the center of the front portion of the driver's seat 2) in front of the driver's seat 2. The inner display 22 is located behind the instrument panel display 21 and inside the vehicle 1. The outer display 23 is located behind the instrument panel display 21 and outside the vehicle 1. The inner display 22 is connected to the instrument panel display 21 via a connecting part 24. The outer display 23 is connected to the instrument panel display 21 via a connecting part 25.

[0050] The central display 26 is located in the middle of the driver's seat 2 and the front passenger seat 3 in the front of the passenger compartment (approximately in the center of the front part of the passenger compartment). That is, the central display 26 is located in the front of the passenger compartment on the side of the front passenger seat 3, which is closer to the instrument display 21, the interior display 22 and the exterior display 23.

[0051] Here, the outer side of vehicle 1 refers to the side closest to the outside of vehicle 1 when viewed from the driver's seat 2, specifically the side of the driver's seat 2's door. Similarly, the inner side of vehicle 1 refers to the side of the passenger seat 3 when viewed from the driver's seat 2, specifically the side of the passenger seat 3's door. For example, in a vehicle 1 where the steering wheel 4 is located on the right side, the outer side of vehicle 1 refers to the right side of vehicle 1, and the inner side of vehicle 1 refers to the left side of vehicle 1. Furthermore, in a vehicle 1 where the steering wheel 4 is located on the left side, the outer side of vehicle 1 refers to the left side of vehicle 1, and the inner side of vehicle 1 refers to the right side of vehicle 1.

[0052] The instrument display 21, internal display 22, external display 23, and central display 26 are all displays with touch panels. It should be noted that at least the internal display 22 and external display 23 need to have touch panels. It should also be noted that the instrument display 21, internal display 22, and external display 23 can be formed by modifying a single touchscreen, or by combining individual touchscreens.

[0053] It should be noted that, regarding the touch panels of each display in the display device 20, pressure-sensitive touch panels that detect the pressure applied by the user when pressing the panel, and capacitive touch panels that detect changes in electrostatic capacitance when the user presses the panel, are examples of such touch panels. Furthermore, the display is, for example, an LCD (Liquid Crystal Display) or an EL (Electroluminescence) panel. Hereinafter, user touch refers to the user touching the touch panel.

[0054] The central display 26 can display driving-related assistance information (e.g., vehicle navigation information) provided to the driver of vehicle 1. Additionally, the central display 26 can also display entertainment-related information such as audio or television.

[0055] Here, based on Figure 2 A more detailed description will be given of the instrument display 21, the internal display 22, and the external display 23 in the display device 20. Figure 2 This is a diagram showing the general configuration of the display device 20 and its surroundings. The instrument display 21 of the display device 20 is fixed to the instrument panel 5. The instrument display 21 is a horizontally elongated display, while the inner display 22 and the outer display 23 are vertically elongated displays. The instrument display 21 is configured with its screen facing the rear of the vehicle and is arranged parallel to the left-right direction (vehicle width direction) of the vehicle 1. It should be noted that the instrument display 21 can also be configured with its screen slightly tilted upwards.

[0056] One end of the connecting portion 24 is connected to the inner end of the instrument panel display 21 on the vehicle side, and the inner display 22 is connected to the other end of the connecting portion 24. The inner display 22 is a display that extends from the inner end of the connecting portion 24 on the vehicle side toward the rear of the vehicle 1 and toward the inner side of the vehicle 1. It should be noted that the angle of the inner display 22 relative to the instrument panel display 21 is smaller than the angle of the connecting portion 24 relative to the instrument panel display 21. Furthermore, the connecting portion 24 is connected to the instrument panel display 21 and the inner display 22 in a curved manner. The connecting portion 24 has a curved surface that is recessed toward the front of the vehicle at the connection with the instrument panel display 21, and a curved surface that is protruding toward the rear of the vehicle at the connection with the inner display 22. It should be noted that the instrument panel display 21 and the inner display 22 may also have curved surfaces.

[0057] One end of the connecting portion 25 is connected to the outer end of the instrument display 21 on the vehicle's outer side, and the outer display 23 is connected to the other end of the connecting portion 25. The outer display 23 is a display that extends from the outer end of the connecting portion 25 on the vehicle's outer side toward the rear of the vehicle 1 and outwards from the vehicle 1. It should be noted that the angle of the outer display 23 relative to the instrument display 21 is smaller than the angle of the connecting portion 25 relative to the instrument display 21. The connecting portion 25 is connected to the instrument display 21 and the outer display 23 in a curved manner. The connecting portion 25 has a curved surface that is recessed toward the front of the vehicle at the connection with the instrument display 21, and a curved surface that is protruding toward the rear of the vehicle at the connection with the outer display 23. It should be noted that the outer display 23 may also have a curved surface.

[0058] The steering wheel 4 includes a gripping part for the driver to hold. Furthermore, since the instrument display 21, the inner display 22, the outer display 23, and the connecting parts 24 and 25 in the display device 20 have the shapes described above, the inner display 22 and the outer display 23 are arranged near the gripping part in the steering wheel 4.

[0059] Furthermore, the inner display 22 and the outer display 23 are angled relative to the left and right directions of the steering wheel 4 and are respectively configured to tilt towards the steering wheel 4. That is, the inner display 22 is configured to protrude further towards the rear of the vehicle 1 as it moves inwards, while the outer display 23 is configured to protrude further towards the rear of the vehicle 1 as it moves outwards. Thus, the inner display 22 and the outer display 23 are respectively configured to face the driver.

[0060] The instrument display 21 is an interface that displays information necessary for driving the vehicle 1, such as the vehicle 1's speed, engine speed (if the vehicle 1 has an engine), charging / discharging status (if the vehicle 1 has a drive battery), driving distance, and the status of advanced driver-assistance systems (ADAS).

[0061] External display 23 displays interfaces (hereinafter sometimes referred to as "first interfaces") respectively related to multiple first defined functions among the multiple functions possessed by vehicle 1. Here, the first defined functions include functions associated with the control of vehicle 1. In addition, internal display 22 displays interfaces (hereinafter sometimes referred to as "second interfaces") respectively related to multiple second defined functions among the multiple functions possessed by vehicle 1 that are different from the multiple first defined functions. Here, the second defined functions include functions associated with the convenience of the occupants of vehicle 1. Each first interface displayed on external display 23 and each second interface displayed on internal display 22 contains operation icons (e.g., switch icons or button icons) operated by the driver of vehicle 1. It should be noted that details regarding the first defined functions, second defined functions, first interfaces, and second interfaces will be described later.

[0062] As described above, considering the driver's operability, the display device 20 is configured with an inner display 22 and an outer display 23 as a pair. Furthermore, in the display device 20, the central display 26 is larger than the inner display 22. Also, the central display 26 is larger than the outer display 23. It should be noted that in this embodiment, the instrument display 21 corresponds to the "instrument section" of this disclosure. And in this embodiment, the inner display 22 and the outer display 23 correspond to the "display section" of this disclosure.

[0063] (Hardware configuration) Figure 3 This is a block diagram schematically illustrating an example of the hardware configuration of a system mounted in a vehicle according to this embodiment. The system mounted in vehicle 1 includes an ECU 10, a display device 20, a voice unit 41, a sensor group 42, an electrical equipment group 43, and a drive system 44.

[0064] ECU10 can be configured as a computer with a processor (CPU (Central Processing Unit), GPU (Graphics Processing Unit), etc.), main storage (RAM (Random Access Memory), ROM (Read Only Memory), etc.), and auxiliary storage (EPROM (Erasable Programmable Read Only Memory), hard disk drive, removable media, etc.). The auxiliary storage stores the operating system (OS), various programs, various tables, etc. By executing the programs stored in the auxiliary storage, various functions (software modules) that meet the specified purpose can be achieved, as described later. However, some or all of the functions can also be implemented as hardware modules using hardware circuits such as ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). Display device 20, voice unit 41, sensor group 42, electrical equipment group 43, and drive system 44 are connected to ECU10. It should be noted that the ECU10 does not necessarily need to be composed of a single piece of hardware; it can also be composed of multiple computers. Furthermore, in this embodiment, the ECU10 is equivalent to the "information processing device" of this disclosure.

[0065] The display device 20 includes an instrument display 21, an internal display 22, an external display 23, a central display 26, a touch panel 27, and a sound output device 28. The touch panel 27 is a unit for detecting touch operations performed on the instrument display 21, internal display 22, external display 23, and central display 26. The touch panel 27 is respectively disposed on the instrument display 21, internal display 22, external display 23, and central display 26. Thus, each display is configured to enable touch-based operation. The instrument display 21, internal display 22, external display 23, connecting part 24, connecting part 25, and touch panel 27 can also be constructed by deforming the shape of a touchscreen.

[0066] The sound output device 28 is a means for outputting sound (e.g., electronic sound). The sound output device 28 may be configured, for example, to include a speaker or a buzzer. The sound output device 28 is configured on both the internal display 22 and the external display 23. As described later, multiple interfaces are displayed alternately on both the internal display 22 and the external display 23. The sound output device 28 is a device for outputting a predetermined switching tone when the display of the interface on the internal display 22 or the external display 23 is switched. It should be noted that details regarding the control of outputting the predetermined switching tone from the sound output device 28 as the display of the interface on the internal display 22 or the external display 23 switches will also be described later.

[0067] The voice unit 41 is a unit that performs voice-based information input and output. The voice unit 41 may include, for example, a speaker and a microphone. The voice unit 41 can acquire the voice spoken by the occupants of vehicle 1. Furthermore, the voice unit 41 can speak to the occupants of vehicle 1.

[0068] Sensor group 42 is a collection of multiple sensors used to acquire sensor data during the driving of vehicle 1. These sensors can be sensors that acquire physical quantities or sensors that acquire image data, etc. Sensor group 42 may include, for example, sensors for detecting the state of vehicle 1 and sensors for detecting driver actions. Specifically, sensor group 42 may include speed sensors, acceleration sensors, accelerator opening sensors, braking sensors, steering angle sensors, engine speed sensors, yaw rate sensors, turn signal switch sensors, gear shift position sensors, GPS (Global Positioning System) sensors, interior temperature sensors, exterior temperature sensors, ranging radar, illuminance sensors, etc.

[0069] A speed sensor detects the speed of vehicle 1. An acceleration sensor detects the acceleration of vehicle 1. An accelerator pedal position sensor detects the position of the accelerator pedal. A brake pedal position sensor detects the position of the brake pedal. A steering angle sensor detects the steering angle of steering wheel 4. An engine speed sensor detects the engine speed. A yaw rate sensor detects the yaw rate of vehicle 1. A turn signal switch sensor detects the state of the turn signal switch. A shift position sensor detects the shift position. A GPS sensor acquires the location information of vehicle 1. An interior temperature sensor detects the interior temperature. An exterior temperature sensor detects the exterior temperature. A ranging radar measures the distance to objects. An illuminance sensor detects the brightness of the ambient light outside vehicle 1.

[0070] Electrical equipment group 43 is a collection of electrical equipment installed in vehicle 1. Electrical equipment group 43 includes, for example, vehicle control system devices such as headlight units, windshield wiper actuators, rearview mirror actuators, and seat actuators. In addition, electrical equipment group 43 also includes in-vehicle devices with functions other than vehicle control, such as navigation devices, multimedia devices, and air conditioning.

[0071] The drive system 44 is a system composed of various drive system devices of the vehicle 1. The drive system devices include, for example, an engine and / or motor as a power source, a battery, a transmission, etc.

[0072] (Functional structure of ECU) Here, based on Figure 4 The functional structure of ECU10 will be explained. Figure 4 This is a block diagram schematically illustrating an example of the functional configuration of an ECU. The ECU 10 includes a control unit 100, a storage unit 110, and an in-vehicle communication module 120 as functional components. The control unit 100 is a functional component provided, for example, by a processor executing various programs stored in an auxiliary storage device. The display device 20 receives control commands from a user, who is a passenger in the vehicle 1, via a touch panel 27. At this time, a signal corresponding to the user's input operation on any one of the multiple displays 21, 22, 23, and 26 is sent from the touch panel 27 to the ECU 10. Furthermore, in the ECU 10, the control unit 100, in response to the user's input operation on any display, executes control of the display device 20, the electrical devices included in the electrical equipment group 43, or the drive system devices included in the drive system 44.

[0073] The control unit 100 includes an HMI (Human Machine Interface) control unit 101, an operation determination unit 102, and an output unit 103 as software modules. The HMI control unit 101 generates interfaces related to various functions of the vehicle 1. Furthermore, the HMI control unit 101 displays the generated interfaces on various displays of the display device 20. In addition, the interfaces generated by the HMI control unit 101 and displayed on each display include operation icons that can be operated by the user. These operation icons are icons used by the driver to control various functions of the vehicle 1. The HMI control unit 101 accepts control commands input by the user through operation of these operation icons.

[0074] The operation determination unit 102 determines the input operation performed by the user on any of the displays based on the signals received from the touch panel 27 of the display device 20. For example, the operation determination unit 102 determines the part of the screen touched by the user on any of the multiple displays 21, 22, 23, and 26 of the display device 20. In addition, the operation determination unit 102 determines the content of the input operation performed by the user on any of the multiple displays 21, 22, 23, and 26 of the display device 20 (e.g., flick, scroll, swipe, tap, pinch-to-release, double-tap, long press, and multi-tap).

[0075] The output unit 103 sends control signals corresponding to control commands received by the HMI control unit 101 or user input operations determined by the operation determination unit 102 to the controlled device (i.e., any one of the electrical devices included in the display device 20, the electrical equipment group 43, or the drive system devices included in the drive system 44). In the controlled device, control corresponding to the control signals is executed by receiving the control signals sent by the output unit 103.

[0076] The storage unit 110 is a functional component for storing information. The storage unit 110 is configured to include a main storage device and an auxiliary storage device. The storage unit 110 stores various programs executed by the control unit 100 and control data used in the execution of these programs.

[0077] The in-vehicle communication module 120 is a functional component used to connect the ECU 10 to the vehicle network using a specified in-vehicle communication standard. Examples of specified in-vehicle communication standards include CAN (Controller Area Network) or LIN (Local Interconnect Network). The ECU 10 communicates with various devices located in the vehicle 1 via the in-vehicle communication module 120.

[0078] (interface) Next, the interfaces displayed on the internal display 22 and external display 23 of the display device 20 will be described. As described above, the HMI control unit 101 displays multiple interfaces related to various functions of the vehicle 1 on each display of the display device 20. At this time, the HMI control unit 101 displays a first interface related to a first specified function (a function associated with the control of the vehicle 1) on the external display 23. In addition, the HMI control unit 101 displays a second interface related to a second specified function (a function associated with the convenience of the occupants of the vehicle 1) on the internal display 22.

[0079] In the display device 20, as described above, the output destinations of the multiple interfaces associated with the various functions of the vehicle 1 are assigned according to the category of the function. Thus, the driver can easily and intuitively identify which of the internal display 22 and external display 23 the interface on which the driver wishes to confirm or operate the displayed content is output to. Furthermore, the operating surfaces of the touch panels 27 on the internal display 22 and external display 23 are positioned near the steering wheel 4. Therefore, when the driver wishes to perform various controls via touch operation of the displays, the amount of movement of the driver's eyes and hands is minimized.

[0080] It should be noted that the external display 23 displays one of a plurality of first interfaces. Furthermore, the internal display 22 displays one of a plurality of second interfaces. The HMI control unit 101 switches between the first interface displayed on the external display 23 and the second interface displayed on the internal display 22.

[0081] Here, based on Figure 5 as well as Figures 6A to 6D The interface displayed on the external monitor 23 will be described. Figure 5 as well as Figures 6A to 6D This diagram illustrates an example of a multi-interface (interface screen) displayed by the HMI control unit 101 on the external display 23 as the first interface. Figure 5 The main screen displayed on the external display 23 is shown. The main screen is the interface typically displayed on the external display 23 while the vehicle 1 is in motion. The main screen displays operation icons related to frequently used functions. It should be noted that the content displayed on the main screen can be customized by the user.

[0082] In addition, such as Figures 6A to 6D As shown, the headlight control screen is displayed on the external display 23. Figure 6A Wiper control screen ( Figure 6B ), rearview mirror adjustment screen ( Figure 6C ) and driving mode setting screen ( Figure 6D () is used as the first interface.

[0083] (A) Headlight control screen The headlight control screen is an interface screen related to the headlight control function. The headlight control screen contains operation icons for setting the illumination status (automatic, on, off, parking lights, daytime running lights, etc.) of the headlights on vehicle 1. Furthermore, the control unit 100 controls the headlight units included in the electrical equipment group 43 based on the operations performed by the driver on the headlight control screen. In addition, the current headlight illumination status is displayed on the headlight control screen.

[0084] (B) Wiper control screen The wiper control screen is an interface screen related to the wiper control function. The wiper control screen includes operation icons for setting the operating status (stop, automatic operation, intermittent operation, continuous operation, etc.) of the wipers (front and rear wipers) on the vehicle 1. Furthermore, the control unit 100 controls the wiper actuators included in the electrical equipment group 43 based on the driver's operations on the wiper control screen. In addition, the wiper control screen displays the current operating status of the front and rear wipers.

[0085] (C) Rearview mirror adjustment screen The rearview mirror adjustment screen is an interface screen related to the rearview mirror adjustment function. The rearview mirror adjustment screen contains operation icons for adjusting the state (folded / unfolded state and angle) of the side rearview mirrors on vehicle 1. Furthermore, the control unit 100 controls the rearview mirror actuators included in the electrical equipment group 43 based on the driver's operations on the rearview mirror adjustment screen. In addition, the current state of the side rearview mirrors is displayed on the rearview mirror adjustment screen.

[0086] (D) Driving mode setting screen The driving mode setting screen is an interface screen related to the driving mode setting function. The driving mode setting screen contains operation icons for setting the driving mode of vehicle 1. Furthermore, the control unit 100 sets the driving mode based on the operations performed by the driver on the driving mode setting screen.

[0087] It should be noted that the aforementioned headlight control function, wiper control function, rearview mirror adjustment function, and driving mode setting function are all types of the first specified functions. However, the first specified functions are not limited to these functions. For example, seat position adjustment function and ADAS setting function are also types of the first specified functions. The seat position adjustment function is a function that adjusts the position and angle of the seat provided in the vehicle 1 by controlling the seat actuator through the control unit 100. The ADAS setting function is a function that controls the ADAS provided in the vehicle 1 through the control unit 100. Furthermore, the seat position adjustment screen and the ADAS setting screen can also be displayed on the external display 23 as the first interface. The seat position adjustment screen is an interface screen related to the seat position adjustment function. In addition, the ADAS setting screen is an interface screen related to the ADAS setting function.

[0088] Next, based on Figure 7 as well as Figures 8A to 8D The interface displayed on the internal display 22 will be described. Figure 7 as well as Figures 8A to 8D This is a diagram illustrating an example of a multi-interface (interface screen) that is displayed on the internal display 22 by the HMI control unit 101 as a second interface. Figure 7 The main screen displayed on the internal display 22 is shown. The main screen is the interface screen that is typically displayed on the internal display 22 while the vehicle 1 is in motion. The main screen displays operation icons related to frequently used functions. It should be noted that the content displayed on the main screen can be customized by the user.

[0089] In addition, such as Figures 8A to 8D As shown, the navigation screen is displayed on the internal display 22. Figure 8A ), audio and video ( Figure 8B ), Air conditioning settings screen ( Figure 8C ) and AI (Artificial Intelligence) assistant screen ( Figure 8D () is used as the second interface.

[0090] (A) Navigation screen The navigation screen is the interface screen related to the navigation function. It displays navigation-related information generated by the control unit 100. In addition, the navigation screen includes operation icons for destination setting, location registration, etc.

[0091] (B) Audio / Video The audio screen is an interface screen related to the audio functions of the multimedia device. The audio screen contains operation icons for controlling the audio functions of the multimedia device (such as music playback). Furthermore, the control unit 100 controls the multimedia devices included in the electrical equipment group 43 based on the operations performed by the driver on the audio screen. In addition, information related to the music being played is displayed on the audio screen.

[0092] (C) Air Conditioner Setting Screen The air conditioning setting screen is an interface screen related to the air conditioning control functions. The air conditioning setting screen contains operation icons for setting the air conditioning's operating status (temperature, fan speed, air conditioning function, etc.). Furthermore, the control unit 100 controls the air conditioners included in the electrical equipment group 43 based on the operations performed by the driver on the air conditioning setting screen. In addition, the current operating status of the air conditioning is displayed on the air conditioning setting screen.

[0093] (D) AI Assistant Screen The AI ​​assistant screen is the interface screen related to the functions of the intelligent agent. It is used to converse with a virtual intelligent agent (AI assistant) capable of natural language-based dialogue. The AI ​​assistant screen includes a character representing the virtual intelligent agent. Users can obtain information by conversing with this character on the AI ​​assistant screen. Natural language-based dialogue services are provided by the control unit 100. Furthermore, the AI ​​assistant screen includes operation icons for conversing with the AI ​​assistant.

[0094] It should be noted that the navigation function, audio function, air conditioning control function, and intelligent agent function mentioned above are all types of the second specified functions. However, the second specified functions are not limited to these functions. For example, the telephone function is also a type of second specified function. The telephone function enables hands-free calling by controlling the wireless communication function of the multimedia device through the control unit 100 to establish a wireless connection with a user terminal located in the vehicle 1. Furthermore, the call interface can also be displayed on the internal display 22 as a second interface. The call screen is an interface screen related to the telephone function.

[0095] (Switching of interface screens) The user (driver of vehicle 1) can switch the interface displayed on the internal display 22 by performing a prescribed touch operation as input. Similarly, the user can switch the interface displayed on the external display 23 by performing a prescribed touch operation as input. Here, the prescribed touch operation can be, for example, horizontal scrolling or swiping. It should be noted that the prescribed touch operation can also be vertical scrolling or swiping.

[0096] In each of the internal display 22 and the external display 23, in response to a specified touch operation performed by the user, the aforementioned multiple interface screens are displayed sequentially. Here, based on Figure 9 and Figure 10 The switching order of the interface screens on the internal display 22 and the external display 23 is explained.

[0097] Figure 9 This is a diagram showing the switching sequence of the interface screens on an external monitor. For example... Figure 9 As shown, regarding the external display 23, the main screen is set to interface number one, the headlight control screen is set to interface number two, the wiper control screen is set to interface number three, the rearview mirror adjustment screen is set to interface number four, and the driving mode setting screen is set to interface number five.

[0098] also, Figure 10 This is a diagram showing the switching sequence of interface screens on the internal display. For example... Figure 10 As shown, regarding the internal display 22, the main screen is set as the first interface, the navigation screen is set as the second interface, the audio screen is set as the third interface, the air conditioning settings screen is set as the fourth interface, and the AI ​​assistant screen is set as the fifth interface.

[0099] Furthermore, in each of the internal display 22 and the external display 23, when the interface screens are switched sequentially in a forward direction, the interface screens are switched sequentially from the first interface screen to the fifth interface screen, and immediately following the fifth interface screen, the interface screen is switched back to the first interface screen. Similarly, in each of the internal display 22 and the external display 23, when the interface screens are switched sequentially in a reverse direction, the interface screens are switched sequentially from the fifth interface screen to the first interface screen, and immediately following the first interface screen, the interface screen is switched back to the fifth interface screen. In each of the internal display 22 and the external display 23, by switching the display of the interface screens in this way, the first to fifth interface screens can be displayed in a loop.

[0100] It should be noted that the switching direction (forward or reverse) of the interface screens in the internal display 22 and the external display 23 corresponds to the direction of the specified touch operation performed by the user. For example, if the specified touch operation is horizontal scrolling or swiping, the interface screen is switched forward when the user scrolls or swipes to the right, and switched backward when the user scrolls or swipes to the left. Alternatively, if the specified touch operation is vertical scrolling or swiping, the interface screen is switched forward when the user scrolls or swipes downward, and switched backward when the user scrolls or swipes upward.

[0101] Furthermore, in both the internal display 22 and the external display 23, when the interface screen is switched, a predetermined switching tone is output from the sound output device 28 in accordance with the timing of the switch. Thus, the user can visually and audibly recognize that the interface screen has switched in response to a predetermined touch operation performed by the user in either the internal display 22 or the external display 23.

[0102] As described above, in each of the internal display 22 and the external display 23, five interface screens can be displayed in a cyclical manner. Therefore, when the interface screens are switched sequentially by the user repeatedly performing prescribed touch operations on the internal display 22 or the external display 23, the user may sometimes find it difficult to perceive whether the cycle of the five interface screens displayed on the display has completed a full cycle or is still in the middle. In such cases, the user may sometimes need to spend time and effort to display the desired interface screen on the internal display 22 or the external display 23.

[0103] Therefore, in the display device 20 of this embodiment, two different sounds are used as the prescribed switching tones output from the sound output device 28. Specifically, in each of the internal display 22 and the external display 23, when switching between two sequentially adjacent interface screens displayed between the first interface screen and the fifth interface screen, the first switching tones are output from the sound output device 28. That is, when switching between the first interface screen and the second interface screen, between the second interface screen and the third interface screen, between the third interface screen and the fourth interface screen, or between the fourth interface screen and the fifth interface screen, the first switching tones are output from the sound output device 28. On the other hand, in each of the internal display 22 and the external display 23, when switching between the first interface screen and the fifth interface screen, a second switching tones different from the first switching tones are output from the sound output device 28.

[0104] By using two distinct sounds as the designated switching tones output from the sound output device 28, the user can perceive (i.e., auditorily) the switch when transitioning between the first and fifth interfaces on both the internal display 22 and the external display 23. Therefore, the user can easily perceive whether the cycle of the five interface images displayed on each display has completed a full cycle or is still in progress. This helps the user to display the desired interface image on either the internal display 22 or the external display 23.

[0105] (Control process) The following is based on Figure 11 The process of switching between the interface screens on the internal display 22 and the external display 23 is explained. Figure 11 This is a flowchart illustrating the process of switching the display screen in this embodiment. This process is executed by the control unit 100 of the ECU 10.

[0106] In this process, firstly in S101, the control unit 100 receives a signal from the touch panel 27 of the display device 20 corresponding to an input operation performed by the user. Next, in S102, the control unit 100 determines, based on the signal received in S101, the input operation performed by the user on any one of the multiple displays 21, 22, 23, and 26 of the display device 20. It should be noted that, as described above, the processing in S102 is performed by the operation determination unit 102.

[0107] Next, in S103, the control unit 100 determines whether the input operation performed by the user, as determined in S102, is a specified touch operation on the internal display 22 or the external display 23. If a negative determination is made in S103, it can be determined that the control requested by the user via the display device 20 is a control other than the display switching control of the interface screen. In this case, the process in S107 is then executed. In S107, the control unit 100 sends a control signal to the device that is the target of the control command, causing it to execute control (a control other than the display switching control of the interface screen) corresponding to the command content of the control command received by the user from the display device 20. After this, the execution of this process temporarily ends.

[0108] On the other hand, if an affirmative determination is made in S103, it can be determined that the control command received by the user from the display device 20 is a display switching command for the interface screen on the internal display 22 or the external display 23. In this case, the process in S104 is then executed. In S104, the control unit 100 determines whether the display switching command received by the user is a command to switch between the first interface screen and the fifth interface screen.

[0109] At this time, sometimes when the fifth screen is displayed on the internal display 22 or the external display 23, a predetermined touch operation for forward switching of the screen is detected via the touch panel 27. In this case, the control unit 100 can determine that the display switching command received by the user is a command to switch the display from the fifth screen to the first screen. Furthermore, sometimes when the first screen is displayed on the internal display 22 or the external display 23, a predetermined touch operation for reverse switching of the screen is detected via the touch panel 27. In this case, the control unit 100 can determine that the display switching command received by the user is a command to switch the display from the first screen to the fifth screen.

[0110] Furthermore, if a negative determination is made in S104, that is, if the display switching command received by the user commands a display switch between two sequentially adjacent interface screens from the first to the fifth interface screen, then the processing in S105 is executed. In S105, the control unit 100 sends a control signal to the display device 20 to switch the display of the interface screen on the internal display 22 and the external display 23, which has undergone a specified touch operation. As a result, a display switch between two sequentially adjacent interface screens from the first to the fifth interface screen is executed on either the internal display 22 or the external display 23.

[0111] Furthermore, in S105, the control unit 100 sends a control signal, which causes the first switching tone to be output from the sound output device 28 of the display on the inner display 22 or the outer display 23 that has undergone a predetermined touch operation, along with a control signal for switching the display of the interface screen, to the display device 20. Thus, in the inner display 22 or the outer display 23, at the timing of the interface screen display switching, the first switching tone is output from the sound output device 28. Afterward, the execution of this process temporarily ends.

[0112] On the other hand, if a positive determination is made in S104, the process in S106 is then executed. In S106, the control unit 100 also sends a control signal to the display device 20 to switch the display of the interface screen on the internal display 22 and the external display 23, which has undergone a specified touch operation. However, in this case, the display switching between the first interface screen and the fifth interface screen is performed on either the internal display 22 or the external display 23.

[0113] Furthermore, in S106, the control unit 100 sends a control signal, which causes the second switching tone to be output from the sound output device 28 of the display on the inner display 22 or the outer display 23 that has undergone a predetermined touch operation, along with a control signal for switching the display of the interface screen, to the display device 20. Thus, in the inner display 22 or the outer display 23, at the timing of the interface screen display switching, the second switching tone is output from the sound output device 28. Afterward, the execution of this process temporarily ends.

[0114] According to the control flow described above, in each of the internal display 22 and the external display 23, when switching between two sequentially adjacent interface screens displayed between the first and fifth interface screens, a first switching tone is output from the sound output device 28. Furthermore, in each of the internal display 22 and the external display 23, when switching between the first and fifth interface screens, a second switching tone is output from the sound output device 28. Thus, when switching between the first and fifth interface screens is displayed on the internal display 22 or the external display 23, the user can perceive the switch audibly.

[0115] It should be noted that in this embodiment, when the display of the interface screen in each of the internal display 22 and the external display 23 is switched, it is not necessary to always output the prescribed switching tone from the sound output device 28. For example, it is also possible that in each of the internal display 22 and the external display 23, the prescribed switching tone is output from the sound output device 28 only when switching between the first interface screen and the fifth interface screen. In this case, in each of the internal display 22 and the external display 23, when switching between two sequentially adjacent interface screens displayed between the first and fifth interface screens, the switching tone is not output from the sound output device 28. Even when the output of the switching tone from the sound output device 28 is controlled in this way, the user can still perceive the display switching between the first and fifth interface screens in each of the internal display 22 and the external display 23 audibly.

[0116] <Second Implementation> (Hardware configuration) In this embodiment, part of the configuration of the display device 20 differs from that in the first embodiment. Figure 12 This is a block diagram schematically illustrating an example of the hardware configuration of a system mounted in a vehicle according to this embodiment. In this embodiment, similar to the first embodiment, the system mounted in vehicle 1 also includes an ECU 10, a display device 20, a voice unit 41, a sensor group 42, an electrical equipment group 43, and a drive system 44. Furthermore, in this embodiment, the display device 20 has a haptic feedback device 29 instead of the sound output device 28 in the first embodiment.

[0117] The haptic feedback device 29 is a device for outputting haptic feedback (e.g., vibration). The haptic feedback device 29 may be configured, for example, to include an eccentric motor type or a piezoelectric type oscillator. Similar to the sound output device 28 in the first embodiment, the haptic feedback device 29 is disposed on both the internal display 22 and the external display 23. The haptic feedback device 29 is a device for outputting prescribed haptic feedback when the display of the interface on the internal display 22 or the external display 23 is switched. The configuration of the display device 20 in the system mounted in the vehicle 1 in this embodiment, except for the haptic feedback device 29, is the same as that in the first embodiment.

[0118] (Switching of interface screens) In the display device 20 of this embodiment, two types of tactile feedback are used as the prescribed switching tactile feedback output from the tactile feedback device 29. Specifically, in each of the internal display 22 and the external display 23, when switching between two sequentially adjacent interface screens displayed between the first interface screen and the fifth interface screen, the tactile feedback device 29 outputs the first switching tactile feedback. That is, when switching between the first interface screen and the second interface screen, between the second interface screen and the third interface screen, between the third interface screen and the fourth interface screen, or between the fourth interface screen and the fifth interface screen, the tactile feedback device 29 outputs the first switching tactile feedback. On the other hand, in each of the internal display 22 and the external display 23, when switching between the first interface screen and the fifth interface screen, the tactile feedback device 29 outputs a second switching tactile feedback that is different from the first switching tactile feedback. Here, the second switching tactile feedback may, for example, be a vibration with an amplitude or frequency different from that of the first switching tactile feedback.

[0119] By distinguishing between two types of haptic feedback as the prescribed switching haptic feedback output from the haptic feedback device 29, when switching between the first and fifth interfaces is displayed on each of the internal display 22 and the external display 23, the user can perceptually (i.e., tactilely) grasp the switch. Therefore, in this embodiment, similar to the first embodiment, the user can easily perceptually grasp whether the cycle of the five interface images displayed on each display has completed a full cycle or is still in the middle of a cycle. This helps the user to display the desired interface image on the internal display 22 or the external display 23.

[0120] (Control process) The following is based on Figure 13 The process of switching between the interface screens on the internal display 22 and the external display 23 is explained. Figure 13 This is a flowchart illustrating the process of controlling the display switching of the interface screen in this embodiment. This process is executed by the control unit 100 of the ECU 10. It should be noted that... Figure 13 The processing of steps other than S205 and S206 in the flowchart shown is as follows: Figure 11 The steps with the same reference numbers in the illustrated process are processed identically. Therefore, explanations of the processing of steps other than S205 and S206 are omitted.

[0121] In this process, if a negative check is performed in S104, then the processing in S205 is executed. In S205, ... Figure 11Similarly, in the process shown, S105 involves the control unit 100 sending a control signal to the display device 20 to switch the display of the interface screen on the internal display 22 and the external display 23, which has undergone a specified touch operation. As a result, in either the internal display 22 or the external display 23, the display switching between two sequentially adjacent interface screens, from the first to the fifth interface screen, is performed.

[0122] Furthermore, in S205, the control unit 100 sends a control signal, which enables the first switching haptic feedback to be output from the haptic feedback device 29 of the display on the inner display 22 and the outer display 23 where a predetermined touch operation has been performed, along with a control signal for switching the display of the interface screen, to the display device 20. Thus, in either the inner display 22 or the outer display 23, at the timing of the switching of the interface screen display, the first switching haptic feedback is output from the haptic feedback device 29. Afterward, the execution of this process temporarily ends.

[0123] On the other hand, if a positive determination is made in S104, the process in S206 is then executed. In S206, the control unit 100 also sends a control signal to the display device 20 to switch the display of the interface screen on the internal display 22 and the external display 23, which has undergone a prescribed touch operation. However, in this case, with Figure 11 Similarly, in the process shown, S106 involves switching between the first and fifth interface screens on the internal display 22 or the external display 23.

[0124] Furthermore, in S206, the control unit 100 sends a control signal, which enables the second switching haptic feedback to be output from the haptic feedback device 29 of the display on the inner display 22 and the outer display 23 where a predetermined touch operation has been performed, along with a control signal for switching the display of the interface screen, to the display device 20. Thus, in either the inner display 22 or the outer display 23, at the timing of the switching of the interface screen display, the second switching haptic feedback is output from the haptic feedback device 29. Afterward, the execution of this process temporarily ends.

[0125] According to the control flow described above, in each of the internal display 22 and the external display 23, when switching between two sequentially adjacent interface screens displayed between the first and fifth interface screens, a first switching haptic feedback is output from the haptic feedback device 29. Furthermore, in each of the internal display 22 and the external display 23, when switching between the first and fifth interface screens displayed, a second switching haptic feedback is output from the haptic feedback device 29. Thus, when switching between the first and fifth interface screens is displayed on the internal display 22 or the external display 23, the user can perceive the switch tactilely.

[0126] It should be noted that in this embodiment, when the display of the interface screen in each of the internal display 22 and the external display 23 is switched, it is not always necessary to output the prescribed switching haptic feedback from the haptic feedback device 29. For example, in each of the internal display 22 and the external display 23, the prescribed switching haptic feedback may only be output from the haptic feedback device 29 when switching between the first interface screen and the fifth interface screen. In this case, in each of the internal display 22 and the external display 23, when switching between two sequentially adjacent interface screens between the first and fifth interface screens, no haptic feedback is output from the haptic feedback device 29. Even with the haptic feedback output from the haptic feedback device 29 controlled in this way, the user can still perceive the display switching between the first and fifth interfaces in each of the internal display 22 and the external display 23 through touch.

[0127] In the first and second embodiments described above, examples are shown of five interface screens, from the first to the fifth, being displayed sequentially in each of the internal display 22 and the external display 23. However, the number of interface screens displayed in each of the internal display 22 and the external display 23 is not limited to five; at least three or more are acceptable. Furthermore, when the number of interface screens displayed in each of the internal display 22 and the external display 23 is n (n≥3), the first to the nth interface screen can be displayed sequentially. Additionally, in each of the internal display 22 and the external display 23, when switching between the first and nth interface screens, a different switching tone or haptic feedback is output than when switching between two sequentially adjacent interface screens.

[0128] Furthermore, in the first and second embodiments described above, the application of the display device of this disclosure to the display device 20 in the vehicle system configured as described above has been explained. However, the application of the display device of this disclosure is not limited to a display device having a pair of displays such as an internal display 22 and an external display 23. Moreover, the application of the display device of this disclosure is not limited to display devices constituting a vehicle system. For example, the display device of this disclosure can also be applied to user terminals such as smartphones carried by users or facility terminals installed in facilities such as shops.

[0129] <Other Implementation Methods> The above-described embodiments are merely examples, and this disclosure can be implemented with appropriate modifications without departing from its spirit. Furthermore, the treatments and components described in this disclosure can be freely combined and implemented as long as no technical contradictions arise.

[0130] Furthermore, a process described as being performed by one device can also be executed by multiple devices. Alternatively, a process described as being performed by different devices can also be executed by one device. In a computer system, the hardware configuration (server configuration) used to implement each function can be flexibly changed.

[0131] This disclosure can also be implemented by supplying a computer program that implements the functions described in the above embodiments to a computer, which then reads and executes the program using one or more processors. Such a computer program can be provided to the computer via a non-transitory computer-readable storage medium that can be connected to the computer's system bus, or via a network. Non-transitory computer-readable storage media include, for example, any type of disk suitable for storing electronic instructions, such as a disk (floppy disk, hard disk drive, etc.), an optical disk (CD-ROM, DVD, Blu-ray disc, etc.), a read-only memory (ROM), random access memory (RAM), EPROM, EEPROM (Electrically Erasable Programmable Read Only Memory), a magnetic card, flash memory, or an optical card.

Claims

1. A display device, characterized in that, Includes a display unit with a touch panel, wherein, The display unit is configured to sequentially switch between interfaces numbered one through n in response to a predetermined touch operation performed by the user, where n is an integer greater than or equal to 3. When switching between the first interface and the nth interface on the display unit, the user receives feedback that is perceptually different from the feedback when switching between interfaces other than the first interface and the nth interface on the display unit.

2. The display device according to claim 1, characterized in that, The display device further includes a sound output device, wherein the feedback is sound output from the sound output device.

3. The display device according to claim 2, characterized in that, When switching between the first interface and the nth interface on the display unit, a specified sound is output from the sound output device; when switching between interfaces other than the first interface and the nth interface on the display unit, no sound is output from the sound output device.

4. The display device according to claim 1, characterized in that, The display device further includes a haptic feedback device, wherein the feedback is haptic feedback output by the haptic feedback device.

5. The display device according to claim 4, characterized in that, When switching between the first interface and the nth interface on the display unit, the haptic feedback device outputs a specified haptic feedback. When switching between interfaces other than the first interface and the nth interface displayed on the display unit, no haptic feedback is output through the haptic feedback device.

6. The display device according to claim 1, characterized in that, The specified touch operation is scrolling or swiping horizontally or vertically.

7. A vehicle-mounted system, characterized in that, include: A display device having a plurality of display units, including at least a pair of display units; as well as An information processing device is configured to control the display device, wherein... The pair of displays are positioned on either side of the steering wheel in front of the driver's seat inside the vehicle, protruding towards the rear of the vehicle in a manner similar to the instrument panel located on the front of the steering wheel. The pair of display units have touch panels, and, The information processing device has a processor configured to perform the following actions: In each of the pair of displays, in response to a predetermined touch operation performed by the user, the first interface to the nth interface are displayed sequentially, where n is an integer greater than or equal to 3; and When switching between the first interface and the nth interface in each of the pair of display units, the user outputs feedback that is perceptually different from the feedback when switching between interfaces other than the first interface and the nth interface in each of the pair of display units.

8. The vehicle-mounted system according to claim 7, characterized in that, The display device also includes a sound output device. The processor is configured to output sound as feedback from the sound output device.

9. The vehicle-mounted system according to claim 8, characterized in that, The processor is configured to: when switching between the first interface and the nth interface in each of the pair of display units, output a predetermined sound from the sound output device; and when switching between interfaces other than the first interface and the nth interface in each of the pair of display units, not output sound from the sound output device.

10. The vehicle-mounted system according to claim 7, characterized in that, The display device also includes a haptic feedback device. The processor is configured to use the haptic feedback device as the feedback output.

11. The vehicle-mounted system according to claim 10, characterized in that, The processor is configured to: when switching between the first interface and the nth interface in each of the pair of display units, output a predetermined haptic feedback through the haptic feedback device; and when switching between interfaces other than the first interface and the nth interface in each of the pair of display units, not output haptic feedback through the haptic feedback device.

12. The vehicle-mounted system according to claim 7, characterized in that, The specified touch operation is scrolling or swiping horizontally or vertically.

13. A vehicle having an in-vehicle system as described in any one of claims 7 to 12.

Citation Information

Patent Citations

  • Display device, display method, program for display method, and recording medium recording program for display method

    JP2006252366A

  • Game device and program

    JP2018051365A

  • Display for automobile

    JP2023152459A