Vehicle-mounted system, vehicle, and information processing device

Abstract

The present disclosure relates to an in-vehicle system, a vehicle, and an information processing apparatus. The information processing apparatus includes a control section configured to control a display device having a pair of first and second display sections. The first display sections are respectively disposed at positions on both side portions of a steering wheel in a manner that the first display sections project toward a rear side of a vehicle from a position of an instrument panel disposed in front of a driver seat and disposed in a front surface of the steering wheel, and have touch panels. The second display section is disposed at an intermediate position between the driver seat and a front passenger seat in front of a vehicle cabin. The control section is configured to mirror a screen displayed on the first display section on which a prescribed input operation by a user is performed to the second display section in a case where the prescribed input operation by the user is detected by the touch panel.

Description

Technical Field

[0001] This disclosure relates to in-vehicle systems, vehicles, and information processing devices. Background Technology

[0002] A vehicle is known to include: a steering wheel; a central display unit disposed in front of the steering wheel; and side displays disposed on one or both sides of the central display unit in the vehicle width direction (for example, see Japanese Patent No. 7306210). Summary of the Invention

[0003] This disclosure improves the convenience for users (drivers or passengers) when using a display device with multiple display sections included in an in-vehicle system.

[0004] The first embodiment of this disclosure provides an in-vehicle system comprising: a display device having a plurality of display units including a pair of first display units and a second display unit; and an information processing device configured to control the display device, wherein the pair of first display units are respectively positioned on both sides of the steering wheel, protruding toward the rear of the vehicle from an instrument panel located in front of the driver's seat and on the front of the steering wheel in the passenger compartment, and each has a touch panel; the second display unit is positioned at the center between the driver's seat and the front passenger seat in the passenger compartment; the information processing device has a control unit configured to, when the touch panel detects that a user has performed a prescribed input operation on one of the pair of first display units, mirror the image displayed on the first display unit on which the prescribed input operation was performed onto the second display unit.

[0005] In the display device of the first embodiment, the size of the second display unit may be larger than the size of the first display unit.

[0006] In the display device of the first embodiment, the second display unit may also have a touch panel.

[0007] In the display device of the first embodiment, the pair of first display portions may be configured to display an interface related to the prescribed functions of the vehicle, the interface including operation icons used for input operations.

[0008] In the first scheme, the specified input operation may also be a swipe or flick or a pinch out in the direction of the passenger seat.

[0009] The vehicle of the second embodiment of this disclosure has the vehicle-mounted system of the first embodiment of this disclosure.

[0010] The third embodiment of the information processing device disclosed herein is an information processing device equipped with a control unit. The control unit is configured to control a display device having a plurality of display units, including a pair of first display units and a second display unit. The pair of first display units are respectively positioned on both sides of the steering wheel, protruding toward the rear of the vehicle from the instrument panel located in front of the driver's seat and on the front of the steering wheel in the passenger compartment, and each has a touch panel. The second display unit is positioned in the middle between the driver's seat and the front passenger seat in the front of the passenger compartment. The control unit is configured to mirror the screen of the first display unit on which the specified input operation was performed onto the second display unit when the touch panel detects that a user has performed a specified input operation on one of the pair of first display units.

[0011] In the display device of the third embodiment, the size of the second display unit may be larger than the size of the first display unit, and the second display unit may have a touch panel.

[0012] In the display device of the third embodiment, the pair of first display portions may respectively display an interface related to the prescribed functions of the vehicle, the interface including operation icons used for input operations.

[0013] In the third scheme, the specified input operation may be a swipe or a light tap in the direction of the passenger seat, or a two-finger spread.

[0014] In addition, as alternatives, the information processing method executed by the aforementioned information processing apparatus, the program for causing a computer to execute the information processing method, or the computer-readable storage medium for non-temporarily storing the program can be listed.

[0015] According to this disclosure, the convenience of users (drivers or passengers) when using the display device with multiple display sections included in the vehicle system can be improved. Attached Figure Description

[0016] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, wherein the same reference numerals denote the same elements, wherein: Figure 1 This is a diagram showing the front portion of the vehicle's interior according to the embodiment.

[0017] Figure 2 It is a diagram showing the general configuration of the display device and its surroundings.

[0018] Figure 3 This is a block diagram schematically representing an example of the hardware configuration of a system mounted on a vehicle.

[0019] Figure 4 This is a block diagram that schematically illustrates an example of the functional structure of an ECU (Electronic Control Unit).

[0020] Figure 5 The first image is an example of multiple interface screens displayed on an external monitor.

[0021] Figure 6 The second figure is an example of multiple interface screens displayed on an external monitor.

[0022] Figure 7 The first image is an example of multiple interface screens displayed on an internal display.

[0023] Figure 8 The second figure is an example of multiple interface screens displayed on an internal display.

[0024] Figure 9 This diagram shows the display when the second interface shown on the inner display is mirrored onto the central display.

[0025] Figure 10 It is a flowchart illustrating the mirror control process of the implementation method. Detailed Implementation

[0026] In recent years, vehicles with multiple displays located at the front of the passenger compartment have been developed. In such vehicles, interfaces related to the vehicle's prescribed functions are sometimes displayed on the displays located in front of the driver's seat. In this case, information provided to the driver or information indicating a request from the driver is output via the interface displayed on the displays.

[0027] Furthermore, in vehicles as described above, it is sometimes desirable to share the screen (interface) displayed on a monitor located in front of the driver's seat with passengers other than the driver. However, it is difficult for passengers to visually recognize the monitor located in front of the driver's seat. Therefore, there is room for improvement in the convenience for users (drivers or passengers) when using a display device with multiple display units.

[0028] In response, one of the solutions disclosed herein is an in-vehicle system comprising: a display device having a plurality of display units including a pair of first display units and a second display unit; and an information processing device configured to control the display device, wherein the pair of first display units are respectively positioned on both sides of the steering wheel, protruding toward the rear of the vehicle from the instrument panel located in front of the driver's seat and on the front of the steering wheel in the passenger compartment, and each has a touch panel; the second display unit is positioned in the middle between the driver's seat and the front passenger seat in the front of the passenger compartment; the information processing device has a control unit configured to, when the touch panel detects that a user has performed a prescribed input operation on one of the pair of first display units, mirror the image displayed on the first display unit on which the prescribed input operation was performed onto the second display unit.

[0029] The in-vehicle system includes a display device. Furthermore, the display device has multiple display units, including a pair of first display units and a second display unit. The pair of first display units are respectively positioned on either side of the steering wheel, protruding towards the rear of the vehicle from the instrument panel located in front of the driver's seat and on the front of the steering wheel. That is, in the driver's seat area of ​​the vehicle, the pair of first display units are respectively positioned near the steering wheel. Moreover, the pair of first display units has a touch panel. Therefore, the first display units can be operated by the driver (touch operation). In addition, the second display unit is positioned in the middle of the front of the vehicle between the driver's seat and the passenger seat. That is, the second display unit is positioned in the front of the vehicle closer to the passenger seat than the pair of first display units.

[0030] Furthermore, the in-vehicle system includes an information processing unit. This unit has a control section configured to control the display unit. The control section is configured to mirror the screen of the first display unit displaying the input operation performed on one of a pair of first displays onto a second display unit when a predetermined input operation is detected by the touch panel. In other words, the control section determines which of the pair of first displays the user performed the predetermined input operation on. Furthermore, the control section displays the same screen as the screen displayed on the first display unit displaying the input operation performed on the first display unit. Here, the predetermined input operation is, for example, a swipe or tap towards the passenger side, or spreading two fingers.

[0031] According to the vehicle system described above, when it is desired to share the screen displayed on either of a pair of first displays located in front of the driver's seat with a passenger other than the driver, the driver can easily share the screen with the passenger. Therefore, the convenience for the user (driver or passenger) when using a display device with multiple displays is improved.

[0032] Furthermore, when the size of the second display unit is larger than that of the first display unit, displaying the image shown on the first display unit on the second display unit allows the image of the object to be displayed larger. Additionally, when both the first and second display units have touch panels, displaying the image shown on the first display unit on the second display unit allows the user to perform input operations (touch operations) on the image of the object on the second display unit.

[0033] Hereinafter, specific embodiments of the present disclosure will be described based on the accompanying drawings. Unless otherwise specified, the dimensions, materials, shapes, and relative arrangements of the constituent components described in this embodiment are not intended to limit the technical scope of the present disclosure.

[0034] Implementation System outline Figure 1 This diagram shows the front portion of the passenger compartment of the vehicle according to this embodiment. A driver's seat 2 and a passenger seat 3 are provided inside the passenger compartment of vehicle 1. It should be noted that vehicle 1 in this embodiment is a right-hand drive vehicle, and the driver's seat 2 is located on the right side of the vehicle 1 in the direction of travel. A steering wheel 4 is provided in front of the driver's seat 2. The steering wheel 4 can be circular or U-shaped (a so-called irregular steering wheel). The steering wheel 4 is connected to the steering system of vehicle 1 via a steering column. The steering column is covered by a column cover. Furthermore, inside the passenger compartment of vehicle 1, the passenger seat 3 is located to the left of the driver's seat 2 (on the left side of the vehicle 1 in the direction of travel).

[0035] A display device 20 is provided at the front of the passenger compartment of vehicle 1. The display device 20 has multiple displays 21, 22, 23, and 26. Specifically, the display device 20 includes an instrument panel display 21, an inner display 22, an outer display 23, and a central display 26. The instrument panel display 21 is located in front of the driver's seat 2 and in front of the steering wheel 4 (approximately at the center of the front portion of the driver's seat 2). The inner display 22 is located behind the instrument panel display 21 and on the inner side of the vehicle 1. The outer display 23 is located behind the instrument panel display 21 and on the outer side of the vehicle 1. The inner display 22 is connected to the instrument panel display 21 via a connecting part 24. The outer display 23 is connected to the instrument panel display 21 via a connecting part 25.

[0036] The central display 26 is located in the middle of the front driver's seat 2 and the front passenger seat 3 inside the passenger compartment (approximately in the center of the front part of the passenger compartment). That is, the central display 26 is located in the front of the passenger compartment on the side of the front passenger seat 3, which is closer to the instrument display 21, the interior display 22 and the exterior display 23.

[0037] Here, the outer side of vehicle 1 refers to the side closest to the outside of vehicle 1 when viewed from the driver's seat 2, specifically the side of the driver's seat 2's door. Similarly, the inner side of vehicle 1 refers to the side of the passenger seat 3 when viewed from the driver's seat 2, specifically the side of the passenger seat 3's door. For example, in a vehicle 1 where the steering wheel 4 is located on the right side, the outer side of vehicle 1 refers to the right side of vehicle 1, and the inner side of vehicle 1 refers to the left side of vehicle 1. Furthermore, in a vehicle 1 where the steering wheel 4 is located on the left side, the outer side of vehicle 1 refers to the left side of vehicle 1, and the inner side of vehicle 1 refers to the right side of vehicle 1.

[0038] The instrument display 21, internal display 22, external display 23, and central display 26 are all displays with touch panels. It should be noted that at least the internal display 22 and external display 23 need to have touch panels. It should also be noted that the instrument display 21, internal display 22, and external display 23 can be formed by modifying a single touchscreen, or by combining individual touchscreens.

[0039] It should be noted that the touch panels of each display in the display device 20 may be pressure-sensitive touch panels that detect the pressure applied by the user when pressing the panel, or capacitive touch panels that detect changes in electrostatic capacitance when the user presses the panel. Furthermore, the display may be, for example, an LCD (Liquid Crystal Display) or an EL (Electroluminescence) panel. Hereinafter, "user touch" refers to the user touching the touch panel.

[0040] The central display 26 can display driving-related assistance information (e.g., car navigation information) provided to the driver of vehicle 1. In addition, the central display 26 can also display entertainment-related information such as audio or video.

[0041] Here, based on Figure 2 The instrument display 21, internal display 22 and external display 23 in the display device 20 will be described in more detail. Figure 2 This is a diagram showing the schematic configuration of the display device 20 and its surroundings. The instrument display 21 of the display device 20 is fixed to the instrument panel 5. The instrument display 21 is a horizontally elongated display, while the inner display 22 and the outer display 23 are vertically elongated displays. The instrument display 21 is configured with its screen facing the rear of the vehicle and is arranged parallel to the left-right direction (vehicle width direction) of the vehicle 1. It should be noted that the instrument display 21 can also be configured to be tilted slightly upwards.

[0042] One end of a connecting portion 24 is connected to the inner end of the instrument cluster display 21 on the vehicle side, and the other end of the connecting portion 24 is connected to an inner display 22. The inner display 22 extends from the inner end of the connecting portion 24 on the vehicle side toward the rear of the vehicle 1 and toward the inner side of the vehicle 1. It should be noted that the angle of the inner display 22 relative to the instrument cluster display 21 is smaller than the angle of the connecting portion 24 relative to the instrument cluster display 21. Furthermore, the connecting portion 24 is curved and connects the instrument cluster display 21 and the inner display 22. The connecting portion 24 has a curved surface that is recessed toward the front of the vehicle at its connection with the instrument cluster display 21, and a curved surface that protrudes toward the rear of the vehicle at its connection with the inner display 22. It should be noted that the instrument cluster display 21 and the inner display 22 may also have curved surfaces.

[0043] One end of a connecting portion 25 is connected to the outer end of the instrument cluster display 21 on the vehicle's outer side, and the other end of the connecting portion 25 is connected to an external display 23. The external display 23 extends from the outer end of the connecting portion 25 towards the rear of the vehicle 1 and outwards from the vehicle's outer side. It should be noted that the angle of the external display 23 relative to the instrument cluster display 21 is smaller than the angle of the connecting portion 25 relative to the instrument cluster display 21. The connecting portion 25 is curved and connects the instrument cluster display 21 and the external display 23. The connecting portion 25 has a curved surface that is recessed towards the front of the vehicle at its connection with the instrument cluster display 21, and a curved surface that protrudes towards the rear of the vehicle at its connection with the external display 23. It should be noted that both the instrument cluster display 21 and the external display 23 may also have curved surfaces.

[0044] The steering wheel 4 includes a grip portion for the driver to hold. Furthermore, in the display device 20, the instrument display 21, the inner display 22, the outer display 23, and each connecting portion 24 and connecting portion 25 have the shapes described above, thereby the inner display 22 and the outer display 23 are arranged near the grip portion in the steering wheel 4.

[0045] Furthermore, the inner display 22 and the outer display 23 are configured to be angled relative to the left and right direction of the steering wheel 4, and each is tilted towards the steering wheel 4. That is, the inner display 22 is configured to protrude further rearward of the vehicle 1 as it is closer to the inside of the vehicle 1, and the outer display 23 is configured to protrude further rearward of the vehicle 1 as it is closer to the outside of the vehicle 1. In this way, the inner display 22 and the outer display 23 are configured to face the driver.

[0046] The instrument display 21 shows an interface that represents information required for driving the vehicle 1, such as the vehicle 1's speed, engine speed (if the vehicle 1 has an engine), charging / discharging status (if the vehicle 1 has a drive battery), driving distance, and the status of advanced driver-assistance systems (ADAS).

[0047] External display 23 displays interfaces (hereinafter sometimes referred to as "first interfaces") respectively related to multiple first defined functions among the multiple functions possessed by vehicle 1. Here, the first defined functions include functions associated with the control of vehicle 1. Furthermore, internal display 22 displays interfaces (hereinafter sometimes referred to as "second interfaces") respectively related to multiple second defined functions among the multiple functions possessed by vehicle 1 that differ from the multiple first defined functions. Here, the second defined functions include functions associated with the convenience of the occupants of vehicle 1. Each first interface displayed on external display 23 and each second interface displayed on internal display 22 includes operation icons (e.g., switch icons or button icons) operated by the driver of vehicle 1. It should be noted that details regarding the first defined functions, second defined functions, first interfaces, and second interfaces will be described later.

[0048] As described above, considering driver operability, the display device 20 is configured with an inner display 22 and an outer display 23 as a pair. Furthermore, in the display device 20, the size of the central display 26 is larger than the size of the inner display 22. Additionally, the size of the central display 26 is larger than the size of the outer display 23. It should be noted that in this embodiment, the instrument display 21 is an example of the "instrument unit" of this disclosure. Furthermore, in this embodiment, the inner display 22 and the outer display 23 are examples of the "first display unit" of this disclosure. Furthermore, in this embodiment, the central display 26 is an example of the "second display unit" of this disclosure.

[0049] Hardware configuration Figure 3 This is a block diagram schematically illustrating an example of the hardware configuration of a system mounted on vehicle 1. The system mounted on vehicle 1 includes an ECU 10, a display device 20, a voice unit 41, a sensor group 42, an electrical equipment group 43, and a drive system 44.

[0050] ECU10 can be configured as a computer with a processor (CPU (Central Processing Unit), GPU (Graphics Processing Unit), etc.), main storage (RAM (Random Access Memory), ROM (Read Only Memory), etc.), and auxiliary storage (EPROM (Erasable Programmable Read Only Memory), hard disk drive, removable media, etc.). The auxiliary storage stores the operating system (OS), various programs, various tables, etc., and can execute the programs stored therein to achieve the various functions (software modules) for the specified purposes as described below. However, some or all of the functions can also be implemented as hardware modules using hardware circuits such as ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). Display device 20, voice unit 41, sensor group 42, electrical equipment group 43, and drive system 44 are connected to ECU10. It should be noted that the ECU10 does not necessarily have to be a single piece of hardware; it can also be composed of multiple computers. Furthermore, in this embodiment, the ECU10 is an example of the "information processing device" of this disclosure.

[0051] The display device 20 includes an instrument display 21, an internal display 22, an external display 23, a central display 26, and a touch panel 27. The touch panel 27 is a unit for detecting touch operations performed on the instrument display 21, internal display 22, external display 23, and central display 26. Touch panels 27 are respectively disposed on the instrument display 21, internal display 22, external display 23, and central display 26. Thus, each display is configured to perform touch-based operations. The instrument display 21, internal display 22, external display 23, connecting portion 24, connecting portion 25, and touch panel 27 can also be constructed by deforming the shape of a touchscreen.

[0052] The voice unit 41 is a unit that performs voice-based information input and output. The voice unit 41 may include, for example, a speaker and a microphone. The voice unit 41 can acquire the voice spoken by the occupants of vehicle 1. Furthermore, the voice unit 41 can speak to the occupants of vehicle 1.

[0053] Sensor group 42 is a collection of multiple sensors used to acquire sensor data during the driving of vehicle 1. The sensors can acquire physical quantities or image data, etc. Sensor group 42 may include, for example, sensors for detecting the state of vehicle 1 and sensors for detecting driver actions. Specifically, sensor group 42 may also include speed sensors, acceleration sensors, accelerator opening sensors, braking sensors, steering angle sensors, engine speed sensors, yaw rate sensors, turn signal switch sensors, shift position sensors, GPS (Global Positioning System) sensors, interior temperature sensors, exterior temperature sensors, ranging radar, illuminance sensors, etc.

[0054] A speed sensor detects the speed of vehicle 1. An acceleration sensor detects the acceleration of vehicle 1. An accelerator pedal position sensor detects the position of the accelerator pedal. A brake pedal position sensor detects the position of the brake pedal. A steering angle sensor detects the steering angle of steering wheel 4. An engine speed sensor detects the engine speed. A yaw rate sensor detects the yaw rate of vehicle 1. A turn signal switch sensor detects the state of the turn signal switch. A shift position sensor detects the shift position. A GPS sensor acquires the location information of vehicle 1. An interior temperature sensor detects the interior temperature. An exterior temperature sensor detects the exterior temperature. A ranging radar determines the distance to an object. An illuminance sensor detects the brightness of the ambient light outside vehicle 1.

[0055] Electrical equipment group 43 is a collection of electrical equipment installed in vehicle 1. Electrical equipment group 43 includes, for example, vehicle control system devices such as headlight units, wiper actuators, rearview mirror actuators, and seat actuators. In addition, electrical equipment group 43 also includes in-vehicle devices with functions other than vehicle control, such as navigation devices, multimedia devices, and air conditioning.

[0056] The drive system 44 is a system composed of various drive devices of the vehicle 1. These drive devices include, for example, an engine and / or motor as a power source, a battery, and a transmission.

[0057] ECU Functional Components Here, based on Figure 4 The functional composition of ECU10 will be explained. Figure 4This is a block diagram schematically illustrating an example of the functional configuration of an ECU. The ECU 10 includes a control unit 100, a storage unit 110, and an in-vehicle communication module 120 as functional components. The control unit 100 is a functional component provided, for example, by a processor executing various programs stored in an auxiliary storage device. The display device 20 receives control commands from a user, who is a passenger in the vehicle 1, via a touch panel 27. At this time, a signal corresponding to the user's input operation on any one of the multiple displays 21, 22, 23, and 26 is sent from the touch panel 27 to the ECU 10. Then, in the ECU 10, the control unit 100, in response to the user's input operation on any display, executes control of the display device 20, the various electrical devices included in the electrical equipment group 43, or the various drive-type devices included in the drive system 44.

[0058] The control unit 100 includes an HMI (Human Machine Interface) control unit 101, an operation determination unit 102, and an output unit 103 as software modules. The HMI control unit 101 generates interfaces related to various functions of the vehicle 1. Furthermore, the HMI control unit 101 displays the generated interfaces on various displays of the display device 20. In addition, the interfaces generated by the HMI control unit 101 and displayed on each display include operation icons that can be operated by the user. These operation icons are icons used by the driver to control various functions of the vehicle 1. The HMI control unit 101 accepts control commands input by the user through operation of these operation icons.

[0059] The operation determination unit 102 determines the user's input operation on any of the displays based on the signal received from the touch panel 27 of the display device 20. For example, the operation determination unit 102 determines the part of the user's touch on any of the multiple displays 21, 22, 23, and 26 of the display device 20. In addition, the operation determination unit 102 determines the content of the input operation performed by the user on any of the multiple displays 21, 22, 23, and 26 of the display device 20 (e.g., swipe, slide, tap, pinch, double tap, long tap, and multi-tap).

[0060] The output unit 103 sends a control signal corresponding to the control command received by the HMI control unit 101 or the user input operation determined by the operation determination unit 102 to the controlled device (i.e., any one of the electrical devices included in the display device 20, the electrical equipment group 43, or the drive devices included in the drive system 44). The controlled device receives the control signal sent by the output unit 103 and thereby executes control corresponding to the control signal. For example, when a user performs a specified input operation on the internal display 22 or the external display 23, the output unit 103 sends a control signal for performing mirroring to the display device 20. Here, mirroring is the control of displaying the same image as the image displayed on the internal display 22 or the external display 23 where the user performed the specified input operation on the central display 26. Details regarding such mirroring control will be described later.

[0061] The storage unit 110 is a functional component for storing information. The storage unit 110 is configured to include a main storage device and an auxiliary storage device. The storage unit 110 stores various programs executed by the control unit 100 and control data used for the execution of these programs.

[0062] The in-vehicle communication module 120 is a functional component used to connect the ECU 10 to the vehicle network using a specified in-vehicle communication standard. Examples of specified in-vehicle communication standards include CAN (Controller Area Network) or LIN (Local Interconnect Network). The ECU 10 communicates with various devices located in the vehicle 1 via the in-vehicle communication module 120.

[0063] interface Next, the interfaces displayed on the inner display 22 and outer display 23 of the display device 20 will be described. As described above, the HMI control unit 101 displays multiple interfaces related to various functions of the vehicle 1 on each display of the display device 20. At this time, the HMI control unit 101 displays a first interface related to a first specified function (a function associated with the control of the vehicle 1) on the outer display 23. In addition, the HMI control unit 101 displays a second interface related to a second specified function (a function associated with the convenience of the occupants of the vehicle 1) on the inner display 22.

[0064] In the display device 20, the output destinations of multiple interfaces related to the various functions of the vehicle 1 are assigned according to the category of function, as described above. This allows the driver to easily and intuitively identify which of the internal display 22 and external display 23 the interface on which the driver wishes to confirm or operate the displayed content is output. Furthermore, the operation surfaces of the touch panels 27 on the internal display 22 and external display 23 are positioned near the steering wheel 4. This minimizes the amount of eye and hand movement required when the driver wishes to perform various controls via touch operation of the displays.

[0065] It should be noted that the external display 23 displays one of a plurality of first interfaces. Furthermore, the internal display 22 displays one of a plurality of second interfaces. The first interface displayed on the external display 23 and the second interface displayed on the internal display 22 are switched via the HMI control unit 101. The driver of the vehicle 1 can switch between the displays by performing a predefined operation, such as swiping left or right, on the touch panel 27 of the internal display 22 or the external display 23.

[0066] Here, based on Figure 5 and Figure 6 The interface displayed on the external monitor 23 will be described. Figure 5 and Figure 6 This diagram illustrates an example of multiple interface screens displayed on the external display 23 as a first interface via the HMI control unit 101. (Example...) Figure 5 As shown, the main screen and shortcut screen are displayed on the external monitor 23.

[0067] Main screen The main screen is the interface typically displayed on the external display 23 while the vehicle 1 is in motion. The main screen displays operation icons related to frequently used functions. It should be noted that the content displayed on the main screen can be customized by the user.

[0068] Quick Screen The shortcut screen is an interface screen used to jump to various interface screens displayed on the external display 23 as the first interface, as described below. The shortcut screen includes operation icons for jumping to various interface screens that can be displayed on the external display 23. The driver selects one of the multiple operation icons included in the shortcut screen and operates it, and the display on the external display 23 switches to the interface screen related to the function corresponding to the selected operation icon.

[0069] In addition, such as Figure 6 As shown, the external display 23 displays the headlight control screen, wiper control screen, rearview mirror adjustment screen, and driving mode setting screen as the first interface.

[0070] Headlight control screen The headlight control screen is an interface screen related to the headlight control function. The headlight control screen includes operation icons for setting the illumination status of the headlights on the vehicle 1 (automatic, on, off, parking lights, daytime running lights, etc.). Furthermore, based on the driver's operations on the headlight control screen, the control unit 100 controls the headlight units included in the electrical equipment group 43. In addition, the current headlight illumination status is displayed on the headlight control screen.

[0071] Wiper control screen The wiper control screen is an interface screen related to the wiper control function. The wiper control screen includes operation icons for setting the operating status (stop, automatic operation, intermittent operation, continuous operation, etc.) of the wipers (front wiper and rear wiper) on vehicle 1. Furthermore, based on the driver's operations on the wiper control screen, the control unit 100 controls the wiper actuators included in the electrical equipment group 43. In addition, the wiper control screen displays the current operating status of the front and rear wipers.

[0072] Rearview mirror adjustment screen The rearview mirror adjustment screen is an interface screen related to the rearview mirror adjustment function. The rearview mirror adjustment screen includes operation icons for adjusting the status (folded / unfolded state and angle) of the side rearview mirrors on vehicle 1. Furthermore, based on the driver's operations on the rearview mirror adjustment screen, the control unit 100 controls the rearview mirror actuators included in the electrical equipment group 43. In addition, the current status of the side rearview mirrors is displayed on the rearview mirror adjustment screen.

[0073] Driving mode setting screen The driving mode setting screen is an interface screen related to the driving mode setting function. The driving mode setting screen includes operation icons for setting the driving mode of vehicle 1. Furthermore, based on the operations performed by the driver on the driving mode setting screen, the control unit 100 sets the driving mode.

[0074] It should be noted that the aforementioned headlight control function, wiper control function, rearview mirror adjustment function, and driving mode setting function are all types of the first specified functions. However, the first specified functions are not limited to these functions. For example, the seat position adjustment function and the ADAS setting function are also types of the first specified functions. The seat position adjustment function is the function of adjusting the position and angle of the seat provided in the vehicle 1 by controlling the seat actuator through the control unit 100. The ADAS setting function is the function of ADAS provided by the vehicle 1 by controlling the control unit 100. Furthermore, the seat position adjustment screen and the ADAS setting screen can also be displayed on the external display 23 as the first interface. The seat position adjustment screen is the interface screen related to the seat position adjustment function. In addition, the ADAS setting screen is the interface screen related to the ADAS setting function.

[0075] Next, based on Figure 7 and Figure 8 The interface displayed on the internal display 22 will be described. Figure 7 and Figure 8 This diagram illustrates an example of multiple interface screens displayed on the internal display 22 as a second interface via the HMI control unit 101. (Example) Figure 7 As shown, the main screen and quick screen are displayed on the internal display 22.

[0076] Main screen The main screen is the interface typically displayed on the internal display 22 while the vehicle 1 is in motion. The main screen displays operation icons related to frequently used functions. It should be noted that the content displayed on the main screen can be customized by the user.

[0077] Quick Screen Quick screens are interface screens used to navigate to various interface screens displayed as a second interface on the internal display 22, as described below. Quick screens include operation icons for navigating to the various interface screens displayed on the internal display 22. The driver selects one of the multiple operation icons included in the quick screen and operates on it, thereby transferring the display on the internal display 22 to the interface screen related to the function corresponding to the selected operation icon.

[0078] In addition, such as Figure 8 As shown, the internal display 22 displays the navigation screen, audio screen, air conditioning settings screen, and AI assistant screen as a second interface.

[0079] Navigation screen The navigation screen is an interface screen related to navigation functions. It displays navigation-related information generated by the control unit 100. Furthermore, the navigation screen includes operation icons for destination setting, location registration, etc.

[0080] Audio and video The audio screen is an interface screen related to the audio functions of the multimedia device. The audio screen includes operation icons for controlling the audio functions of the multimedia device (such as song playback). Furthermore, based on the driver's operations on the audio screen, the control unit 100 controls the multimedia device included in the electrical equipment group 43. In addition, information related to the song being played is displayed on the audio screen.

[0081] Air conditioner settings screen The air conditioning setting screen is an interface screen related to the air conditioning control functions. The air conditioning setting screen includes operation icons for setting the air conditioning's operating status (temperature, fan speed, air conditioning function, etc.). Furthermore, based on the driver's operations on the air conditioning setting screen, the control unit 100 controls the air conditioners included in the electrical equipment group 43. In addition, the current operating status of the air conditioning is displayed on the air conditioning setting screen.

[0082] AI assistant screen The AI ​​assistant screen is an interface screen related to the functions of the intelligent agent. It is used to converse with a virtual intelligent agent (AI assistant), which can engage in natural language-based dialogue. The AI ​​assistant screen includes a character representing the virtual intelligent agent. Users can obtain information by conversing with this character on the AI ​​assistant screen. Natural language-based dialogue services are provided through the control unit 100. Furthermore, the AI ​​assistant screen includes operation icons for conversing with the AI ​​assistant.

[0083] It should be noted that the navigation function, audio function, air conditioning control function, and smart agent function mentioned above are all types of the second specified functions. However, the second specified functions are not limited to these functions. For example, the telephone function is also a type of second specified function. The telephone function enables hands-free calling by wirelessly connecting to a user terminal located in the vehicle 1 through the wireless communication function of the multimedia device controlled by the control unit 100. Furthermore, the internal display 22 can also display the call screen as a second interface. The call screen is an interface screen related to the telephone function.

[0084] Mirror control The display device 20 of this disclosure is configured to perform mirror control. Mirror control is the control of mirroring the screen displayed on the internal display 22 or the screen displayed on the external display 23 onto the central display 26. For example, as described above, the internal display 22 displays a second interface related to a second specified function, wherein the second specified function is a function related to the convenience of the occupants of the vehicle 1. Furthermore, it is sometimes desirable for a passenger, rather than the driver of the vehicle 1, to operate the second interface. In such cases, the second interface displayed on the internal display 22 is mirrored onto the central display 26 by the driver performing a specified input operation on the internal display 22.

[0085] Figure 9 This diagram illustrates the display configuration when the second interface shown on the internal display 22 is mirrored onto the central display 26. Here, the pre-defined input operation performed by the driver on the internal display 22 could be, for example, a sliding motion towards the direction where the central display 26 is located, i.e., towards the passenger seat. Figure 9 In Figure 7 When the main screen shown in the main display is displayed on the internal display 22, a specified input operation (slide) is performed on the internal display 22. Thus, as... Figure 9 As shown, the main screen of the internal display 22 is mirrored onto the central display 26. That is, the same screen as the main screen of the internal display 22 is displayed on the central display 26.

[0086] As described above, when the same screen as the main screen of the internal display 22 is displayed on the central display 26, passengers can visually recognize the content displayed on the internal display 22 through the central display 26. Furthermore, the central display 26 in the display device 20 also has a touch panel 27. Therefore, by displaying the main screen of the internal display 22 on the central display 26, passengers can operate the main screen of the internal display 22.

[0087] Furthermore, when a specified input operation is performed on the internal display 22 while a screen other than the main screen is displayed thereon, the same screen (interface) displayed on the internal display 22 will also be displayed on the central display 26, just as described above. Therefore, passengers can perform various operations performed by the driver via the internal display 22 through the central display 26. Specifically, passengers can take over from the driver's duties, performing navigation operations via the navigation screen or engaging in conversations with the AI ​​assistant via the AI ​​assistant screen.

[0088] It should be noted that the image mirrored to the central display 26 is not limited to the image displayed on the internal display 22. That is to say, when a specified input operation is performed on the external display 23, the same image (interface) displayed on the external display 23 is displayed on the central display 26.

[0089] Furthermore, the mirroring of the image displayed on the internal display 22 or the image displayed on the external display 23 onto the central display 26 is not limited to the presence of passengers other than the driver in the vehicle 1. That is, the mirroring described above can be implemented even when there are no passengers in the vehicle 1.

[0090] Here, the central display 26 is larger than the inner display 22 and also larger than the outer display 23. Therefore, by mirroring the images displayed on the inner display 22 or the outer display 23 onto the central display 26, these images can be displayed at a larger size. Thus, even when there are no passengers in the vehicle 1 and the mirroring is implemented as described above, the driver can visually recognize the images displayed on the inner display 22 or the outer display 23 in a larger format.

[0091] Furthermore, the prescribed input operation for mirroring the image on the internal display 22 or external display 23 to the central display 26 is not limited to a swipe towards the passenger side. The prescribed input operation can also be a light swipe towards the passenger side. Additionally, the prescribed input operation can also be spreading two fingers. Based on these input operations, the driver can intuitively mirror the image displayed on the internal display 22 or the image displayed on the external display 23 to the central display 26.

[0092] Control process The following is based on Figure 10 The process of mirror control is explained. Figure 10 This is a flowchart illustrating the mirror control process of this embodiment. This process is executed by the control unit 100 of the ECU 10.

[0093] In this process, firstly, in S101, the control unit 100 receives a signal from the touch panel 27 of the display device 20 corresponding to an input operation performed by the user. Next, in S102, the control unit 100 determines, based on the signal received in S101, the user's input operation on any one of the multiple displays 21, 22, 23, and 26 of the display device 20. It should be noted that, as described above, the processing in S102 is performed by the operation determination unit 102.

[0094] Next, in S103, the control unit 100 determines whether the input operation performed by the user, as determined in S102, is a specified input operation for the internal display 22 or the external display 23. If a negative determination is made in S103, it can be determined that the control requested by the user via the display device 20 is a control other than mirror control. In this case, the process in S105 is then executed. In S105, the control unit 100 sends a control signal for executing the control (other than mirror control) corresponding to the command content of the control command received by the display device 20 from the user to the device to which the control command is received. After this, the execution of this process temporarily ends.

[0095] On the other hand, if a positive determination is made in S103, the process in S104 is then executed. In S104, the control unit 100 sends a control signal to the display device 20 for performing mirroring. That is, the control unit 100 sends a control signal to the display device 20 to display a screen identical to the screen displayed on the inner display 22 and the outer display 23, which was determined in S102 to be the screen of the user who performed the specified input operation, on the central display 26. As a result, mirroring is performed on the display device 20. After that, the execution of this process temporarily ends.

[0096] According to the control process described above, by having the driver perform a specified input operation on the internal display 22 or the external display 23, the same image displayed on the internal display 22 or the external display 23 can be displayed on the central display 26.

[0097] Other implementation methods The above-described embodiments are merely examples, and this disclosure can be appropriately modified and implemented without departing from its spirit. Furthermore, the treatments and components described in this disclosure can be freely combined and implemented as long as no technical contradictions arise.

[0098] Furthermore, processes described as being performed by one device can also be performed by multiple devices. Alternatively, processes described as being performed by different devices can also be performed by one device. In a computer system, the hardware configuration (server configuration) used to implement each function can be flexibly changed.

[0099] This disclosure can also be implemented by supplying a computer program that implements the functions described in the above embodiments to a computer, which then reads and executes the program using one or more processors. Such a computer program can be provided to the computer either via a non-transitory computer-readable storage medium that can be connected to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk suitable for storing electronic instructions, such as disks (floppy disks, hard disk drives, etc.), optical disks (CD-ROMs, DVDs, Blu-ray discs, etc.), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM (Electrically Erasable Programmable Read Only Memory), magnetic cards, flash memory, or optical cards.

Claims

1. A vehicle-mounted system, characterized in that, include: The display device includes a pair of first display units and a second display unit; as well as An information processing device is configured to control the display device, wherein... The pair of first display units are respectively positioned on either side of the steering wheel, protruding further rearward than the instrument panel, and each has a touch panel. The instrument panel is located in front of the driver's seat inside the vehicle and on the front of the steering wheel. The second display unit is positioned in the middle between the driver's seat and the front passenger seat at the front of the vehicle compartment. The information processing device has a control unit, wherein the control unit is configured to mirror the screen of the first display unit on which the specified input operation is performed onto the second display unit when a specified input operation is detected by the touch panel on one of the pair of first display units.

2. The vehicle-mounted system according to claim 1, characterized in that, In the display device, the size of the second display unit is larger than the size of the first display unit.

3. The vehicle-mounted system according to claim 1, characterized in that, In the display device, the second display unit has a touch panel.

4. The vehicle-mounted system according to claim 3, characterized in that, In the display device, the pair of first display portions respectively display interfaces related to the prescribed functions of the vehicle, and the interfaces include operation icons used for input operations.

5. The vehicle-mounted system according to claim 1, characterized in that, The specified input operation is a swipe or tap in the direction of the passenger seat, or a two-finger gesture.

6. A vehicle, characterized in that, include: The vehicle system as described in any one of claims 1 to 5.

7. An information processing device, characterized in that, Includes a control unit configured to control a display device comprising a pair of first and second display units, wherein, The pair of first display units are respectively positioned on either side of the steering wheel, protruding further rearward than the instrument panel, and each has a touch panel. The instrument panel is located in front of the driver's seat inside the vehicle and on the front of the steering wheel. The second display unit is positioned in the middle between the driver's seat and the front passenger seat at the front of the vehicle compartment. The control unit is configured to mirror the screen displayed on the first display unit on which the specified input operation was performed onto the second display unit when the touch panel detects that a user has performed a specified input operation on one of the pair of first display units.

8. The information processing apparatus according to claim 7, characterized in that, In the display device, the size of the second display unit is larger than the size of the first display unit. The second display unit has a touch panel.

9. The information processing apparatus according to claim 8, characterized in that, In the display device, the pair of first display portions respectively display interfaces related to the prescribed functions of the vehicle, and the interfaces include operation icons used for input operations.

10. The information processing apparatus according to claim 7, characterized in that, The specified input operation is a swipe or tap in the direction of the passenger seat, or a two-finger gesture.

Images