Vehicle-mounted system, vehicle, and information processing device

Abstract

The present application relates to a vehicle-mounted system, a vehicle, and an information processing device, and reliably performs information delivery to a driver. The vehicle-mounted system has a first display portion disposed on a front surface of a steering wheel of a vehicle and on a front side of the vehicle, a second display portion disposed on a side of the steering wheel and on an inner side of the vehicle, and a third display portion disposed on a side of the steering wheel and on an outer side of the vehicle. The vehicle-mounted system independently performs display control on the first display portion, the second display portion, and the third display portion in a first condition, and performs display control related to a notification having a priority level of a passenger of the vehicle of a prescribed value or more through a virtual screen disposed across the first display portion, the second display portion, and the third display portion in a second condition.

Description

Technical Field

[0001] This disclosure relates to vehicle technology. Background Technology

[0002] There is a technology for providing information to reduce the burden on drivers of automobiles. Relatedly, for example, Patent Document 1 discloses an in-vehicle system in which an information-providing display is positioned near the steering wheel.

[0003] Patent Document 1: Japanese Patent No. 7306210

[0004] Patent Document 2: Japanese Patent Application Publication No. 2019-206254 Summary of the Invention

[0005] The purpose of this disclosure is to reliably transmit information to the driver.

[0006] One aspect of this disclosure relates to an in-vehicle system, including:

[0007] The system includes a storage unit that stores images corresponding to notifications with a priority of a predetermined value or higher among multiple notifications generated by the vehicle, and includes a first area, a second area, and a third area; a first display unit disposed on the front of the steering wheel of the vehicle and disposed at the front of the vehicle; a second display unit disposed on the side of the steering wheel and disposed at the inner side of the vehicle; a third display unit disposed on the side of the steering wheel and disposed at the outer side of the vehicle; and an information processing device comprising a control unit that performs the following processing: in a first state, outputting different information related to the vehicle to the first display unit, the second display unit, and the third display unit respectively; and in a second state, when a notification with a priority of a predetermined value or higher for the occupants of the vehicle is generated, outputting the first area of ​​the image corresponding to the notification to the first display unit, the second area to the second display unit, and the third area to the third display unit.

[0008] One aspect of this disclosure relates to an in-vehicle system, including:

[0009] A first display unit is disposed on the front of the steering wheel of the vehicle and is disposed on the front side of the vehicle; a second display unit is disposed on the side of the steering wheel and is disposed on the inner side of the vehicle; a third display unit is disposed on the side of the steering wheel and is disposed on the outer side of the vehicle; and an information processing device having a control unit that performs the following processing: in a first state, independently controlling the display of the first display unit, the second display unit, and the third display unit; and in a second state, when a notification with a priority of a predetermined value or higher is generated to the occupants of the vehicle, performing the display control related to the notification through a virtual screen disposed across the first display unit, the second display unit, and the third display unit.

[0010] One aspect of this disclosure relates to an information processing apparatus.

[0011] The information processing device is mounted on a vehicle having a first display unit disposed on the front of the steering wheel and located at the front of the vehicle, a second display unit disposed on the side of the steering wheel and located at the inner side of the vehicle, and a third display unit disposed on the side of the steering wheel and located at the outer side of the vehicle. The information processing device has a control unit that performs the following processes: in a first state, it performs independent display control on the first display unit, the second display unit, and the third display unit; and in a second state, it performs display control related to the notification through a virtual screen configured across the first display unit, the second display unit, and the third display unit when a notification with a priority of a predetermined value or higher is generated to the occupants of the vehicle.

[0012] Alternatively, vehicles equipped with the aforementioned vehicle-mounted system, information processing methods executed by the aforementioned information processing device, programs for causing computers to execute the information processing method, or computer-readable storage media that non-temporarily stores the program can be listed.

[0013] According to this disclosure, information can be reliably transmitted to the driver. Attached Figure Description

[0014] Figure 1 This is a diagram showing the interior of vehicle 1 according to the embodiment.

[0015] Figure 2 This is an enlarged view of the steering wheel and its surrounding area.

[0016] Figure 3 This is a diagram showing an example of the constituent elements of vehicle 1.

[0017] Figure 4 This is a diagram showing an example of the components of a vehicle ECU10.

[0018] Figure 5 It is a diagram showing an overview of the screen output to an external monitor.

[0019] Figure 6 This is a diagram showing an example of a screen being output to an external display.

[0020] Figure 7 This is a diagram showing an example of a screen being output to an external display.

[0021] Figure 8 It is a diagram showing an overview of the screen being output to the internal display.

[0022] Figure 9 This is a diagram showing an example of a screen being output to an internal display.

[0023] Figure 10 This is a diagram showing an example of a screen being output to an internal display.

[0024] Figure 11 This is a diagram showing the content displayed on a monitor under normal conditions.

[0025] Figure 12 This is a diagram showing what the monitor displays when a notification is generated.

[0026] Figure 13 These are examples of images corresponding to notifications that are stored in a storage device.

[0027] Figure 14 This is a flowchart of the processes performed by the HMI control unit 1011.

[0028] Figure 15 This is a diagram illustrating an example of a display device involved in a variation.

[0029] Explanation of reference numerals in the attached figures

[0030] 1…Vehicle, 10…Vehicle ECU, 101…Control device, 102…Storage device, 103…Communication module, 21…Instrument display, 22…Internal display, 23…External display, 24…Central display, 25…Touch panel, 26…Sound unit, 30…Body ECU. Detailed Implementation

[0031] In recent years, with the increasing sophistication of automobiles, displays used to provide information have become larger or more numerous.

[0032] For example, a method has been proposed to place a large touch panel display between the driver's seat and the front passenger seat in the front of the vehicle to allow for simultaneous vehicle-related operations and information provision.

[0033] However, in such a method, the driver's gaze shifts significantly when operating vehicle components or confirming output information. For vehicle safety, it is preferable to minimize this shift in the driver's gaze.

[0034] Generally speaking, many driver's seats now feature LCD displays instead of traditional instrument panels. By displaying information on these devices, eye movement can be minimized.

[0035] However, the size of the display device positioned on the front is limited, and it may not be able to display all the information the driver needs. In addition, if this information is output in the same area at the same time, such as information needed for driving the vehicle and auxiliary information such as entertainment, it will hinder the intuitive transmission of information.

[0036] In addition, there are also issues to be addressed in configuring the input interfaces used for operation.

[0037] For example, there is a known steering wheel with cursor keys and push-button switches that allows input operations while driving. However, in such an input interface, the layout of the buttons, etc., is fixed, making it difficult to adapt to multiple different objects. For example, setting the temperature of the air conditioner can be done using two physical keys, but it is not possible to directly specify any arbitrary location on the map using physical keys.

[0038] Although operation via a touch panel was also considered, the touch panel display, as described above, is located far from the steering wheel in the front of the cabin, so in addition to the movement of the eyes, the driver's hands also need to move significantly.

[0039] To address these issues, an in-vehicle system was considered that includes a display device near the steering wheel capable of touch-based input.

[0040] For example, by placing small displays with touch panels on the left and right sides of the steering wheel respectively, drivers can perform intuitive and quick operations.

[0041] However, if the display is placed near the steering wheel, there are concerns that multiple displays within the driver's field of vision could delay the transmission of information to the driver.

[0042] For example, consider a scenario where, among multiple displays, a notification or warning (e.g., a request to switch from autonomous to manual driving) is generated while the driver is operating a specific display. For instance, there is a concern that the driver might not notice a message displayed on the instrument cluster while operating a display located next to the steering wheel.

[0043] The in-vehicle system disclosed herein addresses such a problem.

[0044] One aspect of this disclosure relates to an in-vehicle system comprising: a first display unit disposed on the front of a steering wheel of a vehicle and disposed at the front of the vehicle; a second display unit disposed on the side of the steering wheel and disposed at the inner side of the vehicle; a third display unit disposed on the side of the steering wheel and disposed at the outer side of the vehicle; and an information processing device having a control unit that performs the following processing: in a first state, independently controlling the display of the first display unit, the second display unit, and the third display unit; and in a second state, when a notification with a priority of a predetermined value or higher is generated for the occupants of the vehicle, performing the display control related to the notification through a virtual screen configured across the first display unit, the second display unit, and the third display unit.

[0045] The first display is a display located on the front of the steering wheel and on the front side of the vehicle, typically an instrument panel with a speedometer.

[0046] The second and third display units are a pair of displays located on either side of the steering wheel. The second and third display units can be configured to perform touch operations based on a touch panel.

[0047] The first display unit and the second and third display units can be arranged either in a position where they are connected to each other, or they can be arranged separately.

[0048] Furthermore, the second and third display units can be positioned in the longitudinal direction of the vehicle, protruding further rearward than the first display unit, i.e., positioned closer to the driver. Additionally, the second and third display units can be positioned in the longitudinal direction of the vehicle, relative to the steering wheel grip, on the front side of the vehicle.

[0049] The steering wheel can be any type of steering wheel that has a grip and allows steering operations to be performed by rotating it; it does not necessarily have to be round.

[0050] The control unit independently controls the first, second, and third display units. For example, the control unit can output information such as vehicle speed, engine speed, and battery level, which are always requested by the driver, to the first display unit, and output information related to vehicle control and passenger convenience to the second and third display units.

[0051] Furthermore, when the control unit generates a notification (e.g., a warning) with a priority of more than a specified value to the occupants of the vehicle, it performs display control related to the notification (e.g., control of outputting the notification image in one piece) through a virtual screen configured across the first display unit, the second display unit, and the third display unit.

[0052] With this configuration, target information can be reliably transmitted regardless of which display the driver is looking at.

[0053] The in-vehicle system may also have a storage unit that stores images corresponding to multiple notifications.

[0054] In addition, the image may include a first region, a second region, and a third region, and the control unit may output the first region of the image to the first display unit, the second region to the second display unit, and the third region to the third display unit, respectively.

[0055] With this configuration, an image can be displayed in one unit using three display units.

[0056] The segmented images can each contain different content.

[0057] Furthermore, the aforementioned first display unit, second display unit, and third display unit may be multiple displays configured in a linear shape.

[0058] By arranging three independent display units in a straight line, a display with less visual disharmony can be achieved.

[0059] The first to third display units do not necessarily have to be separate displays. For example, the first to third display units may also be configured as a linear display area on a single display device.

[0060] Hereinafter, embodiments of the present disclosure will be described based on the accompanying drawings. The following embodiments are illustrative examples, and the present disclosure is not limited to the configuration of the embodiments.

[0061] (First Implementation)

[0062] An overview of the vehicle system according to the first embodiment will be described. The vehicle system according to this embodiment is configured to include a vehicle 1.

[0063] Reference Figure 1 The following describes vehicle 1.

[0064] Figure 1This diagram shows the interior of vehicle 1. As shown, a driver's seat 2 and a passenger seat 3 are provided inside the passenger compartment of vehicle 1. In this embodiment, vehicle 1 is a right-hand drive vehicle, and the driver's seat 2 is located on the right side of the vehicle.

[0065] A steering wheel 4 is located on the front side of the driver's seat 2. The steering wheel can be either round or U-shaped as shown in the figure (a so-called irregular steering wheel).

[0066] The steering wheel 4 is connected to the steering control device of the vehicle 1 via the steering column. The steering column is covered by a steering column cover.

[0067] The passenger seat 3 is located to the left of the driver's seat 2, and a central display screen 24 is located at the front of the vehicle, between the driver's seat 2 and the passenger seat 3. The central display screen 24 displays auxiliary information such as car navigation, or entertainment-related content such as audio and television.

[0068] An instrument display 21 is provided on the side in front of the steering wheel 4. Located in front of the driver's seat 2, the instrument display 21 is a full-screen display that provides various information to the driver of the vehicle 1. The instrument display 21 displays, for example, information necessary for vehicle operation such as vehicle speed, engine speed (if the vehicle 1 has an engine), charging / discharging status (if the vehicle 1 has a drive battery), and distance traveled. The instrument display 21 is an example of a "first display unit" in this disclosure.

[0069] In addition, a pair of display devices are provided on both sides of the instrument display 21. The pair of display devices are connected to the left and right ends of the instrument display 21 respectively, and the left and right displays are positioned on both sides of the steering wheel 4.

[0070] In this embodiment, the display located on the inner side of the vehicle in a pair of display devices is referred to as the inner display, and the display located on the outer side of the vehicle is referred to as the outer display. The inner display 22 is an example of a "second display unit" in this disclosure, and the outer display 23 is an example of a "third display unit" in this disclosure.

[0071] Reference Figure 2 The detailed structure of the internal display 22 and the external display 23 will be described.

[0072] The internal display 22 and the external display 23 are longitudinal displays, and are connected to the instrument display 21 respectively.

[0073] An external display 23 is connected to the right end of the instrument display 21 facing forward of the vehicle, and an internal display 22 is connected to the left end facing forward of the vehicle. This allows the display surface to be positioned near the grip area of ​​the steering wheel 4.

[0074] The above description is an example of the case where vehicle 1 is a right-hand drive vehicle. In the case where vehicle 1 is a left-hand drive vehicle, the left and right sides are reversed. That is, the outer display 23 is connected to the left end of the instrument display 21 facing forward of the vehicle, and the inner display 22 is connected to the right end facing forward of the vehicle.

[0075] The inner display 22 and the outer display 23 are angled relative to the left and right directions of the steering wheel, and are respectively configured to tilt towards the steering wheel side. That is, the inner display 22 is configured to protrude further back into the vehicle as it is closer to the inside, and the outer display 23 is configured to protrude further back into the vehicle as it is closer to the outside. In this way, the inner display 22 and the outer display 23 are respectively configured to face the driver.

[0076] Figure 2 The area 4R, indicated by the dashed line, is the part where the right hand holds the steering wheel 4 (the grip area). Figure 2 The area 4L, indicated by the dashed line, is the part where the left hand holds the steering wheel 4 (the grip area). By making the support part 5 into the shape described above, the positions of the inner display 22 and the outer display 23 in the vehicle's longitudinal direction can be made closer to the grip area of ​​the steering wheel 4. Therefore, the amount of hand movement required when the driver touches the inner display 22 or the outer display 23 while driving can be further reduced.

[0077] Among them, Figure 2 In this example, the instrument display 21, the internal display 22, and the external display 23 are each an independent display device, but this can also be achieved with a single display device. Figure 2 As shown in the diagram. For example, the horizontally elongated display device, which is bent or curved, can be divided into three areas, and each area can function as an instrument display 21, an internal display 22, and an external display 23.

[0078] [System Composition]

[0079] Next, the configuration of each device in the vehicle system of vehicle 1 will be explained.

[0080] First, the constituent elements of vehicle 1 will be explained. Figure 3 This is a diagram schematically illustrating an example of the configuration of vehicle 1. Vehicle 1 is configured to include a vehicle system, an electrical system, and an input / output system.

[0081] The vehicle system is the system that controls the movement of vehicle 1. The vehicle system contains multiple components related to the movement of the vehicle.

[0082] An input / output system is a system that provides information to the occupants of vehicle 1 and receives input from them. An input / output system comprises multiple components for inputting and outputting information.

[0083] The electrical system is a system that controls the electrical components present in the vehicle's body. It includes multiple components related to the electrical components present in the vehicle's body.

[0084] Each system may contain multiple electrical components and an ECU that controls those electrical components.

[0085] The vehicle ECU10 and body ECU30 can be configured as a computer with a processor (CPU, GPU, etc.), main storage (RAM, ROM, etc.), and auxiliary storage (EPROM, hard disk drive, removable media, etc.). The auxiliary storage stores the operating system (OS), various programs, various tables, etc. By executing the programs stored therein, various functions (software modules) that meet the specified purpose can be achieved, as described later. However, some or all of the functions can also be implemented as hardware modules using hardware circuits such as ASICs and FPGAs.

[0086] The vehicle ECU10 is connected to several components related to the vehicle's operation.

[0087] GPS unit 11 is a unit used to obtain the location information of vehicle 1. GPS unit 11 includes a GPS antenna and a positioning module for locating the location information. The GPS antenna is an antenna that receives positioning signals transmitted from positioning satellites (also known as GNSS satellites). The positioning module is a module that calculates the location information based on the signals received by the GPS antenna.

[0088] The ETC (Electronic Toll Collection System) unit 12 is a unit used to collect tolls for toll roads via wireless communication. The ETC unit 12 is configured to include an antenna and a communication module.

[0089] The wireless communication unit 13 includes an antenna and a communication module for performing wireless communication. The antenna is an antenna element that inputs and outputs wireless signals. In this embodiment, the antenna is suitable for mobile communication (e.g., 3G, 4G, 5G, etc.). The antenna may be configured to include multiple physical antennas. The communication module is a module for performing mobile communication.

[0090] Alternatively, the wireless communication unit 13 may include a communication module other than one for communication with mobile devices. For example, the wireless communication unit 13 may include a Bluetooth-based communication module. This enables wireless connection with a user terminal located inside the vehicle, allowing for the provision of services in cooperation with the user terminal (e.g., hands-free calling).

[0091] Sensor group 14 is a collection of multiple sensors used to acquire sensor data during vehicle operation. These sensors can be sensors that acquire physical quantities or sensors that acquire image data, etc. In this embodiment, a sensor for detecting vehicle speed (vehicle speed sensor 141) and an image sensor (vehicle camera 142) that acquires an image of the area in front of the vehicle are exemplified as sensors.

[0092] In addition, components belonging to the drive system (such as engine, motor, battery, transmission, etc.) can be further connected to the vehicle ECU10.

[0093] The ECU30 is connected to multiple electrical components of the vehicle body 1.

[0094] In this embodiment, the vehicle air conditioner, windshield wipers, headlights, side mirrors, and power seats are examples of electrical devices included in the body of the vehicle 1.

[0095] The air conditioning unit 31 is the automotive air conditioning system of vehicle 1. The air conditioning unit 31 includes, for example, a cooling unit, a heating unit, a compressor, a condenser, etc. In addition, the air conditioning unit 31 may also include a control unit for controlling them.

[0096] The wiper unit 32 includes a front wiper, a rear wiper, and a motor for driving them.

[0097] The headlight unit 33 includes the headlights of the vehicle 1 and a unit for driving the headlights. The headlights are configured to switch between high beams and low beams, for example. When the headlights of the vehicle 1 are adaptive headlights, the illumination can also be controlled based on commands from the vehicle ECU 30. The headlight unit 33 may further include taillights, brake lights, turn signals, and / or units for driving them.

[0098] The rearview mirror actuator 34 includes a drive unit for driving the left and right side rearview mirrors disposed on the vehicle 1. The angle of the side rearview mirrors can be adjusted up, down, left, and right by the rearview mirror actuator 34.

[0099] The seat actuator 35 includes a drive unit for adjusting the position of the seat installed in the vehicle 1. The seat actuator 35 allows adjustment of the position, height, angle, etc. of the seat surface and backrest.

[0100] Next, the device used for inputting and outputting information will be described.

[0101] In this embodiment, vehicle 1 has four displays, namely instrument display 21, internal display 22, external display 23 and central display 24, which are used for outputting information.

[0102] The instrument display 21 is a display positioned in front of the driver, outputting information related to the vehicle 1. The instrument display 21 primarily outputs vehicle status-related information such as vehicle speed, engine speed, fuel level, battery level, charging / discharging status, and distance traveled, but it can also output other information.

[0103] The inner display 22 and the outer display 23 are touch-screen displays located on either side of the steering wheel. As described above, the inner display 22 is located on the center side of the vehicle, and the outer display 23 is located on the outer side of the vehicle.

[0104] When vehicle 1 is a right-hand drive vehicle, the internal display 22 is positioned on the left side of the vehicle's direction of travel, and the external display 23 is positioned on the right side of the vehicle's direction of travel. When vehicle 1 is a left-hand drive vehicle, the internal display 22 is positioned on the right side of the vehicle's direction of travel, and the external display 23 is positioned on the left side of the vehicle's direction of travel.

[0105] The central display 24 is a display located in the center of the vehicle. The central display 24 is positioned where a display previously equipped with a vehicle navigation system was installed. The central display 24 displays, for example, auxiliary information such as car navigation, or entertainment-related content such as audio and television.

[0106] The touch panel 25 is a unit for detecting touch operations performed on the aforementioned displays. In this embodiment, the inner display 22, the outer display 23, and the central display 24 each have a touch panel 25, enabling touch-based operations. The touch panel 25 detects touch operations performed on these displays and sends the detected content to the vehicle ECU 10.

[0107] The sound unit 26 is a unit that inputs and outputs information based on sound. The sound unit 26 may include, for example, a speaker and a microphone.

[0108] Next, the detailed composition of the vehicle ECU10 will be explained.

[0109] The vehicle ECU 10 is connected to the vehicle system and the drive system (powertrain system), thereby enabling control of the vehicle 1. In addition, the vehicle ECU 10 has the function of inputting and outputting information through components included in the input / output system and the function of controlling the electrical system via the body ECU 30 that controls the electrical system.

[0110] Figure 4 This is a diagram illustrating the detailed structure of the vehicle's ECU10.

[0111] The vehicle ECU 10 is configured to have a control device 101, a storage device 102 and a communication module 103.

[0112] The control device 101 is a computing unit that executes a prescribed program to implement various functions of the vehicle ECU 10. The control device 101 can be implemented by a hardware processor such as a CPU. Furthermore, the control device 101 can be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0113] In this embodiment, the control unit 101 of the vehicle ECU 10 is configured with six software modules: an HMI control unit 1011, a vehicle control unit 1012, an ADAS control unit 1013, an entertainment control unit 1014, a navigation unit 1015, and an auxiliary unit 1016. Each software module can be implemented by the control unit 101 (CPU, etc.) executing a program stored in the storage device 102 (described later). Information processing performed by the software modules is synonymous with information processing performed by the control unit 101 (CPU, etc.).

[0114] The HMI control unit 1011 generates a user interface for controlling various components of the vehicle and provides it to the vehicle occupants via the input / output system. Additionally, the HMI control unit 1011 passes information input via the input / output system (e.g., instructions for implementing user-specified controls) to corresponding software modules.

[0115] Therefore, any component of the vehicle can be controlled via a user interface.

[0116] In the following description, user-generated instructions for controlling the components of vehicle 1 will be referred to as "user instructions". For example, instructions to change the air conditioning temperature, change the driving mode, make a phone call, or play music are examples of "user instructions".

[0117] The components of a vehicle can be electrical devices such as headlights and windshield wipers. Additionally, the components can be an onboard computer or software modules executed by that computer (e.g., autonomous driving software, navigation software, etc.).

[0118] The HMI control unit 1011 selects the user interface output destination from multiple displays (instrument display 21, internal display 22, external display 23, and central display 24) according to the type of component being controlled. The specific configuration will be described later.

[0119] The vehicle control unit 1012 controls the components of the vehicle system or the drive system.

[0120] The vehicle control unit 1012 can control the target component (e.g., the drive motor) based on instructions (e.g., acceleration instructions) received from other components (e.g., the ADAS control unit 1013 described later), or based on user instructions (e.g., headlight illumination instructions) obtained via the HMI control unit 1011.

[0121] The ADAS control unit 1013 controls the Advanced Driver-Assistance Systems. For example, the ADAS control unit 1013 generates vehicle control commands based on sensor information obtained from the onboard sensors included in the sensor group 14, enabling driver assistance functions such as cruise control, pre-collision safety, and lane keeping assist. The ADAS control unit 1013 controls the vehicle system and drive system, for example, by sending control commands to the vehicle control unit 1012.

[0122] The entertainment control unit 1014 performs controls related to the entertainment provided to the occupants of the vehicle. Examples of entertainment-related functions include audio functions and television / radio functions.

[0123] The navigation unit 1015 provides car navigation functionality. The navigation unit 1015 can generate and provide route guidance for the vehicle based on location information obtained from the GPS unit 11 and traffic information obtained from the wireless communication unit 13. For example, the navigation unit 1015 can also receive the vehicle's destination and route designation via the HMI control unit 1011 and output information related to the generated route.

[0124] The auxiliary unit 1016 provides information to vehicle occupants by executing a language model capable of dialogue based on natural language. The language model can be, for example, an LLM (Large Language Model). For instance, by executing an LLM containing information related to the vehicle occupants, information can be provided based on natural language. Where there are multiple occupants, the auxiliary unit 1016 can obtain the language model corresponding to each person via a network and execute any given language model.

[0125] Storage device 102 is a mechanism for storing information, and is composed of storage media such as RAM, disk, and flash memory. Storage device 102 stores programs executed by control device 101, data used by those programs, etc.

[0126] The communication module 103 is a communication interface for connecting the vehicle ECU 10 to the vehicle network. The communication module 103 is configured, for example, to communicate with components of the vehicle 1 via a network such as CAN (Controller Area Network).

[0127] The specific configuration of the vehicle ECU 10 can be appropriately modified by omitting, substituting, or adding components depending on the implementation method. For example, the control device 101 may include multiple hardware processors. These hardware processors may be microprocessors, FPGAs, GPUs, etc. Additionally, input / output devices other than those shown (e.g., optical drivers) may be added. Furthermore, the vehicle ECU 10 may be composed of multiple computers. In this case, the hardware configuration of each computer may be identical or different.

[0128] [Interface screen provided by HMI control unit]

[0129] Next, the user interface provided by the HMI control unit 1011 will be described.

[0130] The HMI control unit 1011 can generate various types of graphical user interface (GUI) screens and output them via the aforementioned multiple displays.

[0131] In this embodiment, the HMI control unit 1011 centrally outputs vehicle control-related information to the external display 23 and centrally outputs information related to occupant convenience and comfort to the internal display 22. Thus, the occupants of the vehicle 1 can intuitively understand which side (left or right) the desired information is output to. Furthermore, the touch panel operation surfaces of both the internal display 22 and the external display 23 are positioned near the steering wheel. This minimizes the driver's line of sight and hand movement.

[0132] The HMI control unit 1011 can switch the screen output to the external display 23 to multiple types of screens.

[0133] Figure 5 This diagram illustrates the transfer of multiple types of screens output to the external display 23. As shown, the HMI control unit 1011 can output multiple screens centered on the main screen 501 to the external display 23.

[0134] (1) Main screen 501

[0135] The main screen 501 is the screen that is usually displayed on the external display while driving. Figure 6 (A) is a diagram representing an example of the main screen 501. The content displayed on the main screen can be customized by the user.

[0136] (2) Headlight control screen 502

[0137] This is a screen showing the illuminated state of the headlights on vehicle 1. Figure 7 (A) is a diagram representing an example of a headlight control screen 502.

[0138] In the headlight control screen 502, the illumination status of the headlights can be selected (automatic, on, off, parking lights, daytime running lights, etc.). The vehicle control unit 1012 generates user commands based on the touch operation obtained via the HMI control unit 1011, and controls the headlight unit 33 by sending the user commands to the vehicle ECU 30.

[0139] Additionally, the vehicle control unit 1012 can also obtain data indicating the headlight illumination status from the vehicle ECU 30 and display the illumination status on the screen via the HMI control unit 1011. For example, the vehicle control unit 1012 can display the current headlight illumination status in the vehicle graphic shown on the screen.

[0140] (3) Wiper control screen 503

[0141] This is a screen that sets the operating status of the windshield wipers (front and rear) of vehicle 1. Figure 7 (B) is a diagram representing an example of a windshield wiper control screen 503.

[0142] In the wiper control screen 503, the operating state of the wipers can be selected (stop, automatic operation, intermittent operation, continuous operation, etc.). The vehicle control unit 1012 generates user commands based on the touch operation obtained via the HMI control unit 1011, and controls the wiper unit 32 by sending the user commands to the vehicle ECU 30.

[0143] Additionally, the vehicle control unit 1012 can also obtain data indicating the operating status of the windshield wipers from the vehicle ECU 30 and display the operating status on the screen via the HMI control unit 1011. For example, the vehicle control unit 1012 can display the current operating status of the windshield wipers in the vehicle graphic shown on the screen.

[0144] (4) Rearview mirror control screen 504

[0145] It is a screen showing the unfolding state and angle of the side rearview mirrors on vehicle 1. Figure 7 (C) is a diagram representing an example of a rearview mirror control screen 504.

[0146] In the rearview mirror control screen 504, the state of the side rearview mirror (folded / unfolded state and angle) can be selected. The vehicle control unit 1012 generates user commands based on the touch operation obtained via the HMI control unit 1011, and controls the rearview mirror actuator 34 by sending the user commands to the vehicle ECU 30.

[0147] In addition, the vehicle control unit 1012 can also obtain data indicating the status of the rearview mirrors from the vehicle ECU 30 and reflect the operation status on the screen via the HMI control unit 1011. For example, the vehicle control unit 1012 can make the graphic of the vehicle shown on the screen reflect the current unfolded / folded state of the side rearview mirrors.

[0148] (5) Driving posture adjustment screen 505

[0149] This is a screen showing the adjustment of the position / angle of the seats (seat surface and backrest) and the position / angle of the steering wheel in vehicle 1.

[0150] In the driving posture adjustment screen 505, the position and angle of the seat and steering wheel can be set. The vehicle control unit 1012 obtains the touch operation obtained by the HMI control unit 1011 via the HMI control unit 1011, generates a user command based on the touch operation, and controls the seat actuator 35 and the like by sending the user command to the vehicle ECU 30.

[0151] (6) ADAS setting screen 506

[0152] This screen is used to notify the vehicle 1 of the operation status of its advanced driver assistance system and to configure it.

[0153] For example, if the advanced driver assistance system of vehicle 1 includes an automatic cruise function, the user of vehicle 1 can set the cruise speed, inter-vehicle distance, whether or not to follow the vehicle in front, and whether or not to follow the lane via the ADAS setting screen 506.

[0154] The ADAS control unit 1013 can generate the information contained in the ADAS setting screen 506.

[0155] (7) Driving mode setting screen 507

[0156] This is the screen for setting the driving mode for vehicle 1. Figure 7 (D) is a diagram representing an example of the driving mode setting screen 507.

[0157] For example, the user of vehicle 1 can select a mode from multiple modes such as standard mode, sport mode, eco mode, and snow mode via the driving mode setting screen 507. The vehicle control unit 1012 changes the vehicle's driving mode based on this selection.

[0158] (8) Vehicle function setting screen 508

[0159] This is a screen used to utilize other functions of vehicle 1. Examples of other functions of vehicle 1 include the opening and closing of the power tailgate and suspension adjustment.

[0160] (9) Display mode setting screen 509

[0161] This is a screen for setting the types of information to be displayed on the instrument display 21. For example, if the instrument display 21 can display multiple pieces of information other than speed, the user of the vehicle 1 can customize the information displayed on the instrument display 21 via the display mode setting screen 509.

[0162] For example, multiple screens, as illustrated above, can be switched by performing a prescribed operation, such as swiping left or right, on the touch panel provided on the external display 23.

[0163] Furthermore, the HMI control unit 1011 can enable the external display 23 to display a shortcut screen 510 for jumping to each screen. Figure 6 Figure (B) is an example of a shortcut screen 510. For example, the shortcut screen can be brought up by performing a prescribed operation (e.g., swiping from bottom to top) on each screen containing the main screen 501. The shortcut screen 510 is provided with multiple interfaces (e.g., buttons) for moving to each screen, and by operating these interfaces, one can move to the target screen.

[0164] In this way, the HMI control unit 1011 will output at least the information related to vehicle control to the external display 23.

[0165] Information related to vehicle control typically refers to information related to vehicle driving control. Examples of driving control related information include information used to control components belonging to the vehicle system, information used to control components belonging to the drive system, etc. Additionally, information about components in the electrical system, such as lights and windshield wipers, necessary for proper vehicle driving, can also be considered driving control related information.

[0166] Furthermore, any information related to vehicle control can be output to the external display 23, and information not directly related to vehicle driving control can also be output to the external display 23. For example, information used to control the vehicle's electric doors can be output to the external display 23.

[0167] Similarly, the HMI control unit 1011 can switch the image output to the internal display 22 to multiple types of images.

[0168] Figure 8 This diagram illustrates the transfer of multiple types of screens output to the internal display 22. As shown, the HMI control unit 1011 can output multiple screens centered on the main screen 801 to the internal display 22.

[0169] (1) Main screen 801

[0170] The main screen 801 is the screen that is usually displayed on the internal display while driving. Figure 9 (A) is a diagram representing an example of the main screen 801. The content displayed on the main screen can be customized by the user.

[0171] (2) Navigation screen 802

[0172] It's a screen related to car navigation. Figure 10 Figure (A) is an example of a navigation screen 802. The information contained in the navigation screen 802 is generated by the navigation unit 1015.

[0173] When the map information in the car navigation is displayed on the central display screen 24, auxiliary information related to the route of vehicle 1 can also be output on the navigation screen 802. This auxiliary information may include, for example, guidance on locations for upcoming left or right turns, estimated arrival time, and remaining distance.

[0174] Alternatively, the navigation screen 802 may include information displayed on the central display 24, or a portion of the user interface.

[0175] For example, frequently used user interfaces such as buttons for starting route guidance to home, buttons for bringing up bookmarks, and buttons for starting route guidance to charging points can also be configured on the navigation screen 802.

[0176] (3) Audio and video 803

[0177] The image is related to the audio function of vehicle 1. Figure 10 Figure (B) is a diagram representing an example of audio display 803. The information contained in the audio display 803 is generated by the entertainment control unit 1014. The entertainment control unit 1014 can obtain and play music via a network or media. The audio display 803 can contain information related to the music being played and an interface for selecting music.

[0178] (4) Air Conditioner Setting Screen 804

[0179] This is a screen used to control the car's air conditioning system in vehicle 1. Figure 10 (C) is a diagram representing an example of an air conditioner setting screen 804.

[0180] In the air conditioning setting screen 804, the temperature, airflow, and operating air conditioning devices (steering wheel heater, seat heater, defroster, etc.) of the car's air conditioning can be set. The vehicle control unit 1012 generates user commands based on the operations performed on the screen and controls the air conditioning unit 31, etc., by sending the user commands to the vehicle ECU 30.

[0181] Although the car air conditioner is an equipment of vehicle 1 controlled by external commands, the air conditioner setting screen 804 is not displayed on the external display 23 but on the internal display 22 because it is related to the comfort of the occupants.

[0182] (5) Telephone screen 805

[0183] This is a screen used for hands-free calling via wireless connection with a user terminal. When the wireless communication unit 13 has a module for wireless communication with a user terminal, calls (or answers) from the user terminal, such as telephone calls, can be made via this module.

[0184] (6) AI Partner Screen 806

[0185] It is a screen used to converse with a virtual agent (AI partner) that can communicate based on natural language. Figure 10 (D) is a diagram representing an example of an AI partner screen 806. This screen contains a virtual agent role that vehicle occupants can interact with to obtain information. Natural language-based dialogue services are provided by the auxiliary unit 1016.

[0186] The AI ​​partner screen 806 may also include an interface for instructing agents. In cases where there are multiple occupants in the vehicle, the auxiliary unit 1016 can be configured to execute any agent corresponding to each person. The AI ​​partner screen 806 may include interfaces for starting and ending dialogue with agents, interfaces for switching agents, etc.

[0187] For example, multiple screens, as illustrated above, can be switched by performing a prescribed operation, such as swiping left or right, on the touch panel provided on the internal display 22.

[0188] Furthermore, the HMI control unit 1011 can enable the internal display 22 to display a shortcut screen 810 for jumping to each screen. Figure 9 Figure (B) is an example of a shortcut screen 810. For example, the shortcut screen can be brought up by performing a specified operation (e.g., swiping from bottom to top) on each screen containing the main screen 801. The shortcut screen 810 is provided with multiple interfaces (e.g., buttons) for moving to each screen, and by operating these interfaces, one can move to the target screen.

[0189] In this way, the HMI control unit 1011 centrally outputs information related to the convenience and comfort of the occupants to the internal display 22.

[0190] While components such as car air conditioning are part of the vehicle, information about components related to the convenience or comfort of occupants may be output to the internal display 22 without being processed as information related to vehicle control.

[0191] Thus, when the information of the object conforms to both information related to vehicle control and information related to occupant convenience (or comfort), the information can be selectively output to either the internal display 22 or the external display 23 according to a prescribed reference.

[0192] Alternatively, unlike the above description, the HMI control unit 1011 may output prescribed information to the central display 24. For example, the information generated by the entertainment control unit 1014 and the navigation unit 1015 can be output not only to the internal display 22 but also to the central display 24.

[0193] [Interruption display on the interface screen]

[0194] Next, we will explain the interruption display.

[0195] Sometimes, while the vehicle 1 is in motion, notifications to occupants are generated from various components of the vehicle 1. For example, when the vehicle 1 is connected to a user terminal, it is necessary to notify the occupants of incoming telephone calls as needed. Additionally, when an event occurs during the use of ADAS functions (e.g., a request to switch from autonomous driving to manual driving), it is necessary to notify the occupants of that event. When a request for such a notification (hereinafter referred to as a notification request) is generated from components of the vehicle 1, the HMI control unit 1011 interrupts the display using any one (or all) of the instrument cluster display 21, the internal display 22, and the external display 23.

[0196] Here is an example of an interrupted display.

[0197] Figure 11 This diagram shows an example of the display content of the instrument display 21, internal display 22, and external display 23 under normal circumstances (when no notification with a priority higher than a specified value has occurred; also known as the first situation).

[0198] As shown in the diagram, the instrument display 21 mainly outputs information related to the vehicle's status, such as vehicle speed, engine speed, remaining fuel, remaining battery, charging / discharging status, and driving distance. Additionally, it displays... Figure 9 As explained, the internal display 22 outputs information related to the convenience and comfort of the occupants. Additionally, as shown... Figure 6 As explained, the external display 23 outputs information related to vehicle control.

[0199] In the vehicle ECU 10 of this embodiment, multiple notifications are defined and assigned different priorities. Furthermore, when a notification is generated, the HMI control unit 1011 displays an image (interruption display) in different ways according to the priority of the notification.

[0200] Figure 12 Example (A) is an example of an interrupted display output when a notification (rear-end collision warning) with a priority exceeding a predetermined value is generated. This is an example of a display output when the ADAS control unit 1013 determines that there is a risk of collision due to excessive proximity to the vehicle ahead. As shown, in this embodiment, when a notification with a priority exceeding a predetermined value is generated, an image spanning three displays is displayed.

[0201] As shown in the diagram, when a notification with a priority exceeding a predetermined value is generated, the output image spans across three displays: the instrument display 21, the internal display 22, and the external display 23. This image consists of three areas: a first area 1201 output to the instrument display 21, a second area 1202 output to the internal display 22, and a third area 1203 output to the external display 23. Furthermore, such an image set is stored in the storage device 102 for each notification.

[0202] When the HMI control unit 1011 receives a notification request regarding a notification with a priority value of a predetermined value or higher, it retrieves the image set corresponding to the notification from the storage device 102. Furthermore, the HMI control unit 1011 controls the output of a first region 1201 (constituting multiple regions of the image) to the instrument display 21, a second region 1202 to the internal display 22, and a third region 1203 to the external display 23. This control can be described as the control that forms a virtual screen using the internal display 22, the instrument display 21, and the external display 23, and outputs the image to that screen.

[0203] In this embodiment, as shown in the figure, the first, second, and third regions are combined to form a single image. This configuration allows the driver's gaze to naturally turn towards the center when receiving a notification.

[0204] Figure 12 (B) is an example of an interrupted display corresponding to a notification (incoming call notification) with a priority lower than a specified value. The illustrated display is output when a voice call comes in from a user terminal connected to vehicle 1. As shown, in this embodiment, when a low-priority notification occurs, image 1204 is displayed on only one display.

[0205] As shown in the figure, when the priority of the notification is less than a specified value, the output image 1204 is not divided into multiple regions. In the illustrated example, this image is output to the internal display 22, but the output destination can be any of the instrument display 21, the internal display 22, and the external display 23. The output destination can be appropriately selected according to the type of notification.

[0206] Storage device 102 stores images corresponding to multiple notifications.

[0207] Figure 13 (A) is an example of an image corresponding to a notification whose priority exceeds a specified value. Figure 13(B) is an example of an image corresponding to a notification with a priority lower than the specified value. Notifications with a priority higher than the specified value could include, for example, "rear-end collision warning," "request to switch to manual driving," "abnormal occurrence notification," or "lane departure warning." Notifications with a priority lower than the specified value could include, for example, "incoming call notification," "route-related suggestions (route change, etc.)," ​​"message (email) notification," or "push notification from the user application."

[0208] The image corresponding to a notification with a priority exceeding the specified value is an image containing three regions, while the image corresponding to a notification with a priority less than the specified value is an image containing no multiple regions.

[0209] The HMI control unit 1011 determines whether to output the corresponding image to a single display or to a virtual screen spanning three displays based on the priority of the notification, and outputs the image after retrieving it from the storage device 102.

[0210] In the latter case, the HMI control unit 1011 outputs the image to the virtual screen by controlling the output of each region contained in the corresponding image to a different display.

[0211] Figure 14 This is a flowchart of the process executed by the HMI control unit 1011 when a notification request is generated from various components of vehicle 1. This process is executed periodically.

[0212] First, in step S11, the HMI control unit 1011 determines whether a notification request has been generated from any of the multiple components of the vehicle 1. If a notification request has been generated, the process proceeds to step S12. If no notification request has been generated, the process ends.

[0213] In step S12, the HMI control unit 1011 determines whether the notification to the target is a notification with a priority value of 10 or higher. A notification with a priority value of 10 or higher is a notification that should be reliably delivered to the driver.

[0214] Examples of notifications that should be reliably delivered to the driver include requests to switch from autonomous to manual driving, notifications of vehicle malfunctions, collision warnings, lane departure warnings, and other notifications that require immediate driver intervention.

[0215] If a positive determination is made in step S12, the process moves to step S13. After the HMI control unit 1011 obtains the image corresponding to the notification (i.e., an image containing three areas) from the storage device 102, it performs an interruption display using all displays.

[0216] If a negative decision is made in step S12 (i.e., the priority of the notification is less than a predetermined value), the process moves to step S14. In step S14, the type of notification is determined. If the notification is from a component related to vehicle control, the process moves to step S16. If the notification is from a component related to occupant convenience or comfort, the process moves to step S15. This selection criterion and reference... Figure 5 as well as Figure 8 The references are the same.

[0217] In step S15, the HMI control unit 1011 outputs an image corresponding to the notification via the internal display 22.

[0218] In step S16, the HMI control unit 1011 outputs an image corresponding to the notification via the external display 23.

[0219] In either case, the output image is one that has not been divided into multiple regions.

[0220] Furthermore, when a notification is output in step S15 or S16, other information may already be displayed on the target device's screen. For example, when a user terminal receives an incoming call, a call notification may be output to the internal display 22, but sometimes the internal display 22 may be displaying other screens such as the air conditioning settings screen.

[0221] In this case, the HMI control unit 1011 outputs the notification in the following manner.

[0222] The first method is to overlay the notification on a screen that is already in output mode.

[0223] For example, an image displaying a notification that a phone call is coming in could be overlaid on an already depicted air conditioning settings screen.

[0224] In this scenario, the screen can be switched if the user responds to the notification, and the displayed screen can be maintained otherwise. For example, the air conditioning settings screen can be switched to the phone app if the user responds to a phone call, and the air conditioning settings screen can continue to be displayed if no action is taken.

[0225] Furthermore, when a notification is sent that does not require user action, there is no need to switch screens.

[0226] The second method is to display a notification after switching to the appropriate screen.

[0227] For example, after switching from the previously depicted air conditioning settings screen to the phone application, an image showing an incoming call notification is overlaid.

[0228] Furthermore, in this situation, the user can return to the original screen once the event mentioned in the notification has ended. For example, if a call ends, the phone application can be automatically closed and the air conditioning settings screen can be displayed again.

[0229] As described above, in the first embodiment, the HMI control unit 1011 of the vehicle ECU uses the external display 23 and the internal display 22 to output various information related to the vehicle and driving.

[0230] The HMI control unit 1011 outputs information related to occupant convenience and comfort (second information) via an inner display located on the inner side of the vehicle, and outputs information related to vehicle control (first information) via an outer display located on the outer side of the vehicle. With this configuration, the driver of vehicle 1 can intuitively see which display unit the requested information is output to, and can minimize the time required to turn their attention to the display.

[0231] Furthermore, when the HMI control unit 1011 generates a notification with a priority exceeding a predetermined value, it treats the instrument cluster display 21, internal display 22, and external display 23 as a single display, outputting the image corresponding to the notification as a single unit. That is, the HMI control unit 1011 outputs the image corresponding to the notification to a virtual screen configured across the three displays. With this configuration, regardless of which display the driver is looking at, their gaze can be naturally guided to the instrument cluster display 21, ensuring reliable recognition of the notification.

[0232] (Modified example)

[0233] The above-described implementation is merely an example, and this disclosure can be appropriately modified without departing from its spirit.

[0234] For example, the processing and methods described in this disclosure can be freely combined and implemented as long as they do not create technical contradictions.

[0235] Furthermore, in this embodiment, although the three displays are treated as a single virtual display and an image is output when a notification with a priority value of a predetermined value or higher is generated, the image of the object can be divided into three parts, and the HMI control unit 1011 can control the output of each image to the three displays separately. With this configuration, it is also possible to display a single image on a virtual screen that spans the three displays.

[0236] Furthermore, although the instrument display 21, internal display 22 and external display 23 are shown to be independent in the embodiments, the displays do not necessarily need to be physically independent.

[0237] For example, it can also be like Figure 15 As shown, the first display unit, second display unit, and third display unit involved in this disclosure are implemented through a single display 1501. Figure 15 In this example, the display 1501 has three display areas (display sections) indicated by reference numerals 1502, 1503, and 1504. Each of the three display areas is planar, and the area between them forms a curved structure.

[0238] In the illustrated example, display area 1502 functions as the internal display 22 (second display unit), and display area 1503 functions as the external display 23 (third display unit) (in the case of a right-hand drive vehicle). Additionally, display area 1504 functions as the instrument display 21 (first display unit).

[0239] The portions connecting display areas 1502 and 1504 (reference numeral 1505) and the portions connecting display areas 1503 and 1504 (reference numeral 1506) are capable of displaying images, but they are not used as display parts under normal circumstances because they are deformed due to physical bending.

[0240] However, if a notification with a priority value higher than a specified value is generated, the curved portion can also be included in the output image. That is, the image can be output on a virtual screen configured to span the entire display area of ​​the display 1501 (the five display areas 1502, 1503, 1504, 1505, and 1506).

[0241] Furthermore, although the embodiments illustrate two types of second information—information related to occupant convenience and information related to occupant comfort—the second information may be either one of these or may include other information.

[0242] Furthermore, although information related to vehicle control is exemplified as the first information in the implementation, the first information may also include other information.

[0243] Alternatively, processes described as being performed by a single device can be distributed among multiple devices. Or, processes described as being performed by different devices can be performed by a single device. In a computer system, the hardware configuration (server configuration) used to implement various functions can be flexibly changed.

[0244] This disclosure can also be implemented by supplying a computer with a computer program containing the functions described in the above embodiments, and having the program read and executed by one or more processors of the computer. Such a computer program can be provided to the computer either through a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk media such as disks (floppy disks, hard disk drives (HDDs), etc.), optical disks (CD-ROMs, DVDs, Blu-ray discs, etc.), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards, flash memory, optical cards, and any type of media suitable for storing electronic instructions.

Claims

1. An in-vehicle system, wherein, include: The storage unit stores images corresponding to notifications with a priority value of more than a specified value among multiple notifications generated by the vehicle, and includes a first area, a second area, and a third area. The first display unit is disposed on the front of the steering wheel of the aforementioned vehicle and is disposed on the front side of the vehicle. The second display unit is disposed to the side of the steering wheel and on the inner side of the vehicle. The third display unit is disposed to the side of the steering wheel and on the outer side of the vehicle; and An information processing apparatus has a control unit that performs the following processes: In the first situation, different information related to the vehicle is output to the first display unit, the second display unit, and the third display unit, respectively. and In the second situation where a notification with a priority of more than the specified value is generated to the occupants of the aforementioned vehicle, the first area of ​​the image corresponding to the notification is output to the first display unit, the second area is output to the second display unit, and the third area is output to the third display unit.

2. An in-vehicle system, wherein, include: The first display unit is disposed on the front of the steering wheel of the vehicle and is disposed on the front side of the vehicle. The second display unit is disposed to the side of the steering wheel and on the inner side of the vehicle. The third display unit is disposed to the side of the steering wheel and on the outer side of the vehicle; and An information processing apparatus has a control unit that performs the following processes: In the first situation, independent display control is performed on the first display unit, the second display unit, and the third display unit; and In the second situation where a notification with a priority of a predetermined value or higher is generated to the occupants of the aforementioned vehicle, the display control related to the notification is performed through a virtual screen configured across the first display unit, the second display unit, and the third display unit.

3. The vehicle-mounted system according to claim 2, wherein, It also has a storage unit that stores the corresponding images for each of the above notifications.

4. The vehicle-mounted system according to claim 3, wherein, The images described above each contain a first region, a second region, and a third region. The control unit outputs the first region of the image to the first display unit, the second region to the second display unit, and the third region to the third display unit.

5. The vehicle-mounted system according to claim 2, wherein, The first display unit, the second display unit, and the third display unit are multiple displays arranged in a linear configuration.

6. The vehicle-mounted system according to claim 2, wherein, The first display unit, the second display unit, and the third display unit are all arranged as linear display areas on a single display device.

7. The vehicle-mounted system according to claim 2, wherein, The second and third display units are positioned in the longitudinal direction of the vehicle, protruding towards the rear of the vehicle compared to the first display unit.

8. The vehicle-mounted system according to claim 7, wherein, The second and third display units are positioned at the front of the vehicle in the longitudinal direction of the vehicle, compared to the steering wheel grip.

9. The vehicle-mounted system according to claim 2, wherein, The control unit outputs second information, which includes at least information related to the convenience of the occupants of the vehicle, via the second display unit, and third information, which includes at least information related to the control of the vehicle, via the third display unit.

10. The vehicle-mounted system according to claim 9, wherein, The information related to the control of the aforementioned vehicle includes information for notifying the status of the components present in the aforementioned vehicle.

11. The vehicle-mounted system according to claim 9, wherein, Information related to the convenience of the occupants of the aforementioned vehicles includes information for providing entertainment to the occupants of the aforementioned vehicles.

12. A vehicle, wherein, It is equipped with the vehicle system described in any one of claims 1 to 11.

13. An information processing device mounted on a vehicle, the vehicle having a first display unit disposed on the front of a steering wheel and disposed on the front side of the vehicle, a second display unit disposed on the side of the steering wheel and disposed on the inner side of the vehicle, and a third display unit disposed on the side of the steering wheel and disposed on the outer side of the vehicle, wherein, The aforementioned information processing apparatus has a control unit that performs the following processes: In the first situation, independent display control is performed on the first display unit, the second display unit, and the third display unit; and In the second situation where a notification with a priority of a predetermined value or higher is generated to the occupants of the aforementioned vehicle, the display control related to the notification is performed through a virtual screen configured across the first display unit, the second display unit, and the third display unit.

Images