Display control device, control method of display control device, and recording medium

Abstract

The present application provides a display control device, a control method of the display control device, and a recording medium. The display control device includes a display operation section mounted on a vehicle, displays information to an occupant of the vehicle, and receives an operation by the occupant; a function control section controls a predetermined function of the vehicle based on a detection result of a vehicle-mounted sensor or the operation by the occupant; and a display control section controls the display operation section based on an operation state of the function. In a case where the operation state of the function has changed under a condition not based on the operation by the occupant, the display control section controls the display operation section to display a function operation screen for changing the operation state of the function by the operation by the occupant.

Description

Technical Field

[0001] This disclosure relates to a display control device, a control method for the display control device, and a display control program. Background Technology

[0002] Previously, a structure was known that was mounted on a vehicle and that switching between an ON and OFF state was performed by touching the display screen (software switch) of a multi-function display, wherein the multi-function display could display various switches for switching the operating state of a predetermined function (see, for example, Japanese Patent Application Publication No. 2023-124880). Summary of the Invention

[0003] The problem that the invention aims to solve Here, if the function's operational state changes automatically without being based on an operation performed by the occupant, the function's operational state may not necessarily be in accordance with the occupant's intention.

[0004] Therefore, even with a software switch structure like the one described above, there is a possibility that passengers may want to quickly and easily change the operating state of the function.

[0005] Methods for solving problems One aspect of the display control device disclosed herein includes: a display operation unit mounted on a vehicle, which displays information to vehicle occupants and is subject to operations performed by the occupants; a function control unit that controls predetermined functions of the vehicle based on detection results from onboard sensors or operations performed by the occupants; and a display control unit that controls the display operation unit based on the operational state of the function. If the operational state of the function changes without being based on operations performed by the occupants, the display control unit controls the display operation unit to display a function operation screen for changing the operational state of the function through operations performed by the occupants.

[0006] In one aspect of the display control device disclosed herein, when the operating state of a function changes without being based on the occupant's operation, the display operation unit is controlled to display a function operation screen for changing the operating state of the function through an operation performed by the occupant. Therefore, the occupant does not need to operate the display operation unit to retrieve the function operation screen in order to change the operating state of the function to the desired state. Thus, even if the operating state changes automatically without being based on the occupant's operation and is not in accordance with the occupant's intention, the occupant can quickly and easily perform the operation to change the operating state of the function.

[0007] In one embodiment, if the operational state of a function changes during vehicle operation without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display a function operation screen containing an operation image for changing the operational state of the function through an operation performed by the occupant. In this case, if the operational state of a function changes automatically during vehicle operation without being based on an operation performed by the occupant, the occupant can quickly and easily operate the operation image.

[0008] In one embodiment, the system can be configured as a lighting control mechanism that illuminates or extinguishes vehicle lights, including headlights. The operating states include an automatic state, a non-automatic state, and a manual state. The automatic state automatically changes the lighting state based on the detection results of an onboard illuminance sensor. The non-automatic state does not automatically change the lighting state based on the illuminance sensor's detection results if an anomaly is detected. The manual state changes the lighting state through operation performed by a passenger. If an anomaly occurs in the illuminance sensor, the function control unit switches the lighting control operating state from automatic to non-automatic. When the lighting control operating state is switched from automatic to non-automatic, the display control unit controls the display operation unit to display a function operation screen for switching the lighting control operating state to manual. In this situation, even if the illuminance sensor malfunctions and the lighting control is automatically switched from automatic to non-automatic, the occupants can quickly and easily switch the lighting control back to manual mode.

[0009] In one embodiment, the display control unit may be configured to display multiple function operation screens and a function selection screen corresponding to each of the multiple functions of the vehicle on the display operation unit. The function selection screen contains links to each of the multiple function operation screens at a higher level than the function operation screens. When the operating state of a function changes without being based on an operation performed by an occupant, the display control unit controls the display operation unit to display the function operation screen corresponding to that function. In this case, for example, even if the function selection screen is displayed on the display operation unit when the operating state of a function is about to change automatically without being based on an operation performed by an occupant, it can automatically switch to the function operation screen for that function without touching any links in the function selection screen.

[0010] In the control method of the display control device involved in other aspects of this disclosure, the display control device controls a display operation unit, which is mounted on a vehicle and displays information to the occupants of the vehicle and is subject to operations performed by the occupants. The control method of the display control device includes: a function control step, in which a predetermined function of the vehicle is controlled by the display control device based on detection results from onboard sensors or operations performed by the occupants; and a display control step, in which the display operation unit is controlled by the display control device based on the operational state of the function. In the display control step, if the operational state of the function changes without being based on operations performed by the occupants due to the function control step, the display operation unit is controlled to display a function operation screen for changing the operational state of the function through operations performed by the occupants.

[0011] In the control method of the display control device according to other aspects of this disclosure, when the operating state of a function changes without being based on an operation performed by the occupant, the display operation unit is controlled to display a function operation screen for changing the operating state of the function through an operation performed by the occupant. Therefore, the occupant does not need to operate the display operation unit to retrieve the function operation screen in order to change the operating state of the function to the desired state. Thus, even if the operating state changes automatically without being based on an operation performed by the occupant and is not in accordance with the occupant's intention, the occupant can quickly and easily perform the operation to change the operating state of the function.

[0012] Another aspect of this disclosure is a non-transitory, computer-readable recording medium storing a display control program that enables a computer to function as a display control device for controlling a display operation unit mounted on a vehicle and displaying information to vehicle occupants and subject to operations performed by the occupants. The display control program enables the computer to function as: a function control unit that controls predetermined functions of the vehicle based on detection results from onboard sensors or operations performed by the occupants; and a display control unit that controls the display operation unit based on the operational state of the function. If the operational state of the function changes without being based on operations performed by the occupants, the display control unit controls the display operation unit to display a function operation screen for changing the operational state of the function through operations performed by the occupants.

[0013] In another aspect of this disclosure, when the operational state of a function changes without being based on an operation performed by the occupant, the display operation unit is controlled to display a function operation screen for changing the operational state of the function through an operation performed by the occupant. Therefore, the occupant does not need to perform an operation on the display operation unit to bring up the function operation screen in order to change the operational state of the function to the desired state. Thus, even if the operational state changes automatically without being based on an operation performed by the occupant and is not in accordance with the occupant's intention, the occupant can quickly and easily perform the operation to change the operational state of the function.

[0014] Invention Effects According to various methods of this disclosure, even if the operating state changes automatically without being based on an operation performed by the occupant and is not in accordance with the occupant's intention, the occupant can quickly and easily perform an operation to change the operating state of the function. Attached Figure Description

[0015] Figure 1 This is a block diagram illustrating the structure of the display control device according to the embodiment.

[0016] Figure 2 This is a summary diagram illustrating the function selection screen.

[0017] Figure 3 This is a summary diagram illustrating the operation screens corresponding to lighting control functions.

[0018] Figure 4 This is a summary diagram illustrating the function operation screens corresponding to the wiper control.

[0019] Figure 5 For the purpose of Figure 1 The flowchart illustrates the functional control processes implemented by the ECU.

[0020] Figure 6 For the purpose of Figure 1 The flowchart illustrates the display control processing implemented by the ECU.

[0021] Figure 7 To indicate Figure 6 The flowchart shows an example of changes in the display control processing. Detailed Implementation

[0022] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0023] Figure 1 This is a block diagram illustrating the structure of the display control device according to the embodiment. The display control device 100 is a device mounted on a vehicle and used to control the vehicle's display operation unit. The vehicle here has predetermined functions controlled based on detection results from onboard sensors or operations performed by occupants. These predetermined functions are those whose operating states can automatically change based on the detection results from onboard sensors. Examples of predetermined functions include automatic lighting (light control), automatic high beam, automatic windshield wipers, automatic seat, and automatic air conditioning. The predetermined functions may be a part of the aforementioned functions or may include functions other than those described above. Details regarding the predetermined functions and operating states will be described later.

[0024] like Figure 1 As shown, the display control device 100 includes an ECU (Electronic Control Unit) 10. The ECU 10 is an electronic control unit that includes a CPU (Central Processing Unit), a storage unit, and an interface. The storage unit may be composed of, for example, ROM (Read Only Memory), RAM (Random Access Memory), or EEPROM (Electrically Erasable Programmable Read-Only Memory). In the ECU 10, various functions are implemented, for example, by using the CPU to execute programs stored in the storage unit. The ECU 10 may also be composed of multiple electronic units.

[0025] The display control device 100, as a structure connected to the ECU 10, includes an illuminance sensor 1 (vehicle sensor), a camera 2 (vehicle sensor), a rain sensor 3 (vehicle sensor), a temperature sensor 4 (vehicle sensor), and an HMI 20.

[0026] Illuminance sensor 1 is a detection device for detecting the illuminance around a vehicle. The illuminance around a vehicle refers to the illuminance used to automatically turn the vehicle's lights on or off. Illuminance sensor 1 is, for example, positioned on the front wall of the passenger compartment below the windshield inside the vehicle. The location of illuminance sensor 1 is not limited to the front of the vehicle. It can also be positioned on the side of the vehicle, the rear of the vehicle, or on the exterior of the vehicle. Illuminance sensor 1 can also be a known structure using light detection elements such as photodiodes or phototransistors. Illuminance sensor 1 sends an illuminance-related detection signal to ECU 10.

[0027] Camera 2 is a recording device that captures images of the vehicle's surroundings and at least one of the occupants inside the vehicle. Camera 2 may, for example, include an exterior camera mounted on the back of an interior rearview mirror (interior rearview mirror) on the side behind the vehicle's windshield to capture images of the area in front of the vehicle. Camera 2 may also include an interior camera mounted on the vehicle's central dashboard to capture images of occupants seated in the vehicle. Camera 2 may also send images of the area in front of the vehicle and images related to the occupants seated in the vehicle to ECU 10.

[0028] The raindrop sensor 3 is a detection device for detecting raindrops adhering to the glass of a vehicle. The raindrop sensor 3 is, for example, located on the inside of the windshield. The raindrop sensor 3 can detect the presence or amount of raindrops. The raindrop sensor 3 can also be a known structure such as an optical or capacitive type. The raindrop sensor 3 sends the detection result related to the presence or amount of raindrops to the ECU 10.

[0029] Temperature sensor 4 is a detection device for detecting the temperature inside and outside the vehicle. Temperature sensor 4 can also be a known structure used for controlling the air conditioning. Temperature sensor 4 sends the detection result related to the detected temperature to ECU 10.

[0030] HMI 20 is an interface for inputting and outputting information between ECU 10 and the occupants. HMI 20 includes, for example, a display control unit 21 installed in the passenger compartment and speakers. That is, the display control unit 21 is mounted on the vehicle. HMI 20 implements image output from the display control unit 21 and voice output from the speakers based on control signals from ECU 10. The display control unit 21 is configured, for example, as a touch panel. The display control unit 21 can be a central display or a navigation display.

[0031] The display operation unit 21 displays information to the vehicle occupants and accepts their operations. The display operation unit 21 is configured to display a function selection screen and multiple function operation screens. The function selection screen is a screen located at a higher level than the multiple function operation screens. The function selection screen includes links that allow users to switch between each of the multiple function operation screens based on their operations. The function operation screens are screens that correspond to each of the vehicle's predetermined functions. Each function operation screen contains an operation image for changing the operational state of that function through operations performed by the occupants. The display operation unit 21 is operated by selecting the operation image performed by the occupants. Selecting the operation image can be, for example, a touch operation of a software switch displayed on the display operation unit 21, i.e., a touch operation of the operation image.

[0032] The ECU10 has a function control unit 11 and a display control unit 12 as a functional structure.

[0033] The function control unit 11 controls predetermined functions of the vehicle based on detection results from onboard sensors or operations performed by occupants. For example, the function control unit 11 controls predetermined functions based on detection results received from at least one of the following: illuminance sensor 1, camera 2, raindrop sensor 3, and temperature sensor 4, or operations performed by occupants.

[0034] The pre-defined functions and operating states are explained. The automatic lighting function automatically turns on or off the lights, including the headlights, based on the ambient light level around the vehicle. The automatic high beam function automatically switches the headlight beam distribution (high beam or low beam) based on the conditions ahead of the vehicle. Here, automatic high beam refers not only to switching between high and low beams but also to adaptive high beam functionality that can change the beam distribution within the high beam.

[0035] The automatic windshield wiper function automatically activates or deactivates the windshield wipers based on the adhesion of raindrops to the windshield. Wiper activation or deactivation may also include adjusting the wiper speed. The automatic seat function automatically adjusts the seat position and backrest angle based on the occupant's position in the vehicle. The automatic climate control function automatically adjusts the set temperature and fan speed of the vehicle's air conditioning system based on ambient light levels and the interior and exterior temperatures.

[0036] The predetermined function's operating states include an automatic state, where the function's operation can be automatically changed based on the detection results of onboard sensors, and a manual state, where the function's operation is controlled by the occupant's actions. The automatic and manual states are switched by the occupant's operation of the display control unit.

[0037] For example, when the predetermined function is automatic lighting, the automatic state is an operation state in which the lights, including the headlights, are automatically turned on or off based on the detection results of the on-board illuminance sensor 1. When the predetermined function is automatic lighting, the manual state is an operation state in which the lights, including the headlights, are turned on or off by the operation of the display control unit performed by the occupant.

[0038] For example, when the predetermined function is automatic high beam, the automatic state is an operation state in which the headlight beam distribution is automatically changed based on the situation in front of the vehicle as identified by camera 2. When the predetermined function is automatic high beam, the manual state is an operation state in which the headlight beam distribution is changed by the operation of the display control unit performed by the occupant.

[0039] For example, when the predetermined function is automatic wiper function, the automatic state is an operation state in which the windshield wipers automatically activate or deactivate based on the adhesion status of raindrops to the windshield detected by the raindrop sensor 3. When the predetermined function is automatic wiper function, the manual state is an operation state in which the windshield wipers activate or deactivate by operation of the display control unit performed by the occupant.

[0040] For example, if the intended function is an automatic seat function, the automatic state is an operation state in which the seat position and backrest angle settings are automatically changed based on the occupant identified by the camera 2 as being seated in the vehicle. If the intended function is an automatic seat function, the manual state is an operation state in which the seat position and backrest angle settings are changed by the occupant through operation of the display control unit.

[0041] For example, when the predetermined function is automatic air conditioning, the automatic mode is an operation state in which the set temperature and airflow of the air conditioning unit in the vehicle are automatically changed based on the ambient illuminance of the vehicle and the interior and exterior temperatures of the vehicle, as identified by the illuminance sensor 1 and the temperature sensor 4. When the predetermined function is automatic air conditioning, the manual mode is an operation state in which the set temperature and airflow of the air conditioning unit in the vehicle are changed by the occupant through operation of the display control unit.

[0042] The vehicle here may also lack a physical switch (such as a headlight switch or wiper switch) for switching between automatic and manual modes. In other words, the intended function, besides being operated by the occupant in manual mode via a software switch on the display control unit, can also be achieved through various known controls. Examples of these known controls include, for instance, the processing itself used to perform the intended function.

[0043] The predetermined function's operating state can also include a non-automatic state where the function's operation does not automatically change based on the detection results of the on-board sensors in the event of an anomaly.

[0044] When the predetermined function is automatic lighting, the non-automatic state is an operation state in which, if there is an abnormality in the illuminance sensor 1, the lighting fixture will not automatically change its on or off state based on the detection result of the illuminance sensor 1. If an abnormality occurs in the illuminance sensor 1 when the automatic lighting function is in the automatic state, the function control unit 11 will switch the operation state of the automatic lighting function from the automatic state to the non-automatic state.

[0045] When the predetermined function is automatic high beam, the non-automatic state is an operation state in which the headlight beam distribution does not automatically change according to the image captured by the camera 2 if there is an abnormality in the camera 2 itself or if the image captured by the camera 2 is unclear and the situation in front of the vehicle cannot be identified. When the automatic high beam function is in operation state in which there is an abnormality in the camera 2 or if the image captured by the camera 2 is unclear and the situation in front of the vehicle cannot be identified, the function control unit 11 switches the operation state of the automatic high beam function from automatic state to non-automatic state.

[0046] When the intended function is automatic wiper, the non-automatic state is a state in which, if there is an anomaly in the rain sensor 3, the windshield wipers will not operate or will stop automatically changing based on the detection result of the rain sensor 3. If an anomaly occurs in the rain sensor 3 when the automatic wiper function is in automatic mode, the function control unit 11 switches the automatic wiper function's operating state from automatic mode to non-automatic mode.

[0047] When the intended function is automatic seat function, the non-automatic state is an operation state in which the seat position and backrest angle are not automatically changed based on the image captured by camera 2 if there is an abnormality in camera 2 itself or if the image captured by camera 2 is unclear and cannot identify the occupant sitting in the vehicle seat. If an abnormality occurs in camera 2 when the automatic seat function is in automatic mode, or if the image captured by camera 2 is unclear and cannot identify the occupant sitting in the vehicle seat, the function control unit 11 switches the operation state of the automatic seat function from automatic mode to non-automatic mode.

[0048] When the intended function is automatic air conditioning, the non-automatic state means that if there is an anomaly in the illuminance sensor 1 or the temperature sensor 4, the set temperature and airflow of the air conditioning unit in the vehicle will not be automatically changed according to the detection results of the illuminance sensor 1 and the temperature sensor 4. If there is an anomaly in the illuminance sensor 1 or the temperature sensor 4 when the automatic air conditioning function is in automatic mode, the function control unit 11 will switch the automatic air conditioning function from automatic mode to non-automatic mode.

[0049] The display control unit 12 controls the display operation unit 21 based on the operation state of a predetermined function. The display control unit 12 controls the display content displayed on the screen of the display operation unit 21 based on the control result of the predetermined function implemented by the function control unit 11.

[0050] When the operating state of a function changes without being based on an operation performed by the occupant, the display control unit 12 controls the display operation unit 21 to display a function operation screen. The function operation screen is an operation screen for functions whose operating state changes without being based on an operation performed by the occupant, and for changing the operating state of that function through an operation performed by the occupant.

[0051] As an example, when the operational state of a function changes without being based on an operation performed by the occupant while the vehicle is in motion, the display control unit 12 controls the display operation unit 21 to display a function operation screen containing an operation image. The operation image refers to an image of a software switch whose operational state changes without being based on an operation performed by the occupant, and whose operational state changes through an operation performed by the occupant. Furthermore, in the condition of "the operational state of a function changes without being based on an operation performed by the occupant while the vehicle is in motion," the vehicle being in motion is not necessarily required.

[0052] The display control unit 12 serves as the top-level screen (home screen) for implementing settings related to predetermined functions, while the display operation unit 21 displays a function selection screen. The top-level screen refers to the screen that is above all other function operation screens in the hierarchical structure of multiple images displayed by the display operation unit 21. The multiple function operation screens are images displayed by the display operation unit 21 for implementing settings related to multiple predetermined functions. The function selection screen is an image displayed by the display operation unit 21 for selecting the function from among the multiple predetermined functions to which the settings are to be implemented.

[0053] Figure 2 This is a summary diagram illustrating the function selection screen. (Example) Figure 2 As shown, function selection screen 30 is an example of a screen displayed on display operation unit 21. Function selection screen 30 includes links for switching to multiple function operation screens 40, 50. Specifically, in Figure 2 In the example, the function selection screen 30 displays a function link image 31 that leads to the function operation screen 40 related to the automatic lighting function, a function link image 32 that leads to the function operation screen 50 related to the automatic wiper function, and a function link image 33 that leads to the function operation screen related to the automatic seat function.

[0054] The display operation unit 21 displays the corresponding function operation screen 40 by having the occupant touch the function link image 31. The display operation unit 21 also displays the corresponding function operation screen 50 by having the occupant touch the function link image 32. Furthermore, the display operation unit 21 displays function operation screens related to the automatic seat function by having the occupant touch the function link image 33.

[0055] Figure 3 This is a schematic diagram illustrating a function operation screen corresponding to lighting control. Function operation screen 40 is an example of a screen used to perform setting operations related to the control of lighting fixtures, including automatic lighting function (lighting control) and automatic high beam function. Function operation screen 40 includes manual headlight operation image 41, automatic headlight operation image 42, and manual parking light operation image 43.

[0056] The manual headlight operation image 41 is an operation image used to set the automatic lighting function and the automatic high beam function to manual mode. For example, if either the automatic lighting function or the automatic high beam function is in automatic mode, the operation state of the automatic lighting function and the automatic high beam function can be changed to manual mode by the occupant touching the manual headlight operation image 41. For example, each time the occupant touches the manual headlight operation image 41, the headlights are switched on or off. In other words, the function operation screen 40 is a function operation screen used to change the operation state of the automatic lighting function and the automatic high beam function through operations performed by the occupant.

[0057] The automatic headlight operation image 42 is an operation image used to set the automatic lighting function and automatic high beam function to automatic mode. If there are no abnormalities in the illuminance sensor 1 and the camera 2, and the automatic lighting function and automatic high beam function are in manual mode, the occupant can touch the automatic headlight operation image 42 to change the operation status of the automatic lighting function and automatic high beam function to automatic mode.

[0058] The manual parking light operation image 43 is an operation image used to set the automatic lighting function and automatic high beam function to manual mode. For example, when the automatic lighting function is in automatic mode, the occupant touches the manual parking light operation image 43 to change the operation status of the automatic lighting function and automatic high beam function to manual mode, and the headlights are turned off. Alternatively, when the automatic lighting function is in automatic mode, the occupant touches the manual parking light operation image 43 to change the operation status of the automatic lighting function and automatic high beam function to manual mode, and the headlights are set to daytime running light mode. It can also be configured such that whenever the occupant touches the manual parking light operation image 43, the side and rear side lights of the vehicle are switched on or off when the headlights are off or in daytime running light mode. In this case, the function operation screen 40 is also a function operation screen used to change the operation status of the automatic lighting function and automatic high beam function through operations performed by the occupant.

[0059] Figure 4 This is a schematic diagram illustrating a function operation screen corresponding to wiper control. Function operation screen 50 is an example of a screen used to perform setting operations related to the automatic wiper function. Function operation screen 50 includes a manual wiper stop operation image 51, an automatic wiper operation image 52, a manual low-speed wiper operation image 53, and a manual high-speed wiper operation image 54.

[0060] The manual wiper stop operation image 51 is an operation image used to set the automatic wiper function to manual mode. For example, when the automatic wiper function is in automatic mode, by touching the manual wiper stop operation image 51, the operation state of the automatic wiper function is changed to manual mode, and the wipers are stopped. In other words, the function operation screen 50 is a function operation screen used to change the operation state of the automatic wiper function through an operation performed by the passenger.

[0061] The automatic wiper operation image 52 is an operation image used to set the automatic wiper function to automatic mode. If there is no abnormality in the rain sensor 3, and the automatic wiper function is in manual mode, the passenger can change the automatic wiper function to automatic mode by touching the automatic wiper operation image 52.

[0062] The manual low-speed wiper operation image 53 is an operation image used to set the automatic wiper function to manual mode. For example, when the automatic wiper function is in automatic mode, the occupant can touch the manual low-speed wiper operation image 53 to change the automatic wiper function to manual mode and make the wipers operate in LO mode.

[0063] The manual high-speed wiper operation image 54 is an operation image used to set the automatic wiper function to manual mode. For example, when the automatic wiper function is in automatic mode, the occupant can touch the manual high-speed wiper operation image 54 to change the automatic wiper function to manual mode and make the wipers operate in HI mode.

[0064] LO mode operates the wipers at a low speed among several preset wiper speed settings. HI mode operates the wipers at a high speed among several preset wiper speed settings. In these cases, the function operation screen 50 also functions to change the operating state of the automatic wipers through operation performed by the occupant.

[0065] exist Figure 2 In the example, the function operation screen related to the automatic seat function, which transitions from the function selection screen 30 to the automatic seat function via a touch operation of the function link image 33 by an occupant, can also be configured in the same manner as the function operation screens 40 and 50. In this case, the function operation screen related to the automatic seat function is a function operation screen used to change the operating state of the automatic seat function through an operation performed by the occupant. Similarly, the function selection screen may also include a function link image that transitions to the function operation screen related to the automatic air conditioning function via a touch operation by an occupant. In this case, the function operation screen related to the automatic air conditioning function is a function operation screen used to change the operating state of the automatic air conditioning function through an operation performed by the occupant.

[0066] Here, we envision a scenario where an onboard sensor malfunctions, causing the predetermined function's operation to change from automatic to non-automatic. In this case, the actions of the predetermined function acquired in automatic mode may be lost due to the change to non-automatic mode. For example, if the predetermined function is automatic lighting, we can consider a situation where, while the vehicle is traveling at night or in a tunnel, the lights change from automatic to non-automatic mode, causing them to turn off. In such a situation, by quickly switching to manual mode, the lights can be turned on as soon as possible using an operation performed by the occupant. However, if we assume that the occupant needs to perform a series of operations, such as touching the function link image 31 to bring up the function operation screen 40 after displaying the function selection screen 30, the effort and time required to switch to manual mode tend to increase.

[0067] Therefore, when the operating state of a function changes without being based on an operation performed by the occupant, the display control unit 12 controls the display operation unit 21 to display the function operation screen corresponding to that function. "The operating state of a function changes without being based on an operation performed by the occupant" includes situations where the operating state changes from one of automatic, manual, or non-automatic states to any other state, without being based on an operation performed by the occupant. For example, it could also be a situation where the operating state automatically changes from automatic to non-automatic because an onboard sensor changes from a state without an abnormality to a state with an abnormality.

[0068] For example, when the automatic lighting function's operating state is switched from automatic to non-automatic, the display control unit 12 controls the display operation unit 21 to display the function operation screen 40 used to switch the automatic lighting function's operating state to manual. In other words, when the automatic lighting function's operating state switches from automatic to non-automatic without being based on an operation performed by the occupant, a screen different from the automatic lighting function's function operation screen 40 is displayed on the display operation unit 21. Therefore, even if a screen other than the function operation screen 40 is displayed on the display operation unit 21 when the automatic lighting function is about to switch from automatic to non-automatic, the function operation screen 40 will still be displayed on the display operation unit 21 after the switch to non-automatic. This allows the occupant to touch-operate the manual headlight operation image 41 without having to retrieve the function operation screen 40. As a result, the system can quickly switch to manual mode, allowing the lights to be turned on as soon as possible. Examples of screens other than the function operation screen 40 include, for example, a navigation screen or a function selection screen 30.

[0069] Similarly, for example, it can be configured such that when the automatic high beam function's operating state is switched from automatic to non-automatic, the display control unit 12 controls the display operation unit 21 to display the function operation screen 40 for switching the automatic high beam function's operating state to manual. Thus, even if a screen other than the function operation screen 40 is displayed on the display operation unit 21 when the automatic high beam function is about to switch from automatic to non-automatic, the function operation screen 40 will still be displayed on the display operation unit 21 after the switch to non-automatic. Alternatively, it can be configured such that when the automatic wiper function's operating state is switched from automatic to non-automatic, the display control unit 12 controls the display operation unit 21 to display the function operation screen 50 for switching the automatic wiper function's operating state to manual. Thus, even if a screen other than the function operation screen 50 is displayed on the display operation unit 21 when the automatic wiper function is about to switch from automatic to non-automatic, the function operation screen 50 will still be displayed on the display operation unit 21 after the switch to non-automatic. Alternatively, when the automatic seat function's operating state is switched from automatic to non-automatic, the display control unit 12 controls the display operation unit 21 to display a function operation screen for switching the automatic seat function's operating state to manual. Therefore, even if a screen other than the function operation screen for switching the automatic seat function's operating state to manual is displayed on the display operation unit 21 when the automatic seat function's operating state is about to switch from automatic to non-automatic, the function operation screen for switching the automatic seat function's operating state to manual will still be displayed on the display operation unit 21 after the switch to non-automatic.

[0070] Furthermore, "the situation where the function's operating state changes without being based on an operation performed by the occupant" can also include situations where, even when there are no anomalies in the onboard sensors and the function's operating state is automatic, the function's operation automatically changes based on changes in the onboard sensor's detection results. In the case of a predetermined function like automatic lighting, the function's operation is "turning the lights on or off." For example, "the situation where the function's operating state changes without being based on an operation performed by the occupant" includes situations where, even when there are no anomalies in the illuminance sensor 1 and the operating state is automatic, the lighting automatically switches between on and off based on changes in illuminance detected by the illuminance sensor 1. In other words, the automatic state can also be described as "a state where the function's operating state can change without being based on an operation performed by the occupant."

[0071] For example, the illuminance of light primarily from the front of the vehicle, as visually perceived by the occupant, may sometimes differ from the illuminance of light primarily from above the vehicle detected by illuminance sensor 1. In such cases, even in automatic mode, the operation of the automatic lighting function may cause discomfort to the occupant. Therefore, even such a change in the operation of the automatic function can be treated as a "case where the operating state of the function changes without being based on an operation performed by the occupant."

[0072] For example, it can be configured such that, when the automatic lighting function is in automatic mode and the lamps automatically switch from off to on based on changes in illuminance detected by the illuminance sensor 1, the display control unit 12 controls the display operation unit 21 to display the function operation screen 40 for switching the automatic lighting function to manual mode. In this case, for example, an occupant visually confirming the light mainly coming from the front of the vehicle may feel that the illuminance is sufficient even without turning on the headlights. Even in such cases, by having the occupant touch the manual headlight operation image 41 or the manual marker light operation image 43 without having to access the function operation screen 40, the headlights that were turned on at a time different from the occupant's perception can be turned off. Similarly, even if the headlights automatically turn off when the occupant feels that the headlights should be on, the headlights that were turned off at a time different from the occupant's perception can be turned on.

[0073] Next, refer to Figures 5 to 7 The flowchart is used to explain the processing of the ECU 10 in the display control device 100 and the control method of the display control device. Figure 5 The flowchart processing is, for example, repeatedly executed according to a predetermined calculation cycle when the power to the vehicle's ECU10 is on. Figure 5 Steps S11 to S16 correspond to the function control steps. Figure 6 Steps S21 to S25 correspond to the display control steps. Figure 7 In this process, steps S21, S22A, and S23 to S25 correspond to the display control steps. For example, in a certain operation cycle, when passing through... Figure 5 After the flowchart processing determines the action state of the function, execution... Figure 6 or Figure 7 The processing of flowcharts. Figure 5 Flowchart processing and Figure 6 or Figure 7 The processing of flowcharts can also be performed in parallel. Figures 5 to 7 The flowchart processing can also be performed according to each predetermined function.

[0074] like Figure 5 As shown, in step S11, the ECU 10 uses the function control unit 11 to determine whether there is an operation that changes the function's operating state through an action performed by the occupant. For example, if there is an operation to touch the manual headlight operation image 41 or the manual parking light operation image 43 on the function operation screen 40 (an operation to set to manual mode), the function control unit 11 determines that there is an operation that changes the function's operating state through an action performed by the occupant. For example, if there is an operation to touch the automatic headlight operation image 42 on the function operation screen 40 (an operation to set to automatic mode), or if there is no operation to set to manual mode when the function's operating state is already automatic, the function control unit 11 determines that there is no operation that changes the function's operating state through an action performed by the occupant.

[0075] When the function control unit 11 determines that an operation is needed to change the function's operating state by an action performed by the occupant (step S11: Yes), the ECU 10 proceeds to step S12. In step S12, the ECU 10 sets the function's operating state to manual mode via the function control unit 11. Afterwards, the ECU 10 terminates. Figure 5 The processing.

[0076] On the other hand, if the function control unit 11 determines that there is no operation to change the operating state of the function by means of an operation performed by the occupant (step S11: No), the ECU 10 proceeds to step S13. In step S13, the ECU 10 performs diagnostics on the vehicle sensors through the function control unit 11. The function control unit 11 can perform diagnostics on the vehicle sensors using known diagnostic methods.

[0077] In step S14, the ECU 10 determines whether the vehicle sensors are functioning correctly via the function control unit 11. If the function control unit 11 determines that the vehicle sensors are functioning correctly (step S14: Yes), the ECU 10 proceeds to step S15. In step S15, the ECU 10 sets the function's operating state to automatic (a state where the function's operating state can change without being based on actions performed by the occupant) via the function control unit 11. Afterward, the ECU 10 terminates the process. Figure 5 The processing.

[0078] On the other hand, if the function control unit 11 determines that there is an anomaly in the vehicle sensor (step S14: No), the ECU 10 proceeds to step S16. In step S16, the ECU 10 sets the operation state to a non-automatic state via the function control unit 11. Afterward, the ECU 10 terminates. Figure 5 The processing.

[0079] like Figure 6 As shown, in step S21, the ECU 10 identifies the operating state through the display control unit 12. The display control unit 12 identifies the operating state based on the... Figure 5 The function control unit 11 determines the operation state of a predetermined function through processing. For example, the display control unit 12 identifies the operation state of an automatic lighting function as an automatic state.

[0080] In step S22, the ECU 10 determines, via the display control unit 12, whether the operating state has changed from an automatic state to a non-automatic state without being based on an operation performed by the occupant. The display control unit 12, for example, in... Figure 5 When a vehicle-mounted sensor that was previously functioning normally malfunctions malfunctions, the system determines that the function's operating state has changed from automatic to non-automatic, based on the change in operating state from automatic to non-automatic, as determined by the function control unit 11. This indicates that the operating state has changed from automatic to non-automatic without being based on any operation performed by the occupant. Figure 5 In the processing, if the state of no abnormality in the vehicle sensors continues, the display control unit 12 determines that the operation state has not changed from automatic to non-automatic without being based on the operation performed by the occupant, based on the fact that the operation state of the function determined by the function control unit 11 continues in automatic or manual mode. Alternatively, in Figure 5 In the processing, when an abnormal state persists in the vehicle sensor, the display control unit 12 determines that the operation state has not changed from automatic to non-automatic without being based on the operation performed by the occupant, based on the fact that the operation state of the function determined by the function control unit 11 continues in a non-automatic state.

[0081] If the display control unit 12 determines that the operating state has changed from automatic to non-automatic without being based on an operation performed by the occupant (step S22: Yes), the ECU 10 proceeds to step S23. In step S23, the ECU 10 reads a function operation screen containing operation images via the display control unit 12. The display control unit 12 reads, for example, a function operation screen 40 containing manual headlight operation image 41 and manual marker light operation image 43. In step S24, the ECU 10 controls the display operation unit 21 via the display control unit 12 to display a function operation screen corresponding to the function whose operating state has changed. The display control unit 12 controls the display operation unit 21, for example, to display a function operation screen 40 corresponding to the automatic lighting function whose operating state has changed. In other words, when a different screen than the function operation screen of the first function (e.g., automatic lighting function) whose operating state changes without being based on an operation performed by the occupant is displayed on the display operation unit 21, the display control unit 12 controls the display operation unit 21 to display the function operation screen corresponding to the first function whose operating state has changed. Afterwards, the ECU 10 terminates. Figure 6 The processing.

[0082] On the other hand, if the display control unit 12 determines that the operating state has not changed from automatic to non-automatic without the occupant's intervention (step S22: No), the ECU 10 proceeds to step S25. In step S25, the ECU 10 controls the display operation unit 21 via the display control unit 12 to maintain the display. Even when a screen other than the function operation screen 40, such as a navigation screen or a function selection screen 30, is displayed, the display control unit 12 can still control the display operation unit 21 to maintain the display. Afterwards, the ECU 10 terminates. Figure 6 The processing.

[0083] Incidentally, Figure 6 The "action state changes from automatic to non-automatic" process in S22 of the flowchart is not a necessary step. For example, as... Figure 7As shown, instead of step S22, step S22A can be performed whereby the ECU 10 determines, via the display control unit 12, whether the operating state has changed without being based on an operation performed by the occupant. In step S22A, if the operating state changes from one of automatic, manual, or non-automatic states to any other state without being based on an operation performed by the occupant, the display control unit 12 can determine that the operating state has changed without being based on an operation performed by the occupant. Alternatively, if the automatic lighting function is in automatic mode and the lamp automatically switches from off to on based on a change in illuminance detected by the illuminance sensor 1, the display control unit 12 can also determine that the operating state has changed without being based on an operation performed by the occupant.

[0084] [Display Control Program] The display control program enables the ECU10 (computer, processor) to function as the function control unit 11 and display control unit 12 described above. The display control program can be provided via a non-transitory recording medium such as ROM or semiconductor memory. The display control program can also be provided via communication such as a network.

[0085] As explained above, in the display control device 100, the control method of the display control device, and the display control program, when the operating state of a function changes without being based on an operation performed by the occupant, the display operation unit 21 is controlled to display the function operation screen 40 and function operation screen 50, which are used to change the operating state of the function through an operation performed by the occupant. Therefore, the occupant does not need to perform an operation on the display operation unit 21 to bring up the function operation screens 40 and 50 in order to change the operating state of the function to the desired state. Thus, even if the operating state changes automatically without being based on an operation performed by the occupant and is not in accordance with the occupant's intention, the occupant can quickly and easily perform an operation to change the operating state of the function.

[0086] The intended function is an automatic lighting function that turns the vehicle's lights, including headlights, on or off. The automatic lighting function has three operating states: automatic, non-automatic, and manual. The automatic state automatically changes the lighting based on the detection results of the onboard illuminance sensor 1. The non-automatic state does not automatically change the lighting based on the illuminance sensor 1's detection results if there is an anomaly. The manual state is where the lighting is changed by operation performed by the occupant. When an anomaly occurs in the illuminance sensor 1, the function control unit 11 switches the automatic lighting function's operating state from automatic to non-automatic. When the automatic lighting function's operating state is switched from automatic to non-automatic, the display control unit 12 controls the display operation unit 21 to display the function operation screen 40 for switching the automatic lighting function's operating state to manual. Therefore, even if an malfunction occurs in the illuminance sensor 1 and the automatic lighting function is automatically switched from automatic to non-automatic, the occupant can quickly and easily switch the automatic lighting function back to manual mode.

[0087] The display control unit 12 is configured to display multiple function operation screens 40, 50 and a function selection screen 30, each corresponding to a different function of the vehicle, on the display operation unit 21. The function selection screen 30, at a higher level than the multiple function operation screens 40, 50, includes function link images 31, 32 that transition to each of the multiple function operation screens 40, 50. When the operating state of a function changes without being based on an operation performed by the occupant, the display control unit 12 controls the display operation unit 21 to display any one of the function operation screens 40, 50 corresponding to that function. Thus, for example, even if the function selection screen 30 is displayed on the display operation unit 21 when the operating state of a function is about to change automatically without being based on an operation performed by the occupant, it can automatically transition to the function operation screen 40, 50 for that function without any touch operation on the function link images 31, 32 in the function selection screen 30.

[0088] While the embodiments of this disclosure have been described above, this disclosure is not limited to the above embodiments.

[0089] Although the number of predetermined functions is two or more in the above embodiments, the number of predetermined functions may also be one.

[0090] Although the above embodiments describe a single function operation screen corresponding to one predetermined function, this is not limited to this example. A single function operation screen may also correspond to multiple predetermined functions.

[0091] Although in the above embodiments, in Figure 5 In steps S13 and S14, the function control unit 11 diagnoses and determines whether there are any abnormalities in the vehicle sensors, but this is not limited to this example. For example, in Figure 5 In steps S13 and S14, regarding the automatic high beam function, the function control unit 11 can also determine whether the situation in front of the vehicle is unclear due to the image captured by the camera 2.

[0092] Although in the above embodiments, such as Figure 5 As shown, the change in the function's operating state is a change from one of the automatic, manual, and non-automatic states to any of the others, but this is not limited to this example. It is also possible to omit one of the automatic, manual, and non-automatic states, and instead change between the remaining two states. For example, the change in the function's operating state could also omit the non-automatic state, and instead change between the automatic and manual states. In this case, it could also be omitted. Figure 5 Steps S13, S14, and S16. Alternatively, the change in the function's action state can omit the manual state and instead change between the automatic and non-automatic states. In this case, it can also be omitted. Figure 5 Steps S11 and S12.

[0093] While the function operation screen includes operation images in the above embodiments, it may also omit them. For example, in the function operation screen 40, a software switch could be used instead of the manual headlight operation image 41 and the manual side marker light operation image 43, and the same function as the manual headlight operation image 41 and the manual side marker light operation image 43 could be implemented by voice recognition of the occupant's voice. In this case, for example, by inputting the occupant's voice, such as "Please turn on the headlights," obtained through a microphone to the ECU 10, and having the ECU 10 perform voice recognition, the automatic lighting function's operation state could be switched to manual mode, and the headlights could be turned on. Touch operation and operation other than voice recognition could also be used. In short, as long as the function's operation state does not change based on the occupant's operation, the function operation screen is displayed on the display operation unit 21, it is sufficient.

[0094] Furthermore, the structural elements of various embodiments of this disclosure are described below. [1] The display control device includes: The display and control unit is mounted on the vehicle and displays information to the occupants of the vehicle and controls the operations performed by the occupants. The function control unit controls the predetermined functions of the vehicle based on the detection results of on-board sensors or the operations performed by the occupants. The display control unit controls the display operation unit based on the operating state of the aforementioned function. If the operating state of the function changes without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display a function operation screen for changing the operating state of the function through an operation performed by the occupant. [2] As described in [1], the display control device, wherein, If the operating state of the function changes during the operation of the vehicle without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display the function operation screen, which includes an operation image for changing the operating state of the function through an operation performed by the occupant. [3] As described in [1] or [2], the display control device, wherein, The function is to control the vehicle's lights, including the headlights, to turn on or off. The operating states include automatic, non-automatic, and manual states. The automatic state is where the lights automatically turn on or off based on the detection results of the onboard illuminance sensor. The non-automatic state is where, in the event of an anomaly in the illuminance sensor, the lights do not automatically turn on or off based on the sensor's detection results. The manual state is where the lights turn on or off through actions performed by the occupant. In the event of an anomaly in the illuminance sensor, the function control unit switches the operation state of the light control from the automatic state to the non-automatic state. When the operation state of the light control changes from the automatic state to the non-automatic state, the display control unit controls the display operation unit to display the function operation screen for switching the operation state of the light control to the manual state. [4] The display control device described in any of [1] to [3], wherein, The display control unit is configured to display a plurality of function operation screens and a function selection screen corresponding to each of the plurality of functions possessed by the vehicle on the display operation unit, wherein the function selection screen includes links for switching to each of the plurality of function operation screens at a higher level than the plurality of function operation screens. If the operating state of the function changes without being based on the operation performed by the occupant, the display control unit controls the display operation unit to display the function operation screen corresponding to the function. [5] In the control method of the display control device, the display control device controls a display operation unit, which is mounted on a vehicle and displays information to the occupants of the vehicle and is subject to operations performed by the occupants. The control method of the display control device includes: The function control steps involve controlling predetermined functions of the vehicle through the display control device and based on the detection results of on-board sensors or the operations performed by the occupants. The display control steps involve controlling the display operation unit via the display control device based on the operational state of the function. In the display control step, if the operation state of the function changes without being based on the operation performed by the occupant due to the function control step, the display operation unit is controlled to display a function operation screen for changing the operation state of the function through the operation performed by the occupant. [6] The display control program enables the computer to function as a display control device that controls a display operating unit mounted on a vehicle, which displays information to the occupants of the vehicle and is subject to operations performed by the occupants. The display control program enables the computer to function as a component of: The function control unit controls the predetermined functions of the vehicle based on the detection results of on-board sensors or the operations performed by the occupants. The display control unit controls the display operation unit based on the operating state of the aforementioned function. If the operating state of the function changes without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display a function operation screen for changing the operating state of the function through an operation performed by the occupant.

Claims

1. A display control device, comprising: A display control unit is mounted on a vehicle and displays information to the occupants of the vehicle, and is subject to operations performed by the occupants. The function control unit controls the predetermined functions of the vehicle based on the detection results of on-board sensors or the operations performed by the occupants. The display control unit controls the display operation unit based on the operating state of the aforementioned function. If the operating state of the function changes without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display a function operation screen for changing the operating state of the function through an operation performed by the occupant.

2. The display control device as described in claim 1, wherein, If the operating state of the function changes during the operation of the vehicle without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display the function operation screen, which includes an operation image for changing the operating state of the function through an operation performed by the occupant.

3. The display control device as described in claim 1 or 2, wherein, The function is to control the vehicle's lights, including the headlights, to turn on or off. The operating states include automatic, non-automatic, and manual states. The automatic state is where the lights automatically turn on or off based on the detection results of the onboard illuminance sensor. The non-automatic state is where, in the event of an malfunction in the illuminance sensor, the lights do not automatically turn on or off based on the sensor's detection results. The manual state is where the lights turn on or off manually by the occupant. In the event of an anomaly in the illuminance sensor, the function control unit switches the operation state of the light control from the automatic state to the non-automatic state. When the operation state of the light control is switched from the automatic state to the non-automatic state, the display control unit controls the display operation unit to display the function operation screen for switching the operation state of the light control to the manual state.

4. The display control device according to any one of claims 1 to 3, wherein, The display control unit is configured to display a plurality of function operation screens and a function selection screen corresponding to each of the plurality of functions possessed by the vehicle on the display operation unit, wherein the function selection screen includes links for switching to each of the plurality of function operation screens at a higher level than the plurality of function operation screens. If the operating state of the function changes without being based on the operation performed by the occupant, the display control unit controls the display operation unit to display the function operation screen corresponding to the function.

5. A control method for a display control device, wherein the display control device controls a display operation unit, the display operation unit being mounted on a vehicle and displaying information to occupants of the vehicle and subject to operations performed by the occupants, wherein... The control method of the display control device includes: The function control steps involve controlling predetermined functions of the vehicle through the display control device and based on the detection results of on-board sensors or the operations performed by the occupants. The display control steps involve controlling the display operation unit via the display control device based on the operational state of the function. If the operation state of the function changes without being based on the operation performed by the occupant through the function control step, the display operation unit is controlled in the display control step to display a function operation screen for changing the operation state of the function through the operation performed by the occupant.

6. A recording medium that is a non-transitory, computer-readable recording medium storing a display control program, the display control program enabling a computer to function as a display control device for controlling a display operation unit mounted on a vehicle and displaying information to and subject to operations performed by the occupants, wherein... The display control program enables the computer to function as a component of: The function control unit controls the predetermined functions of the vehicle based on the detection results of on-board sensors or the operations performed by the occupants. The display control unit controls the display operation unit based on the operating state of the aforementioned function. If the operating state of the function changes without being based on an operation performed by the occupant, the display control unit controls the display operation unit to display a function operation screen for changing the operating state of the function through an operation performed by the occupant.

Images