Display control device, display device, vehicle, method, and storage medium

Abstract

The present disclosure relates to a display control device, a display device, a vehicle, a method, and a storage medium. A display control device mounted in a vehicle includes a reception unit that receives information about dirt of a vehicle-mounted sensor mounted in the vehicle, and a control unit that controls display of a cleaning execution button displayed on a display device mounted in the vehicle, the cleaning execution button being used to execute cleaning of the vehicle-mounted sensor, on the basis of the information about the dirt received by the reception unit.

Description

Technical Field

[0001] This disclosure relates to display control devices, etc., installed in vehicles. Background Technology

[0002] Maintaining the detection performance of sensors, cameras, and other devices (hereinafter collectively referred to as "vehicle sensors") is crucial when implementing vehicle driving control such as driver assistance and autonomous driving.

[0003] Japanese Unexamined Patent Application Publication No. 2013-082358 (JP 2013-082358 A) discloses a vehicle cleaning device for cleaning vehicle-mounted cameras. The vehicle cleaning device displays images taken by the vehicle-mounted camera on a display screen, and also displays a touch panel switch (software switch) for cleaning the camera. Then, when the driver operates the touch panel switch, the vehicle cleaning device cleans the glass window of the vehicle-mounted camera. Summary of the Invention

[0004] However, according to the technology described in JP 2013-082358 A, a touch panel switch for camera cleaning is displayed when the vehicle is in rear-wheel drive mode. Therefore, the touch panel switch is displayed even when the onboard camera is only slightly dirty and does not require cleaning, which can be annoying to the user. Because the touch panel switch is always displayed when the vehicle is in rear-wheel drive mode, the user, such as the driver, needs to determine the necessity of cleaning based on the image taken by the onboard camera and displayed on the monitor.

[0005] This disclosure provides a display control device, etc., that enables the display of a software switch for performing cleaning of vehicle-mounted sensors to be turned on at a more appropriate time and in a more appropriate mode.

[0006] According to one aspect of this disclosure, a display control device installed in a vehicle includes a receiving unit and a control unit. The receiving unit is configured to receive information about dirt on an on-board sensor installed in the vehicle, and the control unit is configured to control the display of a cleaning execution button on a display device installed in the vehicle, based on the information about the dirt received by the receiving unit, the cleaning execution button being used to perform cleaning of the on-board sensor.

[0007] According to this disclosure, a display control device can be provided that enables the display to be switched on and off at a more appropriate time and in a more appropriate mode for performing cleaning of vehicle-mounted sensors. Attached Figure Description

[0008] The features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, wherein like reference numerals denote like elements, and wherein:

[0009] Figure 1 This is a schematic diagram of the functional blocks of a display control device and its peripheral parts according to one embodiment;

[0010] Figure 2A This is a diagram illustrating an example of a screen display on a display device;

[0011] Figure 2B This is a diagram illustrating an example of a screen display on a display device;

[0012] Figure 3 This is a flowchart of the first example of the cleaning execution button display control;

[0013] Figure 4 This is a second example of the processing flowchart for the cleaning execution button display control;

[0014] Figure 5 This is the third example of the processing flowchart for the cleaning execution button display control;

[0015] Figure 6 This is the fourth example of the processing flowchart for the cleaning execution button display control;

[0016] Figure 7A This is an example diagram showing a drawing of a prominent cleaning execution button;

[0017] Figure 7B This is an example diagram showing a drawing of a prominent cleaning execution button;

[0018] Figure 7C This is an example diagram showing a drawing of a prominent cleaning execution button;

[0019] Figure 7D This is an example diagram showing a drawing of a prominent cleaning execution button;

[0020] Figure 7E This is an example diagram showing a drawing of a prominent cleaning execution button;

[0021] Figure 7F This is an example diagram showing a drawing of a highlighted cleaning execution button; and

[0022] Figure 7G This is an example diagram showing a drawing of a prominent cleaning execution button. Detailed Implementation

[0023] The display control device installed in a vehicle according to this disclosure controls the display of a cleaning execution button on the display device based on the dirt status of onboard sensors. This allows the cleaning execution button for the onboard sensors to be displayed on the display device at a more appropriate time and in a more appropriate mode. An embodiment of this disclosure will be described in detail below with reference to the accompanying drawings.

[0024] Example

[0025] Configuration

[0026] Figure 1 This is a schematic diagram of the functional blocks of a display control device 100 and its peripheral portion according to an embodiment of the present disclosure. Figure 1 The functional blocks shown include an onboard sensor 11, a detection device 12, a display device 13, a cleaning device 14, and a display control device 100. The display control device 100 is communicatively connected to the detection device 12, the display device 13, and the cleaning device 14. Figure 1 In the middle, solid arrows indicate the direction of sending instructions, data, etc.

[0027] The vehicle sensor 11 is, for example, a camera installed in the vehicle. In this embodiment, the vehicle sensor 11 is a rearview monitoring camera installed in the trunk lid or tailgate at the rear of the vehicle to capture images of the area behind the vehicle. However, the vehicle sensor 11 is not limited to this, and can also be a camera that captures images of the area in front of the vehicle.

[0028] The detection device 12 is a device for detecting dirt on the vehicle-mounted sensor 11. The detection device 12 detects dirt on the lens of the vehicle-mounted sensor 11 (e.g., a vehicle-mounted camera) based on images captured by the vehicle-mounted sensor 11. For example, dirt on the vehicle-mounted sensor 11 can be detected based on brightness variations between adjacent pixels. For example, when the brightness difference between pixels is equal to or greater than a predetermined value, the detection device 12 can determine that there is dirt on the vehicle-mounted sensor 11. When dirt is present in a specific area or more areas of an image captured by the vehicle-mounted sensor 11, the detection device 12 can determine that there is dirt that needs cleaning. The detection device 12 can also determine the degree of dirt detected on the vehicle-mounted sensor 11. For example, when an area in the image where the brightness difference between adjacent pixels is equal to or greater than a predetermined value is equal to or greater than a first area (the aforementioned specific area) and less than a second area, the degree of dirt on the vehicle-mounted sensor 11 can be determined as "dirt level 1," and when that area is equal to or greater than the second area, it can be determined as "dirt level 2." The degree of dirt can be divided into three or more levels. When the detection device 12 determines that there is dirt on the vehicle sensor 11 that needs to be cleaned, it sends dirt detection information (including, if necessary, information about the degree of dirt, such as the dirt level) to the receiving unit 101 of the display control device 100 (described later). The detection device 12 may be integrated into the vehicle sensor 11 or may be installed separately from the vehicle sensor 11 in the vehicle.

[0029] The display control device 100 is installed in the vehicle and controls the display of the display device 13 based on dirt detection information about the on-board sensor 11. The display control device 100 also cleans the on-board sensor 11 based on user operation instructions to the display device 13 via the cleaning device 14. The display control device 100 includes at least a receiving unit 101, a control unit 102, and an indicating unit 103, and may further include a cleaning limit determination unit 104.

[0030] The receiving unit 101 is communicatively connected to the detection device 12 and receives dirt detection information from the detection device 12 regarding the vehicle-mounted sensor 11. The connection method between the receiving unit 101 and the detection device 12 is not limited to any particular one, but can be a wired connection or a wireless connection.

[0031] The cleaning restriction determination unit 104 determines whether the vehicle is in a state where cleaning of the on-board sensor 11 is prohibited by vehicle driving control, or whether the vehicle is in a state where the cleaning effect can be fully achieved. For example, the state where cleaning of the on-board sensor 11 is prohibited is when the on-board sensor 11 is being used while vehicle driving control is in progress, more specifically, when the vehicle is changing lanes or about to change lanes. For example, the state where the cleaning effect can be fully achieved is when the cleaning device 14 can fully clean the dirt attached to the on-board sensor 11, and due to the surrounding environment of the vehicle, the risk of dirt immediately adhering to the on-board sensor 11 after cleaning is very small. The method for determining whether the cleaning effect can be fully achieved is not limited to any specific method, but can be based on dirt detection information or image information captured by the on-board sensor 11, or can be based on sensing information from other on-board sensors. The state where cleaning of the on-board sensor 11 is prohibited and the state where the cleaning effect cannot be fully achieved will be referred to as the "cleaning restriction state". The cleaning restriction determination unit 104 can be omitted.

[0032] Based on the dirt detection information received by the receiving unit 101 from the detection device 12, the control unit 102 executes control for displaying the cleaning execution button on the display device 13 (display / non-display switching control) and control for highlighting it (display mode change control). The cleaning execution button is a button used to perform cleaning of the vehicle sensor 11 and is one of the software switches that can be selectively presented to the user via the display device 13. Therefore, the cleaning execution button can only be displayed and highlighted when the vehicle sensor 11 needs to be cleaned. However, it should be noted that the display control of the cleaning execution button is executed when the user has pre-allowed the display or highlighting of the cleaning execution button (when the cleaning SW display setting is on). On the other hand, when the display or highlighting of the cleaning execution button is not allowed (when the cleaning SW display setting is off), the control unit 102 does not execute the control for displaying and highlighting the cleaning execution button, even when the receiving unit 101 receives dirt detection information. When the cleaning limit determination unit 104 determines that the vehicle is in a cleaning limit state, the control unit 102 also does not execute the control for displaying and highlighting the cleaning execution button. Therefore, the cleaning execution button should only be displayed or highlighted when cleaning is feasible and can achieve sufficient cleaning results.

[0033] The indicator unit 103 is communicatively connected to the cleaning device 14 installed in the vehicle and instructs the cleaning device 14 to clean the vehicle sensor 11. Specifically, when it is detected that the user has selected the cleaning execution button displayed on the display screen of the display device 13, the indicator unit 103 instructs the cleaning device 14 to clean the vehicle sensor 11.

[0034] The display control device 100 described above may be composed, in whole or in part, of an electronic control unit (ECU), which typically includes a processor such as a microprocessor, memory, input / output interfaces, etc. By causing the processor to read and execute programs stored in the memory, the ECU can perform some or all of the functions performed by the receiving unit 101, the control unit 102, the indicating unit 103, and the cleaning limit determination unit 104.

[0035] Display device 13 is a human-machine interface (HMI) such as that of a car navigation system, installed in the vehicle and communicatively connected to display control device 100. The method of connecting display device 13 and display control device 100 is not limited to any particular method, but can, for example, use existing in-vehicle networks such as Controller Area Network (CAN). Figure 1 In this configuration, the display device 13 and the display control device 100 are configured separately, but the display device 13 can be configured to include the display control device 100.

[0036] When the display device 13 receives a display request from the control unit 102 of the display control device 100 to display the cleaning execution button, it displays the cleaning execution button on the display screen of the display device 13. Furthermore, when the display device 13 receives a highlight request from the control unit 102 of the display control device 100 to highlight the already displayed cleaning execution button, the display device 13 displays the cleaning execution button on the display screen of the display device 13 and simultaneously performs a predetermined highlighting operation on the button. The highlighting operation will be described later.

[0037] Figure 2A and Figure 2B These are diagrams illustrating an example of a screen display on display device 13. For example... Figure 2A and Figure 2B As shown, the cleaning execution button ( Figure 2A Text display switch 13a in the middle, Figure 2B The icon display switch 13b) can be overlaid on the image captured by the vehicle-mounted sensor 11. Figure 2A and Figure 2BIn the example, the wash execution button is displayed in the image captured by the camera used for rear-view monitoring. Using the image captured by the vehicle sensor 11 and the simultaneously displayed wash execution button, the user can determine the necessity of wash execution. If the wash SW display is enabled when the receiving unit 101 receives dirt detection information and the vehicle is not in a wash restriction state, the wash execution button can be displayed and highlighted even while the vehicle is in motion. When the vehicle sensor 11 is a rear-view monitoring camera, and assuming dirt detection information is received and the wash SW display is enabled, the wash execution button can be overlaid on the image captured by the vehicle sensor 11 or highlighted when the vehicle is in rear-drive mode.

[0038] The cleaning device 14 performs cleaning of the vehicle sensor 11 according to the instructions of the indicating unit 103. The cleaning device 14 includes, for example, a tank containing cleaning fluid, a pump that pumps the cleaning fluid from the tank, and a cleaning nozzle through which the pumped cleaning fluid is sprayed toward the vehicle sensor 11. For example, the pump is turned on and off during operation via a relay. The pump is connected to the cleaning nozzle via a hose, and the spray outlet of the cleaning nozzle is located near the vehicle sensor 11 in the rear of the vehicle. While the method of connecting the cleaning device 14 and the display control device 100 is not limited to any particular method, the cleaning device 14 and the display control device 100 are connected via an in-vehicle network such as Ethernet (registered trademark) or Low Voltage Differential Signaling (LVDS). In this embodiment, the cleaning device 14 is connected to the display control device 100 so that they can communicate directly with each other. However, for example, the cleaning device 14 may be connected to the display control device 100 via the detection device 12 or the vehicle sensor 11.

[0039] Control Processing

[0040] Further reference Figures 3 to 5 This section will describe some specific examples of the control performed by the display control device 100.

[0041] (1) First example

[0042] Figure 3 This is a flowchart illustrating a first example of the display control of the cleaning execution button performed by the various components of the display control device 100. The first example of control involves displaying the cleaning execution button on the display device 13 when the cleaning execution button is not displayed on the display device 13 and cleaning of the vehicle sensor 11 is desired. When the vehicle's ignition is turned on (IG-ON), the process begins according to... Figure 3 The first example shown displays the control of the cleaning execution button, and repeats this process until the ignition is turned off (IG-OFF).

[0043] In step S301, the cleaning restriction determination unit 104 determines whether the vehicle is in a cleaning restriction state. As described above, the cleaning restriction state is a state where cleaning of the vehicle sensor 11 is prohibited or the cleaning effect of the vehicle sensor 11 cannot be fully obtained. When the cleaning restriction determination unit 104 determines that the vehicle is not in a cleaning restriction state (step S301, No), the control proceeds to step S302. When the cleaning restriction determination unit 104 determines that the vehicle is in a cleaning restriction state (step S301, Yes), the determination operation of step S301 is repeated.

[0044] In step S302, the control unit 102 determines the state of the cleaning SW display setting as information regarding the possibility of displaying the cleaning execution button. That is, the control unit 102 determines whether the cleaning SW display setting indicates that the display device 13 is allowed to display the cleaning execution button as enabled or disabled. When the control unit 102 determines that the cleaning SW display setting is enabled (step S302, enabled), control proceeds to step S303. When the control unit 102 determines that the cleaning SW display setting is disabled (step S302, disabled), processing proceeds to step S301.

[0045] In step S303, the control unit 102 determines whether the receiving unit 101 has received dirt detection information from the detection device 12. The dirt detection information may not include information about the degree of dirtiness (e.g., dirt level). When the control unit 102 determines that the receiving unit 101 has received dirt detection information (step S303, Yes), control proceeds to step S304. When the control unit 102 determines that the receiving unit 101 has not received dirt detection information (step S303, No), control proceeds to step S301.

[0046] In step S304, the control unit 102 sends a request to the display device 13 to display the cleaning execution button (software switch) (display request). As a result, the display device 13 displays the following... Figure 2A or Figure 2B The example shows a cleaning execution button. After the request to display the cleaning execution button is made, control returns to step S301. When the control unit 102 detects that the cleaning execution button has been selected during the display of the cleaning execution button, the indication unit 103 instructs the cleaning device 14 to clean the vehicle sensor 11.

[0047] (2) Second example

[0048] Figure 4This is a flowchart illustrating a second example of display control of the cleaning execution button performed by the various components of the display control unit 100. The second example of control involves highlighting the cleaning execution button when it is already displayed on the display unit 13 and cleaning of the vehicle sensor 11 is desired. When the vehicle's ignition is turned on (IG-ON), the process begins according to... Figure 4 The second example shows the display control process for the cleaning execution button, and repeats the process until the ignition device is turned off (IG-OFF).

[0049] In step S401, the cleaning restriction determination unit 104 determines whether the vehicle is in a cleaning restriction state. As described above, a cleaning restriction state is a state where cleaning of the vehicle sensor 11 is prohibited or the cleaning effect of the vehicle sensor 11 cannot be fully obtained. When the cleaning restriction determination unit 104 determines that the vehicle is not in a cleaning restriction state (step S401, No), the control proceeds to step S402. When the cleaning restriction determination unit 104 determines that the vehicle is in a cleaning restriction state (step S401, Yes), the determination operation of step S401 is repeated.

[0050] In step S402, the control unit 102 determines the state of the cleaning SW display setting as information regarding the possibility of displaying the cleaning execution button. That is, the control unit 102 determines whether the cleaning SW display setting indicates that the display device 13 is allowed to display the cleaning execution button as enabled or disabled. When the control unit 102 determines that the cleaning SW display setting is enabled (step S402, enabled), control proceeds to step S403. When the control unit 102 determines that the cleaning SW display setting is disabled (step S402, disabled), processing proceeds to step S401.

[0051] In step S403, the control unit 102 sends a request to the display device 13 to display the cleaning execution button (software switch) (display request). As a result, the display device 13 displays the following... Figure 2A or Figure 2B The example shows a cleaning execution button. After a request to display the cleaning execution button is made, control proceeds to step S404. When the control unit 102 detects that the cleaning execution button has been selected during the display of the cleaning execution button, the indication unit 103 instructs the cleaning device 14 to clean the on-board sensor 11.

[0052] In step S404, the control unit 102 determines whether the receiving unit 101 has received dirt detection information from the detection device 12. The dirt detection information may not include information about the degree of dirtiness (e.g., dirt level). When the control unit 102 determines that the receiving unit 101 has received dirt detection information (step S404, Yes), control proceeds to step S405. When the control unit 102 determines that the receiving unit 101 has not received dirt detection information (step S404, No), control proceeds to step S401.

[0053] In step S405, the control unit 102 sends a request (highlighting request) to the display device 13 to highlight the already displayed cleaning execution button (software switch) with a predetermined drawing pattern. The drawing pattern is intended to draw the driver's attention to the cleaning execution button. Figures 7A to 7G The highlighted cleaning execution button is shown. Figure 2B The icon displays an example of a drawing pattern for switch 13b).

[0054] Here are some examples of drawing patterns.

[0055] ( Figure 7A The drawing pattern that changed the size of the cleaning execution button. Figure 7A In the example, the size of the icon display switch 13b is increased.

[0056] ( Figure 7B The color of the cleaning execution button's drawing pattern has been changed. Figure 7B In the example, the background color of the icon display switch 13b is different from the color of the icon.

[0057] ( Figure 7C The indicator shows a graphic symbol that signals the cleaning execution button. Figure 7C In the example, a marker is displayed in the upper right corner of the icon display switch 13b.

[0058] ( Figure 7D Add motion (effect) graphics to the display of the cleaning execution button. Figure 7D In the example, the icon shows switch 13b being toggled periodically. Besides toggling, the motion can be rotation, flashing, or waving.

[0059] ( Figure 7E This refers to a three-dimensional drawing of the cleaning execution button. Figure 7E In the example, the icon showing switch 13b is displayed as if it popped up on the screen.

[0060] ( Figure 7F The drawing pattern of the cleaning execution button's frame has been changed. Figure 7FIn the example, the icon shows that the outer frame of switch 13b is thickened. Besides thickness, other changes such as blinking can also be used.

[0061] ( Figure 7G The design of the cleaning execution button has been changed in the drawing. Figure 7G In the example, the icon shows that switch 13b has been changed to a design with rounded corners.

[0062] - The drawing pattern has been moved from its display position to indicate the cleaning execution button. For example, in Figure 2B The icon displayed in the upper right corner shows that the switch 13b has been moved to the center of the screen of the display device 13 and is displayed.

[0063] Each of the above drawing patterns can be implemented individually, or some drawing patterns can be combined and implemented.

[0064] By prominently displaying the cleaning execution button, the driver can be alerted to dirt on the vehicle sensor 11, which in turn encourages the driver to clean the sensor 11. After the request to press the cleaning execution button is made, control returns to step S401. When the control unit 102 detects that the cleaning execution button has been selected and simultaneously highlights and displays the cleaning execution button with any of the aforementioned graphic patterns, the indication unit 103 instructs the cleaning device 14 to clean the vehicle sensor 11.

[0065] (3) Third example

[0066] Figure 5 This is a flowchart illustrating a third example of the display control of the cleaning execution button performed by the various components of the display control device 100. The third example of control involves displaying and highlighting the cleaning execution button on the display device 13 in the form of a drawing based on the degree of dirt on the vehicle sensor 11 when the cleaning execution button is not displayed on the display device 13 and cleaning of the vehicle sensor 11 is desired. When the vehicle's ignition is turned on (IG-ON), the process begins according to... Figure 5 The third example shown displays the control of the cleaning execution button, and repeats this process until the ignition is turned off (IG-OFF).

[0067] In step S501, the cleaning restriction determination unit 104 determines whether the vehicle is in a cleaning restriction state. As described above, a cleaning restriction state is a state where cleaning of the vehicle sensor 11 is prohibited or the cleaning effect of the vehicle sensor 11 cannot be fully obtained. When the cleaning restriction determination unit 104 determines that the vehicle is not in a cleaning restriction state (step S501, No), the control proceeds to step S502. When the cleaning restriction determination unit 104 determines that the vehicle is in a cleaning restriction state (step S501, Yes), the determination operation of step S501 is repeated.

[0068] In step S502, the control unit 102 determines whether the receiving unit 101 has received dirt detection information from the detection device 12. The dirt detection information includes information about the degree of dirtiness (e.g., dirt level). When the control unit 102 determines that the receiving unit 101 has received the dirt detection information (step S502, Yes), control proceeds to step S503. When the control unit 102 determines that the receiving unit 101 has not received the dirt detection information (step S502, No), control proceeds to step S501.

[0069] In step S503, the control unit 102 determines whether the dirt on the vehicle sensor 11 meets a predetermined condition based on the dirt detection information received by the receiving unit 101. This determination is made to identify the degree of dirt on the vehicle sensor 11. For example, when the dirt level included in the dirt detection information is equal to or higher than "dirt level 2", the control unit 102 can determine that the dirt meets the predetermined condition. In addition to the dirt level, the predetermined condition may also appropriately use parameters commensurate with the degree of dirt included in the dirt detection information. When the control unit 102 determines that the dirt on the vehicle sensor 11 meets the predetermined condition (step S503, yes), control proceeds to step S506. When the dirt on the vehicle sensor 11 does not meet the predetermined condition (step S503, no), control proceeds to step S504.

[0070] In step S504, the control unit 102 determines the state of the cleaning SW display setting as information regarding the possibility of displaying the cleaning execution button. That is, the control unit 102 determines whether the cleaning SW display setting indicates that the display device 13 is allowed to display the cleaning execution button as enabled or disabled. When the control unit 102 determines that the cleaning SW display setting is enabled (step S504, enabled), control proceeds to step S505. When the control unit 102 determines that the cleaning SW display setting is disabled (step S504, disabled), processing proceeds to step S501.

[0071] In step S505, the control unit 102 requests the display device 13 to display the cleaning execution button (software switch) in a first graphic pattern (first prominent request). As a result, the cleaning execution button (software switch) is displayed on the display device 13 in a first graphic pattern. Figures 7A to 7G The pattern of any one or two or more drawing patterns shown is as follows: Figure 2A or Figure 2BThe cleaning execution button is shown. As the first drawing pattern, a drawing pattern is set to less strongly remind the driver of the vehicle than the second drawing pattern (described later). For example, a change in the size of the cleaning execution button, a change in the color of the cleaning execution button, etc., can be set as the first drawing pattern. After the first prominent request of the cleaning execution button is made, control returns to step S501.

[0072] In step S506, the control unit 102 requests the display device 13 to display the cleaning execution button (software switch) in a second graphic pattern (second prominent request). As a result, the cleaning execution button (software switch) is displayed on the display device 13 in a second graphic pattern. Figures 7A to 7G The pattern of any one or two or more drawing patterns shown is as follows: Figure 2A or Figure 2B The cleaning execution button is shown. As a second drawing pattern, a drawing pattern is set that more strongly reminds the vehicle driver than the first drawing pattern described above. For example, changes in the movement of the cleaning execution button or a shift in the display position of the cleaning execution button can be set as the second drawing pattern. After making the second prominent request for the cleaning execution button, control returns to step S501.

[0073] When the control unit 102 detects that the cleaning execution button has been selected and highlights the cleaning execution button with any drawing pattern, the indicator unit 103 instructs the cleaning device 14 to clean the vehicle sensor 11.

[0074] (4) Fourth example

[0075] Figure 6 This is a flowchart illustrating a fourth example of the display control of the cleaning execution button performed by the various components of the display control device 100. The fourth example of control involves highlighting the cleaning execution button in a pattern representing the degree of dirt on the vehicle sensor 11 when the cleaning execution button is already displayed on the display device 13 and cleaning of the vehicle sensor 11 is desired. When the vehicle's ignition is turned on (IG-ON), the process begins according to... Figure 6 The fourth example shown displays the control of the cleaning execution button, and repeats this process until the ignition is turned off (IG-OFF).

[0076] In step S601, the cleaning restriction determination unit 104 determines whether the vehicle is in a cleaning restriction state. As described above, a cleaning restriction state is a state where cleaning of the vehicle sensor 11 is prohibited or the cleaning effect of the vehicle sensor 11 cannot be fully obtained. When the cleaning restriction determination unit 104 determines that the vehicle is not in a cleaning restriction state (step S601, No), the control proceeds to step S602. When the cleaning restriction determination unit 104 determines that the vehicle is in a cleaning restriction state (step S601, Yes), the determination operation of step S601 is repeated.

[0077] In step S602, the control unit 102 determines the state of the cleaning SW display setting as information regarding the possibility of displaying the cleaning execution button. That is, the control unit 102 determines whether the cleaning SW display setting indicates that the display device 13 is allowed to display the cleaning execution button as enabled or disabled. When the control unit 102 determines that the cleaning SW display setting is enabled (step S602, enabled), control proceeds to step S603. When the control unit 102 determines that the cleaning SW display setting is disabled (step S602, disabled), control proceeds to step S601.

[0078] In step S603, the control unit 102 sends a request (display request) to the display device 13 to display the cleaning execution button (software switch). As a result, the display device 13 displays the following... Figure 2A or Figure 2B The example shows a cleaning execution button. When a request to display the cleaning execution button is made, control proceeds to step S604. When the control unit 102 detects that the cleaning execution button has been selected during its display, the indication unit 103 instructs the cleaning device 14 to clean the on-board sensor 11.

[0079] In step S604, the control unit 102 determines whether the receiving unit 101 has received dirt detection information from the detection device 12. The dirt detection information includes information about the degree of dirtiness (e.g., dirt level). When the control unit 102 determines that the receiving unit 101 has received the dirt detection information (step S604, Yes), control proceeds to step S605. When the control unit 102 determines that the receiving unit 101 has not received the dirt detection information (step S604, No), control proceeds to step S601.

[0080] In step S605, the control unit 102 determines whether the dirt on the vehicle sensor 11 meets a predetermined condition based on the dirt detection information received by the receiving unit 101. This determination is made to identify the degree of dirt on the vehicle sensor 11. For example, when the dirt level included in the dirt detection information is equal to or higher than "dirt level 2", the control unit 102 can determine that the dirt meets the predetermined condition. In addition to the dirt level, the predetermined condition can appropriately use parameters commensurate with the degree of dirt included in the dirt detection information. When the control unit 102 determines that the dirt on the vehicle sensor 11 meets the predetermined condition (step S605, yes), control proceeds to step S607. When the control unit 102 determines that the dirt on the vehicle sensor 11 does not meet the predetermined condition (step S605, no), control proceeds to step S606.

[0081] In step S606, the control unit 102 sends a request to the display device 13 to highlight the already displayed cleaning execution button (software switch) in a first drawing pattern (first highlight request). As a result, the cleaning execution button (software switch) is displayed on the display device 13 in a first drawing pattern. Figures 7A to 7G The pattern of any one or two or more drawing patterns shown is highlighted as follows: Figure 2A or Figure 2B The cleaning execution button is shown. The first drawing pattern has been described above. After the first prominent request of the cleaning execution button is made, control returns to step S601.

[0082] In step S607, the control unit 102 sends a request to the display device 13 to highlight the already displayed cleaning execution button (software switch) in a second drawing pattern (second highlight request). As a result, the cleaning execution button (software switch) is displayed on the display device 13 in a second drawing pattern. Figures 7A to 7G The pattern of any one or two or more drawing patterns shown is highlighted as follows: Figure 2A or Figure 2B The cleaning execution button is shown. The second drawing pattern has been described above. After the second prominent request of the cleaning execution button is made, control returns to step S601.

[0083] When the control unit 102 detects that the cleaning execution button has been selected and highlights the cleaning execution button with any drawing pattern, the indicator unit 103 instructs the cleaning device 14 to clean the vehicle sensor 11.

[0084] Although the first to fourth examples of the display control processing of the cleaning execution button performed by the various components of the display control device 100 have been described above, when the cleaning limit determination unit 104 is not installed in the display control device 100, the corresponding processing steps S301, S401, S501 and S601 are omitted.

[0085] Operation and Effect

[0086] As described above, according to one embodiment of this disclosure, the display control device 100 determines whether to request the display device 13 to display the cleaning execution button or to highlight it based on dirt detection information about dirt on the vehicle sensor 11 detected by the detection device 12. Therefore, the display device 13 can display or highlight the cleaning execution button of the vehicle sensor 11 at a more appropriate time. Furthermore, when dirt is detected on the vehicle sensor 11, the cleaning execution button is displayed instead of being continuously displayed, or when dirt is detected on the vehicle sensor 11, the continuously displayed cleaning execution button is highlighted. These arrangements give the user a less complicated impression and can reduce the number of software switches displayed on the screen.

[0087] The display control device 100 according to this embodiment may include a cleaning restriction determination unit 104. Therefore, when ongoing vehicle driving control prohibits cleaning of the on-board sensor 11, or when cleaning of the on-board sensor 11 cannot effectively remove the dirt detected by the detection device 12, the display control device 100 does not request the display device 13 to display or highlight the cleaning execution button. Therefore, even though cleaning is prohibited, it is unlikely or impossible to display or highlight the cleaning execution button on the display device 13, and even though cleaning cannot be achieved, it is unlikely or impossible to clean the on-board sensor 11.

[0088] Although one embodiment of the present disclosure has been described above, the present disclosure can be considered as a display control device, a method executed by a display control device including a processor and a memory, a control program for executing the method, a computer-readable non-transitory storage medium storing the control program, and a vehicle equipped with a display control device.

[0089] The display control device disclosed herein can be used in vehicles equipped with onboard sensors such as onboard cameras and onboard sensor cleaning devices.

Claims

1. A display control device installed in a vehicle, the display control device comprising: A receiving unit configured to receive information about dirt on onboard sensors installed in the vehicle; and A control unit, configured to control the display of a cleaning execution button on a display device installed in the vehicle, based on information about the dirt received by the receiving unit, the cleaning execution button being used to perform cleaning of the on-board sensors, wherein: The receiving unit is configured to receive, based on the vehicle's state, further information regarding the cleaning limitations of the on-board sensors, and, based on the driver's actions, further information regarding the likelihood of displaying the cleaning execution button; and The control unit is configured to further control the display of the cleaning execution button on the display device based on the information regarding the cleaning limitations and the information regarding the possibility of displaying the cleaning execution button; The information regarding the cleaning limitations indicates whether the vehicle is in a state where the cleaning effect is sufficiently achieved; The information regarding the possibility of displaying the cleaning execution button is to indicate whether to allow the display device to display the cleaning execution button as enabled or to indicate whether to disable the display device from displaying the cleaning execution button as disabled.

2. The display control device according to claim 1, wherein, The control unit is configured to switch between displaying and not displaying the cleaning execution button on the display device based on the information about the dirt.

3. The display control device according to claim 1, wherein, The control unit is configured to change the display mode of the cleaning execution button displayed on the display device based on the information about the dirt.

4. The display control device according to claim 2, wherein, The control unit is configured to cause the display device to display the cleaning execution button when the information about the dirt meets predetermined conditions.

5. The display control device according to claim 3, wherein, The control unit is configured to highlight the cleaning execution button displayed on the display device when the information about the dirt meets the predetermined conditions, compared to when the information about the dirt does not meet the predetermined conditions.

6. The display control device according to claim 1, wherein, The control unit is configured to cause the display device to display the cleaning execution button, or to highlight and display the cleaning execution button, when the information about the dirt meets predetermined conditions, regardless of the information about the possibility of displaying the cleaning execution button.

7. The display control device according to any one of claims 1 to 6, further comprising an indicator unit configured to instruct a cleaning device installed in the vehicle to clean the on-board sensor when the cleaning execution button is detected to be selected.

8. A display device comprising a display control device according to any one of claims 1 to 7.

9. A vehicle comprising the display device according to claim 8.

10. A display control method, implemented by a computer of a display control device installed in a vehicle, the display control method comprising: Receive information about dirt on the onboard sensors installed in the vehicle; and Based on the received information about the dirt, the display of a cleaning execution button on a display device installed on the vehicle is controlled to perform cleaning of the on-board sensors, wherein: Based on the vehicle's status, further information regarding the cleaning limitations of the onboard sensors is received; and based on the driver's actions, further information regarding the likelihood of displaying the cleaning execution button is received; and Further, based on the information regarding the cleaning limitations and the information regarding the possibility of displaying the cleaning execution button, the display of the cleaning execution button on the display device is controlled. The information regarding the cleaning limitations indicates whether the vehicle is in a state where the cleaning effect is sufficiently achieved; The information regarding the possibility of displaying the cleaning execution button is to indicate whether to allow the display device to display the cleaning execution button as enabled or to indicate whether to disable the display device from displaying the cleaning execution button as disabled.

11. A storage medium storing a program executed by a computer of a display control device installed in a vehicle, the program comprising: Receive information about dirt on the onboard sensors installed in the vehicle; and Based on the received information about the dirt, the display of a cleaning execution button on a display device installed on the vehicle is controlled to perform cleaning of the on-board sensors, wherein: Based on the vehicle's status, further information regarding the cleaning limitations of the onboard sensors is received; and based on the driver's actions, further information regarding the likelihood of displaying the cleaning execution button is received; and Further, based on the information regarding the cleaning limitations and the information regarding the possibility of displaying the cleaning execution button, the display of the cleaning execution button on the display device is controlled. The information regarding the cleaning limitations indicates whether the vehicle is in a state where the cleaning effect is sufficiently achieved; The information regarding the possibility of displaying the cleaning execution button is to indicate whether to allow the display device to display the cleaning execution button as enabled or to indicate whether to disable the display device from displaying the cleaning execution button as disabled.

Images