Vehicle function information provision system and vehicle function information provision method

Abstract

Avoid providing explanatory displays about vehicle functions to users under inappropriate circumstances. [Solution] A vehicle function information provision system that provides explanatory displays of vehicle functions to a user riding in a vehicle, wherein if there is an approaching obstacle among the obstacles surrounding the vehicle that is approaching the vehicle, the provision of explanatory displays of vehicle functions to the user is prohibited, and if there is no approaching obstacle among the obstacles surrounding the vehicle that is approaching the vehicle, the provision of explanatory displays of vehicle functions to the user is permitted.

Description

Technical Field

[0001] The present invention relates to a vehicle function information providing system and a vehicle function information providing method.

Background Art

[0002] Conventionally, as a technical document regarding the provision of information on vehicle functions, Japanese Unexamined Patent Application Publication No. 2005-050273 is known. This publication discloses an in-vehicle device operation support system that guides a user regarding an in-vehicle device, downloads an online manual according to the user's usage history, and guides the user on how to operate the in-vehicle device according to the driving state of the vehicle. The operation methods guided by this system are, for example, the positions of operation switches and the basic operation methods of operation switches. It is also shown that, when the user is a driver and the operation method that the driver needs to pay attention to is the target of operation guidance, the guidance is provided when the vehicle is in a stopped state.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above-described conventional system, the guidance method for the in-vehicle device is changed according to the driving state of the vehicle. However, even when the vehicle is in a stopped state, there are cases where it is not appropriate to guide the user regarding the in-vehicle device depending on the external situation of the vehicle. There was a problem that the influence of the external situation of the vehicle could not be sufficiently considered in the conventional system.

Means for Solving the Problems

[0005] One aspect of the present invention is a vehicle function information provision system that provides explanatory displays of vehicle functions to a user riding in a vehicle, wherein the provision of explanatory displays of vehicle functions is prohibited when there is an approaching obstacle among the obstacles surrounding the vehicle, and the provision of explanatory displays of vehicle functions is permitted when there is no approaching obstacle among the obstacles surrounding the vehicle.

[0006] According to one aspect of the present invention, the vehicle function information provision system prohibits the provision of explanatory displays of vehicle functions when an approaching obstacle is present. This makes it possible to avoid providing explanatory displays of vehicle functions to the user under inappropriate circumstances, taking into account the situation of obstacles around the vehicle.

[0007] In a vehicle function information provision system according to one aspect of the present invention, if there are obstacles moving around the vehicle, but no approaching obstacles are present among the obstacles around the vehicle, the system may suggest to the user that the display of vehicle function explanations be started. This vehicle function information system suggests starting the display of vehicle function explanations when there are moving obstacles around the vehicle but no approaching obstacles, providing users with an appropriate timing to receive explanations of vehicle functions. This makes it easier for users to understand how to use vehicle functions and can improve their utilization rate. In addition, by suppressing the display of explanations at unnecessary times, it can reduce inconvenience for users.

[0008] In a vehicle function information provision system according to one aspect of the present invention, the system obtains the user's past viewing history of vehicle function descriptions based on the user's personal authentication result, and if the number of times the user has viewed vehicle function descriptions in the past is equal to or greater than a threshold, or if the user has viewed vehicle function descriptions within a set period, it is not necessary to display vehicle function descriptions to the user. This vehicle function information system allows for the automatic display of vehicle function explanations at appropriate times when the user does not need to concentrate on operating the vehicle. This enables users to learn how to use the vehicle functions at the right moment. Furthermore, since the explanation display starts automatically without user intervention, convenience is improved and inconvenience for the user is reduced.

[0009] In a vehicle function information provision system according to one aspect of the present invention, the provision of explanatory displays of vehicle functions may be prohibited when the vehicle is stopped or not in autonomous driving mode. This vehicle function information provision system prevents the display of explanatory information about vehicle functions when the vehicle is stopped or not in autonomous driving mode, thereby preventing explanatory information from being displayed when the user should be concentrating on driving.

[0010] In a vehicle function information provision system according to one aspect of the present invention, the system may automatically start displaying explanations of vehicle functions to the user when all obstacles around the vehicle are stationary, or when there are no obstacles around the vehicle. According to this vehicle function information provision system, when all obstacles around the vehicle are stationary, or when there are no obstacles around the vehicle, the system automatically starts displaying explanations of vehicle functions to the user, allowing the user to receive explanations of vehicle functions at the appropriate time. This makes it easier for users to understand how to use the vehicle functions and can improve the utilization rate of those functions.

[0011] In a vehicle function information provision system according to one aspect of the present invention, it is possible to determine whether a preset viewing prohibition condition is met based on the vehicle's driving state or the condition of obstacles around the vehicle, and if it is determined that the viewing prohibition condition is met, the provision of explanatory displays of vehicle functions to the user may be prohibited. According to this vehicle function information provision system, if it is determined that the conditions for prohibiting viewing are met based on the vehicle's driving status or the condition of obstacles around the vehicle, the provision of explanatory displays for vehicle functions is prohibited. This prevents the system from suggesting or automatically starting explanatory displays when the driving status or external environment is inappropriate, thus avoiding causing inconvenience to the user.

[0012] In a vehicle function information provision system according to one aspect of the present invention, it may be determined that the viewing prohibition condition is met when the vehicle is in a reversing state or when there is a moving obstacle within the vehicle's proximity determination distance. According to this vehicle function information provision system, by prohibiting the provision of explanatory displays for vehicle functions when the vehicle is in reverse or when there is a moving obstacle within the vehicle's proximity detection range, it is possible to suppress the suggestion or automatic activation of explanatory displays in situations where the user should be paying attention to their surroundings, thereby avoiding causing inconvenience to the user.

[0013] Another aspect of the present invention is a vehicle function information provision system and a method for providing vehicle function information to a user riding in a vehicle, wherein the vehicle function information provision system prohibits the provision of vehicle function information when there is an approaching obstacle among the obstacles surrounding the vehicle, and permits the provision of vehicle function information when there is no approaching obstacle among the obstacles surrounding the vehicle.

[0014] According to another aspect of the present invention, the vehicle function information provision method of the vehicle function information provision system prohibits the provision of explanatory displays of vehicle functions when an approaching obstacle is present. This makes it possible to avoid providing explanatory displays of vehicle functions to the user under inappropriate circumstances, taking into account the situation of obstacles around the vehicle. [Effects of the Invention]

[0015] According to each aspect of the present invention, it is possible to avoid providing explanatory displays of vehicle functions to the user under inappropriate circumstances, taking into account the situation of obstacles around the vehicle.

Brief Description of the Drawings

[0016] [Figure 1] It is a block diagram showing a vehicle function information providing system according to an embodiment. [Figure 2] It is a table for explaining an example of a start mode of an explanatory display of vehicle functions. [Figure 3] It is a flowchart showing an example of a personal browsing history acquisition process of a vehicle function information providing system. [Figure 4] It is a flowchart showing an example of an information providing process of a vehicle function information providing system. [Figure 5] It is a flowchart showing an example of an information providing process that is a continuation of the flowchart of FIG. 4. [Figure 6] It is a flowchart showing an example of an information providing prohibition process of a vehicle function information providing system.

Embodiments for Carrying Out the Invention

[0017] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0018] FIG. 1 is a block diagram showing the configuration of a vehicle function information providing system 100 according to an embodiment. The vehicle function information providing system 100 shown in FIG. 1 is a system that provides an explanatory display of vehicle functions to a user riding in a vehicle at an appropriate timing.

[0019] The user is, for example, the driver of a vehicle. The user may include passengers in the vehicle other than the driver. The vehicle may be a vehicle with an automatic driving function or a vehicle without an automatic driving function. The automatic driving function is, for example, a function that can execute control at an automatic driving level of 2 or higher recognized by the Society of Automotive Engineers (SAE) in the United States. Specifically, the automatic driving function in this embodiment may include functions for executing ACC (Adaptive Cruise Control) and LKA (Lane Keeping Assist). It is only necessary that the situation allows the user to have time to view the explanatory display of the vehicle functions. The automatic driving function may be limited to a function that can execute control at an automatic driving level of 3 or higher.

[0020] The vehicle function is a function of the vehicle for providing convenience to the user. The vehicle function may include the above-described automatic driving function. The vehicle function may include a parking assistance function. The parking assistance function is a function for assisting the user to park the vehicle appropriately. The parking assistance function uses a plurality of sensors and cameras to recognize the external environment of the vehicle and guides the driver to park the vehicle in an appropriate position. The parking assistance function may be a function for automatically executing the parking of the vehicle. The vehicle function may include a function for checking the situation outside the vehicle (for example, a panoramic view monitor).

[0021] Vehicle functions may include ADAS (Advanced Driver Assistance Systems) functions. ADAS functions may include at least one of the following: ACC, LKA, collision mitigation braking (e.g., pre-collision safety), collision avoidance assistance, rear side warning function (e.g., blind spot monitor), night vision function (e.g., night view), traffic sign recognition function (e.g., road sign assist), driver abnormality stop assistance, driver abnormality response function, automatic headlight adjustment assistance (e.g., adaptive front lighting), lane change assistance, deceleration and steering assistance for obstacles (e.g., proactive driving assist), preceding vehicle departure notification function (e.g., preceding vehicle departure alarm), and crossing vehicle notification function (e.g., front cross traffic alert).

[0022] The vehicle function information provision system 100 is centered around a control ECU 10 (Electronic Control Unit) mounted on the vehicle. The control ECU 10 is an electronic control unit having a CPU (Central Processing Unit) and a memory unit, the memory unit consisting of ROM (Read Only Memory), RAM (Random Access Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), etc. The control ECU 10 realizes various functions by executing programs stored in the memory unit with the CPU. The control ECU 10 may be composed of multiple electronic units.

[0023] The control ECU 10 is connected to a driver monitor camera 1, a vehicle speed sensor 2, a clearance sonar 3, a radar sensor 4, and an external camera 5. These sensors and cameras detect the vehicle's surrounding environment and status, and transmit this information to the control ECU 10.

[0024] The driver monitor camera 1 is a camera for capturing images of the driver's face and head. The driver monitor camera 1 is mounted, for example, on the steering column cover and captures images of the driver, including their face. The driver monitor camera 1 is a digital camera having an image sensor such as a CCD or CIS. The driver monitor camera 1 transmits the captured driver images to the control ECU 10 at a predetermined frame rate. The driver monitor camera 1 may include cameras capable of capturing images of occupants other than the driver.

[0025] Vehicle speed sensor 2 is a sensor that detects the speed of the vehicle. Vehicle speed sensor 2 transmits the detected vehicle speed information to the control ECU 10. Clearance sonar 3 is a sensor that uses ultrasound to detect obstacles around the vehicle. Clearance sonar 3 accurately detects obstacles at close range and transmits obstacle information related to the detected obstacles to the control ECU 10. Note that clearance sonar 3 is not mandatory.

[0026] The radar sensor 4 is a sensor that uses radio waves or light to detect obstacles around the vehicle, and includes millimeter-wave radar and LiDAR. The radar sensor 4 transmits information about the detected obstacles to the control ECU 10.

[0027] External camera 5 is a camera that captures images of the vehicle's external environment. External camera 5 includes a front camera that captures images of the area in front of the vehicle. External camera 5 may also include a rear camera that captures images of the area behind the vehicle, and side cameras that capture images of the area to the sides of the vehicle. External camera 5 transmits the captured images of the vehicle's external environment to the control ECU 10.

[0028] The HMI 6 is an interface for inputting and outputting information between the vehicle function information provision system 100 and the user, and is equipped with a display 6a and a speaker 6b located inside the vehicle cabin. The HMI 6 outputs at least one of the following: an image from the display 6a and an audio signal from the speaker 6b, in response to a control signal from the control ECU 10. The display 6a may be a center display located on the vehicle's dashboard, or it may be a HUD (Head Up Display). The display 6a may have a touch panel function. The HMI 6 may have various buttons for user operation, and may also have a voice recognition function.

[0029] Next, the functional configuration of the control ECU 10 will be described. As shown in Figure 1, the control ECU 10 includes a personal authentication unit 11, a driving state recognition unit 12, an external environment recognition unit 13, and an information provision unit 14. Note that some of the functions of the control ECU 10 may be performed by an external server capable of communicating with the vehicle.

[0030] The personal authentication unit 11 performs personal authentication of the vehicle user. For example, the personal authentication unit 11 authenticates the user by comparing the driver image captured by the driver monitor camera 1 with registered facial image data. The personal authentication unit 11 may also perform personal authentication using fingerprint authentication, iris authentication, voice authentication, a dedicated smartphone application, passcode input, or other methods. The personal authentication unit 11 may also perform personal authentication by combining multiple methods.

[0031] The personal authentication unit 11 obtains the user's past viewing history of vehicle function descriptions based on the user's personal authentication result. The user's past viewing history of vehicle function descriptions includes at least the type of vehicle function the user has viewed in the past and the time of viewing. Vehicle function types include parking assist functions and ACC, etc. The viewing history may also include the number of times each type of vehicle function has been viewed. The viewing history may also include viewing status, such as whether viewing was interrupted midway, how far was viewed, and whether it was viewed to the end. The viewing history may also include viewing initiation status, such as whether the user started viewing voluntarily without a system suggestion, whether the user started viewing after receiving a system suggestion, or whether viewing was automatically started by the system.

[0032] Browsing history is stored in the memory unit of the control ECU 10 or in other in-vehicle databases. The browsing history database may be located on an external server, and browsing records may be obtained via wireless communication.

[0033] The driving state recognition unit 12 recognizes the vehicle's driving state based on the detection results of various sensors on the vehicle. The driving state recognition unit 12 recognizes the vehicle's speed as the driving state based on the detection results of the vehicle speed sensor 2. The driving state recognition unit 12 determines whether the vehicle is stopped or not based on the vehicle's speed. The driving state recognition unit 12 may also determine that the vehicle is stopped if the vehicle speed remains near 0 km / h for a certain period of time.

[0034] The driving state recognition unit 12 may recognize the vehicle's driving state, such as its yaw rate and acceleration, using a yaw rate sensor, an acceleration sensor, or other sensors. The driving state recognition unit 12 may also recognize the vehicle's shift position based on the detection result of the shift position sensor. For example, if the shift position is set to "reverse," the driving state recognition unit 12 recognizes that the vehicle is in reverse. The driving state recognition unit 12 may also monitor the operating status of the vehicle's autonomous driving system and recognize whether or not the vehicle is in autonomous driving mode.

[0035] The external environment recognition unit 13 recognizes the external environment of the vehicle based on information from the clearance sonar 3, radar sensor 4, external camera 5, etc. The external environment of the vehicle includes the status of obstacles outside the vehicle. The external environment recognition unit 13 recognizes the status of obstacles outside the vehicle based on information from the clearance sonar 3, radar sensor 4, external camera 5, etc. The status of obstacles includes whether or not an obstacle is present, the position of the obstacle relative to the vehicle, the speed of movement of the obstacle, and the direction of movement. The speed of movement of the obstacle may be the speed of movement relative to the vehicle. The direction of movement of the obstacle may be the direction of movement relative to the vehicle.

[0036] Obstacles include other vehicles and pedestrians. Other vehicles may include passenger cars, trucks, buses, motorcycles, bicycles, and personal mobility devices. Personal mobility devices may include at least one of the following: electric kick scooters, two-wheeled self-balancing electric mobility devices, electric unicycles, electric skateboards, electric roller skates, and electric wheelchairs. Obstacles may also include animals such as dogs and deer. Obstacles may also include structures such as guardrails and utility poles, and parked vehicles.

[0037] The external environment recognition unit 13 calculates the distance between the vehicle and the obstacle based on the position of the obstacle relative to the vehicle. Based on the distance between the vehicle and the obstacle, the external environment recognition unit 13 recognizes obstacles around the vehicle. Obstacles around the vehicle are, for example, obstacles detected by the vehicle's sensors that are within a certain distance from the vehicle. Obstacles around the vehicle may include all obstacles detected by the vehicle's sensors. Obstacles around the vehicle may also include obstacles that are within a preset range around the vehicle.

[0038] The external environment recognition unit 13 determines whether all obstacles around the vehicle are stationary or whether there are no obstacles around the vehicle. The external environment recognition unit 13 also determines whether there are approaching obstacles based on the position and direction of movement of obstacles around the vehicle. An approaching obstacle is an obstacle moving toward the vehicle. When the vehicle is in motion, approaching obstacles may also include obstacles approaching in the direction of the vehicle's travel. For example, this includes cases where another vehicle is approaching the vehicle or where a pedestrian is crossing in the direction of the vehicle's travel.

[0039] The external environment recognition unit 13 may determine whether there are any obstacles moving away from the vehicle based on the position and direction of movement of obstacles present around the vehicle. An obstacle moving away from the vehicle is an obstacle that is moving away from the vehicle.

[0040] The information provision unit 14 provides the user with an explanatory display of vehicle functions by transmitting a control signal to the HMI 6. The explanatory display of vehicle functions is provided, for example, as a video with audio. The explanatory display of vehicle functions may include both short videos prioritizing time efficiency and full videos prioritizing comprehensive content. The explanatory display of vehicle functions may also be performed using still images that change in a sliding manner. The explanatory display of vehicle functions may also be primarily audio-based. In that case, an icon or text indicating that an audio explanation of vehicle functions is in progress may be displayed on a part of the display 6a.

[0041] The information provision unit 14 provides a vehicle function explanation display when the user initiates an operation to start the vehicle function explanation display. An initiation operation is, for example, an operation by the user to select to start the vehicle function explanation display by using a touch panel or button. The information provision unit 14 proposes to the user to start the vehicle function explanation display when predetermined conditions are met. The information provision unit 14 proposes to start the vehicle function explanation display by displaying an image on the display 6a and / or outputting sound from the speaker 6b. For example, the information provision unit 14 proposes to start the vehicle function explanation display by displaying a window on the display 6a with text indicating that the vehicle function explanation display should be started and an icon prompting the user to touch it. The method of proposal is not particularly limited. In addition, the information provision unit 14 automatically starts the vehicle function explanation display when predetermined conditions are met. The various conditions will be described in detail later.

[0042] The information provision unit 14 determines whether or not to display a vehicle function explanation to the user based on the user's past viewing history of vehicle function explanations recognized by the personal authentication unit 11. This enables the provision of appropriate information according to the user's level of understanding and usage.

[0043] Specifically, the information provision unit 14 determines whether the number of times a user has previously viewed a vehicle function description is below a threshold. Hereinafter, the number of times a user has previously viewed a vehicle function description will be referred to as the number of views. If the number of views is not below the threshold (i.e., the number of views is equal to or greater than the threshold), the information provision unit 14 determines that there is no need to display a description of the vehicle function in question.

[0044] The judgment threshold can be, for example, the number of times a user is deemed to have sufficiently understood the explanation of the vehicle's functions. The judgment threshold may be one time, two times, three or more times, or five or more times. Different judgment thresholds may be set for each type of vehicle function. Different judgment thresholds may be set for each type of explanatory display, such as short videos or full videos. The information provision unit 14 may determine that viewing the full video is necessary even if the number of times the user has viewed the short video is equal to or greater than the judgment threshold, but the number of times the user has viewed the full video is less than the judgment threshold.

[0045] The information provision unit 14 may change the judgment threshold based on the usage status of vehicle functions. The information provision unit 14 may set a lower judgment threshold for vehicle functions, such as parking assist functions, the more frequently the user uses those functions.

[0046] The information provision unit 14 may determine whether the user has viewed the vehicle function description within the set period. The set period may be three months, six months, or one year. The set period can be set arbitrarily. If the user has viewed the vehicle function description within the set period, the information provision unit 14 may determine that there is no need to display the vehicle function description. This determination is made for each vehicle function.

[0047] The information provision unit 14 may change the setting period based on the usage status of the vehicle functions. The information provision unit 14 may set a longer setting period for vehicle functions, such as parking assist functions, if the user uses those functions more frequently.

[0048] The information provision unit 14 controls the provision of the vehicle function explanation display based on the vehicle's driving state recognized by the driving state recognition unit 12, when it determines that an explanation of the vehicle function is necessary. Specifically, the information provision unit 14 prohibits the provision of the vehicle function explanation display if the external environment recognition unit 13 does not determine that the vehicle is stopped or in autonomous driving mode. The information provision unit 14 allows the provision of the vehicle function explanation display if it determines that the vehicle is stopped or in autonomous driving mode. However, if the provision of the explanation display is prohibited due to other requirements, the prohibition takes precedence over the permission. The same applies hereafter.

[0049] Furthermore, if the information provision unit 14 determines that a vehicle function explanation display is necessary, it controls the provision of the vehicle function explanation display based on the status of obstacles around the vehicle recognized by the external environment recognition unit 13. The information provision unit 14 prohibits the provision of the vehicle function explanation display if there are approaching obstacles around the vehicle. In situations where approaching obstacles are present, it is desirable for the user to pay attention to the surrounding situation without being distracted by the vehicle function explanation display. While the provision of the vehicle function explanation display is prohibited, the explanation display may not be provided even if the user performs an operation to start the vehicle function explanation display. However, even when it is prohibited, if the user wishes, the explanation display may be provided after a warning display is shown. The information provision unit 14 allows the provision of the vehicle function explanation display if there are no approaching obstacles around the vehicle.

[0050] The information provision unit 14 temporarily disables the display of vehicle function explanations when other vehicles or pedestrians are approaching, even when the user is viewing the vehicle function explanations, so that the user can pay attention to their surroundings. The information provision unit 14 allows the display of vehicle function explanations when the external environment recognition unit 13 determines that there are no approaching obstacles around the vehicle.

[0051] The information provision unit 14 may, when the provision of vehicle function explanation displays is not prohibited, suggest to the user that the vehicle function explanation display be started when there are moving obstacles around the vehicle, but no approaching obstacles among the obstacles around the vehicle. The information provision unit 14 suggests starting the vehicle function explanation display by controlling the HMI 6 and / or by displaying an image on the display 6a and / or outputting sound from the speaker 6b. The information provision unit 14 may also suggest starting the vehicle function explanation display to the user when there are no approaching obstacles among the obstacles around the vehicle, and there are obstacles moving away from the vehicle.

[0052] The suggestion to start displaying vehicle function explanations may be made at a timing that takes into account the user's situation as recognized from the driver image of the driver monitor camera 1. The information provision unit 14 may withhold the suggestion to start displaying vehicle function explanations if it recognizes that the user is paying attention to operating a vehicle system such as the navigation system. The information provision unit 14 may also withhold the suggestion to start displaying vehicle function explanations if the user is concentrating on operating a smartphone or watching television on the display 6a.

[0053] The information provision unit 14, for example, suggests to the user to start displaying an explanation of the vehicle's functions when the vehicle is parked, there are no other vehicles or pedestrians or other obstacles nearby, and the surrounding obstacles are moving away from the vehicle. The user can then start displaying an explanation of the vehicle's functions in response to this suggestion.

[0054] The information provision unit 14 automatically starts displaying vehicle function explanations when all obstacles around the vehicle are stopped or when there are no obstacles around the vehicle, provided that the provision of vehicle function explanations is not prohibited. Automatic start of vehicle function explanation means that the system automatically starts providing vehicle function explanations without any user operation. The user can also turn off the automatic start function in advance. The information provision unit 14, for example, controls the HMI 6 to play a video as a vehicle function explanation on the display 6a and outputs an audio explanation from the speaker 6b. The information provision unit 14 may also be configured to perform automatic start only when the vehicle is stopped.

[0055] The information provision unit 14 may determine whether a pre-set viewing prohibition condition is met based on the vehicle's driving status or the detection results of obstacles around the vehicle. If the information provision unit 14 determines that the viewing prohibition condition is met, it prohibits providing the user with explanatory displays of vehicle functions.

[0056] The information provision unit 14 determines, for example, that the viewing prohibition condition is met when the vehicle is in reverse. In situations where the vehicle is reversing, it is desirable for the user to pay attention to the area around the vehicle.

[0057] The information provision unit 14 may determine that the viewing prohibition condition is met if there is a moving obstacle within the proximity detection distance. The information provision unit 14 may determine whether or not there is a moving obstacle within the proximity detection distance based on the detection result of the clearance sonar 3. The proximity detection distance may be 1m, 1.5m, or 2m. The proximity detection distance can be set arbitrarily. The information provision unit 14 may also determine that the viewing prohibition condition is met if there is a stationary pedestrian or cyclist within the proximity detection distance.

[0058] The information provision unit 14 may determine that the viewing prohibition condition is met while the parking assistance function is being executed. The information provision unit 14 may determine that the viewing prohibition condition is met when the vehicle is in autonomous driving mode and performing complex driving such as turning right or left at an intersection or changing lanes. The information provision unit 14 may determine that the viewing prohibition condition is met when the vehicle is stopped at a traffic light or waiting for oncoming traffic to pass when turning right at an intersection, or in any other situation where the stopped state will end in a short time. The information provision unit 14 may also determine that the viewing prohibition condition is met if it detects that a vehicle ahead of a stopped vehicle or a vehicle two vehicles ahead (another vehicle in front of the vehicle ahead) has started moving. The status of the vehicle and the status of the vehicle ahead may be detected by image recognition using images captured by the external camera 5, or by detection from the GNSS (Global Navigation Satellite System) receiver and map information.

[0059] Here, Figure 2 is a table illustrating examples of initiation modes for the vehicle function explanation display. Figure 2 shows different activation types, screen elements, types, and sound combinations for initiation modes 1 to 4. The screen elements, types, and sounds in initiation modes 1 to 4 are the elements used to introduce the vehicle function explanation display. The vehicle function explanation display itself is provided in different forms, such as videos with sound.

[0060] Figure 2 shows activation mode 1, which illustrates the case where the activation type is "User-Initiated." The user can initiate the display of vehicle function explanations, for example, when the vehicle's system is running and the provision of vehicle function explanations is not prohibited. The screen element displayed is "Full Onboarding," which indicates that detailed explanations will be displayed across the entire screen. The type is "Display," indicating that visual information will be provided. The sound is set to "None," meaning no audio assistance is provided. Note that this is just an example, and sound output may be provided.

[0061] Initiation Mode 2 describes a case where the activation type is "System Proposal (Screen Notification)". Initiation Mode 2 is one mode in which the information provision unit 14 proposes to the user the start of displaying an explanation of the vehicle's functions. This means that the system automatically displays a notification on the screen, prompting the user to view the explanation. The screen element is "Notification," and concise information is displayed. The type is "Display," and visual information is provided through an image. The sound is "Chime," and a notification sound is played to alert the user.

[0062] Initiation Mode 3 describes a case where the activation type is "System Proposal (Voice Notification)". Initiation Mode 3 is one mode in which the information provision unit 14 proposes to the user the start of displaying explanations of vehicle functions. This means that the system automatically makes a voice notification and prompts the user to display the explanation. The screen element is "Notification," and concise information is displayed. The type is "Voice," and information is provided using voice. This allows the user to receive an audio explanation in addition to visual information. The sound is "Voice," and a detailed audio explanation is provided. The display of explanations of vehicle functions itself may be performed through full onboarding or voice output.

[0063] Startup Mode 4 describes the case where the activation type is "automatic start". Startup Mode 4 is one mode in which the information provision unit 14 automatically starts displaying the vehicle function explanation. The screen elements are "full onboarding", and detailed explanations are displayed across the entire screen. The type is "display", and visual information is provided. The sound is "chime", and a notification sound is played to alert the user to the automatic start.

[0064] Next, the processing of the vehicle function information provision method of the vehicle function information provision system 100 according to this embodiment will be explained with reference to the drawings. Figure 3 is a flowchart showing an example of the personal browsing history acquisition process of the vehicle function information provision system 100.

[0065] As shown in Figure 3, the control ECU 10 of the vehicle function information provision system 100 performs user authentication by the personal authentication unit 11 as step S1. The personal authentication unit 11 performs user authentication using, for example, a driver image captured by the driver monitor camera 1.

[0066] Next, as step S2, the control ECU 10 obtains the user's past viewing history of vehicle function descriptions from the personal authentication unit 11. The viewing history includes information such as how often the user has viewed vehicle function descriptions in the past. The personal authentication unit 11 obtains the viewing history associated with the user identified through personal authentication. The personal authentication unit 11 obtains the viewing history for each vehicle function.

[0067] Figure 4 is a flowchart showing an example of the information provision process of the vehicle function information provision system 100. The determination of the information provision process may be performed for each vehicle function. Priority may be set in advance for the display of vehicle function descriptions. The vehicle function information provision system 100 performs information provision processing regarding the display of vehicle function descriptions in order of priority, for example.

[0068] As shown in Figure 4, in step S10, the control ECU 10 uses the information provision unit 14 to determine whether the user's past viewing count is below a threshold. This checks how often the user has viewed the vehicle function explanation display in the past and determines whether that number is less than the set threshold. If the user's past viewing count is below the threshold, the control ECU 10 proceeds to step S11. If the user's past viewing count is not below the threshold, the control ECU 10 proceeds to step S14.

[0069] In step S11, the control ECU 10 determines, via the information provision unit 14, whether the user has viewed the vehicle function explanation display within the set period. This determines the necessity of viewing the explanation display based on whether the user has viewed the explanation display within the set period, looking back from the present. If the user has not viewed the vehicle function explanation display within the set period, the control ECU 10 proceeds to step S12. If the user has viewed the vehicle function explanation display within the set period, the control ECU 10 proceeds to step S14.

[0070] In step S12, the control ECU 10 determines whether the vehicle is stopped or in autonomous driving mode using the driving state recognition unit 12. If the vehicle is stopped or in autonomous driving mode, the control ECU 10 proceeds to step S13. If the vehicle is not stopped or in autonomous driving mode, the control ECU 10 proceeds to step S14.

[0071] In step S13, the control ECU 10 determines whether or not there are approaching obstacles around the vehicle using the external environment recognition unit 13. If there are approaching obstacles around the vehicle, the control ECU 10 proceeds to step S14. If there are no approaching obstacles around the vehicle, the control ECU 10 proceeds to the flowchart in Figure 5.

[0072] In step S14, the control ECU 10 prohibits the information provision unit 14 from providing explanatory displays of vehicle functions. The information provision unit 14 will not provide explanatory displays of vehicle functions even if the user performs a start operation. Note that if the answer is NO in steps S10 and S11, it is not necessarily required to proceed to step S14 to prohibit the function; simply not providing explanatory displays may suffice.

[0073] Figure 5 is a flowchart showing an example of information provision processing, which is a continuation of the flowchart in Figure 4. As shown in Figure 5, in step S20, the control ECU 10 determines whether there are moving obstacles around the vehicle using the external environment recognition unit 13. If there are moving obstacles around the vehicle, the control ECU 10 proceeds to step S21. If there are no moving obstacles around the vehicle, the control ECU 10 proceeds to step S22. The situation in which the system proceeds to step S22 corresponds to a situation where all obstacles around the vehicle are stationary, or where there are no obstacles around the vehicle.

[0074] In step S21, the control ECU 10, via the information provision unit 14, proposes to the user the start of displaying explanations of vehicle functions. The information provision unit 14 proposes the start of displaying explanations of vehicle functions by controlling the HMI 6. After that, the control ECU 10 terminates the current information provision process.

[0075] In step S22, the control ECU 10 automatically starts displaying explanations of vehicle functions to the user via the information provision unit 14. The information provision unit 14 automatically starts displaying explanations of vehicle functions by controlling the HMI 6. The explanations of vehicle functions are provided, for example, as a full video. After that, the control ECU 10 terminates this information provision process.

[0076] Figure 6 is a flowchart showing an example of the information provision prohibition process of the vehicle function information provision system 100. The flowchart shown in Figure 6 may be executed independently of Figures 4 and 5. If the provision of vehicle description displays is prohibited by the information provision prohibition process in Figure 6, the suggestion to start the description display in Figure 4 and the automatic start of the description display in Figure 5 are also prohibited. Note that the vehicle function information provision system 100 does not necessarily need to perform the information provision prohibition process shown in Figure 6.

[0077] As shown in Figure 6, in step S30, the control ECU 10 recognizes the vehicle's driving state using the driving state recognition unit 12. The vehicle's driving state includes information regarding the vehicle's reverse state. The vehicle's driving state may also include shift position information.

[0078] Next, in step S32, the control ECU 10 recognizes the external environment of the vehicle using the external environment recognition unit 13. The external environment of the vehicle includes the condition of obstacles around the vehicle.

[0079] Next, the control ECU 10 determines whether the viewing prohibition condition is met by the information provision unit 14. The information provision unit 14 determines that the viewing prohibition condition is met, for example, when the vehicle is in reverse. The information provision unit 14 may also determine that the viewing prohibition condition is met when there is a moving obstacle within the proximity determination distance. If the control ECU 10 determines that the viewing prohibition condition is met, it proceeds to step S33. If the control ECU 10 does not determine that the viewing prohibition condition is met, it terminates the current information provision prohibition process.

[0080] According to the vehicle function information provision system 100 and the vehicle function information provision method of this embodiment described above, the provision of explanatory displays of vehicle functions is prohibited when an approaching obstacle is present. Therefore, it is possible to avoid providing explanatory displays of vehicle functions to the user under inappropriate circumstances, taking into account the situation of obstacles around the vehicle.

[0081] Furthermore, the vehicle function information provision system 100 can provide explanations of vehicle functions at appropriate times based on the user's past browsing history, the vehicle's status, and the surrounding obstacles. This makes it easier for users to understand how to use vehicle functions and can improve their utilization rate. In addition, by suppressing unnecessary explanation displays, it can reduce inconvenience for the user.

[0082] According to the vehicle function information provision system 100, when there are moving obstacles around the vehicle but no approaching obstacles, the system suggests starting the display of vehicle function explanations, providing users with an appropriate timing to receive explanations of vehicle functions. This makes it easier for users to understand how to use the vehicle functions and can improve the utilization rate of those functions. Furthermore, by suppressing the display of explanations at unnecessary times, the system can reduce inconvenience for users.

[0083] According to the vehicle function information provision system 100, the system can automatically start displaying explanations of vehicle functions in appropriate situations where the user does not need to concentrate on operating the vehicle, allowing the user to learn how to use the vehicle functions at the right time. Furthermore, since the explanation display starts automatically without any user operation, convenience is improved and inconvenience for the user is reduced.

[0084] According to the vehicle function information provision system 100, by prohibiting the provision of explanatory displays for vehicle functions when the vehicle is stopped or not in autonomous driving mode, it is possible to prevent explanatory displays from being shown when the user should be concentrating on driving. Furthermore, according to the vehicle function information provision system 100, by automatically starting the display of explanatory displays for vehicle functions to the user when all obstacles around the vehicle are stationary or when there are no obstacles around the vehicle, the user can receive explanations of vehicle functions at an appropriate time. As a result, users can more easily understand how to use the vehicle functions and improve the utilization rate of vehicle functions.

[0085] According to the vehicle function information provision system 100, if it determines that the viewing prohibition condition is met based on the vehicle's driving state or the condition of obstacles around the vehicle, the provision of explanatory displays for vehicle functions is prohibited. This prevents the system from suggesting or automatically starting explanatory displays in situations where the driving state or external environment is inappropriate, thus avoiding causing inconvenience to the user. Specifically, according to the vehicle function information provision system 100, if it determines that the viewing prohibition condition is met when the vehicle is in reverse or when there is a moving obstacle within the vehicle's proximity detection distance, the provision of explanatory displays for vehicle functions is prohibited. This prevents the system from suggesting or automatically starting explanatory displays in situations where the user should be paying attention to their surroundings.

[0086] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above. The present invention can be implemented in various forms, starting with the embodiments described above, by making various changes and improvements based on the knowledge of those skilled in the art.

[0087] The vehicle function information provision system 100 does not necessarily need to authenticate the user's personal information. The vehicle function information provision system 100 is not required to determine whether or not to display a vehicle function explanation based on the user's past viewing history of vehicle function explanations. In this case, the driver monitor camera 1 is also unnecessary.

[0088] The vehicle function information provision system 100 may provide a display of vehicle function explanations when the user initiates a start operation, regardless of the vehicle's driving status. The vehicle function information provision system 100 may not provide a display of vehicle function explanations when the vehicle is in autonomous driving mode. When the vehicle is in autonomous driving mode, the vehicle function information provision system 100 may provide a display of vehicle function explanations only when the vehicle has a driving plan that involves driving on a straight road for a certain period of time or longer.

[0089] The information provision unit 14 is not necessarily required to suggest to the user that the display of vehicle function explanations begin. Similarly, the information provision unit 14 is not necessarily required to automatically start the display of vehicle function explanations to the user. The information provision unit 14 is not necessarily required to determine the conditions for prohibiting viewing. [Explanation of symbols]

[0090] 1...Driver monitor camera, 2...Vehicle speed sensor, 3...Clearance sonar, 4...Radar sensor, 5...External camera, 6...HMI, 6a...Display, 6b...Speaker, 10...Control ECU, 11...Personal authentication unit, 12...Driving state recognition unit, 13...External environment recognition unit, 14...Information provision unit.

Claims

1. A vehicle function information provision system that provides explanatory displays of vehicle functions to users riding in a vehicle, If there is an approaching obstacle among the obstacles surrounding the vehicle, the provision of explanatory displays for the vehicle's functions is prohibited. A vehicle function information provision system that allows the provision of a display explaining the vehicle function when the aforementioned approaching obstacle is not present among the obstacles surrounding the vehicle.

2. The vehicle function information provision system according to claim 1, which, when there are obstacles moving around the vehicle but the approaching obstacle is not among the obstacles around the vehicle, proposes to the user the start of displaying an explanation of the vehicle functions.

3. Based on the user's personal authentication results, the user's past viewing history of the vehicle function descriptions is obtained. The vehicle function information provision system according to claim 1 or 2, wherein if the number of times the user has viewed the vehicle function explanation display in the past is equal to or greater than a determination threshold, or if the user has viewed the vehicle function explanation display within a set period, the vehicle function explanation display is not displayed to the user.

4. The vehicle function information provision system according to claim 1 or 2, wherein the provision of explanatory displays for the vehicle functions is prohibited when the vehicle is stopped or when the vehicle is not in autonomous driving mode.

5. The vehicle function information provision system according to claim 4, which automatically starts providing the user with an explanatory display of the vehicle functions when all obstacles around the vehicle are stopped, or when there are no obstacles around the vehicle.

6. Based on the vehicle's driving status or the condition of obstacles around the vehicle, it is determined whether or not the pre-set conditions for prohibiting viewing are met. The vehicle function information provision system according to claim 4, which prohibits providing the user with the explanation display of the vehicle function when it is determined that the aforementioned viewing prohibition conditions are met.

7. The vehicle function information provision system according to claim 6, which determines that the viewing prohibition condition is met when the vehicle is in a reversing state or when there is a moving obstacle within the proximity determination distance of the vehicle.

8. A method for providing vehicle function information for a vehicle function information provision system that provides explanatory displays of vehicle functions to users riding in a vehicle, The aforementioned vehicle function information provision system prohibits the provision of explanatory displays for the vehicle function if there is an approaching obstacle among the obstacles surrounding the vehicle. A method for providing vehicle function information, which allows the provision of a display explaining the vehicle function if the aforementioned approaching obstacle is not present among the obstacles surrounding the vehicle.

Images