Guidance device, guidance control device, guidance method, and program

JP7584377B2Active Publication Date: 2024-11-15HONDA MOTOR CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2021139091
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-27
Publication Date
2024-11-15
Estimated Expiration
2041-08-27

AI Technical Summary

Benefits of technology

【0017】 上記(1)~(10)の態様によれば、ユーザが余裕を持った状態で運転支援機能について案内することができる。 上記(5)の態様によれば、ユーザに、走行開始後において運転支援機能を作動させるための案内を好適に行うことができ、速やかに運転支援機能を利用させることができる。 上記(6)の態様によれば、ユーザに、周辺環境に応じた好適な運転支援機能を選択させることができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007584377000001
    Figure 0007584377000001
  • Figure 0007584377000002
    Figure 0007584377000002
  • Figure 0007584377000003
    Figure 0007584377000003
Patent Text Reader

Abstract

To provide a guiding device, a guidance control device, a guiding method, and a program which can guide a driving support function in a state in which a user is in good time.SOLUTION: A guiding device is installed in a mobile object, and comprises: an output device including a display device; an input device which accepts an operation of a crew member of the mobile object for starting each of a plurality of driving support functions with which the mobile object is equipped; and a guidance control device which determines whether the mobile object is being stopped or is moving and allows display of a moving image for explaining any of the plurality of driving support functions on the display device when the mobile object is being stopped.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a guidance device, a guidance control device, a guidance method, and a program. [Background technology]

[0002] Driving assistance functions that provide various driving assistance to improve safety and convenience when a person drives a vehicle have been put to practical use. Highly developed driving assistance functions are sometimes called ADAS (Advanced Driver-Assistance Systems) functions. However, vehicles in recent years have become multifunctional, and it may take time for users after delivery to understand the ADAS functions equipped in the vehicle and select the appropriate function. As a result, users may not be able to fully use the ADAS functions.

[0003] In relation to this, an invention has been disclosed of a device that explains the functions of in-vehicle equipment to a user through an in-vehicle equipment function explanation device that includes a storage means for storing descriptions of various functions of the in-vehicle equipment, a determination means for determining whether the situation is favorable for using the various functions, and a presentation means for presenting an explanation of the function when it is determined that the situation is favorable for using the function (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-261703 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology described in Patent Document 1, guidance is provided mainly while the vehicle is moving, so that the user may not be able to receive guidance on the driving assistance function in a relaxed state.

[0006] The present invention has been made in consideration of the above circumstances, and one of its objectives is to provide a guidance device, a guidance control device, a guidance method, and a program that can provide guidance about driving assistance functions to a user with ample time to spare. [Means for solving the problem]

[0007] The guidance device, guidance control device, guidance method, and program according to the present invention employ the following configuration. (1): A guidance device according to one embodiment of the present invention is a guidance device installed on a moving body, and includes an output device including a display device, an input device that accepts operations by an occupant of the moving body to activate each of a plurality of driving assistance functions equipped on the moving body, and a guidance control device that determines whether the moving body is stopped or moving, and, if the moving body is stopped, allows the display device to display a video explaining one of the plurality of driving assistance functions.

[0008] (2) In the above aspect (1), the guidance control device causes the display device to display the video including operation guidance for the input device.

[0009] (3): In the above aspect (2), the video is divided into a plurality of steps, and the guidance control device advances the video to the next step in response to the occupant performing an operation on the input device in accordance with the operation guidance for a certain step.

[0010] (4): In any of the above aspects (1) to (3), the guidance control device refers to playback history information of the video stored in a memory unit, and, for the driving assistance function for which the corresponding video has been displayed, when the moving body is moving, causes the output device to output guidance information in the form of still images and / or audio to explain the start-up or activation operation of the driving assistance function.

[0011] (5): In the above aspect (4), the vehicle further includes an occupant recognition unit that recognizes occupants of the vehicle, the playback history information is generated for each recognized occupant, and the guidance control device refers to information in the playback history information corresponding to the recognized occupant.

[0012] (6): In the above aspect (2), a surrounding environment detection device is further provided for detecting the surrounding environment of the moving body, and the guidance control device selects a driving assistance function to guide the occupant to operate based on the surrounding environment detected using the surrounding environment detection device and with reference to vehicle status information obtained via an in-vehicle communication line.

[0013] (7): In the above aspect (2), the guidance control device refers to vehicle status information obtained from the driving assistance device via the in-vehicle communication line, and selects a driving assistance function to guide the occupant to operate.

[0014] (8): A guidance control device according to another aspect of the present invention is a guidance control device installed in a moving body, and includes a determination unit that determines whether the moving body is stopped or moving, and a guidance control unit that, when it is determined that the moving body is stopped, allows a display device installed in the moving body to display a video explaining the operation of starting one of the multiple driving assistance functions on an input device that accepts operations by an occupant of the moving body to start each of the multiple driving assistance functions equipped in the moving body.

[0015] (9): A guidance method according to another aspect of the present invention includes a guidance control device for a guidance device that is installed on a moving body and includes an output device including a display device and an input device that accepts operations by an occupant of the moving body to activate each of a plurality of driving assistance functions equipped on the moving body, the guidance control device determining whether the moving body is stopped or moving, and if the moving body is stopped, allowing the display device to display a video explaining the operation of activating any of the plurality of driving assistance functions on the input device.

[0016] (10): A program according to another aspect of the present invention causes a guidance control device of a guidance device that is installed in a moving body and that has an output device including a display device and an input device that accepts operations by an occupant of the moving body to activate each of a plurality of driving assistance functions equipped on the moving body to determine whether the moving body is stopped or moving, and if the moving body is stopped, allows the display device to display a video explaining the operation of activating any of the plurality of driving assistance functions via the input device. Effect of the Invention

[0017] According to the above aspects (1) to (10), the user can be provided with guidance regarding the driving support function in a relaxed state. According to the above aspect (5), it is possible to preferably provide the user with guidance for activating the driving assistance function after starting driving, and to allow the user to promptly use the driving assistance function. According to the above aspect (6), it is possible to allow the user to select a suitable driving assistance function according to the surrounding environment. [Brief description of the drawings]

[0018] [Figure 1] 1 is a diagram showing an example of a configuration of devices mounted on a vehicle, with a guide device 1 at the center. [Diagram 2] FIG. 4 is a diagram showing an example of the contents of occupant information 61. [Diagram 3] 13 is a diagram showing an example of an introduction screen of the guidance device 1 displayed on the display device 32. FIG. [Figure 4] 13 is a diagram showing an example of an introduction screen of the guidance device 1 displayed on the display device 32. FIG. [Diagram 5] 13 is a diagram showing an example of a screen displayed on the display device 32 to prompt the user to customize the guidance device 1. FIG. [Figure 6] 5 is a flowchart showing an example of the contents of processing executed by the guidance control device 50 and the driving assistance control device 100 regarding a comfort assistance function. [Figure 7]FIG. 13 is a diagram illustrating an example of a driving support function list screen. [Figure 8] FIG. 13 is a diagram showing an example of an explanatory screen regarding a comfort support function. [Figure 9] 13 is a diagram for explaining an overview of a usage instruction video corresponding to a comfort support function. FIG. [Figure 10] FIG. 13 is a diagram showing an example of the operation of the "output device" when the ACC function is recommended and selected by the occupant. [Figure 11] 6 is a flowchart showing an example of control performed by the guidance control device 50 with respect to a safety support function provided by the driving support control device 100. [Figure 12] 10 is a flowchart showing another example of the contents of the processing executed by the guidance control device 50 and the driving assistance control device 100 regarding the comfort assistance function. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, with reference to the drawings, an embodiment of a guidance device, a guidance control device, a guidance method, and a program of the present invention will be described. The guidance device is mounted on a moving body. The moving body in the present invention is, for example, an object that moves on a road by power and can be driven by a person. In addition, the moving body is equipped with a driving assistance function. In the following description, it is assumed that the moving body is a vehicle.

[0020] [Overall configuration] FIG. 1 is a diagram showing an example of the configuration of devices mounted on a vehicle, mainly a guidance device 1. The guidance device 1 provides guidance to a driver (or an operator) of the vehicle about driving assistance functions of the vehicle. The guidance device 1 includes, for example, a surrounding environment detection device 10, an input device 20, a display unit 30, a vehicle sensor 40, and a guidance control device 50. The vehicle is further equipped with a driving assistance control device 100. These devices and devices are connected to each other by multiple communication lines such as a CAN (Controller Area Network) communication line (a type of in-vehicle communication line), serial communication lines, wireless communication networks, etc. For example, the guidance control device 50 acquires the activation state of the driving assistance function that can be activated from the driving assistance control device 100 or the like via the CAN communication line. Note that the configuration shown in FIG. 1 is merely an example, and part of the configuration may be omitted, or another configuration may be added.

[0021] The surrounding environment detection device 10 is a device for detecting the surrounding environment of a vehicle. The surrounding environment detection device 10 includes, for example, a vehicle position recognition device 12 including a GPS receiver and map information, a radar device 14, and an exterior camera 16. The vehicle position recognition device 12 recognizes the position of the vehicle and matches it with the map information. The radar device 14 emits radio waves such as millimeter waves around the vehicle and detects radio waves (reflected waves) reflected by an object to detect at least the position (distance and direction) of the object. The radar device 14 is attached to an arbitrary location of the vehicle. The radar device 14 may detect the position and speed of the object by a frequency modulated continuous wave (FM-CW) method. The exterior camera 16 is, for example, a digital camera using a solid-state image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The exterior camera 16 is attached to an arbitrary location of the vehicle. When capturing an image of the front, the exterior camera 16 is attached to the top of the front windshield, the back of the rearview mirror, or the like. The exterior camera 16 periodically and repeatedly captures images of the surroundings of the vehicle. The exterior camera 16 may be a stereo camera. The surrounding environment detection device 10 outputs the detection results to the driving assistance control device 100 and the guidance control device 50.

[0022] The input device 20 accepts operations (including pseudo operations following guidance from the guidance device 1) performed by a vehicle occupant to activate a driving assistance function. The input device 20 outputs information indicating the contents of the accepted operations to the guidance control device 50 and the driving assistance control device 100. In this embodiment, the input device 20 includes switches on the steering wheel or instrument panel, or GUI (Graphical User Interface) switches set on a display unit, or other vehicle switches that can obtain operation contents directly as CAN signals or from various control devices. The input device 20 may also include a driving operator such as an accelerator pedal.

[0023] The display unit 30 includes, for example, a display device 32 that displays images, a speaker 34 that emits sound, and an in-vehicle camera 36 that captures the space inside the vehicle. The combination of the display device 32 and the speaker 34 is an example of an "output device." The in-vehicle camera 36 captures images of at least the heads (faces) of passengers seated in the driver's seat or the passenger seat. The display device 32 may be a touch panel.

[0024] The vehicle sensor 40 includes a speed sensor that detects the speed of the vehicle, an acceleration sensor that detects the acceleration, a yaw rate sensor that detects the angular velocity around a vertical axis, an orientation sensor that detects the orientation of the vehicle, and the like.

[0025] Before describing the guidance control device 50, we will describe driving assistance functions that can be provided by the driving assistance control device 100. The driving assistance control device 100 has, for example, the following driving assistance functions. Although FIG. 1 shows the driving assistance control device 100 as if there is one driving assistance control device 100, there may be one or more driving assistance control devices 100 for each driving assistance function. (1): ACC (Adaptive Cruise Control) function: This function enables the vehicle to automatically accelerate and decelerate within a preset speed range, maintaining an appropriate distance from the vehicle in front and reducing the burden on the driver. (2): CC (Cruise Control) function: A function that maintains a constant vehicle speed. (3) Lane Keeping Assist System (LKAS): This function assists in steering to keep the vehicle in the center of the lane when driving on expressways, reducing the burden on the driver. (4) CMBS (Collision Mitigation Braking System) function: This function provides step-by-step assistance to avoid collisions with vehicles in front, pedestrians, and oncoming vehicles, or to mitigate damage caused by such collisions. (5): RDM (Road Departure Mitigation) function: This function prevents the vehicle from going out of its lane and provides steering assistance to return the vehicle to its lane. (6): BSI (Blind Spot Information) function: This function detects vehicles diagonally behind the vehicle, which are often in blind spots while driving, and reduces the burden on the driver by alerting the driver. (7) PKS (Parking sensor system) function: This function reduces the burden on the driver by detecting obstacles in front of or behind the vehicle when parking or leaving a parking space, or when making right or left turns in narrow alleys, etc., and alerts the driver. (8): LSAEB (Low Speed ​​Automatic Emergency Braking) function: A general term for the false start prevention function and the false rear start prevention function. This function detects obstacles in front and behind the vehicle when the vehicle is stopped or traveling at a low speed, and suppresses sudden acceleration when the driver steps on the accelerator. The group of driving assistance functions exemplified above is merely an example, and the vehicle may be equipped with any combination of driving assistance functions, and may be equipped with other driving assistance functions not exemplified.

[0026] [Guidance control device] The guidance control device 50 includes, for example, a determination unit 51, an occupant recognition unit 52, a guidance control unit 53, and a storage unit 60. The determination unit 51, the occupant recognition unit 52, and the guidance control unit 53 are each realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (non-transient storage medium) such as a DVD or a CD-ROM, and installed in the storage device by mounting the storage medium in a drive device. The guidance control device 50 performs processing while sharing information with the driving assistance control device 100 through communication, and may be included in the driving assistance control device 100.

[0027] The storage unit 60 is realized by a non-transient storage device such as a HDD, a flash memory, a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The storage unit 60 stores information such as passenger information 61 and guidance information 62 (video, still images, audio).

[0028] The determination unit 51 determines whether the vehicle is stopped or moving. For example, the determination unit 51 determines whether the vehicle is stopped or moving based on information collected by some or all of the speed sensor included in the vehicle sensor 40, the vehicle position recognition device 12, and the exterior camera 16. For example, the determination unit 51 determines that the vehicle is stopped when the output of the speed sensor indicates zero and the position information output by the GPS receiver is unchanged or the degree of change in the image captured by the exterior camera 16 is small, and otherwise determines that the vehicle is moving.

[0029] The occupant recognition unit 52 recognizes who the occupants are in the vehicle (recognizes the occupants) based on, for example, an image of the occupant captured by the in-vehicle camera 36. The occupant recognition unit 52 recognizes the occupants based on, for example, occupant information 61 stored in the storage unit 60. FIG. 2 is a diagram showing an example of the contents of the occupant information 61. The occupant information 61 is, for example, information in which an occupant ID, which is identification information of the occupant, is associated with a judgment image captured in advance or image features and playback history information of videos, still images, and audio. The playback history information will be described later.

[0030] The occupant recognition unit 52 compares the image of the occupant captured by the in-vehicle camera 36 (or the feature amount derived from the image) with the image for judgment (or the feature amount of the image for judgment), and if the similarity is equal to or exceeds a criterion, recognizes that the occupant captured in the image captured by the in-vehicle camera 36 is an occupant having an occupant ID registered in the occupant information 61. If the image of the occupant captured by the in-vehicle camera 36 (or the feature amount derived from the image) does not match the image for judgment (or the feature amount of the image for judgment), the occupant recognition unit 52 recognizes that the occupant is an occupant who has not been imaged before, and adds the image of the occupant captured as a new occupant (or the feature amount derived from the image) as the image for next judgment (or the feature amount of the image for judgment) to the occupant information 61 in association with the newly issued occupant ID. Note that, as a method of registering a new occupant, it is possible to refer to the occupant information registered on the display unit 30.

[0031] The "playback history information" of the occupant information 61 is information that stores when (date and time) and in what guidance format (video / still image / audio) guidance for each driving assistance function was activated for each occupant ID. In addition to (or instead of) the playback history information, the occupant information 61 may also include playback information for each driving assistance function. The "playback information for each driving assistance function" is information that compiles the number of times that video, still images, and audio have been played and activated for each driving assistance function.

[0032] The "CAN signal history information" of the occupant information 61 is, for example, a history of information transmitted and received between the driving assistance control device 100 and the guidance control device 50, and elsewhere via an in-vehicle bus such as a CAN communication line, and is information that enables the usage history of each driving assistance function to be recognized.

[0033] The guidance control unit 53 controls the display device 32 and the speaker 34 of the output device 33 based on, for example, the driving state of the vehicle, the occupant information 61, and the guidance information 62 determined by the determination unit 51. The guidance information 62 is information such as video, still images, and audio for each driving support function.

[0034] In this embodiment, the driving assistance functions that can be provided by the driving assistance control device 100 are classified into, for example, a comfort assistance function and a safety assistance function. The guidance device 1 provides guidance regarding the comfort assistance function while the vehicle is stopped and while the vehicle is traveling. The guidance device 1 provides guidance regarding the safety assistance function only while the vehicle is stopped. The comfort assistance function is a function that assists driving while traveling and is a function that requires operation while traveling. Furthermore, the passenger can turn the comfort assistance function on / off at any timing. The safety assistance function is a function that is automatically activated when the vehicle is in a dangerous situation and is a function that does not require operation while traveling. Furthermore, in consideration of safety and security, it is set to on as standard at the time of shipment.

[0035] [Introduction] A description will now be given of a method for providing information about the driving support function by the guidance device 1. First, as an introductory explanation, the guidance device 1 provides, for example, the following information depending on the information notification situation. (A): When the current day is within a first period after the purchase of the vehicle, when the vehicle system is started, the guidance device 1 displays an introduction screen as shown in Fig. 3 on the display device 32. When a predetermined operation is performed on the input device 20 while this screen is displayed, the guidance device 1 goes into full operation. (B): When the current day is within a second period after the purchase of the vehicle, when the vehicle system is started, the guidance device 1 causes the display device 32 to display an introduction screen as shown in Fig. 4. When a predetermined operation is performed on the input device 20 while this screen is displayed, the guidance device 1 causes the display device 32 to display a video introducing a specific driving assistance function. (C): When a certain driving assistance function (here, a preceding vehicle approach warning) has been used, the guidance device 1 causes the display device 32 to display a screen prompting the user to make customization settings for that driving assistance function, as shown in FIG. 5.

[0036] [Information about comfort support functions] 6 is a flowchart showing an example of the process executed for the comfort support function by the guidance control device 50 and the driving support control device 100. The process of this flowchart is started, for example, when the vehicle system is started, and is repeatedly executed for each control cycle.

[0037] First, the occupant recognition unit 52 recognizes an occupant in the vehicle (here, this refers to an occupant sitting in the driver's seat) (step S300). The occupant recognition unit 52 determines whether or not the occupant shown in the image captured by the in-vehicle camera 36 is an occupant previously registered in the occupant information 61 (step S302), and if the occupant is not previously registered in the occupant information 61, registers the information of the occupant as a new occupant in the occupant information 61 (step S303).

[0038] Next, as described above, the determination unit 51 determines whether the vehicle is stopped or moving (step S304).

[0039] If it is determined that the vehicle is stopped, the guidance control unit 53 causes the display device 32 to display an introductory explanation regarding the guidance device 1, as described above (step S306).

[0040] Next, the guidance control unit 53 acquires and refers to playback information for each driving support function corresponding to the occupant ID of the occupant recognized in step S300 (step S308). Then, the guidance control unit 53 acquires the driving support functions installed in the vehicle, and when the guidance device 1 is in full operation, causes the display device 32 to display a driving support function list screen (step S310). Here, if the occupant has received sufficient guidance on the driving support function to which the occupant is to be guided (for example, if the number of times guidance is provided is greater than a reference value), the subsequent processing may be skipped and the processing of the flowchart may be terminated.

[0041] FIG. 7 is a diagram showing an example of a driving support function list screen. As shown in the figure, the driving support function list screen is a screen that lists driving support functions that are targets for video playback. For example, the guidance control unit 53 extracts driving support functions for which the video has not been played back, or driving support functions for which the video has been played back less than a predetermined number of times and still images / audio have not been played back, based on the playback information for each driving support function corresponding to the occupant ID of the acquired occupant, and causes the display device 32 to display a list screen listing the extracted driving support functions. The areas representing the driving support functions on the driving support function list screen are GUI switches that can be selected by the occupant.

[0042] When the occupant selects one of the driving support functions included in the driving support function list screen, the guidance control unit 53 causes the display device 32 to display an explanatory screen relating to the selected comfort support function (step S312). FIG. 8 is a diagram showing an example of an explanatory screen relating to a comfort support function. The example in this figure shows an explanatory screen relating to the ACC function, which is one of the comfort support functions. For this explanatory screen, the occupant can select, for example, two routes, "Customize" and "How to use". When the occupant selects "Customize", the guidance control unit 53 transitions the current display screen to a customization setting screen. When the occupant selects "How to use", the guidance control unit 53 causes a video explaining how to use the selected comfort support function to be played, divided into steps.

[0043] The process of the flowchart will be described below assuming that the occupant has selected "How to use." In this case, as described above, the guidance control unit 53 plays the instruction video for how to use the selected comfort support function, dividing it into steps (step S314). FIG. 9 is a diagram for explaining an overview of the instruction video for how to use the comfort support function. The instruction video for how to use the comfort support function is divided into a number of chapters (steps) (three in the figure: chapters 1 to 3), and the occupant can proceed to the next chapter by performing the operations guided in each chapter.

[0044] Then, the guidance control device 50 judges whether or not all the operations guided by the display device 32 in the usage video for each chapter have been performed (step S316). If all the operations guided by the display device 32 have been performed, the driving assistance control device 100 starts up a comfort assistance function related to the operations (step S318).

[0045] The driving assistance control device 100 activates the comfort support function when the comfort support function is started and predetermined conditions related to the vehicle speed, etc. are satisfied. Even if it is determined that the vehicle is stopped and the comfort support function is started, the driving assistance control device 100 does not activate the comfort support function when it determines that the vehicle speed, etc. does not satisfy the predetermined conditions. Next, the guidance control device 50 displays information on the display device 32 to notify the occupant of the conditions that the vehicle needs to satisfy in order to activate the comfort support function (step S320).

[0046] Next, the guidance control unit 53 updates the playback history information and the playback information for each driving support function in the occupant information 61 (S322). This completes one cycle of the processing in this flowchart. Note that if the operation guided by the display device 32 in the usage video for each chapter is not all performed and an instruction to end the guidance is given by some operation, the playback history information and the playback information for each driving support function in the occupant information 61 may or may not be updated.

[0047] On the other hand, if it is determined in step S304 that the vehicle is traveling, the guidance control unit 53 uses the surrounding environment detection device 10 to determine the surrounding environment of the vehicle (step S324). Here, the guidance control unit 53 determines, for example, the type of road on which the vehicle is located as the surrounding environment. In addition to the type of road, the guidance control unit 53 may determine the traffic volume, the number of pedestrians, the weather, the time of day, road dividing lines, lane boundaries, etc. as the surrounding environment. For example, the guidance control unit 53 determines the type of road based on the type of road dividing lines, the presence of bulkheads, signboards, etc., captured in the image captured by the exterior camera 16 as a result of searching map information using position information measured by the GPS receiver.

[0048] The guidance control unit 53 determines whether the occupant has permitted the driving support function to be recommended (step S326). If it is determined that the occupant has permitted the driving support function to be recommended, the guidance control unit 53 determines whether the occupant has learned the driving support function (step S328). If it is determined that the driving support function has been learned, the guidance control unit 53 determines whether the driving support function can be activated (step S330). If it is determined that the driving support function can be activated, the guidance control unit 53 determines whether the number of times the driving support function has been guided is equal to or less than a reference value (step S332). If it is determined that the number of times the driving support function has been guided is equal to or less than a reference value, the guidance control unit 53 proceeds to step S334. If it is determined that any of the above four determination conditions (steps S326 to S332) is not satisfied, the guidance control unit 53 updates the playback history information and the playback information for each driving support function in the occupant information 61 (S322), and one cycle of the processing of this flowchart ends.

[0049] If it is determined that all the determination conditions in steps S326 to S332 are satisfied, the guidance control device 50 determines whether or not a comfort support function that matches the surrounding environment determined in step S324 (hereinafter, simply referred to as comfort support function) has been activated (step S334). If the comfort support function has been activated, the guidance control device 50 and the driving support control device 100 determine whether or not the conditions (environmental conditions) for activating the comfort driving support function selected in step S336 are satisfied (step S342). For example, the environmental conditions necessary for activating the selected comfort support function are that the vehicle speed is within a specified range, the road dividing lines on the left and right of the vehicle are recognized and the vehicle is traveling near the center between them, the curvature of the road is equal to or less than a reference value, and the turn signal is not activated.

[0050] If the conditions for activating the comfort driving support function are satisfied, the driving support control device 100 activates the comfort support function (step S346). If the conditions for activating the comfort driving support function are not satisfied, the guidance control device 50 causes the display device 32 to display information informing the occupant of the conditions that must be satisfied for the comfort support function to be activated (step S344), and performs the determination of step S342 again.

[0051] If it is determined in step S334 that the comfort support function is not activated, the guidance control device 50 selects one or more comfort support functions based on the determined road environment, and displays information recommending the selected comfort support function to the occupant on the display device 32 (step S336). For example, the guidance control unit 53 displays an image showing the recommended comfort support function in the form of a GUI switch on the display device 32, allowing the occupant to select it.

[0052] When the occupant selects a comfort support function displayed on the display device 32, the guidance control unit 53 causes the "output device" to output still guidance images and / or voice guidance in steps (step S338). For example, when it is determined that the vehicle is traveling on an expressway, the guidance control unit 53 recommends the ACC function. FIG. 10 is a diagram showing an example of the operation of the "output device" when the ACC function is recommended as an example and selected by the occupant.

[0053] As shown in FIG. 10, the guidance control unit 53 causes the display device 32 to display a still image that guides the occupant on the operation to be performed on the input device 20, and causes the speaker 34 to output a voice guidance corresponding to the still image. For example, for a still image 1, the guidance control unit 53 causes the display device 32 to display a still image 1 of operation guidance, "Please press the switch once," and causes the speaker 34 to output a voice guidance 1, "Please press the switch once." Then, when the occupant operates a predetermined part of a switch (hereinafter, a steering switch) provided on the steering wheel according to the operation guidance provided by the still image 1 and the voice guidance 1, the guidance control unit 53 causes the display device 32 to switch the still image 1 to a still image 2 of the next step, and causes the speaker 34 to output a voice guidance 2 corresponding to the still image 2. For example, in the still image 2, the guidance control unit 53 displays the still image 2 of the operation guidance "When the speed reaches the speed you want to maintain, push the SET / RES switch down" on the display device 32 and outputs the voice guidance 2 "When the speed reaches the speed you want to maintain, push the SET / RES switch down" to the speaker 34. Then, when the occupant performs an operation corresponding to the operation guidance provided by the still image 2 and the voice guidance 2, if the speed at that time matches the predetermined condition for activating the ACC function, the guidance control unit 53 causes the display device 32 to switch the still image 2 to the still image 3 of the next step and outputs the voice guidance 3 corresponding to the still image 3 to the speaker 34. For example, in the still image 3, the guidance control unit 53 displays the result "The ACC function has been activated" on the display device 32 and outputs the voice guidance 3 "The ACC function has been activated" to the speaker 34. If the speed at the above time does not match the predetermined condition for activating the ACC function, an error message may be output. In addition, since the operation of the same function varies depending on the model and year of the vehicle, an operation method suitable for the design and operation method of the vehicle owned may be presented.

[0054] In the operation of FIG. 10, if the comfort support function is already in an activated state, playback may start from still image 2 instead of still image 1.

[0055] Next, the guidance control device 50 determines whether or not all operations guided by the display device 32 and the speaker 34 for each step of the guidance image have been performed (step S340). If all operations guided by the display device 32 and the speaker 34 have been performed, the comfort support function selected in step S336 has been activated and operations required for activation have been performed, or the comfort support function selected in step S336 has already been activated and operations required for activation have been performed.

[0056] Next, the guidance control device 50 and the driving assistance control device 100 judge whether or not the conditions (environmental conditions) for activating the comfort support function selected in step S336 are satisfied (step S342). If the conditions for activating the comfortable driving support function are satisfied, the driving assistance control device 100 activates the comfort support function (step S346). If the conditions for activating the comfortable driving support function are not satisfied, the guidance control device 50 displays information on the display device 32 notifying the occupant of the conditions that must be satisfied for the comfort support function to be activated (step S344), and performs the judgment of step S342 again.

[0057] Finally, the guidance control unit 53 updates the playback history information and the playback information for each driving support function in the occupant information 61 (S322), and ends one cycle of the processing of this flowchart. Note that, if the operation guided by the display device 32 and the speaker 34 for each step of the guidance image is not all performed and an instruction to end the guidance is given by some operation, the playback history information and the playback information for each driving support function in the occupant information 61 may or may not be updated.

[0058] [Safety support function] The comfort support function has been described above. Below, the control performed in relation to the safety support function provided by the driving support control device 100 will be described.

[0059] 11 is a flowchart showing an example of control performed by the guidance control device 50 for the safety support function provided by the driving support control device 100. The processing of this flowchart is started when the vehicle system is started, and is repeatedly executed for each control cycle, similar to the control performed for the comfort support function.

[0060] The processing of steps S400 to S410 in this flowchart is the same as the processing of steps S300 to S310 in Fig. 6, and therefore description thereof will be omitted. If it is determined in step S404 that the vehicle is traveling, the safety support function is not activated, and one cycle of processing of this flowchart ends. If it is determined that the vehicle is stopped, when the occupant selects one of the safety support functions included in the driving support function list screen, the guidance control unit 53 causes the "output device" to output an introductory video / still image and audio related to the selected safety support function (step S412).

[0061] Similar to the control performed for the comfort support function described above, the guidance control unit 53 divides the introductory video for the selected safety support function into a plurality of chapters (steps) and plays them (step S412). Next, the guidance control unit 53 updates the playback history information in the occupant information 61 and the playback information for each driving support function (S414). This completes one cycle of the processing of this flowchart. The processing of the flowcharts of FIG. 6 and FIG. 11 may be integrated and executed as one process.

[0062] According to the embodiment described above, the guidance device 1 is installed in a vehicle and includes an "output device" including a display device 32 and a speaker 34, an input device 20 that receives operations from the occupant to activate each of the multiple driving assistance functions equipped in the vehicle, and determines whether the vehicle is stopped or moving, and if the vehicle is stopped, allows the display device 32 to display a video explaining one of the multiple driving assistance functions, so that after delivery of the vehicle, the user can receive guidance about the driving assistance functions equipped in the vehicle with ease.

[0063] In addition, according to the embodiment, when the vehicle is traveling, guidance information explaining the startup operation is output to the output device in the form of a still image and / or audio, thereby making it possible to provide optimal guidance for activating the driving assistance function after the vehicle has started traveling.

[0064] Furthermore, according to the embodiment, by further providing a surrounding environment detection device for detecting the surrounding environment, the user can select a suitable driving assistance function according to the surrounding environment.

[0065] (Modification of the embodiment) In the above embodiment, the occupant recognition unit 52 recognizes the occupant (driver) seated in the driver's seat, and provides guidance by referring to the occupant information 61 related to the driver. In the modified example described below, the occupant recognition unit 52 recognizes the occupant in the passenger seat, and performs processing by also referring to the occupant information 61 related to the occupant in the passenger seat. Specifically, based on the occupant information 61 (including information on the occupant in the driver's seat and the passenger seat), the guidance control device 50 skips guidance when there is an occupant in the passenger seat who has received sufficient guidance about the driving assistance function to be provided to the driver or who has been activated many times (when the number of times of guidance is greater than a reference value, or when the number of times of activation is greater than a reference value).

[0066] 12 is a flowchart showing an example of the process executed by the guidance control device 50 and the driving support control device 100 for the comfort support function, by further recognizing the passenger in the passenger seat and taking into consideration whether or not the passenger is skilled in the driving support function. The process of this flowchart is started, for example, when the vehicle system is started, and is repeatedly executed for each control cycle.

[0067] First, the occupant recognition unit 52 recognizes an occupant seated in the driver's seat of the vehicle (step S500). The occupant recognition unit 52 determines whether or not the occupant shown in the image captured by the in-vehicle camera 36 is an occupant previously registered in the occupant information 61 (step S502), and if the occupant is not previously registered in the occupant information 61, registers the information of the occupant as a new occupant in the occupant information 61 (step S503).

[0068] Next, the occupant recognition unit 52 recognizes an occupant seated in the passenger seat of the vehicle (step S504). Then, the determination unit 51 determines whether the vehicle is stopped or moving, as described above (step S506). If it is determined that the vehicle is moving, the processing executed by the guidance control device 50 and the driving assistance control device 100 is similar to the processing after step S324 in FIG. 6, and therefore the description will be omitted. If it is determined that the vehicle is stopped, the guidance control unit 53 causes the display device 32 to display an introductory explanation regarding the guidance device 1, as described above (step S508).

[0069] Next, the guidance control unit 53 acquires and refers to the playback information for each driving support function corresponding to the occupant ID of the occupant recognized in step S500 and step S504 (step S510). The guidance control unit 53 judges whether the passenger in the passenger seat is an expert in the driving support function to be introduced to the driver (step S512). An expert is a passenger in the passenger seat who has received a reference value or more of video, still image, and audio guidance for the driving support function to be introduced to the driver, or has started the function a reference value or more, based on the occupant information 61. If the passenger in the passenger seat is an expert, the guidance control unit 53 skips the guidance. If the passenger in the passenger seat is not an expert, the guidance control unit 53 acquires the driving support functions installed in the vehicle and displays a list screen on the display device 32 (step S514). The process from step S514 onwards is the same as the process from step S310 onwards in FIG. 6, and therefore will not be described.

[0070] 12, the driver's seat and the passenger's seat are recognized, and the comfort support function is described with the processing that takes into account the case where the passenger in the passenger's seat is an expert. The safety support function is similar, so the description is omitted.

[0071] According to the modified example of the embodiment described above, in addition to achieving the same effect as the embodiment, by determining whether the passenger in the passenger seat is an experienced person, if the passenger in the passenger seat is an experienced person, the user can quickly use the driving assistance function.

[0072] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0073] The above embodiment can be expressed as follows. A guidance control device that is installed in a moving body and communicates with an output device including a display device and an input device that receives an operation by a passenger of the moving body to activate each of a plurality of driving assistance functions equipped in the moving body, A storage device storing a program; a hardware processor; The hardware processor executes the program, determining whether the moving object is stationary or moving; When the moving object is stopped, a video for explaining any one of the plurality of driving assistance functions is displayed on the display device. A guidance control device configured as follows. [Explanation of symbols]

[0074] 10 Surrounding environment detection device 20 Input Devices 32 Display device 34 Speaker 40 Vehicle Sensors 50 Guidance control device 100 Driving assistance control device

Claims

1. A guide device installed on a moving body, an output device including a display device; an input device that receives an operation by a passenger of the moving body to activate each of a plurality of driving assistance functions equipped in the moving body; a guidance control device that determines whether the moving object is stopped or moving, and when the moving object is stopped, allows the display device to display a video that explains any one of the plurality of driving assistance functions; The guidance control device refers to playback history information of the video stored in a storage unit, and when the moving body is moving, causes the output device to output guidance information for explaining a start-up operation or an operation of the driving support function for which the corresponding video has been displayed, in the form of a still image and / or a sound. Guidance device.

2. An occupant recognition unit that recognizes an occupant of the moving body, the playback history information is generated for each of the recognized occupants; the guidance control device refers to information corresponding to the recognized occupant in the playback history information; The guidance device according to claim 1 .

3. The guidance control device causes the display device to display the video including operation guidance for the input device. A guide device according to claim 1 or 2.

4. The video is divided into several steps, the guidance control device advances the video to a next step in response to the occupant performing an operation on the input device in accordance with the operation guidance for a certain step; The guidance device according to claim 3.

5. The vehicle further includes a surrounding environment detection device for detecting a surrounding environment of the vehicle, The guidance control device selects a driving assistance function to be operated by the occupant based on the surrounding environment detected by the surrounding environment detection device and with reference to vehicle state information acquired via an in-vehicle communication line. The guidance device according to claim 3.

6. The guidance control device refers to vehicle status information acquired from the driving assistance device via an in-vehicle communication line, and selects a driving assistance function to be guided to the occupant. The guidance device according to claim 3.

7. A guidance control device installed in a moving body, A determination unit that determines whether the moving object is stopped or moving; a guidance control unit that, when it is determined that the moving body is stopped, allows a display device installed in the moving body to display a video explaining an operation of starting any one of a plurality of driving assistance functions on an input device that receives an operation by an occupant of the moving body to start each of the plurality of driving assistance functions, The guidance control device refers to playback history information of the video stored in a storage unit, and when the moving body is moving, outputs guidance information for explaining a start-up operation or an operation of the driving support function for which the corresponding video has been displayed, to an output device in the form of a still image and / or a sound. Guidance control device.

8. A guidance control device for a guidance device, the guidance control device including an output device including a display device and an input device for receiving an operation by a passenger of the moving body to activate each of a plurality of driving assistance functions equipped in the moving body, determining whether the moving object is stationary or moving; permitting the display device to display a video explaining an operation of activating any one of the plurality of driving assistance functions via the input device when the moving object is stopped; When the moving object is moving, referring to playback history information of the video stored in a storage unit, and outputting, to the output device, guidance information for explaining a start-up operation or an operation of the driving assistance function for which the corresponding video has been displayed, in the form of a still image and / or sound. How to guide.

9. A guidance control device for a guidance device including an output device including a display device and an input device for receiving an operation by a passenger of the moving body to activate each of a plurality of driving assistance functions equipped in the moving body, determining whether the moving object is stationary or moving; permitting the display device to display a video explaining an operation of activating any one of the plurality of driving assistance functions via the input device when the moving object is stopped; When the moving object is moving, the playback history information of the video stored in the storage unit is referenced, and for the driving assistance function for which the corresponding video has been displayed, guidance information for explaining the start-up operation or operation operation of the driving assistance function is output to the output device in the form of a still image and / or sound. program.

Citation Information

Patent Citations

  • System for explaining functions of on-vehicle equipment

    JP2008261703A

  • Voice recognition control system

    JP2017090613A

  • Drive supporting system

    JP2017167199A

  • Vehicle control system, vehicle control method and program

    JP2018203008A

  • Function explanation device, movable body, and function explanation method

    JP2020152157A