Guidance device, guidance control device, guidance method, and storage medium

Abstract

The present application provides a guidance device, a guidance control device, a guidance method, and a storage medium, in which a driving assistance function can be guided in a state where a user has a margin. The guidance device is provided in a moving body, wherein the guidance device includes an output device including a display device, an input device that accepts an operation of a passenger of the moving body for starting a plurality of driving assistance functions provided in the moving body, and a guidance control device that determines whether the moving body is in a stop or in a movement, and allows the display device to display a dynamic image for explaining an arbitrary driving assistance function of the plurality of driving assistance functions in a case where the moving body is in a stop.

Description

[0001] This application claims priority based on Japanese Patent Application No. 2021-139091, filed on August 27, 2021, the contents of which are incorporated herein by reference. Technical Field

[0002] This invention relates to a guiding device, a guiding control device, a guiding method, and a storage medium. Background Technology

[0003] As people drive, various driver assistance functions are becoming increasingly practical to improve safety and convenience. Highly developed driver assistance functions are sometimes called ADAS (Advanced Driver-Assistance Systems). However, with the increasing multi-functionality of vehicles in recent years, users sometimes spend time understanding the ADAS functions equipped in their vehicles and selecting the appropriate functions after delivery. As a result, users sometimes do not fully master the ADAS functions.

[0004] Relatedly, an invention is disclosed that discloses a device for explaining the functions of a vehicle-mounted device to a user via a vehicle-mounted device function explanation device. The vehicle-mounted device function explanation device includes: a storage unit that stores explanations of various functions of the vehicle-mounted device; a determination unit that determines whether it is a condition where it is preferred to use various functions; and a prompting unit that prompts the explanation of the function when it is determined that it is a condition where it is preferred to use the function (see Japanese Patent Application Laid-Open No. 2008-261703). Summary of the Invention

[0005] In the technology described in Japanese Patent Application Publication No. 2008-261703, guidance is specifically provided while the vehicle is in motion, so sometimes the user cannot receive guidance from the driving assistance function when there is sufficient leeway.

[0006] The present invention provides a guidance device, guidance control device, guidance method, and storage medium that enable driving assistance functions to be guided when the user has sufficient time.

[0007] The guiding device, guiding control device, guiding method, and storage medium of the present invention adopt the following structure.

[0008] (1): A guidance device of the present invention is disposed on a mobile body, wherein the guidance device comprises: an output device including a display device; an input device that receives an operation from an occupant of the mobile body to activate a plurality of driving support functions equipped on the mobile body respectively; and a guidance control device that determines whether the mobile body is stopped or moving, and when the mobile body is stopped, allows the display device to display a dynamic screen explaining any of the plurality of driving support functions.

[0009] (2): In the above (1) scheme, the guidance control device causes the display device to display the dynamic screen containing the operation guidance for the input device.

[0010] (3): In the above (2) scheme, the dynamic screen is divided into multiple steps. The guidance control device operates the input device according to the operation guidance of the passenger in a certain step, so that the dynamic screen enters the next step.

[0011] (4): In any of the above schemes (1) to (3), the guidance control device refers to the playback history information of the dynamic screen stored in the storage unit, and in the case of the moving body moving, causes the output device to output guidance information explaining the start operation or operation of the driving support function by means of still images and / or sound regarding the driving support function that has been displayed on the corresponding dynamic screen.

[0012] (5): In the above (4) scheme, there is also an occupant identification unit for identifying the occupants of the moving body, the playback history information is generated according to each identified occupant, and the guidance control device refers to the information in the playback history information corresponding to the identified occupant.

[0013] (6): In the above (2) scheme, a surrounding environment detection device is also provided for detecting the surrounding environment of the moving body. The guidance control device selects a driving support function to guide the occupant to operate based on the surrounding environment detected by the surrounding environment detection device and the vehicle status information obtained via the in-vehicle communication line.

[0014] (7): In the above (2) scheme, the guidance control device selects the driving support function to guide the occupant to operate by referring to the vehicle status information obtained from the driving support device via the in-vehicle communication line.

[0015] (8): Another aspect of the present invention includes a guidance control device disposed on a mobile body, wherein the guidance control device comprises: a determination unit that determines whether the mobile body is stopped or moving; and a guidance control unit that, when determining that the mobile body is stopped, allows a display device disposed on the mobile body to display a dynamic screen explaining a startup operation, wherein the startup operation refers to the startup operation of any one of the plurality of driving support functions performed on an input device receiving an operation from an occupant of the mobile body to activate a plurality of driving support functions equipped on the mobile body.

[0016] (9): Another aspect of the present invention provides a guidance method in which a guidance device disposed on a mobile body includes: an output device including a display device; and an input device that accepts an operation from an occupant of the mobile body to activate a plurality of driving support functions equipped on the mobile body respectively. The guidance method causes the guidance control device of the guidance device to perform the following processing: determining whether the mobile body is stopped or moving; and, if the mobile body is stopped, allowing the display device to display a dynamic screen explaining the activation operation, wherein the activation operation refers to the activation operation of any one of the plurality of driving support functions performed on the input device.

[0017] (10): Another aspect of the present invention includes a storage medium storing a program in which a guiding device disposed on a mobile body comprises: an output device including a display device; and an input device that accepts an operation from an occupant of the mobile body to activate a plurality of driving support functions equipped on the mobile body respectively. The program causes the guiding control device of the guiding device to perform the following processing: determining whether the mobile body is stopped or moving; and, if the mobile body is stopped, allowing the display device to display a dynamic screen explaining the activation operation, which refers to the activation operation of any one of the plurality of driving support functions performed on the input device.

[0018] According to the above schemes (1) to (10), the driving support function can be guided when the user has the time and energy.

[0019] According to the above scheme (5), users can be appropriately guided to make the driving support function work after driving begins, and users can quickly make use of the driving support function.

[0020] According to the above scheme (6), users can select appropriate driving support functions that correspond to the surrounding environment. Attached Figure Description

[0021] Figure 1 This diagram illustrates an example of the structure of a device mounted on a vehicle, centered around a guidance device.

[0022] Figure 2 This is an example diagram showing the content of passenger information.

[0023] Figure 3 This diagram illustrates an example of a display device showing an introductory screen for a guide device.

[0024] Figure 4 This diagram illustrates an example of a display device showing an introductory screen for a guide device.

[0025] Figure 5 This diagram illustrates an example of a display device showing a customized setting that prompts the guiding device.

[0026] Figure 6 This is a flowchart illustrating an example of the processing performed by the guidance control device and the driving support control device regarding the comfort support function.

[0027] Figure 7 This is an example of a screen showing an overview of driving support functions.

[0028] Figure 8 This is an example of an explanatory screen related to comfort support functions.

[0029] Figure 9 This is a diagram that provides an overview of the dynamic screen illustrating how to use the comfort support function.

[0030] Figure 10 This diagram illustrates an example of the operation of the "output device" when the ACC function is recommended and selected by the occupants.

[0031] Figure 11 This is a flowchart illustrating an example of control performed by the guidance control device regarding the safety support functions provided by the driving support control device.

[0032] Figure 12 This is another flowchart illustrating the processing performed by the guidance control device and the driving support control device in relation to the comfort support function. Detailed Implementation

[0033] Hereinafter, embodiments of the guiding device, guiding control device, guiding method, and storage medium of the present invention will be described with reference to the accompanying drawings. The guiding device is mounted on a mobile body. The mobile body of the present invention, for example, moves on a road by power and can be driven by a person. Furthermore, the mobile body is equipped with driving assistance functions. In the following description, the mobile body is a vehicle.

[0034] [Overall Structure]

[0035] Figure 1 This diagram illustrates an example of the structure of a device mounted on a vehicle, centered on a guidance device 1. The guidance device 1 provides driving support functions to the vehicle's driver (or operator). The guidance device 1 includes, for example, a surrounding environment detection device 10, an input device 20, a display unit 30, vehicle sensors 40, and a guidance control device 50. The vehicle also includes a driving support control device 100. These devices are interconnected via multiplexed communication lines such as CAN (Controller Area Network) communication lines (a type of in-vehicle communication line), serial communication lines, and wireless communication networks. For example, the guidance control device 50 obtains the activation status of the driving support functions that can be activated from the driving support control device 100 via the CAN communication line. It should be noted that... Figure 1 The structure shown is just one example; you can omit part of the structure or add other structures.

[0036] The surrounding environment detection device 10 is a device used to detect the surrounding environment of a vehicle. The surrounding environment detection device 10 includes, for example, a vehicle position recognition device 12 including a GPS receiver and map information; a radar device 14; and an external camera 16. The vehicle position recognition device 12 identifies the vehicle's position and matches it with map information. The radar device 14 emits millimeter-wave or other radio waves around the vehicle and detects the radio waves (reflected waves) reflected by objects to detect at least the position (distance and orientation) of the objects. The radar device 14 can be installed in any part of the vehicle. The radar device 14 can also detect the position and speed of objects using FM-CW (Frequency Modulated Continuous Wave) technology. The external camera 16 is, for example, a digital camera using a solid-state imaging element such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor). The external camera 16 can be installed in any part of the vehicle. When taking pictures of the front, the external camera 16 is installed on the upper part of the windshield, behind the rearview mirror inside the vehicle, etc. The exterior camera 16 periodically and repeatedly captures images of the vehicle's surroundings. The exterior camera 16 can also be a stereo camera. The surrounding environment detection device 10 outputs the detected results to the driver support control device 100 and the guidance control device 50.

[0037] Input device 20 accepts operations from vehicle occupants to activate driving assistance functions (including virtual operations performed under the guidance of guidance device 1). Input device 20 outputs information indicating the content of the received operation to guidance control device 50 and driving assistance control device 100. In this embodiment, input device 20 includes vehicle switches such as switches provided on the steering wheel, dashboard, etc., or GUI (Graphical User Interface) switches provided on the display unit, which can obtain operation content directly or from various control devices as other CAN signals. Input device 20 may also include driving operation components such as accelerator pedal.

[0038] The display unit 30 may include, for example, a display device 32 for displaying images, a speaker 34 for emitting sound, and an in-vehicle camera 36 for capturing images of the interior space of the vehicle. The display device 32 and the speaker 34 together constitute an example of an "output device." The in-vehicle camera 36 captures images of at least the head (face) of the occupants seated in the driver's seat and the front passenger seat. The display device 32 may also be a touch panel.

[0039] The vehicle sensor 40 includes a speed sensor for detecting the vehicle's speed, an acceleration sensor for detecting acceleration, a yaw rate sensor for detecting the angular velocity about the vertical axis, and an orientation sensor for detecting the vehicle's orientation.

[0040] Before describing the guidance control device 50, the driving support functions provided by the driving support control device 100 will be explained. The driving support control device 100 has, for example, the following driving support functions. Figure 1 The diagram shows the presence of a single driving support control device 100, but a driving support control device 100 may also exist for each or each of the driving support functions.

[0041] (1): ACC (Adaptive Cruise Control) function: It is a function that automatically accelerates and decelerates the vehicle within a preset speed range, and it is a function that maintains an appropriate distance from the vehicle in front while following the vehicle, thereby reducing the driver's driving load.

[0042] (2): CC (Cruise Control) function: This function maintains a certain vehicle speed.

[0043] (3): LKAS (Lane Keeping Assist System) function: When driving on highways, it supports steering operations by keeping the driver near the center of the lane, thus reducing the driver's driving load.

[0044] (4): CMBS (Collision Mitigation Braking System) function: It provides phased support for avoiding collisions with oncoming vehicles, pedestrians, and oncoming vehicles or for mitigating the damage to victims.

[0045] (5): RDM (Road Departure Mitigation) function: It is a steering support function that prevents vehicles from going out of the lane and returns them to the lane.

[0046] (6): BSI (Blind Spot Information) function: It is a function that detects vehicles diagonally behind the vehicle in blind spots that are easy to drive in, and reduces the driving load by urging the driver to pay attention.

[0047] (7): PKS (Parking sensor system) function: It is a function that reduces driving load by detecting obstacles in front of and behind the vehicle and prompting the driver to pay attention when parking, leaving the parking lot, or making left and right turns in narrow alleys.

[0048] (8): LSAEB (Low Speed ​​Automatic Emergency Braking) function: It is a general term for the wrong start suppression function and the rear wrong start suppression function. It is a function that detects obstacles in front and behind when the driver is stopped or driving at low speed and suppresses the rapid acceleration when the driver presses the accelerator pedal.

[0049] The above-described group of driving support functions is just one example. Driving support functions can be installed in any combination in a vehicle, and other driving support functions not shown can also be installed.

[0050] [Guidance Control Device]

[0051] The guidance control device 50 includes, for example, a determination unit 51, an occupant identification unit 52, a guidance control unit 53, and a storage unit 60. The determination unit 51, occupant identification unit 52, and guidance control unit 53 are each implemented by executing programs (software) using a hardware processor such as a CPU (Central Processing Unit). Some or all of these components can also be implemented using hardware (including circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), and GPU (Graphics Processing Unit), or through a combination of software and hardware. The program can be pre-stored in a storage device such as an HDD (Hard Disk Drive) or flash memory (a storage device with a non-transitory storage medium), or stored in a removable storage medium such as a DVD or CD-ROM (a non-transitory storage medium), and installed in the storage device by mounting the storage medium to a drive unit. The guidance control device 50 processes information while sharing it with the driving support control device 100 via communication, and may also be included within the driving support control device 100.

[0052] The storage unit 60 is implemented, for example, by a non-transitory storage device such as an HDD, flash memory, RAM (Random Access Memory), or ROM (Read Only Memory). The storage unit 60 stores, for example, occupant information 61 and guidance information 62 (moving images, still images, and sounds).

[0053] The determination unit 51 determines whether the vehicle is stationary or in motion. For example, the determination unit 51 determines whether the vehicle is stationary or in motion based on information collected by some or all of the speed sensor, vehicle position recognition device 12, and external camera 16 included in the vehicle sensor 40. For example, if the speed sensor output shows zero and the position information output by the GPS receiver remains unchanged or the change in the image captured by the external camera 16 is small, the determination unit 51 determines that the vehicle is stationary; otherwise, it determines that the vehicle is in motion.

[0054] The occupant identification unit 52 identifies who is inside the vehicle based on images of occupants captured by the in-vehicle camera 36 (occupant identification). The occupant identification unit 52 also identifies occupants based on occupant information 61 stored in the storage unit 60. Figure 2This is a diagram illustrating an example of the content of occupant information 61. Occupant information 61, for example, establishes a correspondence between the occupant ID (as occupant identification information) and pre-captured images or image features used for determination, as well as playback history information for moving images, still images / sound. Playback history information will be discussed later.

[0055] The occupant identification unit 52 compares the image of the occupant captured by the in-vehicle camera 36 (or the feature value derived from the image) with the image used for determination (or the feature value of the image used for determination). If the comparison is similar to or higher than a certain threshold, it identifies the occupant reflected in the image captured by the in-vehicle camera 36 as an occupant with the occupant ID registered in the occupant information 61. If the image of the occupant captured by the in-vehicle camera 36 (or the feature value derived from the image) does not match the image used for determination (or the feature value of the image used for determination), the occupant identification unit 52 identifies that the occupant is not a previously captured occupant, and adds the image (or the feature value derived from the image) of the occupant captured as a new occupant to the occupant information 61 by establishing a correspondence between the image (or the feature value of the image used for determination) and the newly issued occupant ID. It should be noted that, as a method for registering new occupants, the registered occupant information can be referenced on the display unit 30.

[0056] The "Playback History Information" in Occupant Information 61 stores information relative to the Occupant ID, indicating when (date and time) and in what manner (moving image / still image / sound) the guidance for each driving support function was initiated. Occupant Information 61 may also include (or replace) playback information for each driving support function in addition to the playback history information. "Playback Information for Each Driving Support Function" is information that totals the number of times moving images, still images, and sounds were played and initiated for each driving support function.

[0057] The "CAN signal history information" of occupant information 61 is, for example, information that can identify the history of other information transmitted and received between the driver support control device 100 and the guidance control device 50 via the CAN communication line or other in-vehicle bus, and information on the usage history of each driver support function.

[0058] The guidance control unit 53 controls the display device 32 and speaker 34 of the output device 33 based on the vehicle's driving status, occupant information 61, and guidance information 62 determined by the determination unit 51. The guidance information 62 includes dynamic images, still images, and sounds for each driving support function.

[0059] In this embodiment, the driving support functions provided by the driving support control device 100 are classified, for example, into comfort support functions and safety support functions. The guidance device 1 provides guidance related to comfort support functions both when the vehicle is stationary and when it is moving. The guidance device 1 provides guidance related to safety support functions only when the vehicle is stationary. Comfort support functions are functions that support driving while in motion and are functions that need to be operated while driving. Furthermore, occupants can activate / deactivate comfort support functions at any time. Safety support functions are functions that automatically operate when the vehicle is in a dangerous situation and are functions that do not need to be operated while driving. Moreover, considering aspects of peace of mind and safety, they are set to be activated by standard at the time of market release.

[0060] [Import Instructions]

[0061] Next, the method for guiding the driving support function provided by the guidance device 1 will be explained. First, the guidance device 1 provides information such as the following, based on the notification status, as an introduction.

[0062] (A): When the vehicle system is started on the day the guidance device 1 is within the first period after the purchase of the vehicle, the display device 32 displays... Figure 3 The screen shown is an introductory display. When the input device 20 is operated as specified while this screen is displayed, the guide device 1 enters a fully operational state.

[0063] (B): When the vehicle system is started, the guidance device 1, within the second period after the purchase of the vehicle, causes the display device 32 to display... Figure 4 The screen displays an introductory image as shown. When a specified operation is performed on the input device 20 while this screen is displayed, the display device 32 displays a dynamic image introducing the specific driving support function.

[0064] (C): When the guidance device 1 has used a certain driving assistance function (in this case, the advance vehicle approach warning), the display device 32 displays an urging message regarding that driving assistance function. Figure 5 The screen shows the customized settings as shown.

[0065] [Guide to Comfort Support Functions]

[0066] Figure 6 This is a flowchart illustrating an example of the processing performed by the guidance control device 50 and the driving support control device 100 regarding the comfort support function. The processing in this flowchart begins, for example, when the vehicle system is started, and is repeatedly executed according to each control cycle.

[0067] First, the occupant identification unit 52 identifies the occupants in the vehicle (here, the occupant sitting in the driver's seat) (step S300). The occupant identification unit 52 determines whether the occupant reflected in the image captured by the in-vehicle camera 36 is an occupant pre-registered in the occupant information 61 (step S302). If the occupant is not pre-registered in the occupant information 61, the occupant's information is registered as a new occupant in the occupant information 61 (step S303).

[0068] Next, the determination unit 51 determines whether the vehicle is stationary or moving, as described above (step S304).

[0069] If the vehicle is determined to be stationary, the guidance control unit 53, as described above, causes the display device 32 to display the import instructions related to the guidance device 1 (step S306).

[0070] Next, the guidance control unit 53 acquires and refers to the playback information of each driving support function corresponding to the occupant ID identified in step S300 (step S308). Furthermore, the guidance control unit 53 acquires the driving support functions installed in the vehicle, and when the guidance device 1 is in a fully operational state, it displays a driving support function overview screen on the display device 32 (step S310). Alternatively, if the occupant has received sufficient guidance regarding the driving support functions intended for them (e.g., the number of guidance sessions exceeds a baseline value), subsequent processing can be skipped, and the flowchart processing can be terminated.

[0071] Figure 7 This is an example of a driver support function overview screen. As shown, the driver support function overview screen lists the driver support functions that are the subjects of dynamic video playback. For example, the guidance control unit 53, based on the playback information of each driver support function corresponding to the acquired occupant ID, extracts driver support functions that are not playing dynamic video, or driver support functions whose dynamic video playback count is less than a predetermined number and whose still video / sound is not played, and causes the display device 32 to display an overview screen listing the extracted driver support functions. The area representing each driver support function in the driver support function overview screen serves as a GUI switch, allowing the occupant to select.

[0072] When an occupant selects a driving support function from the driving support function overview screen, the guidance control unit 53 causes the display device 32 to display an explanatory screen related to the selected comfort support function (step S312). Figure 8This diagram illustrates an example of an explanatory screen related to comfort support functions. The example shown here illustrates an explanatory screen regarding the ACC function within comfort support functions. On this explanatory screen, for example, the occupant can select between two paths: "Customization" and "Usage Mode." When the occupant selects "Customization," the guidance control unit 53 switches the current display screen to the customization settings screen. When the occupant selects "Usage Mode," the guidance control unit 53 plays a step-by-step explanatory screen showing the usage mode of the selected comfort support function.

[0073] The following describes the process of the flowchart for the occupant selecting the "usage mode". In this case, as described above, the guidance control unit 53 plays the dynamic screen explaining the usage mode of the selected comfort support function step by step (step S314). Figure 9 This diagram is a summary of the dynamic screen illustrating how to use the comfort support function. The dynamic screen illustrating how to use the comfort support function is divided into several chapters (steps) (chapter 1 to 3 in the diagram), and the occupant proceeds to the next chapter by performing the operations guided by each chapter.

[0074] Furthermore, the guidance control device 50 determines whether all the operations guided by the display device 32 in the usage mode dynamic screen of each chapter have been performed (step S316). If all the guided operations have been performed, the driving support control device 100 activates the comfort support function involved in the operation (step S318).

[0075] The driver support control device 100 activates the comfort support function when it is engaged and certain conditions related to vehicle speed are met. Even if the vehicle is determined to be stationary and the comfort support function is activated, the driver support control device 100 will not activate the comfort support function if it determines that the vehicle speed or other conditions are not met. Next, the guidance control device 50 instructs the display device 32 to display information to the occupants regarding the conditions that the vehicle needs to meet to activate the comfort support function (step S320).

[0076] Next, the guidance control unit 53 updates the playback history information and the playback information of each driving support function in the occupant information 61 (S322). Thus, the processing of cycle 1 of this flowchart ends. It should be noted that if the operation guided by the display device 32 in the usage mode dynamic screen of each chapter is not fully performed but the end of the guidance is indicated by certain operations, the playback history information and the playback information of each driving support function in the occupant information 61 may or may not be updated.

[0077] On the other hand, if it is determined in step S304 that the vehicle is in motion, the guidance control unit 53 uses the surrounding environment detection device 10 to determine the vehicle's surrounding environment (step S324). Here, the guidance control unit 53 may, for example, determine the type of road in which the vehicle is located as the surrounding environment. Alternatively, in addition to the road type, the guidance control unit 53 may also determine the surrounding environment based on traffic volume, number of pedestrians, weather, time of day, road markings, driving road boundaries, etc. For example, the guidance control unit 53 may determine the road type based on the results obtained by retrieving map information using location information measured by a GPS receiver, the type of road markings reflected in the image captured by the external camera 16, the presence of walls, signs, etc.

[0078] The guidance control unit 53 determines whether the occupant allows the recommended driving assistance function (step S326). If the occupant allows the recommended driving assistance function, the guidance control unit 53 determines whether the occupant has completed the learning of the driving assistance function (step S328). If the occupant has completed the learning of the driving assistance function, the guidance control unit 53 determines whether the driving assistance function can be activated (step S330). If the driving assistance function can be activated, the guidance control unit 53 determines whether the number of guidance attempts for the driving assistance function is below a reference value (step S332). If the number of guidance attempts is below the reference value, the guidance control unit 53 proceeds to step S334. If any of the above four determination conditions (steps S326 to S332) are not met, the guidance control unit 53 updates the playback history information and the playback information of each driving assistance function in the occupant information 61 (S322), and the processing of loop 1 of this flowchart ends.

[0079] If all the determination conditions of steps S326 to S332 are met, the guidance control device 50 determines whether the comfort support function (hereinafter referred to as the comfort support function) that meets the surrounding environment determination in step S324 has been activated (step S334). If the comfort support function is activated, the guidance control device 50 and the driving support control device 100 determine whether the conditions for the selected comfort driving support function in step S336 to operate (environment-related conditions) are met (step S342). For example, the environmental conditions required for the selected comfort support function to operate are: the vehicle speed is within a specified range, the left and right road markings of the vehicle are identified and the vehicle is driving near the center of these road markings, the curvature of the road is below a reference value, and the direction indicator is not activated.

[0080] If the conditions for the operation of the aforementioned comfort driving support function are met, the driving support control device 100 activates the comfort support function (step S346). If the conditions for the operation of the comfort driving support function are not met, the guidance control device 50 causes the display device 32 to display information to notify the occupant of the conditions that need to be met for the comfort support function to operate (step S344), and performs the determination in step S342 again.

[0081] If it is determined in step S334 that the comfort support function is not activated, the guidance control device 50 selects one or more comfort support functions based on the determined road environment, and causes the display device 32 to display information recommending the selected comfort support function to the occupant (step S336). For example, the guidance control unit 53 causes the display device 32 to display an image of the recommended comfort support function in the form of a GUI switch, allowing the occupant to select it.

[0082] When an occupant selects a comfort support function displayed on the display device 32, the guidance control unit 53 causes the "output device" to output a guidance still image and / or guidance sound in a step-by-step manner (step S338). For example, if it is determined that the vehicle is traveling on a highway, the guidance control unit 53 recommends the ACC function. Figure 10 This diagram illustrates an example of the operation of the "output device" when the ACC function is recommended as an example and the occupant selects it.

[0083] like Figure 10As shown, the guidance control unit 53 causes the display device 32 to display a still image guiding the occupant to perform operations on the input device 20, and causes the speaker 34 to output an audio guide corresponding to the still image. For example, in still image 1, the guidance control unit 53 causes the display device 32 to display a still image 1 with operation guidance such as "Please press the switch only once," and causes the speaker 34 to output an audio guide 1 with the same message. Furthermore, when the occupant operates the switch (hereinafter referred to as the steering switch) located on the steering wheel according to the operation guidance provided by still image 1 and audio guide 1, the guidance control unit 53 causes the display device 32 to switch still image 1 to still image 2 for the next step, and causes the speaker 34 to output an audio guide 2 corresponding to still image 2. For example, in still screen 2, the guidance control unit 53 causes the display device 32 to display still screen 2 with the operation guidance "When the desired speed is reached, please tilt the SET / RES switch downwards," and causes the speaker 34 to output an audio guidance 2 with the same message. Next, when the occupant performs an operation corresponding to the operation guidance provided by still screen 2 and audio guidance 2, if the speed at that point in time matches the specified conditions for ACC function operation, the guidance control unit 53 causes the display device 32 to switch still screen 2 to still screen 3 for the next step, and causes the speaker 34 to output an audio guidance 3 corresponding to still screen 3. For example, in still screen 3, the guidance control unit 53 causes the display device 32 to display the result "ACC function is working," and causes the speaker 34 to output an audio guidance 3 with the same message. It should be noted that if the speed at the aforementioned point in time does not match the specified conditions for ACC function operation, an error message can be output. It should be noted that even the same function may operate differently depending on the type and year of the vehicle. Therefore, it is recommended to provide the appropriate operating method based on the appearance and operating procedures of your vehicle.

[0084] exist Figure 10 During the action, if the comfort support function is already activated, playback can start from still screen 2 instead of still screen 1.

[0085] Next, the guidance control device 50 determines whether all the operations guided by the display device 32 and speaker 34 in each step of the guidance image have been performed (step S340). If all the guided operations have been performed, the selected comfort support function in step S336 has been activated and the operation required for its operation has been performed, or the selected comfort support function in step S336 has been activated and the operation required for its operation has been performed.

[0086] Next, the guidance control device 50 and the driving support control device 100 determine whether the conditions (environment-related conditions) for operating the selected comfort support function in step S336 are met (step S342). If the conditions for operating the comfort driving support function are met, the driving support control device 100 activates the comfort support function (step S346). If the conditions for operating the comfort driving support function are not met, the guidance control device 50 causes the display device 32 to display information to notify the occupant of the conditions that need to be met for the comfort support function to operate (step S344), and performs the determination in step S342 again.

[0087] Finally, the guidance control unit 53 updates the playback history information and the playback information of each driving support function in the occupant information 61 (S322), ending the processing of cycle 1 of this flowchart. It should be noted that if the operations guided by the display device 32 and speaker 34 in each guidance image step are not all performed, but the end of guidance is indicated by some operations, the playback history information and the playback information of each driving support function in the occupant information 61 may or may not be updated.

[0088] [Security Support Function]

[0089] The comfort support function has been explained above. The following describes the control measures performed regarding the safety support function provided by the driver support control device 100.

[0090] Figure 11 This is a flowchart illustrating an example of control performed by the guidance control device 50 regarding the safety support functions provided by the driver support control device 100. The processing in this flowchart, similar to the control regarding the comfort support functions, begins upon startup of the vehicle system and is repeated for each control cycle.

[0091] The processing of steps S400 to S410 in this flowchart and Figure 6 The processing of steps S300 to S310 is the same, so the explanation is omitted. If it is determined in step S404 that the vehicle is in motion, the safety support function is not activated, and the processing of loop 1 of this flowchart ends. If it is determined that the vehicle is stationary, when the occupant selects one of the safety support functions included in the driver support function overview screen, the guidance control unit 53 causes the "output device" to output an introductory dynamic screen / static screen and sound related to the selected safety support function (step S412).

[0092] Similar to the aforementioned control of comfort support functions, the guidance control unit 53 divides the introductory dynamic screen of the selected safety support function into multiple chapters (steps) and plays them (step S412). Next, the guidance control unit 53 updates the playback history information in the occupant information 61 and the playback information of each driving support function (S414). Thus, the processing of cycle 1 of this flowchart ends. Figure 6 and Figure 11 The processing of flowcharts can also be integrated into a single process and executed.

[0093] According to the embodiments described above, the guidance device 1 installed in the vehicle includes: an "output device" which includes a display device 32 and a speaker 34; and an input device 20 which accepts the operation of the occupant for activating the multiple driving support functions equipped in the vehicle, determines whether the vehicle is stopped or in motion, and allows the display device 32 to display a dynamic screen explaining any of the multiple driving support functions when the vehicle is stopped, so that the user after delivery of the vehicle can receive guidance from the driving support functions equipped in the vehicle in a relaxed state.

[0094] Furthermore, according to the embodiment, when the vehicle is in motion, the output device outputs guidance information explaining the start-up operation in the form of a still image and / or sound, thereby enabling appropriate guidance for enabling the driving support function to operate after driving begins.

[0095] Furthermore, according to the implementation method, it also includes a surrounding environment detection device for detecting the surrounding environment, thereby enabling the user to select appropriate driving support functions corresponding to the surrounding environment.

[0096] (Modifications of the implementation method)

[0097] In the above-described embodiment, the occupant identification unit 52 is configured to specifically identify the occupant (driver) seated in the driver's seat and provide guidance based on the occupant information 61 related to the driver. In the variation described below, the occupant identification unit 52 identifies the occupant in the front passenger seat and also processes the information based on the occupant information 61 related to the front passenger seat. Specifically, the guidance control device 50 skips guidance based on the occupant information 61 (including information on the occupant in the driver's seat and the front passenger seat) if the driving support function to be guided to the driver has been sufficiently guided, or if the occupant who has been activated more frequently is in the front passenger seat (the number of guidance attempts is more than the reference value or the number of activations is more than the reference value).

[0098] Figure 12This is a flowchart illustrating an example of the processes performed by the control unit 50 and the driving support control unit 100 regarding comfort support functions, taking into account the presence of a passenger in the front passenger seat and the availability of someone skilled in driving assistance functions. The processing in this flowchart begins, for example, when the vehicle system is started, and is repeated for each control cycle.

[0099] First, the occupant identification unit 52 identifies the occupant sitting in the driver's seat of the vehicle (step S500). The occupant identification unit 52 determines whether the occupant reflected in the image captured by the in-vehicle camera 36 is an occupant pre-registered in the occupant information 61 (step S502). If the occupant is not a pre-registered occupant in the occupant information 61, the occupant's information is registered as a new occupant in the occupant information 61 (step S503).

[0100] Next, the occupant identification unit 52 identifies the occupant seated in the front passenger seat of the vehicle (step S504). Furthermore, the determination unit 51, as described above, determines whether the vehicle is stationary or in motion (step S506). If it is determined that the vehicle is in motion, the processing performed by the guidance control device 50 and the driver support control device 100 is as follows: Figure 6 The processing after step S324 is the same, so the explanation is omitted. If it is determined that the vehicle is stopped, the guidance control unit 53 causes the display device 32 to display the import instructions related to the guidance device 1 as described above (step S508).

[0101] Next, the guidance control unit 53 acquires and refers to the playback information of each driving support function corresponding to the occupant ID identified in steps S500 and S504 (step S510). The guidance control unit 53 determines whether the passenger in the front passenger seat is proficient in the driving support function to be guided to the driver (step S512). A proficient person is defined as a passenger in the front passenger seat who, based on the occupant information 61, has received guidance on the driving support function to be guided to the driver through dynamic images, still images, or sounds at a reference value or more, or has activated the function at a reference value or more. If the passenger in the front passenger seat is proficient, the guidance control unit 53 skips the guidance. If the passenger in the front passenger seat is not proficient, the guidance control unit 53 acquires the driving support functions installed in the vehicle and displays a summary screen on the display device 32 (step S514). The processing after step S514 is as follows: Figure 6 The processing after step S310 is the same, so the explanation is omitted.

[0102] exist Figure 12 The document explains how to identify the driver and front passenger occupants, and considers the case where the front passenger is a skilled driver when discussing comfort support functions. The same applies to safety support functions, therefore, their descriptions are omitted.

[0103] According to the variations of the implementation method described above, in addition to achieving the same effect as the implementation method, by determining whether the passenger in the front seat is a skilled person, the user can quickly utilize the driving assistance function if the passenger in the front seat is a skilled person.

[0104] The above description illustrates specific embodiments of the present invention, but the present invention is not limited to such embodiments in any way, and various modifications and substitutions can be made without departing from the spirit of the present invention.

[0105] The above-described embodiments can be performed as follows.

[0106] A guidance and control device is configured to be disposed on a mobile body and communicate with an output device and an input device. The output device includes a display device, and the input device receives operations from the occupants of the mobile body to activate multiple driving assistance functions equipped on the mobile body.

[0107] The guidance control device includes:

[0108] Storage device, which stores a program; and

[0109] Hardware processor,

[0110] The hardware processor executes the program to perform the following processing:

[0111] Determine whether the moving body is stationary or in motion; and

[0112] When the moving body is stationary, the display device displays a dynamic screen illustrating any of the plurality of driving support functions.

Claims

1. A guiding device disposed on a moving body, wherein, The guiding device includes: An output device, which includes a display device; An input device that accepts operations from the occupants of the mobile body to activate various driving support functions equipped on the mobile body; as well as The guidance control device determines whether the moving body is stationary or moving. If the moving body is stationary, it allows the display device to display dynamic images illustrating any of the plurality of driving support functions. The guidance control device refers to the playback history information of the dynamic images stored in the storage unit, and regarding the driving support function that has displayed the corresponding dynamic images, when the moving body is moving, causes the output device to output guidance information explaining the start-up or operation of the driving support function through still images and / or sound.

2. The guiding device according to claim 1, wherein, The guidance control device causes the display device to display the dynamic screen containing operation guidance for the input device.

3. The guiding device according to claim 2, wherein, The dynamic visuals are divided into several steps. The guidance control device causes the dynamic screen to proceed to the next step when the occupant operates the input device according to the operation guidance of a certain step.

4. The guiding device according to claim 1, wherein, It also includes an occupant identification unit for identifying the occupants of the moving vehicle. The playback history information is generated for each of the identified occupants. The guidance and control device refers to the information in the playback history information corresponding to the identified passenger.

5. The guiding device according to claim 2, wherein, It also includes a surrounding environment detection device for detecting the surrounding environment of the moving body. The guidance control device selects a driving support function to guide the occupant's operation based on the surrounding environment detected by the surrounding environment detection device and the vehicle status information obtained via the in-vehicle communication line.

6. The guiding device according to claim 2, wherein, The guidance control device selects a driving support function to guide the occupant's operation by referring to the vehicle status information obtained from the driving support device via the in-vehicle communication line.

7. A guidance and control device disposed on a moving body, wherein, The guidance control device includes: The determination unit determines whether the moving body is stationary or moving; and The guidance control unit, when determining that the mobile body is stationary, allows the display device provided on the mobile body to display a dynamic screen explaining the following startup operation: the startup operation refers to the startup operation of any one of the multiple driving support functions, performed on an input device that receives an operation from an occupant of the mobile body to activate multiple driving support functions equipped on the mobile body. The guidance control device refers to the playback history information of the dynamic images stored in the storage unit, and outputs guidance information explaining the start-up or operation of the driving support function by means of still images and / or sound when the moving body is in motion, regarding the driving support function that has displayed the corresponding dynamic images.

8. A bootstrapping method, wherein, The guidance device installed on the mobile body includes: an output device, which includes a display device; and an input device, which accepts operations from the occupants of the mobile body for activating various driving support functions equipped on the mobile body. The guiding method causes the guiding control device of the guiding device to perform the following processing: Determine whether the moving body is stationary or in motion; When the moving body is stationary, the display device is allowed to display a dynamic screen illustrating the following startup operation, which refers to the startup operation of any of the plurality of driving support functions performed on the input device; as well as Referring to the playback history information of the dynamic images stored in the storage unit, regarding the driving support function that has displayed the corresponding dynamic images, when the moving body is moving, the output device outputs guidance information explaining the start-up or operation of the driving support function through still images and / or sound.

9. A storage medium storing a program, wherein, The guidance device installed on the mobile body includes: an output device, which includes a display device; and an input device, which accepts operations from the occupants of the mobile body for activating various driving support functions equipped on the mobile body. The program causes the guidance control device of the guidance device to perform the following processing: Determine whether the moving body is stationary or in motion; When the moving body is stationary, the display device is allowed to display a dynamic screen illustrating the following startup operation, which refers to the startup operation of any of the plurality of driving support functions performed on the input device; as well as Referring to the playback history information of the dynamic images stored in the storage unit, regarding the driving support function that has displayed the corresponding dynamic images, when the moving body is moving, the output device outputs guidance information explaining the start-up or operation of the driving support function through still images and / or sound.

Images