Display control device and display control method

Abstract

Included are: a departure preparation progress determination unit (13) to determine the progress of a passenger's preparation for the departure of a vehicle based on occupant information; a departure intention determination unit (14) to determine an intention to initiate the vehicle's departure based on operational information; a warning level determination unit (15) to determine, based on the progress of the passenger's preparation and the driver's intention to initiate the vehicle's departure, a level of warning to the driver of the severity of an unexpected situation that the vehicle or an occupant is likely to encounter if the vehicle departs;a warning indicator information generation unit (16) to generate warning indicator information to cause a display device (40) to display according to the level determined for the driver by the warning level determination unit (15); and a display control unit (18) to cause the display device (40) to display on the basis of the warning indicator information.

Description

FIELD OF TECHNOLOGY

[0001] The present disclosure relates to a display control apparatus and a display control method. STATE OF THE ART

[0002] When initiating the departure of a vehicle, the driver of the vehicle must initiate the departure after the vehicle is in a condition in which no problems will arise even when the vehicle is departing, that is, a condition in which it is assumed that the vehicle or any of its passengers will not encounter an unexpected situation even when departing.

[0003] If the condition of the vehicle is such that an unexpected situation may occur when the vehicle departs, the driver may need to take some measures, such as stopping and waiting for an operation for the vehicle to depart or helping a passenger to prepare so that the vehicle can depart without encountering the unexpected situation.

[0004] Incidentally, as a technique for notifying a driver of the seat belt fastening state of a passenger, Patent Literature 1 discloses a technique in which a seat belt fastening state of an unoccupied seat, a seat belt fastening state of an occupied seat and an unfastened seat belt, or a seat belt fastening state of an occupied seat and a fastened seat belt are displayed in different colors, whereby the driver can recognize at a glance from a driver's seat whether the occupant is sitting or not and whether the seat belt is fastened or not. REFERENCE LISTPATENT LITERATURE

[0005] Patent Literature 1: JP 2015-66983 A SUMMARY OF THE INVENTIONTECHNICAL PROBLEM

[0006] The severity of an unexpected situation that may occur during a vehicle's departure depends on the extent to which the occupants, including the driver and passengers, prepare for the vehicle's departure. As the severity of the unexpected situation that may occur changes, some of the measures the driver takes to enable the vehicle to depart without encountering the unexpected situation and their necessity also change. Therefore, it is desirable for the driver to grasp a certain degree of severity of the unexpected situation when instructing the vehicle to depart.

[0007] Traditionally, the problem is that it is not possible to inform the driver about the severity of the unexpected situation that may occur when the driver instructs the vehicle to depart.

[0008] It should be noted that the technique disclosed in Patent Literature 1 only informs the passenger's seat belt fastening status by displaying a specific printout, and it is not possible for the driver to grasp the severity of an unexpected situation when the driver initiates the vehicle departure by simply looking at the display. Therefore, the technique described in Patent Literature 1 cannot solve the above problem.

[0009] The present disclosure is intended to solve the above problem, and an object of the present disclosure is to provide a display control device in which, in a case where there is a possibility that a vehicle or a passenger encounters an unexpected situation, when the driver causes the vehicle to depart, a driver can be warned in a display form in which a severity of the unexpected situation can be recognized. SOLUTION TO THE PROBLEM

[0010] A display control device according to the present disclosure includes an occupant information acquisition unit for acquiring occupant information regarding an occupant; an operation information acquisition unit for acquiring operation information regarding use of a vehicle by a driver of the vehicle; a departure preparation progress determination unit for determining the progress of a passenger's preparation for departure of the vehicle based on the occupant information acquired by the occupant information acquisition unit; a departure intention determination unit for determining the driver's intention to cause the vehicle to depart based on the operation information acquired by the operation information acquisition unit;a warning level determination unit for determining a level for warning the driver of the severity of an unexpected situation that the vehicle or the passenger is likely to encounter when the vehicle departs, based on the departure preparation progress by the passenger determined by the departure preparation progress determination unit and the intention to cause the vehicle to depart determined by the departure intention determination unit; a warning display information generation unit for generating warning display information for causing a display corresponding to the level determined by the driver warning level determination unit; and a display control unit for causing a display device to display based on the warning display information generated by the warning display information generation unit. ADVANTAGEOUS EFFECTS OF THE INVENTION

[0011] According to the present disclosure, in a case where there is a possibility that the vehicle or the passenger will encounter an unexpected situation when the driver causes the vehicle to depart, the display control device can warn the driver in a display form in which a severity of the unexpected situation can be known. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing a configuration example of a display control device according to a first embodiment. Fig. 2A, Fig. 2B, Fig. 2C and Fig. 2D are diagrams for explaining warning display information generated by a warning display information generating unit in the first embodiment. Fig. 3A, Fig. 3B and Fig. 3C are diagrams for explaining progress display information generated by a progress display information generating unit in the first embodiment. Fig. 4 is a diagram listing screen examples that a display control unit displays in the first embodiment of a display device. Fig. 5 is a diagram of the display device that displays a screen based on warning display information and progress display information in accordance with the control of the display control unit when viewed from the vehicle interior in the first embodiment. Fig. 6 is a flowchart for explaining an operation of the display control device according to the first embodiment. Fig. Fig. 7 is a flowchart for explaining details of an example of the processing in step ST2a in Fig. 6 by a departure preparation progress determination unit. Fig. Fig. 8 is a flowchart for explaining details of the processing in step ST2b in Fig. 6 by a departure intention determination unit. Fig. Fig. 9 is a flowchart for explaining details of an example of the processing in step ST3 in Fig. 6 by a warning level determination unit. Fig. 10A, Fig. 10B and Fig. 10C are diagrams for explaining the progress display information generated by the progress display information generation unit in the first embodiment for displaying the progress of preparation by a passenger in an animation that changes with the lapse of time. Fig. 11A, Fig. 11B, Fig. 11C and Fig. 11D are diagrams for explaining screen examples of the display device in a case where the display control unit causes the display device to display only a display based on the warning display information of the first embodiment. Fig. 12A and Fig. 12B are diagrams showing an example of a hardware configuration of the display control device according to the first embodiment. DESCRIPTION OF THE EMBODIMENTS

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. First embodiment

[0013] A display control device according to a first embodiment is mounted, for example, on a vehicle. The display control device serves to control the display of a display device installed in the vehicle. The display device is, for example, a display panel mounted in front of the steering wheel of the vehicle.

[0014] For example, when passengers, including a driver and a passenger, board the vehicle and the driver initiates the vehicle departure, the display control device causes the display device to display a display to warn the driver that an unexpected situation may occur upon departure of the vehicle. Specifically, the display control device causes the display device to display a display to warn the driver of an unexpected situation upon departure of the vehicle, in a form that indicates the severity of the unexpected situation that may occur.

[0015] Note that in the first embodiment, the display device is assumed to be the display panel described above, but this is only an example, and the display device may be, for example, a display device arranged in a center console in a front part of the vehicle interior or a display device arranged in a rearview mirror. The display device to be displayed by the display control device may be any display device provided at a position that the driver can visually recognize when looking in front of the vehicle without largely changing his line of sight.

[0016] In the following first embodiment, it is assumed as an example that a total of two people, including a driver and a passenger, enter and drive off in the vehicle. For example, it is assumed that the passenger is seated in a rear seat.

[0017] Fig. Fig. 1 is a diagram showing a configuration example of a display control device 1 according to the first embodiment. Note that the vehicle in Fig. 1 is not shown.

[0018] The display control device 1 is connected to a first sensor 20, a second sensor 30 and a display device 40.

[0019] The first sensor 20 is mounted on the vehicle and detects a state of the vehicle interior. The first sensor 20 outputs information about the detected state of the vehicle interior (hereinafter referred to as "first sensor information") to the display control device 1. Details of the first sensor information will be described later.

[0020] In the first embodiment, the first sensor 20 is assumed to be various sensors mounted on the vehicle, such as a camera sensor arranged at a location where the vehicle interior can be imaged, a load sensor or a contact sensor arranged in a seat, and a seatbelt sensor provided in a take-up portion or a fastening portion of a seatbelt. The load sensor or the contact sensor may be mounted, for example, on a floor part in the vehicle interior.

[0021] Although in Fig. While only a first sensor 20 is shown in FIG. 1, this is merely an example. The display control device 1 can be connected to a plurality of first sensors 20 of different types.

[0022] The second sensor 30 is mounted on the vehicle and detects various operations performed on the vehicle. The second sensor 30 outputs information about the detected various operations (hereinafter referred to as "second sensor information") to the display control device 1. Details of the second sensor information will be described later.

[0023] In the first embodiment, it is assumed that the second sensor 30 is various sensors such as a shift position sensor, a brake sensor that detects the operating state of a parking brake, a pedal sensor that detects a pedal operation, and a grip sensor arranged on a steering wheel.

[0024] Although in Fig. While only one second sensor 30 is shown in FIG. 1, this is merely an example. The display control device 1 can be connected to a plurality of second sensors 30 of different types. Furthermore, the first sensor 20 and the second sensor 30 can be a common sensor. The first sensor 20 and the second sensor 30 can, for example, be a common camera sensor.

[0025] The display device 40 is a display panel that displays based on the control of the display control device 1. Details of a screen displayed by the display device 40 will be described later.

[0026] The display control device 1 includes an occupant information acquisition unit 11, an operation information acquisition unit 12, a departure preparation progress determination unit 13, a departure intention determination unit 14, a warning level determination unit 15, a warning display information generation unit 16, a progress display information generation unit 17, and a display control unit 18.

[0027] The occupant information acquisition unit 11 includes a seat information acquisition unit 111, a seat belt fastening information acquisition unit 112, and a posture information acquisition unit 113.

[0028] The operation information acquisition unit 12 includes a gear shift information acquisition unit 121, a parking brake operation information acquisition unit 122, and a pedal operation information acquisition unit 123.

[0029] The occupant information acquisition unit 11 acquires information about the state of an occupant (hereinafter referred to as "occupant information") based on the first sensor information output from the first sensor 20. The occupant information includes, for example, information about the seating position of an occupant, information about the occupant's seatbelt fastening, and information about the occupant's posture. Note that in the occupant information, the seating information, seatbelt fastening information, and posture information are linked to information that can indicate a position of the occupant. In the first embodiment, the position of the occupant is represented by, for example, the position of a seat on which the occupant is currently sitting or will be sitting.

[0030] Seat information includes, for example, information about the presence or absence of the occupant and information about whether the occupant is sitting on the seat or not.

[0031] Seat belt fastening information includes, for example, information about whether or not the occupant has fastened the seat belt and information about whether or not the occupant has completed fastening the seat belt.

[0032] The posture information includes, for example, information about the presence or absence of an unsafe posture of the occupant.

[0033] The seat information acquisition unit 111 acquires the seat information.

[0034] For example, the seat information acquisition unit 111 acquires an image obtained by capturing the vehicle interior as first sensor information from the camera sensor, the first sensor 20. Then, the seat information acquisition unit 111 performs image recognition processing using a known image recognition technique on the acquired image to detect the presence or absence of an occupant and determine whether the occupant is seated on the seat. Note that the seat information acquisition unit 111 can specify the position of the occupant and the seat where the occupant is seated based on the acquired image.

[0035] Furthermore, the seat information acquisition unit 111 may acquire, for example, information indicating a load (hereinafter referred to as "load information") or information indicating the presence or absence of contact (hereinafter referred to as "contact information") as first sensor information from the load sensor or the contact sensor, which is the first sensor 20, and detect the presence or absence of an occupant and whether the occupant is sitting on the seat based on the load information or the contact information. Note that the seat information acquisition unit 111 may indicate the position of the occupant and the seat where the occupant is sitting based on the load information or the contact information.

[0036] The seat information acquisition unit 111 acquires, as seat information, information about the presence or absence of the occupant and information about whether the occupant is sitting on the seat or not, which have been detected.

[0037] Here, it is assumed that the seat information acquisition unit 111 detects the presence or absence of the occupant and determines whether the occupant is seated on the seat based on the captured image, the load information, or the contact information. For example, the camera sensor may detect the presence or absence of the occupant and determine whether the occupant is seated on the seat, and output information about the presence or absence of the occupant and information about whether the occupant is seated or not as seat information to the seat information acquisition unit 111. In addition, for example,the load sensor or the contact sensor detects the presence or absence of the occupant and whether the occupant is sitting on the seat, and outputs information about the presence or absence of the occupant and information about whether the occupant is sitting on the seat as seat information to the seat information acquiring unit 111.

[0038] Furthermore, the seat information acquisition unit 111 can output, for example, the first sensor information as seat information to the departure preparation progress determination unit 13, and the departure preparation progress determination unit 13 can detect the presence or absence of the occupant and determine whether the occupant is sitting on the seat. The details of the departure preparation progress determination unit 13 will be described later.

[0039] The seat belt fastening information acquisition unit 112 acquires seat belt fastening information.

[0040] For example, the seatbelt fastening information acquisition unit 112 acquires, as first sensor information, the image obtained by capturing the vehicle interior from the camera sensor, the first sensor 20. Then, the seatbelt fastening information acquisition unit 112 performs image recognition processing using a known image recognition technique on the captured image to determine whether the occupant has fastened the seatbelt and whether the occupant has completed fastening the seatbelt.

[0041] Furthermore, the seatbelt fastening information acquisition unit 112 may acquire, as first sensor information, for example, information about whether a buckle switch of the seatbelt is on or off, information about an amount of retraction, or information about an amount of winding of the seatbelt (hereinafter referred to as "seatbelt sensor information") from the seatbelt sensor, which is the first sensor 20, and determine whether or not the occupant has operated the seatbelt and whether or not the occupant has completed fastening the seatbelt based on the seatbelt sensor information. Note that the seatbelt fastening information acquisition unit 112 may determine the position of the occupant and the seat where the occupant is seated based on the seatbelt sensor information.

[0042] The seat belt fastening information acquisition unit 112, as a seat belt fastening information acquisition unit, acquires the detected information on whether or not the occupant has fastened the seat belt and whether or not the occupant has completed fastening the seat belt.

[0043] Here, it is assumed that the seat belt fastening information acquisition unit 112 detects whether the occupant has fastened the seat belt or not based on the captured image or the seat belt sensor information, but this is only an example. For example, the camera sensor may detect whether the occupant has fastened the seat belt or not and whether the occupant has completed fastening the seat belt or not, and output information about whether the occupant has fastened the seat belt or not and whether the occupant has completed fastening the seat belt or not to the seat belt fastening information acquisition unit 112 as seat belt fastening information.In addition, the seat belt sensor can detect, for example, whether the occupant has fastened the seat belt or not and whether the occupant has completed fastening the seat belt or not, and output information about whether the occupant has fastened the seat belt or not and whether the occupant has completed fastening the seat belt or not to the seat belt fastening information acquiring unit 112 as the seat belt fastening information.

[0044] Furthermore, for example, the seat belt fastening information acquisition unit 112 may output the first sensor information to the departure preparation progress determination unit 13, and the departure preparation progress determination unit 13 may recognize whether or not the occupant has fastened the seat belt and whether or not the occupant has completed fastening the seat belt.

[0045] The posture information acquisition unit 113 acquires the posture information.

[0046] For example, the posture information acquisition unit 113 acquires, as first sensor information, an image obtained by capturing the vehicle interior with the camera sensor, which is the first sensor 20. Then, the posture information acquisition unit 113 performs image recognition processing using a known image recognition technique on the captured image to detect the presence or absence of an unsafe posture of the occupant. Since the technique for detecting an unsafe posture of the occupant based on the captured image is a known technique, a detailed description of this technique will be omitted.

[0047] Furthermore, the posture information acquisition unit 113 may acquire, for example, load information or contact information as first sensor information from the load sensor or the contact sensor, which is the first sensor 20, and detect the presence or absence of an unsafe posture of the occupant based on the load information or the contact information. Since the technique of detecting an unsafe posture of the occupant based on the load information or the contact information is a known technique, a detailed description of this technique will be omitted.

[0048] The posture information acquisition unit 113 acquires the detected information about the presence or absence of an unsafe posture of the occupant as posture information.

[0049] Here, it is assumed that the posture information acquisition unit 113 detects the presence or absence of an unsafe posture of the occupant based on the captured image, the load information, or the contact information, but this is only an example. For example, the camera sensor may detect the presence or absence of an unsafe posture of the occupant and output information about the presence or absence of an unsafe posture of the occupant to the posture information acquisition unit 113 as posture information. In addition, for example, the load sensor or the contact sensor may detect the presence or absence of an unsafe posture of the occupant and output information about the presence or absence of an unsafe posture of the occupant to the posture information acquisition unit 113 as posture information.

[0050] Further, for example, the posture information acquisition unit 113 may output the first sensor information as posture information to the departure preparation progress determination unit 13, and the departure preparation progress determination unit 13 may detect the presence or absence of an unsafe posture of the occupant.

[0051] The occupant information acquisition unit 11 outputs the occupant information including the seat information acquired by the seat information acquisition unit 111, the seat belt fastening information acquired by the seat belt information acquisition unit 112, and the posture information acquired by the posture information acquisition unit 113 to the departure preparation progress determination unit 13.

[0052] The operation information acquisition unit 12 acquires operation information based on the second sensor information output from the second sensor 30. The operation information includes, for example, shift operation information regarding a shift position, parking brake operation information, and pedal operation information.

[0053] The switching process information includes, for example, switching position information.

[0054] Parking brake operating information includes, for example, information indicating that the parking brake has been released.

[0055] Pedal operation information includes information about whether the driver has depressed the accelerator pedal. Pedal operation information may include information about the application of a brake pedal, the release of the brake pedal, the application of an accelerator pedal, and the release of the accelerator pedal.

[0056] The switching operation information acquisition unit 121 acquires the switching operation information.

[0057] For example, the shift information acquisition unit 121 acquires information indicating a current shift position (hereinafter referred to as "shift position information") as second sensor information from the shift position sensor, which is the second sensor 30. Then, the shift information acquisition unit 121 detects whether the driver has set the shift position to a P position, a D position, or an R position based on the shift position information.

[0058] The shift information acquisition unit 121 acquires, as shift information, the detected information as to whether the driver has set the shift position to the P position, the D position, or the R position.

[0059] Here, it is assumed that the shift information acquisition unit 121 detects whether the driver has set the shift position to the P position, the D position, or the R position based on the shift information, but this is only an example. For example, the shift position sensor may detect whether the driver has set the shift position to the P shift, the D shift, or the R shift, and output information indicating whether the driver has set the shift position to the P shift, the D shift, or the R shift to the shift information acquisition unit 121 as the shift information.

[0060] Further, for example, the shift information acquisition unit 121 may output the second sensor information as shift information to the departure intention determination unit 14, and the departure intention determination unit 14 may recognize whether the driver has set the shift position to the P position, the D position, or the R position. Details of the departure intention determination unit 14 will be described later.

[0061] The parking brake operation information acquisition unit 122 acquires the parking brake operation information.

[0062] For example, the parking brake operation information acquisition unit 122 acquires information about the parking brake (hereinafter referred to as "parking brake information") as second sensor information from the brake sensor, which is the second sensor 30. Then, the parking brake operation information acquisition unit 122 recognizes that the driver has released the parking brake based on the parking brake information.

[0063] The parking brake operation information acquisition unit 122 acquires, as parking brake operation information, the detected information as to whether the driver has released the parking brake.

[0064] Here, it is assumed that the parking brake operation information acquisition unit 122 detects that the driver has released the parking brake based on the parking brake information; however, this is only an example. For example, the brake sensor may detect that the driver has released the parking brake and output information about it to the parking brake operation information acquisition unit 122 as parking brake operation information indicating that the driver has released the parking brake.

[0065] Further, for example, the parking brake operation information acquisition unit 122 may output the second sensor information as parking brake operation information to the departure intention determination unit 14, and the departure intention determination unit 14 may recognize that the driver has released the parking brake.

[0066] The pedal operation information acquisition unit 123 acquires pedal operation information.

[0067] For example, the pedal operation information acquisition unit 123 acquires, as second sensor information, information about the operation of the brake pedal (hereinafter referred to as "pedal information") from the pedal sensor, which is the second sensor 30. Then, the pedal operation information acquisition unit 123 detects, based on the pedal information, whether the driver has performed an accelerator pedal operation. The pedal operation information acquisition unit 123 can acquire the degree of operation of the brake pedal, the degree of release of the brake pedal, the degree of operation of the accelerator pedal, and the degree of release of the accelerator pedal.

[0068] The pedal operation information acquisition unit 123 acquires, as pedal operation information, the detected information regarding whether the driver has performed the accelerator pedal operation. The pedal operation information acquisition unit 123 may acquire, as pedal operation information, information regarding the degree of brake pedal operation, the degree of brake pedal release, the degree of accelerator pedal operation, or the degree of accelerator pedal release.

[0069] Here, it is assumed that the pedal operation information acquisition unit 123 detects whether the driver has operated the accelerator pedal based on the pedal information, but this is just an example. For example, the pedal sensor may detect whether the driver has performed the accelerator pedal operation and output information about whether the driver has performed the accelerator pedal operation as pedal operation information to the pedal operation information acquisition unit 123.

[0070] Furthermore, for example, the pedal operation information acquisition unit 123 may output the second sensor information as the pedal operation information to the departure intention determination unit 14, and the departure intention determination unit 14 may recognize whether the driver has performed the accelerator pedal operation.

[0071] The operation information acquisition unit 12 outputs the operation information, including the shift operation information acquired by the shift operation information acquisition unit 121, the parking brake operation information acquired by the parking brake operation information acquisition unit 122, and the pedal operation information acquired by the pedal operation information acquisition unit 123, to the departure intention determination unit 14.

[0072] Based on the passenger information acquired by the passenger information acquisition unit 11, the departure preparation progress determination unit 13 determines the progress of a passenger's preparation for departure of the vehicle. In the following description, the passenger's "preparation for departure of the vehicle" is also referred to simply as "preparation."

[0073] When the passenger departs with the vehicle, it is assumed that they are preparing for departure by, for example, getting into the vehicle, sitting down, fastening their seatbelt, and adjusting their posture so that they do not sway even when the vehicle starts moving. In the first embodiment, the departure preparation progress determination unit 13 assumes that the passenger is preparing in the order described above and determines the progress of the preparation performed in the order described above into the four stages of "none," "initial stage," "middle stage," and "complete." In the first embodiment, a state where the passenger's progress is "none" means a state where there is no passenger at all. If there is no passenger, there is no progress in the passenger's preparation either.A state where the passenger is in an "early stage" means the passenger is boarding the vehicle and is ready to take a seat. A state where the passenger has reached the "middle stage" indicates that the passenger is ready to fasten the seat belt after sitting down. A state where the passenger has "completed the process" means the passenger has completed fastening the seat belt and is ready to correct their posture so that they do not sway even when the vehicle starts moving.

[0074] For example, in the first embodiment, the passenger's preparation in the four stages is numerically expressed as "0: none," "1: initial stage," "2: middle stage," and "3: complete." That is, the larger the numerical value indicating the passenger's preparation, the more advanced the passenger's preparation is.

[0075] An example of a method for determining the progress of the passenger's preparation by the departure preparation progress determining unit 13 will be described.

[0076] First, the departure preparation progress determination unit 13 determines whether the passenger is present or not based on the occupant information. Specifically, the departure preparation progress determination unit 13 determines whether the passenger is present or not based on the seat information included in the occupant information.

[0077] When it is determined that there is no passenger, the departure preparation progress determination unit 13 determines that the progress of the passenger's preparation is “0: none”.

[0078] If it is determined that a passenger is present, the departure preparation progress determination unit 13 determines whether the passenger has taken their seat or not. Specifically, the departure preparation progress determination unit 13 determines whether the passenger has taken their seat or not based on the seat information included in the passenger information.

[0079] If it is determined that the passenger has not yet taken a seat, the departure preparation progress determination unit 13 determines that the passenger's preparation progress is "1: Initial Stage." "1: Initial Stage" indicates a state in which the passenger is present but has not yet taken a seat.

[0080] If it is determined that the passenger has taken their seat, the departure preparation progress determination unit 13 determines whether the passenger has fastened the seat belt or not. Specifically, the departure preparation progress determination unit 13 determines whether the passenger has fastened the seat belt or not based on the seat belt fastening information included in the occupant information.

[0081] If it is determined that the passenger has not fastened their seat belt, the departure preparation progress determination unit 13 determines that the passenger's preparation progress is "1: Initial Stage." "1: Initial Stage" indicates a state in which the passenger has taken their seat but has not yet begun fastening their seat belt.

[0082] If it is determined that the passenger has fastened the seat belt, the departure preparation progress determination unit 13 determines whether the passenger has completed fastening the seat belt. Specifically, the departure preparation progress determination unit 13 determines whether the passenger has completed fastening the seat belt based on the seat belt fastening information included in the passenger information.

[0083] If it is determined that the passenger has not yet completed fastening the seat belt, the departure preparation progress determination unit 13 determines that the passenger's preparation progress is "2: Middle Stage." "2: Middle Stage" indicates a state in which the passenger has taken their seat and started to operate the seat belt, but the fastening of the seat belt has not yet been completed.

[0084] If it is determined that the passenger is wearing a seatbelt, the departure preparation progress determination unit 13 determines whether the passenger is in an unsafe posture. Specifically, the departure preparation progress determination unit 13 determines whether or not the passenger is in an unsafe posture based on the posture information included in the passenger information.

[0085] If it is determined that the passenger's posture is unsafe, the departure preparation progress determination unit 13 determines that the passenger's preparation progress is "2: Middle Stage." "2: Middle Stage" refers to a state in which the passenger has fastened the seat belt but has not yet corrected their posture to prevent swaying.

[0086] If it is determined that the passenger's posture is not unsafe, the departure preparation progress determination unit 13 determines that the passenger's preparation progress is "3: Complete." "3: Complete" indicates a state in which the passenger has completed the preparation for the vehicle's departure.

[0087] The departure preparation progress determination unit 1) outputs the determined information on the passenger's preparation progress (hereinafter referred to as "departure preparation progress information") to the warning level determination unit 1) and the progress display information generation unit 1). The departure preparation progress information includes information on the passenger's preparation progress, here the numerical values ​​from "0" to "3." In the departure preparation progress information, the information on the passenger's preparation status and the passenger's position can be linked.

[0088] The departure intention determination unit 14 determines the driver's intention to cause the vehicle to depart based on the operation information acquired by the operation information acquisition unit 12. In the following description, the driver's "intention" to cause the vehicle to depart is also simply referred to as "intention to depart."

[0089] When the driver steers the vehicle and starts driving, it is assumed that the driver operates the vehicle in the sequence of, for example, shifting from "P" to "D" or "R," releasing the parking brake, and depressing the accelerator pedal to cause the vehicle to depart. In the first embodiment, it is assumed that the driver operates the vehicle in the sequence described above to cause the vehicle to depart. Since the vehicle is operated in the sequence described above, it can be said that the driver is ready to cause the vehicle to depart; in other words, the driver's intention to cause the vehicle to depart increases.

[0090] In the first embodiment, the departure intention determination unit 14 considers the progress of the vehicle's operation performed in the above-described order as an increase in the driver's departure intention, and determines the departure intention into three stages of "low," "medium," and "high." Note that the departure intention can also be indicated by a numerical value, similar to the passenger's preparation progress described above.

[0091] An example of a method for determining the driver's intention to depart by the departure intention determining unit 14 will be described.

[0092] First, the departure intention determination unit 14 determines a shift position and a parking brake release operation based on the operation information. Specifically, the departure intention determination unit 14 determines the shift position and the parking brake release operation based on the shift operation information and parking brake operation information included in the operation information.

[0093] When the switching operation for setting the D gear or the R gear is not performed, that is, the shift position remains at the P gear, and the operation for releasing the parking brake is not performed, the departure intention determining unit 14 determines that the driver's intention to depart is "low".

[0094] When the switching operation for setting the D gear or the R gear is not performed, that is, the shift position remains at the P gear, and the operation for releasing the parking brake is performed, the departure intention determining unit 14 determines that the driver's intention to depart is "medium".

[0095] In addition, when the switching operation for setting the D shift or the R shift is performed and the parking brake release operation is not performed, the departure intention determination unit 14 determines that the driver's intention to depart is “medium”.

[0096] Next, when the shift operation for setting the D-shift or the R-shift and the parking brake release operation are performed, the departure intention determination unit 14 determines the presence or absence of the accelerator pedal operation based on the operation information. Specifically, the departure intention determination unit 14 determines the presence or absence of the accelerator pedal operation based on the accelerator pedal operation information of the operation information.

[0097] Even when the switching operation for setting the D-shift or the R-shift and the parking brake release operation are performed, the departure intention determining unit 14 determines that the driver's intention to depart is “medium” if the accelerator pedal operation is not performed.

[0098] When the shift operation for setting the D shift or the R shift and the parking brake release operation are performed, and further when the accelerator operation is performed, the departure intention determination unit 14 determines that the driver's intention to depart is "high".

[0099] The departure intention determination unit 14 outputs information about the driver's departure intention (hereinafter referred to as "departure intention information") to the warning level determination unit 15. The departure intention information includes information about the driver's intention to depart ("low," "medium," or "high").

[0100] Based on the passenger's preparation progress determined by the departure preparation progress determination unit 13 and the driver's intention to cause the vehicle to depart determined by the departure intention determination unit 14, the warning level determination unit 15 determines a level for warning the driver of the severity of an unexpected situation that the vehicle or the passenger may encounter during departure (hereinafter referred to as "warning level").

[0101] In the first embodiment, the warning level determination unit 15 sets the warning level for the driver to five levels from "Level 0" to "Level 4." The warning level indicates that the vehicle condition is a condition in which an unexpected situation that the vehicle or its passengers may encounter upon departure is more serious, the larger the value of the warning level. In other words, the larger the value of the warning level, the more important the warning is to the driver. Since the vehicle condition is a condition in which an unexpected situation that the vehicle or its passengers may encounter upon departure is more serious, the driver needs to pay more attention to ensure that the vehicle can start driving without the vehicle or its passengers encountering the unexpected situation.

[0102] An example of a method for determining a warning level by the warning level determining unit 15 according to the first embodiment based on the preparation progress of the passenger and the driver's intention to depart will be described.

[0103] For example, the warning level determining unit 15 determines the warning level depending on a predetermined condition (hereinafter referred to as “warning level determining condition”).

[0104] The warning level determination condition is set in advance by an administrator or the like and stored in a location accessible to the warning level determination unit 15.

[0105] For example, the following (Condition A) to (Condition F) are set as the warning level determination condition. (Condition A)

[0106] If the driver's intention to depart is "low", the warning level is "Level 0", regardless of the passenger's level of preparation. (Condition B)

[0107] Even if the driver's intention to depart is "medium" or "high", the warning level is "level 0" if the passenger's preparations are "0: none" or "3: completed". (Condition C)

[0108] If the driver's intention is "medium" and the passenger's preparation level is "2: medium phase", the warning level is "level" 1. (Condition D)

[0109] If the driver's intention is "medium" and the passenger's preparation level is "1: Initial stage", the warning level is "Level 2". (Condition E)

[0110] If the driver's intention to depart is "high" and the passenger's preparation level is "2: middle phase", the warning level is "level" 3. (Condition F)

[0111] If the driver's intention is "high" and the passenger's preparation level is "1: Initial stage", the warning level is "Level 4".

[0112] Please note that the content of the warning level determination condition is only an example, and the administrator or the like can set the warning level determination condition as needed. The administrator or the like sets the warning level determination condition so that the warning level is determined by a combination of the driver's intention to depart and the progress of the passenger's preparation.

[0113] The warning level determination unit 15 outputs a result of the determination of the warning level (hereinafter referred to as “level determination result”) to the warning display information generation unit 16.

[0114] In the level determination result, the warning level, the information about the driver's intention to depart, and the information about the progress of the passenger's preparation are associated with each other.

[0115] Based on the level determination result outputted by the warning level determination unit 15, the warning display information generation unit 16 generates information for causing a display corresponding to the warning level determined by the warning level determination unit 15 (hereinafter referred to as “warning display information”) to the driver.

[0116] Fig. 2A, Fig. 2B, Fig. 2C and Fig. 2D are diagrams for explaining the warning display information generated by the warning display information generating unit 16 in the first embodiment.

[0117] The warning display information generating unit 16 generates warning display information for displaying a screen as shown in Fig. 2A, Fig. 2B, Fig. 2C or Fig. 2D on the display device 40. The display control of the display device 40 is carried out via the display control unit 18 to be described later. It should be noted that an area in the display device 40 in which the Fig. 2A, Fig. 2B, Fig. 2C or Fig. 2D screen is displayed.

[0118] For example, when the warning level is “Level 1”, the warning display information generation unit 16 generates warning display information to display a screen on which display items as shown in Fig. 2A, in particular a message ‘Preparation is not yet complete’ and a symbol with a large number of circles.

[0119] For example, if the warning level is “Level 2”, the warning display information generation unit 16 generates warning display information for displaying a screen on which the Fig. 2B, in particular a “Caution” message and a symbol with a large number of circles, are displayed.

[0120] For example, when the warning level is “Level 3”, the warning display information generation unit 16 generates warning display information for displaying a screen on which display items as shown in Fig. 2C, in particular a “Warning” message and a symbol with a large number of circles.

[0121] For example, when the warning level is “Level 4”, the warning display information generation unit 16 generates warning display information for displaying a screen on which display items as shown in Fig. 2D, in particular a message about “Danger” and a symbol with a large number of circles are displayed.

[0122] When the warning level is “Level 0”, the warning display information generating unit 16 does not generate any warning display information.

[0123] The warning display information generation unit 16 generates the warning display information such that the display is emphasized at a higher warning level. For example, the warning display information generation unit 16 generates the warning display information such that the Fig. 2B is highlighted darker than the circle symbol shown in Fig. 2A shown circle symbol, which in Fig. 2C is highlighted darker than the circle symbol shown in Fig. 2B and the circle symbol shown in Fig. The circle symbol shown in 2D is highlighted darker than the one in Fig. 2C. The warning display information generation unit 16 may generate the warning display information so that the circular symbol flashes.

[0124] It should be noted that in the Fig. 2A, Fig. 2B, Fig. 2C and Fig. 2D, for simplicity, a square is shown surrounding the message and the circular symbol, but the square is not displayed on the display device 40.

[0125] As described above, the warning display information generating unit 16 generates warning display information to cause a display of the severity of the warning of an unexpected situation that may occur when the vehicle departs, in such a way that the display is made in a form in which the driver pays more attention because the warning level is higher.

[0126] The warning display information generation unit 16 outputs the generated warning display information in conjunction with the information indicating the driver's intention to depart and the passenger's progress display information to the display control unit 18.

[0127] The progress display information generation unit 17 generates information based on the passenger's preparation progress determined by the departure preparation progress determination unit 13 to prompt a display corresponding to the passenger's preparation progress (hereinafter referred to as "progress display information"). Specifically, the progress display information generation unit 17 generates progress display information based on the passenger's preparation progress determined by the departure preparation progress determination unit 13 to inform the driver of a progress state of the passenger's preparation in a form corresponding to the passenger's preparation progress.

[0128] Fig. 3A, Fig. 3B and Fig. 3C are diagrams for explaining the progress display information generated by the progress display information generating unit 17 in the first embodiment.

[0129] The progress display information generating unit 17 generates progress display information for displaying a screen as shown in Fig. 3A, Fig. 3B or Fig. 3C on the display device 40. The display control of the display device 40 is carried out via the display control unit 18 to be described later. It should be noted that an area in the display device 40 in which the Fig. 3A, Fig. 3B, Fig. 3C or Fig. 3D displayed screen is displayed.

[0130] For example, when the passenger's preparation progress is “1: Initial stage”, the progress display information generation unit 17 generates progress display information to display a screen on which a message “Preparation” and an icon indicating a person are displayed, as shown in Fig. 3A.

[0131] For example, when the passenger's preparation progress is “2: middle stage”, the progress display information generation unit 17 generates progress display information to display a screen on which a message “Preparation” and an icon indicating the person wearing the seat belt are displayed, as shown in Fig. 3B.

[0132] For example, when the progress of the passenger's preparation is “3: completed,” the progress display information generation unit 17 generates progress display information for displaying a screen on which a message “Departure OK” and an icon on which a check mark indicating completion of fastening the seat belt is superimposed on the buckled person are displayed, as shown in Fig. 3C.

[0133] When the progress of the passenger's preparation is “0: none”, the progress display information generation unit 17 does not generate any progress display information.

[0134] The progress display information generation unit 17 generates the progress display information so that the Fig. 3B is more prepared for the departure of the vehicle by the passenger than the symbol in Fig. 3A, and the symbol shown in Fig. 3C is more prepared for the departure of the vehicle by the passenger than the symbol in Fig. Symbol shown in Figure 3B.

[0135] It should be noted that in the Fig. 3A, Fig. 3B and Fig. 3C, for simplicity, a square is shown surrounding the message and the icon, but the square is not displayed on the display device 40.

[0136] As described above, the progress display information generation unit 17 generates the progress display information for notifying the driver of the status of the passenger's preparation in such a manner that the display is made in a form indicating that the preparation is in progress when the passenger's preparation for departure is in progress, in other words, when the numerical value indicating the passenger's preparation for departure becomes larger.

[0137] The progress display information generation unit 17 outputs the generated progress display information in conjunction with the information indicating the progress of the passenger's preparation to the display control unit 18.

[0138] The display control unit 18 causes the display device 40 to perform a display based on the warning display information generated by the warning display information generating unit 16 and a display based on the progress display information generated by the progress display information generating unit 17.

[0139] For example, the display control unit 18 causes the display device 40 to superimpose a message and an icon based on the warning display information generated by the warning display information generation unit 16 and a message and an icon based on the progress display information generated by the progress display information generation unit 17. The display control unit 18 can correlate the warning display information and the progress display information by displaying the passenger preparation progress information associated with the warning display information and the progress display information, respectively.

[0140] Fig. 4 is a diagram showing screen examples that the display control unit 18 displays on the display device 40 in the first embodiment.

[0141] For example, the warning display information for displaying the warning level 4 screen, as shown in Fig. 2D, with the progress display information for displaying the passenger’s preparation progress screen of “1: Initial phase”, as shown in Fig. 3A. Therefore, the display control unit 18 causes the display device 40 to display a screen as shown in Fig. 4 with Da. In a case where the messages overlap due to the superposition of the display based on the warning display information and the display based on the progress display information, the display control unit 18, for example, causes the message based on the warning display information to be displayed preferentially. Fig. 4, the display control unit 18 gives priority to the "Danger" message over the "Preparation" message. As a result, the "Preparation" message is not displayed.

[0142] In addition, for example, the warning display information for displaying the warning level 3 screen as shown in Fig. 2C, with the progress display information for displaying the passenger preparation progress screen “2: middle phase”, as shown in Fig. 3B. Therefore, the display control unit 18 causes the display device 40 to display a screen as shown in Fig. 4 indicated by Db.

[0143] In addition, for example, the warning display information for displaying the warning level 2 screen, as shown in Fig. 2B, with the progress display information for displaying the passenger preparation progress screen “1: Initial phase”, as shown in Fig. 3A. Therefore, the display control unit 18 causes the display device 40 to display a screen as shown in Fig. 4 indicated with Dd.

[0144] In addition, for example, the warning display information for displaying the warning level 1 screen, as shown in Fig. 2A, with the progress display information for displaying the passenger preparation progress screen “2: middle phase” as shown in Fig. 3B. Therefore, the display control unit 18 causes the display device 40 to display a screen as shown in Fig. 4 indicated with De.

[0145] Furthermore, in a case where, for example, the warning display information generation unit 16 does not generate the warning display information and the progress display information generation unit 17 generates the progress display information, the display control unit 18 causes the display device 40 to display only one screen based on the progress display information. For example, if the passenger's preparation status is "3: Complete," the warning level is "Level 0," so no warning display information is generated, but progress display information is generated. That is, only the progress display information generated by the progress display information generation unit 17 is output to the display control unit 18.

[0146] In this case, the display control unit 18 causes the display device 40 to display a screen based on the progress display information (see Dc, Df, Dg, Dh and Di in Fig. 4).

[0147] If the warning display information generation unit 16 does not generate the warning display information and the progress display information generation unit 17 does not generate the progress display information, the display control unit 18 does not display the screen based on the warning display information or the screen based on the progress display information on the display device 40. For example, if the progress of the passenger's preparation is "0: none," no progress display information is generated, and the warning level is set to "Level 0," so that no warning display information is generated. That is, neither the warning display information generated by the warning display information generation unit 16 nor the progress display information generated by the progress display information generation unit 17 is output to the display control unit 18.

[0148] Fig. 5 is a diagram of the display device 40 that displays a screen based on the warning display information and the progress display information under the control of the display control unit 18 as viewed from the vehicle interior in the first embodiment.

[0149] In the first embodiment, as described above, it is assumed that the display device 40 is a display panel mounted in front of a steering wheel (in Fig. 5 designated 51) is located in the vehicle. It should be noted that in Fig. 5 is a left-hand drive vehicle, but this is only an example. The vehicle may be a right-hand drive vehicle.

[0150] In Fig. 5, the display device 40 has, for example, a display area on the left side as seen from the vehicle interior (in Fig. 5 marked by 401), a display area in the middle, seen from the vehicle interior (in Fig. 5 by 402), and a display area on the right side as seen from the vehicle interior (in Fig. 5 marked by 403).

[0151] The screen based on the warning display information and the progress display information is displayed in the display area on the left side as viewed from the vehicle interior.

[0152] In Fig. 5, the display control unit 18 causes the display device 40 to display a screen on which the message and the symbol based on the warning display information corresponding to the warning level 1 and the message and the symbol based on the progress display information corresponding to the progress of the passenger's preparation "2: middle stage" are superimposed.

[0153] An operation of the display control device 1 according to the first embodiment will be described.

[0154] Fig. 6 is a flowchart for explaining the operation of the display control device 1 according to the first embodiment.

[0155] For example, the display control device 1 repeats the process shown in the flowchart of Fig. 6 while a vehicle power supply is switched on.

[0156] The occupant information acquisition unit 11 acquires occupant information based on the first sensor information output from the first sensor 20 (step ST1a).

[0157] Specifically, the seat information acquisition unit 111 acquires the seat information. Furthermore, the seat belt fastening information acquisition unit 112 acquires information about the fastening of the seat belt. Furthermore, the posture information acquisition unit 113 acquires the posture information.

[0158] The occupant information acquisition unit 11 outputs the occupant information including the seat information acquired by the seat information acquisition unit 111, the seat belt fastening information acquired by the seat belt information acquisition unit 112, and the posture information acquired by the posture information acquisition unit 113 to the departure preparation progress determination unit 13.

[0159] The operation information acquisition unit 12 acquires operation information based on second sensor information output from the second sensor 30 (step ST1b). Specifically, the gearshift information acquisition unit 121 acquires the gearshift information. Furthermore, the parking brake operation information acquisition unit 122 acquires the parking brake operation information. Furthermore, the pedal operation information acquisition unit 123 acquires the pedal operation information.

[0160] The operation information acquisition unit 12 outputs the operation information, including the shift operation information acquired by the shift operation information acquisition unit 121, the parking brake operation information acquired by the parking brake operation information acquisition unit 122, and the pedal operation information acquired by the pedal operation information acquisition unit 123, to the departure intention determination unit 14.

[0161] Based on the occupant information acquired by the occupant information acquisition unit 11 in step ST1a, the departure preparation progress determination unit 13 determines the progress of a passenger's preparation for the departure of the vehicle (step ST2a).

[0162] The departure preparation progress determining unit 13 outputs departure preparation progress information about the determined progress of the passenger's preparation for departure to the warning level determining unit 15 and the progress display information generating unit 17.

[0163] Based on the operation information acquired by the operation information acquisition unit 12 in step ST1b, the departure intention determination unit 14 determines the intention to cause the vehicle to depart by the driver (step ST2b).

[0164] The departure intention determining unit 14 outputs to the warning level determining unit 15 information about the determined driver's intention to depart.

[0165] Based on the passenger's preparation progress determined by the departure preparation progress determination unit 13 in step ST2a and the driver's intention to cause the vehicle to depart determined by the departure intention determination unit 14 in step ST2b, the warning level determination unit 15 determines a warning level to warn the driver of the severity of an unexpected situation that the vehicle or the passenger may encounter during departure (step ST3).

[0166] The warning level determination unit 15 outputs a level determination result to the warning display information generation unit 16.

[0167] Based on the level determination result outputted by the warning level determination unit 15 in step ST3, the warning display information generation unit 16 generates warning display information to cause a display corresponding to the warning level determined for the driver by the warning level determination unit 15 (step ST4).

[0168] The warning display information generation unit 16 outputs the generated warning display information in conjunction with the information indicating the driver's intention to depart and the passenger's progress display information to the display control unit 18.

[0169] The progress display information generation unit 17 generates progress display information to display a display corresponding to the preparation state based on the progress of the passenger's preparation determined by the departure preparation progress determination unit 13 in step ST5 (step ST2a).

[0170] The progress display information generation unit 17 outputs the generated progress display information in conjunction with the information indicating the progress of the passenger's preparation to the display control unit 18.

[0171] The display control unit 18 causes the display device 40 to perform a display based on the warning display information generated by the warning display information generation unit 16 in step ST4 and a display based on the progress display information generated by the progress display information generation unit 17 in step ST5 (step ST6).

[0172] In the operation of the display control device 1 shown in the flowchart of Fig. As shown in Figure 6, the processing is performed in the order of step ST3, step ST4, and step ST5, but this is only an example. The order of the processing in steps ST3 to ST4 and the processing in step ST5 may be reversed, or the processing in steps ST3 to ST4 and the processing in step ST5 may be performed in parallel.

[0173] Fig. Fig. 7 is a flowchart for explaining details of an example of the processing in step ST2a in Fig. 6 by the departure preparation progress determination unit 13.

[0174] It should be noted that the flowchart of Fig. 7 takes place in a case where the departure preparation progress determining unit 13 determines the progress of the passenger's preparation in the four phases of "none", "initial phase", "middle phase" and "completed".

[0175] First, the departure preparation progress determination unit 13 determines whether a passenger is present or not based on the occupant information (step ST2a-1).

[0176] If it is determined in step ST2a-1 that there is a passenger (if "YES" in step ST2a-1), the departure preparation progress determination unit 13 determines whether the passenger has taken his seat or not (step ST2a-2).

[0177] If it is determined in step ST2a-2 that the passenger has taken his seat (if "YES" in step ST2a-2), the departure preparation progress determination unit 13 determines whether the passenger has fastened the seat belt or not (step ST2a-3).

[0178] If it is determined in step ST2a-3 that the passenger has fastened the seat belt (if “YES” in step ST2a-3), the departure preparation progress determination unit 13 determines whether the passenger has completed fastening the seat belt or not (step ST2a-4).

[0179] When it is determined in step ST2a-4 that the passenger has completed fastening the seat belt (if “YES” in step ST2a-4), the departure preparation progress determination unit 13 determines whether or not the passenger is in an unsafe posture (step ST2a-5).

[0180] When it is determined in step ST2a-5 that there is no unsafe posture of the passenger (when “NO” in step ST2a-5), the departure preparation progress determining unit 13 determines that the progress of the passenger's preparation is “3: completed” (step ST2a-9).

[0181] If it is determined in step ST2a-4 that the passenger has not completed fastening the seat belt (if “NO” in step ST2a-4) or if it is determined in step ST2a-5 that there is an unsafe posture of the passenger (if “YES” in step ST2a-5), the departure preparation progress determination unit 13 determines that the preparation progress of the passenger is “2: middle stage” (step ST2a-8).

[0182] When it is determined in step ST2a-2 that the passenger has not completed the seating operation (if “NO” in step ST2a-2), or when it is determined in step ST2a-3 that the passenger has not fastened the seat belt (if “NO” in step ST2a-3), the departure preparation progress determining unit 13 determines that the progress of the passenger's preparation is “1: Initial stage” (step ST2a-7).

[0183] When it is determined in step ST2a-1 that there is no passenger (when “NO” in step ST2a-1), the departure preparation progress determining unit 13 determines that the progress of preparation by the passenger is “0: none” (step ST2a-6).

[0184] Subsequently, the departure preparation progress determining unit 13 outputs the departure preparation progress information to the warning level determining unit 15 and the progress display information generating unit 17.

[0185] Fig. Fig. 8 is a flowchart for explaining details of the processing in step ST2b in Fig. 6 by the departure intention determination unit 14.

[0186] It should be noted that the flowchart of Fig. 8 is performed in a case where the departure intention determining unit 14 determines the driver's intention to depart in three phases of "low", "medium" or "high".

[0187] First, the departure intention determination unit 14 determines whether or not a switching operation for setting the D position or the R position has been performed based on the operation information (step ST2b-1).

[0188] When it is determined in step ST2b-1 that the switching operation for setting the D shift or the R shift has been performed (if "YES" in step ST2b-1), the departure intention determining unit 14 determines whether or not an operation for releasing the parking brake has been performed (step ST2b-2).

[0189] When it is determined in step ST2b-2 that the parking brake release operation has been performed (if "YES" in step ST2b-2), the departure intention determination unit 14 determines whether or not an accelerator pedal operation has been performed based on the operation information (step ST2b-3).

[0190] When it is determined in step ST2b-3 that the accelerator pedal has been depressed (if “YES” in step ST2b-3), the departure intention determining unit 14 determines that the driver's intention to depart is “high” (step ST2b-7).

[0191] On the other hand, if it is determined in step ST2b-1 that the switching operation for setting the D shift or the R shift has not been performed ("NO" in step ST2b-1), in other words, if it is determined that the shift position remains in the P shift, the departure intention determining unit 14 determines whether or not an operation for releasing the parking brake has been performed (step ST2b-4).

[0192] If it is determined in step ST2b-4 that the parking brake release operation has been performed (if "YES" in step ST2b-4), if it is determined in step ST2b-2 that the parking brake release operation has not been performed (if "NO" in step ST2b-2), or if it is determined in step ST2b-3 that the accelerator pedal has not been operated (if "NO" in step ST2b-3), the departure intention determining unit 14 determines that the driver's intention to depart is "medium" (step ST2b-6).

[0193] When it is determined in step ST2b-4 that the parking brake release operation has not been performed (if “NO” in step ST2b-4), the departure intention determining unit 14 determines that the driver's intention to depart is “low” (step ST2b-5).

[0194] Subsequently, the departure intention determination unit 14 outputs the departure intention information to the warning level determination unit 15.

[0195] Fig. Fig. 9 is a flowchart for explaining details of an example of the processing in step ST3 in Fig. 6 by the warning level determination unit 15.

[0196] It should be noted that the flowchart of Fig. 9 is performed in a case where the warning level determination unit 15 determines warning levels of five levels “Level 0” to “Level 4” in accordance with the warning level determination condition, and the above-described (Condition A) to (Condition F) are set in the warning level determination condition.

[0197] The warning level determination unit 15 detects the warning level determined by the departure intention determination unit 14 in step ST2b of Fig. 6 (step ST3-1) output departure intention information.

[0198] The warning level determination unit 15 acquires the warning level determined by the departure preparation progress determination unit 13 in step ST2a of Fig. 6 (step ST3-2) output departure preparation progress information.

[0199] The warning level determination unit 15 determines whether the driver's intention to depart is "low", "medium", or "high" based on the departure intention information (step ST3-3).

[0200] When it is determined in step ST3-3 that the driver's departure intention is "high" (when "High" in step ST3-3), the warning level determination unit 15 determines whether the passenger's preparation progress is "0: none", "1: initial stage", "2: middle stage", or "3: completed" based on the departure preparation progress information (step ST3-5).

[0201] When it is determined in step ST3-5 that the passenger's preparation progress is "1: Initial stage" (when "Initial stage" in step ST3-5), the warning level determining unit 15 determines the warning level as "Level 4" (step ST3-10).

[0202] When it is determined in step ST3-5 that the preparation progress of the passenger is “2: middle stage” (when “Middle stage” in step ST3-5), the warning level determining unit 15 determines the warning level as “Level 3” (step ST3-9).

[0203] When it is determined in step ST3-3 that the driver's departure intention is "medium" (when "medium" in step ST3-3), the warning level determination unit 15 determines whether the passenger's preparation progress is "0: none", "1: initial stage", "2: middle stage", or "3: completed" based on the departure preparation progress information (step ST3-4).

[0204] When it is determined in step ST3-4 that the passenger's preparation progress is "1: Initial stage" (when "Initial stage" in step ST3-4), the warning level determining unit 15 determines the warning level as "Level 2" (step ST3-8).

[0205] When it is determined in step ST3-4 that the passenger's preparation progress is "2: middle stage" (when "Middle stage" in step ST3-4), the warning level determining unit 15 determines the warning level as "Level 1" (step ST3-7).

[0206] When it is determined in step ST3-3 that the driver's intention to depart is "low" (when "low" in step ST3-3), when it is determined in step ST3-5 that the progress of the passenger's preparation is "0: none" or "3: completed" (when "None" or "Completed" in step ST3-5), or when it is determined in step ST3-4 that the progress of the passenger's preparation is "0: none" or "3: completed" (when "None" or "Completed" in step ST3-4), the warning level determining unit 15 determines the warning level as "level 0" (step ST3-6).

[0207] Subsequently, the warning level determination unit 15 outputs a level determination result to the warning display information generation unit 16.

[0208] It should be noted that in the flowchart of Fig. 9 The processing is performed in the order of step ST3-1 and step ST3-2, but this is only an example. The order of processing in step ST3-1 and processing in step ST3-2 may be reversed, or the processing in step ST3-1 and processing in step ST3-2 may be performed in parallel.

[0209] As described above, the display control device 1 can warn the driver of the severity of an unexpected situation that may occur at various levels when the driver attempts to initiate the vehicle departure by causing the display device 40 to display based on the warning display information. By simply checking the display device 40, the driver can grasp the severity of the unexpected situation that may occur and take some measures corresponding to the severity of the unexpected situation that may occur.

[0210] At this time, the display control device 1 can inform the driver of the passenger's preparation progress by prompting them to perform the display jointly based on the progress display information. By grasping the passenger's preparation status, the driver can easily determine what kind of measures should be taken against the passenger.

[0211] By the display control device 1, for example, a warning level “Level 4” (e.g., since Fig. 4) triggers a corresponding display, the driver can recognize that a serious unexpected situation is likely to occur and that measures must be taken to avoid the unexpected situation, such as immediately stopping the operation of the vehicle for departure or returning to operation. For example, the driver immediately stops the operation of the vehicle for departure or operates the vehicle to resume operation. At this time, since the display control device 1 makes a display indicating that the progress of the passenger's preparation is, for example, "initial stage," it is possible for the driver to grasp at a glance that the passenger's preparation has hardly progressed, even though the operation of the vehicle has progressed to the point where the vehicle can depart soon. The driver can talk to the passenger to help them prepare, for example,"Do you need help?".

[0212] In addition, the display control device 1 can warn the driver that there is a possibility that a serious unexpected situation may occur and that it is necessary to eliminate the possibility that the unexpected situation may occur, for example, by displaying a display corresponding to the warning level “Level 3” (e.g., Db in Fig. 4). At this time, since the display control device 1 displays a display indicating that the progress of the passenger's preparation is, for example, "mid-stage," the driver can see at a glance that the vehicle's operation has progressed to the point where the vehicle can depart soon, but the passenger's preparation is not yet complete, and that there is no problem in urging the vehicle to depart if the passenger's preparation, which has progressed to a stage before completion, is completed. The driver can talk to the passenger to inform them of the departure and request them to complete the preparation for departure, for example, "Are we ready to go? Are you okay?"

[0213] In addition, the display control device 1 can warn the driver that the probability of a serious unexpected situation occurring is low, but that it is necessary to pay attention to the passenger’s condition, for example, by displaying a display corresponding to the warning level “Level 2” (e.g. Dd in Fig. 4). At this time, since the display control device 1 displays a message indicating that the passenger's preparation progress is, for example, "Initial Stage," the driver can see at a glance that the passenger's preparation progress is slow compared to the vehicle's operation progress. The driver can talk to the passenger to check their condition, for example, "Sit down quickly. Are you wearing your seat belt?"

[0214] In addition, the display control device 1 can warn the driver that the probability of a serious unexpected situation occurring is low, but that it is better to pay attention to the passenger's condition by displaying a display corresponding to the warning level “Level 1” (e.g. De in Fig. 4). The driver thus guides the vehicle toward departure to ensure a smooth departure for the passenger. At this time, since the display control device 1 indicates that the passenger's preparation is in the "middle stage," for example, the driver can see at a glance that the passenger's preparation is not yet complete but is progressing smoothly. The driver can speak to the passenger to prepare the vehicle for departure, for example, "It seems like it's okay to depart soon."

[0215] When the warning level is "Level 0," the display control device 1 does not perform a display corresponding to the warning level. That is, when the warning level is "Level 0," the display control device 1 does not warn the driver of a possible unexpected situation. Since the warning is not issued, the driver can assume that the vehicle or its passengers will not encounter an unexpected situation even when departing, or that an unexpected situation that may occur when the vehicle departs is not serious. At this time, the display control device 1 initiates a display informing the passenger of the preparation progress. From the display showing the progress of the passenger's preparation, the driver can know that the passenger's preparation is complete or will be completed by departure.The driver can use his awareness for other things without paying attention to the passenger.

[0216] With the conventional technique of indicating that the passenger is fastening their seat belt by displaying a specific expression as described above, it is not possible for the driver to grasp how serious an unexpected situation may be when the driver causes the vehicle to depart just by looking at the display. With the technique of indicating the passenger's condition by displaying a specific expression, the driver can, for example, assume that the passenger's preparation is going smoothly and there is no problem causing the vehicle to depart, in other words, that the vehicle will not be put into an unexpected situation even during departure, and continue to depart, feeling an abnormality when depressing the accelerator pedal.The driver checks the passenger at this time and then finds that the passenger has forgotten to make preparations or that the passenger has encountered a problem.

[0217] As described above, it has not been possible to inform the driver of the severity of the unexpected situation that may occur when the driver initiates the vehicle's departure. Therefore, in order for the driver to understand the severity of the unexpected situation that may occur when the driver initiates the vehicle's departure, they must check the passenger's preparation for the vehicle's departure by asking the passenger or changing their posture and looking at the passenger.

[0218] On the other hand, the display control device 1 according to the first embodiment can warn the driver that an unexpected situation may occur when the driver causes the vehicle to depart, so that the severity of the unexpected situation that may occur can be recognized. In other words, the importance of the warning can be recognized by generating warning display information for displaying according to a certain warning level and causing the display device 40 to display the warning display information. When the driver recognizes the significance of the warning, the driver saves time and effort for checking the passenger's condition in detail. In addition, the display control device 1 changes the display content as the driver's intention increases or as the passenger's preparation for departure progresses.For example, the driver can recognize that the importance of the warning has changed because the warning changes as the driver progresses through the departure process, and can take action depending on a current condition.

[0219] For example, assume that the driver stops operation and waits for departure because the display corresponding to the warning level "Level 3" appears. Then, as the passenger gently prepares for departure, the display changes in the order of the "Level 2" display, the "Level 1" display, and the "Level 0" display. From the changing display, the driver can know that the passenger is preparing for departure and that the situation is approaching a state where there are no problems, even if the driver instructs the vehicle to depart.

[0220] If the Level 3 warning persists after a while, the driver understands that a condition has arisen where a serious unexpected situation may occur if the driver continually causes the vehicle to depart. In this case, the driver can review the condition in detail to rule out a condition where a serious unexpected situation may occur if the driver causes the vehicle to depart, such as asking the passenger to make preparations and allowing the vehicle to depart without any problems.

[0221] As described above, in the first embodiment, it is assumed that when the passenger gets into the vehicle and the driver causes the vehicle to depart, the display control device 1 causes the display device to display a display to warn the driver that an unexpected situation may occur when the vehicle departs. Notwithstanding this, the display control device 1 also displays a display during driving, for example, that is,also at the departure of the vehicle, in a case where the passenger deviates from the state in which the passenger has taken his seat, from the state in which the passenger has fastened the seat belt, or the state in which there is no unsafe posture, give the driver a warning divided into levels about the severity of an unexpected situation that may occur due to the departure of the vehicle, which is similar to the case where the driver causes the vehicle to depart by always carrying out the operation as shown in the flowchart of . Fig. 6 while the vehicle's power is on. Thus, the display control device 1 can also help the driver realize that they need to be warned to avoid an unexpected situation.

[0222] In the first embodiment described above, the progress display information generation unit 17 may generate progress display information for displaying the passenger's preparation progress in the form of an animation that changes over time according to the passenger's preparation progress.

[0223] Fig. 10A, Fig. 10B and Fig. 10C are diagrams for explaining the progress display information generated by the progress display information generation unit 17 in the first embodiment to display the progress of a passenger's preparation in an animation that changes over time.

[0224] For example, when the progress of the passenger's preparation is “1: Initial stage”, the progress display information generation unit 17 may generate progress display information to cause the display device 40 to display a screen on which an icon indicating a seat (see P1-1), an icon indicating the seat and a person displayed in light (see P1-2), and an icon indicating the seat and the person displayed in dark (see P1-3) are repeatedly displayed in an animation as shown in Fig. 10A.

[0225] For example, when the progress of the passenger's preparation is “2: middle stage”, the progress display information generation unit 17 may generate progress display information to cause the display device 40 to display a screen on which an icon indicating a person (see P2-1), an icon indicating the person who has pulled out the seat belt to a shoulder (see P2-2), and an icon indicating the person who has pulled out the seat belt to a waist (see P2-3) are repeatedly displayed in an animation as shown in Fig. 10B.

[0226] For example, when the progress of the passenger's preparation is “3: completed,” the progress display information generation unit 17 may generate progress display information to cause the display device 40 to display a screen on which an icon indicating a person who has completed fastening the seat belt (see P3-1), an icon indicating a state in which a check mark is partially placed on the person who has completed fastening the seat belt (see P3-2), and an icon indicating a state in which the check mark is completely placed on the person who has completed fastening the seat belt (see P3-3) are repeatedly displayed in an animation as shown in Fig. 10C.

[0227] It should be noted that in the Fig. 10A, Fig. 10B and Fig. 10C, for simplicity, a square is shown surrounding the message and the symbol, but the square is not displayed on the display device 40.

[0228] Moreover, in the above first embodiment, in the display control device 1, the display control unit 18 causes the display device 40 to perform display based on the warning display information generated by the warning display information generating unit 16 and display based on the progress display information generated by the progress display information generating unit 17, but this is only an example.

[0229] The display control unit 18 is only required to cause the display device 40 to perform at least one display based on the warning display information generated by the warning display information generating unit 16. That is, the display control unit 18 does not need to perform a display based on the progress display information generated by the progress display information generating unit 17. If the display control unit 18 does not cause the display to be performed based on the progress display information, the display control device 1 may be configured not to include the progress display information generating unit 17. In this case, the display control device 1 may skip the processing of step ST5 for the operation of the display control device 1, which is described with reference to the flowchart in Fig. 6 is described.

[0230] Fig. 11A, Fig. 11B, Fig. 11C and Fig. 11D are diagrams for explaining screen examples of the display device 40 in a case where the display control unit 18 causes the display device 40 to display only a display based on the warning display information in the first embodiment.

[0231] Since it is not necessary to display a message or icon based on the warning display information and a message or icon based on the progress display information on top of each other, as in the Fig. 11A, Fig. 11B, Fig. 11C and Fig. 11D, the display control unit 18 can perform the display control so that a message "Preparation is not yet complete", "Caution", "Warning" or "Danger" is displayed in the center of a circle symbol.

[0232] In the Fig. 11A, Fig. 11B, Fig. 11C and Fig. 11D, a square is shown surrounding the message and icon for simplicity, but the square is not displayed on the display device 40.

[0233] When the display control unit 18 causes the display device 40 to display both the message or icon based on the warning display information and the message or icon based on the progress display information, it is not necessary to display the message or icon based on the warning display information and the message or icon based on the progress display information in a superimposed manner. For example, the display control unit 18 may cause the display device 40 to display the message or icon based on the warning display information and the message or icon based on the progress display information side by side.

[0234] In the above first embodiment, the departure preparation progress determination unit 13 determines the passenger's preparation progress using the seat information, seat belt fastening information, and posture information. However, this is only one example.

[0235] For example, the departure preparation progress determination unit 13 can determine the progress of the passenger's preparation based on the seat information, the seat belt fastening information, and the posture information.

[0236] If the departure preparation progress determination unit 13 does not use the seat information to determine the preparation progress by the passenger, the display control device 1 may be configured not to include the seat information acquisition unit 111. In this case, the departure preparation progress determination unit 13 may perform the processing of steps ST2a-1 to ST2a-2 in the flowchart described with reference to the flowchart of Fig. Skip the procedure described in section 7.

[0237] In a case where the departure preparation progress determination unit 13 does not use the seat belt fastening information acquisition unit 112 to determine the progress of the passenger's preparation, the display control device 1 may be configured not to include the seat belt fastening information acquisition unit. In this case, the departure preparation progress determination unit 13 may perform the processing of steps ST2a-3 to ST2a-4 in the flowchart described with reference to FIG. Fig. Skip the procedure described in section 7.

[0238] In a case where the departure preparation progress determination unit 13 does not use the posture information to determine the preparation progress of the passenger, the display control device 1 may be configured not to include the posture information acquisition unit 113. In this case, the departure preparation progress determination unit 13 may perform the processing of step ST2a-5 in the flowchart described with reference to the flowchart of Fig. Skip the procedure described in section 7.

[0239] In the above first embodiment, the departure preparation progress determining unit 13 may determine the progress of the passenger's preparation based on information other than the seat information, the seat belt information, and the posture information.

[0240] For example, the departure preparation progress determination unit 13 can determine the progress of the passenger's preparation based on behavior other than the passenger's unsafe posture (e.g., whether the passenger is calm or not, or whether the passenger is performing an action irrelevant to departure). In this case, the occupant information acquisition unit 11 detects behavior other than the passenger's unsafe posture and forwards it as occupant information to the departure preparation progress determination unit 13.

[0241] Furthermore, the departure preparation progress determination unit 13 may determine the passenger's preparation progress based on the passenger's gaze direction (e.g., whether the passenger is looking forward or not). In this case, the passenger information acquisition unit 11 acquires, for example, the passenger's gaze direction and transmits it to the departure preparation progress determination unit 13 as passenger information.

[0242] Furthermore, the departure preparation progress determination unit 13 can, for example, determine the progress of the passenger's preparation based on a passenger's utterance. In this case, the passenger information acquisition unit 11 acquires, for example, the passenger's facial expression and transmits it to the departure preparation progress determination unit 13 as the passenger information.

[0243] In the above first embodiment, the departure intention determination unit 14 determines the driver's intention to depart by using the shift operation information, parking brake operation information, and pedal operation information. However, this is only one example.

[0244] For example, the departure intention determining unit 14 may determine the driver's intention to depart by using one or two of the shift operation information, the parking brake operation information, and the pedal operation information.

[0245] If the departure intention determination unit 14 does not use the shift operation information to detect the driver's departure intention, the display control device 1 may be configured not to include the shift operation information detecting unit 121 for detecting the departure intention. In this case, the departure intention determination unit 14 may skip the processing of step ST2b-1 in the flowchart described with reference to FIG. Fig. Skip the procedure described in section 8.

[0246] If the departure intention determination unit 14 does not use the parking brake operation information to determine the driver's intention to depart, the display control device 1 may be configured not to include the parking brake operation information acquisition unit 122. In this case, the departure intention determination unit 14 may perform the processing of steps ST2b-2 and ST2b-4 in the flowchart described with reference to FIG. Fig. Skip the procedure described in section 8.

[0247] When the departure intention determination unit 14 does not use the pedal operation information to determine the driver's intention to depart, the display control device 1 may be configured not to include the pedal operation information acquisition unit 123. In this case, the departure intention determination unit 14 may skip the processing of step ST2b-3 in the flowchart described with reference to FIG. Fig. Skip the procedure described in section 8.

[0248] Moreover, in the above first embodiment, the departure intention determining unit 14 can determine the driver's intention to depart by using information other than the shift operation information, the parking brake operation information, and the pedal operation information.

[0249] For example, the departure intention determination unit 14 may determine the driver's intention to depart based on the information about whether the driver is holding the steering wheel. In this case, the operation information acquisition unit 12 detects, for example, whether the driver is holding the steering wheel and transmits this to the departure intention determination unit 14 as the operation information.

[0250] Furthermore, in the above-mentioned first embodiment, the departure preparation progress determination unit 13 determines the progress of the passenger's preparation for the vehicle's departure into four stages: "0: none," "1: initial stage," "2: middle stage," and "3: complete." However, this is only an example. The progress of the passenger's preparation for the vehicle's departure determined by the departure preparation progress determination unit 13 can be set to two stages, three stages, or five or more stages. The stage can be set by an administrator or the like as needed based on an operation to be performed in the vehicle in stages as preparation for the passenger's departure.

[0251] Furthermore, in the above first embodiment, the departure intention determination unit 14 determines the driver's intention to cause the vehicle to depart in three phases: "low," "medium," or "high," but this is only an example. The driver's intention to cause the vehicle to depart determined by the departure intention determination unit 14 may be set to two phases or four or more. The phase may be set by an administrator or the like as needed based on an operation assumed to be performed in phases when the driver causes the vehicle to depart.

[0252] In the above first embodiment, the warning level determined by the warning level determination unit 15 is set to five phases from "Level 0" to "Level 4," but this is only an example. The phases of the warning level can be set by an administrator or the like as needed.

[0253] In the first embodiment above, it is assumed that the passenger is sitting in the rear seat, but this is only an example. The passenger can, for example, sit in a passenger seat.

[0254] In the first embodiment, the number of passengers is one, but this is just an example. For example, there may be a plurality of passengers. When there are multiple passengers, the departure preparation progress determination unit 13 in the display control device 1 may set an average of the departure preparation progress of the multiple passengers as the departure preparation progress of the passengers, or set the slowest progress (that is, the progress represented by the smallest numerical value) among the departure preparation progress of the multiple passengers as the departure preparation progress of the passengers.For example, if there are two passengers and the preparation progress of one of the passengers is “1: initial stage” and the preparation progress of the other passenger is “3: completed”, the departure preparation progress determination unit 13 may set “2: middle stage” as the average of the preparation progress of the two passengers.

[0255] Furthermore, for example, the progress display information generation unit 17 may generate progress display information for each of the plurality of passengers, and the display control unit 18 may cause the display device 40 to perform the display based on the progress display information for each of the plurality of passengers. For example, the display control unit 18 displays a seat in the vehicle interior, matches the displayed seat with a seat where the passenger is sitting or will be sitting, and causes the display to be performed based on the progress display information of each of the plurality of passengers. From the display device 40, the driver can intuitively understand the readiness of the passenger in any seat to prepare for departure.

[0256] Furthermore, in the above first embodiment, it is assumed that the display device 40 to be displayed by the display control device 1 is a display device 40 located at a position visually recognizable by the driver looking ahead of the vehicle without largely changing the line of sight. However, this is only an example. The display device 40 to be displayed by the display control device 1 may be, for example, a display device 40 provided at a position visually recognizable by a passenger on a rear seat, such as a backrest of a front seat, in addition to the display device 40 provided at the position visually recognizable by the driver looking ahead of the vehicle without largely changing the line of sight.In this case, the display control device 1 can, for example, inform the rear seat passenger of the driver's intention to depart and an unexpected situation that may occur when the driver initiates the vehicle's departure. For example, the passenger can voluntarily prepare for departure earlier without waiting for an instruction from the driver, transmit a specific request, such as instructing the driver to wait for departure, or conduct themselves to avoid an unexpected situation.

[0257] In the above first embodiment, the display control device 1 is a vehicle-mounted device, and the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 are provided in the vehicle-mounted device.Separately, some of the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 may be included in the on-board device of the vehicle, and others may be included in a server connected to the on-board device via a network.In addition, the server may include the entire occupant information acquisition unit 11, the pedal operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18.

[0258] Fig. 12A and Fig. 12B are diagrams showing an example of a hardware configuration of the display control device 1 according to the first embodiment.

[0259] In the first embodiment, the functions of the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 are realized by a processing circuit 1001. That is, the display control device 1 includes the processing circuit 1001 for performing control to display an unexpected situation to the driver in a display form in which a severity of the unexpected situation can be recognized in a case where the vehicle or the occupant may encounter the unexpected situation upon departure of the vehicle.

[0260] The processing circuit 1001 may be special hardware, as shown in Fig. 12A, or a processor 1004 executing a program stored in a memory, as shown in Fig. 12B.

[0261] If the processing circuit 1001 is dedicated hardware, the processing circuit 1001 corresponds, for example, to a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof.

[0262] If the processing circuit is the processor 1004, the functions of the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning indication display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 are implemented by software, firmware, or a combination of software and firmware. The software or firmware is described as a program and stored in a memory 1005.The processor 1004 reads and executes the program stored in the memory 1005, performing the functions of the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress acquisition unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18. That is, the display control device 1 includes the memory 1005 for storing a program that, when executed by the processor 1004, is used to execute the functions described above. Fig.6. Furthermore, it can be said that the program stored in the memory 1005 causes a computer to execute a processing procedure or method performed by the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18.Here, the memory 1005 corresponds to, for example, a non-volatile or volatile semiconductor memory such as a RAM, a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM) or an electrically erasable programmable read-only memory (EEPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a digital versatile disc (DVD), or the like.

[0263] It should be noted that the functions of the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 may be implemented partly by dedicated hardware and partly by software or firmware.For example, the functions of the occupant information acquisition unit 11 and the operation information acquisition unit 12 can be implemented by the processing circuit 1001 as dedicated hardware, and the functions of the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 can be implemented by the processor 1004, which reads and executes the program stored in the memory 1005.

[0264] Furthermore, the display control device 1 includes an input interface device 1002 and an output interface device 1003 that perform wired or wireless communication with a device such as the first sensor 20, the second sensor 30, or the display device 40.

[0265] As described above, a display control device 1 according to the first embodiment includes: an occupant information acquisition unit 11 for acquiring occupant information regarding an occupant; an operation information acquisition unit 12 for acquiring operation information regarding operation of a vehicle by a driver of the vehicle; a departure preparation progress determination unit 13 for determining the progress of a passenger's preparation for departure of the vehicle based on the occupant information acquired by the occupant information acquisition unit 11; a departure intention determination unit 14 for determining the driver's intention to cause the vehicle to depart based on the operation information acquired by the operation information acquisition unit 12;a warning level determination unit 15 for determining a level (warning level) for warning the driver of the severity of an unexpected situation that the vehicle or the passenger is likely to encounter when the vehicle departs, based on the passenger's preparation progress determined by the departure preparation progress determination unit 13 and the driver's intention to cause the vehicle to depart, determined by the departure intention determination unit 14; a warning display information generation unit 16 for generating warning display information to cause a display to be performed according to the level (warning level) determined for the driver by the warning level determination unit 15;and a display control unit 18 for causing a display device 40 to perform a display based on the warning display information generated by the warning display information generation unit 16. Consequently, in a case where the vehicle or the passenger is expected to encounter an unexpected situation when the driver causes the vehicle to depart, the display control device 1 can warn the driver in a display form in which a severity of the unexpected situation can be known. Therefore, the driver can grasp the severity of the unexpected situation that may occur only by checking the display device 40 and take some measures corresponding to the severity of the unexpected situation that may occur.

[0266] Furthermore, the display control unit 18 includes, in addition to the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, and the warning display information generation unit 16, the display control device 1 includes a progress display information generation unit 17 for generating progress display information to cause a display corresponding to the progress of the passenger's preparation to be performed based on the progress of the passenger's preparation determined by the departure preparation progress determination unit 13, and the display control unit 18 is configured to cause the display device 40 to display based on the warning display information generated by the warning display information generation unit 16.and performs a display based on the progress display information generated by the progress display information generation unit 17. Thus, the display control device 1 can inform the driver of the passenger's preparation progress. Using the display device 40, the driver can see the passenger's preparation progress and easily determine what measures should be taken for the passenger.

[0267] Furthermore, the progress display information generation unit 17 in the display control device 1 can generate progress display information for displaying the passenger's preparation progress in the form of an animation that changes over time depending on the passenger's preparation progress. Thus, the display control device 1 can inform the driver of the passenger's preparation progress. The driver can check the passenger's preparation progress using the display device 40.

[0268] It should be noted that any element of the embodiment may be changed or any element of the embodiment may be omitted. INDUSTRIAL APPLICABILITY

[0269] In the display control device according to the present disclosure, in a case where there is a possibility that a vehicle or a passenger may encounter an unexpected situation when the driver causes the vehicle to depart, a driver can be warned in a display form in which a severity of the unexpected situation can be recognized. LIST OF REFERENCE SYMBOLS

[0270] 1: Display control device, 11: Occupant information acquisition unit, 111: Seat information acquisition unit, 112: Seat belt fastening information acquisition unit, 113: Posture information acquisition unit, 12: Operation information acquisition unit, 121: Gear shift information acquisition unit, 122: Parking brake operation information acquisition unit, 123: Pedal operation information acquisition unit, 13: Departure preparation progress determination unit, 14: Departure intention determination unit, 15: Warning level determination unit, 16: Warning display information generation unit, 17: Progress display information generation unit, 18: Display control unit, 20: First sensor, 30: Second sensor, 40: Display device, 1001: Processing circuit, 1002: Input interface device, 1003: Output interface device, 1004: Processor, 1005: Memory QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] JP 2015-66983 A

[0005]

Claims

[1] A display control device comprising: an occupant information acquisition unit for acquiring occupant information about an occupant; an operation information acquisition unit for acquiring operation information relating to the operation of a vehicle by a driver of the vehicle; a departure preparation progress determining unit for determining the progress of a passenger's preparation for departure of the vehicle based on the occupant information acquired by the occupant information acquiring unit; a departure intention determining unit for determining an intention of the driver to cause the vehicle to depart based on the operation information acquired by the operation information acquiring unit; a warning level determining unit for determining a level of warning to the driver of the severity of an unexpected situation that the vehicle or the passenger is likely to encounter when the vehicle departs, based on the preparation progress by the passenger determined by the departure preparation progress determining unit and the driver's intention to cause the vehicle to depart determined by the departure intention determining unit; a warning display information generation unit for generating warning display information to cause a display device to be displayed according to the level determined by the driver warning level determination unit; and a display control unit for causing the display device to display warning display information based on the warning display information generated by the warning display information generating unit. [2] The display control device according to claim 1, wherein the warning display information generating unit generates the warning display information so that the display is emphasized when the level determined by the warning level determining unit is higher. [3] The display control device according to claim 1, wherein the warning display information generating unit generates the warning display information to cause the display device to display an icon or a message corresponding to the level determined by the warning level determining unit. [4] Display control device according to one of claims 1 to 3, comprising a progress display information generation unit for generating progress display information to cause the display device to display according to the progress of the passenger's preparation based on the progress of the passenger's preparation determined by the departure preparation progress determination unit, wherein the display control unit causes the display device to display warning display information based on the warning display information generated by the warning display information generation unit and to display progress display information based on the progress display information generated by the progress display information generation unit. [5] The display control device according to claim 4, wherein the progress display information generating unit generates the progress display information for displaying the progress of the preparation by the passenger in an animation that changes with the lapse of time depending on the progress of the preparation by the occupant. [6] A display control method comprising: Acquiring, by an occupant information acquiring unit, occupant information about an occupant; Acquiring, by an operation information acquisition unit, operation information about the operation of a vehicle by a driver of the vehicle; Determining, by a departure preparation progress determining unit, the progress of a passenger's preparation for departure of the vehicle based on the occupant information acquired by the occupant information acquiring unit; Determining, by a departure intention determining unit, the driver's intention to cause the vehicle to depart based on the operation information acquired by the operation information acquiring unit; Determining, by a warning level determining unit, a level of warning to the driver of the severity of an unexpected situation that the vehicle or the passenger is likely to encounter when the vehicle departs, based on the preparation progress by the passenger determined by the departure preparation progress determining unit and the driver's intention to cause the vehicle to depart determined by the departure intention determining unit; Generating, by a warning display information generating unit, warning display information to cause a display device to be displayed according to the level determined by the driver warning level determining unit; and Causing the display device, by a display control unit, to display warning display information based on the warning display information generated by the warning display information generating unit.

Images