Display control device and display control method
By designing a display control device in the vehicle, using sensors to obtain information to determine the progress of the passengers' preparation and driver's intentions, generating warning levels and progress information, dynamically displaying the severity of the unexpected situation, solving the problem that the vehicle cannot be effectively notified when departure is set in the prior art. The problem of the severity of the unexpected situation has improved the driver's ability to respond.
Patent Information
- Application Number
- CN202280094039.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-29
- Publication Date
- 2024-11-08
AI Technical Summary
The prior art cannot effectively inform the driver of the severity of the unexpected situation that may be trapped when the vehicle leaves, and cannot grasp the preparation status of the passenger through the display of fixed performance.
A display control device is designed to obtain occupants and vehicle operation information through sensors, determine the preparation progress of the passenger and the driver's departure intention, generate corresponding warning levels and progress information, and perform dynamic display to warn the driver of possible accidents. Severity of the situation.
It realizes the display of the severity of the unexpected situation when the vehicle sets off, reduces the trouble of confirming the status of the passengers one by one, and improves the driver's awareness and ability to respond to departure preparations.
Smart Images

Figure CN118922337A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a display control device and a display control method. Background Art
[0002] When the vehicle starts, the driver needs to start the vehicle after the vehicle is in a state where it can be said that there will be no problem even if the vehicle starts. In other words, after it is assumed that the vehicle or passengers will not fall into an unexpected situation even if the vehicle starts.
[0003] When the vehicle is in a state where an unexpected situation may occur when the vehicle departs, the driver sometimes needs to take certain measures, such as stopping operations for vehicle departure and waiting, or helping fellow passengers prepare, in order to avoid the unexpected situation and enable the vehicle to depart.
[0004] However, as a technology for notifying the driver of the seat belt wearing status of fellow passengers, for example, the following technology is disclosed in Patent Document 1: by color-coding the seat belt status of an unoccupied seat, the seat belt status of a seated seat but not worn, or the seat belt status of a seated seat and worn, the driver can visually confirm at a glance whether the occupant has sat in the driver's seat and whether the seat belt is worn.
[0005] Prior art literature
[0006] Patent Literature
[0007] Patent Document 1: Japanese Patent Application Publication No. 2015-66983 Summary of the invention
[0008] Problem that the invention aims to solve
[0009] The severity of the unexpected situation that may occur when the vehicle is about to start changes in stages according to how far the passengers including the driver and the other passengers have advanced their preparations for the vehicle to start. If the severity of the unexpected situation that may occur changes, the driver's certain responses and their necessity for starting the vehicle without falling into the unexpected situation also change. Therefore, it is expected that the driver will understand the severity of the unexpected situation that may occur when the vehicle is about to start.
[0010] Conventionally, there has been a problem in that the driver cannot be informed of the severity of an unexpected situation that may occur when the vehicle is started.
[0011] In addition, the technology disclosed in Patent Document 1 only informs fellow passengers of the wearing status of their seat belts through a fixed display, and the driver cannot understand how serious the unexpected situation may be when the vehicle is set off by observing the display. Therefore, the technology disclosed in Patent Document 1 still cannot solve the above-mentioned problem.
[0012] The present disclosure is completed to solve the above problems. Therefore, its purpose is to provide a display control device that can warn the driver in a display method that allows the driver to know the severity of the unexpected situation when the vehicle or the passengers may fall into an unexpected situation when the vehicle is set off.
[0013] Means used to solve problems
[0014] The display control device of the present disclosure comprises: an occupant information acquisition unit, which acquires occupant information related to the occupant; an operation information acquisition unit, which acquires operation information related to the operation of the vehicle by the driver of the vehicle; a departure preparation progress determination unit, which determines the progress of the preparation of the co-passenger for the departure of the vehicle based on the occupant information acquired by the occupant information acquisition unit; a departure intention determination unit, which determines the driver's intention to start the vehicle based on the operation information acquired by the operation information acquisition unit; a warning level determination unit, which determines the severity level of warning the driver of the unexpected situation that the vehicle or the occupant may fall into when the vehicle departs, based on the progress of the preparation of the co-passenger determined by the departure preparation progress determination unit and the driver's intention to start the vehicle determined by the departure intention determination unit; a warning display information generation unit, which generates warning display information, the warning display information being used to perform a display corresponding to the level for the driver determined by the warning level determination unit; and a display control unit, which causes the display device to perform a display based on the warning display information generated by the warning display information generation unit.
[0015] Effects of the Invention
[0016] According to the present disclosure, when the vehicle or the passengers may fall into an unexpected situation when the vehicle is set off, the display control device can warn the driver in a display manner that allows the driver to know the severity of the unexpected situation. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 This is a diagram showing a configuration example of a display control device according to Embodiment 1.
[0018] Figure 2A , Figure 2B , Figure 2C as well as Figure 2D This is a diagram for explaining the warning display information generated by the warning display information generating unit in the first embodiment.
[0019] Figure 3A , Figure 3B as well as Figure 3C This is a diagram for explaining the progress display information generated by the progress display information generating unit in the first embodiment.
[0020] Figure 4 This is a diagram showing an overview of screen examples that the display control unit causes the display device to display in the first embodiment.
[0021] Figure 5 This is a diagram showing a display device that displays a screen based on warning display information and progress display information in accordance with control by a display control unit in the first embodiment, as viewed from within the vehicle cabin.
[0022] Figure 6 This is a flowchart for explaining the operation of the display control device according to the first embodiment.
[0023] Figure 7 This is used to explain the progress of the departure preparation judgment unit. Figure 6 A flowchart showing details of an example of the processing of step ST2a.
[0024] Figure 8 This is used to explain the departure intention determination unit Figure 6 Flowchart of details of the processing of step ST2b.
[0025] Fig. 9 This is used to explain the warning level determination Figure 6 A flowchart showing details of an example of the processing of step ST3.
[0026] Fig. 10A , Fig. 10B as well as Fig. 10C This is a diagram for explaining progress display information generated by the progress display information generating unit in the first embodiment, the progress display information being used to display the progress of the preparation of the fellow passenger by an animation that changes with the passage of time.
[0027] Fig.11A , Fig. 11B , Fig. 11C as well as Fig.11D This is a diagram for explaining an example of a screen of the display device when the display control unit causes the display device to display only a display based on the warning display information in the above-mentioned first embodiment.
[0028] Fig. 12A and Fig. 12B This is a diagram showing an example of the hardware configuration of the display control device according to the first embodiment. DETAILED DESCRIPTION
[0029] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0030] Implementation method 1.
[0031] The display control device of the first embodiment is mounted on a vehicle, for example. The display control device performs display control of a display device mounted on the vehicle. The display device is assumed to be, for example, an instrument panel provided in front of a steering wheel in the vehicle.
[0032] For example, when passengers including the driver and a fellow passenger enter the vehicle and the driver operates the vehicle to start the vehicle, the display control device causes the display device to display a display for warning the driver that an unexpected situation may occur when the vehicle starts. Specifically, the display control device causes the display device to display a display for warning the driver that an unexpected situation may occur when the vehicle starts in a manner that allows the driver to know the seriousness of the unexpected situation that may occur.
[0033] In the first embodiment, as described above, the display device is assumed to be a dashboard, but this is only an example, and the display device may be, for example, a display device provided on a center console provided at the front of the vehicle interior, or a display device provided on a rearview mirror. The display device that is the object of display control means is only required to be provided at a position where the driver looking ahead of the vehicle can visually recognize the display without having to significantly shift his or her line of sight.
[0034] In the following first embodiment, as an example, it is assumed that a total of two persons, namely a driver and one passenger, enter the vehicle and start the vehicle. The passenger is assumed to sit in a rear seat, for example.
[0035] Figure 1 1 is a diagram showing a configuration example of a display control device 1 according to Embodiment 1. Figure 1 The illustration of the vehicle is omitted.
[0036] The display control device 1 is connected to the first sensor 20 , the second sensor 30 , and the display device 40 .
[0037] The first sensor 20 is mounted on the vehicle and detects the state of the vehicle interior. The first sensor 20 outputs information on the detected state of the vehicle interior (hereinafter referred to as "first sensor information") to the display control device 1. The first sensor information will be described in detail later.
[0038] In the first embodiment, the first sensor 20 is assumed to be a camera sensor that can capture images of a location in the vehicle, a load sensor or a contact sensor that is installed on a seat, a seat belt sensor that is installed at a winding portion or a fastening portion of a seat belt, or other various sensors installed in the vehicle. The load sensor or the contact sensor may be installed at a floor portion in the vehicle, for example.
[0039] In addition, Figure 1 In the figure, only one first sensor 20 is shown, but this is just an example. The display control device 1 can also be connected to a plurality of first sensors 20 of different types.
[0040] The second sensor 30 is mounted on the vehicle and detects various operations performed on the vehicle. The second sensor 30 outputs information related to the detected various operations (hereinafter referred to as "second sensor information") to the display control device 1. The second sensor information will be described in detail later.
[0041] In the first embodiment, the second sensor 30 may be various sensors such as a shift position sensor, a brake sensor for detecting an operating state of a parking brake, a pedal sensor for detecting pedal operation, and a grip sensor provided on a steering wheel.
[0042] In addition, Figure 1 In the figure, only one second sensor 30 is shown, but this is just an example. The display control device 1 can be connected to a plurality of second sensors 30 of different types.
[0043] In addition, the first sensor 20 and the second sensor 30 may be a common sensor. For example, the first sensor 20 and the second sensor 30 may be a common camera sensor.
[0044] The display device 40 is a dashboard, and performs display under the control of the display control device 1. The screen displayed on the display device 40 will be described in detail later.
[0045] The display control device 1 includes an occupant information acquisition unit 11 , an operation information acquisition unit 12 , a departure preparation progress determination unit 13 , a departure intention determination unit 14 , a warning level determination unit 15 , a warning display information generation unit 16 , a progress display information generation unit 17 , and a display control unit 18 .
[0046] The occupant information acquisition unit 11 includes a seating information acquisition unit 111 , a seatbelt wearing information acquisition unit 112 , and a posture information acquisition unit 113 .
[0047] The operation information acquisition unit 12 includes a shift operation information acquisition unit 121 , a parking brake operation information acquisition unit 122 , and a pedal operation information acquisition unit 123 .
[0048] The passenger information acquisition unit 11 acquires information related to the state of the passenger (hereinafter referred to as "passenger information") based on the first sensor information output from the first sensor 20. The passenger information includes, for example, seating information related to the seating of the passenger, seat belt wearing information related to the wearing of the seat belt by the passenger, and posture information related to the posture of the passenger. In the passenger information, the seating information, seat belt wearing information, and posture information correspond to information that can identify the position of the passenger. In the first embodiment, the position of the passenger is represented by, for example, the position of the seat where the passenger is to sit or has sat.
[0049] The seating information includes, for example, information on the presence or absence of an occupant and information on whether an occupant is seated in a seat.
[0050] The seatbelt wearing information includes, for example, information on whether the occupant has operated the seatbelt and information on whether the occupant has completed wearing the seatbelt.
[0051] The posture information includes, for example, information on whether the posture of the occupant is deformed.
[0052] The seating information acquisition unit 111 acquires seating information.
[0053] For example, the seating information acquisition unit 111 acquires a captured image of the interior of the vehicle from a camera sensor serving as the first sensor 20 as the first sensor information. Then, the seating information acquisition unit 111 performs image recognition processing using a known image recognition technology on the captured image to detect the presence of an occupant and whether the occupant is seated in a seat. In addition, the seating information acquisition unit 111 can determine the position of the occupant and the seat in which the occupant is seated based on the captured image.
[0054] In addition, for example, the seating information acquisition unit 111 may acquire information indicating a load (hereinafter referred to as "load information") or information indicating the presence or absence of contact (hereinafter referred to as "contact information") as first sensor information from a load sensor or a contact sensor as the first sensor 20, and detect the presence or absence of an occupant and whether the occupant is seated in a seat based on the load information or the contact information. In addition, the seating information acquisition unit 111 can determine the position of the occupant and the seat on which the occupant is seated based on the load information or the contact information.
[0055] The seating information acquisition unit 111 acquires the detected information on the presence or absence of an occupant and the information on whether the occupant is seated in a seat as seating information.
[0056] Here, the seating information acquisition unit 111 detects the presence of an occupant and whether the occupant is seated on a seat based on a captured image, load information, or contact information, but this is merely an example. For example, a camera sensor may detect the presence of an occupant and whether the occupant is seated on a seat, and output information related to the presence of an occupant and whether the occupant is seated on a seat as seating information to the seating information acquisition unit 111. For example, a load sensor or a contact sensor may detect the presence of an occupant and whether the occupant is seated on a seat, and output information related to the presence of an occupant and whether the occupant is seated on a seat as seating information to the seating information acquisition unit 111.
[0057] For example, the seating information acquisition unit 111 may output the first sensor information as seating information to the departure preparation progress determination unit 13, and the departure preparation progress determination unit 13 may detect the presence of an occupant and whether the occupant is seated in a seat. The departure preparation progress determination unit 13 will be described in detail later.
[0058] The seatbelt wearing information acquisition unit 112 acquires the seatbelt wearing information.
[0059] For example, the seat belt wearing information acquisition unit 112 acquires a captured image of the interior of the vehicle as the first sensor information from a camera sensor serving as the first sensor 20. The seat belt wearing information acquisition unit 112 then performs image recognition processing using a known image recognition technology on the captured image to detect whether the occupant has operated the seat belt and whether the occupant has worn the seat belt.
[0060] In addition, for example, the seat belt wearing information acquisition unit 112 may acquire information on the on / off state of the buckle switch of the seat belt, information on the withdrawal amount of the seat belt, or information on the winding amount (hereinafter referred to as "seat belt sensor information") from the seat belt sensor as the first sensor 20 as the first sensor information, and detect whether the occupant has operated the seat belt and whether the occupant has worn the seat belt based on the seat belt sensor information. In addition, the seat belt wearing information acquisition unit 112 can determine the position of the occupant and the seat in which the occupant is seated based on the seat belt sensor.
[0061] The seatbelt wearing information acquisition unit 112 acquires the detected information on whether the occupant has operated the seatbelt and whether the occupant has finished wearing the seatbelt as the seatbelt wearing information.
[0062] In addition, here, the seat belt wearing information acquisition unit 112 detects whether the occupant has operated the seat belt and whether the occupant has completed wearing the seat belt based on the captured image or the seat belt sensor information, but this is just an example. For example, it is also possible that the camera sensor detects whether the occupant has operated the seat belt and whether the occupant has completed wearing the seat belt, and outputs the information related to whether the occupant has operated the seat belt and whether the occupant has completed wearing the seat belt as the seat belt wearing information to the seat belt wearing information acquisition unit 112. In addition, for example, it is also possible that the seat belt sensor detects whether the occupant has operated the seat belt and whether the occupant has completed wearing the seat belt, and outputs the information related to whether the occupant has operated the seat belt and whether the occupant has completed wearing the seat belt as the seat belt wearing information to the seating information acquisition unit 111.
[0063] Furthermore, for example, the seatbelt wearing information acquisition unit 112 may output the first sensor information to the departure preparation progress determination unit 13 , and the departure preparation progress determination unit 13 may detect whether the occupant has operated the seatbelt and whether the occupant has finished wearing the seatbelt.
[0064] The posture information acquisition unit 113 acquires posture information.
[0065] For example, the posture information acquisition unit 113 acquires a captured image of the interior of the vehicle from a camera sensor serving as the first sensor 20 as the first sensor information. Then, the posture information acquisition unit 113 performs image recognition processing on the captured image using a known image recognition technology to detect whether the posture of the occupant is deformed. Since the technology for detecting the posture of the occupant based on the captured image is a known technology, a detailed description is omitted.
[0066] In addition, for example, the posture information acquisition unit 113 may acquire load information or contact information as the first sensor information from a load sensor or a contact sensor as the first sensor 20, and detect the presence or absence of posture deformation of the occupant based on the load information or the contact information. Since the technology for detecting posture deformation of the occupant based on the load information or the contact information is a well-known technology, a detailed description is omitted.
[0067] The posture information acquisition unit 113 acquires the detected information on whether the posture of the occupant is deformed as posture information.
[0068] In addition, here, the posture information acquisition unit 113 detects whether the posture of the occupant is distorted based on the captured image, load information or contact information, but this is just an example. For example, a camera sensor may detect whether the posture of the occupant is distorted, and output information related to whether the posture of the occupant is distorted as posture information to the posture information acquisition unit 113. In addition, for example, a load sensor or a contact sensor may detect whether the posture of the occupant is distorted, and output information related to whether the posture of the occupant is distorted as posture information to the posture information acquisition unit 113.
[0069] Furthermore, for example, the posture information acquisition unit 113 may output the first sensor information as the posture information to the departure preparation progress determination unit 13 , and the departure preparation progress determination unit 13 may detect whether the posture of the occupant is deformed.
[0070] The occupant information acquisition unit 11 outputs occupant information including seating information acquired by the seating information acquisition unit 111 , seat belt wearing information acquired by the seat belt wearing information acquisition unit 112 , and posture information acquired by the posture information acquisition unit 113 to the departure preparation progress determination unit 13 .
[0071] The operation information acquisition unit 12 acquires operation information based on the second sensor information output from the second sensor 30. The operation information includes, for example, shift operation information related to the shift position, parking brake operation information related to the operation of the parking brake, and pedal operation information related to the pedal operation.
[0072] The shift operation information includes, for example, information on the gear position.
[0073] The parking brake operation information includes, for example, information indicating that the parking brake has been released.
[0074] The pedal operation information includes information on whether the driver has performed an accelerator operation. The pedal operation information may also include information on the amount of depression of a brake pedal, the amount of release of the brake pedal, the amount of depression of an accelerator pedal, and the amount of release of the accelerator pedal.
[0075] The shift operation information acquisition unit 121 acquires shift operation information.
[0076] For example, the shift operation information acquisition unit 121 acquires information indicating the current shift position (hereinafter referred to as "shift position information") as the second sensor information from the shift position sensor as the second sensor 30. Then, the shift operation information acquisition unit 121 detects whether the driver has set the shift position to the shift position P, the shift position D, or the shift position R based on the shift position information.
[0077] The shift operation information acquisition unit 121 acquires information on whether the driver has set the shift position to Shift P, Shift D, or Shift R, as the shift operation information.
[0078] In addition, here, the shift operation information acquisition unit 121 detects whether the driver has set the gear position to Shift P, Shift D, or Shift R based on the parking brake information, but this is just an example. For example, the gear position sensor may detect whether the driver has set the gear position to Shift P, Shift D, or Shift R, and output information indicating whether the driver has set the gear position to Shift P, Shift D, or Shift R to the shift operation information acquisition unit 121 as the shift operation information.
[0079] For example, the shift operation information acquisition unit 121 may output the second sensor information as the shift operation information to the departure intention determination unit 14, and the departure intention determination unit 14 may detect whether the driver has set the gear position to Shift P, Shift D, or Shift R. The departure intention determination unit 14 will be described in detail later.
[0080] The parking brake operation information acquisition unit 122 acquires parking brake operation information.
[0081] For example, the parking brake operation information acquisition unit 122 acquires information related to the parking brake (hereinafter referred to as "parking brake information") as the second sensor information from the brake sensor as the second sensor 30. Then, the parking brake operation information acquisition unit 122 detects whether the driver has released the parking brake based on the parking brake information.
[0082] The parking brake operation information acquisition unit 122 acquires information on whether the driver has released the parking brake, which is detected, as parking brake operation information.
[0083] In addition, here, the parking brake operation information acquisition unit 122 detects whether the driver has released the parking brake based on the parking brake information, but this is just an example. For example, the brake sensor may detect whether the driver has released the parking brake, and output information indicating whether the driver has released the parking brake to the parking brake operation information acquisition unit 122 as the parking brake operation information.
[0084] Furthermore, for example, the parking brake operation information acquisition unit 122 may output the second sensor information as the parking brake operation information to the departure intention determination unit 14 , and the departure intention determination unit 14 may detect whether the driver has released the parking brake.
[0085] The pedal operation information acquisition unit 123 acquires pedal operation information.
[0086] For example, the pedal operation information acquisition unit 123 acquires information related to the operation of the brake pedal (hereinafter referred to as "pedal information") as the second sensor information from the pedal sensor as the second sensor 30. Then, the pedal operation information acquisition unit 123 detects whether the driver has performed an accelerator operation based on the pedal information. The pedal operation information acquisition unit 123 may also detect the amount of depression of the brake pedal, the amount of release of the brake pedal, the amount of depression of the accelerator pedal, and the amount of release of the accelerator pedal.
[0087] The pedal operation information acquisition unit 123 acquires information related to whether the driver has performed an accelerator operation as the pedal operation information. The pedal operation information acquisition unit 123 may also acquire information related to the amount of brake pedal depression, the amount of brake pedal release, the amount of accelerator pedal depression, or the amount of accelerator pedal release as the pedal operation information.
[0088] In addition, here, the pedal operation information acquisition unit 123 detects whether the driver has performed an accelerator operation based on the pedal information, but this is just an example. For example, it is also possible that the pedal sensor detects whether the driver has performed an accelerator operation, and outputs information related to whether the driver has performed an accelerator operation to the pedal operation information acquisition unit 123 as the pedal operation information.
[0089] Furthermore, for example, the pedal operation information acquisition unit 123 may output the second sensor information as the pedal operation information to the departure intention determination unit 14 , and the departure intention determination unit 14 may detect whether the driver has performed an accelerator operation.
[0090] The operation information acquisition unit 12 outputs operation information including the shift operation information acquired by the shift operation information acquisition unit 121 , the parking brake operation information acquired by the parking brake operation information acquisition unit 122 , and the pedal operation information acquired by the pedal operation information acquisition unit 123 to the departure intention determination unit 14 .
[0091] The departure preparation progress determination unit 13 determines the progress of the passenger's preparation for vehicle departure based on the passenger information acquired by the passenger information acquisition unit 11. In the following description, the passenger's "preparation for vehicle departure" is also simply referred to as "preparation".
[0092] When a fellow passenger uses a vehicle for a trip, it is assumed that the fellow passenger prepares for departure in the order of, for example, entering the vehicle, sitting down, wearing a seat belt, and correcting the posture so that the vehicle does not shake even when it starts to move. In Embodiment 1, the departure preparation progress determination unit 13 assumes that the fellow passenger prepares in the above order, and determines the progress of the preparations made in the above order in four stages: "none", "early", "mid-term", or "completed". In Embodiment 1, the progress of the fellow passenger is "none", which means that there is no fellow passenger at all. If there is no fellow passenger, there is no progress based on the preparation of the fellow passenger. The progress of the fellow passenger is "early", which means that the fellow passenger has prepared until entering the vehicle and sitting down. The progress of the fellow passenger is "mid-term", which means that the fellow passenger has prepared until wearing a seat belt after sitting down. The progress of the fellow passenger is "completed", which means that the fellow passenger has prepared until wearing a seat belt and correcting the posture so that the vehicle does not shake even when it starts to move.
[0093] In the first embodiment, for example, the four stages of the passenger's preparation are represented by numerical values such as "0: none", "1: early", "2: mid-term" or "3: complete". That is, the larger the numerical value representing the passenger's preparation, the more advanced the passenger's preparation is.
[0094] An example of a method for determining the progress of a fellow passenger's preparation by the departure preparation progress determining unit 13 will be described.
[0095] First, the departure preparation progress determination unit 13 determines the presence or absence of a fellow passenger based on the passenger information. Specifically, the departure preparation progress determination unit 13 determines the presence or absence of a fellow passenger based on the seating information included in the passenger information.
[0096] When determining that there is no fellow passenger, the departure preparation progress determination unit 13 determines the progress of the fellow passenger's preparation as "0: none".
[0097] When determining that there is a fellow passenger, the departure preparation progress determination unit 13 determines whether the fellow passenger has taken his seat. Specifically, the departure preparation progress determination unit 13 determines whether the fellow passenger has taken his seat based on the seating information included in the passenger information.
[0098] When determining that the fellow passenger has not yet taken his seat, the departure preparation progress determination unit 13 determines the progress of the fellow passenger's preparation as “1: early.” This “1: early” indicates that there is a fellow passenger but the fellow passenger has not yet taken his seat.
[0099] When determining that the passenger has taken his seat, the departure preparation progress determination unit 13 determines whether the passenger has fastened his seat belt. Specifically, the departure preparation progress determination unit 13 determines whether the passenger has fastened his seat belt based on the seat belt wearing information included in the passenger information.
[0100] If it is determined that the fellow passenger has not operated the seat belt, the departure preparation progress determination unit 13 determines the progress of the fellow passenger's preparation as "1: early." This "1: early" means that the fellow passenger has taken his seat but has not yet started the seat belt fastening operation.
[0101] When determining that the passenger has operated the seat belt, the departure preparation progress determination unit 13 determines whether the passenger has completed the seat belt wearing. Specifically, the departure preparation progress determination unit 13 determines whether the passenger has completed the seat belt wearing based on the seat belt wearing information included in the passenger information.
[0102] If the departure preparation progress determination unit 13 determines that the passenger has not finished wearing the seat belt, it determines the progress of the passenger's preparation as "2: mid-term". This "2: mid-term" means that the passenger has taken a seat and started to operate the seat belt but has not finished wearing the seat belt.
[0103] When determining that the passenger has completed the wearing of the seat belt, the departure preparation progress determination unit 13 determines whether the passenger's posture is out of shape. Specifically, the departure preparation progress determination unit 13 determines whether the passenger's posture is out of shape based on the posture information included in the passenger information.
[0104] If the departure preparation progress determination unit 13 determines that the passenger's posture is out of shape, it determines the progress of the passenger's preparation as "2: mid-term." This "2: mid-term" means that the passenger has fastened the seat belt but has not corrected his posture to avoid shaking.
[0105] When determining that the passenger has not lost his posture, the departure preparation progress determination unit 13 determines the progress of the passenger's preparation as “3: completed.” This “3: completed” indicates that the passenger has completed the preparation to be performed for the vehicle departure.
[0106] The departure preparation progress determination unit 13 outputs the determined information related to the progress of the preparation of the fellow passenger (hereinafter referred to as "departure preparation progress information") to the warning level determination unit 15 and the progress display information generation unit 17. The departure preparation progress information is information indicating the progress of the preparation of the fellow passenger, and includes the above-mentioned numerical values of "0" to "3". In the departure preparation progress information, the information indicating the progress of the preparation of the fellow passenger may be associated with the position of the fellow passenger.
[0107] The departure intention determination unit 14 determines the driver's intention to start the vehicle based on the operation information acquired by the operation information acquisition unit 12. In the following description, the driver's "intention to start the vehicle" is also simply referred to as "departure intention."
[0108] When the driver drives the vehicle to travel, it is assumed that the driver operates the vehicle in the order of, for example, shifting the gear from "P" to "D" or "R", releasing the parking brake, and stepping on the accelerator pedal as operations for the driver to start the vehicle. In the first embodiment, the driver operates the vehicle in the above order to start the vehicle. As the vehicle is operated in the above order, the driver's preparations for starting the vehicle are complete, in other words, the driver's intention to start the vehicle becomes stronger.
[0109] In the first embodiment, the departure intention determination unit 14 regards the progress of the vehicle operation performed in the above order as the improvement of the driver's departure intention, and determines the departure intention according to three stages: "low", "medium" or "high". In addition, the departure intention can also be represented by a numerical value, similar to the progress of the preparation of the above-mentioned fellow passengers.
[0110] An example of a method for determining the driver's departure intention by the departure intention determination unit 14 will be described.
[0111] First, the departure intention determination unit 14 determines the shift position and the parking brake release operation based on the operation information. Specifically, the departure intention determination unit 14 determines the shift position and the parking brake release operation based on the shift operation information and the parking brake operation information included in the operation information.
[0112] The departure intention determination unit 14 determines that the driver's departure intention is "low" when no shift operation to shift D or shift R is performed, that is, the shift position remains shift P, and no operation to release the parking brake is performed.
[0113] The departure intention determination unit 14 determines that the driver's departure intention is "medium" when the shift operation to shift D or shift R is not performed, that is, the shift position remains shift P, and the parking brake is released.
[0114] Furthermore, the departure intention determination unit 14 determines that the driver's departure intention is "medium" even when a shift operation to shift D or shift R is performed and an operation to release the parking brake is not performed.
[0115] When a shift operation to Shift D or Shift R is performed and the parking brake is released, the departure intention determination unit 14 determines whether an accelerator operation is performed based on the operation information. Specifically, the departure intention determination unit 14 determines whether an accelerator operation is performed based on the accelerator operation information of the operation information.
[0116] Even when a shift operation to Shift D or Shift R is performed and an operation to release the parking brake is performed, the departure intention determination unit 14 determines that the driver's departure intention is "medium" unless there is an accelerator operation.
[0117] When a shift operation to Shift D or Shift R is performed and an operation to release the parking brake is performed, and when there is an accelerator operation, the start intention determination unit 14 determines that the driver's start intention is "high".
[0118] The departure intention determination unit 14 outputs the determined information on the driver's departure intention (hereinafter referred to as "departure intention information") to the warning level determination unit 15. The departure intention information includes information indicating the driver's departure intention ("low", "medium" or "high").
[0119] The warning level determination unit 15 determines the severity level (hereinafter referred to as the "warning level") of the unexpected situation that the vehicle or passengers may encounter when the vehicle departs, based on the progress of the passenger's preparation determined by the departure preparation progress determination unit 13 and the driver's intention to depart the vehicle determined by the departure intention determination unit 14.
[0120] In the first embodiment, as an example, the warning level determination unit 15 sets the warning level for the driver to five stages, namely "level 0" to "level 4". The larger the value of the warning level, the more serious the unexpected situation that the vehicle or the occupants may fall into when the vehicle departs. In other words, the larger the value of the warning level, the higher the importance of the warning to the driver. The more serious the unexpected situation that the vehicle or the occupants may fall into when the vehicle departs, the more the driver needs to pay more attention so that the vehicle can depart without the vehicle or the occupants falling into the unexpected situation.
[0121] An example of a method for determining the warning level based on the progress of the fellow passenger's preparation and the driver's departure intention by the warning level determination unit 15 in the first embodiment will be described.
[0122] For example, the warning level determination unit 15 determines the warning level according to preset conditions (hereinafter referred to as “warning level determination conditions”).
[0123] The warning level determination conditions are set in advance by a manager or the like, and are stored in a location where the warning level determination unit 15 can refer to them.
[0124] The warning level determination conditions include, for example, the following (condition A) to (condition F).
[0125] (Condition A)
[0126] If the driver's departure intention is "low", the warning level is "level 0" regardless of the progress of the passenger's preparation.
[0127] (Condition B)
[0128] Even if the driver's departure intention is "medium" or "high", if the progress of the passenger's preparation is "0: None" or "3: Completed", the warning level is "Level 0"
[0129] (Condition C)
[0130] When the driver's departure intention is "medium" and the progress of the passenger's preparation is "2: medium", the warning level is "level 1"
[0131] (condition D)
[0132] If the driver's departure intention is "medium" and the progress of the passenger's preparation is "1: early", the warning level is "level 2"
[0133] (Condition E)
[0134] When the driver's departure intention is "high" and the progress of the passenger's preparation is "2: medium", the warning level is "level 3"
[0135] (Condition F)
[0136] When the driver's departure intention is "high" and the progress of the passenger's preparation is "1: early", the warning level is "level 4"
[0137] The above-mentioned warning level determination conditions are merely examples, and the administrator can set the warning level determination conditions appropriately. The administrator sets the warning level determination conditions so that the warning level is set according to the combination of the driver's departure intention and the progress of the fellow passenger's preparation.
[0138] The warning level determination unit 15 outputs a determination result of the warning level (hereinafter referred to as “level determination result”) to the warning display information generation unit 16 .
[0139] In the level determination result, the warning level, information indicating the driver's departure intention, and information indicating the progress of the fellow passenger's preparation are associated with each other.
[0140] The warning display information generating unit 16 generates information (hereinafter referred to as “warning display information”) for displaying a warning corresponding to the warning level determined by the warning level determining unit 15 for the driver based on the level determination result outputted from the warning level determining unit 15 .
[0141] here, Figure 2A , Figure 2B , Figure 2C as well as Figure 2D This is a diagram for explaining the warning display information generated by the warning display information generating unit 16 in the first embodiment.
[0142] The warning display information generating unit 16 generates a warning display information for Figure 2A , Figure 2B , Figure 2C or Figure 2D The screen shown is a warning display information displayed on the display device 40. The display control unit 18 described later performs display control on the display device 40. Figure 2A , Figure 2B , Figure 2C or Figure 2D The area of the display device 40 of the screen shown is predetermined.
[0143] For example, when the warning level is "level 1", the warning display information generating unit 16 generates warning display information for displaying a screen showing Figure 2A Specifically, the display elements shown are a message “Preparation is not yet complete” and an icon composed of a plurality of circles.
[0144] For example, when the warning level is "level 2", the warning display information generating unit 16 generates warning display information for displaying a screen showing Figure 2B Specifically, the display elements shown are a message "Caution" and an icon composed of a plurality of circles.
[0145] For example, when the warning level is "level 3", the warning display information generating unit 16 generates warning display information for displaying a screen showing Figure 2C Specifically, the display elements shown are a message called "Warning" and an icon composed of a plurality of circles.
[0146] For example, when the warning level is "level 4", the warning display information generating unit 16 generates warning display information for displaying a screen showing Figure 2D Specifically, the display elements shown are a message "Danger" and an icon composed of a plurality of circles.
[0147] When the warning level is “level 0”, the warning display information generating unit 16 does not generate warning display information.
[0148] The warning display information generating unit 16 generates the warning display information in such a manner that the higher the warning level, the more emphasized the display. For example, the warning display information generating unit 16 generates the warning display information in such a manner that: Figure 2A The circle icon shown, Figure 2B The circular icon shown is more heavily emphasized. Figure 2C The circle icon shown is larger than Figure 2B The circle icon shown is more heavily emphasized than Figure 2C The circle icon shown, Figure 2D The circular icon shown is more heavily emphasized. The warning display information generating unit 16 may generate the warning display information so that the circular icon is displayed in a blinking manner.
[0149] In addition, Figure 2A , Figure 2B , Figure 2C as well as Figure 2D In the figure, for convenience, a quadrilateral surrounding the message and the circular icon is shown, but the quadrilateral is not displayed on the display device 40.
[0150] Thus, the warning display information generating unit 16 generates warning display information for displaying a warning of the seriousness of an unexpected situation that may occur when the vehicle departs, so that the higher the warning level, the more attention the driver will pay.
[0151] The warning display information generating unit 16 outputs the generated warning display information to the display control unit 18 in association with information indicating the driver's departure intention and information indicating the progress of the fellow passenger's preparation.
[0152] The progress display information generating unit 17 generates information for displaying the progress of the fellow passenger's preparation (hereinafter referred to as "progress display information") based on the progress of the fellow passenger's preparation determined by the departure preparation progress determining unit 13. Specifically, the progress display information generating unit 17 generates progress display information for displaying the following display based on the progress of the fellow passenger's preparation determined by the departure preparation progress determining unit 13, and the display is used to notify the driver of the progress of the fellow passenger's preparation in a manner corresponding to the progress of the fellow passenger's preparation.
[0153] here, Figure 3A , Figure 3B as well as Figure 3C This is a diagram for explaining the progress display information generated by the progress display information generating unit 17 in the first embodiment.
[0154] The progress display information generating unit 17 generates information for making Figure 3A , Figure 3B or Figure 3C The screen shown is progress display information displayed on the display device 40. The display control unit 18 described later performs display control on the display device 40. Figure 3A , Figure 3B or Figure 3C The area of the display device 40 of the screen shown is predetermined.
[0155] For example, when the progress of the preparation of the fellow passenger is "1: early", the progress display information generating unit 17 generates progress display information for displaying a screen showing Figure 3A A message "Preparing" and an icon representing a person are shown.
[0156] For example, when the progress of the preparation of the fellow passenger is "2: mid-term", the progress display information generating unit 17 generates progress display information for displaying a screen showing Figure 3B A message saying "Getting Ready" and an icon showing a person wearing a seat belt are shown.
[0157] For example, when the progress of the preparation of the fellow passenger is "3: completed", the progress display information generating unit 17 generates progress display information for displaying a screen showing Figure 3C The message “OK to start” is shown, and for a person wearing a seat belt, an icon of a check mark indicating that the wearing of the seat belt is complete is superimposed.
[0158] When the progress of the fellow passenger's preparation is "0: None", the progress display information generating unit 17 does not generate progress display information.
[0159] The progress display information generating unit 17 generates the progress display information in the following manner: Figure 3B The icons shown are Figure 3A Compared to the icon shown, the passengers are more prepared for the departure of the vehicle. Figure 3C The icons shown are Figure 3B Compared to the icon shown, the passenger is more advanced in preparing for departure of the vehicle.
[0160] In addition, Figure 3A , Figure 3B as well as Figure 3C In D, a quadrilateral surrounding the message and the icon is illustrated for convenience, but the quadrilateral is not displayed on the display device 40.
[0161] Thus, the progress display information generating unit 17 generates progress display information for notifying the driver of the progress of the fellow passenger's preparation for departure in the following manner: the more advanced the fellow passenger's preparation for departure is, in other words, the larger the numerical value indicating the fellow passenger's preparation for departure is, the more advanced the preparation is displayed.
[0162] The progress display information generating unit 17 associates the generated progress display information with information indicating the progress of the fellow passenger's preparation and outputs it to the display control unit 18 .
[0163] The display control unit 18 causes the display device 40 to perform display based on the warning display information generated by the warning display information generating unit 16 , and to perform display based on the progress display information generated by the progress display information generating unit 17 .
[0164] For example, the display control unit 18 causes the display device 40 to display a message and an icon based on the warning display information generated by the warning display information generating unit 16, and a message and an icon based on the progress display information generated by the progress display information generating unit 17 in an overlapping manner. The display control unit 18 can associate the warning display information with the progress display information through the corresponding information indicating the progress of the preparation of the fellow passenger.
[0165] Figure 4 This is a diagram that summarizes screen examples that the display control unit 18 causes the display device 40 to display in the first embodiment.
[0166] For example, to display Figure 3A The progress display information of the screen showing the progress of the preparation of the fellow passengers "1: Early" and the information for displaying Figure 2D Therefore, the display control unit 18 causes the display device 40 to display Figure 4 For example, as a result of overlapping the display based on the warning display information and the display based on the progress display information, when the messages overlap, the display control unit 18 causes the message based on the warning display information to be displayed preferentially. Figure 4 For the screen shown in Da, the display control unit 18 gives priority to the message "Danger" over the message "Preparing". As a result, the message "Preparing" is not displayed.
[0167] In addition, for example, to display Figure 3B The progress display information for displaying the progress of the preparation of the fellow passengers "2: mid-term" is shown. Figure 2C The warning display information of the warning level 3 screen shown in FIG. 1 corresponds to the warning display information of the warning level 3 screen shown in FIG. 1 . Therefore, the display control unit 18 causes the display device 40 to display Figure 4 The screen shown in Db.
[0168] In addition, for example, to display Figure 3A The progress display information of the screen showing the progress of the preparation of the fellow passengers "1: Early" and the information for displaying Figure 2B The warning display information of the warning level 2 screen shown in FIG. 1 corresponds to the warning display information of the warning level 2 screen shown in FIG. 1 . Therefore, the display control unit 18 causes the display device 40 to display Figure 4 The screen shown in Dd.
[0169] In addition, for example, to display Figure 3B The progress display information for displaying the progress of the preparation of the fellow passengers "2: mid-term" is shown. Figure 3A The warning display information of the screen of the warning level 1 shown in FIG. 1 corresponds to the warning display information of the screen of the warning level 1 shown in FIG. Figure 4 The screen shown in De.
[0170] Furthermore, for example, when the warning display information generating unit 16 does not generate warning display information and the progress display information generating unit 17 generates progress display information, the display control unit 18 causes the display device 40 to display only a screen based on the progress display information. For example, when the progress of the preparation of the fellow passenger is "3: Completed", the warning level becomes "Level 0", so no warning display information is generated, but progress display information is generated. That is, only the progress display information generated by the progress display information generating unit 17 is output to the display control unit 18.
[0171] In this case, the display control unit 18 causes the display device 40 to display a screen based on the progress display information (see Figure 4 Dc, Df, Dg, Dh and Di).
[0172] In addition, when the warning display information generating unit 16 does not generate the warning display information and the progress display information generating unit 17 does not generate the progress display information, the display control unit 18 causes the display device 40 to display neither the screen based on the warning display information nor the screen based on the progress display information. For example, when the progress of the preparation of the fellow passenger is "0: None", the progress display information is not generated, the warning level becomes "Level 0", and therefore, the warning display information is not generated. That is, the warning display information generated by the warning display information generating unit 16 is not output to the display control unit 18, and the progress display information generated by the progress display information generating unit 17 is not output to the display control unit 18.
[0173] Figure 5 This is a diagram showing the display device 40 displaying a screen based on the warning display information and the progress display information under the control of the display control unit 18 in the first embodiment, as viewed from the vehicle cabin.
[0174] In the first embodiment, as described above, the display device 40 is assumed to be provided on the steering wheel ( Figure 5 In addition, in Figure 5 In the figure, the vehicle is a left-hand steering wheel vehicle, but this is just an example. The vehicle may also be a right-hand steering wheel vehicle.
[0175] exist Figure 5 As an example, the display device 40 has a display area ( Figure 5 401 in FIG. 4 ), a display area located in the center when viewed from inside the vehicle ( Figure 5 402 in FIG. 1 ), and a display area located on the right side when viewed from inside the vehicle ( Figure 5 403 in the example).
[0176] The screen display based on the warning display information and the progress display information is displayed in the display area located on the left side when viewed from the vehicle interior.
[0177] exist Figure 5 In the example, the display control unit 18 causes the display device 40 to display a screen in which a message and an icon based on the warning display information corresponding to the warning level 1 and a message and an icon based on the progress display information corresponding to the progress “2: mid-term” of the fellow passenger's preparation are superimposed and displayed.
[0178] The operation of the display control device 1 according to the first embodiment will be described.
[0179] Figure 6 This is a flowchart for explaining the operation of the display control device 1 according to the first embodiment.
[0180] The display control device 1 repeats, for example, while the vehicle power source is turned on. Figure 6 The actions are shown in the flowchart.
[0181] The occupant information acquisition unit 11 acquires occupant information based on the first sensor information output from the first sensor 20 (step ST1 a ).
[0182] Specifically, the seating information acquisition unit 111 acquires seating information. Furthermore, the seat belt wearing information acquisition unit 112 acquires seat belt wearing information. Furthermore, the posture information acquisition unit 113 acquires posture information.
[0183] The occupant information acquisition unit 11 outputs occupant information including seating information acquired by the seating information acquisition unit 111 , seat belt wearing information acquired by the seat belt wearing information acquisition unit 112 , and posture information acquired by the posture information acquisition unit 113 to the departure preparation progress determination unit 13 .
[0184] The operation information acquisition unit 12 acquires the operation information based on the second sensor information output from the second sensor 30 (step ST1b). Specifically, the shift operation information acquisition unit 121 acquires the shift operation information. In addition, the parking brake operation information acquisition unit 122 acquires the parking brake operation information. In addition, the pedal operation information acquisition unit 123 acquires the pedal operation information.
[0185] The operation information acquisition unit 12 outputs operation information including the shift operation information acquired by the shift operation information acquisition unit 121 , the parking brake operation information acquired by the parking brake operation information acquisition unit 122 , and the pedal operation information acquired by the pedal operation information acquisition unit 123 to the departure intention determination unit 14 .
[0186] The departure preparation progress determination unit 13 determines the progress of the fellow passenger's preparation for vehicle departure based on the passenger information acquired by the passenger information acquisition unit 11 in step ST1a (step ST2a).
[0187] The departure preparation progress determination unit 13 outputs the departure preparation progress information related to the determined progress of the fellow passenger's preparation to the warning level determination unit 15 and the progress display information generation unit 17 .
[0188] The departure intention determination unit 14 determines the driver's departure intention of the vehicle based on the operation information acquired by the operation information acquisition unit 12 in step ST1b (step ST2b).
[0189] The departure intention determination unit 14 outputs the determined departure intention information on the driver's departure intention to the warning level determination unit 15 .
[0190] The warning level determination unit 15 determines the severity of the unexpected situation that the vehicle or passengers may encounter when the vehicle departs, based on the progress of the passenger's preparation determined by the departure preparation progress determination unit 13 in step ST2a and the driver's intention to depart the vehicle determined by the departure intention determination unit 14 in step ST2b (step ST3).
[0191] The warning level determination unit 15 outputs the level determination result to the warning display information generation unit 16 .
[0192] The warning display information generating unit 16 generates warning display information for providing a display to the driver according to the warning level determined by the warning level determining unit 15 based on the level determination result outputted from the warning level determining unit 15 in step ST3 (step ST4 ).
[0193] The warning display information generating unit 16 outputs the generated warning display information to the display control unit 18 in association with information indicating the driver's departure intention and information indicating the progress of the fellow passenger's preparation.
[0194] The progress display information generating unit 17 generates progress display information for displaying the progress of the fellow passenger's preparation based on the progress of the fellow passenger's preparation determined by the departure preparation progress determining unit 13 in step ST5 (step ST5 ).
[0195] The progress display information generating unit 17 associates the generated progress display information with information indicating the progress of the fellow passenger's preparation and outputs it to the display control unit 18 .
[0196] The display control unit 18 causes the display device 40 to perform display based on the warning display information generated by the warning display information generating unit 16 in step ST4 , and to perform display based on the progress display information generated by the progress display information generating unit 17 in step ST5 (step ST6 ).
[0197] exist Figure 6 In the operation of the display control device 1 shown in the flowchart, the processing is performed in the order of step ST3, step ST4, and step ST5, but this is only an example. The order of the processing of step ST3 to step ST4 and the processing of step ST5 may be reversed, and the processing of step ST3 to step ST4 and the processing of step ST5 may be performed in parallel.
[0198] Figure 7 This is used to explain the process performed by the departure preparation progress determination unit 13. Figure 6 A flowchart showing details of an example of the processing of step ST2a.
[0199] in addition, Figure 7 The process shown in the flowchart is a process performed when the departure preparation progress determination unit 13 determines the progress of the fellow passenger's preparation in four stages: "none", "early", "mid-term", and "completed".
[0200] First, the departure preparation progress determination unit 13 determines the presence or absence of a fellow passenger based on passenger information (step ST2 a - 1 ).
[0201] When it is determined in step ST2a-1 that there is a fellow passenger ("YES" in step ST2a-1), the departure preparation progress determination unit 13 determines whether the fellow passenger has completed taking a seat (step ST2a-2).
[0202] When it is determined in step ST2a-2 that the passenger has taken his seat ("YES" in step ST2a-2), the departure preparation progress determination unit 13 determines whether the passenger has operated the seat belt (step ST2a-3).
[0203] When it is determined in step ST2a-3 that the fellow passenger has operated the seat belt ("YES" in step ST2a-3), the departure preparation progress determination unit 13 determines whether the fellow passenger has completed the wearing of the seat belt (step ST2a-4).
[0204] When it is determined in step ST2a-4 that the fellow passenger has finished wearing the seat belt ("YES" in step ST2a-4), the departure preparation progress determination unit 13 determines whether the fellow passenger's posture is out of shape (step ST2a-5).
[0205] When it is determined in step ST2a-5 that the fellow passenger has not lost his / her posture ("No" in step ST2a-5), the departure preparation progress determination unit 13 determines that the progress of the fellow passenger's preparation is "3: Completed" (step ST2a-9).
[0206] When it is determined in step ST2a-4 that the fellow passenger has not completed fastening the seat belt ("No" in step ST2a-4), or when it is determined in step ST2a-5 that the fellow passenger has a deformed posture ("Yes" in step ST2a-5), the departure preparation progress determination unit 13 determines that the progress of the fellow passenger's preparation is "2: mid-term" (step ST2a-8).
[0207] When it is determined in step ST2a-2 that the passenger has not completed taking a seat (the case of "No" in step ST2a-2), or when it is determined in step ST2a-3 that the passenger has not operated the seat belt (the case of "No" in step ST2a-3), the departure preparation progress determination unit 13 determines that the progress of the passenger's preparation is "1: early" (step ST2a-7).
[0208] When it is determined in step ST2a-1 that there is no fellow passenger ("No" in step ST2a-1), the departure preparation progress determination unit 13 determines that the progress of the fellow passenger's preparation is "0: None" (step ST2a-6).
[0209] Then, the departure preparation progress determination unit 13 outputs the departure preparation progress information to the warning level determination unit 15 and the progress display information generation unit 17 .
[0210] Figure 8 This is used to explain the process performed by the departure intention determination unit 14. Figure 6 Flowchart of details of the processing of step ST2b.
[0211] in addition, Figure 8 The process shown in the flowchart is a process performed when the departure intention determination unit 14 determines the driver's departure intention in three stages, namely, "low", "medium", or "high".
[0212] First, the departure intention determination unit 14 determines whether a shift operation to shift D or shift R has been performed based on the operation information (step ST2 b - 1 ).
[0213] When it is determined in step ST2b-1 that a shift operation to Shift D or Shift R has been performed (YES in step ST2b-1), the departure intention determination unit 14 determines whether an operation to release the parking brake has been performed (step ST2b-2).
[0214] When it is determined in step ST2b-2 that the parking brake release operation has been performed (YES in step ST2b-2), the departure intention determination unit 14 determines whether the accelerator operation has been performed based on the operation information (step ST2b-3).
[0215] When it is determined in step ST2b-3 that the accelerator operation is performed ("YES" in step ST2b-3), the departure intention determination unit 14 determines that the driver's departure intention is "high" (step ST2b-7).
[0216] On the other hand, when it is determined in step ST2b-1 that the shift operation to shift to D or shift to R has not been performed (the case of "No" in step ST2b-1), in other words, when it is determined that the gear position remains unchanged with shift P, the departure intention determination unit 14 determines whether an operation to release the parking brake has been performed (step ST2b-4).
[0217] When it is determined in step ST2b-4 that an operation to release the parking brake has been performed ("Yes" in step ST2b-4), when it is determined in step ST2b-2 that no operation to release the parking brake has been performed ("No" in step ST2b-2), or when it is determined in step ST2b-3 that no accelerator operation has been performed ("No" in step ST2b-3), the departure intention determination unit 14 determines that the driver's departure intention is "medium" (step ST2b-6).
[0218] When it is determined in step ST2b-4 that the parking brake release operation has not been performed (NO in step ST2b-4), the departure intention determination unit 14 determines that the driver's departure intention is "low" (step ST2b-5).
[0219] Then, the departure intention determination unit 14 outputs the departure intention information to the warning level determination unit 15 .
[0220] Fig. 9 This is used to explain the warning level determination unit 15. Figure 6A flowchart showing details of an example of the processing of step ST3.
[0221] in addition, Fig. 9 The process shown in the flowchart is a process in which the warning level determination unit 15 determines the five warning levels of "level 0" to "level 4" according to the warning level determination conditions, and the above-mentioned (condition A) to (condition F) are set in the warning level determination conditions.
[0222] The warning level determination unit 15 obtains Figure 6 The departure intention information output from the departure intention determination unit 14 in step ST2b (step ST3-1).
[0223] The warning level determination unit 15 obtains Figure 6 The departure preparation progress information output from the departure preparation progress determining unit 13 in step ST2a is output (step ST3-2).
[0224] The warning level determination unit 15 determines whether the driver's departure intention is "low", "medium", or "high" based on the departure intention information (step ST3-3).
[0225] When it is determined in step ST3-3 that the driver's intention to depart is "high" (the "high" case in step ST3-3), the warning level determination unit 15 determines, based on the departure preparation progress information, whether the progress of the fellow passenger's preparation is "0: None", "1: Early", "2: Mid-term", or "3: Completed" (step ST3-5).
[0226] When it is determined in step ST3-5 that the progress of the fellow passenger's preparation is "1: early" (in the case of "early" in step ST3-5), the warning level determination unit 15 determines that the warning level is "level 4" (step ST3-10).
[0227] When it is determined in step ST3-5 that the progress of the fellow passenger's preparation is "2: mid-term" (in the case of "mid-term" in step ST3-5), the warning level determination unit 15 determines that the warning level is "level 3" (step ST3-9).
[0228] When it is determined in step ST3-3 that the driver's departure intention is "medium" (the case of "medium" in step ST3-3), the warning level determination unit 15 determines whether the progress of the passenger's preparation is "0: None", "1: Early", "2: Medium", or "3: Completed" based on the departure preparation progress information (step ST3-4).
[0229] When it is determined in step ST3 - 4 that the progress of the fellow passenger's preparation is “1: early” (“early” in step ST3 - 4 ), the warning level determination unit 15 determines that the warning level is “level 2” (step ST3 - 8 ).
[0230] When it is determined in step ST3-4 that the progress of the fellow passenger's preparation is "2: mid-term" (in the case of "mid-term" in step ST3-4), the warning level determination unit 15 determines that the warning level is "level 1" (step ST3-7).
[0231] When it is determined in step ST3-3 that the driver's intention to depart is "low" (the case of "low" in step ST3-3), when it is determined in step ST3-5 that the progress of the passenger's preparation is "0: None" or "3: Completed" (the case of "None" or "Completed" in step ST3-5), or when it is determined in step ST3-4 that the progress of the passenger's preparation is "0: None" or "3: Completed" (the case of "None" or "Completed" in step ST3-4), the warning level determination unit 15 determines that the warning level is "Level 0" (step ST3-6).
[0232] Then, the warning level determination unit 15 outputs the level determination result to the warning display information generation unit 16 .
[0233] In addition, Fig. 9 In the flowchart, the processing is performed in the order of step ST3-1 and step ST3-2, but this is only an example. The order of the processing of step ST3-1 and the processing of step ST3-2 may be reversed, and the processing of step ST3-1 and the processing of step ST3-2 may be performed in parallel.
[0234] In this way, the display control device 1 can warn the driver in a graded manner of the severity of the unexpected situation that the driver may encounter when operating the vehicle to start the vehicle by causing the display device 40 to display the warning display information. The driver can understand the severity of the unexpected situation that the driver may encounter simply by checking the display device 40, and can take certain measures according to the severity of the unexpected situation that the driver may encounter.
[0235] At this time, the display control device 1 can notify the driver of the progress of the fellow passenger's preparation by also displaying the progress display information. The driver can understand the progress of the fellow passenger's preparation, thereby easily understanding certain actions to be taken with respect to the fellow passenger.
[0236] For example, the display control device 1 performs a display corresponding to the warning level "level 4" (for example, Figure 4Da), the driver can understand that there is a high possibility of falling into a serious unexpected situation, and it is necessary to immediately stop the vehicle operation for departure or restore the operation to avoid the unexpected situation. For example, the driver immediately stops the vehicle operation for departure or restores the operation. At this time, the display control device 1 makes a display indicating the progress of the passenger's preparation as "early", so that, for example, the driver can understand at a glance that although the vehicle operation has advanced to a state where it is almost ready to depart, the passenger's preparation has hardly advanced. The driver can have a conversation such as "Do you need any help?" to help the passenger prepare.
[0237] Furthermore, for example, the display control device 1 performs a display corresponding to the warning level "level 3" (for example, Figure 4 Dd), can warn the driver that a serious unexpected situation may occur and the possibility of falling into an unexpected situation needs to be eliminated. At this time, the display control device 1 displays the progress of the passenger's preparation as "mid-term", so that, for example, the driver can understand at a glance that although the operation of the vehicle has been advanced to a state where the passenger's preparation is almost ready to depart, the passenger's preparation is not completed, and if the passenger's preparation is completed one step further, there will be no problem even if the vehicle departs. The driver can have a conversation with the passenger to notify the departure and urge them to complete the departure preparation, such as "Are you going to leave? Is it okay?"
[0238] Furthermore, for example, the display control device 1 performs a display corresponding to the warning level "level 2" (for example, Figure 4 Db), the driver can be warned that although the possibility of falling into a serious accident is low, it is necessary to pay attention to the status of the fellow passengers. At this time, the display control device 1 makes a display indicating that the progress of the fellow passengers' preparation is "early", so that, for example, the driver can understand at a glance that the progress of the fellow passengers' preparation is slower than the progress of the vehicle operation. The driver can say to the fellow passengers, "Quickly sit down, are you fastened your seat belt?" etc. to confirm the driver's status.
[0239] In addition, for example, the display control device 1 performs a display corresponding to the warning level "level 1" (for example, Figure 4 Da), can warn the driver that although it is almost impossible to fall into a serious unexpected situation, it is best to pay attention to the status of the fellow passengers. For example, the driver performs vehicle operations for departure in order to allow the fellow passengers to depart comfortably. At this time, the display control device 1 notifies the progress of the preparation of the fellow passengers as "mid-term", so that, for example, the driver can understand at a glance that although the preparation of the fellow passengers is not completed, it is progressing smoothly. The driver can say "It's almost time to leave, is it okay?" etc., so that the fellow passengers can prepare for the start of the vehicle.
[0240] When the warning level is "level 0", the display control device 1 does not display the information corresponding to the warning level. That is, when the warning level is "level 0", the display control device 1 does not warn the driver that an unexpected situation may occur. By not being warned, the driver can understand that the vehicle or passengers will not get into an unexpected situation even if the vehicle departs, or that the unexpected situation that may occur when the vehicle departs is not serious. At this time, the display control device 1 displays the progress of preparations to notify fellow passengers. If the display of the progress of preparations to notify fellow passengers is seen, the driver can understand that the preparations of the fellow passengers are completed or will be completed before departure. The driver does not need to pay attention to the fellow passengers and can focus on other aspects.
[0241] In the above-mentioned conventional technology of notifying the wearing status of the seat belt of the co-passenger through a fixed display, the driver cannot understand how serious the unexpected situation may be when the vehicle is set off by observing the display. In the technology of notifying the status of the co-passenger through a fixed display, for example, the driver thinks that the preparation of the co-passenger is going smoothly and there is no problem in setting off the vehicle, in other words, there will be no unexpected situation even if the vehicle sets off, and may feel abnormal when the operation for setting off is carried out and the accelerator is stepped on. The driver then confirms the co-passenger and notices that the co-passenger has forgotten to prepare or that the co-passenger has some trouble.
[0242] Thus, in the past, it was impossible to inform the driver of the severity of the unexpected situation that may occur when the vehicle is set off. Therefore, in order to let the driver know the severity of the unexpected situation that may occur when the vehicle is set off, the driver must talk to the passenger or change his body posture and look at the passenger to confirm the extent of the passenger's preparation for the vehicle to set off.
[0243] In contrast, the display control device 1 of embodiment 1 generates warning display information for displaying a display corresponding to the determined warning level, and displays it on the display device 40, thereby being able to warn the driver of the possibility of an unexpected situation when setting off the vehicle, so that the driver is aware of the severity of the possible unexpected situation, in other words, the importance of the warning. By knowing the importance of the warning, the driver can reduce the trouble of confirming the status of the fellow passengers one by one. In addition, the display control device 1 changes the display content as the driver's intention to depart increases or as the departure preparations of the fellow passengers progress. For example, the driver can understand that the importance of the warning has changed based on the warning that changes during the driver's operation for departure, and can understand the response that should be taken in accordance with the current situation.
[0244] For example, since a display corresponding to the warning level "Level 3" is displayed, the driver stops the operation for departure and waits. After that, if the fellow passenger successfully advances the preparation for departure, the display changes to a display corresponding to "Level 2", a display corresponding to "Level 1", and a display corresponding to "Level 0" in sequence. By observing the changing display, the driver can understand that the fellow passenger is advancing the preparation for departure and is approaching a state where there is no problem even if the vehicle is departed.
[0245] If the display corresponding to the warning level "Level 3" is still displayed even after a period of time, the driver knows that a serious unexpected situation may occur when the vehicle is set off. In this case, the driver can confirm the situation in detail, so that the passengers can prepare, eliminate the serious unexpected situation when the vehicle is set off, and set off the vehicle without any problems.
[0246] In addition, as described above, in the first embodiment, it is assumed that when the occupant enters the vehicle and the driver operates the vehicle to start the vehicle, the display control device 1 causes the display device to display a display for warning the driver that an unexpected situation may occur when the vehicle starts. Figure 6 Thus, even during the vehicle driving process, in other words, even in the state of the vehicle starting, when the passenger leaves the state of being seated, the state of wearing the seat belt, or the state of not losing posture, the driver is warned of the severity of the unexpected situation that may occur due to the vehicle starting, just like when the vehicle is about to start. As a result, the display control device 1 can also make the warning helpful to remind the driver to take measures to avoid unexpected situations.
[0247] In the above-mentioned first embodiment, the progress display information generating unit 17 may generate progress display information for displaying the progress of the preparation of the fellow passenger by an animation that changes with the passage of time, based on the progress of the preparation of the fellow passenger.
[0248] Fig. 10A , Fig. 10B as well as Fig. 10C This is a diagram for explaining the progress display information generated by the progress display information generating unit 17 in the first embodiment for displaying the progress of the preparation of the fellow passenger by an animation that changes with the passage of time.
[0249] For example, when the progress of the preparation of the fellow passenger is "1: early", the progress display information generating unit 17 may generate progress display information for causing the display device 40 to display a screen in which the following information is displayed by repeating an animation: Fig. 10A The icons shown are seats (see P1-1), seats and people displayed lightly (see P1-2), and seats and people displayed darkly (see P1-3).
[0250] For example, when the progress of the preparation of the fellow passenger is "2: mid-term", the progress display information generating unit 17 may generate progress display information for causing the display device 40 to display a screen in which the following information is displayed by repeating an animation: Fig. 10B The icons shown are those representing people (see P2-1), those representing people with the seat belt pulled out to the vicinity of their shoulders (see P2-2), and those representing people with the seat belt pulled out to the vicinity of their waists (see P2-3).
[0251] For example, when the progress of the preparation of the fellow passenger is "1: early", the progress display information generating unit 17 may generate progress display information for causing the display device 40 to display a screen in which the following information is displayed by repeating an animation: Fig. 10C The icon shown indicates a person who has completed wearing the seat belt (refer to P3-1), the icon indicates a state in which the check mark is overlapped halfway for the person who has completed wearing the seat belt (refer to P3-2), and the icon indicates a state in which the check mark is completely overlapped for the person who has completed wearing the seat belt (refer to P3-3).
[0252] In addition, Fig. 10A , Fig. 10B as well as Fig. 10C In the figure, for convenience, a quadrilateral surrounding the message and the icon is illustrated, but the quadrilateral is not displayed on the display device 40.
[0253] In the above first embodiment, in the display control device 1, the display control unit 18 causes the display device 40 to display based on the warning display information generated by the warning display information generating unit 16 and to display based on the progress display information generated by the progress display information generating unit 17, but this is only an example.
[0254] The display control unit 18 may at least cause the display device 40 to display the warning display information generated by the warning display information generating unit 16. That is, the display control unit 18 does not necessarily need to display the progress display information generated by the progress display information generating unit 17. When the display control unit 18 does not display the progress display information, the display control device 1 may be configured not to include the progress display information generating unit 17. In this case, the display control unit 18 may be configured not to include the progress display information generating unit 17. Figure 6 The operation of the display control device 1 is described in the flowchart of FIG. 1 . The display control device 1 can omit the processing of step ST5 .
[0255] here, Fig.11A , Fig. 11B , Fig. 11C as well as Fig.11D This is a diagram for explaining an example of a screen of the display device 40 when the display control unit 18 causes the display device 40 to display only a display based on the warning display information in the above-mentioned first embodiment.
[0256] The display control unit 18 does not need to display the message or icon based on the warning display information and the message or icon based on the progress display information in an overlapping manner. Therefore, for example, Fig.11A , Fig. 11B , Fig. 11C as well as Fig.11D As shown, display control is performed so that a message of "Preparation is not yet completed", "Caution", "Warning" or "Danger" is displayed in the center of the circular icon.
[0257] exist Fig.11A , Fig. 11B , Fig. 11C as well as Fig.11D In the figure, for convenience, a quadrilateral surrounding the message and the icon is illustrated, but the quadrilateral is not displayed on the display device 40.
[0258] Furthermore, when the display control unit 18 causes the display device 40 to display both a message or icon based on the warning display information and a message or icon based on the progress display information, it is not necessary to display the message or icon based on the warning display information and the message or icon based on the progress display information in an overlapping manner. For example, the display control unit 18 may cause the display device 40 to display a message or icon based on the warning display information and a message or icon based on the progress display information side by side.
[0259] Furthermore, in the above-described first embodiment, the departure preparation progress determination unit 13 determines the progress of the fellow passenger's preparation using the seating information, the seatbelt wearing information, and the posture information, but this is merely an example.
[0260] For example, the departure preparation progress determination unit 13 may determine the progress of the fellow passenger's preparation using any one or two of the seating information, the seatbelt wearing information, and the posture information.
[0261] When the departure preparation progress determination unit 13 does not use the seating information in determining the progress of the preparation of the fellow passenger, the display control device 1 may be configured not to include the seating information acquisition unit 111. In this case, the departure preparation progress determination unit 13 uses the seating information. Figure 7 In the operation described in the flowchart, the processing of step ST2a-1 to step ST2a-2 can be omitted.
[0262] When the departure preparation progress determination unit 13 does not use the seat belt wearing information in determining the progress of the fellow passenger's preparation, the display control device 1 may be configured not to include the seat belt wearing information acquisition unit 112. Figure 7 In the operation described in the flowchart, the processing of step ST2a-3 to step ST2a-4 can be omitted.
[0263] When the departure preparation progress determination unit 13 does not use the posture information in determining the progress of the preparation of the fellow passenger, the display control device 1 may be configured not to include the posture information acquisition unit 113. In this case, the departure preparation progress determination unit 13 uses the posture information. Figure 7 In the action described in the flowchart, the processing of step ST2a-5 can be omitted.
[0264] In the above first embodiment, the departure preparation progress determination unit 13 may determine the progress of the fellow passenger's preparation using information other than the seating information, the seatbelt wearing information, and the posture information.
[0265] For example, the departure preparation progress determination unit 13 may determine the progress of the preparation of the fellow passenger based on the fellow passenger's behavior other than the posture deviation (for example, whether the fellow passenger is calm or whether the fellow passenger is performing an action unrelated to departure). In this case, for example, the passenger information acquisition unit 11 detects the passenger's behavior other than the posture deviation and outputs it to the departure preparation progress determination unit 13 as the passenger information.
[0266] In addition, for example, the departure preparation progress determination unit 13 may also determine the progress of the fellow passenger's preparation based on the direction of the fellow passenger's line of sight (e.g., whether it is facing the front). In this case, for example, the passenger information acquisition unit 11 detects the direction of the passenger's line of sight and outputs it to the departure preparation progress determination unit 13 as passenger information.
[0267] Furthermore, for example, the departure preparation progress determination unit 13 may determine the progress of the passenger's preparation based on the passenger's expression. In this case, for example, the passenger information acquisition unit 11 detects the passenger's expression and outputs it to the departure preparation progress determination unit 13 as passenger information.
[0268] Furthermore, in the above first embodiment, the start intention determination unit 14 determines the start intention of the driver using the shift operation information, the parking brake operation information, and the pedal operation information, but this is only an example.
[0269] For example, the departure intention determination unit 14 may determine the driver's departure intention using any one or two of the shift operation information, the parking brake operation information, or the pedal operation information.
[0270] When the departure intention determination unit 14 does not use the shift operation information in determining the driver's departure intention, the display control device 1 may be configured not to include the shift operation information acquisition unit 121. In this case, the departure intention determination unit 14 uses the shift operation information. Figure 8 In the action described in the flowchart, the processing of step ST2b-1 can be omitted.
[0271] When the departure intention determination unit 14 does not use the parking brake operation information in determining the driver's departure intention, the display control device 1 may be configured not to include the parking brake operation information acquisition unit 122. In this case, the departure intention determination unit 14 uses the parking brake operation information acquisition unit 122. Figure 8 In the actions described in the flowchart, the processing of step ST2b-2 and step ST2b-4 can be omitted.
[0272] When the departure intention determination unit 14 does not use the pedal operation information in determining the driver's departure intention, the display control device 1 may be configured not to include the pedal operation information acquisition unit 123. In this case, the departure intention determination unit 14 uses the pedal operation information. Figure 8 In the action described in the flowchart, the processing of step ST2b-3 can be omitted.
[0273] In the above first embodiment, the departure intention determination unit 14 may determine the driver's departure intention using information other than the shift operation information, the parking brake operation information, and the pedal operation information.
[0274] For example, the departure intention determination unit 14 may determine the driver's departure intention based on information on whether the driver is holding the steering wheel. In this case, for example, the operation information acquisition unit 12 detects whether the driver is holding the steering wheel and outputs the operation information to the departure intention determination unit 14.
[0275] In the above-mentioned first embodiment, the departure preparation progress determination unit 13 determines the progress of the preparation for the departure of the vehicle by the fellow passenger according to the four stages of "0: none", "2: early", "3: mid-term" or "4: completed", but this is only an example. The progress of the preparation for the departure of the vehicle determined by the departure preparation progress determination unit 13 may be two stages, three stages, or five stages or more. The manager or the like can appropriately set the stages based on the actions that are expected to be performed in stages as preparation for the departure when the fellow passenger uses the vehicle for travel.
[0276] In the above first embodiment, the departure intention determination unit 14 determines the driver's intention to start the vehicle in three stages, namely "low", "medium" or "high", but this is only an example. The driver's intention to start the vehicle determined by the departure intention determination unit 14 may be in two stages, or may be in four or more stages. The stages can be appropriately set by a manager or the like based on the operations expected to be performed in stages when the driver starts the vehicle.
[0277] In the above-mentioned first embodiment, the warning level determined by the warning level determination unit 15 is divided into five stages, namely, "Level 0" to "Level 4", but this is only an example, and the warning level stages can be appropriately set by a manager or the like.
[0278] In the above first embodiment, it is assumed that the passenger sits in the rear seat, but this is just an example. For example, the passenger may sit in the front passenger seat.
[0279] In addition, in the above embodiment 1, it is assumed that there is one passenger, but this is just an example. For example, there may be multiple passengers. In the case where there are multiple passengers, in the display control device 1, the departure preparation progress determination unit 13 may use the average of the progress of the preparations of the multiple passengers as the progress of the preparations of the passengers, or may use the slowest progress (i.e., the progress represented by the smallest numerical value) among the progress of the preparations of the multiple passengers as the progress of the preparations of the passengers. For example, in the case where there are two passengers and the progress of the preparations of one passenger is "1: Early" and the progress of the preparations of the other passenger is "3: Completed", the departure preparation progress determination unit 13 may use "2: Mid-term" as the average of the progress of the preparations of the two passengers.
[0280] In addition, for example, the progress display information generating unit 17 may generate progress display information for each of the plurality of fellow passengers, and the display control unit 18 may cause the display device 40 to display the progress display information for each of the plurality of fellow passengers. For example, the display control unit 18 may cause the seat display in the vehicle to correspond the displayed seat to the seat where the fellow passenger has sat or is about to sit, and display the progress display information for each of the plurality of fellow passengers. By checking the display device 40, the driver can intuitively understand to what extent the fellow passenger in which seat has made preparations for departure.
[0281] In addition, in the above embodiment 1, regarding the display device 40 that the display control device 1 causes to display, it is assumed that a display device 40 is set at a position where the driver who is looking at the front of the vehicle can visually confirm without moving his sight significantly, but this is only an example. For example, regarding the display device 40 that the display control device 1 causes to display, in addition to the display device 40 that is set at a position where the driver who is looking at the front of the vehicle can visually confirm without moving his sight significantly, it can also be a display device 40 that is set at a position where the passengers in the rear seats, such as the back of the seat of the front seat, can visually confirm. In this case, the display control device 1 can, for example, notify the passengers in the rear seats of the driver's intention to depart and the unexpected situation that may occur when the driver causes the vehicle to depart. As a result, the passengers can, for example, spontaneously prepare for departure in advance without waiting for the driver's instructions, convey specific expectations such as instructing the driver to wait for departure, or take actions by themselves to avoid unexpected situations.
[0282] In the above-mentioned first embodiment, the display control device 1 is a vehicle-mounted device mounted on a vehicle, and the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 are provided in the vehicle-mounted device. Without being limited to this, some of the occupant information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 may be provided in the vehicle-mounted device of the vehicle, and the rest may be provided in a server connected to the vehicle-mounted device via a network. Alternatively, the passenger information acquisition unit 11 , the operation information acquisition unit 12 , the departure preparation progress determination unit 13 , the departure intention determination unit 14 , the warning level determination unit 15 , the warning display information generation unit 16 , the progress display information generation unit 17 , and the display control unit 18 may all be provided in a server.
[0283] Fig. 12A and Fig. 12B This is a diagram showing an example of the hardware configuration of the display control device 1 according to the first embodiment.
[0284] In the first embodiment, the functions of the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 are implemented by the processing circuit 1001. That is, the display control device 1 includes the processing circuit 1001, and the processing circuit 1001 is used to control the following: when the vehicle or the passenger may fall into an unexpected situation when the vehicle is set off, the situation is displayed to the driver in a display method that allows the driver to know the severity of the unexpected situation.
[0285] The processing circuit 1001 may be Fig. 12A The dedicated hardware shown in FIG. Fig. 12B A processor 1004 is shown executing programs stored in memory.
[0286] When the processing circuit 1001 is dedicated hardware, the processing circuit 1001 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.
[0287] In the case where the processing circuit is a processor 1004, the functions of the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 are implemented by software, firmware, or a combination of software and firmware. The software or firmware is described in the form of a program and stored in the memory 1005. The processor 1004 executes the functions of the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 by reading and executing the program stored in the memory 1005. That is, the display control device 1 has a memory 1005, and the memory 1005 is used to store the above-mentioned results when executed by the processor 1004. Figure 6The program stored in the memory 1005 can also be said to be a procedure or method for causing the computer to execute the processing of the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18. Here, the memory 1005 corresponds to, for example, a RAM, a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable Read-Only Memory) or other nonvolatile or volatile semiconductor memory, a magnetic disk, a floppy disk, an optical disk, a high-density disk, a mini disk, a DVD (Digital Versatile Disc), and the like.
[0288] In addition, the functions of the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 may be partially realized by dedicated hardware and partially realized by software or firmware. For example, the functions of the passenger information acquisition unit 11 and the operation information acquisition unit 12 may be realized by the processing circuit 1001 as dedicated hardware, and the functions of the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, the progress display information generation unit 17, and the display control unit 18 may be realized by the processor 1004 reading and executing a program stored in the memory 1005.
[0289] Furthermore, the display control device 1 includes devices such as the first sensor 20 , the second sensor 30 , or the display device 40 , and an input interface device 1002 and an output interface device 1003 that perform wired or wireless communication.
[0290] As described above, according to the first embodiment, the display control device 1 is configured to include: an occupant information acquisition unit 11, which acquires occupant information related to an occupant; an operation information acquisition unit 12, which acquires operation information related to an operation of the vehicle by a driver of the vehicle; a departure preparation progress determination unit 13, which determines the progress of the preparation for departure of the vehicle by the fellow passengers based on the occupant information acquired by the occupant information acquisition unit 11; a departure intention determination unit 14, which determines the driver's intention to start the vehicle based on the operation information acquired by the operation information acquisition unit 12; and a warning level determination unit 15, which determines the warning level of the vehicle based on the operation information acquired by the departure preparation progress determination unit 11. 3 and the driver's intention to start the vehicle determined by the departure intention determination unit 14, to determine the severity level (warning level) of the unexpected situation that the vehicle or passengers may fall into when the vehicle starts; a warning display information generation unit 16, which generates warning display information for displaying according to the level (warning level) for the driver determined by the warning level determination unit 15; and a display control unit 18, which causes the display device 40 to display based on the warning display information generated by the warning display information generation unit 16. Thus, the display control device 1 can warn the driver in a display method that allows the driver to know the severity of the unexpected situation when the vehicle or passengers may fall into the unexpected situation when the vehicle starts. As a result, the driver can grasp the severity of the unexpected situation that may fall into by simply checking the display device 40, and can take certain measures according to the severity of the unexpected situation that may fall into.
[0291] In addition, the display control device 1 is configured to include, in addition to the passenger information acquisition unit 11, the operation information acquisition unit 12, the departure preparation progress determination unit 13, the departure intention determination unit 14, the warning level determination unit 15, the warning display information generation unit 16, and the display control unit 18, a progress display information generation unit 17, which generates progress display information for displaying the progress of the passenger's preparation based on the progress of the passenger's preparation determined by the departure preparation progress determination unit 13, and the display control unit 18 causes the display device 40 to display the warning display information generated by the warning display information generation unit 16, and to display the progress display information generated by the progress display information generation unit 17. Thus, the display control device 1 can notify the driver of the progress of the passenger's preparation. The driver can understand the progress of the passenger's preparation by checking the display device 40, and can easily understand certain responses to be taken with respect to the passenger.
[0292] Furthermore, in the display control device 1, the progress display information generating unit 17 may generate progress display information for displaying the progress of the preparation of the fellow passenger in an animation that changes over time, based on the progress of the preparation of the fellow passenger. Thus, the display control device 1 can notify the driver of the progress of the preparation of the fellow passenger. The driver can understand the progress of the preparation of the fellow passenger by checking the display device 40.
[0293] In addition, any constituent element of the embodiment may be modified or omitted.
[0294] Industrial Applicability
[0295] The display control device of the present disclosure can warn the driver by displaying the severity of the unexpected situation when the vehicle or the passengers may fall into an unexpected situation when the vehicle is set off.
[0296] Description of Reference Numerals
[0297] 1 display control device, 11 occupant information acquisition unit, 111 seating information acquisition unit, 112 seat belt wearing information acquisition unit, 113 posture information acquisition unit, 12 operation information acquisition unit, 121 shift operation information acquisition unit, 122 parking brake operation information acquisition unit, 123 pedal operation information acquisition unit, 13 departure preparation progress determination unit, 14 departure intention determination unit, 15 warning level determination unit, 16 warning display information generation unit, 17 progress display information generation unit, 18 display control unit, 20 first sensor, 30 second sensor, 40 display device, 1001 processing circuit, 1002 input interface device, 1003 output interface device, 1004 processor, 1005 memory.
Claims
1. A display control device, wherein: The display control device comprises: an occupant information acquisition unit that acquires occupant information related to the occupant; an operation information acquisition unit that acquires operation information related to an operation of the vehicle by a driver of the vehicle; a departure preparation progress determination unit that determines the progress of the preparation for departure of the vehicle by a fellow passenger based on the passenger information acquired by the passenger information acquisition unit; a departure intention determination unit that determines the driver's intention to start the vehicle based on the operation information acquired by the operation information acquisition unit; a warning level determination unit that determines a level of severity of an unexpected situation that may occur to the vehicle or the occupant when the vehicle is started, based on the progress of the preparation of the fellow passenger determined by the start preparation progress determination unit and the driver's intention to start the vehicle determined by the start intention determination unit; a warning display information generating unit configured to generate warning display information for providing a display corresponding to the level determined by the warning level determining unit for the driver; as well as A display control unit causes a display device to perform a display based on the warning display information generated by the warning display information generation unit.
2. The display control device according to claim 1, characterized in that: The warning display information generating unit generates the warning display information so as to be displayed more emphasized as the level determined by the warning level determining unit is larger.
3. The display control device according to claim 1, characterized in that: The warning display information generating unit generates the warning display information for displaying an icon or a message corresponding to the level determined by the warning level determining unit.
4. The display control device according to any one of claims 1 to 3, characterized in that: The display control device includes a progress display information generating unit for generating progress display information for displaying a display corresponding to the progress of the fellow passenger's preparation based on the progress of the fellow passenger's preparation determined by the departure preparation progress determining unit. The display control unit causes the display device to perform a display based on the warning display information generated by the warning display information generation unit, and to perform a display based on the progress display information generated by the progress display information generation unit.
5. The display control device according to claim 4, characterized in that: The progress display information generating unit generates the progress display information for displaying the progress of the preparation of the fellow passenger using an animation that changes with the passage of time, based on the progress of the preparation of the fellow passenger.
6. A display control method, wherein: The display control method comprises the following steps: The passenger information acquisition unit acquires passenger information related to the passenger. An operation information acquisition unit acquires operation information related to an operation of the vehicle by a driver of the vehicle; a departure preparation progress determination unit that determines the progress of a fellow passenger's preparation for departure of the vehicle based on the passenger information acquired by the passenger information acquisition unit; a departure intention determination unit that determines the driver's intention to start the vehicle based on the operation information acquired by the operation information acquisition unit; a warning level determination unit that determines a level of severity of an unexpected situation that the vehicle or the occupant may fall into when the vehicle is started, based on the progress of the preparation of the fellow passenger determined by the start preparation progress determination unit and the driver's intention to start the vehicle determined by the start intention determination unit; a warning display information generating unit generating warning display information for performing a display corresponding to the level determined by the warning level determining unit for the driver; as well as The display control unit causes a display device to perform a display based on the warning display information generated by the warning display information generation unit.
