Display control device, display system, and display control method
By coordinating control between multiple display units of the vehicle, the problems of occupants' uneasiness and inconsistency during automatic driving to manual driving mode switching are solved, and the smooth identification and understanding of driving state switching is achieved.
Patent Information
- Application Number
- CN202380034482.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-27
- Filing Date
- 2023-04-26
- Publication Date
- 2024-11-29
AI Technical Summary
When the autonomous driving system switches from autonomous driving mode to manual driving, the sudden switching display causes the occupant to be uneasy and may violate the occupant's expectations, resulting in a sense of incongruity.
By coordinating control among multiple display units, first displaying the driving switching notification information without overlapping the image that the occupant is viewing, and transferring it to the perimeter of the field of view or other display units as appropriate, ensuring that the occupant can continue to watch while continuing to watch. The original image is used to switch status while recognizing.
It reduces the uneasiness of the occupants, avoids the sense of incongruity, and ensures smooth identification and understanding of driving status switching.
Smart Images

Figure CN119053502A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a display control device, a display system, a display control method, etc., which are installed in a vehicle such as an automobile. Background Art
[0002]
[0040] of Patent Document 1 states that "when switching from automatic driving to manual driving, the display on the interior display screen is changed to specific display content or images indicating the switch to manual driving, thereby increasing the driver's enthusiasm for manual driving."
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2021-82354 Summary of the invention
[0006] Problems to be solved by the invention
[0007] When the automatic driving system needs to switch the vehicle from the automatic driving mode to the manual driving mode, it issues a request to urge the passenger who is the driver during manual driving to return to the vehicle operation, in other words, it issues a takeover request (TOR). Here, "takeover" means handing over driving, and "takeover request" means a request to hand over driving.
[0008] In this specification, TOR may be referred to as a "driving switch request" for switching the driving state. In addition, TOR is a type of "driving switch notification information" in a broad sense for notifying the switching of the driving state.
[0009] Here, for example, a case is assumed in which a TOR needs to be issued while a map image, entertainment video, or the like is displayed on a screen or the like provided so as to cover a windshield or a part of the windshield during autonomous driving.
[0010] At this time, if the display during automatic driving is suddenly switched to the display of TOR, there is a possibility that the passenger who is the driver will feel uneasy.
[0011] Although it is also considered to have the display during autonomous driving and the display of TOR coexist, this will result in the mixing of different types of images, which is expected to cause a great sense of discomfort to the passengers.
[0012] In addition, there may be cases where the occupant wants to continue watching the images or videos that they are watching during autonomous driving. The action of forcibly ending the display during autonomous driving and switching to the TOR display can also be said to be an action that goes against the expectations of the occupant.
[0013] The present inventors have found out such a problem through their research. Regarding such a problem, Patent Document 1 mentioned above does not describe it, nor does it mention a countermeasure therefor.
[0014] One of the objects of the present invention is to recognize the switching of the driving state without a sense of incongruity in consideration of alleviating the anxiety of the occupant or not violating the expectations of the occupant when switching the driving state.
[0015] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary embodiments and best modes and the accompanying drawings.
[0016] Means for solving problems
[0017] Hereinafter, in order to facilitate understanding of the contents of the present invention, embodiments of the present invention will be exemplified.
[0018] In a first embodiment of the present invention, a display control device is provided, wherein:
[0019] The display control device includes a control unit that controls image display on a plurality of display units mounted on the vehicle.
[0020] The plurality of display units include a first display unit that displays a first image and a second display unit that displays a second image.
[0021] When the driving switching notification information for notifying the occupant that the vehicle will switch from the first driving state to the second driving state is displayed while the occupant of the vehicle is viewing the first image displayed by the first display unit,
[0022] The control unit performs the following processing:
[0023] a first display control process of causing the second display unit to display the driving switch notification information as the second image so as not to overlap with the first image; and
[0024] The second display control process then causes the first display unit to display the driving switch notification information instead of the first image.
[0025] In the first embodiment, when the driving state is switched, the driving switch notification information is not suddenly displayed to replace the first image that the occupant is watching, but the driving switch notification information is first displayed in a manner that does not overlap with the first image, so that the occupant can recognize the driving switch notification information in, for example, the peripheral field of vision while watching the first image. Therefore, it is possible to notify, in other words, to forewarn, that the driving state needs to be switched without causing the occupant to feel uncomfortable.
[0026] Then, by transferring the driving switching notification information to the position where the first image is displayed, the occupant can be reliably notified of details related to the driving switching, the switching timing, etc. The occupant can visually recognize the driving switching notification information without moving their eyes away from the first image, thereby reducing the burden on the occupant.
[0027] According to this aspect, when the driving state is switched, the occupant's anxiety can be reduced, and the occupant can recognize the switch of the driving state without feeling uncomfortable.
[0028] In the second solution subordinate to the first solution, it may also be that
[0029] The first display unit is a projection type display device that projects display light of an image onto a screen provided so as to cover the windshield of the vehicle or at least a portion of the windshield.
[0030] The second display unit is a display device that displays an image on a display screen.
[0031] The control unit executes the first and second display control processes before a switching period of the driving state ends.
[0032] In the second scheme, a preferred example in which the display control of the present invention is effective is shown. For example, in the case where the automatic driving state is switched to the manual driving state with the end of the automatic driving section, the notification based on the driving switching notification information only needs to be executed before the end of the switching period of the driving state, and it is also conceivable that there is a relatively long time margin before the end of the switching period.
[0033] In the automated driving zone, it is conceivable that, for example, entertainment images, map images, etc. are displayed at a position facing forward, in other words, at a position facing straight ahead, or in the vicinity thereof, and the occupant is visually recognizing these images.
[0034] Such a display can be realized by, for example, using a projection display device such as a head-up display (HUD) that projects an image onto a screen covering a windshield or a portion of a windshield. In this case, the image of the driving switching notification information can also be displayed larger, for example, at a position substantially in front of the vehicle when viewed from the passenger, so that the display can be easily viewed.
[0035] On the other hand, in addition to the HUD device, a vehicle is often provided with a display device such as a central information display (CID) that is built into the instrument panel or vertically installed on the instrument panel. The CID is often arranged near the passengers, and the passengers can see the images displayed on the HUD while understanding the images displayed on the CID in the peripheral field of vision.
[0036] Therefore, a first type of display device of a projection type such as a HUD that projects an image is coordinated with a second type of display device of a screen display type such as a CID that directly displays an image on a screen, and first, the driving switch notification information is displayed on the screen display type display device. In this case, the occupant can watch the first image and notice that the driving switch notification information is displayed around his or her field of vision, and can indirectly understand that the driving state is about to be switched.
[0037] Afterwards, the driving switch notification information is displayed through the HUD, etc., and the driving switch notification information is displayed to replace the first image. As a result, the occupants can directly visually recognize the easy-to-see displayed driving switch notification information without looking away, and can reliably identify and confirm the content, timing, etc. of the driving switch.
[0038] In this way, by cooperatively controlling a plurality of display devices, in other words, a plurality of display units, it is possible to reduce the occupant's anxiety when switching the driving state, and to enable the occupant to recognize the switching of the driving state without a sense of disharmony.
[0039] In a third embodiment subordinate to the first or second embodiment, it may be that:
[0040] If the first image is a predetermined continuation content estimated to be the content that the occupant wishes to continue viewing, or a continuation setting content that is preset as the content that the occupant wishes to continue viewing,
[0041] The control unit executes a third display control process in parallel with the second display control process to display the first image as the second image on the second display unit.
[0042] In the third scheme, when the first image viewed by the occupant is a prescribed continuation content or a continuation setting content, a third display control process is performed to transfer the first image to the second display unit in such a manner that, for example, the occupant can continue to view the first image by occasionally looking away after the driving switch notification information is displayed to replace the first image.
[0043] The third display control is performed in parallel with the second display control, so as a result, the display of the first image and the display of the driving switching notification information are interchanged. The first image continues to be displayed on the second display unit, so the occupant can continue to view the first image at an appropriate timing.
[0044] In addition, since the first image and the image of the driving switching notification information are exchanged, it does not take time, there is no visual discomfort to the occupants, and the psychological burden is also less.
[0045] As described above, according to the present aspect, when the driving state is switched, it is possible to recognize the switching of the driving state without a sense of incongruity, taking into account that it does not violate the expectations of the occupants.
[0046] In a fourth aspect subordinate to the first or second aspect, it may be that:
[0047] If the first image is not the predetermined continuation content that is estimated to be the content that the occupant wishes to continue viewing, and is not the continuation setting content that is preset as the content that the occupant wishes to continue viewing,
[0048] The control unit executes a fourth display control process to display the content displayed on the second display unit before the drive switching notification information is displayed on the second display unit again.
[0049] In the fourth aspect, the image displayed before the driving switch notification information is displayed is displayed again on the second display unit without performing the second display control for displaying the first image. Thus, the image whose display was interrupted due to the prompting of the driving switch notification information can be viewed again. For example, the occupant can obtain useful information from the image again.
[0050] In a fifth aspect subordinate to the first or second aspect, it may be that:
[0051] If the first image is not the predetermined continuation content that is estimated to be the content that the occupant wishes to continue viewing, and is not the continuation setting content that is preset as the content that the occupant wishes to continue viewing,
[0052] The control unit executes a fifth display control process to cause the second display unit to display a content selection image, and when content is selected using the content selection image within a predetermined period, cause the second display unit to display the selected content.
[0053] In the fifth aspect, the content selection image is displayed on the second display portion without performing the second display control for causing the second display portion to display the first image.
[0054] Thus, the passenger can select the content displayed on the second display unit. When the passenger selects content within a predetermined period, for example, during the driving switching period, the selected content is displayed on the second display unit. Therefore, the passenger can view the content image that he likes, and the convenience is improved.
[0055] In a sixth aspect subordinate to the fifth aspect, it may be that:
[0056] When the content is not selected within the specified period,
[0057] The control unit executes a sixth display control process to maintain the content selection image even after the predetermined period.
[0058] In the sixth aspect, if no content is selected within a predetermined period, such as during a driving switch, the display of the content selection image on the second display unit can be maintained even after the predetermined period has passed. Therefore, the occupant can select the content displayed on the second display unit even after the predetermined period has passed, which improves convenience.
[0059] In a seventh aspect dependent on any one of the first to sixth aspects, it may be that:
[0060] In the case where there are other display units besides the first and second display units,
[0061] The control unit performs a seventh display control process, i.e., any one of the following processes, on the other display unit during the execution of the first and second display control processes:
[0062] Reduce conspicuity by reducing the brightness, chroma or lightness of the display;
[0063] or
[0064] A semi-transparent shading sheet is provided on the display image surface to reduce the conspicuity;
[0065] or
[0066] Set to non-display;
[0067] or
[0068] Displays an auxiliary image indicating the switching driving status.
[0069] In the seventh scheme, for example, during the implementation of the second and third display control processes, in other display units different from the display unit where the display has changed, the following controls for focusing the occupant's attention on the display unit where the display has changed may be implemented, for example: reducing the brightness, chroma or brightness of the display to a specified value; forming a translucent black shading sheet on the display screen; cutting off the display; or displaying auxiliary images such as text, animation, etc. that indicate that the driving status is being switched.
[0070] This prevents the occupant's awareness from being distracted and allows them to concentrate on the content to be switched and displayed, thereby enabling reliable information presentation.
[0071] In an eighth aspect dependent on any one of the first to seventh aspects, it may be that:
[0072] The control unit performs any one of the following processes on at least one of the first and second display units as a method of eliminating an image and a method of appearing an image during a display switching period:
[0073] Transient image removal and appearance processing;
[0074] or
[0075] Use fade-out and fade-in processing to change brightness over time;
[0076] or
[0077] This is accompanied by the removal and appearance of emphasis processing due to image flickering or changes in display form.
[0078] According to the eighth aspect, the conspicuousness can be improved by devising a method of eliminating and appearing an image when switching the display. This helps, for example, to make the occupant focus on the display unit whose display is changing.
[0079] In a ninth aspect dependent on any one of the first to eighth aspects, it may be that:
[0080] The display unit is any one of a head-up display (HUD) device, an instrument display, a direct projection display that projects an image displayed on the display onto a windshield or a screen without passing through an optical system, a central information display (CID), a center console monitor, a widescreen display, a passenger display, a display mirror, and a side monitor, and an in-vehicle projector that projects an image in the vehicle.
[0081] In the ninth aspect, by effectively utilizing a plurality of display units, in other words, display devices, provided in the vehicle, the various display control processes described above can be effectively implemented without adding a special display device.
[0082] In a tenth aspect dependent on any one of the first to ninth aspects, it may be that:
[0083] When one display device has a plurality of display areas whose displays can be independently controlled, the control unit regards one display area as one display unit and executes the first and second display control processes.
[0084] In the tenth scheme, when a display device, in other words, a display apparatus has multiple display areas that can independently control the display, each display area can be regarded as having a display unit to perform the above-mentioned various controls, thereby substantially increasing the number of display units that can be used.
[0085] In other words, by regarding each display region as having a display unit, the number of selectable display units increases, and an optimal display unit can be selected and used. Therefore, the visual effect for the occupant can be improved.
[0086] In the eleventh aspect subordinate to any one of the first to sixth aspects and the eighth to tenth aspects, it may be that:
[0087] The control unit executes a display shift process in the second display control process to shift the driving switch notification information to the first display unit as time passes.
[0088] In the eleventh aspect, for example, when switching the display content between the first and second display units, the display is switched by moving the display via the third display unit, or the display position is moved in the display unit having a horizontally long display screen, or the display position is moved by moving the movable display unit, thereby implementing display switching control accompanied by movement. Thus, for example, the change in display content can leave an impression on the occupants, and more reliable information presentation can be performed.
[0089] The display system of the present invention comprises:
[0090] A plurality of display units mounted on the vehicle; and
[0091] The control unit according to any one of the first to eleventh aspects.
[0092] This makes it possible to realize a display system, in other words, an in-vehicle display system, which can recognize the switching of the driving state without a sense of incongruity in consideration of alleviating the anxiety of the occupants or not violating the expectations of the occupants when switching the driving state.
[0093] The display control method of the present invention,
[0094] It controls the image display of multiple display units installed in the vehicle, among which,
[0095] The plurality of display units include a first display unit that displays a first image and a second display unit that displays a second image.
[0096] The method comprises the following steps:
[0097] When the driving switching notification information for notifying the occupant that the vehicle will switch from the first driving state to the second driving state is displayed while the occupant of the vehicle is viewing the first image displayed by the first display unit,
[0098] a step of executing a first display control process for causing the second display unit to display the driving switching notification information as the second image so as not to overlap with the first image; and
[0099] A step of executing a second display control process, and then transferring the driving switch notification information to the first display unit, so that the driving switch notification information is displayed instead of the first image.
[0100] As a result, when the driving state is switched, the occupants' anxiety can be reduced, and the switching of the driving state can be reliably recognized without any sense of discomfort.
[0101] It will be readily apparent to those skilled in the art that the exemplified aspects of the present invention may be further modified without departing from the spirit of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0102] Figure 1 It is a diagram showing a configuration example of a driving assistance system (automatic driving system), a vehicle display system, and a display control device.
[0103] Figure 2 This is a diagram showing an example of a display unit (display device) that can be used in the present invention.
[0104] Figure 3 1 is a diagram showing an example of the first to fourth display control processes.
[0105] Figure 4 : is a diagram showing an example of the fifth and sixth display control processes.
[0106] Figure 5 : is a figure which shows an example of the 7th display control process.
[0107] Figure 6 This is a diagram showing a display example in which a fade-out and fade-in method is used as a method of eliminating and appearing an image when switching displays.
[0108] Figure 7 This is a diagram showing a display example in the case where the emphasis display method is used as a method of eliminating and appearing an image when switching the display.
[0109] Figure 8 : is a flowchart showing an example of display control accompanying a driving switching request.
[0110] Fig. 9 : is a flowchart showing another example of display control accompanying the driving switching request.
[0111] Fig.10 FIG. 1 is a diagram showing a specific example of display control in a vehicle traveling on a highway. DETAILED DESCRIPTION
[0112] The best embodiment described below is intended to facilitate understanding of the present invention. Therefore, those skilled in the art should note that the present invention is not unreasonably limited by the embodiment described below.
[0113] In the following description, various display devices may be referred to as “display units.” In addition, a display device that can display a real image on a display screen, such as a liquid crystal panel, may be referred to as a “display or display device.”
[0114] In the following description, the term "driving switch request" is used, but it is to be interpreted in a broad sense. For example, the autonomous driving system may issue a driving switch request not only when switching from an autonomous driving state to a manual driving state, but also when switching the autonomous driving level.
[0115] In addition, the "driving switching notification information" issued by the system mounted on the vehicle when the driving state is switched is also preferably interpreted in the broadest sense. For example, as the first driving state and the second driving state, for example, the parking state and the driving state can be listed. When the vehicle stops at a red light, the timing of the red light turning green is detected through the vehicle-road communication, and the display control processing described below is implemented before the timing. In addition, if it is a vehicle equipped with a cruise control function, the first driving state and the second driving state can be set to the set speed driving state and the normal driving state. For example, according to the amount of surrounding traffic, it is predicted that it is difficult to continue to maintain the set speed driving state and the brake operation is performed, and the display control processing described below is implemented. In addition, if it is a vehicle equipped with a follow-up cruise control (ACC), the first driving state and the second driving state can be set to the ACC driving state and the normal driving state. For example, when the vehicle determines that it is difficult to adjust the speed through the camera due to the influence of weather, a switching request to manual driving is transmitted to the driver, and at the same time, the display control processing described below is implemented. In the following description, the case of switching from the automatic driving state to the manual driving state is mainly described.
[0116] In addition, as a display device that projects an image (or display light of an image) onto a projection target member such as a windshield, a head-up display (HUD) device is typically known.
[0117] Among them, the HUD device projects images via a reflective optical system such as a concave mirror, but there are also display devices that remove the reflective optical system and directly project, for example, an image displayed on a display screen onto a projected component. In this specification, for convenience, it is referred to as a direct projection display or WSD (windshield display) to distinguish it from the HUD device.
[0118] In addition, as a projection display device (display unit), a projector that projects image display light onto a steering wheel, etc. can also be used. In this specification, a projector that is installed in a vehicle and can present information in addition to interior decoration is referred to as an "in-vehicle projector."
[0119] Reference Figure 1 . Figure 1 is a diagram showing an example of the configuration of a driving assistance system (automatic driving system), a vehicle display system, and a display control device. Figure 1In the diagram, the width direction of the vehicle (the left-right direction when viewed from the driver) is the X direction, the height direction of the vehicle is the Y direction, and the front direction when viewed from the driver is the Z direction.
[0120] The driving support system (automatic driving system) 10 includes an information collecting unit 12 that collects various information from ECUs and the like, an AI module 14 , a speed control module 16 , and a steering control module 18 .
[0121] The display system includes a display control device (processor) 102, a speaker (sound output unit) 106, an image analysis unit 110, an occupant status determination unit 111, an in-vehicle projector 112, a camera 114 for photographing the occupants (driver, etc.) of the vehicle 1, a center console monitor 121, a central information display (CID) 122, and a head-up display (HUD) device 125.
[0122] Furthermore, the passenger state determination unit 111 includes a driving state estimation unit 13 and a driving state monitoring unit 15 .
[0123] The HUD device 125 can display a virtual image (image) on a virtual virtual image display surface PS1 set in a space at a predetermined distance from the viewpoint of the occupant in front, for example, by projecting the image onto the windshield 2 (or a transparent or semi-transparent screen provided to cover the windshield 2). The same is true for the WSD.
[0124] In addition, a central information display (CID) 122 and a HUD device 125 are provided on the instrument panel 120 , and further, a center console monitor 121 is provided on the instrument panel 120 .
[0125] In addition, the in-vehicle projector 112 can present necessary information by, for example, projecting the image R1 onto the steering wheel 4. However, this is just an example, and the in-vehicle projector 112 may project the image onto the instrument panel 120, the windshield 2, or a screen (not shown) provided so as to cover the windshield 2.
[0126] The display control device (processor) 102 includes a control unit 113 for controlling the display modes of various display units and a voice guidance unit 105 .
[0127] The control section 113 includes an overall control section 104 , a display control section 107 , a HUD and WSD control section 108 , and an in-vehicle projector control section 109 .
[0128] Next, refer to Figure 2 . Figure 2 FIG. 1 is a diagram showing an example of a display unit (display device) that can be used in the present invention. Figure 2 In, with Figure 1The same parts are denoted by the same reference numerals.
[0129] like Figure 2 As shown in A-1 of FIG. 1 , as the display unit (display device) that can be used in the present invention, for example, a head-up display (HUD) device 125, an instrument display 124, a WSD 123 as a direct projection display that projects an image displayed on the display onto a windshield or a screen without passing through an optical system, a central information display (CID) 122, a center console monitor 121, a passenger display 128, display mirrors (electronic rearview mirrors) 126a, 126b, side monitors 127a, 127b, and an in-vehicle projector 112 can be listed. In addition, reference numeral 129 is a rearview mirror.
[0130] By effectively utilizing a variety of display units, in other words, display devices, included in the vehicle 1 , the various display control processes described above can be effectively implemented without adding a special display device.
[0131] In addition, if Figure 2 As shown in A-2 of FIG. 1 , when a display device has multiple display areas that can independently control display, the control unit 113 may also treat one display area as one display unit and perform the display control process described later. This can substantially increase the number of display units that can be used.
[0132] exist Figure 2 In A-2 of FIG. 1 , the virtual image display surface PS1 of the HUD 125 is divided into two independent display areas PS1a and PS1b. In addition, the virtual image display surface PS2 of the WSD 123 is also divided into two independent display areas PS2a and PS2b.
[0133] In addition, the screen of the center console monitor 121 is divided into two independent display areas α and β. In addition, the horizontally long screen of the widescreen display 130 extending in the left-right direction is divided into five independent display areas Za to Ze.
[0134] By regarding each display region as having a display unit, the number of selectable display units increases, and an optimal display unit can be selected and used. Therefore, the visual effect for the occupant can be improved.
[0135] Next, refer to Figure 3 . Figure 3 FIG. 1 is a diagram showing an example of first to fourth display controls. Figure 3 In the drawings, the same reference numerals are used for the same parts as those in the above-mentioned figures.
[0136] exist Figure 3In the example, the HUD device 125 is used as the first display unit (display device), and the central information display (CID) 122 is used as the second display unit (display device).
[0137] exist Figure 3 In A-1 of FIG. 1 , the vehicle 1 is in an automatic driving state, and an image A such as entertainment content and a bird's-eye view map is displayed on the virtual image display surface PS1 through the HUD device 125. The entertainment content is, for example, a TV screen, a music playback screen, and other content that contains entertainment elements that are not related to driving operations. In addition, the bird's-eye view map is, for example, a map depicted in a manner of looking down on the ground from above, and can also be called a bird's-eye view or a panoramic view.
[0138] During manual driving, the passenger 5 serving as the driver looks straight ahead, for example, and sees the image A displayed substantially in front of the vehicle.
[0139] In addition, an image B serving as navigation information for assisting the operation of the vehicle 1 is displayed on the CID 122 , for example.
[0140] Furthermore, when the passenger 5 wishes to continue viewing the first image A currently being viewed even after the display is switched, the passenger 5 can operate the setting unit 133 in advance to register the content as the continuation setting content.
[0141] In addition, Figure 3 In A-1 of FIG. 1 , the dotted ellipse indicates the area estimated as the field of view of the occupant 5. For example, when the occupant 5 visually recognizes the image A at the front position, the line of sight direction is uniquely determined. For example, the overall control unit 104 of the control unit 113 can uniquely determine the field of view according to a predetermined algorithm with the line of sight direction as the center, and estimate it as the field of view of the occupant 5. In the following description, the estimated field of view is sometimes referred to as the field of view.
[0142] Next, refer to Figure 3 For example, when the automatic driving section in which the vehicle 1 is traveling is about to end, the automatic driving system issues a driving switch request (TOR), in other words, issues driving switch notification information.
[0143] exist Figure 3 In A-2 of FIG. 1 , the image C of the driving switching notification information is displayed on CID 122. In other words, when the image C of the driving switching notification information notifying the occupant 5 that the vehicle 1 will switch from the first driving state (e.g., the automatic driving state) to the second driving state (e.g., the manual driving state) is displayed while the occupant 5 of the vehicle 1 is viewing the first image A displayed by the HUD device 125 as the first display unit, the control unit 113 (refer to FIG. 1 ) Figure 1) performs a first display control process to cause CID122 as a second display unit to display image C of driving switch notification information as a second image in a manner that does not overlap with the first image A, replacing the previously displayed image B.
[0144] In addition, when there are multiple display units capable of displaying image C of driving switch notification information within the range estimated to be the field of view of the occupant 5 (within the dotted ellipse), the overall control unit 104 of the control unit 113 can select a display unit suitable for displaying image C of driving switch notification information.
[0145] For example, in Figure 3 In the example of A-1, for example, the image C of the driving switching notification information can also be displayed on the meter display 124. However, the meter display 124 is separated from the first image A in the vertical direction when viewed from the occupant 5, but overlaps in the horizontal direction. Therefore, when the image C of the driving switching notification information is displayed on the meter display 124, the images overlap vertically, which can also be considered to bring a slightly complicated vision.
[0146] Therefore, in Figure 3 In the example of A-1 of FIG. 1 , the image C of the driving switching notification information is displayed on the CID 122 which does not overlap with the first image A in the vertical direction and the horizontal direction and is arranged near the occupant 5 .
[0147] However, this is just an example and the present invention is not limited to this example.
[0148] The image B displayed on the CID 122 as the second display unit is temporarily saved and stored in the memory 135 .
[0149] Then, as shown in A-3 and A-4, image A is replaced with image C. In other words, the control unit 113 controls the HUD device 125 as the first display unit to execute the second display control process so that the virtual image display surface PS1 displays image C of the driving switching notification information instead of the first image A.
[0150] In this way, when the driving state is switched, the image C of the driving switch notification information is not suddenly displayed to replace the first image A that the occupant 5 is watching, but the image C of the driving switch notification information is first displayed in a manner that does not overlap with the first image A, so that the occupant 5 can recognize the image C of the driving switch notification information in the periphery of the visual field while watching the first image A. Therefore, it is possible to notify, in other words, to forewarn, that the driving state needs to be switched without causing the occupant 5 to feel uncomfortable.
[0151] Thereafter, by shifting the image C of the driving switching notification information to the position where the first image A is displayed, for example, the detailed contents related to the driving switching, the switching timing, etc. can be reliably notified to the occupant 5 .
[0152] The first and second display control processes are performed before the end of the driving state switching period. In other words, in the case where the automatic driving state is switched to the manual driving state with the end of the automatic driving section, the notification based on the driving switching notification information only needs to be performed before the end of the driving state switching period, and it is also conceivable that there is a relatively long time before the end of the switching period.
[0153] In the automatic driving zone, for example, it is conceivable that entertainment images, map images, etc. are displayed at a position facing forward, in other words, at a position facing straight ahead, or in the vicinity thereof, and the occupant visually recognizes these images.
[0154] Such a display can be realized by, for example, using a projection display device such as a head-up display (HUD) 125 that projects an image onto a screen that covers a windshield or a portion of a windshield. In this case, the image of the driving switching notification information can also be displayed larger, for example, at a position substantially in front of the passenger when viewed from the passenger's position, and an easy-to-see display can be realized.
[0155] On the other hand, in addition to the HUD device 125, the vehicle 1 is often provided with a display device such as a central information display (CID) 122 that is built into the instrument panel 120 or vertically installed on the instrument panel 120. The CID 122 is often arranged near the passenger 5, and the passenger 5 can see the image displayed on the HUD 125 while understanding the image displayed on the CID 122 in the peripheral field of vision.
[0156] Therefore, the first type of display device of the projection type such as the HUD 125 that projects images is coordinated with the second type of display device of the screen display type such as the CID 122 that directly displays images on the screen, and first, the image C of the driving switching notification information is displayed on the screen display type display device 122. In this case, the occupant 5 can watch the first image A and notice that the image C of the driving switching notification information is displayed around his / her field of vision, and can indirectly understand that the driving state is about to be switched.
[0157] Afterwards, an image of the driving switch notification information is displayed through HUD125, etc., and image C of the driving switch notification information is displayed to replace the first image A. As a result, the occupant 5 can directly visually recognize the easy-to-see image of the driving switch notification information without looking away, and can reliably identify and confirm the content, timing, etc. of the driving switch.
[0158] In this way, by cooperatively controlling a plurality of display devices, in other words, a plurality of display units, it is possible to reduce the anxiety of the occupant 5 when the driving state is switched, and to allow the occupant 5 to recognize the switch of the driving state without feeling uncomfortable.
[0159] In addition, the first display unit 125 in the above description can also be referred to as a display unit at a position where the degree of deviation of the line of sight in the left-right direction is the smallest when viewed from the occupant 5. In addition, the second display unit 122 is located at a position where the degree of deviation of the line of sight in the left-right direction is greater than that of the first display unit 125, and is relatively close to the occupant 5 within the range of the field of vision (or field of vision) of the occupant 5 who views the image displayed on the first display unit 125, and can also be said to be a display unit where the occupant 5 can recognize the displayed image.
[0160] Next, a case where the first image A continues to be displayed even after the display is switched and a case where the first image A is not displayed will be described.
[0161] exist Figure 3 In A-3, the control unit 113 determines whether the image A being viewed by the passenger 5 is the prescribed continuation content Aa estimated to be the content that the passenger 5 wishes to continue viewing, the continuation setting content Ab pre-set as the content that the passenger 5 wishes to continue viewing, or other non-continuation content Ac.
[0162] In the case of the continuation content Aa or the continuation setting content Ab, as shown in A-4, image A is moved to the position of image C in parallel with image C being moved to the position of image A. In other words, images A and C are interchanged. Figure 3 In A-2 of FIG. 1 , the replacement is indicated by arrows pointing to each other. The above control performed by the control unit 113 is referred to as a third display control process.
[0163] The third display control process is performed in parallel with the second display control process, and as a result, the display of the first image A is exchanged with the image C of the driving switching notification information. The first image A continues to be displayed on the second display unit 122, so the occupant 5 can continue to view the first image A at an appropriate timing even after the display is switched.
[0164] Furthermore, since the first image A and the image C of the driving switching notification information are exchanged simultaneously and in parallel, it does not take time, does not cause visual discomfort to the occupants, and reduces the psychological burden.
[0165] In this way, when the driving state is switched, it is possible to recognize the switch of the driving state without a sense of incongruity, taking into account that it does not violate the expectations of the occupants.
[0166] In addition, if Figure 3 As shown on the right side of A-3 of FIG. 1 , when the first image is neither the specific continuation content Aa nor the continuation setting content Ab, in other words, when it is the non-continuation content Ac, for example, Figure 3 As shown in A-4 of FIG. 1 , the image B displayed in A-1 is displayed again on the second display unit 122. This display control performed by the control unit 113 is referred to as a fourth display control process.
[0167] Thereby, the passenger 5 can watch the image B whose display was interrupted due to the presentation of the driving switching notification information again. The passenger 5 can obtain useful information from the image B again, for example.
[0168] Next, refer to Figure 4 . Figure 4 FIG. 4 is a diagram showing an example of the fifth and sixth display control processes. Figure 4 In the drawings, the same reference numerals are used to indicate the parts that are common to the above-mentioned figures.
[0169] Figure 4 A-1, A-2 and Figure 3 The A-1 and A-2 are the same. Figure 4 In A-3 of FIG. 1 , when the first image A is a discontinued content, the control unit 113 causes the second display unit 122 to display the content selection image D.
[0170] Next, when the content selection image D is referred to within a predetermined period and the content to be displayed next is selected by, for example, operating the setting unit 133, the control unit 113 performs the following operation. Figure 4 As shown in A-3 of FIG. 1 , the second display unit 122 is caused to display the image F of the selected content. This display control is referred to as a fifth display control process.
[0171] Thus, the passenger 5 can select the content displayed on the second display unit 122. When the passenger 5 selects content within a predetermined period, for example, within the driving switching period (in other words, before the end of the automatic driving period), the selected content F is displayed on the second display unit 122. Therefore, the passenger 5 can view the content image he likes, and the convenience is improved.
[0172] In addition, if no content is selected within the specified period, Figure 4 As shown in A-4 of FIG. 1 , the control unit 113 may perform display control for maintaining the content selection image D even after a predetermined period of time. This display control is referred to as a sixth display control process.
[0173] Thus, even after the predetermined period has passed, the content selection image D on the second display unit 122 can be retained. Therefore, even after the predetermined period has passed, the occupant 5 can appropriately select the content displayed on the second display unit 122 when he has time, thereby improving convenience.
[0174] In addition, the operation method when selecting the predetermined content may be any of, for example, an operation using a button, a touch operation on the display panel, a voice operation using a sound, or an operation using a gesture.
[0175] Next, refer to Figure 5 . Figure 5 is a diagram showing an example of the seventh display control process. Figure 5 In the drawings, the same reference numerals are used to indicate the parts that are common to the above-mentioned figures.
[0176] exist Figure 5 In the example of FIG. 1 , in addition to the first and second display units 125 and 122, there is another display unit, in other words, a third display unit 123. The image D is displayed on the virtual image display surface PS2 by the WSD serving as the third display unit 123.
[0177] Here, during the first display control process of displaying the image C of the driving switching notification information on the screen of the second display unit 122 and the second display control process of displaying the image C on the virtual image display surface PS1 of the first display unit 125, a display control process of reducing the conspicuity of the display image of the other display unit, the third display unit 123, is implemented. This display control is referred to as the seventh display control process.
[0178] In the seventh display control process, for example, any one of the following processes may be implemented: reducing the conspicuity by lowering the brightness, saturation or brightness of the display, or reducing the conspicuity by setting a translucent shading sheet on the display image plane, or setting it to non-display, or displaying an auxiliary image indicating the switch of the driving status.
[0179] In other words, the following control may be implemented to focus the consciousness of the occupant 5 on the display portion showing changes: in addition to displaying the display portion showing changes, the brightness, chroma or lightness of the display is reduced to a specified value, a translucent black shading sheet is formed on the display screen, the display is cut off, and auxiliary images such as text, animation, etc. are displayed to indicate that the driving state is switching.
[0180] This allows the occupant 5 to concentrate on the content to be switched and displayed without distracting his / her awareness, thereby enabling reliable information presentation.
[0181] exist Figure 5 In A-2 of FIG. 1 , the brightness of the image D is sufficiently reduced, and the image D is in a state where it is difficult to visually recognize. Figure 5 A-3 or A-4. Figure 5 A-3 and A-4 are equivalent to the previously described Figure 3 The processing of A-4 and A-5 is omitted here.
[0182] Next, refer to Figure 6 . Figure 6 FIG. 1 is a diagram showing a display example in which a fade-out and fade-in method is used as a method of eliminating and appearing an image when switching displays. Figure 6 In the drawings, the same reference numerals are used for the same parts as those in the above-mentioned figures.
[0183] Figure 6The example shows that previously Figure 2 This is an example of a change in display mode in the process of exchanging the image C of the driving switching notification information with the first image A described in A-4 of FIG. Figure 6 In A-1 to A-4, a fade-out process is implemented to gradually eliminate the display images A and C of the first and second display units as time passes.
[0184] exist Figure 6 In A-5 to A-7 of FIG. 1 , a fade-in process is performed to gradually make the display images C and A of the first and second display units appear over time.
[0185] Next, refer to Figure 7 . Figure 7 This is a diagram showing a display example in the case where the emphasis display method is used as a method of eliminating and appearing an image when switching the display.
[0186] exist Figure 7 In the example of , emphasis display is performed. Emphasis display can be said to be a process of changing the conspicuousness by, for example, blinking the displayed image, changing the color, etc., temporarily changing the image size, or adding text, icons, etc.
[0187] Figure 7 The example shows that previously Figure 2 This is an example of a change in display mode in the process of exchanging the image C of the driving switching notification information with the first image A described in A-4.
[0188] exist Figure 7 In A-1 of FIG. 1 , the image C showing the driving switching notification information is displayed, and within the prescribed period immediately thereafter, as Figure 7 As in A-2 of FIG. 1 , an emphasis display process is performed on image C, such as repeatedly flashing the image C several times.
[0189] Then, in Figure 7 In A-3 of the present invention, the first image A is exchanged with the image C of the driving switching notification information. Within a predetermined period immediately after the exchange, both the image A and the image C are subjected to an emphasis display process. After the predetermined period has passed, if Figure 7 As in A-4 of FIG. 1 , the emphasized display is released and the normal display is returned.
[0190] Thus, when switching the image display, the control unit 113 can implement the switching operation in at least one of the first and second display units 125 and 122. Figure 3 The instantaneous image elimination and appearance processing as shown in A-4 of FIG. 1 may also be performed as shown in FIG. Figure 6 The elimination and appearance processing using fade-out and fade-in that changes the brightness over time may be implemented as in the example of Figure 7As an example, the elimination and appearance processing of the image during the display switching period is implemented with the emphasis processing performed due to the flickering of the image or the change of the display form as a method of eliminating the image and a method of appearing the image.
[0191] By devising a method for removing and appearing an image when switching the display, it is possible to improve the conspicuity, which helps, for example, to make the occupants focus on the display unit whose display is changing.
[0192] Next, refer to Figure 8 . Figure 8 : is a flowchart showing an example of display control accompanying a driving switching request.
[0193] The following describes the case where the automatic driving is switched to manual driving in a vehicle capable of automatic driving. Figure 8 In the embodiment of the present invention, steps S1 to S13 are implemented before completely switching from automatic driving to manual driving.
[0194] In step S1, the driving state monitoring unit 15 (see Figure 1 ) detects the state of the occupant 5. In step S2, the AI module 14 (refer to Figure 1 ) Read the driving plan. The driving plan is, for example, a plan for determining where to drive in the autonomous driving zone, and is determined in advance before starting driving in the autonomous driving zone.
[0195] In step S3, for example, the AI module 14 determines whether it is necessary to switch from the automatic driving to the manual driving. This determination can be performed, for example, by determining whether the driving road has reached a predetermined distance (for example, 10 km) from the point where the automatic driving section is switched to the manual driving section. The determination can also be made using time instead of distance.
[0196] However, this is an example and is not limited to this example. For example, there may be a case where the end of the automatic driving section is notified multiple times at intervals. In this case, there may also be a case where the driving switch notification information is issued at a time point much earlier than the end timing of the automatic driving section.
[0197] If the driving does not need to be switched, the process returns to steps S1 and S2 . If the driving needs to be switched, the process proceeds to step S4 .
[0198] In step S4, it is determined whether the state of the occupant is good. In other words, the occupant state determination unit 111 (see Figure 1 ) determines whether the state of the occupant 5 is in a state where it can receive information provided by a collection of multiple display units (display unit group).
[0199] For example, the image analysis unit 110 performs image analysis on the image captured by the image capturing camera 114. Based on the analysis result, the driving state monitoring unit 15 of the occupant state determination unit 111, for example, calculates the alertness and forward attention of the occupant 5. Based on the calculated multiple factors, for example, the driving state estimation unit 13 calculates the driving fitness of the occupant 5. When the calculated driving fitness reaches a predetermined threshold, in other words, when the answer is yes in step S4, the process proceeds to step S7. When it does not reach the predetermined threshold, in other words, when the answer is no in step S4, the process proceeds to step S5.
[0200] In step S5, it is determined whether there is not enough margin in the automatic driving section. Whether there is enough margin can be determined, for example, based on whether the distance to the end point of the automatic driving section is above a predetermined threshold. If there is enough margin, in other words, if the answer is no in step S5, the process returns to step S4. If there is not enough margin, in other words, if the answer is yes in step S5, the process transfers to step S6. In step S6, the driving assistance system (automatic driving system) 10 guides the vehicle 1 to a retreat place such as a service area or a parking area and stops it.
[0201] If the answer is yes in step S4, the process proceeds to step S7. In step S7, an image of a takeover request (TOR: a type of driving switching request) is displayed on, for example, the second display unit 122 as described above. This display is displayed to the occupant 5 in advance as a notice before switching the driving state, and can also be called a pre-display or a pre-notification display.
[0202] Furthermore, when an image is displayed on the second display unit 122, the image of TOR is displayed instead of the image on the second display unit 122. In other words, the first display control process is executed.
[0203] In step S8, it is determined whether it is the time to switch the content. More specifically, for example, it is determined whether the content has been switched to a location. The location is predetermined in consideration of the time that the occupants can fully prepare psychologically and physically for manual driving before reaching the end of the automatic driving section.
[0204] In addition, the point may be determined based on the distance (for example, 1 km) from the end point of the autonomous driving section in addition to the time (for example, 5 minutes) from the end point of the autonomous driving section.
[0205] If the content transfer point has not been reached, in other words, if the answer is No in step S8, the process returns to step S4. If the answer is Yes in step S8, the process proceeds to step S9.
[0206] Furthermore, when the loop of step S4 , step S7 , step S8 , and step S4 is repeated until the content transfer point is reached, the display of the image on the second display unit 122 can be maintained.
[0207] In step S9, it is determined whether the first image displayed on the first display unit 125 is specific continued content. This determination is performed, for example, by the overall control unit 104 of the control unit 113. Specific continued content may include predetermined entertainment content, bird's-eye view maps useful for vehicle operation, and the like.
[0208] If the answer is no in step S9, the process proceeds to step S10. In step S10, it is determined whether the first image displayed on the first display unit 125 is the continued setting content. If the answer is yes in step S10 and the answer is yes in step S9 described above, the second display control process of switching the image of TOR by transferring it to the first display unit 125 and the third display control process of switching the image by transferring the first image to the second display unit 122 are simultaneously and concurrently implemented.
[0209] On the other hand, if the answer is NO in step S10, the process proceeds to step S11. In step S11, only the second display control process is executed.
[0210] In step S13 , the driving state of the vehicle 1 is switched to manual driving.
[0211] Next, refer to Fig. 9 . Fig. 9 FIG. 4 is a flowchart showing another example of display control accompanying a driving switching request. Fig. 9 In the steps S1 to S8, Figure 8 The same, therefore the description is omitted.
[0212] In step S14, the second display control process of transferring the image of TOR to the first display unit 125 to switch the image and displaying the content selection image (content selection screen) on the second display unit 122 is performed. Displaying the content selection image corresponds to the first half of the fifth display control process.
[0213] In step S15, it is determined whether the occupant has selected a display content within a predetermined period of time. If the answer is yes in step S15, the process proceeds to step S16.
[0214] In step S16, the selected content is displayed, which corresponds to the second half of the fifth display control process.
[0215] In step S17, the driving is switched to manual driving.
[0216] If the answer is NO in step S15, the process proceeds to steps S18 and S19. In step S18, the process switches to automatic driving. In step S19, the display of the content selection image (content selection screen) is maintained. This corresponds to the first half of the sixth display control process.
[0217] After that, when the passenger selects content in step S20, the selected content is displayed in step S21. This corresponds to the second half of the sixth display control process.
[0218] Next, refer to Fig.10 . Fig.10 FIG. 1 is a diagram showing a specific example of display control in a vehicle traveling on a highway.
[0219] exist Fig.10 In A-1 of FIG. 1 , the vehicle 1 is traveling in the automatic driving mode on the road surface 6 of the expressway. On the windshield 2 , a bird's-eye view map (map information) MP is displayed by the HUD device 125 as the first display unit.
[0220] In addition, on the widescreen display 130 , for example, a remaining fuel display D1 and a vehicle speed display SP are displayed.
[0221] exist Fig.10 In A-2 of FIG. 1 , the end of the automatic driving section is notified to the occupant by a guidance voice such as “the automatic driving section will end in 3 minutes.” At the same time, an icon image G1 as driving switching notification information prompting the occupant to hold the steering wheel is displayed on the widescreen display 130 as the second display unit. This display control corresponds to the first display control process.
[0222] In this case, the remaining fuel display D1 is not displayed. This corresponds to the seventh display control process. However, the vehicle speed display SP is maintained.
[0223] exist Fig.10 In the A-3, the end of the automatic driving section is notified to the passengers through a guidance voice such as "The automatic driving section will end in 2 minutes."
[0224] At the same time, Fig.10 The position of the icon image G1 displayed in A-2 of FIG. 1 is moved to the right (toward the direction of the steering wheel). As a result, the icon image G1 can be easily grasped in the center of the passenger's field of vision. In addition, the vehicle speed display SP is displayed on the lower side of the bird's-eye view map MP through the HUD device 125. In other words, the vehicle speed display SP changes its display position from the widescreen display 130 to the virtual image display surface of the HUD device 125.
[0225] exist Fig.10 In the A-4, the occupants are urged to hold the steering wheel through a guiding voice such as "Please hold the steering wheel".
[0226] Furthermore, the second display control process is executed to transfer the icon image G1 to the position where the bird's-eye view map MP is displayed, and simultaneously, the third display control process is executed to transfer the bird's-eye view map MP to the position where the icon image G1 is displayed.
[0227] Here, the text "Please hold the steering wheel" is added to the icon image G1 after the transition, and the display form is changed, so that the timing of holding the steering wheel is further emphasized. Such transformation and application can be performed appropriately.
[0228] As described above, regarding the icon image G1, the moving Fig.10 The display position in A-2 of the display control unit is changed to the position where the bird's-eye view map MP is displayed, and then the second display control process is performed to transfer the display position to the position where the bird's-eye view map MP is displayed. In other words, during the second display control process, the icon image G1 as the driving switching notification information is subjected to a display movement process to move to the position where the bird's-eye view map MP is displayed as time passes. This can, for example, make the change in display content impressive to the occupant, and can provide more reliable information presentation.
[0229] In the above example, the display switching is performed after the display position of the driving switching notification information is moved in the display unit (widescreen display 130) having a horizontally long display screen, but the driving switching notification information may be moved by switching the display to be displayed. In addition, it is also possible to use a display (movable display) that can be moved in the left-right direction to move it. In addition, it is also possible to perform movement control using the in-vehicle projector 112.
[0230] exist Fig.10 In A-5 of FIG. 1 , an exit 904 and an exit guide 906 are visible on the left side in front of the vehicle 1 . In addition, an emphasis image J1 that emphasizes the exit 904 is displayed by the HUD device 125 , for example.
[0231] In addition, the vehicle is notified of the switch to manual driving through a guidance voice message such as "We are approaching the exit. We have switched from automatic driving to manual driving."
[0232] In addition, on the wide screen display 130, the brightness of the bird's-eye view map MP is reduced so that the occupant can concentrate on the driving operation for heading toward the exit 904. In addition, since the vehicle speed information is information necessary for the driving operation, the vehicle speed display SP is displayed again. Such display modification and application can be performed appropriately.
[0233] exist Fig.10In A-6 of FIG. 1 , a guidance display (road surface overlapping display) 907 to the exit is displayed. In addition, a guidance voice such as “Please follow the guidance display to the exit” is issued by the driving assistance system 10. On the widescreen display 130, the display of the bird's-eye view map MP and the vehicle speed display SP with reduced brightness is maintained.
[0234] As described above, according to the present invention, when the driving state is switched, it is possible to reduce the anxiety of the occupant or recognize the switch of the driving state without a sense of incongruity without violating the expectations of the occupant, taking into account.
[0235] The present invention can be modified and applied in various ways. For example, the driving switch notification information is not limited to the one illustrated in the above embodiment, and various display forms can be appropriately adopted.
[0236] In addition, in this specification, the term "vehicle" can also be interpreted in a broad sense as a means of transportation. In addition, terms related to navigation are also interpreted in a broad sense. In addition, the HUD device, display device, display unit, display system, etc. also include devices used as simulators (such as aircraft simulators, simulators for game devices, etc.).
[0237] The present invention is not limited to the above-described exemplary embodiments, and a person skilled in the art can easily modify the above-described exemplary embodiments within the scope of the claims.
[0238] Explanation of symbols
[0239] 1: Vehicle (this vehicle); 2: Windshield (projected component); 4: Steering wheel; 10: Driving assistance system (automatic driving system); 12: Information collection unit; 13: Driving state estimation unit; 14: AI module; 15: Driving state monitoring unit; 16: Speed control module; 18: Steering control module; 102: Display control device (processor); 104: Overall control unit; 105: Voice guidance unit; 107: Display control unit; 108: HUD and WSD control unit; 109: In-vehicle projector control unit; 110: Image analysis unit; 111: Passenger state determination unit; 112: In-vehicle projector; 114: Shooting camera; 120: Instrument panel; 125: HUD Device (first display unit); 121: center console monitor; 122: central information display (CID: second display unit); 123: direct projection display (WSD) that projects onto a windshield or a screen without passing through an optical system; 124: instrument display; 126 (126a, 126b): display mirror; 127 (127a; 127b): side monitor; 128: passenger display; 130: widescreen display; 133: setting unit; 135: memory; A: first image; C: driving switch notification information (image of driving switch notification information, second image); D: content selection image (content selection screen); F: image of selected content; PS: virtual image display surface.
Claims
1. A display control device, characterized in that: The display control device includes a control unit that controls image display on a plurality of display units mounted on the vehicle. The plurality of display units include a first display unit that displays a first image and a second display unit that displays a second image. When the driving switching notification information for notifying the occupant that the vehicle will switch from the first driving state to the second driving state is displayed while the occupant of the vehicle is viewing the first image displayed by the first display unit, The control unit performs the following processing: a first display control process of causing the second display unit to display the driving switch notification information as the second image so as not to overlap with the first image; as well as The second display control process then causes the first display unit to display the driving switch notification information instead of the first image.
2. The display control device according to claim 1, characterized in that: The first display unit is a projection type display device that projects display light of an image onto a screen provided so as to cover the windshield of the vehicle or at least a portion of the windshield. The second display unit is a display device that displays an image on a display screen. The control unit executes the first and second display control processes before a switching period of the driving state ends.
3. The display control device according to claim 1, characterized in that: If the first image is a predetermined continuation content estimated to be the content that the occupant wishes to continue viewing, or a continuation setting content that is preset as the content that the occupant wishes to continue viewing, The control unit executes a third display control process in parallel with the second display control process to display the first image as the second image on the second display unit.
4. The display control device according to claim 1, characterized in that: If the first image is not the predetermined continuation content that is estimated to be the content that the occupant wishes to continue viewing, and is not the continuation setting content that is preset as the content that the occupant wishes to continue viewing, The control unit performs a fourth display control process for causing the content displayed on the second display unit before the drive switching notification information is displayed to be displayed again on the second display unit.
5. The display control device according to claim 1, characterized in that: If the first image is not the predetermined continuation content that is estimated to be the content that the occupant wishes to continue viewing, and is not the continuation setting content that is preset as the content that the occupant wishes to continue viewing, The control unit executes a fifth display control process to cause the second display unit to display a content selection image, and when content is selected using the content selection image within a predetermined period, cause the second display unit to display the selected content.
6. The display control device according to claim 5, characterized in that: When the content is not selected within the specified period, The control unit executes a sixth display control process to maintain the content selection image even after the predetermined period.
7. The display control device according to claim 1, characterized in that: In the case where there are other display units besides the first and second display units, The control unit performs a seventh display control process, i.e., any one of the following processes, on the other display unit during the execution of the first and second display control processes: Reduce conspicuity by reducing the brightness, chroma or lightness of the display; or A semi-transparent shading sheet is provided on the display image surface to reduce the conspicuity; or Set to non-display; or Displays an auxiliary image indicating the switching driving status.
8. The display control device according to claim 1, characterized in that: The control unit performs any one of the following processes on at least one of the first and second display units as a method of eliminating an image and a method of appearing an image during a display switching period: Transient image removal and appearance processing; or Use fade-out and fade-in processing that causes brightness to vary over time; or This is accompanied by the removal and appearance of emphasis processing due to image flickering or changes in display form.
9. The display control device according to claim 1, characterized in that: The display unit is any one of a head-up display (HUD) device, an instrument display, a direct projection display that projects an image displayed on the display onto a windshield or a screen without passing through an optical system, a central information display (CID), a center console monitor, a widescreen display, a passenger display, a display mirror, and a side monitor, and an in-vehicle projector that projects an image in the vehicle.
10. The display control device according to claim 1, characterized in that: In the case where a display device has a plurality of display areas whose displays can be independently controlled, The control unit regards one display area as one display unit and executes the first and second display control processes.
11. The display control device according to claim 1, characterized in that: The control unit executes a display shift process in the second display control process to shift the drive switching notification information to the first display unit as time passes.
12. A display system, characterized in that: have: A plurality of display units mounted on the vehicle; and The control unit according to any one of claims 1 to 11.
13. A display control method for controlling image display on a plurality of display units mounted on a vehicle, wherein: The plurality of display units include a first display unit that displays a first image and a second display unit that displays a second image. The display control method is characterized by comprising the following steps: When the driving switching notification information for notifying the occupant that the vehicle will switch from the first driving state to the second driving state is displayed while the occupant of the vehicle is viewing the first image displayed by the first display unit, a step of executing a first display control process for causing the second display unit to display the driving switching notification information as the second image so as not to overlap with the first image; and A step of executing a second display control process, and then transferring the driving switch notification information to the first display unit, so that the driving switch notification information is displayed instead of the first image.
