Vehicle display system, vehicle display method, and vehicle display program

Abstract

This vehicle display system displays content on a plurality of displays (2a) provided so as to have non-display regions interposed between display screens. An occupant state monitor (22a) is provided for detecting the head position and angle of an occupant in a vehicle and the line of sight of the occupant. A display processing unit (13) performs, on the basis of a detection result of the occupant state monitor (22a), hiding prevention processing on important information on the condition that said important information is included in content to be displayed on the displays (2a), and displays said content on one of the display screens of the plurality of displays.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Japanese Application No. 2021-073381 filed on April 23, 2021, the contents of which are incorporated herein by reference. [Technical field]

[0002] The present disclosure relates to a vehicle display system, a vehicle display method, and a vehicle display program. [Background technology]

[0003] Conventionally, cockpit systems have installed multiple displays, such as a meter display, a center display, and a head-up display, on an instrument panel to display various information, such as meter images, multimedia images, and driving support information. In recent years, there has been a demand for larger displays to be installed in vehicles, and multiple medium-sized displays are often installed side by side. This is because they can be constructed more inexpensively than installing a single large display. Up until now, technologies have been provided for constructing a cockpit system with multiple displays installed side by side in a vehicle.

[0004] In a display system using multiple displays, there are non-display areas at the edges of each display that cannot be displayed. For this reason, when a single image or video is displayed, the non-display areas can cause a sense of incongruity. Conventionally, when displaying content across multiple displays, a technology has been provided that takes the non-display areas into consideration, displays the content without distorting the display dimensions, and maintains continuity by adjusting the display position of the content according to the position and line of sight of the passenger. However, with this technology, important content may not be displayed depending on the display position of the content and the relative positional relationship between the display position and the passenger.

[0005] Patent Document 1 is provided as a technology related to the present application. Patent Document 1 discloses a technology in which a display effect determination unit continuously displays toward a target coordinate, and determines a direction corresponding to the actual position of the information processing device in GUI movement between information processing devices across screens. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2009-288839 A Summary of the Invention

[0007] The present disclosure aims to provide a vehicle display system, a vehicle display method, and a vehicle display program that are capable of accurately displaying information to occupants while maintaining continuity of content between the display screens of multiple displays as much as possible.

[0008] One aspect of the present disclosure is a device for displaying content on a plurality of displays arranged on either side of a non-display area, and includes an occupant status monitor for detecting the head position and angle of a vehicle occupant and the line of sight of the occupant, and a display processing unit for performing a process to prevent important information from being hidden and displaying the important information on one of the display screens of the plurality of displays on the condition that important information is included in the content to be displayed on the displays based on the detection result of the occupant status monitor. When the amount of movement of the occupant's viewpoint is greater than a predetermined amount based on the detection result of the occupant state monitor, important information displayed on one display cannot be confirmed by the occupant, and the information is displayed on another display.

[0009] According to one aspect of the present disclosure, a determination is made as to whether important information is included in content, and the important information is displayed on one of the display screens of the multiple displays after processing to prevent it from being hidden. This makes it possible to accurately display information to occupants while maintaining the continuity of content between the display screens of the multiple displays as much as possible. [Brief description of the drawings]

[0010] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: [Figure 1A] FIG. 1A is an external configuration diagram of a cockpit system in a first embodiment; [Figure 1B] FIG. 1B is a diagram showing the configuration and control image of a PtoP display; [Figure 1C] FIG. 1C is a second diagram showing the configuration and control image of a PtoP display; [Diagram 2] FIG. 2 is a block diagram illustrating a vehicle display system; [Diagram 3] FIG. 3 is a block diagram showing the hardware and software. [Figure 4] FIG. 4 is a flowchart showing the outline of the processing contents. [Diagram 5] Figure 5 shows an example of a screen displayed on multiple displays. [Figure 6] Figure 6 is the first diagram showing the relationship between the virtual space and the real space that is rendered according to the application's requirements. [Figure 7] Figure 7 is the second diagram showing the relationship between virtual space and real space. [Figure 8] Figure 8 is the third diagram showing the relationship between virtual space and real space. [Figure 9] Figure 9 shows the second example of a screen displayed on multiple displays. [Figure 10] Figure 10 is the fourth diagram showing the relationship between virtual space and real space. [Figure 11] Figure 11 is the fifth diagram showing the relationship between virtual space and real space. [Figure 12] Figure 12 shows the third example of a screen displayed on multiple displays. [Figure 13] FIG. 13 is a sixth diagram showing the relationship between the virtual space and the real space in the second embodiment; [Figure 14] Figure 14 is the fourth example of a screen displayed on multiple displays. [Figure 15] Figure 15 is the seventh diagram showing the relationship between virtual space and real space. [Figure 16] Figure 16 is the fifth example of a screen to be displayed on multiple displays. [Figure 17] Figure 17 is the eighth figure showing the relationship between virtual space and real space. [Figure 18] Figure 18 is the ninth diagram showing the relationship between virtual space and real space. [Figure 19] Figure 19 is the sixth example of a screen to be displayed on multiple displays. [Figure 20] Figure 20 is the 10th diagram showing the relationship between virtual space and real space. [Figure 21] Figure 21 is the seventh example of a screen to be displayed on multiple displays. [Figure 22] FIG. 22 is an eighth example of a screen displayed on a plurality of displays in the third embodiment. [Diagram 23] Figure 23 is the ninth example of a screen to be displayed on multiple displays. [Figure 24] FIG. 24 is a first diagram for explaining a positional relationship between a non-display area and an external object in the fourth embodiment; [Diagram 25] FIG. 25 is a second diagram for explaining the positional relationship between the non-display area and an external object; [Figure 26] FIG. 26 is a third diagram for explaining the positional relationship between the non-display area and an external object; [Figure 27] FIG. 27 is a fourth diagram for explaining the positional relationship between the non-display area and an external object; [Figure 28] FIG. 28 is a fifth diagram for explaining the positional relationship between the non-display area and an external object; [Figure 29] FIG. 29 is a block diagram showing an outline of the hardware and software in the modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, several embodiments of the vehicular display system 1 will be described with reference to the drawings. Note that the same reference numerals will be used to denote substantially common parts in the respective embodiments.

[0012] (First embodiment) The first embodiment will be described with reference to Fig. 1A to Fig. 12. As shown in Fig. 1A and Fig. 1B, a vehicle display system 1 is composed of a cockpit system 4 having a plurality of displays such as a pillar-to-pillar display 2 and a center display 3. However, the number, arrangement, and configuration of the displays are merely examples and are not limited to these. Hereinafter, the pillar-to-pillar display 2 will be referred to as a PtoP display 2.

[0013] 1A and 1B, the PtoP display 2 is configured with multiple displays 2a arranged side by side to form a landscape shape. Each display 2a of the PtoP display 2 is a large display that is configured with a liquid crystal display or an organic EL display, etc., and is provided on the dashboard between the left and right pillars of the vehicle. The PtoP display 2 is configured to be able to display various image contents such as meter images, images captured by the peripheral camera 23, entertainment images such as still images and videos, and map images of the current location in full graphic display.

[0014] The center display 3 is configured, for example, with a liquid crystal display or an organic EL display, and is installed between the driver's seat and the passenger seat and below the PtoP display 2, as shown in Fig. 1A. The center display 3 is installed near the center console where it is easily visible to both the driver and the passenger in the passenger seat, and is capable of displaying various contents. An operation panel 21 is configured above the center display 3, and allows the selection of contents to be displayed on the PtoP display 2, and input operations for operating the air conditioning, audio, and navigation functions.

[0015] The PtoP display 2 is installed vertically alongside the center display 3. Installing two screens vertically alongside each other increases the display area that the occupants can view at one time. In the cockpit system 4, the display screen of each display 2a of the PtoP display 2 is installed so as to be positioned further back than the display screen of the center display 3. Each display 2a of the PtoP display 2 has a black band-like frame 2b on its outer edge. The frame 2b is provided to surround the display screen and therefore serves as a non-display area.

[0016] As shown in Figs. 1B and 2, many ECUs 5 are configured in the vehicle and connected to an in-vehicle network 25. The ECUs 5 include a display system ECU, a surroundings monitoring system ECU, a driving control system ECU, and a DCM that communicates with the outside of the vehicle. DCM stands for Data Communication Module. The driving control system ECUs are well-known vehicle control ECUs, engine control ECUs, motor control ECUs, brake control ECUs, steering control ECUs, and integrated control ECUs. The driving control system ECUs include an autonomous driving ECU. The autonomous driving ECU is an Autonomous Driving Electric Control Unit.

[0017] When the autonomous driving ECU receives an automatic control signal, it drives the driving actuator to execute a corresponding level of driving assistance or autonomous driving. For example, in level I driving assistance, the vehicle can execute automatic braking to avoid collisions with obstacles, following the preceding vehicle, or lane prevention driving to prevent the vehicle from going out of the lanes on either side. In level II autonomous driving, the vehicle can execute a combination of level I driving assistance, or autonomous driving under specific conditions, such as automatically overtaking slower vehicles on a highway or automatically merging onto a highway. In level II autonomous driving, the driver is required to monitor the autonomous driving. In level III or higher autonomous driving, the system executes all driving tasks while monitoring the vehicle.

[0018] Each ECU 5 is mainly composed of a microcomputer equipped with various storage units 6 such as a processor, a cache memory, a RAM, and a ROM, an I / O, and a bus connecting these. Each ECU 5 is connected to other ECUs 5 provided in the vehicle so as to be able to communicate with them via a communication control unit 7 and an in-vehicle network 25.

[0019] In this embodiment, as shown in FIG. 1B, a plurality of display-related ECUs 5 constitute an HCU as an information processing device 10. The display-related ECUs 5 share the processing power of their internal physical resources to perform display processing on the displays 2, 3, etc., and, for example, as shown in FIG. 1C, each ECU 5 performs display processing individually for each display 2a of the PtoP display 2. HCU stands for Human Machine Interface Control Unit. Although the in-vehicle network 25 is shown to be connected between the plurality of display-related ECUs 5, they may be connected by a dedicated line. The storage unit 6 described above is a non-transient substantial storage medium that non-temporarily stores computer-readable programs and data. The non-transient substantial storage medium is realized by a semiconductor memory or the like.

[0020] 2, the information processing device 10 includes a control device 11, a calculation device 12, a storage unit 6, a display processing unit 13, a sound processing unit 14, an I / O control unit 15 that manages inputs and outputs from various devices, a communication control unit 7 that manages communications with other ECUs 5, and a wireless control unit 16 that is configured by connecting an antenna 16a and enables wireless connection with other mobile terminals 27 via wireless LAN or Bluetooth (registered trademark). Here, a form in which output signals from main components such as a position detector 19, an operation panel 21, an occupant monitor 22, a surrounding camera 23, and a distance detection sensor 24 shown in FIG. 2 are input to the information processing device 10 through the I / O control unit 15 will be described, but they may also be input from other ECUs 5 such as an ECU for a surrounding monitoring system and an ECU for a driving control system through an in-vehicle network 25.

[0021] The wireless control unit 16 is communicatively linked with a mobile terminal 27 carried by a vehicle occupant. The information processing device 10 waits for an incoming call to the mobile terminal 27, and when the mobile terminal 27 receives an incoming call from the other party and the call is answered, a hands-free call can be performed between the mobile terminal 27 and the other party via the speaker 18 and the microphone 17. The information processing device 10 can also recognize voice input through the microphone 17.

[0022] The arithmetic unit 12, under the control of the control unit 11, calculates the display area to be displayed on the display screens of the displays 2 and 3 for the content of images, sentences, characters, or symbols (hereinafter referred to as images, etc.) stored in the storage unit 6, calculates in which area of ​​the display screens of the displays 2 and 3 the content of images, etc. is to be displayed, and on which area the content of images, etc. is to be superimposed and displayed in a 2D layer, and outputs the display area together with the content of images, etc. to the control unit 11. The symbol here is a general term for not only symbols in the original sense, but also content that represents signs such as traffic signs as icons, etc., and particularly refers to information other than images, sentences, and characters displayed on each of the displays 2 and 3 by the navigation function.

[0023] The display processing unit 13, under the control of the control device 11, processes and displays content such as images in the above-mentioned display areas on the display screens of the displays 2 and 3. This allows content such as images to be displayed in a superimposed manner for each display layer on the display screens of the displays 2 and 3.

[0024] Under the control of the control device 11, the voice processing unit 14 inputs a received voice input from the microphone 17 and outputs a transmitted voice from the speaker 18. When the voice processing unit 14 inputs text and character content from the control device 11, it converts it into voice and reads it out through the speaker 18.

[0025] The position detector 19 detects the position with high accuracy using a well-known GNSS receiver such as a GPS, not shown, and an inertial sensor such as an acceleration sensor or a gyro sensor. The position detector 19 outputs a position detection signal to the control device 11 through the I / O control unit 15. The position identification unit 11a of the control device 11 realizes a function as an ADAS locator that sequentially measures the current position of the vehicle with high accuracy based on map information input from a map data input device and the position detection signal of the position detector 19. ADAS is an abbreviation for Advanced Driver Assistance Systems. In this case, the vehicle position is represented by a coordinate system consisting of latitude and longitude, and in this coordinate system, for example, the X axis indicates longitude and the Y axis indicates latitude. Note that the positioning of the vehicle can be performed based on information on a travel distance obtained based on a sensing result by a vehicle speed sensor mounted on the vehicle, and various configurations can be adopted as long as the configuration can identify the position of the vehicle. The control device 11 can perform so-called navigation processing based on the current position of the vehicle.

[0026] The operation panel 21 is a predetermined display, for example a touch panel configured on the display 3, and when an operation input is made by an occupant, the I / O control unit 15 accepts the operation input and outputs it to the control device 11. The control device 11 executes control based on the operation signal of the operation panel 21.

[0027] The occupant monitor 22 detects the state or operation state of an occupant in the vehicle. The occupant monitor 22 is configured using, for example, a power switch, an occupant state monitor 22a, a turn switch, an automatic control switch, etc., and outputs various signals to the control device 11. The occupant monitor 22 may also include a steering sensor that detects whether the steering wheel is being gripped or steered by the driver, a seating sensor that detects whether the driver is seated in the seat, an accelerator pedal or brake pedal depression sensor, etc.

[0028] The power switch outputs a signal according to the operation when the user turns it on in the vehicle cabin to start the internal combustion engine or the electric motor. The occupant status monitor includes a camera that detects the state of the occupant in the D seat or P seat by capturing an image of the occupant with an image sensor and outputs an image signal. The occupant status monitor 22a for the driver is called DSM. DSM is an abbreviation for Driver Status Monitor. The occupant status monitor 22a acquires an image signal captured by irradiating the driver's head with near-infrared light, performs image analysis as necessary, and outputs the image to the control device 11. The occupant status monitor 22a is used to detect the state of the occupant such as the driver, particularly during driving assistance or automatic driving. The turn switch outputs a turn signal to turn right or left according to the operation when the occupant turns it on in the vehicle cabin to activate the direction indicator of the vehicle.

[0029] The automatic control switch outputs an automatic control signal corresponding to an operation when the automatic control switch is turned on by an occupant in the vehicle cabin in order to command automatic control of the vehicle's driving state. The control device 11 can determine the behavior of the vehicle occupant, for example, the direction in which the line of sight is facing, based on the signal from the occupant monitor 22, and can also input the operation state of the power switch, the operating state of the turn signal, command information for automatic control of the vehicle, etc.

[0030] The peripheral cameras 23 constitute peripheral monitoring sensors such as a front camera that images the area in front of the vehicle, a rear camera that images the area behind the vehicle, a corner camera that images the front and rear parts of the vehicle, or a side camera that images the side of the vehicle, and an electronic mirror, and these are output to the control device 11 via the I / O control unit 15 as respective image signals for the front guide monitor, back guide monitor, corner view monitor, side guide monitor, and electronic mirror, and stored in the memory unit 6.

[0031] The vehicle is also provided with a distance detection sensor 24 as a perimeter monitoring sensor for detecting the distance to an obstacle. The distance detection sensor 24 is composed of a clearance sonar, LiDAR, millimeter wave radar, etc., and can detect vehicles, people, animals, objects fallen on the road, guard rails, curbs, trees, etc. that are close to the front, front side, rear side, rear or side of the vehicle. It can also detect the direction to the obstacle and the distance to the obstacle. The above-mentioned perimeter monitoring sensor can also detect road markings such as lane markings, stop lines, pedestrian crossings, signs such as "Stop" written on the road, and stop lines displayed at the boundaries of intersections that are provided on the roads around the vehicle.

[0032] 3 shows an example of the hardware and software configuration of the information processing device 10. Each ECU 5, 5a is equipped with an SoC 30, 31, respectively, and the above-mentioned microcomputer is built into the equipped SoC 30, 31. The microcomputer built into the SoC 30, 31 of the ECU 5 is configured so that a plurality of various applications 33 (hereinafter abbreviated as apps 33) run on a pre-installed general-purpose OS 32, for example, Linux OS (Linux is a registered trademark). SoC is an abbreviation for System On Chip.

[0033] The applications 33 include an image processing application 34 and other applications. In response to a drawing request from the image processing application 34, a processor built into the SoC 30 performs drawing processing on the display screen of each display 2a of the PtoP display 2.

[0034] On the other hand, ECU 5a is provided for meter drawing purposes and is therefore denoted by reference numeral 5a. A real-time OS 35 capable of processing with higher real-time performance than the general-purpose OS 32 is embedded in the microcomputer built into SoC 31 of ECU 5a, and is configured to run a meter application 36 on the real-time OS 35. Please note that the following description may focus mainly on applications 33 such as image processing application 34 and meter application 36.

[0035] The meter application 36 notifies the user of the vehicle speed, RPM, warnings, etc. and draws image content to be displayed in a specific display area of ​​the PtoP display 2. For example, the meter application 36 draws image content such as a speedometer, a tachometer, a shift range position, or a warning light. The speedometer includes a speed image that needs to be updated in real time to show changes in the vehicle speed. Similarly, the tachometer is also included in the meter image because it needs to be updated in real time to show changes in the number of rotations.

[0036] Furthermore, the content drawn by the meter application 36 can also be displayed on another display, here the center display 3. The content drawn by the meter application 36 requires relatively higher real-time performance than the content drawn by other applications.

[0037] The applications 33 include a navigation application, etc. The navigation application realizes the above-mentioned navigation function, and mainly displays image contents such as a navigation screen including a map, the current position of the vehicle, etc. on the PtoP display 2 or the center display 3.

[0038] The applications 33 also include an image synthesis application. The image synthesis application is an application that specifies the size and type of various image contents to be displayed on the display device, synthesizes the images of the image contents within one frame, and outputs this synthesized mixed image to the PtoP display 2 and the center display 3. The image synthesis application realizes the function of an image synthesis unit, also called a compositor, and the function of an image output unit.

[0039] A display layer for drawing the image content is assigned to each of the applications 33 and 36 that draw image content. These display layers are allocated in the storage unit 6 in a size that allows the necessary image content to be drawn.

[0040] Furthermore, the image contents displayed on the PtoP display 2 and the center display 3 can be animated. Here, animation refers to a display mode in which the position or size of an image showing the content gradually changes, the image rotates, the user interface moves as a whole in response to a swipe operation, the image gradually fades in or out, or the color of the image changes.

[0041] 2 executes various processes based on the detection results of the occupant monitor 22, particularly the occupant status monitor 22a, when executing various processes by executing various applications 33, 36 stored in the storage unit 6. The display processing unit 13 changes the display position of image content to be displayed on the displays 2 and 3, or changes the image content, based on the detection results of the occupant status monitor 22a.

[0042] The display processing unit 13 executes the application 33 to display an image A, such as a real image or a virtual image, in a virtual space K1 defined by virtual coordinates, and displays the image A in 2D or 3D representation two-dimensionally or three-dimensionally on the display screen of the PtoP display 2, thereby allowing the occupant to see the image A. At this time, the PtoP display 2, including its display screen and the frame 2b surrounding the display screen, appears to be located between the virtual space K1 and the real space K2 in which the vehicle occupant exists.

[0043] The effects and operations of the above configuration will be described with reference to Figures 4 and onwards. The information processing device 10 causes the PtoP display 2, the center display 3, etc. to display various contents using the display processing unit 13, and at this time may cause each display 2a of the PtoP display 2 to process and display a single piece of content, or may cause the center display 3 to process and display a single piece of content. Furthermore, the information processing device 10 may cause the display processing unit 13 to display content such as a single image across the display screens of multiple displays 2a.

[0044] When the information processing device 10 displays a single content across the display screens of the multiple displays 2a, the vehicle occupants can see a black frame 2b between the multiple displays 2a. In this case, continuous images or text cannot be displayed, resulting in a broken display, and the continuity of the display cannot be maintained. Therefore, the information processing device 10 may execute the process shown in FIG. 4 to display the content hidden by the frame 2b on one of the displays 2a for the occupants to see.

[0045] The control device 11 detects the head position and angle of the vehicle occupant and the line of sight using the occupant state monitor 22a in S1 of Fig. 4. At this time, the occupant state monitor 22a stores an image signal of an image of the body of the occupant, such as the driver, in the storage unit 6 through the I / O control unit 15. The calculation device 12 detects the position of the head part of the body and also the positions of facial parts such as the eyes in the captured image by performing image analysis of the captured image, and detects the head position and angle of the occupant and the direction of the line of sight. The technology for image analysis of the head position and angle of the occupant and the direction of the line of sight may be incorporated into the occupant state monitor 22a.

[0046] Following or in parallel with S1, the arithmetic device 12 calculates in S2 the coordinates of the display area in which the content is to be displayed on the displays 2 and 3. Here, it calculates which coordinate plane or coordinate space in the virtual space K1 shown in Fig. 6 the content is to be displayed on. When the arithmetic device 12 passes the results of calculating the coordinates to be displayed on the multiple displays 2a to the control device 11, the control device 11 determines in S3 whether the content can be viewed by the occupant, for example the driver, based on the head position and angle thereof, and the line of sight direction of the occupant calculated in S1, and the areas to be displayed on the multiple displays 2a calculated in S2.

[0047] If the control device 11 determines that all of the content can be seen by the occupants, it determines NO in S3, and the display processing unit 13 generates an image of the content as is in S4. Then, the display processing unit 13 divides the output image to be displayed on each of the multiple displays 2a in S5 to generate multiple images, and outputs the images to each of the multiple displays 2a in S6. This allows the multiple displays 2a to display the corresponding content. For example, when different content such as a map display screen, an image captured by the peripheral camera 23, and an entertainment image is to be displayed on each display 2a, the processing is performed in the order of S3 → S4 → S5 → S6.

[0048] The control device 11 determines whether or not the system should continue by determining whether or not it is necessary to determine whether or not it is necessary to change the display position of the content using the occupant state monitor 22a in S7. If it is necessary, the control device 11 continues the system and returns the process to S1 to repeat the process.

[0049] Conversely, when it is determined in S3 that the content is not visible to the occupant, the control device 11 determines YES in S3 and determines in S8 whether the content is important information J. In particular, when it is determined that the content is not visible to the occupant, this is mainly the case when continuous content is displayed across multiple displays 2a.

[0050] As will be described later, when the driver parks in a parking space Sp located behind the vehicle, the display processing unit 13 may display an image captured by the rear guide camera across multiple displays 2a so that the driver can check the rear of the vehicle at a wide angle. In this case, the control device 11 determines whether the content determined to be important information J is hidden by the frame 2b when viewed by the occupant, thereby determining whether the conditions S3 and S8 are satisfied.

[0051] When the control device 11 determines that the content is not important information J, it determines NO in S8 and repeats the processes of S4 to S7. That is, if the content is not important information J, the display processing unit 13 displays the content as it is in the display areas of the displays 2 and 3.

[0052] Conversely, if the content is important information J, the display processing unit 13 performs a process to prevent hiding in S9, divides the image content to be displayed on each of the multiple displays 2a to generate multiple images, and outputs the multiple images to each display 2a in S6. This allows the important information J to be displayed on one of the multiple displays 2a. Thereafter, the control device 11 repeats the process from S1 through S7 as necessary.

[0053] A detailed description will be given below with examples. Fig. 5 shows an example in which a driver parks his / her vehicle inside an arbitrary parking space Sp while checking the frame line W marked in the public parking lot and the fence H behind his / her vehicle. The hatched area in Fig. 5 indicates an area determined by the control device 11 as important information J in S8 of Fig. 4. The display processing unit 13 extracts an image of a partial area Ra on the center side from the image of the area R of the entire content stored in the storage unit 6, and calculates the coordinates of the virtual space K1 in which the content is to be displayed in S2 of Fig. 4. The display processing unit 13 then divides the image of the extracted area Ra and displays it on each display 2a of the PtoP display 2.

[0054] The PtoP display 2 is located between a virtual space K1 and a real space K2 where a vehicle occupant exists. The control device 11 determines the head position and line of sight of the occupant using the occupant state monitor 22a by the computing device 12, and determines that the parking space Sp surrounded by the frame line W is important information J by recognizing the frame line W surrounding the parking space Sp in the image of the area Ra.

[0055] If the control device 11 determines in S3 and S8 that the important information J can be displayed on only one display 2a and is not hidden by the frame 2b when the important information J is viewed by the occupant, the control device 11 determines NO in S8 of Fig. 4. The display processing unit 13 generates image content so as to project the coordinates of the virtual space K1 onto the display screen of each display 2a in S4 of Fig. 4, and divides the image and outputs multiple images to each display 2a in S5.

[0056] As shown in FIG. 6, in the virtual space K1 defined by virtual coordinates, the display processing unit 13 displays the captured image of the back guide camera by the image A of 2D representation by expressing the captured image of the extracted area Ra on the plane coordinates parallel to the actual display screen of the PtoP display 2, i.e., on the coordinates on the plane parallel to the XZ plane in FIG. 6. Here, an example of projecting the image A in a plane as a 2D representation is shown, but this is not limited to this. As shown in FIG. 7 as an image diagram of the XY plane in the virtual space K1, for example, a three-dimensional image Aa expressed in 3D may be projected in the virtual space K1 by stereoscopically synthesizing the captured information using multiple cameras and using a polygon drawing technique. This allows the occupant to confirm the image A of 2D representation or the image Aa of 3D representation. As described above, the important information J is displayed on one display 2a without being divided and displayed by the frame 2b, making it easier for the occupant to confirm the important information J.

[0057] A case where the driver then tilts his head to the left to check the display 2a will be described with reference to Fig. 8 and subsequent figures. The control device 11 detects the movement of the head position, the change in the angle of the head position, and the movement of the occupant's line of sight using the occupant state monitor 22a. When the control device 11 determines in S3 and S8 of Fig. 4 that the content that is important information J is not visible to the occupant based on the detection information of the occupant state monitor 22a, it generates image content that has been subjected to an anti-obscuration process in S9 of Fig. 4.

[0058] Specifically, the display processing unit 13 performs coordinate conversion on the above-mentioned reference image A in the virtual space K1, and draws it while tilting it in the virtual space K1 as shown in FIG. 8. As shown in FIG. 8 and FIG. 9, the display processing unit 13 can display the drawn image A2 in accordance with the driver's line of sight by, for example, drawing the image A2 after the coordinate conversion so that the relationship between the driver's line of sight and the image A2 after the coordinate conversion is perpendicular in the virtual space K1. In this way, the display processing unit 13 can display important information J on one display 2a by drawing the image content in 3D, and the important information J can be easily seen by the passenger. Although an example of drawing the 2D image A in 3D has been shown, as shown in FIG. 10, the same effect can be obtained for the image Aa in 3D representation by polygons by tilting it in the virtual space K1 and drawing the image Aa2 in 3D.

[0059] Moreover, the important information J may be drawn as follows. When the occupant tilts his / her head to the left to check the display 2a, the control device 11 may perform the obscuration prevention process in S9 of FIG. 4, and may display the image content of the region Ra by shifting it to the right and reducing it vertically and horizontally at the same magnification as shown in FIG. 11 and FIG. 12 using the image content of a new region Rb. At this time, even if the display processing unit 13 draws the image A2 of the image content of the region Rb on the same XZ plane as the image A in the virtual space K1, the important information J can be displayed on one display 2a as shown in FIG. 12. Even when the occupant shifts the head position to look into the display, the control device 11 can perform the obscuration prevention process to display the important information J on one display 2a, so that the occupant can check the content near the boundary of the frame 2b.

[0060] The important information J may be vehicle content related to keywords such as safety and security. The important information J may be vehicle content extracted by image recognition of a partial area related to vehicle control among the image content displayed on the multiple displays 2a of the PtoP display 2, such as obstacles such as fences H that require collision avoidance, other vehicles such as automobiles and bicycles moving outside the vehicle, pedestrians that similarly require collision avoidance, and vehicle targets such as the above-mentioned frame lines W. Such partial areas are areas that have a relatively high level of importance among the entire image content, and therefore may be positioned as important information J. In particular, the important information J may be changed according to various vehicle control information that is input and changes from time to time. The important information J may be information displayed in a specific part of the back guide monitor, front guide monitor, corner view monitor, and side guide monitor.

[0061] According to this embodiment, by using the head position and angle of the occupant detected by the occupant status monitor 22a and the 3D coordinates of the virtual space K1 set for the image content, the relative position between the head position of the occupant and the display 2a displaying the image content can be defined, and it can be determined whether the occupant is looking at the image content. As a result, it is possible to realize the appearance and disappearance of each image content according to the head position and angle of the occupant.

[0062] In the conventional technology, important information J displayed across multiple displays 2a had to be partially hidden in a regular manner. However, in this embodiment, even if important information J is present near the boundary of the frame 2b, the passenger can certainly see it. This allows the passenger to feel a sense of unity of the image content. In this embodiment, multiple displays 2a arranged consecutively in the horizontal direction are illustrated as an example, but the present invention can also be applied to other physical arrangements, such as between displays 2a and 3 linked in the vertical direction.

[0063] Although the case where the occupant moves his / her head position to the left and right has been exemplified, the present invention is not limited to this, and can also accommodate cases where the occupant shifts his / her head position forward, backward, or up and down. For example, when the occupant moves forward and backward, when this movement is detected by the occupant state monitor 22a, the display processing unit 13 can change the display state of the image content according to the movement of the occupant's head position by enlarging or reducing the image drawn in the virtual space K1 or adjusting the coordinate position of the image drawn in the virtual space K1. This can provide the same effect as described above.

[0064] Second embodiment The second embodiment will be described with reference to Fig. 13 to Fig. 21. The information processing device 10 executes a navigation application to display a navigation map screen G2 on the PtoP display 2, and executes a navigation function by successively updating a current position mark M1 and a destination mark M2 on the map screen G2. At this time, the PtoP display 2 can display the map screen G2 on a large horizontal screen, making it easy for the passenger to check the map.

[0065] However, as shown in FIG. 13, even if the display processing unit 13 displays an image A3 of the map screen G2 at a default coordinate position in the virtual space K1 and the map screen G2 is displayed across multiple displays 2a as shown in FIG. 14, if the current position mark M1 is hidden by the frame 2b and the occupant cannot see it, it is difficult for the occupant to instantly determine where on the map screen G2 the current position of the vehicle is.

[0066] Therefore, the information processing device 10 may classify information such as the current position mark M1, the destination mark M2, and a branch guide display to the destination as important information J, and may continue to display such information on any one of the displays 2a in the PtoP display 2. In the above example, the display processing unit 13 moves the coordinate position of the image A3 on the map screen G2 in the virtual space K1 based on the detection information that detects the head position and line of sight of the occupant so that the current position mark M1 is moved to a position where the occupant can reliably see it. In the example shown in FIG. 15, the image A3 is moved parallel to the X-axis direction. See the image A4 after the movement. The occupant can confirm the current position mark M1 by looking at the image A4 in the virtual space K1.

[0067] Furthermore, the control device 11 can detect that the content including the important information J has been confirmed by the occupant based on the detection result of the occupant monitor 22 and the display state on the display 2a by the display processing unit 13. After this, it is desirable for the display processing unit 13 to maintain or change the display position of the content so that the occupant can continue to view the content including the important information J.

[0068] That is, after the control device 11 detects that the occupant has viewed the content including the important information J, the display position of the important information J is changed and controlled by combining the head position of the occupant with the display position of the important information J so that the important information J continues to be in the field of view of the occupant without being blocked by the frame 2b. This allows the occupant to continue viewing the content including the important information J as long as the occupant continues to view the display 2a. This does not apply when the occupant status monitor 22a detects that the occupant has taken his / her gaze off the display 2a. Furthermore, when the control device 11 detects that the occupant has taken his / her gaze off the display 2a for a momentary predetermined time (e.g., a few tenths of a second) but then turned his / her gaze back to the same display 2a, the control device 11 may exceptionally allow the occupant to continue viewing the content including the important information J.

[0069] For example, as shown in Fig. 15, when the control device 11 detects that the current position mark M1 has been seen by the occupant, and then, when the occupant state monitor 22a detects that the occupant's head position has moved as shown in the upper diagram of Fig. 17, the display processing unit 13 may move the display coordinates of the image A4 so that the occupant can continue to see the current position mark M1. Furthermore, when the occupant state monitor 22a detects that the occupant's head position has returned to its original position, the display processing unit 13 sets the display position on the display 2a by maintaining or changing the coordinates of the image A4 in the virtual space K1 based on the occupant's head position as shown in the lower diagram of Fig. 17. This allows the occupant to continue to see the current position mark M1, which is important information J.

[0070] In addition, when the display processing unit 13 detects that the amount of movement of the occupant's viewpoint is greater than a predetermined amount based on the detection results of the occupant status monitor 22a, and important information J cannot be confirmed by the occupant even if it is displayed on one display 2a, it is desirable to display it on, for example, another adjacent display 2a.

[0071] The upper diagram of Fig. 18 shows a virtual space K1, and when the occupant's head position moves to the left, the amount of movement is greater than a predetermined amount, and the control device 11 determines that the occupant will not be able to confirm the current position mark M1 if it is displayed on the right display 2a in Fig. 18, the display processing unit 13 may move the image A3 of the display position of the map screen G2 in the virtual space K1 to an image A5, thereby displaying it on the left display 2a as shown in Fig. 19. This allows the occupant to confirm the current position mark M1, which is important information J, even if the occupant's head position moves significantly.

[0072] Even if the occupant state monitor 22a detects that the head position of the occupant has returned to the original position, the display processor 13 sets the display position on the display 2a by maintaining or changing the coordinates of the image A5 in the virtual space K1 based on the head position of the occupant. This allows the occupant to continue checking the current position mark M1, which is important information J.

[0073] Similarly, in the second embodiment, the display processing unit 13 may render the image in 3D in the virtual space K1. That is, the display processing unit 13 may perform coordinate conversion on the above-mentioned reference image A3 in the virtual space K1 and render the image inclined in the virtual space K1 as shown in FIG. 20. As shown in specific examples in FIG. 20 and FIG. 21, the display processing unit 13 can represent the rendering surface in accordance with the driver's line of sight by rendering the image A6 after the coordinate conversion so that the relationship between the driver's line of sight and the image A6 after the coordinate conversion is perpendicular in the virtual space K1. In this way, the display processing unit 13 renders the image content in 3D, so that the important information J can be displayed on one display 2a, making it easier for the driver to see the important information J.

[0074] According to this embodiment, in the case of the map screen G2 related to navigation, the coordinate position of the virtual space K1 is maintained or changed based on whether the part being watched is the current position mark M1, which is important information J. This embodiment also provides the same effects as the above-mentioned embodiment.

[0075] Third embodiment The third embodiment will be described with reference to Fig. 22 and Fig. 23. As shown in Fig. 22 or 23, the same technique as in the above-described embodiment may be applied when the display processing unit 13 displays the meter image G3 on the display 2a.

[0076] The meter image G3 displays the actual speed M2, the target speed M3 during driving assistance or automatic driving, the blinking turn direction of the turn signal M4, the remaining fuel level M5, warnings M6, the shift range position status M7, and the following status of the preceding vehicle M8 when using the driving assistance function by following driving.

[0077] When displaying these image contents M2 to M8 on the display 2a, the display processing unit 13 changes the coordinates to be drawn in the virtual space K1 based on the detection results of the occupant status monitor 22a, thereby displaying the image contents M2 to M8 on the display 2a so that the occupant can continue to view all of the image contents M2 to M8.

[0078] For example, as shown in Fig. 22, the display processing unit 13 displays the actual speed M2 "57km / h" in a position close to the frame 2b, and also displays the turn direction M4 of the turn indicator, but in this case, it is better to display the actual speed M2 and the turn direction M4 on either the left or right display 2a. The same is true for the target speed M3, the remaining fuel amount M5, warnings M6, the shift range position status M7, and the following status of the preceding vehicle M8. This embodiment also has the same effects as the previous embodiment.

[0079] (Fourth embodiment) The fourth embodiment will be described with reference to Fig. 24 to Fig. 28. In this embodiment, a specific external object B1 is detected from the content by a feature detection unit including a peripheral camera 23 that captures the outside of the vehicle or a distance detection sensor 24 that detects the distance to an obstacle, and the display processing unit 13 performs display processing of the external object B1 in accordance with the frame B2. The specific external object B1 may be set arbitrarily and appropriately, but it is preferable to set it to an external obstacle B2 that constitutes a blind spot of the line of sight. Examples of the external obstacle B2 include a utility pole B3, a high-rise building B4, and a vehicle parked on the road, as shown in Fig. 24, and other arbitrary external objects B1 may be other buildings B5, manholes B6 (see Fig. 25), and the like.

[0080] In such a case, it is further desirable that the display processing unit 13 transforms the content based on the detection results of the occupant status monitor 22a so as to superimpose the outside object B1 on the frame 2b in accordance with the movement of the line of sight of the vehicle occupant, and processes the content for display on the multiple displays 2a.

[0081] An example of a display image in normal times is shown in Fig. 24. When displaying and processing the content using a 2D representation image, the display processing unit 13 detects the movement of the occupant's line of sight using the occupant state monitor 22a, and performs display processing by moving the display area on a two-dimensional plane, here the XZ plane, so that the utility pole B3, which is an external obstacle B2, is superimposed on the extension line n of the frame 2b in accordance with the movement of the occupant's line of sight.

[0082] Furthermore, as the vehicle travels, the captured image of the peripheral camera 23 changes, and the content that the display processing unit 13 processes for display also changes from time to time. In such a case, it is desirable that the display processing unit 13 shrinks (or enlarges) the image of the content, as shown in the display image of FIG. 25, or deforms the content by rotating it around the position of the frame 2b or distorting the image, as shown in the display image of FIG. 26, and performs display processing by matching the external object B1 to the frame 2b when viewed from the passenger's viewpoint. By displaying the content that does not need to be viewed by the passenger on the frame 2b that exists between the multiple displays 2a, the display processing unit 13 can utilize the non-display area of ​​the frame 2b and perform display processing that does not look unnatural even as a two-dimensional display.

[0083] In addition, for example, when multiple cameras such as an ADAS stereo camera are used as the peripheral camera 23 to acquire information about the vehicle's surroundings and image information, it is desirable for the display processing unit 13 to acquire images of areas that are in the blind spot of the vehicle occupants in the direction of travel of the vehicle from the information about the vehicle's surroundings, and display the acquired image content on at least one of the multiple displays 2a.

[0084] The peripheral camera 23 captures images using multiple cameras, and can synthesize captured images accompanying the vehicle's travel, and can obtain images with as few blind spots as possible by using well-known technologies such as AI processing. Therefore, the display processing unit 13 can display, as content, pedestrians and bicycles hidden behind obstacles B2 outside the vehicle, such as utility poles B3, high-rise buildings B4, and parked vehicles on the road, and can alert the occupants.

[0085] As illustrated in FIG. 27, this is applied to a PtoP display 2 in which a frame 2b exists between multiple adjacent displays 2a-2a, 2a-2a, and a case will be described in which multiple external obstacles B2, such as utility poles B3, are detected as external objects B1 in the content of the image captured by the peripheral camera 23 while the vehicle is traveling.

[0086] In such a case, it is preferable that the display processing unit 13 changes the scale of the content, for example, enlarges it, so as to display the plurality of utility poles B3 in accordance with the corresponding frames 2b, as illustrated in Fig. 28. In this example, an example of enlarging is illustrated, but it may be reduced.

[0087] In addition, for example, in such a case, in addition to the utility pole B3, an external object B1 such as a high-rise building B4, a building B5, or a manhole B6 may be detected as shown in Fig. 27. In such a case, it is preferable that the information processing device 10 detects the direction and distance to the obstacle close to the vehicle using the distance detection sensor 24, and based on these detection results, the display processing unit 13 performs display processing of the external object B1 located closer to the vehicle by matching it to the frame 2b. In the example of Fig. 27, the external object B1 closest to the vehicle is detected as the utility pole B3, so the display processing unit 13 performs display processing of the utility pole B3 by matching it to the frame 2b.

[0088] Then, the display processing unit 13 can perform display processing without narrowing the angle of view more than necessary, and can perform display processing without causing discomfort to the vehicle occupants. In the example of Fig. 28, an example is shown in which the frame 2b is aligned with the utility pole B3, but when the utility pole B3 moves out of the image captured by the peripheral camera 23 as the vehicle moves forward, it is preferable to perform display processing by aligning the frame 2b with a high-rise building B4 or another building B5. According to such an embodiment, display processing can be performed without causing discomfort to the occupants.

[0089] (Other embodiments) The present disclosure is not limited to the above-described embodiment, but can be implemented in various modified forms, and can be applied to various embodiments without departing from the spirit of the present disclosure. In the first embodiment, as shown in specific examples in Figures 8 and 9, the image is drawn at an angle in the virtual space K1. However, the display processing unit 13 does not have to orthogonally intersect the driver's line of sight with the image A2 after coordinate transformation, for example, in the virtual space K1. As shown in specific examples in Figures 20 and 21 in the second embodiment, for example, the drawing surface is expressed to be aligned with the driver's line of sight by drawing the driver's line of sight and the image A6 after coordinate transformation in the virtual space K1 so that the relationship between them is perpendicular, but the relationship between the driver's line of sight and the image A6 after coordinate transformation does not have to be perpendicular.

[0090] In the above embodiment, the display system ECU 5 is configured by a plurality of ECUs 5, but the display system ECU 5 may be configured as an HCU by one ECU 5. An example of the hardware and software configuration in this case is shown in FIG. 29. Each ECU 5 is equipped with an SoC 230, and a microcomputer is built into the equipped SoC 230. The microcomputer built into the SoC 230 of the ECU 5 is configured with a general-purpose OS 32 and a real-time OS 35 on a hypervisor 231. A plurality of various applications 33 are configured to run on the general-purpose OS 32. The real-time OS 35 can process with higher real-time performance than the general-purpose OS 32. The meter application 36 is configured to run on the real-time OS 35. Even when such a configuration is adopted, the same configuration, action, and effect as those of the above embodiment are achieved.

[0091] In the drawing, 2 indicates a PtoP display, 2a indicates a display, 2b indicates a frame (non-display area), 13 indicates a display processing unit, and 22a indicates an occupant state monitor.

[0092] The control device 11 and the display processing unit 13 described in the present disclosure may be realized by a dedicated computer provided by configuring a processor and a memory programmed to execute one or more functions embodied in a computer program. Alternatively, the control device 11, the display processing unit 13, and the method described in the present disclosure may be realized by a dedicated computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control device 11, the display processing unit 13, and the method described in the present disclosure may be realized by one or more dedicated computers configured by combining a processor and a memory programmed to execute one or more functions and a processor configured with one or more hardware logic circuits. Also, the computer program may be stored in a computer-readable non-transitory tangible recording medium as instructions executed by a computer.

[0093] Although the present disclosure has been described based on the above-described embodiment, it is understood that the present disclosure is not limited to the embodiment or structure. The present disclosure also includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including one, more, or less than one element, are also within the scope and concept of the present disclosure.

Claims

1. A display system for a vehicle that displays content on a plurality of displays (2a) arranged on either side of a non-display area (2b), an occupant status monitor (22a) for detecting the head position and angle of a vehicle occupant and the line of sight of the occupant; a display processing unit (13) for performing a hidden prevention process on the important information and displaying the important information on one of the display screens of the plurality of displays on the condition that the important information is included in the content to be displayed on the display based on a detection result of the occupant state monitor, The display processing unit is a display system for a vehicle that, when the amount of movement of the occupant's viewpoint is greater than a predetermined amount based on the detection results of the occupant status monitor, displays the important information on one of the displays, but when the important information cannot be confirmed by the occupant, displays the important information on the other display.

2. A display system for a vehicle that displays content on a plurality of displays (2a) arranged on either side of a non-display area (2b), an occupant status monitor (22a) for detecting the head position and angle of a vehicle occupant and the line of sight of the occupant; a display processing unit (13) for performing a hidden prevention process on the important information and displaying the important information on one of the display screens of the plurality of displays on the condition that the important information is included in the content to be displayed on the display based on a detection result of the occupant state monitor, a feature detection unit (23) for detecting a specific external object seen by an occupant of the vehicle from the content; When the feature detection unit detects an external object, the display processing unit transforms the content based on the detection result of the occupant status monitor so as to superimpose the external object on the non-display area in accordance with the line of sight movement of the vehicle occupant, and processes the content for display on the multiple displays.

3. A vehicle display system as described in claim 2, wherein the display processing unit transforms the content by enlarging, reducing, rotating, or distorting an image of the content.

4. When the feature detection unit acquires information about the surroundings of the vehicle using multiple cameras, The vehicle display system according to claim 2 or 3, wherein the display processing unit acquires an image of an area that is in a blind spot for occupants of the vehicle in the direction of travel of the vehicle from information about the vehicle's surroundings and processes the image on the display.

5. When the non-display area is provided between each of the adjacent displays, when a plurality of external objects are detected in the content, The vehicle display system according to claim 2 , wherein the display processing unit processes the display of the plurality of external objects by changing a scale to fit each of the external objects to the non-display areas.

6. When a plurality of external objects are detected in the content, The vehicular display system according to claim 2 , wherein the display processing unit performs display processing for the external object located closer to the vehicle to match the non-display area.

7. The display processing unit is configured to represent an image in a virtual space defined by virtual coordinates and to project the image on the display screen of the display, 3. The vehicular display system according to claim 1, wherein the non-display area is configured by a frame positioned between the virtual space and a real space in which the occupant is present.

8. A vehicle display system as described in claim 1 or 2, wherein the important information is directed to vehicle content extracted by image recognition of a partial area related to vehicle control from the content displayed on the multiple displays.

9. A display system for a vehicle as described in claim 1 or 2, wherein the display processing unit, after detecting that the content has been viewed by the occupant based on the detection result of the occupant status monitor, performs the anti-obscuration processing by maintaining or changing the display position of the content so that the content can be continued to be viewed.

10. A vehicle display system as described in claim 7, wherein the display processing unit performs the anti-obscuration processing by moving the image parallel to the screen in the virtual space.

11. A vehicle display system as described in any one of claims 1 to 10, wherein the display processing unit displays the important information on any one of the multiple displays by rendering a 2D representation of an image in 3D.

12. A vehicle display system as described in any one of claims 1 to 11, wherein the display processing unit performs enlargement or reduction processing and displays it on any one of the multiple displays.

13. A display method for a vehicle, which displays content on a plurality of displays (2a) provided with non-display areas between display screens, comprising: A step of detecting the head position and angle of a vehicle occupant and the line of sight of the occupant by an occupant status monitor (22a); and a step of displaying the important information on any one of the display screens of the plurality of displays by a display processing unit (13) after performing a hidden prevention process on the important information on the condition that the important information is included in the content to be displayed on the display based on the detection result of the occupant state monitor, In the process of displaying on one of the display screens of the multiple displays, when the amount of movement of the occupant's viewpoint is greater than a predetermined amount based on the detection results of the occupant status monitor, the display processing unit displays the important information on one of the displays, but when the important information cannot be confirmed by the occupant, the display processing unit displays the important information on another of the displays.

14. A display method for a vehicle, which displays content on a plurality of displays (2a) provided with non-display areas between display screens, comprising: A step of detecting the head position and angle of a vehicle occupant and the line of sight of the occupant by an occupant status monitor (22a); and a step of displaying the important information on any one of the display screens of the plurality of displays by a display processing unit (13) after performing a hidden prevention process on the important information on the condition that the important information is included in the content to be displayed on the display based on the detection result of the occupant state monitor, a feature detection unit (23) for detecting a specific external object seen by an occupant of the vehicle from the content; When the feature detection unit detects the external object, In the process of displaying the content on any one of the display screens of the multiple displays, the display processing unit transforms the content based on the detection results of the occupant status monitor so as to superimpose the external object on the non-display area in accordance with the line of sight movement of the vehicle occupant, and processes the content for display on the multiple displays.

15. A display program for a vehicle that displays content on a plurality of displays (2a) provided with a non-display area between display screens, A procedure for detecting the head position and angle of a vehicle occupant and the line of sight of the occupant by an occupant state monitor (22a); a step of causing a display processing unit (13) to perform a process to prevent obscuration of the important information and display the important information on any one of the display screens of the plurality of displays on the condition that the important information is included in the content to be displayed on the display based on the detection result of the occupant state monitor; In the procedure of displaying on one of the display screens of the multiple displays, when the amount of movement of the occupant's viewpoint is greater than a predetermined amount based on the detection results of the occupant status monitor, the display processing unit displays the important information on one of the displays, but when the important information cannot be confirmed by the occupant, the display processing unit displays the important information on another of the displays.

16. A display program for a vehicle that displays content on a plurality of displays (2a) provided with a non-display area between display screens, A procedure for detecting the head position and angle of a vehicle occupant and the line of sight of the occupant by an occupant state monitor (22a); a step of causing a display processing unit (13) to perform a process to prevent obscuration of the important information and display the important information on any one of the display screens of the plurality of displays, on the condition that important information is included in the content to be displayed on the display based on the detection result of the occupant state monitor; a feature detection unit (23) for detecting a specific external object seen by an occupant of the vehicle from the content; The display processing unit, when the external object is detected by the feature detection unit, transforms the content based on the detection result of the occupant status monitor so as to superimpose the external object on the non-display area in accordance with the line of sight movement of the vehicle occupant, and processes the content on the multiple displays.

Images