Vehicle display control device, vehicle display control method, and vehicle display control program

Abstract

To provide a display control device for a vehicle capable of reducing discomfort of a user when an image is displayed along a travel lane for transmitting that there is a danger of lane deviation, and provide a display control method for a vehicle and a display control program for a vehicle.SOLUTION: A display control device for a vehicle 10 includes: a lane recognition unit 62 that recognizes a travel lane; and a display control unit 68 that displays one of a plurality of preset images along the travel lane so as to be overlapped in a scene in front of own vehicle when a travel position of the own vehicle approaches an edge of the travel lane.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a vehicle display control device, a vehicle display control method, and a vehicle display control program. [Background technology]

[0002] Patent Document 1 discloses a vehicle display device that displays a predetermined image in a display area showing the view in front of the vehicle. Patent Document 1 proposes that when it is determined that the vehicle is likely to deviate from its lane, an image of a three-dimensional object is displayed along the lane to notify the occupants of the risk of lane departure. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-175877 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when an image along the driving lane is displayed, if the image is different from the scenery ahead of the vehicle, the user may feel uncomfortable. Therefore, the above-mentioned prior art has room for improvement in this respect.

[0005] In consideration of the above facts, the present invention aims to provide a vehicle display control device, a vehicle display control method, and a vehicle display control program that can reduce the sense of discomfort felt by the user when displaying an image along the driving lane to notify the user of the risk of lane departure. [Means for solving the problem]

[0006] First Aspect The vehicle display control device according to the present invention comprises: an acquisition unit that acquires a running time;The system includes a lane recognition unit that recognizes the lane of travel, and a display control unit that displays one of a plurality of pre-set images along the lane of travel so as to be superimposed on the view ahead of the vehicle when the vehicle approaches the edge of the lane of travel. The display control unit displays an image selected from the plurality of images based on the time of travel acquired by the acquisition unit.

[0007] First Aspect According to the , images are displayed based on the time of the drive. This reduces the sense of discomfort felt by the user when an image is displayed along the driving lane to notify the user of the risk of lane departure.

[0014] No. 2 In a first aspect, the vehicle display control device according to the aspect has an image setting unit capable of setting the display size of the image, and the display control unit displays one of a plurality of pre-set images at the set image size.

[0015] No. 2 According to this aspect, when an image is displayed superimposed on the scenery ahead of the vehicle, the image size can be set to a display size that does not cause the user to feel uncomfortable, thereby reducing the user's sense of discomfort.

[0016] No. 3 The vehicle display control method according to the above aspect is a method in which a computer executes processing including acquiring the time while driving, recognizing the driving lane, and, when the driving position of the vehicle approaches the edge of the driving lane, displaying one of a plurality of pre-set images along the driving lane so as to be superimposed on the view ahead of the vehicle, and an image selected from the plurality of images based on the acquired driving time is displayed.

[0017] No. 4The vehicle display control program according to the embodiment is a vehicle display control program for causing a computer to execute processing including acquiring the time while driving, recognizing the driving lane, and, when the driving position of the vehicle approaches the edge of the driving lane, displaying one of a plurality of pre-set images along the driving lane so as to be superimposed on the scenery ahead of the vehicle, and displaying an image selected from the plurality of images based on the acquired driving time. [Effects of the Invention]

[0018] As described above, the vehicle display control device, vehicle display control method, and vehicle display control program of the present invention can reduce the sense of discomfort felt by the user when displaying an image along the driving lane to notify the user of the risk of lane departure. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a schematic diagram of a front part of a vehicle interior of a vehicle to which a vehicle display device according to an embodiment of the present invention is applied, viewed from the rear side of the vehicle. [Figure 2] 1 is a block diagram showing a hardware configuration of a vehicle display device according to an embodiment of the present invention; [Figure 3] 1 is a block diagram showing a functional configuration of a vehicle display device according to an embodiment of the present invention; [Figure 4] FIG. 10 is a diagram illustrating an example of a setting screen presented to a user. [Figure 5] FIG. 10 is a diagram showing an example of an image displayed along a driving lane. [Figure 6] 6 is a partial enlarged view showing an example of a display method for the image shown in FIG. 5. FIG. [Figure 7] 10 is a flowchart showing an example of the flow of a display process in the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0020] Hereinafter, a vehicle 12 to which a vehicle display device 10 according to an embodiment is applied will be described with reference to FIGS.

[0021] 1, an instrument panel 14 is provided in the front portion of the cabin of a vehicle 12. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, the vehicle is a right-hand drive vehicle in which the steering wheel 16 is provided on the right side, and a driver's seat 28 is located on the right side of the vehicle.

[0022] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 extends in the vertical direction and the width direction of the vehicle, and separates the interior of the vehicle from the exterior of the vehicle.

[0023] A head-up display display area 26 (hereinafter simply referred to as "display area 26") is provided on the windshield glass 18 in front of the driver's seat 28. The display area 26 is configured as a projection surface onto which an image is projected by a head-up display device 48 (see FIG. 2) serving as a vehicle display device. Specifically, the head-up display device 48 is provided on the vehicle front side of the instrument panel 14, and an image is projected from this head-up display device 48 onto the display area 26 of the windshield glass 18. In other words, the display area 26 is configured as a part of the windshield glass 18 that serves as the projection surface for the head-up display device 48.

[0024] Here, a vehicle 12 is provided with a vehicle display control device 10. The vehicle display control device 10 of this embodiment is configured with, for example, one or more ECUs (Electronic Control Units).

[0025] (Hardware configuration of the vehicle display control device 10) Fig. 2 is a block diagram showing the hardware configuration of the vehicular display control device 10. As shown in Fig. 2, the vehicular display control device 10 includes a CPU (Central Processing Unit: processor) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, a communication I / F (communication interface) 38, and an input / output I / F (input / output interface) 40. Each component is connected to each other via a bus 42 so as to be able to communicate with each other.

[0026] The CPU 30 is a central processing unit that executes various programs and controls each part. That is, the CPU 30 reads programs from the ROM 32 or storage 36 and executes the programs using the RAM 34 as a work area. The CPU 30 controls each of the above components and performs various arithmetic processing in accordance with the programs recorded in the ROM 32 or storage 36.

[0027] The ROM 32 stores various programs and various data. The RAM 34 temporarily stores programs or data as a working area. The storage 36 is configured with an HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs including the operating system and various data.

[0028] The communication I / F 38 is an interface for the vehicle display control device 10 to communicate with an external server and other devices, and may be, for example, a CAN (Controller Area Network), an Ethernet, or the like. Standards used include LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), and Wi-Fi (registered trademark).

[0029] The input / output I / F 40 is electrically connected to a head-up display device 48 and a driving system control unit 50 .

[0030] The head-up display device 48 displays predetermined information in the display area 26 of the windshield glass 18 .

[0031] The driving system control unit 50 is a control device that controls various driving systems mounted on the vehicle 12, and is configured with, for example, one or more ECUs (Electronic Control Units). The various driving systems include an automated driving system and a driving assistance system. The driving assistance systems include a stopping system and a starting system for avoiding contact between a detected object and the vehicle 12, as well as various ADAS (Advanced Driving Assistant Systems) such as an ACC (Adaptive Cruise Control) system, an LTA (Lane Tracing Assist) system, and an LCA (Lane Change Assist). The driving system control unit 50 controls various actuators mounted on the vehicle 12 to automatically perform some or all of the operations of the accelerator, brake, turn signal, steering, etc. of the vehicle 12, thereby operating the various driving systems.

[0032] (Functional configuration of the vehicle display control device 10) The vehicular display control device 10 uses the above hardware resources to realize various functions. The functional configuration realized by the vehicular display control device 10 will be described with reference to FIG.

[0033] 3, the vehicle display control device 10 includes, as functional components, an acquisition unit 60, a lane recognition unit 62, an image setting unit 64, an image generation unit 66, and a display control unit 68. Each functional component is realized by the CPU 30 reading and executing a program stored in the ROM 32 or the storage 36.

[0034] The acquisition unit 60 acquires information related to the control of the driving system based on a signal transmitted from the driving system control unit 50. In this embodiment, the acquisition unit 60 particularly acquires information related to the control of the LCA system in the vehicle 12. When the LCA system detects a risk of the vehicle 12 deviating from its driving lane, it assists the driver in steering the vehicle to maintain the lane. As an example, the vehicle display control device 10 performs a display process, which will be described later, in conjunction with the operation of the LCA system. That is, when a risk of the vehicle 12 deviating from its driving lane is detected, a predetermined image is displayed in the display area 26 of the windshield glass 18 to notify the user of the risk of lane departure.

[0035] The acquisition unit 60 also acquires road information about the lane the vehicle 12 is traveling in. This road information includes information about the road surface conditions of the lane, such as the color of the road surface and the type of dividing lines. This road information can be acquired in various ways. For example, the road information may be acquired based on images of the surroundings (front, rear, and sides) of the vehicle 12 captured by an onboard camera (not shown). Alternatively, for example, satellite photos, weather information, external map data, etc. may be acquired from an external server via the communication I / F 38, and the road information may be acquired based on this acquired data. Alternatively, for example, if high-precision map data is stored in the storage 36, the road information may be acquired based on the high-precision map data.

[0036] The acquisition unit 60 also acquires the time during travel and weather information for the current location of the vehicle 12. For example, this information may be acquired by identifying the current location of the vehicle 12 based on a signal from a GPS (Global Positioning System) sensor (not shown), and acquiring the time and weather information corresponding to the current location from an external server.

[0037] The lane recognition unit 62 recognizes the driving lane of the vehicle 12. Various publicly known methods can be used to recognize the driving lane. In one example of this embodiment, an in-vehicle camera (not shown) captures images of the surroundings (front, rear, and sides) of the vehicle 12, and based on the captured images, the driving lane is recognized from boundaries such as dividing lines, asphalt, grass, soil, and curbs.

[0038] The image setting unit 64 performs various settings for the image to be displayed in the display area 26. For example, the image setting unit 64 selects one of a plurality of images set in advance in accordance with the display mode set by the user, and sets the image to be displayed in the display area 26.

[0039] 4 shows an example of a setting screen 70 presented to the user when selecting a display mode. The setting screen 70 is displayed on a display unit (not shown) configured with a display or the like. Mode selection objects (70A to 70C) corresponding to a plurality of display modes are displayed on the setting screen. The user selects one of the mode selection objects by operating an operation unit (not shown), and the corresponding display mode is executed.

[0040] The favorite display mode as a display mode is a mode in which one image selected by the user from a plurality of images set in advance is displayed.

[0041] The road surface identification display mode is a display mode in which an image selected from a plurality of preset images is displayed based on road information acquired by the acquisition unit 60. In this road surface identification display mode, the road surface conditions, such as the color of the road surface and the type of lane markings, are determined, and an image that is expected to match the road surface conditions is selected.

[0042] Note that not deviating from the road surface conditions is a broad concept that includes both a state in which the display image is not so unrealistic that it makes the user feel uncomfortable, and a state in which the display image is not so difficult to distinguish from the road surface that it makes the user feel uncomfortable.

[0043] For example, if there are no markings on the road surface, an image that resembles the markings may be selected. Alternatively, if there are markings on the road surface, an image in a color different from the markings may be selected. Alternatively, depending on the color of the road surface, an image in a color that makes it easy to distinguish between the road surface and the displayed image may be selected. The image setting unit 64 may select an image based on a table that associates road surface conditions with images, for example.

[0044] The environment-identifying display mode displays an image selected from a plurality of preset images based on at least one of the time of day and weather information during travel. For example, an image that is expected to blend in well with the environment surrounding the vehicle 12 is selected, taking into consideration the time of day during travel and weather information for the current location of the vehicle 12.

[0045] Note that being in harmony with the environment around the vehicle 12 is a broad concept that includes both not being so unrealistic that the user feels uncomfortable, and not being so difficult to distinguish between the road surface and the displayed image that the user feels uncomfortable.

[0046] For example, the brightness around the vehicle may be determined depending on whether the vehicle is being driven during the day or at night, and an image with a color that makes it easy to distinguish between the road surface and the displayed image may be selected.Also, for example, an image with a design that harmonizes with the weather may be selected depending on weather information.

[0047] Furthermore, the image setting unit 64 sets the display size of the image. The image setting unit 64 can set the display size to a size previously set by the user, for example, by operating an operation unit (not shown). The image setting unit 64 may also set the image size according to at least one of road information, traveling time, and weather information.

[0048] The image generation unit 66 generates an image to be displayed in the display area 26 based on the information set by the image setting unit 64 .

[0049] The display control unit 68 displays the image generated by the image generation unit 66 in the display area 26 based on the control information of the driving system transmitted from the driving system control unit 50. For example, the image is displayed when the acquisition unit 60 acquires information indicating that the LCA system has been activated.

[0050] Here, the display control unit 68 controls the image generated by the image setting unit 64 to be displayed along the driving lane so as to be superimposed on the scenery ahead of the vehicle 12. That is, the image generated by the image generation unit 66 is an AR image. An AR image is an image rendered using Augmented Reality technology. That is, the scenery ahead of the vehicle 12 is visible in the display area 26 through the windshield glass 18, and the image is displayed superimposed on this scenery. The display control unit 68 transmits output data of the generated image to the head-up display device 48, and the transmitted output data is output by the head-up display device 48.

[0051] Here, with reference to FIGS. 5 and 6, an example of an image displayed along a driving lane will be described. As shown in these figures, when the driving position of the vehicle 12 approaches the edge of the driving lane (the left edge in FIG. 5), a plurality of images B are displayed along the driving lane 80 via the display area 26. In the illustrated example, the images B are block-shaped three-dimensional images. Furthermore, each image B is rendered as an animation moving from the back side of the display area 26 to the front side. This provides a user viewing the display area with the visual effect that the traveling vehicle 12 is running over an approaching three-dimensional object. Furthermore, in the animation of the images B, the images stop moving in front of the display area and are then displayed in a line along the driving lane 80. This provides a occupant in the driver's seat with the visual effect that rumble strips are formed along the white line L1 on the departure direction (left direction) of the vehicle 12.

[0052] Figure 6 shows an enlarged view of area P shown in Figure 5. As shown in this figure, the three-dimensional image B, which has stopped moving in front of the display area, is displayed as if it is vibrating up and down. This gives the occupant in the driver's seat who is viewing third display unit 26 a sense of realism, as if the vehicle 12 is vibrating when stepping on a three-dimensional object.

[0053] (Display processing operation) An example of the operation of the display processing executed by the vehicular display control device 10 will be described with reference to the flowchart shown in Fig. 7. This display processing is executed, for example, when the ignition switch of the vehicle 12 is turned on. The display processing is executed by the CPU 30 reading a program from the ROM 32 or storage 36 and expanding the program in the RAM 34.

[0054] As shown in FIG. 7, in step S10, the CPU 30 recognizes the lane in which the vehicle 12 is traveling by using the function of the lane recognition unit 62.

[0055] In step S11, the CPU 30 determines whether or not there is a risk of the vehicle 12 deviating from its lane. Specifically, the CPU 30 determines whether or not driving assistance by the LCA system has been activated as a result of the vehicle 12's driving position approaching the edge of the driving lane. If the LCA system of the vehicle 12 is activated, the determination in step S11 is affirmative, and the CPU 30 proceeds to processing in step S12. On the other hand, if the LCA system of the vehicle 12 is not activated, the determination in step S111 is negative, and the CPU 30 proceeds to processing in step S13.

[0056] In step S12, CPU 30 causes image generation unit 66 and display control unit 68 to display an image in display area 26. As shown in Fig. 5, to the user, image B appears to be displayed along driving lane 80 as seen through display area 26. This allows the user to recognize that there is a risk of the vehicle running off course.

[0057] In step S13, the CPU 30 determines whether or not driving of the vehicle has ended. Specifically, for example, it determines whether or not the ignition switch of the vehicle 12 has been turned off. If the ignition switch has been turned off, the determination in step S13 is affirmative, and the CPU 30 ends the display process. On the other hand, if the ignition switch has not been turned off, the determination in step S13 is negative, and the CPU 30 returns to the process of step S10.

[0058] (Action and effect) As described above, the vehicular display control device 10 according to this embodiment can display image B corresponding to the view ahead of the vehicle 12 (host vehicle) from among a plurality of images, as shown in Fig. 5. This reduces the sense of discomfort felt by the user when an image is displayed along the driving lane to notify the user of the risk of lane departure.

[0059] Furthermore, in this embodiment, the favorites display mode is set to display the image set by the user, thereby reducing the sense of discomfort felt by the user.

[0060] Furthermore, in this embodiment, by setting the road surface discrimination display mode, an image according to road information is displayed, thereby reducing the sense of discomfort felt by the user.

[0061] Furthermore, in this embodiment, by setting the environment identification display mode, an image based on the time and weather information during driving is displayed, thereby reducing the sense of discomfort felt by the user.

[0062] In addition, in this embodiment, when an image is displayed superimposed on the scenery ahead of the vehicle 12, the image size can be set to a display size that does not cause the user to feel uncomfortable, thereby reducing the user's sense of discomfort.

[0063] Although the vehicular display control device 10 according to the embodiment has been described above, it is needless to say that it can be embodied in various forms without departing from the spirit of the present invention. For example, in the above embodiment, the user selects a display mode, and an image is selected according to the selected display mode. However, the image may be displayed in one display mode pre-installed in the vehicle. Alternatively, the image may be displayed in a combination of multiple display modes.

[0064] Furthermore, in the above embodiment, an example has been described in which an image is displayed in the display area 26 of the head-up display device 48, but the present invention is not limited to this. For example, the present invention may be applied to a case in which an image is displayed on a display or the like provided on an instrument panel. In this case, an image along the driving lane is displayed so as to be superimposed on an image captured in front of the vehicle 12. The display area may also be a display of an external device. For example, it may be a display of an operating device operated by an operator performing remote driving. Therefore, the user in the above embodiment may be a passenger in the vehicle or an operator in a remote location.

[0065] Furthermore, the processing performed by the CPU 30 after reading the program in the above embodiment may be performed by various processors other than the CPU 30. Examples of such processors include programmable logic devices (PLDs) such as field-programmable gate arrays (FPGAs), whose circuit configuration can be changed after manufacture, and dedicated electrical circuits such as application-specific integrated circuits (ASICs), which are processors with circuit configurations specifically designed to perform specific processing. The virtual item display processing may be performed by one of these various processors, or by a combination of two or more processors of the same or different types, such as multiple FPGAs or a combination of a CPU and an FPGA. The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0066] Furthermore, in the above embodiment, various data is stored in the storage 36, but this is not limiting. For example, a non-transitory recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a USB (Universal Serial Bus) memory may be used as the storage unit. In this case, various programs, data, etc. are stored in these recording media. [Explanation of symbols]

[0067] 10. Vehicle display control device 12 Vehicle (own vehicle) 62 Lane recognition unit 68 Display control unit 80 driving lanes B Image

Claims

1. an acquisition unit that acquires a running time; a lane recognition unit that recognizes a driving lane; a display control unit that, when the vehicle approaches the edge of a lane, displays one of a plurality of preset images along the lane so as to be superimposed on a view ahead of the vehicle; and and The display control unit displays an image selected from the plurality of images based on the driving time acquired by the acquisition unit.

2. An image setting unit capable of setting the display size of the image, The vehicle display control device according to claim 1 , wherein the display control unit displays one of a plurality of preset images in a preset image size.

3. Acquire the time while driving and recognize the driving lane, When the vehicle approaches the edge of the lane, one of a plurality of preset images is displayed along the lane so as to be superimposed on the view ahead of the vehicle. A vehicle display control method in which a computer executes a process including: A vehicle display control method for displaying an image selected from the plurality of images based on the acquired driving time.

4. Acquire the time while driving and recognize the driving lane, A display control program for a vehicle that causes a computer to execute a process including: when the driving position of the vehicle approaches an edge of a driving lane, displaying one of a plurality of preset images along the driving lane so as to be superimposed on a view ahead of the vehicle, A display control program for a vehicle that displays an image selected from the plurality of images based on the acquired driving time.

Images