Information processing apparatus, vehicle, and information processing method

Abstract

The present invention relates to an information processing apparatus. The apparatus includes an information acquisition unit that acquires travel information related to travel of a vehicle that includes a vehicle-mounted instrument panel, and a display mode changing unit that changes a display mode of the vehicle-mounted instrument panel in accordance with a change in the travel information.

Description

Technical Field

[0001] This invention relates to information processing devices, vehicles, and information processing methods. Background Technology

[0002] Patent document 1 discloses a vehicle instrument that improves design by moving the pointer of an indicator on the vehicle instrument panel from the minimum scale position to the maximum scale position and then back to the minimum scale position when the push-button switch is turned off.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2004-177146 Summary of the Invention

[0006] The problem the invention aims to solve

[0007] However, this existing technology does not take into account the improved visual legibility of the vehicle's instrument panel while the vehicle is in motion. Therefore, for example, if the driver's line of sight towards the speedometer on the instrument panel is obstructed by the steering wheel, which is positioned closer to the speedometer than the vehicle itself, while the vehicle is in motion, the driver needs to move their head to adjust their gaze. Therefore, there is room for improvement in the existing technology regarding the visual legibility of the vehicle's instrument panel.

[0008] Non-limiting embodiments of the present invention are used to provide an information processing apparatus, vehicle, and information processing method that can improve the visual legibility of an in-vehicle instrument panel.

[0009] Solution to the problem

[0010] An information processing apparatus according to one embodiment of the present invention includes: an information acquisition unit that acquires driving information related to the driving of a vehicle equipped with an instrument panel; and a display mode changing unit that changes the display mode of the instrument panel according to changes in the driving information.

[0011] One embodiment of the present invention provides a vehicle equipped with the aforementioned information processing device.

[0012] An embodiment of the information processing method of the present invention includes: a step of acquiring driving information related to the driving of a vehicle equipped with an in-vehicle instrument panel; a step of determining, based on the driving information, whether it is necessary to change the display form of the in-vehicle instrument panel; and a step of changing the display form of the in-vehicle instrument panel if it is necessary to change the display form of the in-vehicle instrument panel.

[0013] Invention Effects

[0014] According to one embodiment of the present invention, an information processing device, a vehicle, and an information processing method can be constructed that can improve the visual recognizability of an in-vehicle instrument panel.

[0015] Further advantages and effects of one embodiment of the present invention will be illustrated by the description and drawings. These advantages and / or effects are provided by the various embodiments and the features described in the description and drawings, but not necessarily all of them need to be provided in order to obtain one or more of the same features. Attached Figure Description

[0016] Figure 1 This is a diagram illustrating a structural example of a vehicle equipped with an information processing device according to an embodiment of the present invention.

[0017] Figure 2 This is a diagram illustrating an example of the hardware structure of an ECU.

[0018] Figure 3 This is a diagram illustrating the structure of an information processing device.

[0019] Figure 4 It is a flowchart used to illustrate the operation of an information processing device.

[0020] Figure 5 This diagram illustrates a situation where the driver's view of the speedometer is obstructed by the steering wheel, which is positioned further forward than the instrument panel.

[0021] Figure 6 This diagram shows the state where the view towards the second speed zone of the speedometer is obstructed by the steering wheel.

[0022] Figure 7 This diagram illustrates an example of moving the second speed zone to a position easily observed by the driver.

[0023] Figure 8 This is a diagram illustrating an example of rotating the speedometer counterclockwise by a certain angle.

[0024] Figure 9 This is a diagram illustrating an example of a display where the speedometer is moved downwards towards the bottom of the vehicle's instrument panel.

[0025] Figure 10 This is an example of a graph showing the speed limit displayed on a speedometer.

[0026] Figure 11 This is a diagram showing a variation of the image representing the speed limit displayed in the speedometer.

[0027] Figure 12 This is a diagram illustrating an example of how the speedometer display changes in response to changes in the vehicle's surrounding environment.

[0028] Figure 13 It is a graph showing the actual vehicle speed displayed during autonomous driving and the envisioned vehicle speed when switching from autonomous driving to manual driving. Detailed Implementation

[0029] Hereinafter, suitable embodiments of the present invention will be described in detail with reference to the accompanying drawings. Furthermore, in this specification and the accompanying drawings, constituent elements having substantially the same function are given the same reference numerals, thus omitting repeated descriptions.

[0030] (Implementation Method)

[0031] Figure 1 This diagram illustrates a structural example of a vehicle equipped with an information processing device according to an embodiment of the present invention. The vehicle 100 is, for example, a passenger car, a truck, or a bus. The vehicle's onboard equipment 1 includes an ECU (Electronic Control Unit) 11, a GPS (Global Positioning System) module 12, an ACC (Accessory) switch 13, sensors 14, a camera unit 15, and a display unit 16. These devices are connected to a CAN (Controller Area Network) 17, which serves as the vehicle's network, and are communicatively connected to the ECU 11. In addition to these, the onboard equipment 1 may also include, for example, a car navigation system, audio equipment, an inverter, a motor, and auxiliary equipment.

[0032] ECU11 is an electronic control unit that collects vehicle information from GPS module 12, ACC switch 13, sensor 14, camera unit 15, etc., and performs various control processes related to the functions specified in vehicle 100. Examples include motor ECU, hybrid ECU, engine ECU, etc. Vehicle information includes vehicle location information, speed information, vehicle status information, camera information, etc. Vehicle location information indicates the current location of vehicle 100, such as the latitude and longitude of the vehicle 100. Vehicle location information is transmitted, for example, from GPS module 12, car navigation device, etc. Speed ​​information indicates the current speed of vehicle 100 transmitted from the vehicle speed sensor. Vehicle status information includes, for example, signals indicating whether ACC switch 13 is on or off. Vehicle status information may also include the operation status of wipers, the status of defroster, throttle opening, brake pedal pressure, steering wheel input, and information obtained from ADAS (Advanced Driver-Assistance Systems). ADAS is a system designed to improve road traffic convenience and assist drivers in their driving operations. Camera information refers to information representing the content of the image captured by camera unit 15. The camera information includes time information, which indicates the time when the image was generated.

[0033] GPS module 12 receives GPS signals sent from satellites, locates the position of vehicle 100 equipped with GPS module 12, and inputs the vehicle position information as the positioning result to ECU 11 via CAN 17.

[0034] The ACC switch 13 is a switch that turns the accessory power of the vehicle 100 on / off according to the operation of the occupant. For example, the ACC switch 13 turns the accessory power on / off according to the operation of a power switch located on the dashboard near the steering wheel in the driver's seat inside the passenger compartment. The power switch is, for example, a push-button switch for operating an ignition device (not shown). The output signal of the ACC switch 13 is an example of information indicating the start and stop of the vehicle 100. Specifically, when the output signal of the ACC switch 13 changes from an off signal to an on signal, it indicates that the vehicle 100 has started; when the output signal of the ACC switch 13 changes from an on signal to an off signal, it indicates that the vehicle 100 has stopped. The ACC switch 13 can be connected to the ECU 11, etc., via CAN 17 communication, and its status signal (on signal / off signal) is sent to the ECU 11.

[0035] Sensor 14 includes sensors for detecting the voltage applied to the inverter, the voltage applied to the motor, the vehicle speed, the throttle opening, the steering wheel input, and the brake input. Additionally, sensor 14 may include, for example, an acceleration sensor for detecting the acceleration of the vehicle 100 and an angular velocity sensor (gyroscope sensor) for detecting the angular velocity of the vehicle 100. The detection information output from sensor 14 is collected by ECU 11 via CAN 17.

[0036] The camera unit 15 is a camera equipped with imaging elements such as CCD (Charge Coupled Device) and CMOS (Complementary Metal Oxide Semiconductor). The camera unit 15 may include, for example, an internal camera unit for photographing the interior of the vehicle and an external camera unit for photographing the exterior of the vehicle.

[0037] The interior camera unit is positioned, for example, to capture images of the faces of occupants in the driver's seat, front passenger seat, etc., and the faces of occupants in the rear seats of the vehicle 100. These positions include the dashboard, the driver's instrument panel, and the roof of the vehicle 100. The interior camera unit is not limited to one unit; multiple units may be installed within the vehicle. The interior camera unit outputs camera information representing the captured images of the interior of the vehicle.

[0038] The external camera unit is an omnidirectional camera, panoramic camera, etc., that captures the scenery around the vehicle. The scenery around the vehicle includes, for example, the scenery in front of the vehicle 100, the scenery to the sides of the vehicle 100 (the driver's side door or the passenger side door), and the scenery behind the vehicle 100. The scenery includes, for example, the lane in which the vehicle travels, objects present in that lane, the sidewalk facing that lane, and objects present on the sidewalk. Objects present in the lane include, for example, vehicles, buildings, structures (advertisements, road signs, traffic lights, utility poles, etc.), people, and animals. Objects present on the sidewalk include, for example, pedestrians, animals, bicycles, structures, animals, and fallen objects. The external camera unit is positioned, for example, at a location capable of capturing the scenery outside the vehicle. This location could be the front grille, side mirrors, roof, or rear bumper. The external camera unit outputs camera information representing the captured images of the scenery outside the vehicle.

[0039] The display unit 16 is, for example, a head-up display that displays images on a vehicle instrument panel or windshield located in front of the driver's seat.

[0040] Next, refer to Figure 2 The hardware structure of the ECU is explained using an example. Figure 2This diagram illustrates an example of the hardware structure of an ECU. The ECU 11 includes: an auxiliary storage device 11A, a memory device 11B, a CPU 11C, and an interface device 11D. These devices constitute an information processing unit 110 and are interconnected via a bus 11E.

[0041] Auxiliary storage device 11A is an HDD (Hard Disk Drive), flash memory, or similar device that stores files, data, etc., required for the processing of ECU 11. Memory device 11B reads the program from auxiliary storage device 11A and saves it when a program start instruction is issued. CPU 11C executes the program saved in memory device 11B, implementing various functions of ECU 11 according to the program. Interface device 11D is, for example, an interface that connects CPU 11C to camera unit 15, sensor 14, etc., via CAN 17.

[0042] Next, refer to Figure 3 An example of the structure of the information processing device 110 is described. Figure 3 This diagram illustrates a structural example of the function of an information processing device. The information processing device 110 includes: an information acquisition unit 111 that acquires driving information, camera information, etc.; an image processing unit 112 that performs various processing operations on the image captured by the camera unit 15 based on the camera information; and a display mode changing unit 120 that changes the display mode of the information displayed on the display unit 16 (e.g., the speedometer on a vehicle instrument panel) according to changes in driving information. Driving information includes, for example, the vehicle information described above, current time information, weather information related to the current location of the vehicle 100, traffic information, information indicating the vehicle's driving mode, and information related to user attributes. Details regarding the image processing unit 112 and the display mode changing unit 120 will be explained later.

[0043] In addition, the information processing device 110 includes: a map information storage unit 115, a display information storage unit 116, and a camera information storage unit 117 for storing camera information sent from the camera unit 15.

[0044] The map information storage unit 115 stores map information such as dynamic maps and 3D high-definition maps. By utilizing map information and vehicle location information, for example, in the speed limit display processing described later, the speed limit can be accurately displayed corresponding to the current position of the vehicle 100.

[0045] The display information storage unit 116 stores display information for display unit 16 to display. Display information includes, for example, image information such as speedometer, oil pressure gauge, and fuel level gauge displayed on the vehicle's instrument panel, as well as image information of the speed limit of the road on which the vehicle 100 is traveling.

[0046] In addition, the displayed information includes hue information representing the hue of a portion of the vehicle's instrument panel. Hue information includes, for example, the color of the background area of ​​the instrument panel, the color of the speedometer's numerical area, the color of the speedometer's pointer, and the color of all or part of the speedometer's area. Hue refers to the lightness or darkness of a color. Specifically, hue is the concentration and type of color displayed by the speedometer based on the vehicle 100's driving status and surrounding environment. Furthermore, the changes in color concentration and type can be gradual. Gradual means that the hue changes continuously based on the vehicle 100's driving status and surrounding environment. For example, on a sunny day, from a time before sunrise (e.g., 5 AM) to a specific time (e.g., 8 AM), as the area around the vehicle 100 gradually brightens, causing the color displayed by the speedometer to change continuously or in stages, multiple concentrations and types of colors corresponding to sunny weather (colors within a specific range on the Munsell color wheel) can be set for the time period from 5 AM to 8 AM.

[0047] In the display information storage unit 116, a correspondence is established between the display information and multiple driving information. For example, the image information of the speedometer, the image information of the speed limit, the color tone of a part of the vehicle instrument panel, etc., are respectively associated with the time, vehicle speed (10 km / h, 50 km / h, etc.), weather (sunny, cloudy, rainy, etc.), vehicle status (parked, driving, etc.), and user attributes (elderly, young, gender, etc.).

[0048] The image processing unit 112 analyzes the camera information stored in the camera information storage unit 117 to determine the direction of the person's gaze, and inputs the gaze information indicating the determined gaze direction to the display mode change unit 120.

[0049] In addition, the image processing unit 112 analyzes the camera information stored in the camera information storage unit 117 to determine the position of an obstacle (e.g., a steering wheel) that is positioned closer to the display unit 16, and inputs obstacle position information indicating the determined position of the obstacle to the display mode change unit 120.

[0050] In addition, the image processing unit 112 analyzes the camera information stored in the camera information storage unit 117 to detect the color tone of the scenery around the vehicle 100, and inputs the color tone information representing the color tone to the display mode change unit 120.

[0051] In addition, the image processing unit 112 analyzes the video information captured by the external camera unit to detect the speed limit, and inputs the speed limit information indicating the speed limit to the display mode change unit 120.

[0052] The display mode change unit 120 includes a display mode change determination unit 113 and a display mode setting unit 114.

[0053] The following information is input to the display mode change determination unit 113: line-of-sight information, obstacle position information, and color tone information from the image processing unit 112; driving information acquired by the information acquisition unit 111; display information stored in the display information storage unit 116; and map information stored in the map information storage unit 115. The display mode change determination unit 113 uses this information, the prescribed change conditions, and the display conditions preferred by the user (driver, etc.) to determine whether it is necessary to change the display mode of the display information displayed on the display unit 16.

[0054] The changing conditions include, for example, the following: a steering wheel is in the line of sight of a person facing the speedometer on the display unit 16; the vehicle speed exceeds a predetermined setting value; the vehicle speed exceeds the speed limit; the latest speed limit obtained in chronological order has changed compared to the previously obtained speed limit.

[0055] The user's preferred display conditions include conditions such as: changing the rotation angle of the speedometer; enlarging the speedometer display; changing the position of a portion of the speedometer (a specific speed range); maintaining the same display mode while driving in urban areas but changing the display mode while driving on highways; and changing the display mode while driving in urban areas but maintaining the same display mode while driving on highways. For example, these display conditions can be set by the driver through a setting screen on the touch panel when starting to drive the vehicle 100, or they can be preset in the memory device 11B and read from the memory device 11B each time the vehicle 100 starts to drive.

[0056] Changes to the display format include, for example, the following: changing the position, size, or color of the speedometer image or the image of the pointer within the speedometer; changing the color tone of a portion of the vehicle's instrument panel. Additionally, changes to the display format include: changing the speed limit image from a non-display state to a display state; changing the speed limit image from a display state to a non-display state; and changing the type of speed limit image.

[0057] The display mode setting unit 114 sets the display mode to be displayed on the display unit 16 based on the determination result of the display mode change determination unit 113, reads the image information corresponding to the set display mode from the display information storage unit 116, and inputs the read display information to the display unit 16. Thus, the display mode of the display information (displayed image) on the display unit 16 can be changed according to changes in driving information.

[0058] Next, refer to Figure 4A summary of the actions taken by the information processing device to change the display format is provided. Figure 4 This is a flowchart illustrating the operation of the information processing device. The information processing device 110 acquires driving information, camera information, etc. (step S1), and uses this information and the aforementioned change conditions to determine whether it is necessary to change the display format of the information displayed on the display unit 16 (step S2). If it is not necessary to change the display format of the information (step S3: "No"), the information processing device 110 maintains the current display format setting (step S4); if it is necessary to change the display format of the information (step S3: "Yes"), it sets the changed display format according to the aforementioned display conditions (step S5).

[0059] Next, refer to Figure 5 Specific examples of actions to change the display format will be explained.

[0060] (Methods for changing the display format of the speedometer)

[0061] Figure 5 This diagram illustrates a situation where the driver's line of sight towards the speedometer is obstructed by a steering wheel positioned further forward than the instrument panel. When the driver's line of sight 70 towards the instrument panel 60 is obstructed by the steering wheel 50, a portion of the speedometer displayed on the instrument panel 60 may be difficult to see.

[0062] For example, when vehicle 100 is driving in the city, its speed is mostly in a low-speed range (first speed range), such as below 60 km / h. If the first speed range on the left side of the speedometer is obstructed by the steering wheel 50, the driver needs to adjust the position of the steering wheel 50 using its tilting mechanism to visually identify the first speed range, or tilt their head to move their line of sight 70. On the other hand, when vehicle 100 is driving on the highway, its speed is mostly in a high-speed range (second speed range), such as above 60 km / h. If the second speed range above the speedometer is obstructed by the steering wheel 50, the driver needs to adjust the steering wheel 50's tilting mechanism or move their line of sight 70 in the same way. Thus, the speed range obstructed by the steering wheel 50 varies depending on the vehicle speed. Therefore, not only is adjusting the position of the steering wheel 50 inconvenient for the driver, but the head movement also hinders safe driving, which is not a good situation.

[0063] The information processing device 110 of this embodiment is configured to change the display format of the speedometer image based on driving information, change conditions, etc., so that the driver can see the vehicle speed without being obstructed by the steering wheel 50, even without tilting or moving their head. (Refer to...) Figures 6 to 9 The following provides a detailed explanation of the changes to the display format.

[0064] Figure 6 The character は represents a state where the view towards the second speed range of the speedometer is obstructed by the steering wheel. Figure 6 The diagram shows a situation where the driver's view of the speed range (second speed range) above the speedometer 61 displayed on the vehicle's instrument panel 60 is obstructed by the annular edge of the steering wheel 50. The speed range of the speedometer 61 from 60 km / h to 120 km / h and the tip of the speedometer needle 61a are blocked behind the edge of the steering wheel 50, thus preventing the driver from accurately judging the current speed.

[0065] In this case, the information processing device 110 changes the display form of the speedometer 61 in the following manner. For the line of sight towards the speed area above the speedometer 61, the line of sight direction (line of sight vector) can be obtained by analyzing an image captured by an internal camera (e.g., a stereo camera), and this line of sight direction is assigned a starting point based on the driver's eye position to determine the line of sight. Specifically, the image processing unit 112 determines the eye area from a three-dimensional image of the driver's face captured by a stereo camera, and observes the shape of the eyeball in stereo, determining the coordinates of the eyeball center based on its curvature. Furthermore, the image processing unit 112 determines the pupil (black part of the eye) area from the eye area, determines the coordinates of the pupil center, and defines the direction from the aforementioned eye center coordinates toward the pupil center coordinates as the line of sight direction (line of sight vector). The image processing unit 112 defines the line of sight as a straight line extending from the eye position as a starting point in the line of sight direction.

[0066] The position of the steering wheel 50 that might obstruct the driver's view can be determined by analyzing a three-dimensional image captured by a stereo camera, for example, by inferring the distances from the reference position to various parts of the steering wheel 50 using the front of the display unit 16 as a reference position.

[0067] The information processing device 110 determines whether the steering wheel 50 is present in the driver's line of sight towards a speed range corresponding to the vehicle speed, based on information related to line of sight, information related to the position of the steering wheel 50, and information related to the current vehicle speed. For example, at a vehicle speed of 30 km / h, even if... Figure 6 With the steering wheel 50 configured that way, it can be determined that there is no part of the steering wheel 50 in the line of sight towards a speed of approximately 30 km / h. In this case, the information processing device 110 does not change the display mode of the speedometer 61 and maintains the current display mode.

[0068] On the other hand, for example, at a vehicle speed of 80 km / h, if the steering wheel is turned 50 degrees... Figure 6With that configuration, it can be determined that a portion of the steering wheel 50 exists in the driver's line of sight towards the second speed zone, which includes 80 km / h. In this case, the information processing device 110, based on the aforementioned display conditions, such as... Figure 7 That changes the display format of the speedometer 61.

[0069] Figure 7 This diagram illustrates an example of moving the second speed zone to a position easily observed by the driver. Figure 7 The following is an example of a display when the following change conditions are selected: the display mode is changed while driving on a highway, and the position of a part of the vehicle instrument panel 60 (a specific speed range) is changed.

[0070] Figure 7 In the vehicle instrument panel 60 shown, the image of the second speed range is now displayed to the left of the speedometer 61, and the pointer 61a of the speedometer 61 points to this second speed range. Therefore, the second speed range and the tip of the pointer 61a of the speedometer 61 are not obstructed by the steering wheel 50, so the driver can see the vehicle speed near the second speed range even without tilting or head movement. Furthermore, when... Figure 7 When the vehicle speed drops to, for example, below 60 km / h in the displayed state, it changes to... Figure 6 An image like the one shown.

[0071] Furthermore, if the display format of the speedometer 61 image switches frequently in conjunction with changes in vehicle speed, visual recognizability may be reduced. Therefore, considering this, the information processing device 110 may be configured, for example, to not return to normal operation when the vehicle speed is temporarily reduced (e.g., for a few seconds to tens of seconds) while driving on a highway, even if the vehicle speed is temporarily reduced due to other vehicles cutting in front of it. Figure 6 The image shown continues to be displayed. Figure 7 An image like the one shown.

[0072] Additionally, the information processing device 110 may also be configured to return to the following conditions, even on a highway: Figure 6 The image shown is only applicable to situations where the vehicle exists within an area from a location where the vehicle speed decreases (such as a parking lot, interchange, etc.) to a location a certain distance away from that location.

[0073] Reference Figure 8 and Figure 9 Another example of a change in the display format of the speedometer will be explained. Figure 8 This is a diagram illustrating an example of rotating the speedometer counterclockwise by a certain angle. (Example) Figure 8As shown, by rotating the entire speedometer, not only the first speed range but also a portion of the second speed range is not obstructed by the steering wheel 50. Therefore, the driver can clearly grasp the current vehicle speed and the speed range before and after that speed. Furthermore, this display method prevents the display pattern of the speedometer 61 from frequently switching in tandem with changes in vehicle speed, thus suppressing any reduction in visual legibility caused by changes in display pattern. Moreover, the rotation direction of the speedometer 61 is not limited to counterclockwise; it can also be clockwise.

[0074] Figure 9 This diagram illustrates an example of a display where the speedometer is moved downwards towards the bottom of the vehicle's instrument panel. (Example) Figure 9 As shown, by moving the speedometer 61 entirely towards the lower side of the instrument panel 60, the first and second speed ranges are not obstructed by the steering wheel 50. Therefore, the driver can clearly grasp the current speed and the speed range before and after that speed. Furthermore, with this change in display configuration, the positions of the first and second speed ranges, and the tilt of the pointer 61a, remain unchanged before and after the display image change, making the speedometer 61 easier to observe. This change in display configuration is particularly useful when there is a large gap inside the annular edge of the steering wheel 50. Moreover, the direction of movement of the speedometer 61 is not limited to the lower side of the instrument panel 60; it can also be the upper side, left side, or right side of the instrument panel 60.

[0075] In addition, the information processing device 110 can also be configured to change the overall position of the speedometer in a manner linked to the rotation angle of the steering wheel 50. When the vehicle is driving on winding mountain roads or similar routes, frequent steering wheel operations are required. Therefore, for example, the display information of the speedometer 61 corresponding to the steering direction and steering input of the steering wheel 50 can be preset in the display information storage unit 116. The display mode change unit 120 can read the display information of the speedometer 61 corresponding to the steering direction and steering input of the steering wheel 50 and display the image of the speedometer 61 in a position easily observed by the driver. As a result, the speedometer 61 can be accurately checked even when turning, thus reducing driver fatigue. Furthermore, by linking the position of the speedometer 61 image to the steering direction, the image of the speedometer 61 can be displayed near the driver's line of sight even when the driver's gaze is directed towards the road ahead of the turn. Therefore, the amount of eye movement between the speedometer 61 and the road is reduced, which can reduce driver fatigue and contribute to safer driving.

[0076] In addition, the information processing device 110 may also be configured to perform display control based on the user's preferred display conditions and driving information, for example, by changing the rotation angle of the speedometer; enlarging the display of the speedometer; changing the position of a portion (a specific speed range) of the speedometer; not changing the display form when driving in urban areas but changing the display form when driving on highways; changing the display form when driving in urban areas but not changing the display form when driving on highways; etc.

[0077] (Method for changing the display format of speed limit)

[0078] Next, refer to Figure 10 and Figure 11 An example will be given of displaying an image of the speed limit on the road on which the vehicle is traveling on the speedometer 61, and changing the display format of the speed limit image according to changes in vehicle speed.

[0079] Figure 10 This is an example of a graph showing the speed limit displayed on a speedometer. For example... Figure 10 As shown, an image 62 with bar-shaped speed limits (e.g., 100 km / h) is overlaid on the image representing the speed of the speedometer 61. Figure 10 On the left, image 62 shows the speed limit when the vehicle speed is below the speed limit. Figure 10 On the right, image 62 shows the speed limit when the vehicle speed exceeds the speed limit.

[0080] The display mode change unit 120 acquires information about the speed limit of the road on which the vehicle 100 is traveling. If the vehicle speed is below the speed limit, it reads image information corresponding to that speed from the display information storage unit 116 and displays it on the speedometer 61 based on the image information. Figure 10 The image 62 showing the speed limit is as shown on the left. In this case, the speed limit image 62 is set to green, for example, as a light. Furthermore, when obtaining speed limit information, methods such as those associated with a dynamic map can be used; or methods that read images of speed limits on the road using a camera device, as disclosed in patent documents (e.g., Japanese Patent Application Publication No. 2018-081555).

[0081] When the vehicle speed exceeds the speed limit, the display mode change unit 120 reads image information corresponding to the speed from the display information storage unit 116, and displays it on the speedometer 61 based on the image information. Figure 10 The image 62 on the right shows a speed limit as shown. In this case, the speed limit image 62 is set to a flashing red, for example.

[0082] By displaying the speed limit image 62 on the speedometer 61, the driver can grasp the speed limit of the road even if they are not looking at the speed limit sign on the road. In addition, there is no need to compare the speed limit sign with the speedometer 61, so there is no need to move the driver's eyes between the speed limit sign and the speedometer 61, which can reduce driver fatigue and help the driver drive safely.

[0083] Furthermore, the colors of the images 62 before and after exceeding the speed limit are not limited to the examples mentioned above. For instance, they can be set to the same color but with different concentrations before and after the vehicle speed exceeds the speed limit, or they can be set to the same color with different flashing cycles.

[0084] Furthermore, the speed-limiting image 62 is not limited to a bar graph; for example, it could be an image covering the entire speed range exceeding the speed limit. (See reference...) Figure 11 This example is explained. Figure 11 This is a diagram showing a variation of the image representing the speed limit displayed in the speedometer.

[0085] For example, when the speed limit is 80 km / h, the display mode change unit 120 reads the image information corresponding to the speed limit from the display information storage unit 116, and displays an image 64 on the speedometer 61 that covers all or part of the speed range exceeding 80 km / h.

[0086] Additionally, for example, when the speed limit changes from 80 km / h to 100 km / h, the display mode change unit 120 reads the image information corresponding to the speed limit from the display information storage unit 116, and based on the image information, displays an image 63 in the speedometer 61 that covers the entire or part of the speed range exceeding 100 km / h.

[0087] In this case, preferably, the display mode changing unit 120 makes the color of image 63 different from that of image 64 in a way that makes the area exceeding the limit speed after the change clear. Alternatively, for example, the display mode changing unit 120 may display image 63 after image 64 is not displayed, or the density of image 64 may be continuously or periodically lightened over time, and image 63 may be displayed after image 64 is no longer displayed.

[0088] Furthermore, the display mode changing unit 120 can also change the color of the speed limit image according to the type of road. For example, the speed limit image for general roads can be set to blue, and the speed limit image for highways can be set to red, thereby making it easier for drivers to understand the different speed limits for each type of road.

[0089] (A method for changing the display format of the speedometer in response to changes in the vehicle's surrounding environment)

[0090] Next, refer to Figure 12 and Figure 13 An example is given of how the display of the speedometer changes in response to changes in the surrounding environment of the vehicle 100.

[0091] Figure 12 This diagram illustrates an example of how the speedometer display changes in response to changes in the vehicle's surrounding environment. Figure 12 On the left, an image of the speedometer 61 during rainy weather is shown as an example. For instance, the display mode change unit 120 reads image information corresponding to the color tone of the vehicle 100's surrounding environment during rainy weather from the display information storage unit 116 by inputting color tone information from the image processing unit 112, and sets the speedometer 61 based on this image information. Figure 12 The speedometer 61 has a background color 65 as shown on the left. In this case, the background color 65 is set to white, for example. As a result, even in dark conditions around the vehicle 100, the image of the speedometer 61 is clear, thereby improving the driver's visual recognition.

[0092] exist Figure 12 On the right side, an image of the speedometer 61 in a sunny weather is shown as an example. For example, the display mode change unit 120 reads image information corresponding to the color tone of the vehicle 100's surrounding environment in a sunny weather from the display information storage unit 116 by inputting color tone information from the image processing unit 112, and sets the speedometer 61 based on this image information. Figure 12 The background color 65 of the speedometer 61 is shown on the right side. In this case, the background color 65 is set to blue, for example. Therefore, even when strong morning sunlight shines into the windshield of the vehicle 100, making it difficult for the driver to see the speedometer (white), the background color 65 of the speedometer 61 changes to blue, reducing the impact of sunlight and significantly improving the visual visibility of the speedometer 61. Furthermore, in the prior art, the brightness of the speedometer 61 can be controlled; however, if only brightness is controlled, for example, if the red light of sunset enters the driver's eyes or is reflected off the speedometer 61, the red portion of the speedometer 61 becomes difficult to see. According to this embodiment, the information processing device 110 changes the color of the speedometer 61 based on changes in the surrounding environment of the vehicle 100, thus improving the visual visibility of the speedometer 61 and assisting the driver. This is especially useful for elderly drivers who have difficulty perceiving color differences.

[0093] Furthermore, the display mode changing unit 120 can also be configured to change the color of the speedometer 61 according to the time period during which the vehicle 100 is traveling, in addition to weather conditions. For example, between 6:00 and 8:00 AM, strong sunlight can affect driving; therefore, the display mode changing unit 120 can be configured to perform the aforementioned control (changing the color of the speedometer 61) during this time period, and not perform the aforementioned control outside of this time period. Alternatively, the display mode changing unit 120 can also be configured, for example, that on cloudy days, when sunlight temporarily intensifies due to cloud cover breaking, the aforementioned control is not performed from the moment the sunlight intensity exceeds a predetermined level until a predetermined time (several minutes) has elapsed, but the aforementioned control is performed after the predetermined time has elapsed. With this structure, the frequent switching of the speedometer 61 color due to changes in the surrounding environment of the vehicle 100 can be prevented, and the reduction in visual visibility can be suppressed.

[0094] Furthermore, the display mode changing unit 120 can also be configured to change the color of the speedometer 61 based on the attributes of the occupants of the vehicle 100, in addition to weather conditions. For example, the display mode changing unit 120 takes the determination result of the facial image from the image processing unit 112 as input, and performs the aforementioned control if the driver is determined to be an elderly person of a specified age or older based on the facial image; otherwise, it does not perform the aforementioned control. With this structure, the visual recognition of the speedometer 61 is improved for elderly people, and for people other than the elderly, they will not feel annoyed by the color changes and can concentrate on driving.

[0095] Alternatively, the display mode change unit 120 can be configured to change the color of the speedometer 61 when the color difference between the color of the environment surrounding the vehicle 100 and the color of the speedometer 61 is lower than a predetermined value. For example, by analyzing an image of the environment surrounding the vehicle captured by the image processing unit 112, information related to the color of the environment surrounding the vehicle can be collected by the display mode change unit 120. The display mode change unit 120 identifies the color surrounding the vehicle based on this information related to the color of the environment surrounding the vehicle and information related to the Munsell color wheel, and compares the identified color with the color set in the speedometer 61 (e.g., the background color 65 of the speedometer 61 mentioned above). Thus, it is possible to determine whether the difference in chromaticity values ​​(color difference) is lower than a predetermined value. For example, when the red light of sunset approaches the background color 65 of the speedometer 61, the speedometer 61 becomes difficult to see; therefore, the display mode change unit 120 performs the aforementioned control when it determines that the color difference is lower than a predetermined value. Therefore, it is possible to suppress the decrease in visual recognition of the speedometer 61 caused by the environment surrounding the vehicle 100, which is independent of the driver's age.

[0096] Alternatively, the display mode changing unit 120 may be configured to replace the background color 65 of the speed of the speedometer 61, and change one of the colors of the speed of the speedometer 61 (the color of the speed value of the speedometer 61), the color of the pointer of the speedometer 61, or the color of all or part of the background area of ​​the speedometer 61.

[0097] In addition, the display mode changing unit 120 can also take into account the display conditions preferred by the user, such as using blue for people who find blue easier to see and green for people who find green easier to see, so as to change the color of the speedometer 61.

[0098] (A method for changing the display format of the speedometer in accordance with the driving mode)

[0099] Next, refer to Figure 13 An example is given of changing the display format of the speedometer according to the driving mode.

[0100] Figure 13 It is a graph representing the actual vehicle speed when driving in autonomous driving mode, and the virtual vehicle speed when switching from autonomous driving mode to manual driving mode.

[0101] In the speedometer 61 of vehicle 100 operating in autonomous driving mode, such as Figure 13 As shown, an image is displayed with a pointer 61a1 indicating the actual vehicle speed. In a vehicle 100 operating in automatic driving mode, if the driving mode is switched from automatic driving mode to manual driving mode, the vehicle speed before and after the switch sometimes deviates significantly.

[0102] For example, even if the current speed is 40 km / h, if the driving mode is switched from automatic driving mode to manual driving mode while the accelerator pedal is pressed hard, the speed will increase sharply, for example, if the speed corresponding to the accelerator pedal opening is 80 km / h, which may lead to a rear-end collision with other vehicles.

[0103] In addition, for example, even if the current speed is 100 km / h, if the driving mode is switched from automatic driving mode to manual driving mode while the foot is only on the accelerator pedal, the speed will drop sharply if the speed corresponding to the accelerator pedal opening is, for example, 10 km / h. This will reduce the distance between the vehicle and the following vehicle, which may be dangerous.

[0104] Given this situation, in the prior art disclosed in, for example, patent document (Japanese Patent Application Publication No. 2007-196809), from the moment the driver requests the disengagement of automatic driving until the switch to manual driving, the driving operation performed by the driver is compared with the driving operation determined by the automatic driving control device to be optimal. If it is determined that the driver is capable of appropriate driving, the system switches to manual driving. However, in this prior art, it is not possible to grasp (see) the degree of deviation of the driver's operation relative to the current driving state, so the driver's anxiety about whether there will be a sharp acceleration or deceleration after switching to manual driving cannot be eliminated. Therefore, there is a problem that the driver may be unable to switch to manual driving.

[0105] In view of this situation, the display mode change unit 120 of this embodiment, for example, takes mode switching information from a mode switch that switches driving modes as input, and when it determines that the current driving mode is autonomous driving mode based on the input mode switching information, it displays the current vehicle speed on the speedometer 61. Furthermore, the display mode change unit 120 infers the vehicle speed corresponding to the throttle opening based on the aforementioned driving information. For example, it uses table information that establishes a correspondence between throttle opening and vehicle speed to infer the vehicle speed corresponding to the throttle opening. The display mode change unit 120 reads image information of the pointer of the vehicle speed corresponding to the inferred vehicle speed from the display information storage unit 116, such as... Figure 13 As shown, in addition to the image of pointer 61a1 representing the actual vehicle speed, an image of pointer 61a2 representing the virtual vehicle speed is also displayed on the speedometer 61. Therefore, in addition to the vehicle speed during autonomous driving, the predicted vehicle speed for switching to manual driving can also be displayed. Thus, since the driver can confirm the difference between the current vehicle speed and the speed for switching to manual driving, for example, if the speed difference is approximately 10 km / h, the driver can switch driving modes without adjusting the throttle opening. Furthermore, if the speed difference exceeds 10 km / h, the driver can adjust the throttle opening to reduce the speed difference while looking at the image of pointer 61a2 representing the virtual vehicle speed, and then switch driving modes. Alternatively, the display mode change unit 120 can be configured to display not only the predicted vehicle speed for switching to manual driving itself, but also information related to the predicted vehicle speed, such as the speed difference during autonomous driving and warnings indicating excessive speed differences.

[0106] Furthermore, the information processing device 110 of this embodiment can also be configured to display the information displayed on the vehicle instrument panel 60 on a head-up display and change its display mode on the head-up display. In this case, the change of display information can be achieved by controlling the optical path length, controlling the optical path direction, etc. For example, when the display mode changing unit 120 changes the display mode of images such as the speedometer displayed on the head-up display, it outputs a command to the head-up unit to control the operation of the optical system. The head-up unit includes a radiating unit and an optical system. The radiating unit is a projector that emits light. The optical system is a component that reflects the light emitted by the radiating unit and illuminates light onto a predetermined area of ​​the display unit provided on the windshield. The optical system is, for example, composed of a concave mirror, multiple lenses, a reflector, etc. The light emitted from the radiating unit is irradiated onto the display unit via the optical system, thereby forming a virtual image such as the speedometer in front of the windshield.

[0107] Various embodiments have been described above with reference to the accompanying drawings, but the present invention is not limited to these examples. Those skilled in the art will understand that various modifications or alterations can be conceived within the scope of this application, and these also fall within the technical scope of the present invention. Furthermore, the constituent elements in the above embodiments can be arbitrarily combined without departing from the spirit of the present invention.

[0108] The specific examples of the present invention have been described in detail above, but these are merely examples and do not constitute a limitation on the scope of protection of this application. The technology described in the scope of protection of this application includes various modifications and alterations to the specific examples described above.

[0109] The entire contents of the description, drawings and abstract contained in Japanese Patent Application No. 2020-046494, filed on March 17, 2020, are incorporated herein by reference.

[0110] Industrial applicability

[0111] One embodiment of the present invention is suitable for information processing devices and vehicles.

[0112] Explanation of reference numerals in the attached figures

[0113] 1. Vehicle-mounted equipment

[0114] 60. Vehicle Instrument Panel

[0115] 61 Speedometer

[0116] 100 vehicles

[0117] 110 Information Processing Device

[0118] 111 Information Acquisition Department

[0119] 112 Image Processing Department

[0120] 113 Display Form Change Determination Unit

[0121] 114 Display Mode Setting Section

[0122] 120 Display Form Change Department

Claims

1. An information processing device comprising: The information acquisition unit acquires driving information related to the driving of a vehicle equipped with an onboard instrument panel; and The display mode changing unit changes the display mode of the vehicle instrument panel according to the changes in the driving information. in, The display mode changing unit determines whether a steering wheel is in the driver's line of sight of the speed area corresponding to the vehicle speed on the vehicle instrument panel, based on the change in vehicle speed as driving information. If the steering wheel is determined to be in the line of sight, the display mode is changed by rotating the entire speed gauge in a clockwise or counterclockwise direction by a certain angle so that a part of the speed area corresponding to the vehicle speed is not obstructed by the steering wheel.

2. An information processing method, comprising: Steps for obtaining driving information related to the driving of a vehicle equipped with an onboard instrument panel; The step of determining whether a steering wheel is in the driver's line of sight in the speed range corresponding to the vehicle speed on the vehicle speedometer panel, based on the change in vehicle speed as driving information; as well as If it is determined that the steering wheel is present in the line of sight, the display form of the speedometer is changed by rotating the entire speedometer in a clockwise or counterclockwise direction by a certain angle so that a portion of the speed area of ​​the speedometer corresponding to the vehicle speed is not obscured by the steering wheel.

Images