Display device, display method and program

The display device adjusts the display mode of virtual images to maintain a larger angle of depression, addressing the issue of crushed images in conventional systems and improving route recognition in vehicle displays.

JP2024159291APending Publication Date: 2024-11-08PANASONIC AUTOMOTIVE SYST CO LTD
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2023075180
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Conventional display systems often result in virtual images being displayed in a crushed manner when superimposed on real images diagonally, making it difficult for users to recognize the real image route correctly.

Method used

A display device that determines a display mode for virtual images based on the vehicle's route, projecting light onto a translucent medium to reflect a virtual image with a larger angle of depression than the user's viewpoint, ensuring the image is not crushed and easily recognizable.

Benefits of technology

The solution allows users to easily recognize the real image route by preventing the virtual image from appearing crushed, enhancing the visibility and clarity of the displayed information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024159291000001_ABST
    Figure 2024159291000001_ABST
Patent Text Reader

Abstract

To provide a display device and the like that can display a display object that allows a user to correctly and easily recognize a route in a real image.SOLUTION: A display device 1 includes: a control part 12 determining a display form of a display object showing a guide image according to a route (scheduled route) where a vehicle 2 is scheduled to travel; and a display part projecting light showing the display object in the display form determined by the control part 12 onto a display medium provided in the vehicle 2, and to cause the display medium to reflect the light toward a user in the vehicle 2 thereby making the display object displayed through the display medium visible to the user as a virtual image. When a condition related to travel of the vehicle 2 is satisfied, the control part 12 determines the display form of the display object so that the display object has a shape corresponding to a view of the virtual image from an angle of depression larger than an angle of depression corresponding to a view of the virtual image from a viewpoint of the user.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a display device, a display method, and a program. [Background technology]

[0002] A head-up display (HUD) mounted on a vehicle is known as a conventional display device. HUDs project light representing an image onto a light-transmitting display medium and reflect the light off the display medium, allowing the user to see a real image through the display medium while allowing the user to visually recognize the image as a virtual image.

[0003] For example, Patent Document 1 discloses a display system for displaying an AR (Augmented Reality) route, which is a virtual image, on a display unit so as to be superimposed on a real image visible to a user. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-159953 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in a conventional display system, when a virtual image is superimposed on a real image path, if the path of the real image to be superimposed is seen at an angle from the user's viewpoint, the virtual image superimposed on the real image path may appear distorted, which may cause the user to be unable to correctly recognize the real image path.

[0006] Therefore, the present disclosure provides a display device and the like capable of displaying an object that allows a user to easily correctly recognize a real image path. [Means for solving the problem]

[0007] A display device according to one aspect of the present disclosure includes a control unit that determines a display mode of a display object that shows a guidance image corresponding to a route along which a vehicle is planned to travel, and a display unit that projects light indicating the display object in the display mode determined by the control unit onto a display medium provided in the vehicle, thereby causing the display medium to reflect the light toward a user inside the vehicle, and allowing the user to view the display object displayed through the display medium as a virtual image, wherein when a condition related to the travel of the vehicle is satisfied, the control unit determines the display mode of the display object so that the virtual image has a shape that appears when viewed from a larger depression angle than when viewed from the user's viewpoint. Effect of the Invention

[0008] A display device or the like according to one embodiment of the present disclosure can display an object that allows a user to easily correctly recognize the path of a real image. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing a vehicle interior in which a display device according to an embodiment is arranged. [Diagram 2] FIG. 2 is a block diagram showing a vehicle. [Diagram 3] FIG. 3 is a diagram showing a flow from generating a guide route to arranging display objects in the embodiment. [Figure 4A] FIG. 4A is an explanatory diagram of the depression angle difference. [Figure 4B] FIG. 4B shows an object displayed when no viewpoint conversion is performed and an object displayed when viewpoint conversion is performed according to the embodiment. [Diagram 5] FIG. 5 is a flowchart showing a first operation example of the display device according to the embodiment. [Figure 6] FIG. 6 is a flowchart showing a second operation example of the display device according to the embodiment. [Figure 7A] FIG. 7A is a diagram showing a display mode of an object according to the curvature of the guide route and the curvature of the object. [Figure 7B]FIG. 7B is a diagram showing the display mode of the display object according to the curvature and depression angle difference of the guide route. [Figure 7C] FIG. 7C is a diagram showing a display mode of a display object according to the shape of a guide route, the number of guide images, and annoyance. [Figure 7D] FIG. 7D is a diagram showing the rotation angle of the guide image. [Figure 7E] FIG. 7E is a diagram showing the display mode of a display object according to the distance to a guide node and the depression angle difference. [Figure 7F] FIG. 7F is a diagram showing a guide image according to the distance to the guide node and the vertex angle. [Figure 7G] FIG. 7G is a diagram showing guide images according to the distance to the guide node. [Figure 8A] FIG. 8A is a diagram showing displayed objects and a route when the traveling direction of the vehicle and the route are parallel and when the traveling direction of the vehicle and the route are non-parallel in a conventional display device. [Figure 8B] FIG. 8B shows a case where a display object is formed only from guide nodes and exit nodes. [Figure 9] FIG. 9 is a diagram showing a flow from generating a guide route to arranging a display object in the modified example of the embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of the display device according to the modified example of the embodiment. [Figure 11] FIG. 11 is another diagram showing the flow from generating a guide route to arranging a display object in the modified example of the embodiment. [Figure 12A] FIG. 12A is a diagram showing a case where a guide image within the display range and a guide image outside the display range have different colors. [Figure 12B] FIG. 12B is a diagram showing a case where the luminance of a guide image within the display range differs from that of a guide image outside the display range. [Figure 12C] FIG. 12C is another diagram showing a case where the guide image within the display range and the guide image outside the display range have different luminance. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components that are not described in the independent claims will be described as optional components.

[0011] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In addition, in each drawing, the same reference numerals are used for substantially the same configuration, and duplicated explanations may be omitted or simplified.

[0012] (Embodiment) First, a display device 1, a display method, and a program according to the present embodiment will be described with reference to FIGS. 1 to 4B.

[0013] FIG. 1 is a diagram showing the cabin of a vehicle 2 in which a display device 1 according to an embodiment is arranged. FIG. 2 is a block diagram showing the vehicle 2. FIG. 3 is a diagram showing a flow from the generation of a guide route to the arrangement of a display object in an embodiment. The left diagram of (a) in FIG. 3 shows a guide route generated using a guide node, an entrance node, and an exit node as viewed from directly above, and the right diagram of (a) in FIG. 3 shows a guide route as viewed from the user's viewpoint. (b) in FIG. 3 shows a state in which a display object arranged along the guide route is subjected to viewpoint conversion and an overhead display object is generated. (c) in FIG. 3 shows a case in which a display object subjected to viewpoint conversion is arranged along the guide route. FIG. 4A is an explanatory diagram of a depression angle difference. FIG. 4B is a diagram showing a display object without viewpoint conversion and a display object with viewpoint conversion according to an embodiment.

[0014] <Functional configuration> As shown in FIG. 1 and FIG. 2, the display device 1 is, for example, a HUD mounted on a vehicle 2. The display device 1 emits display light, which is light showing a display object, toward a translucent display medium, and reflects the display light from the display medium, so that the display light can be incident on the user's eyes. For example, when the display device 1 is used in the vehicle 2, the display device 1 can reflect the display light emitted to a display medium such as a translucent front windshield or a translucent combiner, so that the display light can be incident on the user's eyes. This allows the user to view the display light three-dimensionally as a virtual image while recognizing a real image through the display medium.

[0015] The display light is light that causes a virtual image to be displayed three-dimensionally on a display medium. The image may be a still image or a moving image, and may include numbers, letters, figures, and the like.

[0016] The display device 1 determines the display mode of the display light to be projected onto the display medium based on information from each of a plurality of devices mounted on the vehicle 2.

[0017] The multiple devices include, for example, a navigation device 21, a vehicle control device 22, a sensor 23, and the like.

[0018] The navigation device 21 is a navigation system mounted on the vehicle 2. By using map data, the navigation device 21 can set a planned route, which is an optimal route along which the vehicle 2 is scheduled to travel from the current location to the destination. The navigation device 21 can also provide surrounding road traffic information and the like, and set a planned route that has been changed in accordance with the surrounding road traffic information. The navigation device 21 outputs vehicle-related information including the set planned route to the display device 1. The planned route is included in the route of the present disclosure.

[0019] The planned route is a route along which the vehicle 2 is scheduled to travel, and is a route superimposed on the actual roads visible through the display medium. The planned route includes guidance nodes indicating route change points for the vehicle 2, entry nodes indicating points just before entering the guidance nodes, and exit nodes that guide the vehicle 2 passing through the guidance nodes. The guidance nodes, entry nodes, and exit nodes are each determined by the navigation device 21, and are included in the vehicle-related information. The guidance nodes, entry nodes, and exit nodes may be determined by the control unit 12 of the display device 1 based on the planned route.

[0020] The vehicle control device 22 is a device that performs various controls related to the traveling of the vehicle 2. The vehicle control device 22 controls the engine speed, and controls the transmission, engine speed, brake system, etc. according to the driver's operation and the traveling conditions. The vehicle control device 22 outputs vehicle-related information including various controls related to the traveling of the vehicle 2 to the display device 1.

[0021] The sensors 23 are mounted on the vehicle 2 and include on-board sensors such as a camera sensor that detects the presence or absence of obstacles around the vehicle 2 and the surrounding environment such as the shape of the road, a distance sensor that detects the distance from the vehicle 2 to the obstacle, a speed sensor that detects the traveling speed of the vehicle 2, an acceleration sensor that detects the acceleration of the vehicle 2, and a steering angle sensor that detects the steering angle. The vehicle control device 22 outputs vehicle-related information to the display device 1, including the surrounding environment, the distance from the vehicle 2 to the obstacle, the traveling speed, the acceleration of the vehicle 2, and the steering angle.

[0022] The display device 1 includes an input unit 11, a control unit 12, a drawing unit 13, and a projection unit .

[0023] The input unit 11 is an input interface that acquires vehicle-related information output from each of a plurality of devices. The input unit 11 outputs the acquired vehicle-related information to the control unit 12.

[0024] As shown in Fig. 2 and Fig. 3, the control unit 12 generates a display object based on the vehicle-related information acquired by the input unit 11, and determines the display mode of the generated display object. Specifically, when a condition related to the travel of the vehicle 2 is satisfied based on the acquired vehicle-related information, the control unit 12 generates a guide route for generating a display object using a guide node, an entry node, and an exit node. The guide route is a part of a planned route composed of the guide node, the entry node, and the exit node, and is a route for generating and arranging a display object. The control unit 12 can generate a display object according to the guide route and determine the display mode of the display object so that the virtual image has a shape when viewed from a larger depression angle than when viewed from the user's viewpoint.

[0025] Here, the display object is an image displayed as a virtual image on a display medium by display light, and is composed of a guide image displayed along a planned route. For example, an arrow-shaped image is illustrated as an example of the guide image, but it is not limited to an arrow-shaped image as long as it is a known image capable of guiding a user. The display object in this embodiment is composed of a plurality of guide images displayed along the planned route. For this reason, the control unit 12 generates a plurality of guide images according to the shape of the planned route indicated in the vehicle-related information, and determines the display mode of the generated plurality of guide images.

[0026] Here, the display mode of the display object is determined according to, for example, the route around the guide node (guidance route), the distance from the vehicle 2 to the guide node, the speed at which the display object is changed according to the guidance route, and the traveling speed of the vehicle 2 around the guide node. The display mode of the display object includes the arrangement position of the display object, the curvature of the display object, the depression angle difference of the display object, the number of guide images, the rotation angle of the multiple guide images, the vertex angle of the guide image, the size of the guide image, and the speed at which the display object is changed. In addition, each of the multiple guide images may be determined to have a display mode such that they do not overlap each other. The guidance route is included in the route of the present disclosure.

[0027] For example, when a condition related to the travel of the vehicle 2 is satisfied, the control unit 12 converts the viewpoint so that a three-dimensional display object, which is a virtual image seen from the user's viewpoint and is arranged along the planned route displayed on the display medium, has the shape of a three-dimensional display object as it would appear if viewed from above, generates the display object, and determines the display mode of the display object.

[0028] At this time, the curvature of the trajectory along the arrangement of the multiple guide images displayed on the display medium (curvature of the displayed object) is smaller than the curvature of the trajectory along the arrangement of the multiple guide images shown as virtual images when viewed from the user's viewpoint, and the depression angle difference of the multiple guide images displayed on the display medium is larger than the depression angle difference of the virtual image when viewed from the user's viewpoint.

[0029] Here, the depression angle difference is a value obtained by subtracting an angle a between a line connecting the front end of the displayed object and the viewpoint and the horizontal direction from an angle b between a line connecting the rear end of the displayed object and the viewpoint and the horizontal direction when the displayed object is viewed from a user's viewpoint in the horizontal direction, as shown in Fig. 4A. The depression angle difference when it is assumed that the displayed object is viewed from above is a value obtained by subtracting an angle A between a line connecting the front end of the displayed object and the viewpoint and the horizontal direction from an angle B between a line connecting the rear end of the displayed object and the viewpoint and the horizontal direction. As a result, the depression angle difference (BA) of multiple guide images displayed on the display medium is greater than the depression angle difference (ba) of the virtual image when viewed from the user's viewpoint.

[0030] For example, as shown in (a) of FIG. 4B, if viewpoint conversion is not performed, the curvature of the trajectory along the arrangement of the multiple guide images seen from the user's viewpoint appears larger than when the multiple guide images are viewed from above. Also, the depression angle difference of the multiple guide images seen from the user's viewpoint appears smaller than when the multiple guide images are viewed from above. Therefore, if each of the multiple guide images is three-dimensional, when the display medium is viewed from the user's viewpoint, the three-dimensional multiple guide images appear to be crushed and deformed. This may make it difficult for the user to recognize the guidance indicated by the displayed object.

[0031] However, in this embodiment, as shown in (b) of Fig. 4B, the control unit 12 generates a display object that has been converted from a viewpoint so that the shape of the display object becomes a three-dimensional shape that would be seen when viewed from above, and determines the display mode of the generated display object. Therefore, a three-dimensional display object in which the curvature is increased, the depression angle difference is reduced, and deformation is suppressed is displayed on the display medium.

[0032] Here, the conditions related to the traveling of the vehicle 2 are conditions that require the user to operate the steering wheel of the vehicle 2 on the planned route. The conditions that require the user to operate the steering wheel of the vehicle 2 are conditions that the vehicle 2 changes course on the planned route. Specifically, the conditions that require the user to operate the steering wheel of the vehicle 2 include at least one of the following: a condition that an intersection or a curve exists on the planned route, a condition that a curve exists on the route from the vehicle 2 to the intersection on the planned route, a condition that another intersection or another curve exists on the route from the vehicle 2 to the intersection or curve on the planned route, and a condition that the vehicle 2 changes course. The conditions that the vehicle 2 changes course include, for example, a condition that an intersection or a curve exists on the planned route and the vehicle 2 changes course immediately before the intersection or curve, a condition to avoid an obstacle such as another moving body or an installed object, etc.

[0033] For example, conditions that require the user to steer the vehicle 2 include a condition in which the user steers the vehicle 2 to make a curve, a right turn, or a left turn, a condition in which even if the vehicle 2 is currently moving straight, a condition in which a curved road or an intersection at which to turn right or left is visible to the user on the planned route, and the user will steer the vehicle 2, and a condition in which the user will steer the vehicle 2 to avoid an obstacle. Therefore, conditions that require the user to steer the vehicle 2 include a condition in which the user is currently steered and a condition in which the user will steer in the near future. Here, an intersection also includes a simple branch or junction, regardless of whether there is a traffic light or not.

[0034] When the control unit 12 determines the display mode, it outputs the determined display mode of the display object to the drawing unit 13.

[0035] Drawing unit 13 obtains the display mode of the object determined from control unit 12, and draws the object according to the display mode of the object determined by control unit 12 in order to project the determined object onto a display medium from projection unit 14. For example, drawing unit 13 adjusts the size, shape, color, brightness, etc. of the object according to the determined display mode of the object. Drawing unit 13 outputs the drawing result to projection unit 14.

[0036] The projection unit 14 projects light (display light) showing an object in a display mode determined by the control unit 12 based on the drawing result acquired from the drawing unit 13 onto a display medium provided in the vehicle 2. The display light projected onto the display medium is reflected by the display medium toward the user inside the vehicle 2, so that the object, which is the display light displayed through the display medium, is visually recognized by the user as a virtual image.

[0037] Such drawing unit 13 and projection unit 14 are included in the display unit of the present disclosure.

[0038] <Processing Operation> Next, the display device 1, the display method, and the processing operation of the program in this embodiment will be described with reference to FIG.

[0039] FIG. 5 is a flowchart showing a first operation example of the display device 1 according to the embodiment.

[0040] (Example 1) First, a plurality of devices mounted on the vehicle 2 transmit vehicle-related information to the display device 1. As a result, the display device 1 acquires the vehicle-related information (S11). That is, the vehicle-related information is input to the input unit 11 of the display device 1. The input unit 11 outputs the input vehicle-related information to the control unit 12.

[0041] Next, the control unit 12 generates a display object based on the acquired vehicle-related information, and when a condition related to the traveling of the vehicle 2 based on the vehicle-related information is satisfied, determines a display mode of the generated display object (S12). Specific details of the generation of the display object and the determination of the display mode of the display object will be described later.

[0042] Next, the control unit 12 outputs the determined display mode of the display object to the drawing unit 13.

[0043] Next, the drawing unit 13 acquires the display mode of the object determined from the control unit 12, and draws the object according to the acquired display mode of the object (S13). The drawing unit 13 outputs the drawing result to the projection unit .

[0044] Next, the projection unit 14 projects display light showing the display object toward the display medium so as to achieve the determined display mode based on the drawing result acquired from the drawing unit 13 (S14). At this time, since the drawing unit 13 has also drawn the planned route, the projection unit 14 projects the light showing the planned route together with the display light toward the display medium. Since the display light is reflected toward the user by the display medium, the user can recognize the display object displayed through the display medium as a virtual image. Then, the display device 1 ends the flowchart of FIG.

[0045] (Example 2) Next, the processing operation of S12 in FIG. 6 will be described in more detail with reference to FIG.

[0046] FIG. 6 is a flowchart showing a second operation example of the display device 1 according to the embodiment.

[0047] First, the control unit 12 acquires the planned route indicated in the vehicle-related information. When the conditions related to the traveling of the vehicle 2 are satisfied, the control unit 12 generates a guide route for generating display objects using the guide nodes, entry nodes, and exit nodes of the planned route (S21).

[0048] Next, when the conditions related to the travel of the vehicle 2 are satisfied, the control unit 12 performs viewpoint conversion on the displayed object (S22). Specifically, the control unit 12 converts a three-dimensional displayed object, which is arranged along a guide route among the planned routes displayed on the display medium and is seen from the user's viewpoint, into a shape of the three-dimensional displayed object as seen when viewed from above. In other words, the control unit 12 converts the shape of the three-dimensional displayed object as seen when the user views the three-dimensional displayed object along the horizontal direction into a shape of the three-dimensional displayed object as seen when the user views the three-dimensional displayed object from above.

[0049] As a result, the curvature of the trajectory along the arrangement of the multiple guide images displayed on the display medium is smaller than the curvature of the trajectory along the arrangement of the multiple guide images shown as virtual images when viewed from the user's viewpoint. Also, the depression angle difference of the multiple guide images displayed on the display medium is larger than the depression angle difference of the virtual image when viewed from the user's viewpoint. Therefore, even if the arrow guide image viewed by the user along the horizontal direction appears crushed and deformed, the arrow guide image viewed by the user from above appears to have less deformation.

[0050] Next, the control unit 12 generates a display object by performing viewpoint conversion on the display object so that a stereoscopic display object with this deformation suppressed is displayed on the display medium (S23).

[0051] Next, the control unit 12 determines the display mode of the display object and arranges the display object (S24).Then, the control unit 12 proceeds to S14 in Fig. 5.Then, the display device 1 ends the flowchart in Fig. 5.

[0052] Here, a method for determining the display mode of a display object will be described with reference to FIGS. 7A to 7G.

[0053] FIG. 7A is a diagram showing the display mode of a display object according to the curvature of a guide route and the curvature of a display object. FIG. 7B is a diagram showing the display mode of a display object according to the curvature of a guide route and the depression angle difference. FIG. 7C is a diagram showing the display mode of a display object according to the shape of a guide route, the number of guide images, and the annoyance. FIG. 7D is a diagram showing the rotation angle of a guide image. FIG. 7E is a diagram showing the display mode of a display object according to the distance to a guide node and the depression angle difference. FIG. 7F is a diagram showing a guide image according to the distance to a guide node and the vertex angle. FIG. 7G is a diagram showing a guide image according to the distance to a guide node.

[0054] Specifically, in order to allow the user to correctly recognize the displayed objects, the control unit 12 determines the display mode according to the placement position of the displayed object according to the guidance route, the guidance route, the distance from the vehicle 2 to the guidance node, the speed at which the displayed object is changed according to the guidance route, and the traveling speed of the vehicle 2 around the guidance node.

[0055] The control unit 12 changes the position of the display object according to the guide route. For example, the control unit 12 determines the position of the display object so that the display object is arranged along the shape of the guide route. Specifically, the control unit 12 determines the position of the display object so that the display object is arranged according to the shape of the guide route, as shown in (c) of FIG. 3.

[0056] Furthermore, the control unit 12 changes the displayed objects in accordance with the guide route. For example, the control unit 12 changes at least one of the curvature of the displayed objects, the depression angle difference of the displayed objects, the number of guide images, and the rotation angle of the multiple guide images in accordance with the guide route.

[0057] Specifically, as shown in Fig. 7A, the control unit 12 calculates the curvature of the guide route, and determines the curvature of the trajectory along the arrangement of the multiple guide images, i.e., the curvature of the display object, according to the calculated curvature. For example, the control unit 12 determines the display mode such that the curvature of the display object becomes smaller as the guide route curves more gently, i.e., the curvature of the guide route becomes smaller. Furthermore, when the curvature of the guide route is medium, the control unit 12 determines the display mode such that the curvature of the display object becomes medium. Furthermore, the control unit 12 determines the display mode such that the curvature of the display object becomes larger as the guide route curves more sharply, i.e., the curvature of the guide route becomes larger. Note that "large" and "small" curvatures refer to cases where the curvature is larger than a reference value, and cases where the curvature is smaller than a reference value, when a medium curvature is used as a reference value.

[0058] Also, as shown in FIG. 7B, the control unit 12 calculates the depression angle difference of the display objects arranged on the guide route, and determines the depression angle difference of the display objects according to the calculated depression angle difference. For example, the control unit 12 determines the display mode so that the depression angle difference of the display objects becomes larger as the guide route curves more gently, that is, the curvature of the guide route becomes smaller. Also, when the curvature of the guide route is medium, the control unit 12 determines the display mode so that the depression angle difference of the display objects becomes medium. Also, the control unit 12 determines the display mode so that the depression angle difference of the display objects becomes smaller as the guide route curves more sharply, that is, the curvature of the guide route becomes larger. Note that a depression angle difference being large and small refers to a case where the depression angle difference is larger than a reference and a case where the depression angle difference is smaller than a reference when a medium depression angle difference is used as a reference.

[0059] Also, as shown in FIG. 7C, the control unit 12 determines the number of guide images in the display object according to the guide route. For example, the control unit 12 determines the display mode so that the number of guide images is reduced to about three as the guide route becomes more gentle or simple. In this case, the user feels less visual annoyance. Also, when the guide route is medium, the control unit 12 determines the display mode so that the number of guide images is reduced to about five. In this case, the user feels less visual annoyance. Also, the control unit 12 determines the display mode so that the number of guide images is increased to about seven as the guide route becomes more sharply or complex. In this case, the user feels more visual annoyance. Note that the control unit 12 may increase the number only when the curvature of the guide route is large and the guide route has a complex shape such as an S-shape. Note that the number of guide images being large and small refers to the case where the depression angle difference is larger than a reference value and the case where the depression angle difference is smaller than a reference value, when the depression angle difference is medium.

[0060] Also, as shown in FIG. 7D, the control unit 12 determines the rotation angle of a plurality of guide images according to the guide route. For example, when the guide image is an arrow, if the rotation angle around the roll axis along the front-rear direction is the roll angle, the control unit 12 determines the display mode so that the roll angle is larger as the curvature of the guide route is larger, and the roll angle is smaller as the curvature of the guide route is smaller. If the rotation angle around the yaw axis along the up-down direction is the yaw angle, the control unit 12 determines the display mode so that the yaw angle is larger as the curvature of the guide route is larger, and the yaw angle is smaller as the curvature of the guide route is smaller. If the rotation angle around the pitch axis along the left-right direction is the pitch angle, the control unit 12 determines the display mode so that the pitch angle is upward with respect to the horizontal plane when the guide route is uphill, and the pitch angle is downward with respect to the horizontal plane when the guide route is downhill. Note that the rotation angle being large and small refer to the case where the rotation angle is larger than the reference and the case where the rotation angle is smaller than the reference, respectively, when the rotation angle is medium.

[0061] Furthermore, the control unit 12 changes the displayed object according to the distance from the vehicle 2 to the guide node. Furthermore, the control unit 12 changes at least one of the depression angle difference of the displayed object, the vertex angle of each of the plurality of guide images, and the size of the plurality of guide images according to the distance from the vehicle 2 to the guide node.

[0062] Specifically, as shown in Fig. 7E, the control unit 12 calculates the depression angle difference of the displayed object, and determines the depression angle difference of the displayed object according to the calculated depression angle difference of the displayed object. For example, the control unit 12 determines the display mode such that the depression angle difference of the displayed object increases as the distance from the vehicle 2 to the guide node increases. Furthermore, if the distance from the vehicle 2 to the guide node is medium, the control unit 12 determines the display mode such that the depression angle difference of the displayed object becomes medium. Furthermore, the control unit 12 determines the display mode such that the depression angle difference of the displayed object becomes smaller as the distance from the vehicle 2 to the guide node becomes closer. Note that the terms "far" and "near" refer to cases where the distance is greater than a reference value of a medium distance, and cases where the distance is smaller than a reference value.

[0063] Furthermore, as shown in FIG. 7F, the control unit 12 determines the apex angle of each of the multiple guide images according to the distance from the vehicle 2 to the guide node. For example, when the guide image is an arrow, the control unit 12 determines the display mode such that the apex angle of the arrow becomes smaller as the distance from the vehicle 2 to the guide node increases. When the guide image is an arrow, the control unit 12 determines the display mode such that the apex angle of the arrow becomes medium if the distance from the vehicle 2 to the guide node is medium. When the guide image is an arrow, the control unit 12 determines the display mode such that the apex angle of the arrow becomes larger as the distance from the vehicle 2 to the guide node decreases. Note that a large apex angle and a small apex angle refer to cases where the apex angle is larger than a reference value and smaller than a reference value, respectively, when a medium apex angle is used as the reference value.

[0064] Furthermore, as shown in Fig. 7G, the control unit 12 determines the size of each of the multiple guide images according to the distance from the vehicle 2 to the guide node. For example, the control unit 12 determines the display mode such that the size of the guide image becomes smaller as the distance from the vehicle 2 to the guide node increases. Furthermore, the control unit 12 determines the display mode such that if the distance from the vehicle 2 to the guide node is medium, the size of the guide image will also be medium. Furthermore, the control unit 12 determines the display mode such that the size of the guide image becomes larger as the distance from the vehicle 2 to the guide node decreases. Note that a large and small guide image refers to a case where the guide image is larger or smaller than a medium size as a reference.

[0065] Furthermore, the control unit 12 changes the speed at which the displayed objects are changed in accordance with the guide route. Furthermore, the control unit 12 may change the speed at which at least some of the guide images among the plurality of guide images are changed in accordance with the guide route, and determine the changed speed.

[0066] Specifically, the control unit 12 determines the display mode so that the speed at which the displayed objects change will be faster when the guide node is approached as the guide route bends sharply, i.e., the curvature of the guide route becomes larger. In other words, the control unit 12 determines the display mode so that the speed at which the displayed objects change will be slower when the guide node is approached as the guide route bends gently, i.e., the curvature of the guide route becomes smaller.

[0067] In addition, the control unit 12 determines the display mode so that the speed at which the displayed object changes when the vehicle approaches the curve increases as the curvature of a curve that exists before the guide node in the vicinity of the guide node increases. In other words, the control unit 12 determines the display mode so that the speed at which the displayed object changes when the vehicle approaches the curve decreases as the curvature of a curve that exists before the guide node in the guide route decreases.

[0068] For example, when the curvature of the curve is large, the control unit 12 determines the display mode so that the rate of change (angular velocity) of the rotation angle of one guide image is 90° / second or more. When the curvature of the curve is small, the control unit 12 determines the display mode so that the rate of change of the rotation angle of one guide image is 45° / second or less. Note that the rate of change of the rotation angle exemplified here is merely an example, and is not limited to the rate of change of the rotation angle shown in this embodiment.

[0069] In another example, when the curvature of the curve is large, the control unit 12 determines the display mode so that the number of guide images changes from 5 to 3 over a period of about 0.5 seconds. When the curvature of the curve is small, the control unit 12 determines the display mode so that the number of guide images changes from 5 to 3 over a period of about 1 second. Note that the number and duration of guide images exemplified here are merely examples, and are not limited to the number and duration of guide images shown in this embodiment.

[0070] In addition, if the control unit 12 determines that the conditions regarding the travel of the vehicle 2 are satisfied after determining that the conditions regarding the travel of the vehicle 2 are not satisfied, the control unit 12 may change the speed at which the display objects are changed depending on the curvature of the guidance route indicating the guidance nodes, entry nodes, and exit nodes.

[0071] Furthermore, the control unit 12 determines the speed at which the display object is changed according to the traveling speed of the vehicle 2 around the guide node.

[0072] Specifically, the control unit 12 determines the display mode such that the faster the traveling speed of the vehicle 2 on the guidance route around the guidance node, the faster the speed at which the displayed object changes when the vehicle 2 approaches the guidance node. In other words, the control unit 12 determines the display mode such that the slower the traveling speed of the vehicle 2 on the guidance route, the slower the speed at which the displayed object changes when the vehicle 2 approaches the guidance node.

[0073] Furthermore, when there is a curve before the guide node, which is in the vicinity of the guide node, the control unit 12 determines the display mode so that the faster the traveling speed of the vehicle 2 approaches the curve, the faster the speed at which the displayed object changes. In other words, when there is a curve before the guide node, the control unit 12 determines the display mode so that the slower the traveling speed of the vehicle 2 approaches the curve, the slower the speed at which the displayed object changes.

[0074] For example, when the traveling speed of the vehicle 2 is fast when approaching a curve, the control unit 12 determines the display mode so that the rate of change of the rotation angle of one guide image is 90° / second or more. Also, when the traveling speed of the vehicle 2 is slow when approaching a curve, the control unit 12 determines the display mode so that the rate of change of the rotation angle of one guide image is 45° / second or less. Note that the rate of change of the rotation angle exemplified here is merely an example, and is not limited to the rate of change of the rotation angle shown in this embodiment.

[0075] In another example, when the traveling speed of vehicle 2 is fast when approaching a curve, control unit 12 determines the display mode such that the number of guide images changes from five to three over a period of about 0.5 seconds. Also, when the traveling speed of vehicle 2 is slow when approaching a curve, control unit 12 determines the display mode such that the number of guide images changes from five to three over a period of about 1 second. Note that the number and duration of guide images exemplified here are merely examples, and are not limited to the number and duration of guide images shown in this embodiment.

[0076] In addition, if the control unit 12 determines that the conditions regarding the travel of the vehicle 2 are satisfied after determining that the conditions regarding the travel of the vehicle 2 are not satisfied, the control unit 12 changes the speed at which the display object is changed according to the speed of the vehicle 2 approaching the guidance node.

[0077] <Action and effect> Next, the effects of the display device 1 according to the present embodiment will be described.

[0078] First, a conventional display device 1 will be described with reference to FIG. 8A.

[0079] FIG. 8A is a diagram showing displayed objects and a route in a conventional display device 1 when the traveling direction of a vehicle 2 is parallel to the route and when the traveling direction of a vehicle 2 is non-parallel to the route.

[0080] In the conventional display device 1, when a virtual image is viewed from the user's viewpoint, the displayed object may appear crushed as shown in Fig. 8A. In this case, the user may not be able to correctly recognize the displayed object.

[0081] However, the display device 1 according to the present embodiment includes a control unit 12 that determines the display mode of a display object showing a guidance image corresponding to a route along which the vehicle 2 is scheduled to travel, and a display unit that projects light showing the display object in the display mode determined by the control unit 12 onto a display medium provided in the vehicle 2, thereby causing the display medium to reflect the light (display light) toward a user inside the vehicle 2, and allowing the user to visually recognize the display object displayed through the display medium as a virtual image. When a condition related to the travel of the vehicle 2 is satisfied, the control unit 12 determines the display mode of the display object so that the virtual image has a shape as if it were viewed from a larger depression angle than when the virtual image is viewed from the user's viewpoint.

[0082] According to this, it is possible to display an object on the display medium as a virtual image having a shape that would be obtained if the virtual image were viewed from above, thereby making it possible to prevent the object from being displayed in a distorted state on the display medium.

[0083] Therefore, it is possible to display an object that allows the user to easily recognize the real image route correctly.

[0084] In addition, the display method of this embodiment includes determining a display mode of a display object that shows a guidance image corresponding to the route along which vehicle 2 is scheduled to travel, projecting light showing the display object in the determined display mode onto a display medium provided in vehicle 2, causing the display medium to reflect the light toward a user inside vehicle 2, allowing the user to view the display object displayed through the display medium as a virtual image, and, when a condition related to the travel of vehicle 2 is satisfied, determining the display mode of the display object so that the virtual image has a shape that appears when viewed from a larger depression angle than when viewed from the user's viewpoint.

[0085] This display method also provides the same effects as those described above.

[0086] Moreover, the program according to the present embodiment is a program for causing a computer to execute the display method.

[0087] This program also provides the same effects as those described above.

[0088] In addition, in the display device 1 according to the present embodiment, the displayed object is composed of a plurality of guide images displayed along a route. The curvature of a path along the arrangement of the plurality of guide images displayed on the display medium is smaller than the curvature of a path along the arrangement of the plurality of guide images shown as a virtual image when viewed from the user's viewpoint.

[0089] This makes it possible to prevent the displayed object from appearing crushed, which makes it easier for the user to correctly recognize the displayed object.

[0090] In the display device 1 according to the present embodiment, the displayed object is composed of a plurality of guide images displayed along the route. The depression angle difference of the displayed object displayed on the display medium is larger than the depression angle difference of the virtual image when viewed from the user's viewpoint.

[0091] This makes it possible to prevent the displayed object from appearing crushed, which makes it easier for the user to correctly recognize the displayed object.

[0092] Furthermore, in display device 1 according to the present embodiment, a plurality of guide images are displayed so as not to overlap each other.

[0093] This makes it possible to prevent a situation in which a plurality of guide images overlap, making it difficult for the user to recognize the displayed object, and as a result, makes it easier for the user to correctly recognize the displayed object.

[0094] In the display device 1 according to the present embodiment, the route includes guidance nodes indicating route change points for the vehicle 2, entry nodes indicating points just before entering the guidance nodes, and exit nodes for guiding the vehicle 2 passing through the guidance nodes. The control unit 12 then determines the display mode of the displayed objects using the guidance nodes, the entry nodes, and the exit nodes.

[0095] Here, a conventional display device will be described with reference to FIG. 8B. FIG. 8B is a diagram showing a case where a display object is formed only with guide nodes and exit nodes. For example, when a display object is formed only with guide nodes and exit nodes, as shown in FIG. 8B, it may appear as if the display object is guiding the user to a road in front, rather than a road in the back. In this case, the user may proceed along a wrong route.

[0096] However, according to the present embodiment, a guide route can be generated using guide nodes, entry nodes, and exit nodes, so that display objects can be generated along the guide route, enabling the user to recognize the direction indicated by the guide route.

[0097] In addition, in the display device 1 according to the present embodiment, the condition related to the traveling of the vehicle 2 is a condition that requires the user to operate the steering wheel at a guidance node.

[0098] For example, when the user needs to operate the steering wheel, the user operates the steering wheel while paying attention to the surroundings of the vehicle 2, thereby changing the traveling direction of the vehicle body.

[0099] In this case, according to the present embodiment, it is possible to display on the display medium an object that is easy for the user to see. This allows the user to correctly recognize the object. As a result, it is expected that the user will be able to proceed with the vehicle 2 on the correct course.

[0100] Furthermore, in the display device 1 of this embodiment, the conditions under which the user is required to operate the steering wheel include at least one of the following conditions: a condition that an intersection exists on the route, a condition that a curve exists on the route from the vehicle 2 to the intersection, and a condition that another intersection or another curve exists on the route from the vehicle 2 to the intersection or curve.

[0101] According to this, when the user needs to operate the steering wheel, a display object that is easy for the user to see can be displayed on the display medium. This allows the user to correctly recognize the display object. As a result, it is expected that the user will be able to proceed with the vehicle 2 on the correct course.

[0102] In the display device 1 according to the present embodiment, the condition that requires the user to operate the steering wheel is a condition that the vehicle 2 changes course on the route.

[0103] According to this, when the vehicle 2 changes course, a display object that is easy for the user to see can be displayed on the display medium. This allows the user to correctly recognize the display object. As a result, it is expected that the user will be able to proceed with the vehicle 2 on the correct course.

[0104] In the display device 1 according to the present embodiment, a condition that requires the user to operate the steering wheel is a condition that an intersection or a curve exists on the route and the vehicle 2 changes course immediately before the intersection or the curve.

[0105] According to this, when the vehicle 2 changes course, a display object that is easy for the user to see can be displayed on the display medium. This allows the user to correctly recognize the display object. As a result, it is expected that the user will be able to proceed with the vehicle 2 on the correct course.

[0106] Furthermore, in the display device 1 according to the present embodiment, the control unit 12 changes the displayed object according to the route around the guide node.

[0107] According to this, since the displayed object can be changed according to the shape of the guide route, the display mode of the displayed object can be determined to be suitable for the guide route, which makes it easier for the user to correctly recognize the displayed object.

[0108] Furthermore, in display device 1 according to the present embodiment, the route includes guidance nodes that indicate route change points for vehicle 2. Then, control unit 12 changes at least one of the curvature of the trajectory along the arrangement of multiple guidance images (curvature of the guidance route), the depression angle difference of displayed objects, the number of guidance images, and the rotation angle of the multiple guidance images, according to the route around the guidance node.

[0109] For example, the greater the curvature of the displayed object, the greater the curvature of the guide route will be felt by the user, and the greater the angle (curvature of the guide route) before and after the guide node will be felt.

[0110] In addition, the smaller the depression angle difference of the displayed object, the greater the curvature of the displayed object will be perceived by the user, and the greater the angle before and after the guidance node will be perceived.

[0111] Furthermore, according to this embodiment, since the control unit 12 can arrange a large number of guide images, it is possible to express a complex shape such as an S-shape by a displayed object.

[0112] In addition, by adjusting the roll angle in the rotation angle of the guide image, the user can expect to feel that the larger the roll angle is, the greater the curvature of the guide route is, and the smaller the roll angle is, the smaller the curvature of the guide route is. In addition, by adjusting the yaw angle, the user can expect to feel that the larger the yaw angle is, the greater the curvature of the guide route is, and the smaller the yaw angle is, the smaller the curvature of the guide route is. In addition, by adjusting the pitch angle, the user can expect to feel that the more upward the pitch angle is relative to the horizontal plane, the higher the climb is, and the more downward the pitch angle is relative to the horizontal plane, the lower the climb is.

[0113] In this way, since the displayed objects can be changed according to the shape of the guide route, the display mode of the displayed objects can be determined to be suitable for the guide route, which makes it easier for the user to correctly recognize the displayed objects.

[0114] Furthermore, in display device 1 according to the present embodiment, the route includes guidance nodes that indicate course change points for vehicle 2. Then, control unit 12 changes at least one of the depression angle difference of the displayed object, the vertex angle of each of the plurality of guidance images, and the size of the plurality of guidance images, depending on the distance from vehicle 2 to the guidance node.

[0115] For example, the greater the depression angle difference, the more likely it is that the user will feel that the guidance node is farther away from the vehicle 2.

[0116] In addition, the narrower the apex angle of the guide image, the more likely it is that the user will feel that the guide node is located farther away from the vehicle 2.

[0117] In addition, since the shape of the guidance image can be made to follow the perspective line depending on the distance from vehicle 2 to the guidance node, it is expected that the user will be able to sense the distance from vehicle 2 to the guidance node.

[0118] In this way, since the displayed objects can be changed according to the distance from the vehicle 2 to the guide node, the display mode of the displayed objects can be determined to be suitable for the guide route. As a result, the user can easily recognize the displayed objects correctly.

[0119] Furthermore, in the display device 1 according to the present embodiment, the control unit 12 changes the speed at which the display object is changed depending on the route.

[0120] According to this, the display mode can be determined so that the greater the curvature of the guidance route, the faster the speed at which the displayed object changes when approaching the guidance node. Also, the greater the curvature of a curve just before the guidance node, the faster the speed at which the displayed object changes when approaching the curve. In this way, the speed at which the displayed object changes can be adjusted according to the shape of the guidance route. This is expected to make it easier for the user to recognize the guidance route.

[0121] Furthermore, in the display device 1 according to the present embodiment, the route includes guidance nodes that indicate course change points for the vehicle 2. The control unit 12 changes the speed at which the displayed objects are changed according to the traveling speed of the vehicle 2 around the guidance nodes.

[0122] According to this, the display mode can be determined so that the faster the traveling speed of the vehicle 2 on the guidance route, the faster the speed at which the displayed object changes when the vehicle 2 approaches the guidance node. Also, if there is a curve just before the guidance node, the display mode can be determined so that the faster the traveling speed of the vehicle 2 when approaching the curve, the faster the speed at which the displayed object changes. In this way, the speed at which the displayed object changes can be adjusted according to the traveling speed of the vehicle 2 on the guidance route. This is expected to make it easier for the user to recognize the guidance route.

[0123] Furthermore, in display device 1 according to this embodiment, the route includes guidance nodes indicating route change points for vehicle 2, entry nodes indicating points just before entering the guidance nodes, and exit nodes that guide vehicle 2 passing through the guidance nodes. If control unit 12 determines that the conditions related to the travel of vehicle 2 are satisfied after determining that the conditions related to the travel of vehicle 2 are not satisfied, control unit 12 changes the speed at which the displayed objects are changed according to the curvature of the route indicating the guidance nodes, entry nodes, and exit nodes.

[0124] This makes it possible to determine the display mode of the display object according to the curvature of the guidance route when the conditions related to the traveling of the vehicle 2 are satisfied, which makes it easier for the user to correctly recognize the display object.

[0125] Furthermore, in the display device 1 according to the present embodiment, the route includes a guidance node indicating a course change point for the vehicle 2. Then, when the control unit 12 determines that the condition related to the traveling of the vehicle 2 is satisfied after determining that the condition related to the traveling of the vehicle 2 is not satisfied, the control unit 12 changes the speed at which the display object is changed according to the speed of the vehicle 2 approaching the guidance node.

[0126] According to this, when the conditions related to the traveling of the vehicle 2 are satisfied, the speed at which the display objects are changed can be adjusted according to the traveling speed of the vehicle 2 on the guidance route. This is expected to make it easier for the user to recognize the guidance route.

[0127] (Modification of the embodiment) First, the configuration of a display device 1 according to this modified example will be described with reference to FIG.

[0128] Fig. 9 is a diagram showing a flow from generating a guide route to arranging display objects in a modified embodiment. The left diagram of Fig. 9(a) shows a guide route generated using guide nodes, entry nodes, and exit nodes as viewed from directly above, and the right diagram of Fig. 9(a) shows the guide route as viewed from the user's viewpoint. Fig. 9(b) shows a state in which display objects arranged along the guide route are subjected to viewpoint conversion and a bird's-eye view of the display objects is generated. Fig. 9(c) shows a case in which the viewpoint-converted display objects are arranged along the guide route.

[0129] This modification differs from the embodiment in that a shifted display object is generated. Unless otherwise specified, the other configurations of this modification are the same as those of the embodiment, and the same components are denoted by the same reference numerals and detailed description of the configurations is omitted.

[0130] For example, when the planned route is curved, or when the vehicle is turned right or left, or when the vehicle steering wheel is operated to change course, etc., the actual route to be traveled may go outside the display range of the display unit. In this case, the displayed objects may not be displayed appropriately, making it difficult for the user to correctly recognize the planned route.

[0131] Therefore, in this modified example, when at least a part of a display object falls outside the display range of the display medium, the control unit 12 determines the display mode of the shifted display object so that the part falls within the display range.

[0132] Specifically, when the actual route to be traveled falls outside the display range of the display unit and the guide route is not displayed in the display range, the control unit 12 shifts the display object to the position closest to the guide route in the display range. For example, as shown in Fig. 9, even if the entry node and guide node of the guide route fall outside the display range, a display object is generated that is shifted to the position closest to the guide route in the display range so as to move from the entry node outside the display range to the exit node within the display range.

[0133] When the control unit 12 generates a shifted display object, it determines the display mode so as to change the color and / or brightness of at least a part of the display range.

[0134] The display aspects of the display objects in this modified example include the position of the display object, the curvature of the display object, the depression angle difference of the display object, the number of guide images, the rotation angle of a plurality of guide images, the vertex angle of the guide image, the size of the guide image, the color of the guide image, the brightness of the guide image, and the speed at which the display object is changed.

[0135] (Example of operation) Next, with reference to FIG. 10, the processing operations of the display device 1, the display method, and the program in this modified example will be described with respect to S12 in FIG.

[0136] FIG. 10 is a flowchart showing an example of the operation of the display device 1 according to the modified example of the embodiment.

[0137] The same processing operations as those in FIG. 6 are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

[0138] First, the control unit 12 performs the processes of steps S21 to S23 to determine whether the guide route is outside the display range (S23a). The viewing angle through the display range of the display medium may be set in advance, and in this case, the control unit 12 can determine whether the guide route is outside the display range based on the traveling direction of the vehicle 2 and the viewing angle.

[0139] When the control unit 12 determines that the guide route is not outside the display range (NO in S23a), the process proceeds to step S24. Then, the display device 1 ends the flowchart of FIG.

[0140] On the other hand, when the control unit 12 determines that the guide route is outside the display range (YES in S23a), it generates a display object shifted so that it is within the display range and determines the display mode of the display object (S23b). Then, the control unit 12 proceeds to step S24. Then, the display device 1 ends the flowchart of FIG.

[0141] Here, the shifted display object will be described with reference to FIG. 9 and FIG.

[0142] Fig. 11 is another diagram showing the flow from generating a guide route to arranging display objects in a modified embodiment. The left diagram of Fig. 11(a) shows a guide route generated using guide nodes, entry nodes, and exit nodes as viewed from directly above, and the right diagram of Fig. 11(a) shows the guide route as viewed from the user's viewpoint. Fig. 11(b) shows a state in which display objects arranged along the guide route are subjected to viewpoint conversion and a bird's-eye view of the display objects is generated. Fig. 11(c) shows a case in which the viewpoint-converted display objects are arranged along the guide route.

[0143] First, as shown in Fig. 9, the display range is shifted to the left from the guide route, causing the entry node and guide node of the guide route to fall outside the display range. In this case, the control unit 12 generates a display object that connects, in the display range, the position closest to the entry node outside the display range, the position closest to the guide node outside the display range, and the exit node within the display range in that order. In this way, the control unit 12 generates a display object in which a part of the guide image of the display object is shifted to a position asymptotically approaching the guide route outside the display range.

[0144] In another example, when turning right or left at a guide node on a planned route, there may be a curve before the guide node. For example, as shown in Fig. 11, when turning right at a guide node, a curve exists before the guide node, so the display range shifts to the left from the guide route, causing the guide route to fall outside the display range. When the vehicle 2 is traveling around a curve, the control unit 12 generates a display object that is shifted to the closest position outside the display range so as to approach the guide route outside the display range.

[0145] When generating a display object shifted in this way, the control unit 12 determines the display mode so as to change the color and / or brightness of at least a part of the display range.

[0146] Here, the shifted display object will be described with reference to FIGS. 12A to 12C.

[0147] Fig. 12A is a diagram showing a case where a guide image within the display range and a guide image outside the display range have different colors. Fig. 12B is a diagram showing a case where a guide image within the display range and a guide image outside the display range have different luminance. Fig. 12C is another diagram showing a case where a guide image within the display range and a guide image outside the display range have different luminance.

[0148] Specifically, when the control unit 12 shifts a guide image of a part of the display object, the control unit 12 determines a display mode in which the color and / or brightness of the shifted guide image is changed. In other words, when the control unit 12 shifts a guide image, the control unit 12 makes at least one of the color, design, and brightness of the non-shifted guide image and the shifted guide image different from each other.

[0149] For example, as shown in Fig. 12A, the control unit 12 may display the unshifted guide image in light blue and the shifted guide image in yellow. Note that the colors of the guide images exemplified here are merely examples, and are not limited to the colors of the guide images shown in this modified example.

[0150] In another example, the control unit 12 may display the unshifted guide image in a solid color and the shifted guide image in a white line drawing, or may display the shifted guide image in a hatched line drawing. Note that the design of the guide image exemplified here is merely an example, and is not limited to the design of the guide image shown in this modified example.

[0151] In another example, the control unit 12 may change the brightness depending on whether or not an object can be displayed with priority over roads along the guide route.

[0152] For example, as shown in Fig. 12B, when control unit 12 can display objects with priority on roads along the guidance route, it may display the brightness of the unshifted guidance image as 100% and the brightness of the shifted guidance image as 50%. Note that the brightness of the guidance image exemplified here is merely an example, and is not limited to the brightness of the guidance image shown in this modified example.

[0153] 12C, when control unit 12 can display objects with priority on roads that deviate from the guidance route, it may display the brightness of the unshifted guidance image at 50% and the brightness of the shifted guidance image at 100%. Note that the brightness of the guidance image exemplified here is merely an example, and is not limited to the brightness of the guidance image shown in this modified example.

[0154] When generating a shifted display object, the control unit 12 may change the display mode to one in which the colors and / or brightness of all of the multiple guide images constituting the display object are changed.

[0155] The effects of the display device 1 according to this modified example will be described below.

[0156] As described above, in the display device 1 according to this modified example, when at least a part of a display object is outside the display range, the control unit 12 determines the display mode of the display object to be shifted so that it is within the display range.

[0157] According to this, even if at least a part of the displayed object is outside the display range, the guide image that is outside the display range can be shifted and displayed within the display range. Therefore, even if the guide route is outside the display range, the displayed object can be displayed within the display range. As a result, the user can correctly recognize the guide route.

[0158] Furthermore, in the display device 1 according to this modification, when the control unit 12 shifts a display object, it changes the color and / or brightness of at least a part of the display range.

[0159] This allows the user to recognize that the guidance image has been shifted, and as a result, the user can correctly recognize the guidance route.

[0160] (Other variations) The display device, the display method, and the program according to the present disclosure have been described above based on the above-mentioned embodiments, but the present disclosure is not limited to these embodiments. As long as it does not deviate from the spirit of the present disclosure, various modifications conceived by a person skilled in the art may also be included in the scope of the present disclosure. Furthermore, modifications of the above-mentioned embodiments may also be included in the above-mentioned embodiments.

[0161] For example, in the display device 1, display method, and program according to the above-described embodiment, the guidance route is composed of one guidance node, one entry node, and one exit node, but each of the entry node and the exit node may be composed of one or more nodes.

[0162] In addition, in the display device 1, the display method, and the program according to the above-described embodiment, a display system may be configured in which a plurality of devices mounted on the vehicle 2 and the display device 1 are combined.

[0163] In addition, in the above embodiment, the HUD is shown as an example of the display device 1, but the HUD may be configured as the projection unit 14. That is, a drawing device including the input unit 11, the control unit 12, and the drawing unit 13 may draw an object to be projected on a display medium and output the drawing result to the HUD, so that the HUD projects light representing the object.

[0164] Furthermore, the display device according to the above-described embodiment is typically realized using an LSI, which is an integrated circuit. These may be individually integrated into one chip, or may be integrated into one chip so as to include some or all of them.

[0165] The integrated circuit is not limited to LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after LSI manufacturing, or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may also be used.

[0166] In the above embodiment, each component of the display device may be implemented by dedicated hardware or by executing a software program suitable for each component. Each component may be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0167] Furthermore, all the numbers used above are merely examples for the purpose of specifically explaining the present disclosure, and the embodiments of the present disclosure are not limited to the exemplified numbers.

[0168] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, some functions may be transferred to other functional blocks, and the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

[0169] In addition, the order in which each step is performed in the flowchart is merely for illustrative purposes and may be other than the above. In addition, some of the steps may be performed simultaneously (in parallel) with other steps.

[0170] In addition, the present disclosure also includes forms obtained by applying various modifications to the above-described embodiments that a person skilled in the art may conceive, and forms realized by arbitrarily combining the components and functions of the embodiments within the scope that does not deviate from the spirit of the present disclosure. [Industrial Applicability]

[0171] The present disclosure can be used in vehicle display devices and the like.

[0172] (Additional Note) The following describes features of the display device and the like described based on the above embodiment.

[0173] <Technology 1> a control unit that determines a display mode of an indication object showing a guide image according to a route that the vehicle is scheduled to travel; a display unit that projects light showing the displayed object in the display mode determined by the control unit onto a display medium provided in the vehicle, causing the light to be reflected by the display medium toward a user in the vehicle, and allows the user to visually recognize the displayed object displayed through the display medium as a virtual image; The control unit determines the display mode of the displayed object so that the virtual image has a shape when viewed from a larger depression angle than when viewed from a viewpoint of the user when a condition related to the traveling of the vehicle is satisfied. Display device.

[0174] <Technology 2> the display object is composed of a plurality of the guide images displayed along the route, The curvature of a path along the arrangement of the plurality of guide images displayed on the display medium is smaller than the curvature of a path along the arrangement of the plurality of guide images shown in the virtual image when viewed from the viewpoint of the user. The display device according to claim 1.

[0175] <Technology 3> the display object is composed of a plurality of the guide images displayed along the route, A depression angle difference of the display object displayed on the display medium is larger than a depression angle difference of the virtual image when viewed from the user's viewpoint. The display device according to any one of claims 1 to 2.

[0176] <Technology 4> The plurality of guide images are displayed so as not to overlap each other. The display device according to any one of claims 2 to 3.

[0177] <Technology 5> the route includes a guidance node indicating a route change point of the vehicle, an entry node indicating a point just before entering the guidance node, and an exit node for guiding the vehicle passing through the guidance node; The control unit determines the display mode of the display object by using the guide node, the entry node, and the exit node. The display device according to any one of the first to fourth aspects.

[0178] <Technology 6> The condition regarding the vehicle's running is a condition that requires the user to operate a steering wheel at the guidance node. The display device according to claim 5.

[0179] <Technology 7> The conditions that require the user to operate the steering wheel include a condition that an intersection exists on the route, a condition that a curve exists on the route from the vehicle to the intersection, and a condition that another intersection or another curve exists on the route from the vehicle to the intersection or the curve. The display device according to claim 6.

[0180] <Technology 8> The condition requiring the user to operate the steering wheel includes a condition requiring the vehicle to change course on the route. The display device according to any one of claims 6 to 7.

[0181] <Technology 9> The condition requiring the user to operate the steering wheel includes a condition in which an intersection or a curve exists on the route and the vehicle changes course immediately before the intersection or the curve. The display device according to any one of the sixth to eighth aspects.

[0182] <Technology 10> When at least a part of the display object is outside a display range, the control unit determines the display mode of the display object to be shifted so as to be within the display range. The display device according to any one of the first to ninth aspects of the present invention.

[0183] <Technology 11> The control unit changes a color and / or a brightness of at least a part of the display range when the display object is shifted. The display device according to claim 10.

[0184] <Technology 12> The control unit changes the display object according to the route around the guide node. The display device according to any one of the fifth to ninth aspects of the present invention.

[0185] <Technology 13> the route includes a guidance node indicating a course change point of the vehicle; The control unit changes at least one of a curvature of a path along an arrangement of the plurality of guide images, a depression angle difference of the displayed object, a number of the guide images, and a rotation angle of the plurality of the guide images, according to the route around the guide node. The display device according to any one of the second to fourth aspects.

[0186] <Technology 14> the route includes a guidance node indicating a course change point of the vehicle; The control unit changes at least one of a depression angle difference of the display object, a vertex angle of each of the plurality of guide images, and a size of the plurality of guide images according to a distance from the vehicle to the guide node. The display device according to any one of Techniques 2 to 4 and 13.

[0187] <Technology 15> The control unit changes a speed at which the display object is changed in accordance with the route. The display device according to any one of Techniques 2 to 4, 13 and 14.

[0188] <Technology 16> the route includes a guidance node indicating a course change point of the vehicle; The control unit changes a speed at which the display object is changed in accordance with a traveling speed of the vehicle around the guidance node. The display device according to any one of Techniques 2 to 4 and Techniques 13 to 15.

[0189] <Technology 17> the route includes a guidance node indicating a route change point of the vehicle, an entry node indicating a point just before entering the guidance node, and an exit node for guiding the vehicle passing through the guidance node; When determining that a condition regarding the travel of the vehicle is satisfied after determining that the condition regarding the travel of the vehicle is not satisfied, the control unit changes a speed at which the display object is changed in accordance with a curvature of the route indicating the guide node, the entry node, and the exit node. The display device according to any one of Techniques 2 to 4 and Techniques 13 to 16.

[0190] <Technology 18> the route includes a guidance node indicating a course change point of the vehicle; When determining that a condition regarding the travel of the vehicle is satisfied after determining that the condition regarding the travel of the vehicle is not satisfied, the control unit changes a speed at which the display object is changed according to a speed of the vehicle approaching the guidance node. The display device according to any one of Techniques 2 to 4 and Techniques 13 to 17.

[0191] <Technology 19> determining a display mode of an indication object showing a guide image according to a route along which the vehicle is scheduled to travel; projecting light showing the display object in the determined display mode onto a display medium provided in the vehicle, causing the display medium to reflect the light toward a user in the vehicle, and allowing the user to view the display object displayed through the display medium as a virtual image; and when a condition related to the traveling of the vehicle is satisfied, determining the display mode of the displayed object so that the virtual image has a shape when viewed from a larger depression angle than when viewed from a viewpoint of the user. Display method.

[0192] <Technology 20> A method for causing a computer to execute the display method described in Technology 19. program. [Explanation of symbols]

[0193] 1 Display device 12 Control section 13 Drawing section (display section) 14 Projection section (display section)

Claims

1. a control unit that determines a display mode of an indication object showing a guide image according to a route that the vehicle is scheduled to travel; a display unit that projects light showing the displayed object in the display mode determined by the control unit onto a display medium provided in the vehicle, causing the light to be reflected by the display medium toward a user in the vehicle, and allows the user to visually recognize the displayed object displayed through the display medium as a virtual image; The control unit determines the display mode of the displayed object so that the virtual image has a shape when viewed from a larger depression angle than when viewed from a viewpoint of the user when a condition related to the traveling of the vehicle is satisfied. Display device.

2. the display object is composed of a plurality of the guide images displayed along the route, The curvature of a path along the arrangement of the plurality of guide images displayed on the display medium is smaller than the curvature of a path along the arrangement of the plurality of guide images shown in the virtual image when viewed from the viewpoint of the user. The display device according to claim 1 .

3. the display object is composed of a plurality of the guide images displayed along the route, A depression angle difference of the display object displayed on the display medium is larger than a depression angle difference of the virtual image when viewed from the user's viewpoint. The display device according to claim 1 .

4. The plurality of guide images are displayed so as not to overlap each other. The display device according to claim 2 or 3.

5. the route includes a guidance node indicating a route change point of the vehicle, an entry node indicating a point just before entering the guidance node, and an exit node for guiding the vehicle passing through the guidance node; The control unit determines the display mode of the display object by using the guide node, the entry node, and the exit node. The display device according to any one of claims 1 to 3.

6. The condition regarding the vehicle's running is a condition that requires the user to operate a steering wheel at the guidance node. The display device according to claim 5 .

7. The conditions that require the user to operate the steering wheel include a condition that an intersection exists on the route, a condition that a curve exists on the route from the vehicle to the intersection, and a condition that another intersection or another curve exists on the route from the vehicle to the intersection or the curve. The display device according to claim 6.

8. The condition requiring the user to operate the steering wheel includes a condition requiring the vehicle to change course on the route. The display device according to claim 6.

9. The condition requiring the user to operate the steering wheel includes a condition in which an intersection or a curve exists on the route and the vehicle changes course immediately before the intersection or the curve. The display device according to claim 6.

10. When at least a part of the display object is outside a display range, the control unit determines the display mode of the display object to be shifted so as to be within the display range. The display device according to any one of claims 1 to 3.

11. The control unit changes a color and / or a brightness of at least a part of the display range when the display object is shifted. The display device according to claim 10.

12. The control unit changes the display object according to the route around the guide node. The display device according to claim 5 .

13. the route includes a guidance node indicating a course change point of the vehicle; The control unit changes at least one of a curvature of a path along a line of the plurality of guide images, a depression angle difference of the displayed object, a number of the guide images, and a rotation angle of the plurality of the guide images, according to the route around the guide node. The display device according to claim 2 or 3.

14. the route includes a guidance node indicating a course change point of the vehicle; The control unit changes at least one of a depression angle difference of the display object, a vertex angle of each of the plurality of guide images, and a size of the plurality of guide images according to a distance from the vehicle to the guide node. The display device according to claim 2 or 3.

15. The control unit changes a speed at which the display object is changed in accordance with the route. The display device according to claim 2 or 3.

16. the route includes a guidance node indicating a course change point of the vehicle; The control unit changes a speed at which the display object is changed in accordance with a traveling speed of the vehicle around the guidance node. The display device according to claim 2 or 3.

17. the route includes a guidance node indicating a route change point of the vehicle, an entry node indicating a point just before entering the guidance node, and an exit node for guiding the vehicle passing through the guidance node; When determining that a condition regarding the travel of the vehicle is satisfied after determining that the condition regarding the travel of the vehicle is not satisfied, the control unit changes a speed at which the display object is changed in accordance with a curvature of the route indicating the guide node, the entry node, and the exit node. The display device according to claim 2 or 3.

18. the route includes a guidance node indicating a course change point of the vehicle; When determining that a condition regarding the travel of the vehicle is satisfied after determining that the condition regarding the travel of the vehicle is not satisfied, the control unit changes a speed at which the display object is changed according to a speed of the vehicle approaching the guidance node. The display device according to claim 2 or 3.

19. determining a display mode of an indication object showing a guide image according to a route along which the vehicle is scheduled to travel; projecting light showing the display object in the determined display mode onto a display medium provided in the vehicle, causing the display medium to reflect the light toward a user in the vehicle, and allowing the user to view the display object displayed through the display medium as a virtual image; and when a condition related to the traveling of the vehicle is satisfied, determining the display mode of the displayed object so that the virtual image has a shape when viewed from a larger depression angle than when viewed from a viewpoint of the user. Display method.

20. A display method for causing a computer to execute the display method according to claim 19. program.

Citation Information

Patent Citations

  • Display device, display method, and movement body

    JP2011121401A

  • Vehicular display apparatus and vehicular display method

    JP2017021019A

  • Display for vehicle and display method for vehicle

    JP2017076175A

  • HUD device, vehicle device and information display method

    JP2017211370A

  • On-vehicle system

    JP2019119318A