Display control device, display device, and display control method

Abstract

The present invention realizes a display control device and so forth that have advantages such as being capable of preventing a plurality of POI images from being sensed as being discretely arranged, being capable of realizing a more readily viewable display, and being capable of displaying a POI image even for objects at positions not facing a road and not visible to a viewer.　A display control device 80 includes an information acquisition unit 81 that acquires map information regarding an object ARa in a vicinity of a vehicle 1 and POI information that is information related to the object ARa, and a control unit 83 that controls display when displaying a POI image α3, which is an image representing the POI information, as a virtual image on a virtual image display plane PS that is imaginary. While the vehicle 1 is traveling, the control unit 83 performs display control for displaying, in a non-superimposed manner on the object ARa as viewed from a viewer 5 on board the vehicle 1, notification POI images α1 and α2 as notification displays for notifying that the object ARa is present.

Description

Display control device, display device, and display control method

[0001] The present invention relates to a display control device, a display device, a display control method, etc., that are mounted on a vehicle such as an automobile.

[0002] Patent Literature 1 describes a method of using a head-up display (HUD) device or the like to superimpose information related to points of interest (POIs) that may be of interest to vehicle occupants, such as the names of buildings and restaurants along the railroad line, onto the corresponding points in the actual scenery as POI displays through the windshield. This allows occupants to recognize information such as the identity of a building in the actual scenery ahead, when the restaurant is open, and how popular the restaurant is. Information such as distant scenery and tourist attractions may also be superimposed and displayed using a HUD device or the like.

[0003] Patent No. 6987208

[0004] POI images are broadly divided into "simplified POI images" with little information and "detailed POI images" with more information. A typical example of a "simplified POI image" is a logo (a design that symbolizes a company, store, organization, etc., in other words, a simplified symbol mark). An example of a "detailed POI image" is one that uses letters and symbols to express various information about a company, store, organization, etc. It can also be called "additional information" that indicates additional information that cannot be expressed in a logo.

[0005] The present inventors have investigated the case where, for example, a simplified POI image is displayed using a HUD device or the like while the vehicle is traveling (particularly when the vehicle is traveling ahead at at least a normal traveling speed (e.g., approximately 40 km / h to 50 km / h)), and as a result, have obtained the following findings.

[0006] (1) Assume a case where, for example, simplified POI images (hereinafter, sometimes simply referred to as POI images) are superimposed on both relatively close objects (near objects) and relatively far objects (far objects) from the perspective of a vehicle occupant (hereinafter, sometimes referred to as the "viewer"). In this case, multiple POI images are displayed separately for near and far objects, which may cause the viewer to perceive the multiple POI images as being scattered (in other words, discretely) and not cohesive, resulting in an uneasy display. (2) Furthermore, since the POI images superimposed on distant objects are drawn using perspective, their size is quite small and undeniably difficult to see. Furthermore, if the POI images are detailed POI images, the viewer may be unable to read the text, making it difficult to obtain additional information. (3) Furthermore, multiple objects at different distances from the viewer may be located at considerable distances. In this case, a POI image is superimposed on each object, but it is difficult for the viewer to recognize the difference in distance to the multiple POI images, and therefore the display may lack a sense of distance (perspective). (4) A POI image is superimposed on at least a portion of an object to notify the viewer of information about the object. Therefore, objects that can be displayed as POI images are typically located along the road on which a vehicle is traveling, facing the road, and are visible to the viewer in the vehicle while the vehicle is traveling. In other words, information cannot be provided by displaying a POI image for objects that do not face the road on which the vehicle is traveling or an oncoming road and are not visible to the viewer. Therefore, the objects for which information can be provided using a POI image are limited. (5) Thus, there are many practical challenges when trying to put into practical use a technology that associates and displays POI images with objects using an in-vehicle display device. Therefore, it becomes necessary to display a POI image, for example, at an appropriate time and in an appropriate position. (6) However, since the vehicle is moving and the distance to each object changes from time to time, strictly controlling the display timing and display position increases the processing load on the display control device (e.g., a processor, etc.) and also increases the cost of the control device.Furthermore, the processing time tends to become longer, and in this case, it cannot be said that there is no possibility of a display delay. The above-mentioned problems have been clarified by the present inventors.

[0007] One object of the present invention is to prevent multiple POI images from appearing to be discretely arranged. Another object of the present invention is to make POI images of distant objects easier to view, thereby facilitating the acquisition of POI information. Another object of the present invention is to make it easier to perceive (understand) the sense of distance (perspective) of the POI images of each object, even when multiple objects at different distances from the viewer are located at considerable distances. Another object of the present invention is to provide information through POI images about objects that are not visible to the viewer, such as those not facing the road on which the vehicle is traveling or the oncoming lane. Another object of the present invention is to enable appropriate control of display timing and display position while reducing the burden on the display control device.

[0008] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings.

[0009] In order to facilitate understanding of the outline of the present invention, the following examples are given of aspects according to the present invention. In a first aspect, a display control device includes an information acquisition unit that acquires map information about objects around a vehicle and POI (Point Of Interest) information that is information related to the objects, and a control unit that controls the display of a POI image that is an image representing the POI information when the POI image is displayed as a virtual image on a virtual image display surface, and the control unit performs display control to display a warning POI image, which serves as a warning indication that the object is present, without being superimposed on the object as seen by a viewer aboard the vehicle while the vehicle is traveling.

[0010] In the first aspect, a novel display control is implemented in which the "pre-announced POI image" is "displayed without being superimposed on the object." In a preferred example, a distant object (which may include an object that is at a distance that cannot be seen by the viewer) is not superimposed, and a pre-announced POI image that notifies the viewer of the presence of the object is displayed preferably closer than the actual position of the object.

[0011] According to this aspect, the predicted POI image is not forcibly superimposed on a distant object, for example. Therefore, even when a predicted POI image is displayed for a distant object, the predicted POI image can be displayed so that it appears relatively close to the viewer, thereby suppressing dispersed vision (discrete vision) and providing a sense of cohesion. Furthermore, the predicted POI image can be displayed at a certain size from the viewer's perspective, realizing an easy-to-view display and facilitating acquisition of POI information. Furthermore, the use of the predicted POI image makes it possible to provide information using the POI image even for objects that are not facing the road on which the vehicle is traveling and are not visible to the viewer.

[0012] In a second aspect dependent on the first aspect, when the width direction of the vehicle is the left-right direction, the control unit may perform display control such that if the object is on the left side of the road on which the vehicle is traveling, the predicted POI image is displayed on the left side as seen by the viewer, and if the object is on the right side of the road, the predicted POI image is displayed on the right side as seen by the viewer.

[0013] In the second aspect, the predicted POI image is displayed on the left or right side of the viewer, depending on whether the object is on the left or right side of the road. This allows the viewer, who sees the predicted POI image, to know in advance information (basic POI information) such as the number of objects on the left or right side of the road, the general direction of the objects as seen by the viewer, or the general distance to the objects. This improves the convenience of the display device.

[0014] In a third aspect dependent on the first or second aspect, the object may include at least one of an object within a distance range visible to the viewer and an object within a distance range not visible to the viewer.

[0015] According to the third aspect, by displaying a preview POI image, it is possible to provide POI information for distant objects that are in a distance range that the viewer cannot see with an easy-to-see preview POI image. Furthermore, even when a preview POI image is displayed for each of a plurality of distant objects, for example, by varying the display position of each preview POI image, it becomes easier to grasp the relative positional relationship of each object. This contributes to the viewer perceiving a certain degree of perspective for each object (each preview POI image).

[0016] In a fourth aspect dependent on any one of the first to third aspects, the object may include at least one of a visible object that is located facing the road in the driving lane in which the vehicle is traveling or the road in the oncoming lane and is visible to the viewer while the vehicle is traveling, and an invisible object that is not facing the road in the driving lane or the road in the oncoming lane and is not visible to the viewer while the vehicle is traveling.

[0017] According to the fourth aspect, it is possible to display a predicted POI image for an object that does not face the driving lane or the oncoming lane and is therefore not directly visible to the viewer while driving. In other words, the predicted POI image is not superimposed on the object, and the display position can be selected with a certain degree of freedom. This makes it possible to display a POI image for an object that does not face the driving lane or the oncoming lane and is therefore not visible, something that was not possible with the prior art. This broadens the scope of information provided. In other words, it is possible to display POI images for a wider variety of objects present around a moving vehicle, thereby enriching the information provided to the viewer. This further improves the convenience of the display device.

[0018] In a fifth aspect that is dependent on the fourth aspect, the control unit may, if the object is a visible object, after starting to display the preview POI image, perform display control to display a superimposed POI image as a superimposed display that is superimposed on the object so that it is superimposed on the object as seen by the viewer as the object approaches the viewer as the vehicle travels, and if the object is an invisible object, after starting to display the preview POI image, perform display control to erase the preview POI image when the preview POI image moves outside the display range for the preview POI image as the vehicle travels.

[0019] In a fifth aspect, after a preview POI image is displayed, if the vehicle approaches a "visible object" as the vehicle travels, a superimposed POI image is displayed so as to overlap the "visible object." This allows the POI information for the "visible object" to be presented more easily to the viewer. Meanwhile, a preview POI image for an "invisible object" is erased when it falls outside the display range for the preview POI image. Note that the above "display range for the preview POI image" may be the same as the "display range on the virtual image display surface." However, this is not limited to this, and may be freely set by display control software, etc. By erasing a preview POI image that has fallen outside the display range, the viewer perceives the preview POI image as naturally flowing backward and disappearing as the vehicle travels, and no discomfort is felt.

[0020] In a sixth aspect dependent on any one of the first to fifth aspects, the control unit may, after starting to display the predicted POI image, perform display control to move the predicted POI image closer to the vehicle over time.

[0021] In the sixth aspect, when an object approaches as the vehicle travels, the predicted POI image is moved from a distance to a closer distance as seen by the viewer in response to the approach of the object, thereby providing a natural visual perception and reducing the sense of incongruity.

[0022] In a seventh aspect dependent on the sixth aspect, the control unit may perform display control to increase the size of the preview POI image over time while the preview POI image is moving, thereby giving the preview POI image a sense of perspective.

[0023] In the seventh aspect, when the preview POI image is moved, a display control is performed to increase the size of the preview POI image over time, thereby giving the preview POI image a sense of perspective. This makes it easier for the viewer to intuitively understand that the object is approaching. In addition, a natural visual sense with a sense of perspective is obtained, thereby reducing the sense of discomfort.

[0024] In an eighth aspect dependent on any one of the first to seventh aspects, when the POI image is divided into a simple aspect POI image and a detailed aspect POI image having more information than the simple aspect POI image, the preview POI image is the simple aspect POI image, and the control unit may set a first display area above the display range of the virtual image display surface in which the simple aspect POI image can be displayed, and perform display control to display the preview POI image in the first display area.

[0025] In the eighth aspect, a simplified POI image, which contains less information than a detailed POI image, is used as the preview POI image. Therefore, a viewer who views the preview POI image can obtain POI information more intuitively, improving convenience. In addition, in this aspect, a first display area capable of displaying the simplified POI image is set in advance in the upper side of the display range of the virtual image display surface (for example, the upper area when the display range is divided into two parts, top and bottom), and the preview POI image is displayed in the first display area. When the first display area is set, for example, a position closer to the center, a position closer to the left edge, a position closer to the right, etc. (in other words, a relative positional relationship within the area) can be easily identified within the first display area, thereby facilitating the positioning of the preview POI display and reducing the burden of display control.

[0026] In a ninth aspect dependent on the eighth aspect, when the height direction of the vehicle is the up-down direction and the width direction of the vehicle is the left-right direction, the control unit sets an upper area at a higher position within the first display area and a lower area located below the upper area, and performs display control such that when the object is a relatively distant object, the advance notice POI image is displayed in the upper area, and when the object is a relatively close object, the advance notice POI image is displayed in the lower area; or when the object is located facing the road in the driving lane in which the vehicle is traveling or the road in the oncoming lane, and is a visible object that is visible to the viewer while the vehicle is traveling, the advance notice POI image is displayed in the lower area, and when the object is not facing the road in the driving lane or the road in the oncoming lane, and is an invisible object that is not visible to the viewer while the vehicle is traveling, the advance notice POI image is displayed in the upper area.

[0027] In the ninth aspect, an "upper region" and a "lower region" are further defined within the first display region capable of displaying a simplified POI image. By utilizing these regions for display control, it is possible to easily control the display position of the preview POI image when it first starts to be displayed, control the movement of the preview POI image thereafter, or control the timing of superimposing the superimposed POI image on the object. The "upper region" and "lower region" may be, for example, strip-shaped (rectangular) regions having a predetermined height and width (although not limited thereto). For example, the "lower region" may be positioned below the "upper region" and adjacent to the upper region, or may be positioned so as to overlap the upper and lower regions, or may be positioned slightly apart from the upper region. Preview POI images for relatively distant objects may be displayed in the upper region, and preview POI images for relatively close objects may be displayed in the lower region. As the vehicle travels forward, the viewer sees the object moving diagonally downward to the left (or right) from a central upper position. By displaying the preview POI image for a distant object above the preview POI image for a nearby object (in other words, in the "upper region"), the above-mentioned "moving diagonally backward to the left (or right) over time" can be achieved without creating a sense of incongruity. Furthermore, the preview POI image for an "invisible object" disappears diagonally backward to the left (or right) as seen by the viewer without being superimposed on the "invisible object." Therefore, it is preferable to display the preview POI image in the "upper region" so as not to interfere with the display of the superimposed POI image. Meanwhile, the preview POI image for a "visible object" is preferable to display in the "lower region" so as to allow for a smooth transition to the "superimposed POI image" (and further, a smooth transition to the display of the POI image in the detailed manner described below).

[0028] In a tenth aspect dependent on the ninth aspect, the control unit may perform display control such that, after starting to display the predicted POI image, if the object is on the left side of the road on which the vehicle is traveling, the predicted POI image is moved to the left, and if the object is on the right, the predicted POI image is moved to the right.

[0029] According to the tenth aspect, it is possible to realize a predicted POI image that has a natural visual appearance (for example, a natural perspective) that corresponds to the approach of an object by a vehicle.

[0030] In an eleventh aspect dependent on the tenth aspect, the control unit further sets, in the display range of the virtual image display surface, a second display area located on the lower left side of the first display area and capable of displaying the POI image in the detailed aspect, a third display area located on the lower right side of the first display area and capable of displaying the POI image in the detailed aspect, and a clearance area located between the second and third display areas and in which display of the POI image in the detailed aspect is prohibited, and when the object is a display target of the POI image in the detailed aspect and the advance notice POI image is moved to the left, A superimposed POI image superimposed on the object may be displayed at the left end of the first area or in a left-most area including the left end, and then display control may be implemented to display the detailed POI image in the second display area.If the object is the display target for the detailed POI image and the preview POI image is moved to the right, a superimposed POI image superimposed on the object may be displayed at the right end of the first area or in a right-most area including the right end, and then display control may be implemented to display the detailed POI image in the third display area.

[0031] In an eleventh aspect, second and third display areas are further set below the first display area as areas in which a detailed POI image can be displayed, and a clearance area in which the detailed POI image cannot be displayed is set between the second and third display areas. This allows the preview POI image, which is a simplified POI image, and the superimposed POI image to be displayed first, and then the detailed POI image is displayed in the second or third display area. If an object is located on the left side of the road (if the object is located on the left side as seen by the viewer), the detailed POI image is displayed in the second display area. If an object is located on the right side of the road (if the object is located on the right side as seen by the viewer), the detailed POI image is displayed in the third display area. Thus, the viewer can view (confirm) detailed information on the side (left or right) where the object is located. However, because a clearance area is provided, the detailed POI image is not displayed in an area overlapping the vehicle's travel path (for example, if the road in which the vehicle is traveling is divided into a "left edge area," a "center area," and a "right edge area," this corresponds to the "center area" where the vehicle is traveling). As a result, the detailed POI image does not interfere with the viewer's ability to check ahead or oncoming vehicles, reducing annoyance. Furthermore, a simplified superimposed POI image is displayed superimposed on an object on the left or right side of the road, and then (e.g., immediately thereafter), a detailed POI image is displayed below the superimposed image and on the same side (left or right) as the object. This allows the viewer to intuitively sense (recognize) that the display mode has changed and switched to a detailed display within their field of view. When the viewer instantaneously turns their gaze in the sensed direction, the detailed POI image comes into view, allowing them to see the detailed POI image and easily obtain information. In this case, the detailed POI image is displayed in close proximity to the object, for example, on the near side of the object, so that the viewer can easily memorize the detailed POI image and the object (specifically, the appearance of the object, an advertising sign, etc.) positioned in the background in a one-to-one correspondence. Thus, according to the eleventh aspect, the detailed POI image can be easily displayed at an appropriate timing and in an appropriate position without giving the viewer a sense of incongruity.

[0032] In a twelfth aspect, a display device includes a display unit that displays an image, and a display control device according to any one of the first to seventh aspects.

[0033] According to the twelfth aspect, a display device can be realized that can prevent the viewer from seeing multiple POI images as being disorganized and dispersed (in other words, discretely arranged) even when displaying POI images of both near and far objects from the viewer's perspective. Furthermore, a display device can be realized that can make POI images of distant objects easier to see and facilitate acquisition of POI information, even when multiple objects at different distances from the viewer are located at considerable distances. Furthermore, a display device can be realized that can easily perceive the sense of distance (perspective) of the POI images of each object. Furthermore, a display device can be realized that can provide information through POI images of objects that are not visible to the viewer because they do not face the road on which the vehicle is traveling or the road facing oncoming traffic. Furthermore, a display device can be realized that can appropriately control the display timing and display position while reducing the burden on the display control device.

[0034] In a thirteenth aspect dependent on the twelfth aspect, the display device may be a head-up display device that displays an image displayed on the display unit as the virtual image on the virtual image display surface by projecting display light of the image displayed on the display unit onto a projection target.

[0035] According to the thirteenth aspect, a highly functional and convenient head-up display device can be realized. Note that the term "head-up display" is to be interpreted in a broad sense. The projection target may be a vehicle windshield or the like. The projection target may also be the eyeglasses of a glasses-type head-mounted display. In this case, the head-mounted display can be understood as a type of head-up display in a broad sense. Therefore, it can be included in the present invention.

[0036] In a fourteenth aspect, the display control method includes a step of acquiring map information about objects around a vehicle and POI (Point Of Interest) information, which is information related to the objects; and a step of, when controlling the display when a POI image, which is an image representing the POI information, is displayed as a virtual image on a virtual virtual image display surface, displaying a warning POI image as a warning display that warns of the presence of the object while the vehicle is traveling, without superimposing it on the object, as seen by a viewer on board the vehicle.

[0037] According to the fourteenth aspect, a display control method can be realized that can prevent the viewer from seeing multiple POI images as being disorganized and dispersed (in other words, discretely arranged) even when POI images are displayed for both near and far objects. Furthermore, a display control method can be realized that can make POI images of distant objects easier to see and facilitate acquisition of POI information, even when multiple objects at different distances from the viewer are located at considerable distances. A display control method can be realized that can easily perceive the sense of distance (perspective) of the POI images of each object. Furthermore, a display control method can be realized that can provide information through POI images for objects that are not visible to the viewer because they do not face the road on which the vehicle is traveling or the road facing oncoming traffic. Furthermore, a display control method can be realized that can appropriately control the display timing and display position while reducing the burden of display processing. Those skilled in the art will readily understand that the exemplified aspects of the present invention can be further modified without departing from the spirit of the present invention.

[0038] FIG. 1 is a diagram showing an example of the configuration of a head-up display (HUD) device to which the present invention is applied, capable of superimposing a POI image on an object. FIG. 2 is a diagram showing an example of the configuration of a projection device installed in a dashboard. FIG. 3 is a diagram showing an example of the correspondence between a virtual image display surface in the HUD device and a display surface in a display unit (such as a display panel or a screen on which an image is displayed). FIGS. 4(A) and (B) are diagrams showing problems that the inventors considered before the present invention. FIGS. 5(A), (B), and (C) are diagrams showing examples of setting a display area on a virtual image display surface. FIGS. 6(A), (B-1), (B-2), and (B-3) are diagrams showing an example of display control of a first POI image (logo mark) in a simplified mode while a vehicle is traveling (corresponding to the display area setting in FIG. 5(A)). FIGS. 7(A), (B-1), and (B-2) are diagrams showing an example of display of a second POI image (a text image indicating a store name) in a detailed mode while a vehicle is traveling (corresponding to the display area setting in FIG. 5(A)). 8A, 8B, 8C, and 8D are diagrams showing an example of display control of the first POI image (logo mark) in a simplified mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5B). FIGS. 9A, 9B, 9C, 9D, and 9E are diagrams showing another example of display control of the first POI image (logo mark) in a simplified mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5B). FIGS. 10A, 10B, 10C, 10D, and 10E are diagrams showing an example of display control of the first POI image (logo mark) in a simplified mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5C). FIGS. 11A, 11B, and 11C are diagrams showing an example of display of the second POI image (a text image indicating the store name) in a detailed mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5C). FIG. 12 is a flowchart showing an example of a main procedure for display control.

[0039] The best mode described below is used to facilitate understanding of the present invention, and therefore, those skilled in the art should be aware that the present invention is not unduly limited by the embodiments described below.

[0040] (Device Configuration) Please refer to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of a head-up display (HUD) device to which the present invention is applied, which is capable of superimposing a POI image on an object. Note that the height direction of the vehicle 1 is defined as the up-down direction (Y direction), the width direction of the vehicle 1 is defined as the left-right direction (X direction), and the front-rear direction is defined as the Z direction.

[0041] As shown in A-1 of FIG. 1, the vehicle 1 is traveling ahead at a speed of 50 km / h on a straight road where the speed limit is 50 km / h.

[0042] A projection device 111 is installed inside the dashboard 41. In the example of FIG. 1, the projection device 111 includes a head-up display (HUD) device 100 and a windshield display (WSD) device 110.

[0043] In a broad sense, a WSD device is a type of HUD device. However, while an HUD device projects (projects) image display light onto a projection target (for example, the windshield 2) via an optical system, a WSD device projects (projects) image display light emitted from a display unit (such as a liquid crystal display device) directly onto a projection target without going through an optical system.

[0044] The HUD device 100 can display an image (POI image) showing POI (Point Of Interest) information, which is information related to an object, superimposed on the object.

[0045] In addition, in the example of Figure 1, the WSD device 110 is used to form the displays shown on the lower side of the windshield 2 (displays of the speed limit, vehicle speed, and a display indicating that a mode displaying popular shops along the line has been selected).

[0046] 1, the vehicle 1 is a left-hand drive vehicle in which the steering wheel 4 is located on the left side. The user of the HUD device 100 and the WSD device 110 is a driver 5 who is driving the vehicle 1. In the following description, the user may be referred to as a "viewer."

[0047] In the example of Figure 1, the store's logo mark α3 (a simplified POI image, which may be referred to as the "first POI image" in this specification) is displayed superimposed on the target store ARa.

[0048] As shown in A- 2 of FIG. 1, the display system 115 includes a communication unit 65 , a navigation device 70 , an ECU (Electronic Control Unit) 77 , and an HUD device 100 .

[0049] The HUD device 100 includes an information acquisition unit 81 , a storage (data accumulation unit) 82 , a display control device (processor) 80 , and a projection unit 90 .

[0050] The navigation device 70 has POI information 71 and map information 74. The POI information 71 has location information 72 about an object to be displayed as a POI, and additional information 73 about the object (e.g., the name of the store, its popularity, sales points, etc.).

[0051] The map information 74 also includes vehicle position information 75 and a display database 76. Information held by the navigation device 70 is supplied to a storage 82 in the display control device 80 as needed. The ECU 77 also acquires various types of information related to the driving state of the vehicle 1, and supplies the acquired information to an information acquisition unit 81 of the display control device 80.

[0052] The information acquisition unit 81 in the display control device 80 acquires map information 74 about objects ARa around the vehicle 1 and POI (Point Of Interest) information 71, which is information related to the objects. The information acquisition unit 81 can appropriately refer to the storage 82 and acquire various types of information stored in the storage 82. The various types of information acquired by the information acquisition unit 81 are supplied to the control unit 83.

[0053] The control unit 83 controls the display (virtual image display) of a POI image (logo mark α3 in Figure 1), which is an image representing POI information, when it is displayed as a virtual image on a virtual virtual image display surface (not shown in Figure 1, symbol PS1 in Figures 2 (A) and (B)).

[0054] The control unit 83 has an object extraction unit 89 that extracts (selects or identifies) objects to be displayed in a POI image. The object extraction is performed, for example, as follows. Reference is now made to FIG. 9A . An overhead map (bird's-eye view map) including the road on which the vehicle 1 is traveling is prepared, as shown in FIG. 9A (the specifics of which will be described later). Then, on the overhead map (bird's-eye view map), a fan-shaped area W, forming part of a semicircle with a radius of, for example, 500 m, is set in front of the vehicle 1, using a reference point on the vehicle 1 side (e.g., the viewer's viewpoint or a predetermined position of the vehicle 1: reference character E in FIG. 9A ). This fan-shaped area W is the range that the control unit 83 can control for display. Then, from the numerous objects within the fan-shaped area W, objects that can be displayed in a POI image are extracted. If there are too many objects, the number of objects can be limited by setting priorities based on popularity or the like.

[0055] Here, the object may include at least one of a nearby object within a distance range visible to the viewer and a distant object within a distance range not visible to the viewer. The object may also include at least one of a visible object (reference symbol ARa in FIG. 9A ) located facing the road on which the vehicle 1 is traveling (reference symbol 11 in FIG. 9A ) or an oncoming lane road and visible to the viewer while the vehicle 1 is traveling, and an invisible object (reference symbols ARb and ARc in FIG. 9A ) not facing the road 11 or an oncoming lane road and not visible to the viewer while the vehicle 1 is traveling (details will be described later). Thus, according to the display control device 80 of this embodiment, by displaying POI images (preview POI images to be described later) of a wider variety of objects along the road 11 on which the vehicle 1 is traveling, it is possible to enrich the information provided to the viewer and significantly improve the convenience of display devices such as a HUD device (reference symbol 100 in FIG. 2 ).

[0056] Continuing the explanation, returning to Figure 1. The control unit 83 also has an area setting unit 84 that sets multiple display areas on the virtual image display surface PS1, a display timing setting unit 85 that sets the display timing, a display position setting unit 86 that sets the display position, a display movement setting unit 87 that sets the display movement mode, and a display mode setting unit 88 that sets the display mode.

[0057] The projection unit 90 has a display unit (a display panel such as a liquid crystal display device, a screen for displaying images, etc.) 151 and a display optical system 92 that projects (projects) display light of the image onto the windshield 2.

[0058] Please refer to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of a projection device installed in a dashboard. In Fig. 2, parts common to Fig. 1 are assigned the same reference numerals.

[0059] In FIG. 2 , the projection device 111 includes an HUD device 100 and a WSD (windshield display) device 110 .

[0060] The HUD device 100 is housed in the dashboard 41. The HUD device 100 has a housing 103, a display unit (light source unit) 151 that emits image display light, and a concave mirror (curved mirror) 170 that constitutes an optical system. The concave mirror 170 projects an image (image display light) onto the windshield 2, which is a projection target.

[0061] A portion of the display light of the HUD device 100 is reflected by the windshield 2 and enters the eye (viewpoint) 3 of the driver (occupant) 5, resulting in a virtual image V1 being displayed on the virtual image display surface PS1. In the previously described FIG. 1 , a POI image α3 is displayed on this virtual image display surface PS1.

[0062] Furthermore, by not making the curvature of the concave mirror 170 uniform, but instead appropriately setting areas of high curvature, medium curvature, low curvature, etc., the virtual image display surface can be made into an inclined surface (for example, a curved inclined surface), making it possible to display with a sense of depth.

[0063] The WSD device 110 is a projection display device that projects display light of an image displayed on the display surface of the display 152 directly onto a projection target (windshield) 2 without passing through an optical system. A virtual image V2 is displayed on a virtual image display surface PS2 by the WSD device 110. In the previously described FIG. 1 , displays such as speed limits and vehicle speeds are displayed by the WSD device 110.

[0064] (Correspondence between Virtual Image Display Range and Image Display Range) Next, reference is made to Fig. 3. Fig. 3 is a diagram showing an example of the correspondence between a virtual virtual image display surface in a HUD device and a display surface in a display unit (such as a display panel or a screen on which an image is displayed). In Fig. 3, parts that are common to the previous drawings are assigned the same reference numerals.

[0065] 3, a display range (virtual image display range) 6 is set on the virtual image display surface PS1. A rectangular image (virtual image) QS is displayed on the left side of this display range (virtual image display range) 6.

[0066] 3A-2, a display surface 7 is set in the display unit 151. An image (real image) display range 9 is set on this display surface 7. On the left side of this image display range 9, a rectangular image (real image) QS' is displayed.

[0067] The display surface 7 corresponds to the virtual image display surface PS1, the image display range 9 corresponds to the display range 6, and the rectangular image (real image) QS' corresponds to the rectangular image (virtual image) QS. In this way, there is a one-to-one correspondence between the configurations shown in A-1 and A-2 in Figure 3.

[0068] The control unit 83 shown in Figure 1 controls the "image display" in the image display range 9 of the display unit 151 shown in A-2 of Figure 3, thereby controlling the "virtual image display" in the display range 6 on the virtual image display surface PS1 shown in A-1 of Figure 3.

[0069] Here, since "image display" and "virtual image display" have a one-to-one correspondence, the explanation of display control is the same whether it is for "image display" or "virtual image display."

[0070] In the following description, for the sake of convenience, the contents of display control in the present invention will be described by explaining the behavior of an image (virtual image) in the display range 6 on the virtual image display surface PS1.

[0071] (Problem Considered by the Inventor Prior to the Invention) Please refer to Figure 4. Figures 4(A) and (B) are diagrams showing a problem considered by the inventor prior to the invention. Note that this problem was identified by the inventor and is not a publicly known matter.

[0072] In FIG. 4A, simplified first POI images (here, logo marks) Q1 to Q4 are superimposed on popular stores located along the left and right sides of the road on which the vehicle 1 is traveling.

[0073] In the example of Figure 4 (A), from the viewer's (here, driver 5), a first POI image Q1 is superimposed on a nearby object on the left side, a first POI image Q2 is superimposed on a nearby object on the right side, a first POI image Q3 is superimposed on a distant object on the left side, and a first POI image Q4 is superimposed on a distant object on the right side.

[0074] In the example of FIG. 4A, the multiple first POI images Q1 to Q4 are arranged in a dispersed (discrete) manner in front of the viewer (driver 5), and are not displayed in an easy-to-view manner.

[0075] Furthermore, the first POI images Q3 and Q4, which are superimposed on distant objects, are drawn using perspective, so their size is quite small and difficult to see. Furthermore, the POI images Q3 and Q4, which are superimposed on distant objects, make it difficult to grasp the sense of distance (perspective). For example, it is unclear which of Q3 and Q4 is farther away.

[0076] Next, refer to FIG. 4(B). In FIG. 4(B), detailed POI images are displayed in association with popular stores located on the left and right sides of the road on which the vehicle 1 is traveling. The detailed POI images are sometimes referred to as "second POI images." In FIG. 4(B), second POI images J1 to J4 (here, supplementary information including text information and star-shaped symbols indicating popularity) are displayed.

[0077] From the viewer's (here, the driver 5) perspective, a second POI image J1 is displayed for a nearby object on the left side, a second POI image J2 is displayed for a nearby object on the right side, a second POI image J3 is displayed for a distant object on the left side, and a second POI image J4 is displayed for a distant object on the right side.

[0078] In the example of Figure 4 (B), the second POI images J3 and J4 displayed on distant objects are drawn using perspective, so their size is quite small and they are barely recognizable.

[0079] Furthermore, with regard to the second POI images J1 and J2 displayed on nearby objects, these nearby objects quickly flow away and disappear diagonally behind the viewer as the vehicle 1 moves, so the viewer may not be able to fully recognize the information contained in the second POI images J1 and J2.

[0080] Furthermore, for the second POI images J1 and J2, additional information including text information and star-shaped symbols indicating popularity is displayed in the form of a bubble in the area toward the center of the road, in other words, in the area overlapping with the route of vehicle 1. Therefore, it cannot be said that this will not interfere with the viewer's ability to check what is ahead, and it is also possible that the viewer will find it annoying.

[0081] Next, reference will be made to Fig. 5. Figs. 5(A), (B), and (C) are diagrams showing examples of setting a display area on a virtual image display surface.

[0082] In a preferred embodiment of the present invention, a plurality of display areas are set in the display range 6, and these display areas are used to appropriately control the display timing and display position of the POI image.

[0083] One possible method for controlling the display timing and display position of a POI image is to precisely calculate the relative positional relationship between the POI image and the object at any time using a predetermined formula based on map information, vehicle position information, and the vehicle's traveling speed, etc., and then use the calculation results to determine the display timing and display position. This invention does not exclude such methods, and such methods can also be included in the display control of the present invention.

[0084] However, since the vehicle 1 is moving and the distance to each object changes from time to time, strictly controlling the display timing and display position increases the processing load on the display control device (e.g., a processor) 80. This also increases the cost of the display control device 80. Furthermore, the processing time tends to be longer, and in this case, it cannot be said that display delays will not occur.

[0085] Therefore, in a preferred embodiment of the present invention, as described above, a plurality of display areas are set and the display areas are used to facilitate control of the display timing and display position of the POI image.

[0086] The display area can be set by the methods shown in FIGS. 5(A), 5(B), and 5(C).

[0087] In FIG. 5A, a first display area ZN1 is set above the display range 6 of the virtual image display surface PS1, a second display area ZN2 is set to the lower left of the first display area ZN1, and a third display area ZN3 is set to the lower right of the first display area ZN1. A clearance area ZN4 is set between the second and third POI display areas ZN2 and ZN3, where the display of the detailed second POI image is prohibited. In a preferred example, each of the areas ZN1 to ZN4 is a rectangular area. The clearance area ZN4 can also be considered a gap area between the second display area ZN2 and the third display area ZN3 in the left-right direction (X direction). In a preferred example, each of the areas ZN1 to ZN4 has a rectangular (quadratic) outer shape, and ZN2 and ZN3 are located below and adjacent to ZN1. However, ZN2 and ZN3 may be provided at a small distance from ZN1, or ZN2 and ZN3 may be provided so as to partially overlap ZN1 above and below.

[0088] In the first display area ZN1, a simplified first POI image (for example, a logo mark) can be displayed superimposed on the target object.

[0089] In the second display area, a second POI image (such as an image including characters and symbols) in a detailed form can be displayed for an object located on the left side of the road.

[0090] In the third display area, a second POI image (such as an image including characters and symbols) in a detailed form can be displayed for an object located on the right side of the road.

[0091] Here, the position of the first display area ZN1 in the height direction of the display range 6 will be described. As will be described later, in the present invention, when a simplified first POI image is applied to an object, the first POI image is not necessarily required to be superimposed on the object, and non-superimposed display is permitted. Here, if this non-superimposed display accidentally overlaps another object, it may mislead the viewer. To prevent this, the first display area ZN1, which defines the display position of the simplified first POI image, is preferably set above the vanishing point R, as shown in FIG. 5A . This is because it is considered unlikely that the simplified first POI image will be superimposed on the object at a position somewhat higher than the vanishing point R.

[0092] In other words, assuming that the vehicle 1 is traveling on a straight road with good visibility, the law of perspective dictates that the actual scene (background) ahead of the vehicle 1 is depicted as converging at the vanishing point R. Therefore, the object on which the simplified first POI image is superimposed is assumed to be located near the vanishing point R in the height direction of the display range 6 (appearing to the viewer at a height position near the vanishing point R), and it is considered rare for a display superimposed on that object to exist at a position higher than the vanishing point R. In consideration of this, the first display area ZN1 in which the simplified first POI image is displayed is positioned above the vanishing point R, so that the non-superimposed POI image is unlikely to overlap with other objects different from the original object. This prevents the viewer from being misled.

[0093] 5A , the display positions and timing of the first and second POI images can be easily set appropriately based on the set display area. For example, the display positions within each display area can be determined relative to each other, taking into account the distance to the object and the vehicle speed. Furthermore, simple control can be implemented, such as shifting the display position to the second or third display area when part or all of the first POI image enters a predetermined area within the first display area. Therefore, the processing load on the display control device (e.g., a processor, etc.), the cost of the control device, and processing time delays can be reduced with a simple configuration.

[0094] Referring to Fig. 5(B), in Fig. 5(B), an upper area Za located on the upper side and a lower area Zb located on the lower side are set within the first display area ZN1 in Fig. 5(A). Also, in Fig. 5(B), the second and third display areas for displaying the second POI image in a detailed form shown in Fig. 5(A) are not set.

[0095] Please refer to Fig. 5(C). Fig. 5(C) shows a display area configuration that combines Fig. 5(A) and Fig. 5(B). Fig. 5(C) shows an upper area Za and a lower area Zb set within a first display area ZN1, a second display area ZN2, and a third display area ZN3.

[0096] The first embodiment shown in FIGS. 6 and 7 corresponds to FIG. 5(A), the second embodiment shown in FIGS. 8 to 10 corresponds to FIG. 5(B), and the third embodiment shown in FIGS. 11 and 12 corresponds to FIG. 5(C).

[0097] (First embodiment) Please refer to Fig. 6. Figs. 6(A), (B-1), (B-2), and (B-3) are diagrams showing an example of simplified display control of a first POI image (logo mark) while a vehicle is traveling (corresponding to the display area setting in Fig. 5(A)). In Fig. 6, parts common to the previous figures are assigned the same reference numerals.

[0098] In the present invention, the second POI image in the detailed mode is not displayed immediately, but the first POI image in the simplified mode is first superimposed on the object, and then the second POI image is displayed. Figures 6(A), (B-1) to (B-3) show examples of display control of the first POI image in the simplified mode.

[0099] As shown in FIG. 6A, the first POI image (logo mark) α in the simplified form is displayed in a strip-shaped (horizontally long rectangular) first display area ZN1.

[0100] The first POI image moves to the left over time and gradually expands in size in accordance with the perspective technique. In Fig. 6, the images whose positions change over time are labeled α1 to α3 for easy identification. On the other hand, the image that represents a higher concept that collectively encompasses α1 to α3 is labeled α.

[0101] First, this first POI image (logo mark) α is ultimately displayed superimposed on an object ARa located on the left side of the road.

[0102] However, first, it is displayed as α1 in a position near the center of the first display area ZN1, and as time passes, the display position moves to the left. α1 moves leftward along the left-right direction to become α2, and α2 then moves leftward to become α3.

[0103] Furthermore, α3 is displayed at the left end or in the left end region of the first display region ZN1. This position of α3 is referred to as the "first display position."

[0104] In addition, as the image moves, the size of the image gradually increases due to perspective drawing. In other words, the size of α2 is larger than the size of α1, and the size of α3 is larger than the size of α2.

[0105] Figures 6 (B-1), (B-2), and (B-3) show how the first POI images α1, α2, and α3 appear to the viewer (driver 5) when the display control shown in Figure 6 (A) is implemented.

[0106] 6(B-1), the object ARa is located at a considerable distance, and the first POI image α1 is displayed closer to the viewer than the object ARa (nearby) without being superimposed on the object ARa. In this case, the first POI image α1 functions as a warning display that notifies the viewer in advance of basic matters such as "there is an object on the left side of the road" and "the object is still far away."

[0107] In Fig. 6(B-2), the object ARa is closer to the viewer than in Fig. 6(B-1), but is still located far away, and the first POI image α2 is displayed closer to the viewer than the object ARa (nearby) without being superimposed on the object ARa. In this situation, the size of the first POI image α2 is larger than the size of the first POI image α1 in Fig. 6(B-1), so the viewer can intuitively know that the object is approaching.

[0108] 6(B-3), the first POI image α3 has reached the left edge of the first display area ZN1 or the left edge area including the left edge (first display position). From the viewer's perspective, the first POI image α3 is superimposed on the object ARa, which is moving diagonally downward to the left and approaching the viewer considerably. The POI image superimposed on the object may be referred to as a "superimposed POI image."

[0109] In this situation, the viewer can reliably recognize the object ARa and can confirm that the first POI image α3 is superimposed on the object ARa, and therefore can intuitively grasp (recognize) the correspondence between the first POI image α3 and the object ARa.

[0110] In this way, when the display control shown in FIG. 6 is performed, the first POI display in the simplified mode is displayed before the second POI image in the detailed mode. Therefore, even if the number of objects on which POI images should be superimposed increases, the annoyance felt by the viewer (a passenger such as a driver) is reduced. Furthermore, even if the first POI image is displayed superimposed on a distant object, the first POI image is displayed with a small amount of information and is easy to see, so the difficulty in viewing is reduced, and the viewer is more likely to obtain useful information from the first POI image. Furthermore, by superimposing the first POI image on the object, the viewer can intuitively recognize (perceive) the correspondence between the first POI image and the object.

[0111] Furthermore, because the first POI image, which has a small amount of information and is easy to view, is displayed in advance, the first POI image functions as a preview display. A POI image with this preview display function is sometimes referred to as a "preview POI image." Therefore, before the second POI image with detailed information is displayed, the viewer can intuitively know in advance that an object to be displayed exists, as well as the approximate location and distance to the object. This reduces the sense of abruptness felt when the second POI image with a large amount of information is displayed, and reduces discomfort. Furthermore, because the viewer is provided with basic information through the advance warning, the viewer has more time to relax. Therefore, when the second POI image with a large amount of information is displayed, for example, in a driving situation where it is determined that checking the road ahead is a priority, the viewer does not need to direct their gaze to the second POI image. Therefore, the viewer's gaze is not suddenly drawn to the second POI image, which prevents them from becoming distracted from the road ahead.

[0112] In the example of FIG. 6, a strip-shaped first display area ZN1 is set above the display range 6, and the first POI image α is displayed within the display area ZN1.

[0113] In (B-3) of Figure 6, when the first POI image α3 is displayed so as to be superimposed on the object ARa, the first POI image α3 can be displayed at the "left end of the first display area, or the left end area including the left end," or at the "right end of the first display area, or the right end area including the right end."

[0114] The "left end" is "the area near the left end in the left-right direction in the first display area," and the "left end area including the left end" is "the area that includes the left end and is expanded further toward the center of the road." These areas can be freely set using software, for example, by a display control device, allowing for a high degree of freedom in design.

[0115] When viewed by a viewer (driver 5) of a vehicle 1 traveling ahead at a predetermined speed, an object located on the left (right) side of the road moves diagonally downward to the left (diagonally downward to the right) away from the center of the road over time, approaches the viewer, and eventually flows diagonally backward to the left (diagonally backward to the right) and disappears.

[0116] Assuming that the first display area ZN1 is set as a strip-shaped (rectangular) area having a predetermined height and a predetermined length in the left-right direction (however, this example is not limited to this), if we imagine a situation in which an object ARa located on the left (or right) side of the road approaches the vehicle 1 and is reliably visible to the viewer, it can be estimated that the object ARa in this case is located at the "left end (right end), or the left end area (right end area) including the left end (right end)" of the first display area ZN1 from the viewer's perspective.

[0117] Therefore, by displaying the first POI image α3 at a first display position in the "left end (right end), or the left end area (right end area) including the left end (right end)" of the first display area ZN1, when the object ARa moves diagonally downward to the left (diagonally downward to the right) and can be clearly seen by the viewer, the first POI image α3 is displayed at just the right time, and from the viewer's perspective, the first POI image α3 appears to be displayed superimposed on an appropriate position of an object of an easy-to-see size.

[0118] 6, the first POI image α can be accurately superimposed on the object ARa through simple control, thereby reducing the processing load on the display control device (e.g., a processor) 80.

[0119] After the first POI image α reaches the first display position in the first display area ZN1, a second POI image β having more detailed information about the object ARa is displayed, as will be described with reference to FIG.

[0120] Next, reference is made to Fig. 7. Figs. 7(A), (B-1), and (B-2) are diagrams (corresponding to the display area setting in Fig. 5(A)) showing an example of the display of a detailed second POI image (a text image showing the store name) while the vehicle is traveling. In Fig. 7, parts that are common to the previous drawings are given the same reference numerals. This also applies to the drawings of the second to fourth embodiments.

[0121] After the situation shown in FIG. 6(B-3), the second POI image β (β1 to β3) in a detailed form is displayed as shown in FIG. 7(B-1) and FIG. 7(B-2).

[0122] In Figure 7(A), in order to clarify the relationship with Figure 6(A) shown above, the first POI image α (α1 to α3) shown in Figure 6(A) is shown with dashed lines.

[0123] As described above, the display position of the first POI image α3 is referred to as the “first display position.” After the first POI image α3 reaches the first display position, the second POI image β (β1 in this case) is displayed in the upper left corner of the second display area ZN2 (for example, this position can be referred to as the “second display position”).

[0124] As with the first POI image α, when the second POI image is collectively referred to as a higher-level concept, it is expressed as the second POI image β, and when each second POI image is to be distinguished when its display position changes over time, it is expressed as the second POI images β1 to β3.

[0125] Here, the second POI image β is an image of text information (accompanying information) indicating that the object ARa is "S Pastry Shop."

[0126] As shown in Figure 7 (A), the display position (second display position) of the second POI image β1 is set below the display position (first display position) of the first POI image from the viewer's perspective, and is set to the left side of the road if the object ARa is on the left side of the road, and is set to the right side of the road if the object ARa is on the right side of the road.

[0127] However, the area ZN4 that overlaps with the travel route of the vehicle 1 is a clearance area, and display of the POI image is prohibited. Specifically, for example, if the road is divided into a "left edge area," a "center area," and a "right edge area," the "center area" is set as the clearance area ZN4, and the second POI image is not displayed. This prevents the second POI image β from interfering with the viewer's confirmation of the road ahead or oncoming vehicles, and reduces annoyance.

[0128] Furthermore, as previously shown in Figure 6, the first POI image is superimposed on the object on the left or right side of the road, and then (for example, immediately afterwards), the second POI image β is displayed below the superimposed display and on the same side (left or right) as the object, so the viewer can intuitively sense (recognize) that the display mode has changed within their field of view and switched to a detailed display.

[0129] When this happens, the viewer instantly turns his or her gaze in the perceived direction, and the second POI image β (β1 to β3) comes into view, allowing the viewer to see (confirm) the second POI image, making it easier to obtain information.

[0130] Also, at this time, the second POI image β is displayed, for example, in front of the object ARa and in close proximity to the object ARa, making it easy for the viewer to remember a one-to-one correspondence between the second POI image β and the object ARa located in the background (specifically, the appearance of the object, an advertising signboard, etc.).

[0131] 7A, the second POI image β1 displayed at the second display position in the second display area ZN2 moves downward as time passes, as seen by the viewer. β1 moves downward to become β2, and β2 moves downward to become β3.

[0132] The direction of downward movement is not particularly limited. For example, the second POI image β may be moved downward along the Y direction (up and down direction). However, in the example of Fig. 7(A) , the second POI image β is moved diagonally downward to the right as seen by the viewer so as to approach the viewer's viewpoint over time (the effect of this case will be described later).

[0133] Figures 7 (B-1) and (B-2) show how the second POI images β1, β2, and β3 appear to the viewer (driver 5) when the display control shown in Figure 7 (A) is implemented.

[0134] In FIG. 7(B-1), a second POI image β1 in a detailed form is displayed below the object ARa in association with the object ARa.

[0135] 7(B-2), the object ARa is closer to the vehicle 1, and the viewer can clearly recognize the exterior of the S confectionery store as the object ARa. In other words, the viewer can simultaneously see the detailed second POI image β3 and the S confectionery store as the target object ARa within the range 8 of their line of sight, making it easier for them to associate and remember the two.

[0136] Under these circumstances, the second POI image β, which is a text image of "S Confectionery Shop," moves downward (including diagonally downward) with a sense of perspective.

[0137] By moving the second POI image β downward, a dynamic visual impression can be given to the viewer, and a slight degree of eye-catchingness can be created without causing a sense of incongruity. This triggers the viewer to naturally turn their gaze toward the moving second POI image β. In this case, the second POI image β reliably catches the viewer's eye, allowing the viewer to reliably see the second POI image β, and making it easier to obtain information.

[0138] Furthermore, by controlling the size of the moving second POI image β to increase over time and adding a sense of perspective, the second POI image β can be displayed in a more natural and easy-to-view manner.

[0139] Furthermore, by moving the second POI image β diagonally downward (diagonally downward to the right) so that the distance to the viewer's viewpoint becomes closer over time, the sense of perspective is emphasized, and the viewer sees the second POI image β (β1 to β3) as being closer to their viewpoint, resulting in a more natural visual perception and further reducing the sense of discomfort.

[0140] Furthermore, by controlling the size of the second POI image β (β1 to β3) to increase over time as the second POI image β moves diagonally downward from the viewer's perspective over time, a more effective sense of perspective can be imparted to the second POI image β. In other words, as the second POI image β approaches the viewer, the size of the second POI image β gradually increases, making letters, symbols, and the like easier to see (or recognize). This makes it easier to obtain information and improves convenience.

[0141] In this way, by continuously using the display controls of Figures 6 and 7, the second POI image can be displayed at an appropriate timing and in an appropriate position without giving the viewer any sense of discomfort.

[0142] In other words, by dividing the information content into left and right displays depending on the object's position relative to the road, and by making the central display area corresponding to the vehicle's route a clearance area where no display is performed, it is possible to realize an easy-to-read POI display while organizing the information, and even if the number of displays increases, it is possible to effectively reduce the annoyance felt by the viewer, and it is also easier to control the display position and timing.

[0143] Second Embodiment Next, reference is made to Fig. 8. Figs. 8A, 8B-1, 8B-2, and 8B-3 are diagrams showing an example of simplified display control of a first POI image (logo mark) while a vehicle is traveling (corresponding to the display area setting in Fig. 5B). In Fig. 8, parts that are common to the previous drawings are given the same reference numerals.

[0144] In the example of Figure 8, an upper area Za located on the upper side and a lower area Zb located on the lower side are set within the first display area ZN1 (area capable of displaying a simplified POI image) previously shown in Figures 6 and 7. In the example of Figure 8, when the display of a simplified POI image as a preview POI image begins, a preview POI image (a simplified POI image) α1 is first displayed in the upper area Za. When the display of the preview POI image α1 begins, if the preview POI image α1 appears to be superimposed on an object other than the actual object, it will mislead the viewer. Therefore, it is necessary to avoid such a situation. Here, reference is made to Figure 5(B) previously shown. As shown in FIG. 5B , when traveling on a straight road, the objects to be displayed as superimposed POI images are often located near the vanishing point R (close to the vanishing point R) on the left and right sides of the road. Therefore, it is assumed that the higher the height position relative to the vanishing point R, the less frequently the superimposed POI image is displayed. Therefore, the upper region Za in the example of FIG. 8 is considered to be an area where the superimposed POI image is displayed less frequently. Taking this into consideration, in the example of FIG. 8 , when the simplified POI image as the advance notice POI image starts to be displayed, the advance notice POI image (simplified POI image) α1 is first displayed in the upper region Za to avoid superimposition with other objects and thereby avoid misleading the viewer (however, this is not limited to this, and α1 may also be displayed in the lower region Zb from the start of display). The advance notice POI image (simplified POI image) α1 then moves left or right in response to the vehicle 1's movement. This movement can include a diagonal movement to the lower left or diagonal movement to the lower right. The preview POI image α1 moves to the position of the preview POI image α2 over time. Thereafter, a superimposed POI image (a POI image in a simplified form) α3 is displayed at a first display position within the lower region Zb (the left end position, or a position within the left end region including the left end, or the right end position, or a position within the right end region including the right end). In other words, the non-superimposed "preview POI image" with a preview function moves further and overlaps the target object at the first display position, thereby losing its preview function and being converted into a "superimposed POI image."In the example of FIG. 8, the second and third display areas ZN2 and ZN3 for displaying the second POI image in the detailed form shown in FIGS. 6 and 7 are not set.

[0145] Figure 8(A) corresponds to Figure 6(A) described above, and Figures 8(B-1) to (B-3) correspond to Figures 6(B-1) to (B-3) described above. In the example of Figure 8, the actions and effects described in Figure 6 can be similarly obtained.

[0146] Furthermore, in Figure 8 (A), an upper area Za located on the upper side and a lower area Zb located on the lower side are set within the first display area ZN1, so that, for example, as shown on the left side of Figure 8 (A), it is easy to move the first POI image α (α1 to α3) diagonally downward so as to cross the boundary line between the upper area Za and the lower area Zb.

[0147] For example, by positioning the first POI image α1 in the upper region Za higher, the first POI image α1 appears farther away from the viewer. Similarly, by positioning the first POI image α3 in the lower region Zb lower, the first POI image α3 appears closer to the viewer. Therefore, by appropriately adjusting the display positions of the first POI images α1 and α3 in the respective regions Za and Zb and adjusting the slope of the line indicating the direction of movement when the POI image α is moved diagonally downward, the movement pattern and perspective of the POI image α as seen by the viewer can be adjusted more flexibly and freely.

[0148] In addition, in a normal display, it is considered rare to display a POI image in the area above the display range 6. However, in the example of Fig. 8(A), since the upper area Za is provided, it is possible to utilize all areas within this upper area Za to display POI images of objects that are located in areas that are quite far away from the viewer. In other words, it is possible to display, for example, a preview POI image for objects that are farther away (for example, objects within a 1 km range from the viewer).

[0149] Furthermore, as shown in FIG. 4A, without applying the present invention, when attempting to display POI images on distant objects, the viewer may experience a disjointed visual experience, with POI images displayed near and far from the viewer's perspective (see FIG. 4A). However, as is clear from FIGS. 8B-1 and 8B-2, in this embodiment, the first POI images α1 and α2 are not forcibly superimposed on distant objects, but are instead displayed as advance notice POI images near the viewer's perspective, thereby eliminating the disjointed visual experience. As is clear from FIGS. 8B-1 to 8B-3, a cohesive visual experience is achieved, thereby reducing the viewer's discomfort.

[0150] Next, reference will be made to Fig. 9. Figs. 9A, 9B, 9C-1, 9C-2, and 9C-3 are diagrams showing another example of simplified display control of the first POI image (logo mark) (corresponding to the display area setting in Fig. 5B). In the example (application example) of Fig. 9, a case will be described in which the objects include a mixture of "visible objects" that can be seen by the viewer while the vehicle 1 is traveling, and "invisible objects."

[0151] As described above, in the present invention, the "object" that can be displayed as a POI may include at least one of a "visible object" that is located facing the road in the driving lane in which vehicle 1 is traveling or the road in the oncoming lane, and is visible to the viewer while the vehicle is traveling, and an "invisible object" that is not facing the road in the driving lane or the road in the oncoming lane, and is not visible to the viewer while the vehicle is traveling.

[0152] Here, a typical example of a "visible object" located on the left side from the viewer's perspective is a store or the like facing the road in the driving lane, and from which it is possible to enter the store (including the parking lot) from the road in the driving lane.

[0153] A typical example of a "visible object" located on the right side of the viewer is a store or the like facing the road in the oncoming lane, in other words, a store or the like that can be entered by making a U-turn later. An "invisible object" is a store or the like that does not face the road in the driving lane or the oncoming lane, and is blocked from view by buildings or the like along the road, and therefore cannot be seen by the viewer while the vehicle is traveling.

[0154] 9A shows an overhead view map (bird's-eye view map) including a road 11 on which the vehicle 1 is traveling. In the overhead view map (bird's-eye view map), a fan-shaped area W that forms part of a semicircle with a radius of, for example, 500 m is set ahead of the vehicle 1, using a reference point on the vehicle 1 side (for example, the viewer's viewpoint position or a predetermined position of the vehicle 1: symbol E in FIG. 9A ). The fan-shaped area W is the range that the control unit 83 can control to display.

[0155] In Figure 9 (A), "visible objects" are indicated by "black circle symbols," and "invisible objects" are indicated by "cross symbols." The number of "visible objects" included in area W is four, and the number of "invisible objects" is six. These total of 10 objects can be candidates for display of the POI image (preview POI image).

[0156] In Fig. 9(A), the object extraction unit 89 in the control unit 83 shown in Fig. 1 extracts object ARa as a "visible object" from among these 10 object candidates, and extracts objects ARb and ARc as "invisible objects." Note that in Fig. 9(A), objects ARa, ARb, and ARc that are to be displayed in the preview POI image are marked with thick solid circles. In addition, when extracting objects, the number of objects may be limited by setting priorities based on, for example, the popularity of a store or the like, and selecting the top ones.

[0157] The objects ARa, ARb, and ARc are displayed with a predicted POI image. The predicted POI image is a POI image that notifies the vehicle 1 of basic POI information (information indicating the presence of an object and whether the object is located to the left or right as seen by the viewer) before the vehicle 1 reaches a position where each object can be recognized (a position where a POI image can be superimposed and displayed). Note that if the vehicle 1 is guided, for example, by a navigation display or the like, it can approach the "invisible objects ARb and ARc" by making appropriate course changes. The predicted POI image functions as a preliminary POI image that notifies the vehicle 1 of basic POI information in advance before the vehicle 1 approaches the object.

[0158] Since the preview POI image is a simplified POI image (here, a logo mark), it is displayed in the first display area ZN1, which is the area for displaying the simplified POI image. However, in FIG. 9B , the first display area ZN1 is divided into an upper area Za and a lower area Zb. Therefore, the preview POI images α (α1 to α3) for the "visible object" are displayed in the "lower area Zb." The preview POI images γ (γ1, γ2) and δ (δ1, δ2) for the "invisible object" are displayed in the "upper area Za." Since the preview POI image for the "invisible object" disappears over time, flowing diagonally backward to the left (right) from the viewer's perspective without being superimposed on the "invisible object," it is preferable to display it in the "upper area" so as not to interfere with the display of the superimposed POI image.

[0159] On the other hand, it is preferable to display the preview POI image for the "visible object" in the "lower area Zb" so that it can smoothly transition to the "superimposed POI image" (and further so that it can smoothly transition to the display of the POI image in the detailed form described below (see Figure 11)).

[0160] Furthermore, because the objects ARa and ARc are located on the left side of the road 11 on which the vehicle 1 is traveling (in other words, they appear to the left when viewed from the viewer), the advance notice POI images α (α1 to α3) and δ (δ1, δ2) move to the left over time in response to the vehicle 1's approach to the objects ARa and ARc. Furthermore, because the object ARb is located on the right side of the road 11 on which the vehicle 1 is traveling (in other words, they appear to the right when viewed from the viewer), the advance notice POI images γ (γ1, γ2) move to the right over time in response to the vehicle 1's approach to the object ARb. Furthermore, as the advance notice POI images (α, γ, δ) move, the size of the advance notice POI images increases over time to create a natural sense of perspective.

[0161] In Fig. 9(C-1), the preview POI images α1, γ1, and δ1 appear relatively far away from the viewer, and in Fig. 9(C-2), the preview POI images α2, γ2, and δ2 appear relatively close to the viewer.

[0162] In FIG. 9 (C-3), the advance notice POI image α3 is displayed so as to overlap the "visible object ARa" as seen by the viewer. At this time, the advance notice POI image α3 is located at the left end of the lower region Zb, or in the left end region including the left end. On the other hand, the advance notice POI image γ for the "invisible object ARb" is erased at the right end of the upper region Za, or in the right end region including the right end, outside the display range of the advance notice POI image γ. The viewer perceives the advance notice POI image γ as flowing diagonally backward to the right as the vehicle 1 travels, resulting in a natural visual sensation. Therefore, no discomfort is felt. Similarly, the advance notice POI image δ for the "invisible object ARc" is erased at the left end of the upper region Za, or in the left end region including the left end, when it goes out of the display range of the advance notice POI image δ. The viewer perceives the advance notice POI image δ as flowing diagonally backward to the left as the vehicle 1 travels, resulting in a natural visual sensation. Therefore, no sense of incongruity occurs.

[0163] (Third embodiment) Next, reference will be made to Figures 10 and 11. Figures 10(A), (B), (C-1), (C-2), and (C-3) are diagrams showing an example of display control of a first POI image (logo mark) in a simplified mode while a vehicle is traveling (corresponding to the display area setting in Figure 5(C)). Figures 11(A), (B-1), and (B-2) are diagrams showing an example of display of a second POI image (text image indicating a store name) in a detailed mode while a vehicle is traveling (corresponding to the display area setting in Figure 5(C)).

[0164] Figures 10(A), (B), and (C-1) to (C-3) correspond to Figures 9(A), (B), and (C-1) to (C-3) described above, except that second, third, and fourth display areas ZN2, ZN3, and ZN4 are set in Figures 10(A), (B), and (C-1) to (C-3), which were not set in Figures 9(A), (B), and (C-1) to (C-3).

[0165] 11(A), (B), (C-1) to (C-3), second, third, and fourth display areas ZN2, ZN3, and ZN4 are also set. Figures 11(A), (B-1), and (B-2) correspond to Figures 7(A), (B-1), and (B-2) described above.

[0166] In other words, in the examples of Figures 10 and 11, the display control of Figures 6 and 7 in the first embodiment described above and the display control of Figure 9 in the second embodiment described above are combined and implemented. Details of the display control have been described above, so a repeated description will be omitted.

[0167] 10 and 11, it is possible to display detailed POI images, providing a high degree of freedom in display control. Furthermore, by utilizing each display area, it is possible to realize various control of display positions and display timings while reducing the burden on the display control device (processor, etc.) 80.

[0168] Fourth Embodiment Next, reference will be made to Fig. 12. Fig. 12 is a flowchart showing an example of a main procedure for display control.

[0169] 12, information processing is performed, such as area setting processing for setting a display area (step S11), processing for detecting POI information of a display target (step S12), processing for acquiring supplementary information (detailed information) about the target (step S13), and processing for determining the initial display position in the horizontal and vertical directions in the display range and the initial display timing (step S14).

[0170] In step S2, a warning display process is performed. The warning display can be, for example, a display for notifying basic POI information in advance before the vehicle approaches the object and becomes recognizable. This display can be performed, for example, in the first display area. The warning display is displayed without being superimposed on the object. The warning display is preferably a simplified display (first display). For example, a warning display may be performed when a "visible object" that faces the driving lane or oncoming traffic and can be seen by the viewer is located far away. A warning display can also be performed appropriately for "invisible objects" that do not face the driving lane or oncoming traffic and cannot be seen by the viewer. The display may be shifted left or right over time, and the size of the display may be changed when shifting left or right to create a sense of perspective. A warning display (warning POI image) for an "invisible object" that does not face the road is erased when it goes outside the display range of the warning display (warning POI image).

[0171] In step S3, a superimposed display process is performed, for example, a process of displaying a superimposed POI image in a simplified mode (first mode) (specifically, a superimposed POI image of a "visible object" facing the driving lane or the oncoming lane) so that at least a part of the image overlaps with an object in a recognizable position (nearby).

[0172] In step S4, an additional information display process is performed, for example, a process of displaying additional information (second display mode) about a closer object in the left and right additional information display areas (second and third display areas).

[0173] In step S5, an incidental information movement process is performed. For example, a process is performed to move the display of the incidental information downward (including diagonally downward). In a preferred example, the incidental information may be moved diagonally downward so as to approach the viewer's viewpoint. When moving downward, the size of the display may be changed to create a sense of perspective.

[0174] As described above, according to the present invention, even when POI images are displayed for both near and far objects, it is possible to prevent the impression that multiple POI images are discretely arranged.

[0175] Furthermore, even if the POI image is of a distant object, the POI image can be made easier to see, making it easier to obtain POI information.

[0176] Furthermore, even when multiple objects at different distances from the viewer are located at a considerable distance, it is possible to make it easier to sense (understand) the sense of distance (perspective) of the POI image of each object.

[0177] Furthermore, when displaying a detailed POI image with a large amount of information, the inconvenience to the viewer can be reduced, and the correspondence between the POI image and the object can be easily grasped.

[0178] Furthermore, the correspondence between the POI image and the object can be clarified, making it easier for the viewer to remember it.

[0179] Furthermore, the display timing and display position can be appropriately controlled while reducing the burden on the display control device.

[0180] Furthermore, even when POI images are displayed for both near and far objects as seen by the viewer, a display device and display control method can be realized that can prevent the multiple POI images from appearing to be disorganized and dispersed (in other words, discretely) arranged.

[0181] Furthermore, it is possible to realize a display device and a display control method that can make a POI image, even if it is a POI image of a distant object, easier to view and make it easier to obtain POI information.

[0182] Furthermore, even when multiple objects at different distances from the viewer are located at a considerable distance, a display device and a display control method can be realized that make it easy to sense (grasp) the sense of distance (perspective) of the POI image of each object.

[0183] Furthermore, it is possible to realize a display device and a display control method that can appropriately control the display timing and display position while reducing the load of display processing.

[0184] Furthermore, it is possible to realize a display device and a display control method that can reduce the annoyance caused to the viewer when displaying a detailed POI image with a large amount of information.

[0185] Furthermore, it is possible to realize a display device and a display control method that can clarify the correspondence between the POI image and the object, making it easier for the viewer to remember it.

[0186] Furthermore, it is possible to realize a display device and a display control method that can appropriately control the display timing and display position while reducing the load of display processing.

[0187] In this specification, the term "vehicle" can be broadly interpreted as a vehicle or a moving object.

[0188] Furthermore, terms relating to navigation (such as map information) are to be interpreted broadly, taking into consideration the broader definition of navigation information that is useful for driving a vehicle.

[0189] The terms "simple POI image (simple display)" and "detailed POI image (detailed display)" are to be interpreted broadly and flexibly. For example, a logo mark, a photograph of a store, etc., can be a simple POI image. Also, for example, a logo mark that includes advertising text, etc., can be a detailed POI image.

[0190] The HUD device and display system also include those used as simulators (for example, aircraft simulators, simulators as game devices, etc.).

[0191] Furthermore, in the above-described embodiment, the projection display device has been mainly described as an HUD device, but the present invention is not limited to this, and for example, an in-car projector or the like can also be used.

[0192] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims.

[0193] 1...Vehicle (own vehicle), 2...Projected member (windshield, etc.), 3...Eye (viewpoint), 4...Steering wheel, 5...Occupant (driver, etc.), 6...Display range, 7...Display surface, 8...Gaze range, 9...Image display range, 41...Dashboard, 65...Communication unit, 70...Navigation device, 71...POI information, 72...Location information, 73...Additional information, 74...Map information, 75...Own vehicle position information, 76...Display database, 77...ECU, 80...Display control device, 81...Information acquisition unit, 82...storage, 83...control unit, 84...area setting unit, 85...display timing setting unit, 86...display position setting unit, 87...display movement setting unit, 88...display mode setting unit, 89...object extraction unit, 90...projection unit, 92...display optical system (optical system), 100...HUD device, 103...casing, 110...WSD device, 111...projection device, 151...display unit (light source unit), 152...display, 170...concave mirror (curved mirror), PS1, PS2...virtual image display surface, V1, V2...virtual image (image), R...vanishing point.

Claims

1. A display control device comprising: an information acquisition unit that acquires map information about objects around a vehicle and POI (Point Of Interest) information that is information related to the objects; and a control unit that controls the display of a POI image that is an image representing the POI information when it is displayed as a virtual image on a virtual image display surface, wherein the control unit performs display control to display a warning POI image, which is a warning display that warns of the presence of the object, without being superimposed on the object, as seen by a viewer boarding the vehicle while the vehicle is traveling.

2. A display control device as described in claim 1, wherein, when the width direction of the vehicle is the left-right direction, the control unit performs display control to display the predicted POI image in a position on the left side as seen by the viewer when the object is on the left side of the road on which the vehicle is traveling, and to display the predicted POI image in a position on the right side as seen by the viewer when the object is on the right side of the road.

3. The display control device according to claim 1, wherein the objects include at least one of objects in a distance range visible to the viewer and objects in a distance range not visible to the viewer.

4. The display control device of claim 1, wherein the objects include at least one of: visible objects that are located facing the road in the driving lane in which the vehicle is traveling or the road in the oncoming lane, and are visible to the viewer while the vehicle is traveling; and invisible objects that are not facing the road in the driving lane or the road in the oncoming lane, and are not visible to the viewer while the vehicle is traveling.

5. The display control device according to claim 4, wherein the control unit, if the object is the visible object, performs display control to display a superimposed POI image as a superimposed display superimposed on the object so as to be superimposed on the object as seen by the viewer after starting display of the preview POI image when the object approaches the viewer as the vehicle travels, and if the object is the invisible object, performs display control to erase the preview POI image when the preview POI image moves outside the display range for the preview POI image as the vehicle travels, after starting display of the preview POI image.

6. The display control device according to claim 1, wherein the control unit performs display control to move the preview POI image closer to the vehicle over time after starting to display the preview POI image.

7. The display control device according to claim 6, wherein the control unit performs display control to increase the size of the preview POI image over time while the preview POI image is moving, thereby giving the preview POI image a sense of perspective.

8. A display control device as described in claim 1, wherein, when the POI image is divided into a POI image in a simplified mode and a POI image in a detailed mode having more information than the POI image in the simplified mode, the preview POI image is the POI image in the simplified mode, and the control unit sets a first display area capable of displaying the POI image in the simplified mode above the display range of the virtual image display surface, and performs display control to display the preview POI image in the first display area.

9. The display control device of claim 8, wherein, when the height direction of the vehicle is the up-down direction and the width direction of the vehicle is the left-right direction, the control unit: sets an upper area at a higher position within the first display area and a lower area located below the upper area, and performs display control such that the preview POI image is displayed in the upper area when the object is a relatively distant object, and the preview POI image is displayed in the lower area when the object is a relatively close object; or, when the object is located facing the road of the driving lane in which the vehicle is traveling or the road of the oncoming lane, and is a visible object that is visible to the viewer while the vehicle is traveling, the preview POI image is displayed in the lower area, and when the object is not facing the road of the driving lane or the road of the oncoming lane, and is an invisible object that is not visible to the viewer while the vehicle is traveling, the preview POI image is displayed in the upper area.

10. The display control device according to claim 9, wherein the control unit, after starting to display the predicted POI image, performs display control to move the predicted POI image to the left when the object is on the left side of the road on which the vehicle is traveling, and to the right when the object is on the right.

11. The control unit further sets, within the display range of the virtual image display surface, a second display area located on the lower left side of the first display area and capable of displaying the POI image in the detailed aspect, a third display area located on the lower right side of the first display area and capable of displaying the POI image in the detailed aspect, and a clearance area located between the second and third display areas and in which display of the POI image in the detailed aspect is prohibited; and when the object is a display target for the POI image in the detailed aspect and the preview POI image is moved to the left, displays a superimposed POI image superimposed on the object in the left end part of the first area or in a left end area including the left end part, and then performs display control to display the POI image in the detailed aspect in the second display area; The display control device described in claim 10, wherein when the object is the display target of the POI image in the detailed aspect and the preview POI image is moved to the right, a superimposed POI image is displayed superimposed on the object at the right end of the first area or a right end area including the right end, and then display control is performed to display the POI image in the detailed aspect in the third display area.

12. A display device having a display unit that displays an image and a display control device described in any one of items 1 to 10.

13. The display device according to claim 12, wherein the display device is a head-up display device that displays an image displayed on the display unit as the virtual image on the virtual image display surface by projecting display light of the image on a projection target member.

14. A display control method including the steps of: acquiring map information about objects around a vehicle and POI (Point Of Interest) information, which is information related to the objects; and, when controlling the display of a POI image, which is an image representing the POI information, displayed as a virtual image on a virtual image display surface, displaying a warning POI image as a warning display warning of the presence of the object while the vehicle is traveling, without being superimposed on the object, as seen by a viewer aboard the vehicle.

Images