Display control device, display device, and display control method

Abstract

The present invention suppresses displaying of a POI image in a detailed mode having a great amount of information from being bothersome for a viewer, and also enables easy comprehension of a correspondence relation between the POI image and an object.　A display control device 80 includes an information acquisition unit 81 that acquires map information regarding an object in a vicinity of a vehicle 1 and POI information which is information related to the object, and a control unit 83 that controls display when displaying a POI image α, which is an image representing POI information, as a virtual image on a virtual image display plane PS which is imaginary. The control unit 83 causes a first POI image α (α3), which is in a simplified mode, to be superimposed and displayed as a POI image so as to be overlapped on an object ARa, and then causes a second POI image β (β1 to β3), which is in a detailed mode in which an amount of information is greater than that of the first POI image α, to be displayed at a second position which is below a first position that is a display position of the first POI image α, and also does not overlap a travel route of the vehicle 1.

Description

Display control device, display device, and display control method

[0001] The present invention relates to a display control device, a display device, a display control method, etc., that are mounted on a vehicle such as an automobile.

[0002] Patent Literature 1 describes a method of using a head-up display (HUD) device or the like to superimpose information related to points of interest (POIs) that may be of interest to vehicle occupants, such as the names of buildings and restaurants along the railroad line, onto the corresponding points in the actual scenery as POI displays through the windshield. This allows occupants to recognize information such as the identity of a building in the actual scenery ahead, when the restaurant is open, and how popular the restaurant is. Information such as distant scenery and tourist attractions may also be superimposed and displayed using a HUD device or the like.

[0003] Patent No. 6987208

[0004] POI images are broadly divided into "simplified POI images" with little information and "detailed POI images" with more information. A typical example of a "simplified POI image" is a logo (a design that symbolizes a company, store, organization, etc., in other words, a simplified symbol mark). An example of a "detailed POI image" is one that uses letters and symbols to express various information about a company, store, organization, etc. It can also be called "additional information" that indicates additional information that cannot be expressed in a logo.

[0005] The present inventors have investigated the case where a detailed POI image (such as a POI image showing additional information) is displayed using a HUD device or the like while the vehicle is traveling (particularly when the vehicle is traveling ahead at least at a normal traveling speed (e.g., approximately 40 km / h to 50 km / h)), and as a result, have obtained the following findings.

[0006] (1) As the number of POI images containing a large amount of information increases, the passengers (typically the "driver," but broadly speaking, the "viewer") in a moving vehicle may feel visually bothered. A specific example of this situation may arise when the driver of a vehicle is traveling on an unfamiliar road and attempts to thoroughly collect (extract) information about popular stores (e.g., stores popular with local residents and tourists) located on both sides of the road. In the following description, "stores, etc." may be referred to as "objects." (2) For example, consider a situation in which a vehicle is traveling steadily on a straight road and multiple (e.g., three or more) display candidate objects exist on both sides of the road. POI images containing a large amount of information inevitably occupy a larger display area. Considering this point, it is difficult to display detailed POI images of objects that are located quite far away from the passenger's perspective. (3) Furthermore, when a nearby object recognizable to the passenger is located on the left or right side of the road, it may be difficult to secure a large display space on the left or right side of the road. In this case, it may be possible to display a detailed POI image in the center of the road (i.e., in an area overlapping with the vehicle's travel path). However, in this case, since the POI image is displayed within the vehicle's travel path, it may interfere with the passenger's (driver's) vision of the road ahead (checking ahead, checking oncoming vehicles, etc.). This may be a cause of annoyance. (4) Because a detailed POI image contains a large amount of information, it may take a certain amount of time for the viewer to read it. For example, if a detailed POI image is displayed superimposed on an object when the viewer is close enough to the object to be able to see it, it may be perceived as somewhat abrupt. In this case, for example, it may be possible that the viewer passes by the object without seeing the POI image. (5) It is also conceivable that the viewer may have been able to obtain (confirm) the information contained in the POI image, but may not have had time to look at the appearance of the object, and may not have remembered the correspondence between the POI image and the object.(6) In practice, there are many problems when trying to put into practical use a technology for displaying POI images in association with objects using an in-vehicle display device. Therefore, it becomes necessary to display POI images, for example, at an appropriate timing and in an appropriate position. (7) However, since a vehicle is moving and the distance to each object changes from time to time, strictly controlling the display timing and display position increases the processing load on the display control device (e.g., a processor, etc.). This also increases the cost of the control device. Furthermore, the processing time tends to be longer, and in this case, it cannot be said that display delays will not occur. The above problems were identified by the present inventor.

[0007] One object of the present invention is to reduce the inconvenience to the viewer when displaying a detailed POI image with a large amount of information. Another object of the present invention is to clarify the correspondence between the POI image and the object, making it easier for the viewer to remember. Yet another object of the present invention is to enable appropriate control of the display timing and display position while reducing the burden on the display control device.

[0008] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings.

[0009] In order to facilitate an understanding of the outline of the present invention, the following examples are given of embodiments according to the present invention.

[0010] In a first aspect, the display control device has an information acquisition unit that acquires map information about objects around a vehicle and POI (Point Of Interest) information that is information related to the objects, and a control unit that controls the display when a POI image that is an image representing the POI information is displayed as a virtual image on a virtual image display surface, and when a height direction of the vehicle is defined as a vertical direction and a width direction of the vehicle is defined as a horizontal direction, the control unit superimposes a first POI image that is a simplified form as the POI image so as to overlap the object as seen by a viewer riding in the vehicle, and after the superimposed display, when the object is on the left side of a road on which the vehicle is traveling, the control unit superimposes the first POI image that is a simplified form as the POI image so as to overlap the object as seen by the viewer riding in the vehicle, and The second POI image, which is a more detailed version with more information than the first POI image, is displayed at a second position which is below the first position where the POI image is displayed, on the left side of the road, and which does not overlap with the vehicle's travel route, and if the object is on the right side of the road on which the vehicle is traveling, the second POI image, which is a more detailed version with more information than the first POI image, is displayed at a third position which is below the first position where the superimposed first POI image is displayed, on the right side of the road, and which does not overlap with the vehicle's travel route, as seen by the viewer.

[0011] In the first aspect, the second POI image in the detailed aspect is not displayed immediately, but the first POI image in the simplified aspect is first superimposed on the object, and then the second POI image is displayed. Because the first POI display in the simplified aspect is displayed first, even if the number of objects on which POI images should be superimposed increases, the annoyance felt by the viewer (a passenger such as a driver) is reduced. Furthermore, even if the first POI image is displayed superimposed on a distant object, the first POI image is displayed with a small amount of information and is easy to see, so the difficulty in viewing is reduced, and the viewer is more likely to obtain useful information from the first POI image. Furthermore, by superimposing the first POI image on the object, the viewer can intuitively recognize (perceive) the correspondence between the first POI image and the object.

[0012] Furthermore, because the first POI image, which has a small amount of information and is easy to view, is displayed in advance, the first POI image functions as a preview display. Therefore, the viewer can intuitively know in advance that the object to be displayed exists and the approximate location of the object before the second POI image, which contains detailed information, is displayed. This reduces the sense of abruptness felt when the second POI image, which contains a large amount of information, is displayed, and reduces discomfort. Furthermore, because the viewer is provided with basic information through the preview, the viewer has more time to relax. Therefore, when the second POI image, which has a large amount of information, is displayed, for example, in a driving situation where it is determined that checking the road ahead is a priority, the viewer does not need to direct their gaze toward the second POI image. Therefore, the viewer's gaze is not suddenly drawn to the second POI image, which prevents them from becoming distracted from the road ahead.

[0013] In this embodiment, a second POI image having more detailed information about the object is then displayed. The display position of the second POI image (second display position) is set below the display position of the first POI image (first display position) from the viewer's perspective, and is set to the left side of the road if the object is on the left side of the road, or to the right side of the road if the object is on the right side of the road. However, the second POI image is not displayed in an area that overlaps with the vehicle's travel path (for example, if the road is divided into a "left edge area," a "center area," and a "right edge area," this corresponds to the "center area"). This prevents the second POI image from interfering with the viewer's confirmation of the road ahead or oncoming vehicles, and reduces annoyance. Furthermore, a first POI image is superimposed on an object on the left or right side of the road, and then (e.g., immediately thereafter) a second POI image is displayed below the superimposed image and on the same side (left or right) as the object. This allows the viewer to intuitively sense (recognize) that the display mode has changed and switched to a detailed display within their field of view. Taking this as an opportunity, the viewer can instantly turn their gaze in the sensed direction, whereupon the second POI image comes into view and can be seen, facilitating the acquisition of information. Furthermore, at this time, the second POI image is displayed, for example, in front of the object and in close proximity to it. This makes it easy for the viewer to memorize a one-to-one correspondence between the second POI image and the object (specifically, the object's appearance, an advertising sign, etc.) located in the background of the second POI image.

[0014] In this way, according to the first aspect, the second POI image can be displayed at an appropriate timing and in an appropriate position without giving the viewer a sense of incongruity.

[0015] In other words, according to the first aspect, displays with a large amount of information are displayed on the left and right depending on the position of the object relative to the road, and the central display area corresponding to the vehicle's driving route is made a clearance area where no display is performed, thereby making it possible to realize POI display that is easy to read while organizing information, and even if the number of displays increases, it is possible to effectively reduce the annoyance felt by the viewer.

[0016] In a second aspect dependent on the first aspect, the control unit may further move the second POI image displayed at the second position downward as viewed by the viewer.

[0017] According to the second aspect, by moving the second POI image downward, a dynamic visual impression can be given to the viewer, and the visibility can be improved without creating a sense of incongruity. This triggers the viewer to naturally turn their gaze toward the moving second POI image. In this case, the second POI image reliably catches the viewer's eye, allowing the viewer to reliably see the second POI image and more easily obtain information.

[0018] In a third aspect dependent on the second aspect, the control unit may give the second POI image a sense of perspective by moving the second POI image so that the size of the second POI image increases over time.

[0019] In the third aspect, the size of the moving second POI image is increased over time to create a sense of perspective, thereby making the second POI image appear more natural and easier to view.

[0020] In a fourth aspect dependent on the first aspect, the control unit may move the second POI image displayed at the second position diagonally downward from the viewer's perspective so that the distance to the viewer's viewpoint becomes closer over time.

[0021] The fourth aspect is the same as the second aspect in that the second POI image is moved downward. However, in the fourth aspect, the second POI image is moved diagonally downward from the viewer's perspective so that the distance to the viewer's viewpoint becomes closer over time. This makes the viewer see the second POI image as if it is approaching their viewpoint, which creates a natural visual sensation and can further reduce the sense of incongruity.

[0022] In a fifth aspect dependent on the fourth aspect, the control unit may give the second POI image a sense of perspective by moving the second POI image so that the size of the second POI image increases over time.

[0023] According to the fifth aspect, as the second POI image approaches the viewer, the size of the second POI image gradually increases, making it easier to see (or recognize) characters, symbols, etc. This makes it easier to obtain information and improves convenience.

[0024] In a sixth aspect dependent on any one of the first to fifth aspects, the control unit may set, within the display range of the virtual image display surface, a first display area in which the first POI image can be superimposed so as to overlap the object, a second display area in which the second POI image can be displayed and which is located on the lower left side of the first display area, a third display area in which the second POI image can be displayed and which is located on the lower right side of the first display area, and a clearance area located between the second and third display areas in which display of the second POI image is prohibited, and may display the first POI image in the first display area, and if the object is located on the left side of the road on which the vehicle is traveling, display the second POI image in the second display area, and if the object is located on the right side of the road on which the vehicle is traveling, display the second POI image in the third display area.

[0025] In the sixth aspect, first to third display areas are set on the virtual image display surface, and the display positions and display timings of the first and second POI displays in the first aspect (and also in the second to fifth aspects) described above are easily controlled using each display area.

[0026] One possible method for appropriately controlling the display timing and display position of the first and second POI images is to precisely calculate the relative positional relationship between the first and second POI images and the object using a predetermined formula based on map information, vehicle position information, and the vehicle's traveling speed, and then determine the display timing and display position using the calculation results. This method is not excluded by the present invention, and can also be included in the display control of the present invention. However, because the vehicle is moving and the distance to each object changes constantly, strictly controlling the display timing and display position increases the processing load on the display control device (e.g., a processor, etc.). This also increases the cost of the control device. Furthermore, this tends to increase processing time, which may result in display delays.

[0027] Therefore, in this aspect, as described above, first to third display areas are provided, and the first POI image is displayed in the first display area, and the second POI image is displayed in the display area (second or third display area) on the same side depending on whether the object is on the left or right side of the road. Using this configuration, for example, it is possible to determine the relative display position within each display area taking into account the distance to the object and the vehicle speed. It is also possible to implement simple control, such as shifting the display position to the second or third display area when part or all of the first POI image enters a predetermined area within the first display area. Therefore, it is possible to reduce the processing load of the display control device (e.g., a processor), the cost of the control device, and processing time delays with a simple configuration.

[0028] In a seventh aspect that is dependent on the sixth aspect, the control unit may, when the object is located on the left side of the road on which the vehicle is traveling, display the first POI image so as to be superimposed on the object at the left end including the left end of the first display area, or at the left end region including the left end, and when the object is located on the right side of the road on which the vehicle is traveling, display the first POI image so as to be superimposed on the object at the right end including the right end of the first display area, or at the right end region including the right end.

[0029] In the seventh aspect, when the first POI image is displayed so as to be superimposed on the object, the first POI image is displayed in the "left edge of the first display area, or the left edge region including the left edge," or the "right edge of the first display area, or the right edge region including the right edge." Note that the "left edge" is "the region near the left edge in the left-right direction of the first display area," and the "left edge region including the left edge" is "the region that includes the left edge and whose area is further expanded toward the center of the road," and these regions can be freely set by software, for example, by a display control device, allowing for a high degree of design freedom.

[0030] As seen by a passenger (viewer) in a vehicle traveling ahead at a predetermined speed, an object located on the left (right) side of the road moves diagonally downward to the left (right) and away from the center of the road over time, approaching the viewer, and eventually disappearing diagonally backward to the left (right). For example, assume that the first display area is set as a strip-shaped area having a predetermined height and a predetermined length in the left-right direction (this is an example and is not limited to this). Assuming a situation in which an object located on the left (or right) side of the road approaches the vehicle and can be reliably identified by the viewer, the object in this case is estimated to be located at the "left end (right end), or the left end region (right end region) including the left end (right end)" of the first display area, as seen by the viewer. Therefore, by displaying the first POI image in the "left end (right end) or the left end region (right end region) including the left end (right end)" of the first display region, when the object moves diagonally downward to the left (diagonally downward to the right) and can be clearly seen by the viewer, the first POI image is displayed at just the right time, and from the viewer's perspective, the first POI image appears to be superimposed at an appropriate position on the object of an easy-to-see size. Thus, according to the seventh aspect, with simple control, it is possible to accurately superimpose the first POI image on the object at the appropriate time. This reduces the processing load on the display control device (e.g., a processor, etc.).

[0031] In an eighth aspect, a display device includes a display unit that displays an image, and a display control device according to any one of the first to seventh aspects.

[0032] According to the eighth aspect, it is possible to realize a display device that can reduce the inconvenience to the viewer when displaying a detailed POI image with a large amount of information. Also, it is possible to realize a display device that can clarify the correspondence between the POI image and the object, making it easier for the viewer to remember. Furthermore, it is possible to realize a display device that can appropriately control the display timing and display position while reducing the burden of display processing.

[0033] In a ninth aspect dependent on the eighth aspect, the display device may be a head-up display device that displays an image displayed on the display unit as the virtual image on the virtual image display surface by projecting display light of the image displayed on the display unit onto a projection target.

[0034] According to the tenth aspect, a highly functional and convenient head-up display device can be realized. Note that the term "head-up display" is to be interpreted in a broad sense. The projection target may be a vehicle windshield or the like. The projection target may also be the eyeglasses of a glasses-type head-mounted display. In this case, the head-mounted display can be understood as a type of head-up display in a broad sense. Therefore, it can be included in the present invention.

[0035] In a tenth aspect, the display control method includes the steps of: acquiring map information about objects around a vehicle and POI (Point Of Interest) information that is information related to the objects; and displaying a POI image that is an image representing the POI information as a virtual image on a virtual image display surface, where the height direction of the vehicle is the up-down direction, the width direction of the vehicle is the left-right direction, and the object is located on at least one of the left and right sides of a road on which the vehicle is traveling, as viewed from a viewer in the vehicle; and after the superimposition, displaying a second POI image that is a detailed aspect with more information than the first POI image at a second position that is, as viewed from the viewer, below a first position that is the display position of the superimposed first POI image and does not overlap with the vehicle's traveling route.

[0036] According to the tenth aspect, a display control method can be realized that can reduce the annoyance caused to the viewer when displaying a detailed POI image with a large amount of information. It is also possible to realize a display control method that can clarify the correspondence between the POI image and the object, making it easier for the viewer to remember. It is also possible to realize a display control method that can appropriately control the display timing and display position while reducing the burden of display processing.

[0037] Those skilled in the art will easily understand that the exemplified embodiments according to the present invention can be further modified without departing from the spirit of the present invention.

[0038] FIG. 1 is a diagram showing an example of the configuration of a head-up display (HUD) device to which the present invention is applied, capable of superimposing a POI image on an object. FIG. 2 is a diagram showing an example of the configuration of a projection device installed in a dashboard. FIG. 3 is a diagram showing an example of the correspondence between a virtual image display surface in the HUD device and a display surface in a display unit (such as a display panel or a screen on which an image is displayed). FIGS. 4(A) and (B) are diagrams showing problems that the inventors considered before the present invention. FIGS. 5(A), (B), and (C) are diagrams showing examples of setting a display area on a virtual image display surface. FIGS. 6(A), (B-1), (B-2), and (B-3) are diagrams showing an example of display control of a first POI image (logo mark) in a simplified mode while a vehicle is traveling (corresponding to the display area setting in FIG. 5(A)). FIGS. 7(A), (B-1), and (B-2) are diagrams showing an example of display of a second POI image (a text image indicating a store name) in a detailed mode while a vehicle is traveling (corresponding to the display area setting in FIG. 5(A)). 8A, 8B, 8C, and 8D are diagrams showing an example of display control of the first POI image (logo mark) in a simplified mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5B). FIGS. 9A, 9B, 9C, 9D, and 9E are diagrams showing another example of display control of the first POI image (logo mark) in a simplified mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5B). FIGS. 10A, 10B, 10C, 10D, and 10E are diagrams showing an example of display control of the first POI image (logo mark) in a simplified mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5C). FIGS. 11A, 11B, and 11C are diagrams showing an example of display of the second POI image (a text image indicating the store name) in a detailed mode while the vehicle is traveling (corresponding to the display area setting in FIG. 5C). FIG. 12 is a flowchart showing an example of a main procedure for display control.

[0039] The best mode described below is used to facilitate understanding of the present invention, and therefore, those skilled in the art should be aware that the present invention is not unduly limited by the embodiments described below.

[0040] (Device Configuration) Please refer to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of a head-up display (HUD) device to which the present invention is applied, which is capable of superimposing a POI image on an object. Note that the height direction of the vehicle 1 is defined as the up-down direction (Y direction), the width direction of the vehicle 1 is defined as the left-right direction (X direction), and the front-rear direction is defined as the Z direction.

[0041] As shown in A-1 of FIG. 1, the vehicle 1 is traveling ahead at a speed of 50 km / h on a straight road where the speed limit is 50 km / h.

[0042] A projection device 111 is installed inside the dashboard 41. In the example of FIG. 1, the projection device 111 includes a head-up display (HUD) device 100 and a windshield display (WSD) device 110.

[0043] In a broad sense, a WSD device is a type of HUD device. However, while an HUD device projects (projects) image display light onto a projection target (for example, the windshield 2) via an optical system, a WSD device projects (projects) image display light emitted from a display unit (such as a liquid crystal display device) directly onto a projection target without going through an optical system.

[0044] The HUD device 100 can display an image (POI image) showing POI (Point Of Interest) information, which is information related to an object, superimposed on the object.

[0045] In addition, in the example of Figure 1, the WSD device 110 is used to form the displays shown on the lower side of the windshield 2 (displays of the speed limit, vehicle speed, and a display indicating that a mode displaying popular shops along the line has been selected).

[0046] 1, the vehicle 1 is a left-hand drive vehicle in which the steering wheel 4 is located on the left side. The user of the HUD device 100 and the WSD device 110 is a driver 5 who is driving the vehicle 1. In the following description, the user may be referred to as a "viewer."

[0047] In the example of Figure 1, the store's logo mark α3 (a simplified POI image, which may be referred to as the "first POI image" in this specification) is displayed superimposed on the target store ARa.

[0048] As shown in A- 2 of FIG. 1, the display system 115 includes a communication unit 65 , a navigation device 70 , an ECU (Electronic Control Unit) 77 , and an HUD device 100 .

[0049] The HUD device 100 includes an information acquisition unit 81 , a storage (data accumulation unit) 82 , a display control device (processor) 80 , and a projection unit 90 .

[0050] The navigation device 70 has POI information 71 and map information 74. The POI information 71 has location information 72 about an object to be displayed as a POI, and additional information 73 about the object (e.g., the name of the store, its popularity, sales points, etc.).

[0051] The map information 74 also includes vehicle position information 75 and a display database 76. Information held by the navigation device 70 is supplied to a storage 82 in the display control device 80 as needed. The ECU 77 also acquires various types of information related to the driving state of the vehicle 1, and supplies the acquired information to an information acquisition unit 81 of the display control device 80.

[0052] The information acquisition unit 81 in the display control device 80 acquires map information 74 about objects ARa around the vehicle 1 and POI (Point Of Interest) information 71, which is information related to the objects. The information acquisition unit 81 can appropriately refer to the storage 82 and acquire various types of information stored in the storage 82. The various types of information acquired by the information acquisition unit 81 are supplied to the control unit 83.

[0053] The control unit 83 controls the display (virtual image display) of a POI image (logo mark α3 in Figure 1), which is an image representing POI information, when it is displayed as a virtual image on a virtual virtual image display surface (not shown in Figure 1, symbol PS1 in Figures 2 (A) and (B)).

[0054] The control unit 83 has an object extraction unit 89 that extracts (selects or identifies) objects to be displayed in a POI image. The object extraction is performed, for example, as follows. Reference is now made to FIG. 9A . An overhead map (bird's-eye view map) including the road on which the vehicle 1 is traveling is prepared, as shown in FIG. 9A (the specifics of which will be described later). Then, on the overhead map (bird's-eye view map), a fan-shaped area W, forming part of a semicircle with a radius of, for example, 500 m, is set in front of the vehicle 1, using a reference point on the vehicle 1 side (e.g., the viewer's viewpoint or a predetermined position of the vehicle 1: reference character E in FIG. 9A ). This fan-shaped area W is the range that the control unit 83 can control for display. Then, from the numerous objects within the fan-shaped area W, objects that can be displayed in a POI image are extracted. If there are too many objects, the number of objects can be limited by setting priorities based on popularity or the like.

[0055] Here, the object may include at least one of a nearby object within a distance range visible to the viewer and a distant object within a distance range not visible to the viewer. The object may also include at least one of a visible object (reference symbol ARa in FIG. 9A ) located facing the road on which the vehicle 1 is traveling (reference symbol 11 in FIG. 9A ) or an oncoming lane road and visible to the viewer while the vehicle 1 is traveling, and an invisible object (reference symbols ARb and ARc in FIG. 9A ) not facing the road 11 or an oncoming lane road and not visible to the viewer while the vehicle 1 is traveling (details will be described later). Thus, according to the display control device 80 of this embodiment, by displaying POI images (preview POI images to be described later) of a wider variety of objects along the road 11 on which the vehicle 1 is traveling, it is possible to enrich the information provided to the viewer and significantly improve the convenience of display devices such as a HUD device (reference symbol 100 in FIG. 2 ).

[0056] Continuing the explanation, returning to Figure 1. The control unit 83 also has an area setting unit 84 that sets multiple display areas on the virtual image display surface PS1, a display timing setting unit 85 that sets the display timing, a display position setting unit 86 that sets the display position, a display movement setting unit 87 that sets the display movement mode, and a display mode setting unit 88 that sets the display mode.

[0057] The projection unit 90 has a display unit (a display panel such as a liquid crystal display device, a screen for displaying images, etc.) 151 and a display optical system 92 that projects (projects) display light of the image onto the windshield 2.

[0058] Please refer to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of a projection device installed in a dashboard. In Fig. 2, parts common to Fig. 1 are assigned the same reference numerals.

[0059] In FIG. 2 , the projection device 111 includes an HUD device 100 and a WSD (windshield display) device 110 .

[0060] The HUD device 100 is housed in the dashboard 41. The HUD device 100 has a housing 103, a display unit (light source unit) 151 that emits image display light, and a concave mirror (curved mirror) 170 that constitutes an optical system. The concave mirror 170 projects an image (image display light) onto the windshield 2, which is a projection target.

[0061] A portion of the display light of the HUD device 100 is reflected by the windshield 2 and enters the eye (viewpoint) 3 of the driver (occupant) 5, resulting in a virtual image V1 being displayed on the virtual image display surface PS1. In the previously described FIG. 1 , a POI image α3 is displayed on this virtual image display surface PS1.

[0062] Furthermore, by not making the curvature of the concave mirror 170 uniform, but instead appropriately setting areas of high curvature, medium curvature, low curvature, etc., the virtual image display surface can be made into an inclined surface (for example, a curved inclined surface), making it possible to display with a sense of depth.

[0063] The WSD device 110 is a projection display device that projects display light of an image displayed on the display surface of the display 152 directly onto a projection target (windshield) 2 without passing through an optical system. A virtual image V2 is displayed on a virtual image display surface PS2 by the WSD device 110. In the previously described FIG. 1 , displays such as speed limits and vehicle speeds are displayed by the WSD device 110.

[0064] (Correspondence between Virtual Image Display Range and Image Display Range) Next, reference is made to Fig. 3. Fig. 3 is a diagram showing an example of the correspondence between a virtual virtual image display surface in a HUD device and a display surface in a display unit (such as a display panel or a screen on which an image is displayed). In Fig. 3, parts that are common to the previous drawings are assigned the same reference numerals.

[0065] 3, a display range (virtual image display range) 6 is set on the virtual image display surface PS1. A rectangular image (virtual image) QS is displayed on the left side of this display range (virtual image display range) 6.

[0066] 3A-2, a display surface 7 is set in the display unit 151. An image (real image) display range 9 is set on this display surface 7. On the left side of this image display range 9, a rectangular image (real image) QS' is displayed.

[0067] The display surface 7 corresponds to the virtual image display surface PS1, the image display range 9 corresponds to the display range 6, and the rectangular image (real image) QS' corresponds to the rectangular image (virtual image) QS. In this way, there is a one-to-one correspondence between the configurations shown in A-1 and A-2 in Figure 3.

[0068] The control unit 83 shown in Figure 1 controls the "image display" in the image display range 9 of the display unit 151 shown in A-2 of Figure 3, thereby controlling the "virtual image display" in the display range 6 on the virtual image display surface PS1 shown in A-1 of Figure 3.

[0069] Here, since "image display" and "virtual image display" have a one-to-one correspondence, the explanation of display control is the same whether it is for "image display" or "virtual image display."

[0070] In the following description, for the sake of convenience, the contents of display control in the present invention will be described by explaining the behavior of an image (virtual image) in the display range 6 on the virtual image display surface PS1.

[0071] (Problem Considered by the Inventor Prior to the Invention) Please refer to Figure 4. Figures 4(A) and (B) are diagrams showing a problem considered by the inventor prior to the invention. Note that this problem was identified by the inventor and is not a publicly known matter.

[0072] In FIG. 4A, simplified first POI images (here, logo marks) Q1 to Q4 are superimposed on popular stores located along the left and right sides of the road on which the vehicle 1 is traveling.

[0073] In the example of Figure 4 (A), from the viewer's (here, driver 5), a first POI image Q1 is superimposed on a nearby object on the left side, a first POI image Q2 is superimposed on a nearby object on the right side, a first POI image Q3 is superimposed on a distant object on the left side, and a first POI image Q4 is superimposed on a distant object on the right side.

[0074] In the example of FIG. 4A, the multiple first POI images Q1 to Q4 are arranged in a dispersed (discrete) manner in front of the viewer (driver 5), and are not displayed in an easy-to-view manner.

[0075] Furthermore, the first POI images Q3 and Q4, which are superimposed on distant objects, are drawn using perspective, so their size is quite small and difficult to see. Furthermore, the POI images Q3 and Q4, which are superimposed on distant objects, make it difficult to grasp the sense of distance (perspective). For example, it is unclear which of Q3 and Q4 is farther away.

[0076] Next, refer to FIG. 4(B). In FIG. 4(B), detailed POI images are displayed in association with popular stores located on the left and right sides of the road on which the vehicle 1 is traveling. The detailed POI images are sometimes referred to as "second POI images." In FIG. 4(B), second POI images J1 to J4 (here, supplementary information including text information and star-shaped symbols indicating popularity) are displayed.

[0077] From the viewer's (here, the driver 5) perspective, a second POI image J1 is displayed for a nearby object on the left side, a second POI image J2 is displayed for a nearby object on the right side, a second POI image J3 is displayed for a distant object on the left side, and a second POI image J4 is displayed for a distant object on the right side.

[0078] In the example of Figure 4 (B), the second POI images J3 and J4 displayed on distant objects are drawn using perspective, so their size is quite small and they are barely recognizable.

[0079] Furthermore, with regard to the second POI images J1 and J2 displayed on nearby objects, these nearby objects quickly flow away and disappear diagonally behind the viewer as the vehicle 1 moves, so the viewer may not be able to fully recognize the information contained in the second POI images J1 and J2.

[0080] Furthermore, for the second POI images J1 and J2, additional information including text information and star-shaped symbols indicating popularity is displayed in the form of a bubble in the area toward the center of the road, in other words, in the area overlapping with the route of vehicle 1. Therefore, it cannot be said that this will not interfere with the viewer's ability to check what is ahead, and it is also possible that the viewer will find it annoying.

[0081] Next, reference will be made to Fig. 5. Figs. 5(A), (B), and (C) are diagrams showing examples of setting a display area on a virtual image display surface.

[0082] In a preferred embodiment of the present invention, a plurality of display areas are set in the display range 6, and these display areas are used to appropriately control the display timing and display position of the POI image.

[0083] One possible method for controlling the display timing and display position of a POI image is to precisely calculate the relative positional relationship between the POI image and the object at any time using a predetermined formula based on map information, vehicle position information, and the vehicle's traveling speed, etc., and then use the calculation results to determine the display timing and display position. This invention does not exclude such methods, and such methods can also be included in the display control of the present invention.

[0084] However, since the vehicle 1 is moving and the distance to each object changes from time to time, strictly controlling the display timing and display position increases the processing load on the display control device (e.g., a processor) 80. This also increases the cost of the display control device 80. Furthermore, the processing time tends to be longer, and in this case, it cannot be said that display delays will not occur.

[0085] Therefore, in a preferred embodiment of the present invention, as described above, a plurality of display areas are set and the display areas are used to facilitate control of the display timing and display position of the POI image.

[0086] The display area can be set by the methods shown in FIGS. 5(A), 5(B), and 5(C).

[0087] In FIG. 5A, a first display area ZN1 is set above the display range 6 of the virtual image display surface PS1, a second display area ZN2 is set to the lower left of the first display area ZN1, and a third display area ZN3 is set to the lower right of the first display area ZN1. A clearance area ZN4 is set between the second and third POI display areas ZN2 and ZN3, where the display of the detailed second POI image is prohibited. In a preferred example, each of the areas ZN1 to ZN4 is a rectangular area. The clearance area ZN4 can also be considered a gap area between the second display area ZN2 and the third display area ZN3 in the left-right direction (X direction). In a preferred example, each of the areas ZN1 to ZN4 has a rectangular (quadratic) outer shape, and ZN2 and ZN3 are located below and adjacent to ZN1. However, ZN2 and ZN3 may be provided at a small distance from ZN1, or ZN2 and ZN3 may be provided so as to partially overlap ZN1 above and below.

[0088] In the first display area ZN1, a simplified first POI image (for example, a logo mark) can be displayed superimposed on the target object.

[0089] In the second display area, a second POI image (such as an image including characters and symbols) in a detailed form can be displayed for an object located on the left side of the road.

[0090] In the third display area, a second POI image (such as an image including characters and symbols) in a detailed form can be displayed for an object located on the right side of the road.

[0091] Here, the position of the first display area ZN1 in the height direction of the display range 6 will be described. As will be described later, in the present invention, when a simplified first POI image is applied to an object, the first POI image is not necessarily required to be superimposed on the object, and non-superimposed display is permitted. Here, if this non-superimposed display accidentally overlaps another object, it may mislead the viewer. To prevent this, the first display area ZN1, which defines the display position of the simplified first POI image, is preferably set above the vanishing point R, as shown in FIG. 5A . This is because it is considered unlikely that the simplified first POI image will be superimposed on the object at a position somewhat higher than the vanishing point R.

[0092] In other words, assuming that the vehicle 1 is traveling on a straight road with good visibility, the law of perspective dictates that the actual scene (background) ahead of the vehicle 1 is depicted as converging at the vanishing point R. Therefore, the object on which the simplified first POI image is superimposed is assumed to be located near the vanishing point R in the height direction of the display range 6 (appearing to the viewer at a height position near the vanishing point R), and it is considered rare for a display superimposed on that object to exist at a position higher than the vanishing point R. In consideration of this, the first display area ZN1 in which the simplified first POI image is displayed is positioned above the vanishing point R, so that the non-superimposed POI image is unlikely to overlap with other objects different from the original object. This prevents the viewer from being misled.

[0093] 5A , the display positions and timing of the first and second POI images can be easily set appropriately based on the set display area. For example, the display positions within each display area can be determined relative to each other, taking into account the distance to the object and the vehicle speed. Furthermore, simple control can be implemented, such as shifting the display position to the second or third display area when part or all of the first POI image enters a predetermined area within the first display area. Therefore, the processing load on the display control device (e.g., a processor, etc.), the cost of the control device, and processing time delays can be reduced with a simple configuration.

[0094] Referring to Fig. 5(B), in Fig. 5(B), an upper area Za located on the upper side and a lower area Zb located on the lower side are set within the first display area ZN1 in Fig. 5(A). Also, in Fig. 5(B), the second and third display areas for displaying the second POI image in a detailed form shown in Fig. 5(A) are not set.

[0095] Please refer to Fig. 5(C). Fig. 5(C) shows a display area configuration that combines Fig. 5(A) and Fig. 5(B). Fig. 5(C) shows an upper area Za and a lower area Zb set within a first display area ZN1, a second display area ZN2, and a third display area ZN3.

[0096] The first embodiment shown in FIGS. 6 and 7 corresponds to FIG. 5(A), the second embodiment shown in FIGS. 8 to 10 corresponds to FIG. 5(B), and the third embodiment shown in FIGS. 11 and 12 corresponds to FIG. 5(C).

[0097] (First embodiment) Please refer to Fig. 6. Figs. 6(A), (B-1), (B-2), and (B-3) are diagrams showing an example of simplified display control of a first POI image (logo mark) while a vehicle is traveling (corresponding to the display area setting in Fig. 5(A)). In Fig. 6, parts common to the previous figures are assigned the same reference numerals.

[0098] In the present invention, the second POI image in the detailed mode is not displayed immediately, but the first POI image in the simplified mode is first superimposed on the object, and then the second POI image is displayed. Figures 6(A), (B-1) to (B-3) show examples of display control of the first POI image in the simplified mode.

[0099] As shown in FIG. 6A, the first POI image (logo mark) α in the simplified form is displayed in a strip-shaped (horizontally long rectangular) first display area ZN1.

[0100] The first POI image moves to the left over time and gradually expands in size in accordance with the perspective technique. In Fig. 6, the images whose positions change over time are labeled α1 to α3 for easy identification. On the other hand, the image that represents a higher concept that collectively encompasses α1 to α3 is labeled α.

[0101] First, this first POI image (logo mark) α is ultimately displayed superimposed on an object ARa located on the left side of the road.

[0102] However, first, it is displayed as α1 in a position near the center of the first display area ZN1, and as time passes, the display position moves to the left. α1 moves leftward along the left-right direction to become α2, and α2 then moves leftward to become α3.

[0103] Furthermore, α3 is displayed at the left end or in the left end region of the first display region ZN1. This position of α3 is referred to as the "first display position."

[0104] In addition, as the image moves, the size of the image gradually increases due to perspective drawing. In other words, the size of α2 is larger than the size of α1, and the size of α3 is larger than the size of α2.

[0105] Figures 6 (B-1), (B-2), and (B-3) show how the first POI images α1, α2, and α3 appear to the viewer (driver 5) when the display control shown in Figure 6 (A) is implemented.

[0106] 6(B-1), the object ARa is located at a considerable distance, and the first POI image α1 is displayed closer to the viewer than the object ARa (nearby) without being superimposed on the object ARa. In this case, the first POI image α1 functions as a warning display that notifies the viewer in advance of basic matters such as "there is an object on the left side of the road" and "the object is still far away."

[0107] In Fig. 6(B-2), the object ARa is closer to the viewer than in Fig. 6(B-1), but is still located far away, and the first POI image α2 is displayed closer to the viewer than the object ARa (nearby) without being superimposed on the object ARa. In this situation, the size of the first POI image α2 is larger than the size of the first POI image α1 in Fig. 6(B-1), so the viewer can intuitively know that the object is approaching.

[0108] 6(B-3), the first POI image α3 has reached the left edge of the first display area ZN1 or the left edge area including the left edge (first display position). From the viewer's perspective, the first POI image α3 is superimposed on the object ARa, which is moving diagonally downward to the left and approaching the viewer considerably. The POI image superimposed on the object may be referred to as a "superimposed POI image."

[0109] In this situation, the viewer can reliably recognize the object ARa and can confirm that the first POI image α3 is superimposed on the object ARa, and therefore can intuitively grasp (recognize) the correspondence between the first POI image α3 and the object ARa.

[0110] In this way, when the display control shown in FIG. 6 is performed, the first POI display in the simplified mode is displayed before the second POI image in the detailed mode. Therefore, even if the number of objects on which POI images should be superimposed increases, the annoyance felt by the viewer (a passenger such as a driver) is reduced. Furthermore, even if the first POI image is displayed superimposed on a distant object, the first POI image is displayed with a small amount of information and is easy to see, so the difficulty in viewing is reduced, and the viewer is more likely to obtain useful information from the first POI image. Furthermore, by superimposing the first POI image on the object, the viewer can intuitively recognize (perceive) the correspondence between the first POI image and the object.

[0111] Furthermore, because the first POI image, which has a small amount of information and is easy to view, is displayed in advance, the first POI image functions as a preview display. A POI image with this preview display function is sometimes referred to as a "preview POI image." Therefore, before the second POI image with detailed information is displayed, the viewer can intuitively know in advance that an object to be displayed exists, as well as the approximate location and distance to the object. This reduces the sense of abruptness felt when the second POI image with a large amount of information is displayed, and reduces discomfort. Furthermore, because the viewer is provided with basic information through the advance warning, the viewer has more time to relax. Therefore, when the second POI image with a large amount of information is displayed, for example, in a driving situation where it is determined that checking the road ahead is a priority, the viewer does not need to direct their gaze to the second POI image. Therefore, the viewer's gaze is not suddenly drawn to the second POI image, which prevents them from becoming distracted from the road ahead.

[0112] In the example of FIG. 6, a strip-shaped first display area ZN1 is set above the display range 6, and the first POI image α is displayed within the display area ZN1.

[0113] In (B-3) of Figure 6, when the first POI image α3 is displayed so as to be superimposed on the object ARa, the first POI image α3 can be displayed at the "left end of the first display area, or the left end area including the left end," or at the "right end of the first display area, or the right end area including the right end."

[0114] The "left end" is "the area near the left end in the left-right direction in the first display area," and the "left end area including the left end" is "the area that includes the left end and is expanded further toward the center of the road." These areas can be freely set using software, for example, by a display control device, allowing for a high degree of freedom in design.

[0115] When viewed by a viewer (driver 5) of a vehicle 1 traveling ahead at a predetermined speed, an object located on the left (right) side of the road moves diagonally downward to the left (diagonally downward to the right) away from the center of the road over time, approaches the viewer, and eventually flows diagonally backward to the left (diagonally backward to the right) and disappears.

[0116] Assuming that the first display area ZN1 is set as a strip-shaped (rectangular) area having a predetermined height and a predetermined length in the left-right direction (however, this example is not limited to this), if we imagine a situation in which an object ARa located on the left (or right) side of the road approaches the vehicle 1 and is reliably visible to the viewer, it can be estimated that the object ARa in this case is located at the "left end (right end), or the left end area (right end area) including the left end (right end)" of the first display area ZN1 from the viewer's perspective.

[0117] Therefore, by displaying the first POI image α3 at a first display position in the "left end (right end), or the left end area (right end area) including the left end (right end)" of the first display area ZN1, when the object ARa moves diagonally downward to the left (diagonally downward to the right) and can be clearly seen by the viewer, the first POI image α3 is displayed at just the right time, and from the viewer's perspective, the first POI image α3 appears to be displayed superimposed on an appropriate position of an object of an easy-to-see size.

[0118] 6, the first POI image α can be accurately superimposed on the object ARa through simple control, thereby reducing the processing load on the display control device (e.g., a processor) 80.

[0119] After the first POI image α reaches the first display position in the first display area ZN1, a second POI image β having more detailed information about the object ARa is displayed, as will be described with reference to FIG.

[0120] Next, reference is made to Fig. 7. Figs. 7(A), (B-1), and (B-2) are diagrams (corresponding to the display area setting in Fig. 5(A)) showing an example of the display of a detailed second POI image (a text image showing the store name) while the vehicle is traveling. In Fig. 7, parts that are common to the previous drawings are given the same reference numerals. This also applies to the drawings of the second to fourth embodiments.

[0121] After the situation shown in FIG. 6(B-3), the second POI image β (β1 to β3) in a detailed form is displayed as shown in FIG. 7(B-1) and FIG. 7(B-2).

[0122] In Figure 7(A), in order to clarify the relationship with Figure 6(A) shown above, the first POI image α (α1 to α3) shown in Figure 6(A) is shown with dashed lines.

[0123] As described above, the display position of the first POI image α3 is referred to as the “first display position.” After the first POI image α3 reaches the first display position, the second POI image β (β1 in this case) is displayed in the upper left corner of the second display area ZN2 (for example, this position can be referred to as the “second display position”).

[0124] As with the first POI image α, when the second POI image is collectively referred to as a higher-level concept, it is expressed as the second POI image β, and when each second POI image is to be distinguished when its display position changes over time, it is expressed as the second POI images β1 to β3.

[0125] Here, the second POI image β is an image of text information (accompanying information) indicating that the object ARa is "S Pastry Shop."

[0126] As shown in Figure 7 (A), the display position (second display position) of the second POI image β1 is set below the display position (first display position) of the first POI image from the viewer's perspective, and is set to the left side of the road if the object ARa is on the left side of the road, and is set to the right side of the road if the object ARa is on the right side of the road.

[0127] However, the area ZN4 that overlaps with the travel route of the vehicle 1 is a clearance area, and display of the POI image is prohibited. Specifically, for example, if the road is divided into a "left edge area," a "center area," and a "right edge area," the "center area" is set as the clearance area ZN4, and the second POI image is not displayed. This prevents the second POI image β from interfering with the viewer's confirmation of the road ahead or oncoming vehicles, and reduces annoyance.

[0128] Furthermore, as previously shown in Figure 6, the first POI image is superimposed on the object on the left or right side of the road, and then (for example, immediately afterwards), the second POI image β is displayed below the superimposed display and on the same side (left or right) as the object, so the viewer can intuitively sense (recognize) that the display mode has changed within their field of view and switched to a detailed display.

[0129] When this happens, the viewer instantly turns his or her gaze in the perceived direction, and the second POI image β (β1 to β3) comes into view, allowing the viewer to see (confirm) the second POI image, making it easier to obtain information.

[0130] Also, at this time, the second POI image β is displayed, for example, in front of the object ARa and in close proximity to the object ARa, making it easy for the viewer to remember a one-to-one correspondence between the second POI image β and the object ARa located in the background (specifically, the appearance of the object, an advertising signboard, etc.).

[0131] 7A, the second POI image β1 displayed at the second display position in the second display area ZN2 moves downward as time passes, as seen by the viewer. β1 moves downward to become β2, and β2 moves downward to become β3.

[0132] The direction of downward movement is not particularly limited. For example, the second POI image β may be moved downward along the Y direction (up and down direction). However, in the example of Fig. 7(A) , the second POI image β is moved diagonally downward to the right as seen by the viewer so as to approach the viewer's viewpoint over time (the effect of this case will be described later).

[0133] Figures 7 (B-1) and (B-2) show how the second POI images β1, β2, and β3 appear to the viewer (driver 5) when the display control shown in Figure 7 (A) is implemented.

[0134] In FIG. 7(B-1), a second POI image β1 in a detailed form is displayed below the object ARa in association with the object ARa.

[0135] 7(B-2), the object ARa is closer to the vehicle 1, and the viewer can clearly recognize the exterior of the S confectionery store as the object ARa. In other words, the viewer can simultaneously see the detailed second POI image β3 and the S confectionery store as the target object ARa within the range 8 of their line of sight, making it easier for them to associate and remember the two.

[0136] Under these circumstances, the second POI image β, which is a text image of "S Confectionery Shop," moves downward (including diagonally downward) with a sense of perspective.

[0137] By moving the second POI image β downward, a dynamic visual impression can be given to the viewer, and a slight degree of eye-catchingness can be created without causing a sense of incongruity. This triggers the viewer to naturally turn their gaze toward the moving second POI image β. In this case, the second POI image β reliably catches the viewer's eye, allowing the viewer to reliably see the second POI image β, and making it easier to obtain information.

[0138] Furthermore, by controlling the size of the moving second POI image β to increase over time and adding a sense of perspective, the second POI image β can be displayed in a more natural and easy-to-view manner.

[0139] Furthermore, by moving the second POI image β diagonally downward (diagonally downward to the right) so that the distance to the viewer's viewpoint becomes closer over time, the sense of perspective is emphasized, and the viewer sees the second POI image β (β1 to β3) as being closer to their viewpoint, resulting in a more natural visual perception and further reducing the sense of discomfort.

[0140] Furthermore, by controlling the size of the second POI image β (β1 to β3) to increase over time as the second POI image β moves diagonally downward from the viewer's perspective over time, a more effective sense of perspective can be imparted to the second POI image β. In other words, as the second POI image β approaches the viewer, the size of the second POI image β gradually increases, making letters, symbols, and the like easier to see (or recognize). This makes it easier to obtain information and improves convenience.

[0141] In this way, by continuously using the display controls of Figures 6 and 7, the second POI image can be displayed at an appropriate timing and in an appropriate position without giving the viewer any sense of discomfort.

[0142] In other words, by dividing the information content into left and right displays depending on the object's position relative to the road, and by making the central display area corresponding to the vehicle's route a clearance area where no display is performed, it is possible to realize an easy-to-read POI display while organizing the information, and even if the number of displays increases, it is possible to effectively reduce the annoyance felt by the viewer, and it is also easier to control the display position and timing.

[0143] Second Embodiment Next, reference is made to Fig. 8. Figs. 8A, 8B-1, 8B-2, and 8B-3 are diagrams showing an example of simplified display control of a first POI image (logo mark) while a vehicle is traveling (corresponding to the display area setting in Fig. 5B). In Fig. 8, parts that are common to the previous drawings are given the same reference numerals.

[0144] In the example of Figure 8, an upper area Za located on the upper side and a lower area Zb located on the lower side are set within the first display area ZN1 (area capable of displaying a simplified POI image) previously shown in Figures 6 and 7. In the example of Figure 8, when the display of a simplified POI image as a preview POI image begins, a preview POI image (a simplified POI image) α1 is first displayed in the upper area Za. When the display of the preview POI image α1 begins, if the preview POI image α1 appears to be superimposed on an object other than the actual object, it will mislead the viewer. Therefore, it is necessary to avoid such a situation. Here, reference is made to Figure 5(B) previously shown. As shown in FIG. 5B , when traveling on a straight road, the objects to be displayed as superimposed POI images are often located near the vanishing point R (close to the vanishing point R) on the left and right sides of the road. Therefore, it is assumed that the higher the height position relative to the vanishing point R, the less frequently the superimposed POI image is displayed. Therefore, the upper region Za in the example of FIG. 8 is considered to be an area where the superimposed POI image is displayed less frequently. Taking this into consideration, in the example of FIG. 8 , when the simplified POI image as the advance notice POI image starts to be displayed, the advance notice POI image (simplified POI image) α1 is first displayed in the upper region Za to avoid superimposition with other objects and thereby avoid misleading the viewer (however, this is not limited to this, and α1 may also be displayed in the lower region Zb from the start of display). The advance notice POI image (simplified POI image) α1 then moves left or right in response to the vehicle 1's movement. This movement can include a diagonal movement to the lower left or diagonal movement to the lower right. The preview POI image α1 moves to the position of the preview POI image α2 over time. Thereafter, a superimposed POI image (a POI image in a simplified form) α3 is displayed at a first display position within the lower region Zb (the left end position, or a position within the left end region including the left end, or the right end position, or a position within the right end region including the right end). In other words, the non-superimposed "preview POI image" with a preview function moves further and overlaps the target object at the first display position, thereby losing its preview function and being converted into a "superimposed POI image."In the example of FIG. 8, the second and third display areas ZN2 and ZN3 for displaying the second POI image in the detailed form shown in FIGS. 6 and 7 are not set.

[0145] Figure 8(A) corresponds to Figure 6(A) described above, and Figures 8(B-1) to (B-3) correspond to Figures 6(B-1) to (B-3) described above. In the example of Figure 8, the actions and effects described in Figure 6 can be similarly obtained.

[0146] Furthermore, in Figure 8 (A), an upper area Za located on the upper side and a lower area Zb located on the lower side are set within the first display area ZN1, so that, for example, as shown on the left side of Figure 8 (A), it is easy to move the first POI image α (α1 to α3) diagonally downward so as to cross the boundary line between the upper area Za and the lower area Zb.

[0147] For example, by positioning the first POI image α1 in the upper region Za higher, the first POI image α1 appears farther away from the viewer. Similarly, by positioning the first POI image α3 in the lower region Zb lower, the first POI image α3 appears closer to the viewer. Therefore, by appropriately adjusting the display positions of the first POI images α1 and α3 in the respective regions Za and Zb and adjusting the slope of the line indicating the direction of movement when the POI image α is moved diagonally downward, the movement pattern and perspective of the POI image α as seen by the viewer can be adjusted more flexibly and freely.

[0148] In addition, in a normal display, it is considered rare to display a POI image in the area above the display range 6. However, in the example of Fig. 8(A), since the upper area Za is provided, it is possible to utilize all areas within this upper area Za to display POI images of objects that are located in areas that are quite far away from the viewer. In other words, it is possible to display, for example, a preview POI image for objects that are farther away (for example, objects within a 1 km range from the viewer).

[0149] Furthermore, as shown in FIG. 4A, without applying the present invention, when attempting to display POI images on distant objects, the viewer may experience a disjointed visual experience, with POI images displayed near and far from the viewer's perspective (see FIG. 4A). However, as is clear from FIGS. 8B-1 and 8B-2, in this embodiment, the first POI images α1 and α2 are not forcibly superimposed on distant objects, but are instead displayed as advance notice POI images near the viewer's perspective, thereby eliminating the disjointed visual experience. As is clear from FIGS. 8B-1 to 8B-3, a cohesive visual experience is achieved, thereby reducing the viewer's discomfort.

[0150] Next, reference will be made to Fig. 9. Figs. 9A, 9B, 9C-1, 9C-2, and 9C-3 are diagrams showing another example of simplified display control of the first POI image (logo mark) (corresponding to the display area setting in Fig. 5B). In the example (application example) of Fig. 9, a case will be described in which the objects include a mixture of "visible objects" that can be seen by the viewer while the vehicle 1 is traveling, and "invisible objects."

[0151] As described above, in the present invention, the "object" that can be displayed as a POI may include at least one of a "visible object" that is located facing the road in the driving lane in which vehicle 1 is traveling or the road in the oncoming lane, and is visible to the viewer while the vehicle is traveling, and an "invisible object" that is not facing the road in the driving lane or the road in the oncoming lane, and is not visible to the viewer while the vehicle is traveling.

[0152] Here, a typical example of a "visible object" located on the left side from the viewer's perspective is a store or the like facing the road in the driving lane, and from which it is possible to enter the store (including the parking lot) from the road in the driving lane.

[0153] A typical example of a "visible object" located on the right side of the viewer is a store or the like facing the road in the oncoming lane, in other words, a store or the like that can be entered by making a U-turn later. An "invisible object" is a store or the like that does not face the road in the driving lane or the oncoming lane, and is blocked from view by buildings or the like along the road, and therefore cannot be seen by the viewer while the vehicle is traveling.

[0154] 9A shows an overhead view map (bird's-eye view map) including a road 11 on which the vehicle 1 is traveling. In the overhead view map (bird's-eye view map), a fan-shaped area W that forms part of a semicircle with a radius of, for example, 500 m is set ahead of the vehicle 1, using a reference point on the vehicle 1 side (for example, the viewer's viewpoint position or a predetermined position of the vehicle 1: symbol E in FIG. 9A ). The fan-shaped area W is the range that the control unit 83 can control to display.

[0155] In Figure 9 (A), "visible objects" are indicated by "black circle symbols," and "invisible objects" are indicated by "cross symbols." The number of "visible objects" included in area W is four, and the number of "invisible objects" is six. These total of 10 objects can be candidates for display of the POI image (preview POI image).

[0156] In Fig. 9(A), the object extraction unit 89 in the control unit 83 shown in Fig. 1 extracts object ARa as a "visible object" from among these 10 object candidates, and extracts objects ARb and ARc as "invisible objects." Note that in Fig. 9(A), objects ARa, ARb, and ARc that are to be displayed in the preview POI image are marked with thick solid circles. In addition, when extracting objects, the number of objects may be limited by setting priorities based on, for example, the popularity of a store or the like, and selecting the top ones.

[0157] The objects ARa, ARb, and ARc are displayed with a predicted POI image. The predicted POI image is a POI image that notifies the vehicle 1 of basic POI information (information indicating the presence of an object and whether the object is located to the left or right as seen by the viewer) before the vehicle 1 reaches a position where each object can be recognized (a position where a POI image can be superimposed and displayed). Note that if the vehicle 1 is guided, for example, by a navigation display or the like, it can approach the "invisible objects ARb and ARc" by making appropriate course changes. The predicted POI image functions as a preliminary POI image that notifies the vehicle 1 of basic POI information in advance before the vehicle 1 approaches the object.

[0158] Since the preview POI image is a simplified POI image (here, a logo mark), it is displayed in the first display area ZN1, which is the area for displaying the simplified POI image. However, in FIG. 9B , the first display area ZN1 is divided into an upper area Za and a lower area Zb. Therefore, the preview POI images α (α1 to α3) for the "visible object" are displayed in the "lower area Zb." The preview POI images γ (γ1, γ2) and δ (δ1, δ2) for the "invisible object" are displayed in the "upper area Za." Since the preview POI image for the "invisible object" disappears over time, flowing diagonally backward to the left (right) from the viewer's perspective without being superimposed on the "invisible object," it is preferable to display it in the "upper area" so as not to interfere with the display of the superimposed POI image.

[0159] On the other hand, it is preferable to display the preview POI image for the "visible object" in the "lower area Zb" so that it can smoothly transition to the "superimposed POI image" (and further so that it can smoothly transition to the display of the POI image in the detailed form described below (see Figure 11)).

[0160] Furthermore, because the objects ARa and ARc are located on the left side of the road 11 on which the vehicle 1 is traveling (in other words, they appear to the left when viewed from the viewer), the advance notice POI images α (α1 to α3) and δ (δ1, δ2) move to the left over time in response to the vehicle 1's approach to the objects ARa and ARc. Furthermore, because the object ARb is located on the right side of the road 11 on which the vehicle 1 is traveling (in other words, they appear to the right when viewed from the viewer), the advance notice POI images γ (γ1, γ2) move to the right over time in response to the vehicle 1's approach to the object ARb. Furthermore, as the advance notice POI images (α, γ, δ) move, the size of the advance notice POI images increases over time to create a natural sense of perspective.

[0161] In Fig. 9(C-1), the preview POI images α1, γ1, and δ1 appear relatively far away from the viewer, and in Fig. 9(C-2), the preview POI images α2, γ2, and δ2 appear relatively close to the viewer.

[0162] In FIG. 9 (C-3), the advance notice POI image α3 is displayed so as to overlap the "visible object ARa" as seen by the viewer. At this time, the advance notice POI image α3 is located at the left end of the lower region Zb, or in the left end region including the left end. On the other hand, the advance notice POI image γ for the "invisible object ARb" is erased at the right end of the upper region Za, or in the right end region including the right end, outside the display range of the advance notice POI image γ. The viewer perceives the advance notice POI image γ as flowing diagonally backward to the right as the vehicle 1 travels, resulting in a natural visual sensation. Therefore, no discomfort is felt. Similarly, the advance notice POI image δ for the "invisible object ARc" is erased at the left end of the upper region Za, or in the left end region including the left end, when it goes out of the display range of the advance notice POI image δ. The viewer perceives the advance notice POI image δ as flowing diagonally backward to the left as the vehicle 1 travels, resulting in a natural visual sensation. Therefore, no sense of incongruity occurs.

[0163] (Third embodiment) Next, reference will be made to Figures 10 and 11. Figures 10(A), (B), (C-1), (C-2), and (C-3) are diagrams showing an example of display control of a first POI image (logo mark) in a simplified mode while a vehicle is traveling (corresponding to the display area setting in Figure 5(C)). Figures 11(A), (B-1), and (B-2) are diagrams showing an example of display of a second POI image (text image indicating a store name) in a detailed mode while a vehicle is traveling (corresponding to the display area setting in Figure 5(C)).

[0164] Figures 10(A), (B), and (C-1) to (C-3) correspond to Figures 9(A), (B), and (C-1) to (C-3) described above, except that second, third, and fourth display areas ZN2, ZN3, and ZN4 are set in Figures 10(A), (B), and (C-1) to (C-3), which were not set in Figures 9(A), (B), and (C-1) to (C-3).

[0165] 11(A), (B), (C-1) to (C-3), second, third, and fourth display areas ZN2, ZN3, and ZN4 are also set. Figures 11(A), (B-1), and (B-2) correspond to Figures 7(A), (B-1), and (B-2) described above.

[0166] In other words, in the examples of Figures 10 and 11, the display control of Figures 6 and 7 in the first embodiment described above and the display control of Figure 9 in the second embodiment described above are combined and implemented. Details of the display control have been described above, so a repeated description will be omitted.

[0167] 10 and 11, it is possible to display detailed POI images, providing a high degree of freedom in display control. Furthermore, by utilizing each display area, it is possible to realize various control of display positions and display timings while reducing the burden on the display control device (processor, etc.) 80.

[0168] Fourth Embodiment Next, reference will be made to Fig. 12. Fig. 12 is a flowchart showing an example of a main procedure for display control.

[0169] 12, information processing is performed, such as area setting processing for setting a display area (step S11), processing for detecting POI information of a display target (step S12), processing for acquiring supplementary information (detailed information) about the target (step S13), and processing for determining the initial display position in the horizontal and vertical directions in the display range and the initial display timing (step S14).

[0170] In step S2, a warning display process is performed. The warning display can be, for example, a display for notifying basic POI information in advance before the vehicle approaches the object and becomes recognizable. This display can be performed, for example, in the first display area. The warning display is displayed without being superimposed on the object. The warning display is preferably a simplified display (first display). For example, a warning display may be performed when a "visible object" that faces the driving lane or oncoming traffic and can be seen by the viewer is located far away. A warning display can also be performed appropriately for "invisible objects" that do not face the driving lane or oncoming traffic and cannot be seen by the viewer. The display may be shifted left or right over time, and the size of the display may be changed when shifting left or right to create a sense of perspective. A warning display (warning POI image) for an "invisible object" that does not face the road is erased when it goes outside the display range of the warning display (warning POI image).

[0171] In step S3, a superimposed display process is performed, for example, a process of displaying a superimposed POI image in a simplified mode (first mode) (specifically, a superimposed POI image of a "visible object" facing the driving lane or the oncoming lane) so that at least a part of the image overlaps with an object in a recognizable position (nearby).

[0172] In step S4, an additional information display process is performed, for example, a process of displaying additional information (second display mode) about a closer object in the left and right additional information display areas (second and third display areas).

[0173] In step S5, an incidental information movement process is performed. For example, a process is performed to move the display of the incidental information downward (including diagonally downward). In a preferred example, the incidental information may be moved diagonally downward so as to approach the viewer's viewpoint. When moving downward, the size of the display may be changed to create a sense of perspective.

[0174] As described above, according to the present invention, even when POI images are displayed for both near and far objects, it is possible to prevent the impression that multiple POI images are discretely arranged.

[0175] Furthermore, even if the POI image is of a distant object, the POI image can be made easier to see, making it easier to obtain POI information.

[0176] Furthermore, even when multiple objects at different distances from the viewer are located at a considerable distance, it is possible to make it easier to sense (understand) the sense of distance (perspective) of the POI image of each object.

[0177] Furthermore, when displaying a detailed POI image with a large amount of information, the inconvenience to the viewer can be reduced, and the correspondence between the POI image and the object can be easily grasped.

[0178] Furthermore, the correspondence between the POI image and the object can be clarified, making it easier for the viewer to remember it.

[0179] Furthermore, the display timing and display position can be appropriately controlled while reducing the burden on the display control device.

[0180] Furthermore, even when POI images are displayed for both near and far objects as seen by the viewer, a display device and display control method can be realized that can prevent the multiple POI images from appearing to be disorganized and dispersed (in other words, discretely) arranged.

[0181] Furthermore, it is possible to realize a display device and a display control method that can make a POI image, even if it is a POI image of a distant object, easier to view and make it easier to obtain POI information.

[0182] Furthermore, even when multiple objects at different distances from the viewer are located at a considerable distance, a display device and a display control method can be realized that make it easy to sense (grasp) the sense of distance (perspective) of the POI image of each object.

[0183] Furthermore, it is possible to realize a display device and a display control method that can appropriately control the display timing and display position while reducing the load of display processing.

[0184] Furthermore, it is possible to realize a display device and a display control method that can reduce the annoyance caused to the viewer when displaying a detailed POI image with a large amount of information.

[0185] Furthermore, it is possible to realize a display device and a display control method that can clarify the correspondence between the POI image and the object, making it easier for the viewer to remember it.

[0186] Furthermore, it is possible to realize a display device and a display control method that can appropriately control the display timing and display position while reducing the load of display processing.

[0187] In this specification, the term "vehicle" can be broadly interpreted as a vehicle or a moving object.

[0188] Furthermore, terms relating to navigation (such as map information) are to be interpreted broadly, taking into consideration the broader definition of navigation information that is useful for driving a vehicle.

[0189] The terms "simple POI image (simple display)" and "detailed POI image (detailed display)" are to be interpreted broadly and flexibly. For example, a logo mark, a photograph of a store, etc., can be a simple POI image. Also, for example, a logo mark that includes advertising text, etc., can be a detailed POI image.

[0190] The HUD device and display system also include those used as simulators (for example, aircraft simulators, simulators as game devices, etc.).

[0191] Furthermore, in the above-described embodiment, the projection display device has been mainly described as an HUD device, but the present invention is not limited to this, and for example, an in-car projector or the like can also be used.

[0192] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims.

[0193] 1...Vehicle (own vehicle), 2...Projected member (windshield, etc.), 3...Eye (viewpoint), 4...Steering wheel, 5...Occupant (driver, etc.), 6...Display range, 7...Display surface, 8...Gaze range, 9...Image display range, 41...Dashboard, 65...Communication unit, 70...Navigation device, 71...POI information, 72...Location information, 73...Additional information, 74...Map information, 75...Own vehicle position information, 76...Display database, 77...ECU, 80...Display control device, 81...Information acquisition unit, 82...storage, 83...control unit, 84...area setting unit, 85...display timing setting unit, 86...display position setting unit, 87...display movement setting unit, 88...display mode setting unit, 89...object extraction unit, 90...projection unit, 92...display optical system (optical system), 100...HUD device, 103...casing, 110...WSD device, 111...projection device, 151...display unit (light source unit), 152...display, 170...concave mirror (curved mirror), PS1, PS2...virtual image display surface, V1, V2...virtual image (image), R...vanishing point.

Claims

1. A vehicle navigation system having an information acquisition unit that acquires map information about objects around a vehicle and POI (Point Of Interest) information that is information related to the objects; and a control unit that controls the display of a POI image that is an image representing the POI information when the POI image is displayed as a virtual image on a virtual image display surface, wherein when the height direction of the vehicle is the up-down direction and the width direction of the vehicle is the left-right direction, the control unit: displays a first POI image in a simplified form as the POI image so as to be superimposed on the object as seen by a viewer in the vehicle; and after the superimposition, when the object is on the left side of a road on which the vehicle is traveling, displays the second POI image in a detailed form containing more information than the first POI image at a second position that is below a first position that is the display position of the superimposed first POI image, on the left side of the road, and does not overlap with the traveling route of the vehicle, as seen by the viewer; a display control device that displays, when the object is on the right side of the road on which the vehicle is traveling, the second POI image, which is a detailed aspect having more information than the first POI image, at a third position which is below the first position, which is the display position of the first POI image displayed in a superimposed manner, as seen by the viewer, on the right side of the road and which does not overlap with the vehicle's traveling path.

2. The display control device according to claim 1, wherein the control unit moves the second POI image displayed at the second position further downward as viewed by the viewer.

3. The display control device according to claim 2, wherein the control unit gives a sense of perspective to the second POI image by moving the second POI image so that the size of the second POI image increases over time.

4. The display control device according to claim 1, wherein the control unit moves the second POI image displayed at the second position diagonally downward as viewed by the viewer so that the image becomes closer to the viewer's viewpoint over time.

5. The display control device according to claim 4, wherein the control unit gives a sense of perspective to the second POI image by moving the second POI image so that the size of the second POI image increases over time.

6. The display control device according to claim 1, wherein the control unit sets, within the display range of the virtual image display surface, a first display area in which the first POI image can be superimposed so as to overlap the object, a second display area in which the second POI image can be displayed and which is located on the lower left side of the first display area, a third display area in which the second POI image can be displayed and which is located on the lower right side of the first display area, and a clearance area located between the second and third display areas and in which display of the second POI image is prohibited, and displays the first POI image in the first display area, and when the object is located on the left side of the road on which the vehicle is traveling, displays the second POI image in the second display area, and when the object is located on the right side of the road on which the vehicle is traveling, displays the second POI image in the third display area.

7. The display control device according to claim 6, wherein the control unit, when the object is located on the left side of the road on which the vehicle is traveling, displays the first POI image so as to be superimposed on the object in the left edge including the left edge or in the left edge region including the left edge of the first display area, and when the object is located on the right side of the road on which the vehicle is traveling, displays the first POI image so as to be superimposed on the object in the right edge including the right edge or in the right edge region including the right edge of the first display area.

8. A display device having a display unit that displays an image and a display control device described in any one of items 1 to 7.

9. The display device according to claim 8, wherein the display device is a head-up display device that displays an image displayed on the display unit as the virtual image on the virtual image display surface by projecting the image onto a projection target.

10. A display control method comprising the steps of: acquiring map information about objects around a vehicle and POI (Point Of Interest) information related to the objects; displaying a POI image representing the POI information as a virtual image on a virtual image display surface, in which the height direction of the vehicle is defined as the up-down direction, the width direction of the vehicle is defined as the left-right direction, and the object is located on at least one of the left and right sides of a road on which the vehicle is traveling as viewed by a viewer in the vehicle; displaying a first POI image in a simplified form as the POI image so as to be superimposed on the object as viewed by the viewer; and displaying, after the superimposition, a second POI image in a detailed form containing more information than the first POI image at a second position as viewed by the viewer that is below a first position that is a display position of the superimposed first POI image and does not overlap with the vehicle's traveling route.

Images