Multi-image display device for a co-pilot application of a motor vehicle

The multi-image display device with ERSA and EA Modules, using eye-tracking, addresses the challenge of passenger visibility by projecting personalized and shared information on the windshield, improving collaboration and efficiency in vehicle tasks.

DE102023100427B4Active Publication Date: 2026-05-07GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
GM GLOBAL TECHNOLOGY OPERATIONS LLC
Filing Date
2023-01-10
Publication Date
2026-05-07

AI Technical Summary

Technical Problem

Existing vehicle display systems do not effectively allow passengers to see projected information accurately, as they lack a direct line of sight to the screen and cannot overlay road geometry from the passenger's perspective, hindering efficient collaboration with the driver.

Method used

A multi-image display device with Extended Reality Field of View Display Modules (ERSA) and an Extended Display Module (EA Module) that utilize eye-tracking devices to project personalized and shared displays on the windshield, overlaying road geometry and providing personalized information to both the driver and passenger, enabling efficient collaboration.

Benefits of technology

Enables simultaneous and accurate viewing of personalized and shared information by both the driver and passenger, enhancing collaboration and efficiency in vehicle tasks such as navigation and maneuvering.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A multi-image display device (106, 206, 306) for a collaborative co-pilot system (104, 204, 304) of a vehicle (100, 200, 300) with a windshield (102), wherein the collaborative co-pilot system (104, 204, 304) includes at least one input device (124, 224, 324) for generating an input signal that displays data associated with at least one of the vehicle (100, 200, 300), a road condition, another vehicle, and a vulnerable road user, wherein the multi-image display device (106, 206, 306) comprises: at least one single-user viewing device (114a / b, 214a / b, 314a / b) with: an augmented reality field of view display module, ERSA module, (118a, 118b), for generating a road condition-associated display, wherein the ERSA module projects the associated display onto a portion of the windscreen visible to a corresponding individual user and displays a road condition-associated geometry; An Extended Display Module (EA module) for creating a shared display visible to a multitude of users, including each individual user; and a computer (188) comprising at least one processor (174) which communicates electrically with the at least one input device (124, 224, 324), the at least one single-user viewing device (114a / b, 214a / b, 314a / b) and the EA module, wherein the computer (188) further comprises a non-transitory computer-readable storage medium (190) which stores instructions such that the at least one processor (174) is programmed to: Receiving the input signal from the at least one input device (124, 224, 324); and Generating a specific actuation signal and a common actuation signal in response to the at least one processor (174) receiving the input signal from the at least one input device (124, 224, 324); wherein the ERSA module (118, 118a, 118b) projects a dedicated display (120a, 120b) in response to the ERSA module (118, 118a, 118b) receiving the dedicated actuation signal from the at least one processor (174); and wherein the EA module (108) projects the common display (110) onto the windscreen (102) when the EA module (108) receives the common actuation signal from the at least one processor (174); the multi-image display device (106, 206, 306) further comprising: a road detection module (170) for generating a road signal associated with the road geometry visible through the windshield (102) and located within the field of vision of the respective individual users; wherein the at least one individual user viewing device (114a / b, 214a / b, 314a / b) further comprises a gaze detection device (116, 116a, 116b) for generating a user signal associated with the position of an eye of the respective individual user, and the at least one processor (174) is further programmed to: Receiving the user signal from the eye-tracking device (116, 116a, 116b); Determining a specific section of the windscreen (102) that overlays the road geometry associated with the road condition, in response to the at least one processor (174) receiving the road signal from the road detection module (170) and the user signal from the eye-tracking device (116, 116a, 116b); and Generating the dedicated actuation signal in response to the at least one processor (174) determining the dedicated section (122a, 122b) of the windscreen (102) that overlays the road geometry; and wherein the ERSA module (118, 118a, 118b) projects the dedicated display (120a, 120b) onto the dedicated section (122a, 122b) of the windscreen (102) and overlays the associated road geometry when the ERSA module (118, 118a, 118b) receives the dedicated actuation signal from the at least one processor (174); wherein the ERSA module (118, 118a, 118b) is configured to generate the dedicated display (120a, 120b) including a notification symbol in response to the ERSA module (118, 118a, 118b) receiving the dedicated actuation signal from the at least one processor (174), wherein the notification symbol is linked to the road condition, wherein the dedicated display (120a, 120b) is configured to display the notification symbol in a far-field image plane of the windshield (102) and information relating to the notification symbol in a near-field image plane of the windshield (102); wherein the EA module (108) is configured to project the common display (110) with first and second colors directed at the respective assigned first and second users of the plurality of users;wherein the EA module (108) is configured to project the common display (110) including at least one annotation addressed to one of the users; ; the EA module (108) includes: a phosphor film (182) applied to the windscreen (102); and an ultraviolet laser device (183) with a microelectromechanical system scanner (186), wherein the ultraviolet laser device (183) projects the common display (100) onto the phosphor layer.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present disclosure relates to display systems that provide information for multiple users in a vehicle, and in particular to a multi-image display device that enables a co-pilot application to display collaborative information to multiple users (e.g., a driver and a co-passenger) and, in addition, to display other information visible to a single designated user (e.g., the driver).

[0002] Automakers are constantly developing systems for efficiently displaying information to the driver. These systems can project light (e.g., graphics or other information) onto a screen located between the driver and the windshield. However, a passenger (e.g., a front passenger) may not have a direct line of sight to the screen, allowing them to accurately see the projected information. Furthermore, while the projected information may be linked to road geometry visible through the windshield, it cannot overlay the road geometry from the passenger's perspective. Therefore, the passenger may need time to determine the road geometry associated with the displayed information.As a result, the passenger cannot work efficiently with the driver to perform a task in the vehicle.

[0003] DE 10 2019 217 273 A1 describes an in-vehicle information display device and a method for controlling the same output, which outputs different information using image output devices arranged on a rear surface of a foreground information display device.The aforementioned information display device applied to a vehicle comprises an output area determination unit configured, upon detection of an event occurring, to determine an image corresponding to the event and an output area from a plurality of areas of a windscreen, a screen correction unit configured to correct the determined image to fit the determined output area, and a projection unit arranged and configured on a rear surface opposite a front surface on which a display is arranged, to project the corrected image onto the determined output area.

[0004] US 2010 / 0 164 702 A1 describes an automotive display system comprising an image projection unit and an angle information acquisition unit. The image projection unit projects a luminous flux containing an image of a display object onto the eye of an image viewer. The angle information acquisition unit acquires at least one of the following: vehicle angle information and external environment angle information. The vehicle angle information refers to an angle of at least one of the following: the position and heading of a vehicle transporting the image viewer. The external environment angle information refers to an angle of a background object at a target position of the display object within the background of the vehicle's external environment.The image projection unit changes the angle of the displayed object in the image based on at least one of the vehicle angle information and external environment angle information acquired by the angle information acquisition unit. It can be considered an object of the present invention to provide an improved multi-image display device.

[0005] A first aspect of the present invention relates to a multi-image display device for a collaborative co-pilot system of a vehicle according to claim 1.

[0006] The drawings described here are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way. Fig. Figure 1 is a schematic diagram of an example of a vehicle with a collaborative display system comprising a multi-image display device with one Extended Display Module, EA Module, for two users and two Extended Reality Field of View Display Modules, ERSA Module, with two associated gaze-tracking devices for one of the two users. Fig. Figure 2 is an enlarged side view of a part of the vehicle. Fig. 1, which shows one of the ERSA modules for projecting a special display that can be viewed by one of the users. Fig. Figure 3 is a schematic view of one of the ERSA modules from Fig. Figure 1, which shows the ERSA modules with a far-field plane and a near-field plane. Fig. Figure 4 is an enlarged side view of a part of the vehicle. Fig. 1, which shows the EA module for projecting a shared display that can be viewed by multiple users. Fig. Figure 5 is a schematic diagram of another example of the vehicle from Fig. Figure 1 shows one of the ERSA modules with a gaze-tracking device and the other ERSA module without a gaze-tracking device. Fig. Figure 6 is a schematic diagram of another example of the vehicle from Fig. 1, which shows the multiview display system with only one ERSA module for one of the users. Fig. Figure 7 is a flowchart for an example of a procedure for operating the collaborative display system for the vehicle of Fig. 1.

[0007] The following description is merely exemplary and is not intended to limit the present disclosure, application or use.

[0008] Referring to Fig. 1 includes an example of a vehicle 100, a windshield 102, and a collaborative display system 104 (system) for one or more co-pilot applications. The co-pilot application (e.g., a navigation application, a parallel parking assistance application, a driving school application, an automatic driver information application, a collision warning application, an infotainment application, etc.) can display information or graphics that enable two or more people to control the vehicle. It can also display information or graphics that enable two or more users to collaborate to perform an activity (e.g.,driving along a route or to a location that is new to a driver and a passenger; parallel parking the vehicle; avoiding a predicted collision with a vulnerable road user, another vehicle, and / or a road obstacle; watching a video when the vehicle is parked; etc.). As described in detail below, the system 104 comprises a multi-image display device 106, which includes an Extended Display Module (EA Module) 108 for projecting a common display 110 onto a common section 112 of the windscreen 102 of the vehicle 100. The common display 110 can be viewed by multiple users (e.g., a driver and a passenger), so that the users can view the common display 110 simultaneously and cooperate to perform the activity.In this non-restrictive example, which is described in detail below, the multi-display device 106 also includes one or more single-user display devices (e.g., a first and a second single-user viewing device 114a, 114b). Each of the first and second single-user viewing devices 114a, 114b includes an eye-tracking device 116 for determining the position of an eye of the associated first and second users. Each of the first and second single-user viewing devices 114a, 114b also includes a first and a second augmented reality head-up display module, ERSA module, 118a, 118b, also known in English as “Augmented Reality Head-up Display”, abbreviated “ARHUD”, for displaying a first and a second dedicated display 120a, 120b on an associated first or second dedicated section 122a, 122b of the windscreen 102.The first and second dedicated sections 122a, 122b overlay a road geometry associated with a road condition and are based on the eye position of the respective first and second users. Each of the first and second dedicated displays 120a, 120b can only be seen by the corresponding designated single user. As a non-restrictive example where the co-pilot application is the navigation application, the first dedicated display 120a for the first user (e.g., the driver) can contain an initial notification icon providing navigation instructions for an upcoming driving maneuver (e.g., an arrow indicating an upcoming turn).Furthermore, the shared display 110 can include a second notification symbol that overlays the edge of a reduced speed limit sign, so that the shared display 110 informs both the driver and the co-passenger of the reduced speed limit as the vehicle approaches the upcoming curve. Additionally, the second dedicated display 120b of the second single-user display device 114b can include a third notification symbol that provides navigation instructions only to the second user (e.g., the co-passenger), and these navigation instructions can be linked to one or more driving maneuvers following the upcoming maneuver. It is conceivable that other examples of the collaborative display system could include more or fewer than two single-user display devices.It is also conceivable that the first dedicated display 120a, the second dedicated display 120b and the common display 110 could provide any other suitable information.

[0009] Continuing the preceding non-restrictive example where the co-pilot application is the navigation application, the vehicle 100 can contain one or more input devices 124 for one or more co-pilot applications. Each input device 124 can be configured to generate an input signal displaying data related to the one or more users, the vehicle, a road condition, another vehicle, and a vulnerable road user (e.g., a pedestrian, a road worker, a person using a wheelchair or other motorized or non-motorized personal mobility device, a person operating an electric scooter or similar device, and a person operating a bicycle or other non-motorized means of transportation).In particular, non-restrictive examples of input devices 124 may include components of a driver monitoring system 126 (DMS) for generating the input signal associated with the driver's attention (e.g., one or more eye-tracking devices 116a, 116b, an inward-facing camera 128, and / or other input devices). Non-restrictive examples of input devices 124 may also include in-vehicle devices attached to the vehicle 100 to generate the input signal associated with the movement of the vehicle 100, other vehicles, and / or vulnerable road users (e.g.,a radar device 130, a lidar device 132, an outward-facing camera 134, a night vision camera 136, an infrared camera 138, an ultrasonic device 140, a steering angle sensor 142, a brake sensor 144, a wheel speed sensor 146, an accelerometer 148, an automated driving system 150 (ADS) and / or other vehicle systems). Non-restrictive examples of the input device 124 may further include off-board devices in the data and communication network 152 [e.g. [e.g., a mobile communications network 154, a dedicated short-range communications (DSRC) network 156, a vehicle-to-infrastructure (V2X) network 158, a global positioning satellite (GPS) network 160, a Wi-Fi network 162, a road traffic monitoring network 164, a road database 166, and an internet network 168]. However, it is conceivable that the input device could include other suitable driver monitoring devices, on-board devices, or off-board devices.It is considered that the input signal may indicate other suitable parameters of the user, the vehicle, other vehicles, vulnerable road users and / or the road condition.

[0010] System 104 further comprises a road detection module 170 for generating a road signal associated with the road geometry visible through the windshield 102 and within the user's field of vision. In this non-restrictive example, the road detection module 170 may include the radar device 130, the lidar device 132, the outward-facing camera 134, the night vision camera 136, the infrared camera 138, the ultrasonic device 140, the cellular network 154, the DSRC network 156, the V2X network 158, the GPS network 160, the Wi-Fi network 162, the road traffic monitoring network 164, the road database 166, and / or the internet network 168. The road signal can indicate the road geometry in the form of an intersection between a first road on which the vehicle is currently driving and a second road that intersects the first road and at which the vehicle is supposed to turn 100 according to the navigation application.In other examples, the road signal may indicate other road geometries, such as an entry ramp, an exit ramp, a junction lane, an adjacent lane and / or other road geometries on which the vehicle is to travel according to the navigation application.

[0011] Each of the first and second ERSA modules 118a, 118b projects an associated first and second dedicated display 120a, 120b onto first and second dedicated sections 122a, 122b of the windscreen 102, which can be seen by an associated first and second user (e.g., the driver and the front passenger). The first and second dedicated sections 122a, 122b of the windscreen 102 can be positioned directly in front of an associated first and second user and at variable virtual distances from the first and second users. While the first ERSA module 118a is described in detail below and in Fig. As shown in Figure 2, the second ERSA module 118b is identical to the first ERSA module 118a. The first ERSA module 118a projects the first dedicated display 120a with one or more notification symbols 172 associated with the road condition in response to the first ERSA module 118a receiving a first dedicated actuation signal from the processor 174, as described in detail below.

[0012] With reference to Fig. 3 The first dedicated display 120a is configured to display the notification symbol 172 on the windshield 102 within a far-field image plane 178 of the first dedicated section 122a of the windshield 102, with the notification symbol 172 being displayed at a position on the windshield 102 that overlays the road geometry associated with the road condition. The far-field image plane 176 contains images that overlay the road geometry 160, e.g., the roadway, visible through the windshield 102. In the Fig. 2 and Fig. In the example shown in Figure 3, the far-field image plane 176 covers only a portion of the entire plane of the windshield 102. However, it is conceivable that the far-field image plane covers the entire plane of the windshield that is not occupied by the near-field image plane 184. Furthermore, the far-field image plane can, as in Fig. 3, extending over each lane, whereas other examples of the far-field image plane extend only over a portion of the lanes that are part of the roadway. The first dedicated display 120a is further configured to display information regarding the notification symbol within a near-field image plane 184 of the first dedicated section 122a of the windscreen 102. In addition, the first single-user viewing device 114a further comprises the gaze-detection device 116a for generating a first user signal that is linked to the position of the eye of the associated first user, such that the first ERSA module 118a projects the notification symbol 172 onto the first dedicated section 122a of the windscreen 102, which is superimposed on the associated road geometry (e.g.,an arrow overlaid on the current lane to instruct the driver to maneuver the vehicle 100 from the current lane into an adjacent lane). In other, non-restrictive examples, the notification symbol 172 may include an animated graphic, a warning symbol, a vehicle symbol, an animal symbol, a pedestrian symbol, and the like.

[0013] The EA module 108 is configured to project the shared display 110 onto a shared section 112 of the windscreen 102, such that the shared display 110 contains one or more shared notification icons that are visible to both the first and second users (e.g., the driver and the front passenger) simultaneously. In this non-restrictive example, the shared section 112 of the windscreen 102 is located between the first and second dedicated sections 122a, 122b of the windscreen 102 and at a common distance of at least two of the users (e.g., the first and second users 180a, 180b).

[0014] A non-restrictive example of EA module 108 (see Fig. 4) comprises a phosphor film 182, which can be applied to the windshield 102, and an ultraviolet laser device 183 (UV laser device) with a microelectromechanical system scanner 186 (MEMS scanner). The UV laser device 184 projects the common display 110 with the common warning symbols onto the phosphor film 182, the common warning symbols superimposed on the associated road geometry. In one non-restrictive example, the common warning symbol may include brackets that superimpose on the edge of a reduced speed limit sign. In other non-restrictive examples, the EA module 108 is configured to project the common display 110 with first and second colors directed at the associated first and second users.The EA module 108 is further configured to project the common display 110 with one or more comments addressed to one of the first and second users.

[0015] Dating back to Fig. 1 The system 104 further comprises a computer 188 with one or more processors 174, which communicate electrically with the input devices 124, the first and second single-user viewing devices 114a, 114b, the EA module 108, and the road detection module 170. The computer 188 further comprises a non-transitory computer-readable memory medium 190 (CRM) that stores instructions such that the processor 174 is programmed to receive the input signal from the input devices 124, including the road signal from the road detection module 170 and the first and second user signals from the eye-tracking device 116 of the first and second single-user viewing devices 114a, 114b. The first and second user signals comprise perceptual data associated with the position of the head of the first and second users and the orientation or gaze position of each user's eyes.It is understood that the users' eye and head positions are located in a different place than the image acquisition devices (e.g., the outward-facing camera 134, the night vision camera 136 and / or the infrared camera 138), and therefore there may be areas in the environment that the user can see that are not captured by the image acquisition devices, and vice versa.

[0016] The processor 174 is programmed to determine the first dedicated section 122a of the windscreen 102, which overlays the road geometry associated with the road condition, in response to the processor 174 receiving the road signal from the road detection module 170 and the processor 174 further receiving the first user signal from the eye-tracking device 116 for the first single-user viewing device 114a. The processor 174 is further programmed to generate the first dedicated actuation signal for the first single-user viewing device in response to the processor determining the first dedicated section 122a of the windscreen 102 and the processor 174 receiving the input signal from the input devices 124.

[0017] The first ERSA module 118a projects the first dedicated display 120a onto the first dedicated section 122a in response to the ERSA module 118 receiving the first dedicated actuation signal from the processor 174. The first ERSA module 118a is configured to generate the first dedicated display, including a first notification icon, in response to receiving the first dedicated actuation signal from the processor 174. The first notification icon is linked to the road condition. As shown in Fig. As shown in Figure 4, the first dedicated display 120a is configured to display the first notification symbol in a far-field image plane of the windscreen 102 and information regarding the first notification symbol in a near-field image plane of the windscreen 102.

[0018] The processor 174 is programmed to determine the second dedicated section 122b of the windscreen 102, which overlays the road geometry associated with the road condition, in response to the processor 174 receiving the road signal from the road detection module 170 and the processor 174 further receiving the second user signal from the eye-tracking device 116 for the second single-user vision device 114b. The processor 174 is further programmed to generate the second dedicated actuation signal for the second single-user vision device 114b in response to the processor 174 determining the second dedicated section 122b of the windscreen 102 and the processor 174 receiving the input signal from the input devices 124.

[0019] The second ERSA module 118b projects the second dedicated display 120b onto the second dedicated section 122b in response to the second ERSA module 118b receiving the second dedicated actuation signal from the processor 174. The second ERSA module 118b is configured to generate the second dedicated display 120b, including a notification icon, in response to the second ERSA module 118b receiving the second dedicated actuation signal from the processor 174. The notification icon is linked to the road condition. As shown in Fig. As shown in Figure 4, the second dedicated display is configured to show the notification symbol in a far-field image plane of the windscreen 102 and information relating to the notification symbol in a near-field image plane of the windscreen 102.

[0020] The processor 174 is programmed to generate a common actuation signal when it receives the road signal from the road detection module 170 and the input signal from the input devices 124. The EA module 108 projects the common display 110 onto the common section 112 of the windshield 102 after receiving the common actuation signal from the processor 174.

[0021] Another, non-restrictive example of a vehicle 200 with a collaborative co-pilot system 204 with a multi-view display 206 is similar to vehicle 100. Fig. 1 and comprises the same components, identified by the same numbers increased by 100. However, while the multi-image display device 106 includes the second single-user viewing device 114b with the eye-tracking device 116, the multi-image display device 206 includes a second single-user device 214b without an eye-tracking device.

[0022] Another, non-restrictive example of a vehicle 300 with a collaborative co-pilot system 304 with a multi-image display device 306 is similar to the vehicle 100 of Fig. 1 and comprises the same components, which are identified by the same numbers increased by 200. However, while the multi-image display device 106 includes the second single-user display device 114b, the multi-image display device 306 does not include a second single-user device.

[0023] In Fig. 7 is a non-restrictive example of a method 400 for operating the multi-image display device 106 for the collaborative display system 104 of Fig. Figure 1 shows the method 400 beginning in block 402 with the generation of an input signal associated with a road condition using the input device 124. The method 400 further comprises generating, using a gaze detection device 116 of the first and second single-user viewing devices 114a, 114b, the first and second user signals which are associated with a position of an eye of the respective first and second users.

[0024] In block 404, the method 400 further comprises generating the road signal using the road detection module 170, which is associated with the road geometry visible through the windshield 102 and located within the field of vision of the respective individual users.

[0025] In block 406, method 400 further comprises receiving, using processor 174, the input signal from input device 124 and the road signal from road detection module 170. Method 400 further comprises receiving, using processor 174, the first and second user signals from eye-tracking devices 116a, 116b and the associated first and second single-user viewing devices 114a, 114b.Method 400 further comprises determining, using the processor 174, the first and second dedicated sections 122a, 122b of the windscreen 102, which overlays the road geometry associated with the road condition, in response to the processor 174 receiving the road signal from the road detection module and the processor 174 receiving the first and second user signals from the gaze detection device 116a, 116b of the first and second single-user viewing devices 114a, 114b.

[0026] In block 408, method 400 further comprises generating the first and second dedicated actuation signals and the common actuation signal using processor 174 in response to processor 174 receiving the input signal from input device 124 and processor 174 receiving the road signal from road detection module 170. Method 400 further comprises generating the first and second dedicated actuation signals using processor 174 based on processor 174 determining an associated first and second dedicated section 122a, 122b of the windshield.

[0027] In block 410, method 400 further comprises generating, using the first ERSA module 118a and the second ERSA module 118b, an associated first or second dedicated display 120a, 120b, which is associated with the road condition. More precisely, method 400 may comprise projecting, using the first and second ERSA modules 118a, 118b, an associated first and second dedicated display 120a, 120b onto associated first and second dedicated sections 122a, 122b of the windscreen 102, which are visible to corresponding individual first and second users. The first and second dedicated displays 120a, 120b overlay the road geometry associated with the road condition in response to the first and second ERSA modules 118a, 118b receiving an associated first and second dedicated actuation signal from the processor 174.

[0028] In block 412, method 400 further comprises generating the common display 110, which is related to the road condition, using the EA module 108. More specifically, method 400 comprises projecting the common display 110, using the EA module 108, onto a portion of the windshield 102 visible to the users, including the first and second users, in response to the EA module 108 receiving the common actuation signal from the processor 174. More specifically, in this non-limiting example, method 400 comprises projecting the common display 110 onto the common section 112 of the windshield 102 using the EA module 108, the common section 112 being located at a common distance of two or more users.In this non-restrictive example, Method 400 further includes projecting the common display 110 with a variety of colors using the EA module 108, the variety of colors providing a notification to one of the associated users. Method 400 may further include projecting, using the EA module 108, the common display 110 containing one or more annotations to provide a notification to one or more of the first and second users.

[0029] Non-restrictive examples of vehicles include land vehicles such as sedans, light and heavy trucks, sport utility vehicles, vans, or motorhomes. Vehicle 100 is an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous (manual) vehicle. A non-restrictive example of a vehicle is an electric vehicle with a propulsion system (e.g., with an electric motor). However, it is conceivable that other non-restrictive examples of the vehicle could have other suitable propulsion systems (e.g., with an internal combustion engine, a hybrid engine, a hydrogen fuel cell, etc.).

[0030] Processors can refer to or be part of an electronic circuit, a combinational logic circuit, a field-programmable gate array (FPGA), a (shared, dedicated, or grouped) processor that executes code, or a combination of some or all of the above, such as in a system-on-a-chip. Processors can also be based on a microprocessor, such as a computer with at least one processor, memory (RAM and / or ROM), and associated input and output buses. The processor can operate under the control of an operating system residing in memory. The operating system can manage computer resources so that computer program code, embodied as one or more computer software applications (such as an application residing in memory), can execute instructions from the processor.In an alternative embodiment, the processor can execute the application directly; in this case, the operating system can be omitted.

Claims

[1] A multi-image display device (106, 206, 306) for a collaborative co-pilot system (104, 204, 304) of a vehicle (100, 200, 300) with a windshield (102), wherein the collaborative co-pilot system (104, 204, 304) includes at least one input device (124, 224, 324) for generating an input signal displaying data associated with at least one of the vehicle (100, 200, 300), a road condition, another vehicle and a vulnerable road user, wherein the multi-image display device (106, 206, 306) comprises: at least one single-user viewing device (114a / b, 214a / b, 314a / b) with: an augmented reality field of view display module, ERSA module, (118a, 118b), for generating a road condition-associated display, wherein the ERSA module projects the associated display onto a portion of the windscreen visible to a corresponding individual user and displays a road condition-associated geometry; An Extended Display Module (EA module) for creating a shared display visible to a multitude of users, including each individual user; and a computer (188) comprising at least one processor (174) which communicates electrically with the at least one input device (124, 224, 324), the at least one single-user viewing device (114a / b, 214a / b, 314a / b) and the EA module, wherein the computer (188) further comprises a non-transitory computer-readable storage medium (190) which stores instructions such that the at least one processor (174) is programmed to: Receiving the input signal from the at least one input device (124, 224, 324); and Generating a specific actuation signal and a common actuation signal in response to the at least one processor (174) receiving the input signal from the at least one input device (124, 224, 324); wherein the ERSA module (118, 118a, 118b) projects a dedicated display (120a, 120b) in response to the ERSA module (118, 118a, 118b) receiving the dedicated actuation signal from the at least one processor (174); and wherein the EA module (108) projects the common display (110) onto the windscreen (102) when the EA module (108) receives the common actuation signal from the at least one processor (174); the multi-image display device (106, 206, 306) further comprising: a road detection module (170) for generating a road signal associated with the road geometry visible through the windshield (102) and located within the field of vision of the respective individual users; wherein the at least one individual user viewing device (114a / b, 214a / b, 314a / b) further comprises a gaze detection device (116, 116a, 116b) for generating a user signal associated with the position of an eye of the respective individual user, and the at least one processor (174) is further programmed to: Receiving the user signal from the eye-tracking device (116, 116a, 116b); Determining a specific section of the windscreen (102) that overlays the road geometry associated with the road condition, in response to the at least one processor (174) receiving the road signal from the road detection module (170) and the user signal from the eye-tracking device (116, 116a, 116b); and Generating the dedicated actuation signal in response to the at least one processor (174) determining the dedicated section (122a, 122b) of the windscreen (102) that overlays the road geometry; and wherein the ERSA module (118, 118a, 118b) projects the dedicated display (120a, 120b) onto the dedicated section (122a, 122b) of the windscreen (102) and overlays the associated road geometry when the ERSA module (118, 118a, 118b) receives the dedicated actuation signal from the at least one processor (174); wherein the ERSA module (118, 118a, 118b) is configured to generate the dedicated display (120a, 120b) including a notification symbol in response to the ERSA module (118, 118a, 118b) receiving the dedicated actuation signal from the at least one processor (174), wherein the notification symbol is linked to the road condition, wherein the dedicated display (120a, 120b) is configured to display the notification symbol in a far-field image plane of the windshield (102) and information relating to the notification symbol in a near-field image plane of the windshield (102); wherein the EA module (108) is configured to project the common display (110) with first and second colors directed at the respective assigned first and second users of the plurality of users;wherein the EA module (108) is configured to project the common display (110) including at least one annotation addressed to one of the users; the EA module (108) includes: a phosphor film (182) applied to the windscreen (102); and an ultraviolet laser device (183) with a microelectromechanical system scanner (186), wherein the ultraviolet laser device (183) projects the common display (100) onto the phosphor layer.

Citation Information

Patent Citations

  • In-vehicle information display device and method for controlling the same

    DE102019217273A1

  • Automotive display system and display method

    US20100164702A1