Display system of vehicle, control method thereof, and computer readable storage medium

CN115503605BActive Publication Date: 2026-09-08HYUNDAI MOTOR CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210222776.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-06-23
Filing Date
2022-03-07
Publication Date
2026-09-08
Estimated Expiration
2042-03-07

AI Technical Summary

Technical Problem

因此,当投影虚拟图像而不考虑驾驶员的身体状况或姿势时,存在增强现实内容与道路上的期望位置不精确匹配的问题

Benefits of technology

[0021] According to the embodiments, the problem caused by the augmented reality content of the augmented reality head-up display matching outside the target location can be solved, thereby improving the commercial viability of the head-up display and increasing consumer quality satisfaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115503605B_ABST
    Figure CN115503605B_ABST
Patent Text Reader

Abstract

A display system of a vehicle, a control method thereof, and a computer-readable storage medium, including: a user input device; a head-up display configured to project a virtual image including augmented reality content, and to adjust a projection position of the augmented reality content according to predetermined driver viewpoint information and a left-right direction offset; and a controller configured to correct the driver viewpoint information or the left-right direction offset according to a control input received through the user input device, wherein the left-right direction offset indicates a degree to which the augmented reality content is offset to the left or right.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-citation of related applications

[0002] This application claims priority to Korean Patent Application No. 10-2021-0081383, filed on June 23, 2021, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to a vehicle display system and its control method. More specifically, the present invention relates to a vehicle display system including an augmented reality head-up display and its control method. Background Technology

[0004] Head-up displays were developed to provide flight information to pilots during flight by providing them in aircraft, and more recently, they have been used to more conveniently inform vehicle drivers of vehicle-related driving information.

[0005] The vehicle's head-up display projects a virtual image onto the windshield in front of the driver's field of vision, and the driver visually recognizes this image. Therefore, the driver can see necessary information directly while looking forward, minimizing driver distraction and contributing to safer driving.

[0006] Recently, augmented reality head-up displays (AR Head-Up Displays) combining vehicle head-up display technology and augmented reality technology have been developed. AR Head-Up Displays provide more realistic and intuitive information by matching vehicle driving-related information (such as navigation information) with the road ahead in real time and projecting the information onto the windshield.

[0007] Furthermore, although the augmented reality head-up display projects virtual images from the same location, the image of the virtual image projected onto the road ahead may differ depending on the driver's viewpoint. The driver's viewpoint may vary due to their physical condition or posture. Therefore, when projecting virtual images without considering the driver's physical condition or posture, there is a problem of inaccurate matching between the augmented reality content and the desired location on the road.

[0008] The information disclosed in the background section of this invention is only intended to enhance the understanding of the general background of this invention and should not be construed as an admission or in any way implying that such information constitutes prior art known to those skilled in the art. Summary of the Invention

[0009] Various aspects of the present invention aim to provide a vehicle display system and control method thereof that support adjusting the projection position of augmented reality content on an augmented reality head-up display according to the driver.

[0010] A vehicle display system according to various exemplary embodiments of the present invention includes: a user input device; a head-up display configured to project a virtual image including augmented reality content and adjust the projection position of the augmented reality content according to predetermined driver viewpoint information and first and second directional offsets; and a controller configured to correct the driver viewpoint information or the first and second directional offsets according to control input received through the user input device, wherein the first and second directional offsets indicate the amount by which the augmented reality content moves in a first direction or a second direction.

[0011] The display system may also include an additional display. The controller may display a user interface screen on this additional display for correcting driver viewpoint information and first and second directional offsets, and may correct the driver viewpoint information or first and second directional offsets based on control input received while displaying the user interface screen.

[0012] The user interface screen may include at least one graphical object representing the driver's view state, which is changed by correcting driver viewpoint information or first and second directional offsets.

[0013] The user interface screen may include a view status bar that indicates the view status of the lane or road profile displayed to the driver based on driver viewpoint information or first and second directional offsets.

[0014] The controller can increase the slope of the view status bar as the driver's viewpoint increases in height, and decrease the slope of the view status bar as the driver's viewpoint decreases in height.

[0015] When the first and second directional offsets are adjusted to the left, the controller can move the view status bar to the left, and when the first and second directional offsets are adjusted to the right, the controller can move the view status bar to the right.

[0016] Furthermore, a method for controlling a display system including a head-up display that projects augmented reality content onto the windshield of a vehicle includes: displaying a user interface screen for correcting driver viewpoint information and for determining first and second directional offsets for determining the projection position of the augmented reality content; correcting the driver viewpoint information or the first and second directional offsets based on control input received via a user input device; and adjusting the projection position of the augmented reality content based on the corrected driver viewpoint information or the corrected first and second directional offsets, wherein the first and second directional offsets indicate the amount by which the augmented reality content is moved to the left or right.

[0017] The user interface screen may include at least one graphical object representing the driver's view state, which is changed by correcting driver viewpoint information or first and second directional offsets.

[0018] The user interface screen may include a view status bar that indicates the view status of the lane or road outline displayed to the driver based on the driver's viewpoint information or first and second directional offsets.

[0019] The slope of the view status bar can increase as the driver's viewpoint information height level increases, and the slope can decrease as the driver's viewpoint information height level decreases.

[0020] When the first and second directional offsets are adjusted to the first direction, the view status bar can be moved to the first direction, and when the first and second directional offsets are adjusted to the second direction, the view status bar can be moved to the second direction.

[0021] According to the embodiments, the problem caused by the augmented reality content of the augmented reality head-up display matching outside the target location can be solved, thereby improving the commercial viability of the head-up display and increasing consumer quality satisfaction.

[0022] The methods and apparatus of the present invention have other features and advantages, which will be apparent or set forth in more detail from the accompanying drawings and the following detailed description, which together serve to explain certain principles of the invention. Attached Figure Description

[0023] Figure 1 The illustration schematically shows a display system for a vehicle according to an exemplary embodiment of the present invention;

[0024] Figure 2 An example of a head-up display setup screen provided in a display system according to an exemplary embodiment of the present invention is shown;

[0025] Figure 3 Used to describe changes in the driver's viewing state based on the driver's viewpoint position;

[0026] Figure 4 It shows when in Figure 2 An example of how the display status of the view status bar 24 changes when adjusting the driver's viewpoint information in the settings screen 20;

[0027] Figure 5 The display status of the view status bar 24 is shown as it changes. Figure 2 The example shown in settings screen 20 is how the left and right offsets are changed;

[0028] Figure 6 An example of a virtual image projected via a heads-up display is shown;

[0029] Figure 7A control method for a vehicle display system according to an exemplary embodiment of the present invention is illustrated schematically.

[0030] It is understood that the accompanying drawings are not to scale and present slightly simplified representations of various features illustrating the basic principles of the invention. Specific design features of the invention as included herein (including, for example, specific dimensions, orientations, positions, and shapes) will be determined in part by the specific intended application and environment of use.

[0031] In the accompanying drawings, reference numerals refer to the same or equivalent portions of the invention throughout the various figures. Detailed Implementation

[0032] Reference will now be made in detail to various embodiments of the invention, examples of which are illustrated in the accompanying drawings and described below. While the invention will be described in conjunction with exemplary embodiments thereof, it will be understood that this description is not intended to limit the invention to those exemplary embodiments. On the other hand, the invention is intended to cover not only the exemplary embodiments thereof, but also various alternatives, modifications, equivalents and other embodiments that may be included within the spirit and scope of the invention as defined in the appended claims.

[0033] In the following, embodiments including those described in the exemplary embodiments will be described in detail with reference to the accompanying drawings, but the same or similar components have the same and similar reference numerals, and overlapping descriptions will be omitted.

[0034] The suffixes “module” and / or “part” used for constituent elements in the following description are provided or mixed only for ease of specification writing and do not inherently have different meanings or functions. Furthermore, in describing exemplary embodiments included in exemplary embodiments, detailed descriptions are omitted where it is determined that a detailed description of the relevant known art might obscure the essential points of the exemplary embodiments included in the exemplary embodiments. Moreover, the accompanying drawings are only for easy understanding of the exemplary embodiments included in the exemplary embodiments, and the technical ideas included in the exemplary embodiments of the invention are not limited by the drawings; all variations included within the spirit and technical scope of the invention can be understood to include equivalents or substitutions.

[0035] Various constituent elements can be described using terms including ordinal numbers such as first, second, etc., but the constituent elements are not limited by these terms. These terms are only used to distinguish one constituent element from another.

[0036] When it is said that a component is "connected" or "linked" to another component, it can mean that it is directly connected or linked to the other component, but it should be understood that there can be other components between them. On the other hand, when it is said that a component is "directly connected" or "directly linked" to another component, it can be understood that there are no other components between them.

[0037] In this application, terms such as “comprising” or “having” are intended to indicate the presence of features, quantities, steps, operations, components, parts or combinations thereof described in the specification, and may be understood to preclude the possibility of the presence or addition of one or more other features, quantities, steps, operations, components, parts or combinations thereof.

[0038] Furthermore, terms such as “part,” “group,” “module,” and “device” described in the specification refer to a unit that performs at least one function or operation, which can be implemented by hardware, software, or a combination of hardware and software.

[0039] Figure 1 The illustration schematically depicts a vehicle display system according to various exemplary embodiments of the present invention.

[0040] refer to Figure 1 According to various exemplary embodiments of the present invention, the vehicle display system 10 may include a user input device 11, a storage device 13, a head-up display (HUD) 14, a display 15, and a controller 16.

[0041] User input device 11 can receive control input from display system 10 from user (driver). User input device 11 may include various types of input devices, such as touch, rotary, tilt, and button types. For example, user input device 11 may include a touchpad formed by a touch sensor coupled to display 15 in an interlayer structure, which will be described later. User input device 11 may be a voice recognition device configured to recognize user voice commands. In this case, user input device 11 may include a microphone for receiving audio signals corresponding to user voice commands. User input device 11 may be a gesture recognition device capable of recognizing user gestures. In this case, user input device 11 may also include a camera for capturing images including user gestures.

[0042] The communication device 12 connects the display system 10 to an external device (e.g., a user terminal) via a wireless communication network, and can send and receive data, information, control inputs, etc. between the display system 10 and the external device.

[0043] Storage device 13 can store various information, data, etc., processed by display system 10. For example, storage device 13 can store various data for displaying the user interface (UI) screen of display system 10 (e.g., menu item list, graphic objects for displaying each menu item, display characteristics of each graphic object (shape, display position, etc.)). Furthermore, storage device 13 can store, for example, setup information for HUD 14, such as driver viewpoint information, left-right offset, etc. Here, driver viewpoint information is expressed by estimating the driver's viewpoint position in display system 10 and matching it to a virtual coordinate space, and HUD 14 can adjust the projection position of each augmented reality content included in the virtual image based on the driver viewpoint information. Furthermore, left-right offset is a value indicating how much the projection position of the virtual image moves in the left-right direction, and based on this, HUD 14 can move the projection position of the virtual image or the augmented reality content included in the virtual image in its left-right direction.

[0044] HUD 14 can project virtual images, including information related to vehicle driving (e.g., navigation information, speed, and lane information), onto the vehicle's windshield. HUD 14 is an augmented reality (AR) HUD and can project virtual images such that the augmented reality content included in the virtual images matches the actual road through the windshield. To this end, HUD 14 can control the projection position of the augmented reality content included in the virtual images based on driver viewpoint information and left-right offset stored in storage device 13.

[0045] Display 15 is a different display from HUD 14 and can display the UI screen used to set up display system 10. Display 15 can be a display included in the vehicle's audio-visual navigation (AVN) system, head unit, cluster, etc.

[0046] The controller 16 can perform overall control operations on the display system 10. The controller 16 can set the configuration information of the HUD 14 (e.g., driver's viewpoint information, left and right directional offset) based on control input received through the user input device 11. For this purpose, the controller 16 can display a UI screen for setting the configuration information of the HUD 14 through the display 15.

[0047] Figure 2 An example of the setup screen for the HUD 14 provided in display system 10 is shown. (Reference) Figure 2Among the menu items displayed on the settings screen 20, AR Matching Adjustment 21 is a menu item used to adjust the position of augmented reality content matching by adjusting the driver's viewpoint information and left-right offset in the settings information of HUD 14. When AR Matching Adjustment 21 is selected from the settings screen 20 via control input received through user input device 11, the controller 16 can display touch objects 22a, 22b and 23a, 23b and 23c for adjusting AR matching, and graphic objects 24, 25, 26a, 26b for displaying the AR matching status on the screen.

[0048] Depending on the driver's viewpoint height, the road shape displayed to the driver (e.g., lane slope or road contour) may vary. Therefore, in order to match the augmented reality content projected via HUD 14 with the desired location (target location) on the actual road, the position of the projected augmented reality content needs to be adjusted according to the driver's viewpoint height. In setup screen 20, touch objects 22a and 22b are touch objects used to correct predetermined driver viewpoint information, that is, touch objects used to adjust the height level up or down according to the driver's predetermined viewpoint information. The driver can adjust the height level of the driver's viewpoint information by touching the corresponding touch objects 22a and 22b.

[0049] When the driver's viewpoint moves left or right, the positional match between the augmented reality content projected through the HUD 14 and the actual road may become misaligned. As the driver's viewpoint moves left, the position matching the augmented reality content of the virtual image with the actual road can shift to the right. Conversely, as the driver's viewpoint moves right, the position matching the augmented reality content of the virtual image with the actual road can shift to the left. Therefore, to match the augmented reality content projected through the HUD 14 with the target position on the actual road, the projection position of the augmented reality content needs to be shifted left and right based on the driver's left-right viewpoint. In the setup screen 20, touch objects 23a, 23b, and 23c are touch objects used to determine the left-right offset of the virtual image (i.e., touch objects used to shift the projection position of the augmented reality content included in the virtual image to the left or right). The driver can set the left / right offset by touching touch objects 23a and 23b or dragging touch object 23c to shift the projection position of the augmented reality content included in the virtual image to the left or right.

[0050] In the settings screen 20, the view status bar 24 can display changes in the driver's view status, such as changes in the view status of the road outline or lane based on predetermined driver viewpoint information and left-right offset. Furthermore, the guide image 25 is a virtual road image predicted to be displayed to the driver based on predetermined driver viewpoint information and left-right offset, and graphic objects 26a and 26b can represent predetermined values ​​for the driver viewpoint information and left-right offset.

[0051] supply Figure 3 This describes changes in the driver's viewing posture based on their viewpoint position. Furthermore, Figure 4 It shows when in Figure 2 An example of how the display status of the view status bar 24 changes when adjusting the driver's viewpoint information in settings screen 20. Figure 5 It shows when in Figure 2 This is an example of how the display status of the view status bar 24 changes when adjusting the left and right offset in the settings screen 20.

[0052] refer to Figure 3 As the driver's viewpoint VP rises, the gradient of the lane L displayed to the driver increases; conversely, as the driver's viewpoint VP falls, the gradient of the lane L displayed to the driver can decrease. For example... Figure 4 As shown, when the driver touches Figure 2 When the driver touches touch object 22a in the settings screen 20 to increase the height level, the controller 16 increases the slope of the viewing status bar 24 and displays the increased slope. Conversely, when the driver touches touch object 22b to decrease the height level, the controller 16 decreases the slope of the viewing status bar 24 and displays the slope. Therefore, the driver can intuitively identify how to adjust the view state in response to adjusting the height level of the driver's viewpoint information on the settings screen 20 by observing changes in the display status (slope) of the view status bar 24.

[0053] like Figure 5 As shown, when the touch object 23a is touched or the touch object 23c is in Figure 2 When dragging left on the settings screen 20, the controller 16 moves the view status bar 24 to the left. Furthermore, the more the touch object 23b is touched or the more the touch object 23c is dragged to the right, the more the controller 16 moves the view status bar 24 to the right. Therefore, the driver can intuitively identify how to adjust the projection position of each augmented reality content element included in the virtual image by adjusting the left-right offset on the settings screen 20 in response to changes in the display state of the view status bar 24 (left-right movement).

[0054] When the controller 16 is setting the configuration information for the HUD 14, that is, when the user interface screen for setting the configuration information for the HUD 14 is displayed on the display 15, the HUD 14 can be controlled so that the projection position of the augmented reality content projected through the HUD 14 based on the changed configuration information can be adjusted in real time. Therefore, the driver can visually check how the changed HUD 14 configuration information affects the projection of the actual virtual image.

[0055] Figure 6 An example of a virtual image 30 projected via HUD 14 when settings change is shown, and how the virtual image 30 is displayed to the driver is illustrated. Reference Figure 6 When the driver's viewpoint information or lateral offset changes, the virtual image 30 projected through the HUD 14 may additionally include graphic objects 31, 32, and 33, which allow the driver to intuitively identify the AR matching status. Graphic object 31 is augmented reality content, and the driver can check the AR matching status by examining the matching position of the augmented reality content 31 on the actual road. Graphic object 32 is a guide line corresponding to the aforementioned view status bar 24, and its slope and display position can be determined in response to the current predetermined driver viewpoint information and lateral offset. Therefore, the driver can check the AR matching status by examining the matching status between the guide line 32 and the actual road lane 35. Graphic object 33 is a graphic object representing the current predetermined value of the driver's viewpoint information and lateral offset, and the driver can examine graphic object 33 to determine the current predetermined value of the driver's viewpoint information and lateral offset.

[0056] As described above, when the driver’s viewpoint information or left-right directional offset is changed based on the control input received through the user input device 11, the controller 16 can update the setting information of the HUD 14 stored in the storage device 13 based on the changed driver’s viewpoint information or left-right directional offset.

[0057] Therefore, HUD 14 can determine the projection position of augmented reality content based on updated driver viewpoint information or left-right offset. Here, HUD 14 can adjust the projection position of the augmented reality content by moving the virtual image as a whole or by adjusting the position of the augmented reality content within the virtual image based on updated driver viewpoint information or left-right offset.

[0058] Figure 7 A control method for a vehicle display system according to various exemplary embodiments of the present invention is illustrated schematically. Figure 7 The method shown can be found in the reference. Figures 1 to 6 The controller 16 of the described display system 10 is used to perform the operation.

[0059] refer to Figure 7 The controller 16 executes a menu for setting the HUD 14 based on the control input received through the user input device 11 (S10). Therefore, a setup screen for setting the HUD 14 can be displayed on the display 15 (S11).

[0060] Will Figure 2 As various exemplary embodiments of the present invention, the setup screen 20 for setting the HUD 14 includes touch objects 22a and 22b for adjusting driver viewpoint information and touch objects 23a, 23b and 23c for adjusting the left and right directional offset of augmented reality content, and may include graphic objects 26a and 26b indicating predetermined values ​​of driver viewpoint information and left and right directional offset, and graphic objects 24 and 26 indicating the driver's field of vision state corresponding to the predetermined values ​​of driver viewpoint information and left and right directional offset.

[0061] The controller 16 can receive control input via the user input device 11 while displaying the setup screen of the HUD 14, and can correct predetermined driver time information or left-right directional deviation based on the received control input (S12). Furthermore, when correcting the driver viewpoint information or left-right directional deviation through step S12, the controller 16 can control the HUD 14 to adjust the projection position of the augmented reality content based on the corrected driver viewpoint information or left-right directional deviation (S13).

[0062] According to the above embodiments, the augmented reality content of HUD 14 provides a user interface for finely adjusting the matching position on the actual road. Therefore, when the augmented reality content is matched outside the target position based on the driver's physical condition or driving posture, the driver can finely adjust the position of the projected augmented reality content of HUD 14 according to the driver's viewpoint. Thus, the problem of mismatch between the augmented reality content of HUD 14 and the target position can be solved, improving the marketability of HUD 14 and increasing consumer satisfaction.

[0063] Meanwhile, in the above embodiments, a UI screen for setting the driver's viewpoint information and the left-right offset of augmented reality content of the HUD 14 installed in the controller 16 of the vehicle is exemplarily shown, and predetermined driver time information and left-right offset are set based on control input received through the user input device 11. However, the exemplary embodiments of the present invention are not limited thereto. According to another exemplary embodiment of the present invention, a user terminal (driver terminal) connected to the display system 10 via the communication device 12 displays a UI screen for setting the driver's viewpoint information and the left-right offset of augmented reality content of the HUD 14 on its display, and the controller 16 can adjust the driver's viewpoint information and the left-right offset of the HUD 14 based on control input received from the user terminal via the communication device 12.

[0064] The control method for the vehicle display system according to the above embodiments can be executed by software. When implemented as software, the components of the present invention are code segments that perform the necessary work. The program or code segment can be stored on a processor-readable medium or transmitted via computer data signals coupled to a carrier wave in a transmission medium or communication network.

[0065] Computer-readable recording media include various recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, DVD_ROM, DVD_RAM, magnetic tape, floppy disk, hard disk, and optical data storage devices. Furthermore, computer-readable recording media are distributed to computer devices connected to a network, thus allowing computer-readable code to be stored and executed in a distributed manner.

[0066] Furthermore, terms related to control devices, such as "controller," "control unit," "control device," or "control module," refer to hardware devices including a memory and a processor configured to execute one or more steps interpreted as an algorithmic structure. The memory stores the algorithmic steps, and the processor executes the algorithmic steps to perform one or more processes of methods according to various exemplary embodiments of the invention. A control device according to exemplary embodiments of the invention may be implemented via a non-volatile memory configured to store algorithms for controlling the operation of various components of a vehicle or data regarding software commands for executing the algorithms, and a processor configured to perform the aforementioned operations using the data stored in the memory. The memory and processor may be separate chips. Alternatively, the memory and processor may be integrated into a single chip. The processor may be implemented as one or more processors. The processor may include various logic circuits and arithmetic circuits, capable of processing data according to a program provided from the memory, and generating control signals based on the processing results.

[0067] The control device may be at least one microprocessor operated by a predetermined program, which may include a series of commands for executing the methods included in the various exemplary embodiments of the present invention described above.

[0068] In various exemplary embodiments of the present invention, the control device may be implemented in hardware or software, or in a combination of hardware and software.

[0069] For ease of interpretation and accurate definition of the appended claims, the terms “above,” “below,” “inside,” “outside,” “up,” “down,” “facing upwards,” “facing downwards,” “front,” “back,” “rear,” “inner,” “external,” “inward,” “outer,” “inner,” “outer,” “forward,” and “backward” are used to describe features of exemplary embodiments as shown in the accompanying drawings. It will also be understood that the term “connection” or its derivatives refer to both direct and indirect connections.

[0070] For purposes of illustration and description, the foregoing description of specific exemplary embodiments of the invention has been presented. These descriptions are not intended to be exhaustive or to limit the invention to the precise forms disclosed, and it will be apparent that many modifications and variations can be made in accordance with the foregoing teachings. The exemplary embodiments were chosen and described to explain certain principles of the invention and its practical application, enabling others skilled in the art to make and utilize various exemplary embodiments of the invention, as well as various alternatives and modifications thereof. The scope of the invention is intended to be defined by the appended claims and their equivalents.

Claims

1. A display system for a vehicle, the display system comprising: User input device; The head-up display (HUD) is configured to project a virtual image including augmented reality content, and to adjust the projection position of the augmented reality content according to predetermined driver viewpoint information and first and second directional offsets. as well as The controller is configured to correct the driver's viewpoint information or the first and second directional offsets based on control input received via the user input device. Wherein, the first directional and second directional offsets indicate the amount by which the augmented reality content moves in the first or second directional direction. The display system also includes an additional display. The controller is configured to display a user interface screen on the additional display for correcting the driver's viewpoint information and the first and second directional offsets, and to correct the driver's viewpoint information or the first and second directional offsets based on the control input received while displaying the user interface screen. The user interface screen includes at least one graphical object representing the driver's view state, which is changed by correcting the driver's viewpoint information or the offset in the first and second directions. The user interface screen includes a view status bar, which indicates the view status of the lane outline or road outline displayed to the driver based on the driver's viewpoint information or the offset to the first and second directions.

2. The display system according to claim 1, wherein, In the HUD settings screen, the first direction is the left direction and the second direction is the right direction.

3. The display system according to claim 1, in, The controller is configured to increase the slope of the view status bar as the height level of the driver's viewpoint information increases, and decrease the slope of the view status bar as the height level of the driver's viewpoint information decreases.

4. The display system according to claim 3, in, The HUD includes a settings screen with touch objects, and Specifically, when the height level increases in response to the driver touching the touch object in the settings screen, the controller is configured to increase the slope of the view status bar and display the increased slope on the settings screen; and when the height level decreases in response to the driver touching the touch object, the controller is configured to decrease the slope of the view status bar and display the decreased slope on the settings screen.

5. The display system according to claim 1, in, The controller is configured to: move the view status bar to the first direction when the first direction and second direction offset are adjusted to the first direction; and move the view status bar to the second direction when the first direction and second direction offset are adjusted to the second direction.

6. A method for controlling a display system, the display system including a head-up display (HUD) that projects augmented reality content onto the windshield of a vehicle, the method comprising: A user interface screen is displayed to correct driver viewpoint information and first and second directional offsets, the driver viewpoint information and the first and second directional offsets being used to determine the projection position of the augmented reality content. The driver's viewpoint information or the first and second directional offsets are corrected based on control input received via a user input device. and The projection position of the augmented reality content is adjusted based on the corrected driver viewpoint information or the corrected first and second direction offsets. Wherein, the first directional and second directional offsets indicate the amount by which the augmented reality content moves in the first or second directional direction. The user interface screen includes at least one graphical object representing the driver's view state, which is changed by correcting the driver's viewpoint information or the offset in the first and second directions. The user interface screen includes a view status bar, which indicates the view status of the lane outline or road outline displayed to the driver based on the driver's viewpoint information or the offset to the first and second directions.

7. The method according to claim 6, wherein, In the HUD settings screen, the first direction is the left direction and the second direction is the right direction.

8. The method according to claim 6, in, The slope of the view status bar increases as the height level of the driver's viewpoint information increases, and decreases as the height level of the driver's viewpoint information decreases.

9. The method according to claim 8, in, The HUD includes a settings screen with touch objects, and Specifically, when the height level increases in response to the driver touching the touch object in the settings screen, the controller is configured to increase the slope of the view status bar and display the increased slope on the settings screen; and when the height level decreases in response to the driver touching the touch object, the controller is configured to decrease the slope of the view status bar and display the decreased slope on the settings screen.

10. The method according to claim 6, in, When the first direction and the second direction offset are adjusted to the first direction, the view status bar is moved to the first direction, and when the first direction and the second direction offset are adjusted to the second direction, the view status bar is moved to the second direction.

11. A non-transitory computer-readable storage medium having a program recorded thereon, the program, when executed by a processor of a computer, causing the computer to perform the method according to claim 6.

Citation Information

Patent Citations

  • Method for manufacturing an imaging module

    KR1020210081383A

  • Multimodal user interface for a vehicle

    US20200219320A1