Vehicle display device and operating method thereof

Abstract

Disclosed is a vehicle display device installed in a windshield region of a vehicle. The vehicle display device comprises: a first display module including a first screen region and a second screen region in which driving state information and driving guidance information of a vehicle are displayed in an AR format; and a second display module disposed separately from the first display module and including a third screen region in which extended content for at least one of the first screen region or the second screen region is displayed in a hover format; and a processor that controls the operations of the first and second display modules and the display of content. The processor selects at least one of different display modes, and controls so that the first display module and the second display module each display different content or the content being displayed by the first display module is displayed so as to continuously move or extend to the second display module.

Description

Vehicle display device and method of operation thereof

[0001] The present invention relates to a vehicle display device and a method of operating the same, and more specifically, to a vehicle display device capable of displaying AR content on a vehicle windshield and a method of operating the same.

[0002] To ensure the safety and convenience of users of vehicles, vehicles are equipped with various sensors and devices, and their functions are becoming more diverse. These vehicle functions can be divided into convenience functions designed to enhance driver comfort and safety functions designed to ensure the safety of drivers and / or pedestrians.

[0003] Vehicle convenience features are driven by development motives related to driver convenience, such as providing infotainment (information + entertainment) functions to the vehicle, supporting partial autonomous driving functions, or helping to secure the driver's visibility, such as night vision or blind spots. Examples include active cruise control (ACC), smart parking assist system (SPAS), night vision (NV), head-up display (HUD), around view monitor (AVM), and adaptive headlight system (AHS).

[0004] In addition, vehicle safety features are technologies that ensure the safety of drivers and / or pedestrians, such as the lane departure warning system (LDWS), lane keeping assist system (LKAS), and autonomous emergency braking (AEB).

[0005] Recently, technologies are being researched to display and share various guidance information on the exterior of the vehicle regarding safe driving and driver safety.

[0006] In particular, display systems that integrate augmented reality (AR) technology into vehicles to project content such as driving routes, obstacle information, and speed warnings onto the windshield or project it externally, allowing drivers or pedestrians to perceive them intuitively, are attracting attention. This technology has the potential to reduce driver distraction and improve the efficiency of traffic flow on the road.

[0007] Such augmented reality-based vehicle display technology is evolving beyond conventional static and unidirectional information displays to adaptively display information based on the driver's field of vision and driving conditions. For example, in-vehicle Head-Up Displays (HUDs) or AR-HUD systems can minimize visual distraction and provide intuitive route guidance and warning functions by projecting key driving information at a position aligned with the driver's line of sight.

[0008] However, current vehicle display systems generally operate based on a single display module, which limits the ability to simultaneously provide driving information and infotainment content, or to dynamically expand or distribute the screen display even if there is connectivity between the content, as they operate independently.

[0009] The present invention aims to solve the aforementioned problems and other problems.

[0010] According to some embodiments of the present invention, the purpose is to provide a vehicle display device capable of linking and displaying content between an independent first display module and a second display module.

[0011] Furthermore, according to another embodiment of the present invention, the purpose is to provide a user interface control technology capable of dynamically controlling the location, amount, size, and display method of content displayed on each display module according to vehicle driving status, user input, and external environment information. Through this, switching between an independent display mode and a cooperative display mode is possible, and the distributed or concentrated display of content can be adjusted according to the situation.

[0012] Furthermore, another objective of the present invention is to provide a vehicle display system capable of supporting cooperative content display based on multiple displays by seamlessly switching and expanding the same content across two or more display modules, or by separating information elements within a single piece of content by function and distributing them to appropriate screen areas.

[0013] To this end, the vehicle display device according to the present invention is designed to enable independent display and cooperative display between screen areas displayed by two different display modules.

[0014] Specifically, a vehicle display device according to an embodiment of the present invention is a vehicle display device installed in the windshield area of ​​a vehicle, comprising: a first display module including a first screen area and a second screen area for displaying vehicle driving status information and driving guide information in an AR format; a second display module including a third screen area for displaying extended content for at least one of the first screen area or the second screen area in a hover format, disposed separately from the first display module; and a processor for controlling the operation of the first display module and the second display module and the display of content. At this time, the processor selects at least one of different display modes to control the first display module and the second display module to each display content, or to control the content displayed in the first display module to continuously move or be extended to the second display module.

[0015] In an embodiment, the processor can control that when switching from a first display mode to a second display mode, a portion of the content is continuously switched and displayed from the first screen area or the second screen area to the third screen area.

[0016] In an embodiment, the processor can control at least one detail of the driving status information displayed in the first screen area to be displayed in the third screen area in the second display mode.

[0017] In an embodiment, the processor can control at least one detail of the driving guide information displayed in the second screen area in the second display mode to be displayed in the third screen area.

[0018] In an embodiment, the processor can control the content to move in the reverse direction from the third screen area to the first screen area or the second screen area of ​​the first display module in the second display mode.

[0019] In an embodiment, the processor can control the movement speed of the content when moving the content between the screen areas of the first and second display modules.

[0020] In an embodiment, the processor can control the display so that when moving continuous playback content between the screen areas of the first and second display modules, the transition between screens is seamless.

[0021] In an embodiment, the processor can control the screen display layers of the first display module and the second display module to synchronize and display the same content.

[0022] In an embodiment, the processor can generate a control signal based on user input to enable synchronous control of the same content in the first and second display modules.

[0023] In an embodiment, the processor can control that some of the multiple visual information constituting a single content be displayed in the first screen area or the second screen area, and the remainder be displayed in the third screen area.

[0024] In an embodiment, the processor can control the operation of the second display module to dynamically adjust the display area or display ratio of the third screen area according to the type of content being displayed.

[0025] In an embodiment, the processor can control the operation of the second display module to adjust the amount of information of the content within the third screen area based on at least one of the vehicle's driving state, road state, and driver's eye movement state provided by the vehicle.

[0026] In an embodiment, the processor can control real-time synchronization between the first display module and the second display module via wired or wireless communication.

[0027] In an embodiment, the processor can switch the display mode of the first and second display modules based on at least one of the external illumination of the vehicle, weather, and time information.

[0028] In an embodiment, the processor can control the display of a portion of the same application screen and the remaining portion in the second screen area and the third screen area.

[0029] In an embodiment, the processor can control the display of related destination or route guidance information in the third screen area as the notification object displayed in the second screen area moves to the third screen area.

[0030] In an embodiment, the processor can control the display of content for a passenger in the third screen area while operating in an independent display mode, and the display of content for a driver in the third screen area while operating in a cooperative display mode.

[0031] In an embodiment, the processor can control the size of the content displayed in the third screen area to be adjustable while operating in the independent display mode, and to restrict the adjustment of the size of the content displayed in the third screen area while operating in the cooperative display mode.

[0032] In an embodiment, the processor can control the display so that the size of the content is changed when the content of the first or second screen area moves to the third screen area.

[0033] In an embodiment, the processor can control the size of the content display area within the third screen area to be changed according to the attribute information of the content.

[0034] The effects of the vehicle display device and the method of operation according to the present invention are described as follows.

[0035] Specifically, according to a vehicle display device and a method of operation thereof in part of the present invention, since a first display module and a second display module can be arranged independently of each other within a vehicle while displaying content in conjunction, the flow of information can be naturally maintained without relying on a single display. Accordingly, various information, such as driving information, driver warnings, or infotainment content, can be organically switched or expanded between physically separated screens, providing the user with an intuitive and highly immersive interface environment.

[0036] Furthermore, according to the present invention, the display mode of each display module can be dynamically switched according to the vehicle's driving state, external environment, or user interaction, and the size, position, and amount of information of the content can be dynamically adjusted. This makes it possible to provide information necessary during driving intensively or to distribute content customized for the driver and the passenger, respectively, thereby significantly improving safety and user convenience.

[0037] Furthermore, the vehicle display device according to the present invention can provide advanced cooperative display functions, such as synchronizing and displaying the same content across two or more screen areas in real time, or selectively separating only certain elements within the content and displaying them on other screens. This enables a more customized UI design that takes into account driver attention through a distributed structure based on the semantic units of the content. Additionally, it has the advantage of allowing the role of each screen to be set more flexibly.

[0038] Accordingly, according to the present invention, the limitations of the information provision method of existing vehicle display systems can be overcome, and a multi-layered user interface environment capable of switching between various display modes and moving, expanding, and distributing content can be implemented.

[0039] FIG. 1 is a drawing illustrating an example of a vehicle related to an embodiment of the present invention.

[0040] FIG. 2 is a drawing of a vehicle related to an embodiment of the present invention viewed from various angles.

[0041] FIGS. 3 and FIGS. 4 are drawings illustrating the interior of a vehicle related to an embodiment of the present invention.

[0042] FIGS. 5 and 6 are drawings referenced to describe various objects related to the driving of a vehicle related to an embodiment of the present invention.

[0043] FIG. 7 is a block diagram referenced to describe a vehicle display device related to an embodiment of the present invention together with the components of a vehicle.

[0044] FIG. 8 is an example drawing showing a vehicle display device according to an embodiment of the present invention mounted in a embedded form in a vehicle.

[0045] FIG. 9 is a block diagram illustrating a configuration for explaining various content movement and linked display modes through the first and second display modules of a vehicle display device according to an embodiment of the present invention.

[0046] FIG. 10 is a drawing for explaining that the first and second display modules of a vehicle display device according to an embodiment of the present invention operate in an independent display mode or a cooperative display mode.

[0047] FIGS. 11, 12, and 13 are drawings illustrating examples in which the content of a first display module is moved to a third screen area of ​​a second display module in a cooperative display mode according to an embodiment of the present invention.

[0048] FIGS. 14, 15, and 16 illustrate an example in which, according to an embodiment of the present invention, a notification object in a second screen area related to driving guide information is continuously moved to a third screen area, and related destination or route guidance information is expanded and displayed.

[0049] FIG. 17 is a diagram illustrating an example in which the same content is synchronized and displayed between the screen display layers of the first and second display modules according to an embodiment of the present invention.

[0050] FIGS. 18, 19, and 20 illustrate an example in which, according to an embodiment of the present invention, the first and second display modules are controlled in conjunction and synchronized with other display devices so that content is seamlessly moved and displayed between the devices.

[0051] FIGS. 21 and 22 are drawings illustrating an example in which the amount of information or screen size of content displayed in a third screen area is adjusted according to vehicle driving status information or driver needs according to an embodiment of the present invention.

[0052] FIGS. 23 and 24 are drawings illustrating an example in which content for a passenger in a third screen area is displayed according to an independent display mode according to an embodiment of the present invention, and the display area of ​​the third screen area is dynamically adjusted according to the attributes of the displayed content.

[0053] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols will be assigned the same reference number, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles. Furthermore, in describing embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the present invention.

[0054] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0055] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0056] A singular expression includes a plural expression unless the context clearly indicates otherwise.

[0057] In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0058] The concept of a vehicle as described in this specification may include automobiles and motorcycles. Hereinafter, vehicles will be described primarily in the context of automobiles.

[0059] The vehicle described in this specification may be a concept that includes all of the following: an internal combustion engine vehicle equipped with an engine as a power source, a hybrid vehicle equipped with an engine and an electric motor as a power source, and an electric vehicle equipped with an electric motor as a power source.

[0060] In the following description, the left side of the vehicle refers to the left side of the vehicle's direction of travel, and the right side of the vehicle refers to the right side of the vehicle's direction of travel.

[0061] FIGS. 1 and 2 are drawings showing the exterior of a vehicle related to an embodiment of the present invention, and FIGS. 3 and 4 are drawings showing the interior of a vehicle related to an embodiment of the present invention.

[0062] FIGS. 5 and 6 are drawings illustrating various objects related to the driving of a vehicle related to an embodiment of the present invention.

[0063] FIG. 7 is a block diagram referenced to describe a vehicle related to an embodiment of the present invention. FIG. 7 is a block diagram referenced to describe a vehicle according to an embodiment of the present invention.

[0064] Referring to FIGS. 1 to 7, the vehicle (100) may include a wheel that rotates by a power source and a steering input device (510) for controlling the direction of travel of the vehicle (100).

[0065] The vehicle (100) may be an autonomous vehicle. The vehicle (100) may be switched between an autonomous driving mode and a manual mode based on user input. For example, the vehicle (100) may be switched from a manual mode to an autonomous driving mode or from an autonomous driving mode to a manual mode based on user input received through a user interface device (hereinafter referred to as a 'user terminal') (200).

[0066] The vehicle (100) may switch to an autonomous driving mode or a manual mode based on driving situation information. The driving situation information may be generated based on object information provided by the object detection device (300). For example, the vehicle (100) may switch from a manual mode to an autonomous driving mode or from an autonomous driving mode to a manual mode based on the driving situation information generated by the object detection device (300). For example, the vehicle (100) may switch from a manual mode to an autonomous driving mode or from an autonomous driving mode to a manual mode based on the driving situation information received through the communication device (400).

[0067] The vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on information, data, and signals provided by an external device.

[0068] When the vehicle (100) is operated in an autonomous driving mode, the autonomous vehicle (100) may be operated based on the driving system (700). For example, the autonomous vehicle (100) may be operated based on information, data, or signals generated from the driving system (710), the vehicle exit system (740), and the parking system (750).

[0069] When the vehicle (100) is operated in manual mode, the autonomous vehicle (100) can receive user input for driving through the driving control device (500). Based on the user input received through the driving control device (500), the vehicle (100) can be operated.

[0070] The overall length refers to the length from the front to the rear of the vehicle (100), the overall width refers to the width of the vehicle (100), and the overall height refers to the length from the bottom of the wheels to the roof. In the following description, the overall length direction (L) may refer to the direction that serves as the reference for measuring the overall length of the vehicle (100), the overall width direction (W) may refer to the direction that serves as the reference for measuring the overall width of the vehicle (100), and the overall height direction (H) may refer to the direction that serves as the reference for measuring the overall height of the vehicle (100).

[0071] As illustrated in FIG. 7, the vehicle (100) may include a user interface device (hereinafter referred to as a 'user terminal') (200), an object detection device (300), a communication device (400), a driving operation device (500), a vehicle driving device (600), a driving system (700), a navigation system (770), a sensing unit (120), a vehicle interface unit (130), a memory (140), a control unit (170), and a power supply unit (190).

[0072] According to an embodiment, the vehicle (100) may include additional components other than those described herein, or may not include some of the described components.

[0073] The user interface device (200) is a device for communication between the vehicle (100) and the user. The user interface device (200) can receive user input and provide information generated by the vehicle (100) to the user. The vehicle (100) can implement a UI (User Interfaces) or UX (User Experience) through the user interface device (which may be referred to as a 'user terminal') (200).

[0074] The user interface device (200) may include an input unit (210), an internal camera (220), a bio-sensing unit (230), an output unit (250), and a processor (270). According to an embodiment, the user interface device (200) may include additional components other than the components described, or may not include some of the components described.

[0075] The input unit (210) is for receiving information from a user, and the data collected from the input unit (120) can be analyzed by the processor (270) and processed into a control command of the user.

[0076] The input section (210) may be positioned inside the vehicle. For example, the input section (210) may be positioned in an area of ​​the steering wheel, an area of ​​the instrument panel, an area of ​​the seat, an area of ​​each pillar, an area of ​​the door, an area of ​​the center console, an area of ​​the head lining, an area of ​​the sun visor, an area of ​​the windshield, or an area of ​​the window.

[0077] The input unit (210) may include a voice input unit (211), a gesture input unit (212), a touch input unit (213), and a mechanical input unit (214).

[0078] The voice input unit (211) can convert the user's voice input into an electrical signal. The converted electrical signal can be provided to the processor (270) or the control unit (170). The voice input unit (211) may include one or more microphones.

[0079] The gesture input unit (212) can convert the user's gesture input into an electrical signal. The converted electrical signal can be provided to the processor (270) or the control unit (170).

[0080] The gesture input unit (212) may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input. According to an embodiment, the gesture input unit (212) may detect a user's three-dimensional gesture input. To this end, the gesture input unit (212) may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.

[0081] The gesture input unit (212) can detect the user's three-dimensional gesture input through the Time of Flight (TOF) method, the structured light method, or the disparity method.

[0082] The touch input unit (213) can convert the user's touch input into an electrical signal. The converted electrical signal can be provided to the processor (270) or the control unit (170).

[0083] The touch input unit (213) may include a touch sensor for detecting a user's touch input. According to an embodiment, the touch input unit (213) may be formed integrally with the display unit (251) to implement a touch screen. Such a touch screen may provide both an input interface and an output interface between the vehicle (100) and the user.

[0084] The mechanical input unit (214) may include at least one of a button, a dome switch, a jog wheel, and a jog switch. An electrical signal generated by the mechanical input unit (214) may be provided to a processor (270) or a control unit (170). The mechanical input unit (214) may be placed on a steering wheel, center fascia, center console, cockpit module, door, etc.

[0085] The internal camera (220) can acquire an image of the vehicle interior. The processor (270) can detect the state of the user based on the image of the vehicle interior. The processor (270) can acquire the user's gaze information from the image of the vehicle interior. The processor (270) can detect the user's gesture from the image of the vehicle interior.

[0086] The biometric detection unit (230) can acquire the user's biometric information. The biometric detection unit (230) includes a sensor capable of acquiring the user's biometric information, and can acquire the user's fingerprint information, heart rate information, etc. by using the sensor. The biometric information can be used for user authentication.

[0087] The output unit (250) is intended to generate an output related to sight, hearing, or touch. The output unit (250) may include at least one of a display unit (251), an acoustic output unit (252), and a haptic output unit (253).

[0088] The display unit (251) can display graphic objects corresponding to various information. The display unit (251) may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0089] The display unit (251) can be formed as a layered structure with the touch input unit (213) or as an integral unit to implement a touch screen.

[0090] The display unit (251) can be implemented as a HUD (Head Up Display). When the display unit (251) is implemented as a HUD, the display unit (251) may be equipped with a projection module to output information through an image projected onto a windshield or window.

[0091] The display unit (251) may include a transparent display. The transparent display may be attached to a windshield or a window. The transparent display may display a predetermined screen while having a predetermined transparency. To have transparency, the transparent display may include at least one of a transparent TFEL (Thin Film Electroluminescent), a transparent OLED (Organic Light-Emitting Diode), a transparent LCD (Liquid Crystal Display), a transparent transparent display, and a transparent LED (Light Emitting Diode) display. The transparency of the transparent display may be adjusted.

[0092] Meanwhile, the user interface device (200) may include a plurality of display units (251a to 251g).

[0093] The display unit (251) may be placed in a part of the steering wheel, a part of the instrument panel (521a, 251b, 251e), a part of the seat (251d), a part of each pillar (251f), a part of the door (251g), a part of the center console, a part of the head lining, a part of the sun visor, or implemented in a part of the windshield (251c) or a part of the window (251h).

[0094] The sound output unit (252) converts an electrical signal provided from the processor (270) or the control unit (170) into an audio signal and outputs it. To this end, the sound output unit (252) may include one or more speakers.

[0095] The haptic output unit (253) generates a tactile output. For example, the haptic output unit (253) can operate by vibrating the steering wheel, seat belt, and seat (110FL, 110FR, 110RL, 110RR) so that the user can perceive the output.

[0096] A processor (hereinafter referred to as a 'control unit') (270) can control the overall operation of each unit of the user interface device (200). According to an embodiment, the user interface device (200) may include a plurality of processors (270) or may not include a processor (270).

[0097] If the user interface device (200) does not include a processor (270), the user interface device (200) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0098] Meanwhile, the user interface device (200) may be named as a vehicle display device. The user interface device (200) may be operated under the control of the control unit (170).

[0099] The object detection device (300) is a device for detecting an object located outside the vehicle (100). The object may be various objects related to the operation of the vehicle (100). Referring to FIGS. 5 and 6, the object (O) may include a lane (OB10), another vehicle (OB11), a pedestrian (OB12), a motorcycle (OB13), a traffic signal (OB14, OB15), light, a road, a structure, a speed bump, a topographical feature, an animal, etc.

[0100] A lane (OB10) may be a driving lane, a lane adjacent to a driving lane, or a lane on which an oncoming vehicle travels. A lane (OB10) may be a concept that includes the left and right lines forming the lane.

[0101] Other vehicles (OB11) may be vehicles driving in the vicinity of the vehicle (100). Other vehicles may be vehicles located within a predetermined distance from the vehicle (100). For example, other vehicles (OB11) may be vehicles that are ahead of or behind the vehicle (100).

[0102] A pedestrian (OB12) may be a person located near a vehicle (100). A pedestrian (OB12) may be a person located within a predetermined distance from the vehicle (100). For example, a pedestrian (OB12) may be a person located on a sidewalk or a roadway.

[0103] A two-wheeled vehicle (OB12) may refer to a vehicle that moves using two wheels and is located around a vehicle (100). A two-wheeled vehicle (OB12) may be a vehicle having two wheels located within a predetermined distance from the vehicle (100). For example, a two-wheeled vehicle (OB13) may be a motorcycle or bicycle located on a sidewalk or roadway.

[0104] Traffic signals may include traffic lights (OB15), traffic signs (OB14), patterns or text drawn on the road surface.

[0105] The light may be light generated from a lamp equipped in another vehicle. The light may be light generated from a street light. The light may be sunlight.

[0106] Roads may include road surfaces, curves, slopes such as uphill and downhill, etc.

[0107] A structure may be an object located near a road and fixed to the ground. For example, a structure may include streetlights, street trees, buildings, utility poles, traffic lights, and bridges.

[0108] Topographical features may include mountains, hills, etc.

[0109] Meanwhile, objects can be classified into moving objects and stationary objects. For example, moving objects may include other vehicles and pedestrians. For example, stationary objects may include traffic signals, roads, and structures.

[0110] The object detection device (300) may include a camera (310), a radar (320), a lidar (330), an ultrasonic sensor (340), an infrared sensor (350), and a processor (370).

[0111] According to an embodiment, the object detection device (300) may include additional components other than the described components, or may not include some of the described components.

[0112] The camera (310) may be positioned at an appropriate location outside the vehicle to acquire images of the vehicle's exterior. The camera (310) may be a mono camera, a stereo camera (310a), an AVM (Around View Monitoring) camera (310b), or a 360-degree camera.

[0113] For example, the camera (310) may be positioned in the interior of the vehicle, close to the front windshield, to acquire an image of the front of the vehicle. Alternatively, the camera (310) may be positioned around the front bumper or radiator grille.

[0114] For example, the camera (310) may be positioned in the interior of the vehicle, close to the rear glass, to obtain an image of the rear of the vehicle. Alternatively, the camera (310) may be positioned around the rear bumper, trunk, or tailgate.

[0115] For example, the camera (310) may be positioned in close proximity to at least one of the side windows in the interior of the vehicle to obtain an image of the side of the vehicle. Alternatively, the camera (310) may be positioned around the side mirror, fender, or door.

[0116] The camera (310) can provide the acquired image to the processor (370).

[0117] The radar (320) may include an electromagnetic wave transmitter and a receiver. The radar (320) may be implemented as a pulse radar or a continuous wave radar based on the principle of radio wave emission. Among the continuous wave radar methods, the radar (320) may be implemented as a Frequency Modulated Continuous Wave (FMCW) or Frequency Shift Keying (FSK) method depending on the signal waveform.

[0118] The radar (320) can detect an object based on the Time of Flight (TOF) method or the phase-shift method using electromagnetic waves, and can detect the location of the detected object, the distance from the detected object, and the relative speed.

[0119] The radar (320) can be placed at an appropriate location outside the vehicle to detect objects located in front, behind, or to the side of the vehicle.

[0120] The lidar (330) may include a laser transmitter and a receiver. The lidar (330) may be implemented using a Time of Flight (TOF) method or a phase-shift method.

[0121] The lidar (330) can be implemented as a driven or non-driven type.

[0122] When implemented as a driven type, the lidar (330) is rotated by a motor and can detect objects around the vehicle (100).

[0123] When implemented as a non-driven type, the lidar (330) can detect an object located within a predetermined range relative to the vehicle (100) by optical steering. The vehicle (100) may include a plurality of non-driven lidars (330).

[0124] Lidar (330) can detect an object based on the Time of Flight (TOF) method or the phase-shift method using laser light medium, and can detect the position of the detected object, the distance from the detected object, and the relative velocity.

[0125] The lidar (330) can be placed at an appropriate location outside the vehicle to detect objects located in front, behind, or to the side of the vehicle.

[0126] The ultrasonic sensor (340) may include an ultrasonic transmitter and a receiver. The ultrasonic sensor (340) can detect an object based on ultrasound and detect the position of the detected object, the distance from the detected object, and the relative speed.

[0127] The ultrasonic sensor (340) can be placed at an appropriate location outside the vehicle to detect an object located in front, behind, or to the side of the vehicle.

[0128] The infrared sensor (350) may include an infrared transmitter and a receiver. The infrared sensor (340) can detect an object based on infrared light and detect the position of the detected object, the distance from the detected object, and the relative speed.

[0129] An infrared sensor (350) can be placed at an appropriate location outside the vehicle to detect an object located in front, behind, or to the side of the vehicle.

[0130] The processor (370) can control the overall operation of each unit of the object detection device (300).

[0131] The processor (370) can detect and track objects based on the acquired image. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed to the object through an image processing algorithm.

[0132] The processor (370) can detect and track an object based on the reflected electromagnetic waves that are reflected back from the object after the transmitted electromagnetic waves are reflected. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed to the object based on the electromagnetic waves.

[0133] The processor (370) can detect and track an object based on the reflected laser light that is reflected back from the object by the transmitted laser. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed to the object based on the laser light.

[0134] The processor (370) can detect and track an object based on the reflected ultrasound that is reflected back from the object after the transmitted ultrasound is reflected. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed to the object based on the ultrasound.

[0135] The processor (370) can detect and track an object based on the reflected infrared light that is reflected back from the object after the transmitted infrared light is reflected. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed to the object based on the infrared light.

[0136] According to an embodiment, the object detection device (300) may include a plurality of processors (370) or may not include a processor (370). For example, each of the camera (310), radar (320), lidar (330), ultrasonic sensor (340), and infrared sensor (350) may individually include a processor.

[0137] If the object detection device (300) does not include a processor (370), the object detection device (300) may be operated under the control of the processor or control unit (170) of the device in the vehicle (100).

[0138] The object detection device (400) can be operated under the control of the control unit (170).

[0139] The communication device (400) is a device for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

[0140] A communication device (400) may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element to perform communication.

[0141] The communication device (400) may include a short-range communication unit (410), a location information unit (420), a V2X communication unit (430), an optical communication unit (440), a broadcast transmission and reception unit (450), and a processor (470).

[0142] According to an embodiment, the communication device (400) may include additional components other than the described components, or may not include some of the described components.

[0143] The short-range communication unit (410) is a unit for short-range communication. The short-range communication unit (410) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.

[0144] The short-range communication unit (410) can form a short-range wireless communication network (Wireless Area Networks) to perform short-range communication between the vehicle (100) and at least one external device.

[0145] The location information unit (420) is a unit for obtaining location information of the vehicle (100). For example, the location information unit (420) may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

[0146] The V2X communication unit (430) is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), other vehicles (V2V: Vehicle to Vehicle), or pedestrians (V2P: Vehicle to Pedestrian). The V2X communication unit (430) may include an RF circuit capable of implementing communication protocols with infrastructure (V2I), communication between vehicles (V2V), and communication with pedestrians (V2P).

[0147] The optical communication unit (440) is a unit for communicating with an external device via light. The optical communication unit (440) may include an optical transmitter that converts an electrical signal into an optical signal and transmits it externally, and an optical receiver that converts a received optical signal into an electrical signal.

[0148] According to an embodiment, the light emitter may be formed to be integrated with a lamp included in the vehicle (100).

[0149] The broadcast transmission / reception unit (450) is a unit for receiving a broadcast signal from an external broadcast management server or transmitting a broadcast signal to a broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

[0150] The processor (470) can control the overall operation of each unit of the communication device (400).

[0151] According to an embodiment, the communication device (400) may include a plurality of processors (470) or may not include a processor (470).

[0152] If the communication device (400) does not include a processor (470), the communication device (400) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0153] Meanwhile, the communication device (400) can implement a vehicle display device together with the user interface device (200). In this case, the vehicle display device may be named a telematics device or an AVN (Audio Video Navigation) device.

[0154] The communication device (400) can be operated under the control of the control unit (170).

[0155] The driving control device (500) is a device that receives user input for driving.

[0156] In manual mode, the vehicle (100) can be operated based on a signal provided by the driving control device (500).

[0157] The driving control device (500) may include a steering input device (510), an acceleration input device (530), and a brake input device (570).

[0158] The steering input device (510) can receive input regarding the direction of travel of the vehicle (100) from a user. The steering input device (510) is preferably formed in the shape of a wheel so that steering input is possible by rotation. According to an embodiment, the steering input device may be formed in the shape of a touch screen, a touch pad, or a button.

[0159] The acceleration input device (530) can receive input from a user for accelerating the vehicle (100). The brake input device (570) can receive input from a user for decelerating the vehicle (100). The acceleration input device (530) and the brake input device (570) are preferably formed in the form of pedals. According to an embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad, or a button.

[0160] The driving operation device (500) can be operated according to the control of the control unit (170).

[0161] The vehicle drive unit (600) is a device that electrically controls the operation of various devices within the vehicle (100).

[0162] The vehicle drive unit (600) may include a power train drive unit (610), a chassis drive unit (620), a door / window drive unit (630), a safety device drive unit (640), a lamp drive unit (650), and an air conditioning drive unit (660).

[0163] According to an embodiment, the vehicle drive unit (600) may include additional components other than the described components, or may not include some of the described components.

[0164] Meanwhile, the vehicle drive unit (600) may include a processor. Each unit of the vehicle drive unit (600) may individually include a processor.

[0165] The power train drive unit (610) can control the operation of the power train device.

[0166] The power train drive unit (610) may include a power source drive unit (611) and a transmission drive unit (612).

[0167] The power source drive unit (611) can control the power source of the vehicle (100).

[0168] For example, when a fossil fuel-based engine is the power source, the power source drive unit (610) can perform electronic control of the engine. By doing so, the output torque of the engine can be controlled. The power source drive unit (611) can adjust the engine output torque according to the control of the control unit (170).

[0169] For example, if the power source is an electric energy-based motor, the power source drive unit (610) can perform control over the motor. The power source drive unit (610) can adjust the rotational speed, torque, etc. of the motor according to the control of the control unit (170).

[0170] The transmission drive unit (612) can perform control over the transmission. The transmission drive unit (612) can adjust the state of the transmission. The transmission drive unit (612) can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

[0171] Meanwhile, when the engine is the power source, the transmission drive unit (612) can adjust the gear engagement state in the forward (D) state.

[0172] The chassis drive unit (620) can control the operation of the chassis device. The chassis drive unit (620) may include a steering drive unit (621), a brake drive unit (622), and a suspension drive unit (623).

[0173] The steering drive unit (621) can perform electronic control of the steering apparatus within the vehicle (100). The steering drive unit (621) can change the direction of travel of the vehicle.

[0174] The brake drive unit (622) can perform electronic control of the brake apparatus within the vehicle (100). For example, it can reduce the speed of the vehicle (100) by controlling the operation of the brakes placed on the wheels.

[0175] Meanwhile, the brake drive unit (622) can control each of the plurality of brakes individually. The brake drive unit (622) can control the braking force applied to the plurality of wheels differently.

[0176] The suspension drive unit (623) can perform electronic control of the suspension apparatus within the vehicle (100). For example, the suspension drive unit (623) can control the suspension apparatus to reduce vibration of the vehicle (100) when there is a curvature in the road surface. Meanwhile, the suspension drive unit (623) can control each of the multiple suspensions individually.

[0177] The door / window drive unit (630) can perform electronic control of the door apparatus or window apparatus within the vehicle (100).

[0178] The door / window drive unit (630) may include a door drive unit (631) and a window drive unit (632).

[0179] The door drive unit (631) can perform control over the door device. The door drive unit (631) can control the opening and closing of a plurality of doors included in the vehicle (100). The door drive unit (631) can control the opening or closing of the trunk or tail gate. The door drive unit (631) can control the opening or closing of the sunroof.

[0180] The window drive unit (632) can perform electronic control of the window apparatus. It can control the opening or closing of a plurality of windows included in the vehicle (100).

[0181] The safety device drive unit (640) can perform electronic control of various safety apparatuses within the vehicle (100).

[0182] The safety device drive unit (640) may include an airbag drive unit (641), a seatbelt drive unit (642), and a pedestrian protection device drive unit (643).

[0183] The airbag drive unit (641) can perform electronic control of the airbag apparatus within the vehicle (100). For example, the airbag drive unit (641) can control the airbag to deploy when danger is detected.

[0184] The seatbelt drive unit (642) can perform electronic control of the seatbelt apparatus within the vehicle (100). For example, the seatbelt drive unit (642) can control the seatbelt to secure the occupant to the seat (110FL, 110FR, 110RL, 110RR) using the seatbelt when danger is detected.

[0185] The pedestrian protection device drive unit (643) can perform electronic control of the hood lift and pedestrian airbag. For example, the pedestrian protection device drive unit (643) can control the hood lift up and the pedestrian airbag to deploy when a collision with a pedestrian is detected.

[0186] The lamp driving unit (650) can perform electronic control of various lamp apparatuses within the vehicle (100).

[0187] The air conditioning drive unit (660) can perform electronic control of the air cinditioner in the vehicle (100). For example, the air conditioning drive unit (660) can control the air cinditioner to operate and supply cold air into the vehicle when the temperature inside the vehicle is high.

[0188] The vehicle drive unit (600) may include a processor. Each unit of the vehicle drive unit (600) may individually include a processor.

[0189] The vehicle drive unit (600) can be operated under the control of the control unit (170).

[0190] The driving system (700) is a system that controls various operations of the vehicle (100). The driving system (700) can be operated in an autonomous driving mode.

[0191] The operation system (700) may include a driving system (710), an exit system (740), and a parking system (750).

[0192] According to an embodiment, the operating system (700) may include additional components other than the described components, or may not include some of the described components.

[0193] Meanwhile, the operating system (700) may include a processor. Each unit of the operating system (700) may individually include a processor.

[0194] Meanwhile, according to an embodiment, if the operating system (700) is implemented in software, it may be a sub-concept of the control unit (170).

[0195] Meanwhile, according to an embodiment, the driving system (700) may be a concept including at least one of a user interface device (200), an object detection device (300), a communication device (400), a vehicle driving device (600), and a control unit (170).

[0196] The driving system (710) can drive the vehicle (100).

[0197] The driving system (710) can perform driving of the vehicle (100) by receiving navigation information from the navigation system (770) and providing a control signal to the vehicle driving device (600). The driving system (710) can perform driving of the vehicle (100) by receiving object information from the object detection device (300) and providing a control signal to the vehicle driving device (600). The driving system (710) can perform driving of the vehicle (100) by receiving a signal from an external device through the communication device (400) and providing a control signal to the vehicle driving device (600).

[0198] The vehicle dispatch system (740) can perform the dispatch of the vehicle (100).

[0199] The vehicle exit system (740) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform the exit of the vehicle (100). The vehicle exit system (740) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform the exit of the vehicle (100). The vehicle exit system (740) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform the exit of the vehicle (100).

[0200] The parking system (750) can perform parking of the vehicle (100).

[0201] The parking system (750) can perform parking of the vehicle (100) by receiving navigation information from the navigation system (770) and providing a control signal to the vehicle driving device (600). The parking system (750) can perform parking of the vehicle (100) by receiving object information from the object detection device (300) and providing a control signal to the vehicle driving device (600). The parking system (750) can perform parking of the vehicle (100) by receiving a signal from an external device through the communication device (400) and providing a control signal to the vehicle driving device (600).

[0202] The navigation system (770) can provide navigation information. The navigation information may include at least one of map information, set destination information, path information according to the set destination, information about various objects on the path, lane information, and current location information of the vehicle.

[0203] The navigation system (770) may include memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system (770).

[0204] According to an embodiment, the navigation system (770) can receive information from an external device through a communication device (400) and update previously stored information.

[0205] According to an embodiment, the navigation system (770) may be classified as a sub-component of the user interface device (200).

[0206] The sensing unit (120) can sense the state of the vehicle. The sensing unit (120) may include an attitude sensor (e.g., yaw sensor, roll sensor, pitch sensor), a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight sensing sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / reverse sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, etc.

[0207] The sensing unit (120) can acquire sensing signals regarding vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / reverse information, battery information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illumination, pressure applied to the accelerator pedal, pressure applied to the brake pedal, etc.

[0208] The sensing unit (120) may further include, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.

[0209] The vehicle interface unit (130) can serve as a channel for various types of external devices connected to the vehicle (100). For example, the vehicle interface unit (130) may be equipped with a port that can be connected to a mobile terminal, and may be connected to a mobile terminal through said port. In this case, the vehicle interface unit (130) can exchange data with the mobile terminal.

[0210] Meanwhile, the vehicle interface unit (130) can serve as a channel for supplying electrical energy to a connected mobile terminal. When a mobile terminal is electrically connected to the vehicle interface unit (130), the vehicle interface unit (130) can provide electrical energy supplied from the power supply unit (190) to the mobile terminal under the control of the control unit (170).

[0211] The memory (140) is electrically connected to the control unit (170). The memory (140) can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory (140) can be a hardware storage device such as ROM, RAM, EPROM, flash drive, hard drive, etc. The memory (140) can store various data for the overall operation of the vehicle (100), such as programs for processing or control by the control unit (170).

[0212] According to an embodiment, the memory (140) may be formed integrally with the control unit (170) or implemented as a sub-component of the control unit (170).

[0213] The control unit (170) can control the overall operation of each unit within the vehicle (100). The control unit (170) may be named an ECU (Electronic Control Unit).

[0214] The power supply unit (190) can supply power necessary for the operation of each component according to the control of the control unit (170). In particular, the power supply unit (190) can receive power from a battery inside the vehicle, etc.

[0215] One or more processors and control units (170) included in the vehicle (100) may be implemented using at least one of ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0216] Hereinafter, a vehicle display device (800) according to an embodiment of the present invention and its operation will be described in more detail with reference to FIGS. 7 and FIGS. 9.

[0217] Referring to FIGS. 7 and 9, a vehicle display device (800) according to an embodiment of the present invention may be installed in the windshield area of ​​a vehicle and may be configured to include a plurality of independent display modules. Specifically, the vehicle display device (800) may include a first display module (810), a second display module (820), and a processor (840).

[0218] The first display module (810) is placed in a certain area on the windshield of a vehicle. The first display module (810) can display driving status information and driving guide information in AR form in the first screen area (811, FIG. 8) and the second screen area (812, FIG. 8), respectively.

[0219] At this time, the first and second screen areas may be placed at positions distinct from each other, or their positions may be varied as needed or at least partially overlapped.

[0220] At this time, the driving status information displayed in the first screen area (811) may include items such as driving speed, direction information, speed limit information, TBT (Turn-By-Turn) information, LKAS (Lane Keeping Assist System), cruise control, etc. Also, in the second screen area (812), information such as guidance information for driving the vehicle, destination information, POI (Point of Interest) information, road warnings, or user notifications may be displayed.

[0221] The second display module (820) may be placed side by side or close to the first display module (810) at a separate location. The second display module (820) may display extended content or details associated with the first or second screen area (812) in a hover form on the third screen area (821, FIG. 8).

[0222] At this time, the third screen area (821) can enlarge some of the content displayed in the first or second screen area (812) or additionally display related details. Accordingly, it enables the hierarchical transmission of information.

[0223] For example, if 'TBT information' is included among the driving status information displayed in the first screen area (811), the road shape for each turning section or the distance to turning may be displayed as detailed information in the third screen area (821).

[0224] Similarly, for example, POI information around the destination can be extended and displayed in the third screen area (821) in conjunction with the destination information displayed in the second screen area (812).

[0225] The processor (840) controls the operation of the first display module (810) and the second display module (820), and controls the configuration and switching method of the content displayed in each screen area.

[0226] The processor (840) can select an independent display mode or a cooperative display mode by comprehensively considering, for example, the user's driving state, the illumination or road conditions outside the vehicle, user input, etc., and can dynamically control the location, amount, and display method of the content according to the selected display mode.

[0227] The vehicle (100) provides various information to the vehicle display device (800). For example, this may include driving status information, guide information, external environment information (weather, road conditions, etc.), driver status (eyesight, fatigue, passenger identification, etc.), and this information may be processed by the processor (840) and reflected as appropriate content display on each display module.

[0228] Meanwhile, a Center Information Display (CID) display (900) positioned at the center of the front of the vehicle may be provided separately from the vehicle display device (800). The vehicle display device (800) may communicate with the separate device, the CID display (900), to interact with it.

[0229] The CID display (900) is a UI input device capable of touch operation and can receive input directly from the user, such as content switching or information requests. Such user input can be reflected in the operation control of each display module through the processor (840).

[0230] FIG. 8 is a diagram exemplarily showing a structure in which a vehicle display device according to an embodiment of the present invention is embedded in a vehicle.

[0231] As illustrated in FIG. 8, a first display module (AR HUD) and a second display module (Hover Display) can be embedded and installed together inside the dashboard of a vehicle. That is, the first and second display modules (810, 820) are not exposed, and only the information displayed by them can be displayed in the first to third screen areas.

[0232] The first display module (810) serves to provide driving information and driving guide information, etc., as graphic objects in the form of augmented reality (AR) to the first and second screen areas (811, 812) indicated by dotted lines on the left side of the vehicle window in the drawing. For example, driving route display, speed limit, and direction change information are superimposed and displayed in front of the driver's field of vision, thereby enabling intuitive driving assistance.

[0233] The first and second screen areas (811, 812) displayed by the first display module (810) may be placed at positions separated from each other, or, if necessary, their positions may be varied or partially overlapped.

[0234] Meanwhile, the second display module (820) performs the function of displaying information associated with an AR object provided by the first display module (810) in a hover form on the third screen area (821) on the window indicated by a dotted line on the right side of the vehicle window in the drawing.

[0235] Here, the second display module (820) may be a projection display composed of a small projector and a diffuser, although not illustrated in detail. This makes it possible to display additional information in a more three-dimensional and separated space by creating a graphic object that appears to float at a specific location on the dashboard. As a result, the driver can distinguish and perceive key information and detailed information even within the same driving information.

[0236] In FIG. 8, a CID (Center Information Display) display (900), which is a separate device from the vehicle display device (800), may be provided.

[0237] The CID display (900) is a UI device located in the center console area of ​​a vehicle and capable of accommodating user input. The CID display (900) is touch-operable and operates integrally with the first and second display modules (810, 820) to provide an intuitive control interface to the user. The processor (840) can comprehensively control content linkage, display mode switching, input response, etc., between each of these display devices.

[0238] As explained above, the integrated embedded structure of the vehicle display device (800) as illustrated in FIG. 8 has technical advantages that allow it to effectively provide various information while minimizing visual distraction during driving as well as the sense of unity in the vehicle design.

[0239] FIG. 9 is a block diagram illustrating the configuration of a vehicle display device (800) according to an embodiment of the present invention and the interlocking relationships between each configuration.

[0240] As described, the vehicle display device (800) includes a first display module (810), a second display module (820), and a processor (830). Additionally, the vehicle display device (800) is configured to receive various information from the vehicle (100) and the CID display (900) or to display it in conjunction with it.

[0241] The processor (830) controls the operation of the first display module (810) and the second display module (820) and enables switching between different display modes or linked display of content.

[0242] The first display module (810) is implemented as a HUD (Head-Up Display) based display that is typically positioned near the lower part of the vehicle's windshield, aligned with the driver's field of vision.

[0243] In an embodiment, the first display module (810) is an AR HUD with augmented reality (AR) technology applied, and can project AR content visualizing vehicle driving status information (e.g., speed, turning direction, lane keeping information, etc.) and driving guide information (e.g., destination, POI, TBT guidance, etc.) onto the windshield area in front of the driver. Through this, the driver can intuitively recognize necessary information while keeping their eyes on the road, and safe driving is possible without distraction.

[0244] Such AR content can be generated in real time based on driving-related data acquired externally, sensor information inside the vehicle, destination / route information provided by navigation systems, etc.

[0245] The processor (830) can collect and analyze this information and then convert it into a 3D AR object through a graphics rendering engine. The converted AR object is then positionally aligned and depth-set to match the vehicle's actual driving environment (e.g., lanes, curved roads, signs, etc.), and then accurately projected into the driver's field of vision through a HUD optical system. This process may include AR coordinate alignment, a field of view correction algorithm, and optical distortion correction.

[0246] In addition, some implementations may use Simultaneous Localization and Mapping (SLAM) technology or real-time environment recognition based on a vehicle front camera.

[0247] The second display module (820) works in conjunction with the first display module (810) to provide content that is extended or supplemented therefrom. The second display module (820) may be implemented by including a small projection system installed on or near the top of the vehicle's dashboard.

[0248] Additionally, the second display module (820) may include a diffuser together with a small projector, thereby enabling a hover-shaped floating image or object to be projected at the eye level of the driver or passenger.

[0249] For example, when speed information is displayed in one of the first and second screen areas of the first display module (810), the second display module (820) can additionally display the speed change trend, acceleration-related warnings, TBT detailed information, etc. in a hover form.

[0250] At this time, the processor (830) can dynamically adjust the type, size, and position of the content so that the content displayed by the second display module (820) does not visually overlap while maintaining the association with the content provided by the first display module (810).

[0251] The processor (830) receives various data from the vehicle (100), such as driving status, sensor information, external light intensity, and weather information, integrates and analyzes the data, sets content suitable for each display module (810, 820), and can output the data in a linked or distributed manner.

[0252] Additionally, the processor (830) can receive a signal corresponding to user input from the CID display (900) and respond to changes in display mode, changes in content type, requests for detailed content display, etc.

[0253] FIG. 10 is a diagram for explaining the operation of the independent display mode and the cooperative display mode of a vehicle display device (800) according to an embodiment of the present invention.

[0254] The vehicle display device (800) includes a first display module (810) and a second display module (820). The first display module (810) may be, for example, an AR HUD. The second display module (820) may be, for example, a Hover Display.

[0255] The first display module (810) may include a first screen area (811) and a second screen area (812). The second display module (820) may be composed of a third screen area (821). Additionally, in this specification, the first and second screen areas (811, 812) and the third screen area (821) may each be referred to as the first to third screen display areas or the first to third display areas.

[0256] The vehicle display device (800) operates in either an independent display mode or a cooperative display mode.

[0257] The independent display mode is a mode in which each display module (810, 820) individually displays content that is independent of each other.

[0258] For example, basic driving information of the vehicle, such as driving speed, fuel status, and instrument panel information, may be displayed in the first screen area (811) of the first display module (810). Also, driver assistance content, such as AR-based lane guidance, direction display, and forward warning, may be provided in the second screen area (812) of the first display module (810). At this time, the AR-based information displayed in the first and second screen areas (811, 812) may vary in position, size, and amount of information relative to each other, and may partially or entirely overlap.

[0259] Meanwhile, auxiliary information unrelated to the driver, such as weather widgets, music playback information, breaking news, and advertising content, may be displayed on the third screen area (821) of the second display module (820). These pieces of information are displayed independently, and the user can view a variety of information simultaneously.

[0260] Additionally, in independent display mode, it is possible to configure the provision of customized content to the passenger in the front seat. For example, the passenger's smartphone screen may be mirrored and displayed in the third screen area (821). Alternatively, a movie playback, message checking, web search screen, etc., may be displayed exclusively on the second display module (820).

[0261] In this case, the driver perceives only driving information through the first display module (810), and the passenger in the front seat can enjoy content independently. This structure is highly advantageous for information distribution and user customization.

[0262] The cooperative display mode is an operation mode in which content displayed by two display modules (810, 820) is linked and displayed as a single flow.

[0263] For example, a path guidance arrow appearing in the second screen area (812) of the first display module (810) can be extended or moved to the right boundary and then naturally extended to the third screen display area of ​​the second display module (820). As a result, the same content is displayed seamlessly across the two display modules (810, 820) without visual dissonance.

[0264] As another example, when a vehicle is approaching an intersection, the remaining distance and turning direction information may be displayed in the first display area of ​​the first display module (810). At the same time, an enlarged intersection map and / or text-based voice guidance information may be displayed in the second display module (820).

[0265] This implementation may be an example where information derived from the same application is divided and displayed by screen.

[0266] The cooperative display mode can also be implemented by distributing the components of a single content across multiple screens. For example, 3D car model content representing a vehicle (100) can be configured to display the front view on the second screen area (812) of the first display module (810) and the rear view on the third screen area (821) of the second display module (820). In this case, the content enhances immersion through a 3D composition with depth.

[0267] Cooperative display mode can also induce an expanded field of vision for the driver. Because the information provided on each screen is interconnected, the driver can easily recognize the relationships between the content.

[0268] For example, by providing a visual flow as a warning icon moves from the first screen area (811) to the third screen area (821), the driver's understanding can be improved and quick judgment can be induced.

[0269] As such, the vehicle display device (800) according to the present invention operates to flexibly switch between an independent display mode and a cooperative display mode according to the situation. Through this, it is possible to provide information optimized for the user and simultaneously improve the driving experience of the driver and passengers.

[0270] FIG. 11 illustrates an example in which content moves from the first screen area (811) of the first display module (810) to the third screen area (821) of the second display module (820) in a cooperative display mode according to an embodiment of the present invention.

[0271] The first display module (810) may be a HUD installed on the windshield in front of the driver to provide driving status information. Basic driving information, such as vehicle speed, fuel efficiency, and ambient temperature, may be displayed in the first screen area (811) of this module.

[0272] As illustrated in FIG. 11, when the initiation condition (e.g., starting of the vehicle and turning on the vehicle display device (800)) is satisfied, AR content (1110') in the form of a car icon starts from the right side of the first screen area (811) and gradually moves to the right to be displayed. While moving, this AR content (1110') gradually reaches the third screen area (821) of the second display module (820).

[0273] During this movement process, visual information such as the position, size, brightness, and transparency of the AR content (1110') is continuously transformed. In addition, the depth information (z-axis coordinate) of the AR content is also adjusted. As a result, the driver can perceive that the AR content (1110', 1110) displayed between the first screen area (811) and the third screen area (821) of the two display modules (810, 820) moves smoothly and is connected without interruption.

[0274] In addition, the 3D AR content in the shape of a car (1110', 1110) can provide visually more realistic car content by rotating or moving up and down while in motion.

[0275] Meanwhile, the car-shaped AR content (1110) moved to the third screen area (821) can be moved in the reverse direction to one of the first and second screen areas (811, 812) of the first display module (810).

[0276] This implementation prevents visual distraction through seamless content transitions and makes information perception while driving more intuitive.

[0277] FIG. 12 illustrates an example in which 3D AR content in the shape of a car is moved from the second screen area (812) of the first display module (810) to the third screen area (821) of the second display module (820) in a cooperative display mode according to an embodiment of the present invention.

[0278] The second screen area (812) can display augmented reality (AR)-based driving guide information on the road ahead, such as lane change guidance, turning path, and warning of a vehicle ahead.

[0279] AR content (1210') displayed in the second screen area (812) moves continuously to the second display module (820) as it moves away from this screen. At this time, the AR content (1210', 1210) is processed so that it naturally connects at the boundary between screens. While the content moves, not only the position information but also the depth is gradually adjusted. Through this, the content maintains seamless depth in three-dimensional space.

[0280] For example, as the AR content (1210') in the shape of a vehicle displayed in the second screen area (812) moves to the third screen display area, its visual characteristics may change, such as gradually becoming larger and having clearer colors. This smooth change in visual information helps the driver perceive it as a single expanded space rather than a transition between screens. To this end, the processor (830) controls such transitions in real time by taking into account the position and display status of each display.

[0281] Meanwhile, the AR content (1210) moved to the third screen area (821) can then be moved back to the second screen area (812) or moved to a separate device, the CID display (900, FIG. 8), to be displayed.

[0282] FIG. 13 shows an example in which content moves seamlessly between the second screen area (812) of the first display module (810) and the third screen area (821) of the second display module (820) in a cooperative display mode according to an embodiment of the present invention.

[0283] For example, the content of the second screen area (812) may display a portion (1310) of AR content in the form of a car, including forward road information. Additionally, depending on the situation, the remaining portion (1310) of the AR content may extend to the right side of the screen and be displayed in the third screen area (821).

[0284] Here, “situation” includes cases where the driver needs to check information, such as route guidance, results of surrounding object recognition, and driving warnings, from a wider field of view.

[0285] For example, in situations requiring a lane change before entering a complex intersection, or when multiple traffic objects are detected, the content displayed in the second screen area (812) may be extended to the third screen area (821) to provide more detailed and intuitive visual information. Additionally, situations in which the content is extended based on direct interaction, such as user gesture input or voice commands, are included. In this way, the expansion of the content can occur dynamically based on conditions such as the driving context of the vehicle, the driver's need for attention, or explicit user input.

[0286] Meanwhile, the content is connected seamlessly at the boundaries between screens. For example, AR vehicle content (1310) may appear in the second screen area (812) and then gradually extend across the right third screen area (821), creating a movement effect.

[0287] Content displayed seamlessly between screen areas can have its visual effects adjusted differently by reflecting factors such as viewpoint, lighting, and weather conditions. In this way, brightness, color contrast, and transparency are automatically adjusted during transitions between screen areas, delivering information to the user without any unnaturalness.

[0288] This implementation allows a single piece of content to be displayed across screen areas of the two display modules (810, 820), and enhances the continuity of driving information, thereby contributing to increasing the driver's concentration and understanding.

[0289] In addition, in cooperative display mode, not only unidirectional but also bidirectional movement of content is possible.

[0290] In other words, content displayed in the third screen area (821) can be returned to the first or second screen area (811, 812). For example, a road hazard warning icon can be moved from the third screen area (821) to the second screen area (812) and integrated into the driving guide. Such flexible content movement expands the interaction between the driver and the system.

[0291] Additionally, in the embodiment, information of the same application may be divided and displayed across screen areas by two display modules (810, 820). For example, in a navigation application, the entire route guidance may be displayed in the second screen area (812), and detailed information about the current turning point may be displayed in the third screen area (821). This method efficiently distributes information to improve visibility.

[0292] Additionally, content containing multiple visual information may be distributed and displayed across two different screen areas. For example, a 3D model of a car may be displayed three-dimensionally across the second screen area (812) and the third screen area (821). As an example, as described with reference to FIG. 13, the front of the AR vehicle object may be displayed in the second screen area (812), and the rear may be displayed in the third screen area (821).

[0293] To enable such synchronized display, the processor (830) performs real-time synchronization between the first and second display modules (810, 820). At this time, real-time communication can be performed via wired or wireless methods. Additionally, the processor (830) matches the display timing of each display module (810, 820) to control the content so that no delay or distortion occurs during content switching.

[0294] The processor (830) can automatically switch the display mode according to at least one of external illumination, weather, and time information.

[0295] For example, in nighttime or tunnel sections, the screen brightness by the first display module (810) can be lowered, and associated auxiliary information can be emphasized through the third screen area (821) by the second display module (820).

[0296] Conversely, when driving on a highway during the day, information can be configured to be concentrated around the first screen area (811) of the first display module (810). And, when weather conditions such as rain or fog are detected, a relevant warning icon can be automatically displayed in the third screen area (821) by the second display module (820). In this way, a display mode that adaptively varies to the external environment can increase the driver's concentration and improve safety.

[0297] FIGS. 14, 15, and 16 illustrate an embodiment in which a notification object in the second screen area (812) is continuously moved to the third screen area (821) in a cooperative display mode, and route guidance information is expanded and displayed.

[0298] As illustrated in FIG. 14, a notification object (1410) related to driving status information and route guide information can be displayed in the second screen area (812) of the first display module (810).

[0299] In this embodiment, the notification object (1410) is implemented as an arrow-shaped AR object, and the AR arrow object intuitively displays the vehicle's direction of travel and direction of rotation. However, it is not limited to this image shape and may be displayed as other forms of AR objects that are advantageous for the driver's attention.

[0300] While driving, an AR-type notification object (1410) can be displayed in driving situations or conditions such as the following:

[0301] 1) Immediately before entering a vehicle entrance / exit: Before entering a highway or a complex intersection, at the point when the user needs to change lanes in advance, a warning notification object may be displayed by the first display module (810).

[0302] 2) Right turn or left turn guidance point: When a specific distance (e.g., 300m, 100m, just before) is reached, an arrow-shaped AR notification object indicating the direction may be gradually displayed.

[0303] 3) When traffic congestion is detected: Based on real-time traffic data, if the expected route includes a congested section, a warning notification object including alternative route guidance may be displayed.

[0304] 4) When approaching a dangerous area: When entering a safety caution zone such as a child protection zone, a sharp curve, or an accident-prone area, a notification object may appear in a warning color to alert the driver.

[0305] 5) When a navigation route change is necessary: ​​When a user's deviation from the route is detected, a notification object containing new destination or direction information may be presented based on real-time re-search results.

[0306] In addition, these AR notification objects can be designed not only to provide simple directional indications but also to convey information in a visually intuitive manner under various driving conditions where the driver's immediate attention or judgment is required.

[0307] In addition, the above conditions can be dynamically adjusted by the processor (830) by taking into account driver preference, driving history, driving environment, etc.

[0308] Through this information projected onto the vehicle's front windshield, the driver can perceive key driving information without distracting their gaze.

[0309] Additionally, in the cooperative display mode, a preparation screen (1420) for displaying extended information related to an AR notification object may be displayed in conjunction with the third screen area (821) of the second display module (820).

[0310] FIG. 15 illustrates the process of a notification object displayed on the first display module (810) gradually moving to the right.

[0311] This notification object (1410) is seamlessly moved to the third screen area (821) of the second display module (820) along with a content transition animation effect. At this time, the movement speed and timing of this notification object (1410) are controlled by the processor (840).

[0312] Additionally, in the third screen area (821) of the second display module (820), an initial screen (1520) including information related to route guidance, such as the destination name, estimated arrival time, and traffic conditions, is gradually displayed.

[0313] In FIG. 16, the extended content of the notification object is displayed in its entirety on the third screen area (821) of the second display module (820). At this point, the extended content (1620) displayed on the third screen area (821) includes various driving support elements such as a detailed route guidance map, information on upcoming waypoints, and information on recommended detour routes. For example, the extended content (1620) may be a navigation screen containing new destinations or new route guidance information.

[0314] This information extends the driving information flow originating from the first display module (810), and the driver can naturally perceive the overall driving flow.

[0315] This configuration ensures continuity and immersion within the driver's field of vision through content linkage between the screens of the first and second display modules (810, 820), and is configured so that as the notification object moves, gradually more information can be displayed in the third screen area (821) of the second display module (820). At this time, the speed of content movement between each display module is controlled by the processor (840) along with animation effects, and the display method is adjusted so that seamless content transitions are achieved.

[0316] In addition, in this cooperative display mode, the movement method and display pattern of the notification object can be adjusted in various ways depending on the vehicle's driving situation or changes in the surrounding environment. For example, if sudden braking or a change of direction is detected, the movement speed of the notification object may be adjusted, or emphasis animations may be added or omitted.

[0317] Furthermore, when the first and second display modules (810, 820) operate in independent display mode, independent content such as media content for the passenger seat and smartphone mirroring can be displayed in the third screen area (821) of the second display module (820).

[0318] On the other hand, when the vehicle display device (800) operates in cooperative display mode, the second display module (820) also displays driving assistance content for the driver, and as a result, the information flow of the entire vehicle can be integrated around the driver.

[0319] The following is a drawing illustrating an example in which the same content is synchronized and displayed in real time between the screen display layers of the first display module (810) and the second display module (820) according to an embodiment of the present invention.

[0320] In the screen areas corresponding to the first display module (810) and the second display module (820), the content may be displayed in a form that overlaps each module, or smoothly connected at the same position and depth value so that it is operated and configured to be perceived by the user as a single UI environment.

[0321] At this time, the processor (830) can automatically adjust the surface projection level, size ratio, brightness, etc., so that the same content can be seamlessly connected in the layer structure between the two display modules (810, 820) without visual dissonance. This configuration takes into account the possibility of bidirectional or repetitive circulation of the same content in a vehicle display environment.

[0322] Referring to FIG. 17, when AR content (1710) in the form of a car moves toward the third screen area (821) in accordance with the synchronization of the first and second display modules (810, 810), a preparatory action for displaying linked content in the third screen area (821) is triggered.

[0323] FIGS. 18, 19, and 20 illustrate an example in which a first display module (810) and a second display module (820) are linked so that content is smoothly moved and displayed between screen areas, and simultaneously synchronized in real-time with an in-vehicle CID display (900) so that the same content is sequentially moved and displayed. This is based on the content linkage operation between independent devices.

[0324] Specifically, in FIG. 18, AR content (user, vehicle, etc.) (1710) displayed on the left side of the user's forward field of view moves toward the center of the screen and extends across the second display module (820). At this time, the CID display (900) can also be synchronized to initiate the screen-on and / or content display preparation phase.

[0325] Next, FIG. 19 describes a case where the AR content (1710) is continuously moved from the first display module (810) through the second display module (820) to the CID display (900). At this time, the depth, display layer, and object size in each display (810, 820, 900) are flexibly expanded or contracted depending on the situation to provide a consistent flow of information to the user.

[0326] Subsequently, the same content eventually reaches the CID display (900), and accordingly, as illustrated in FIG. 20, information is displayed integrally through the linked operation between the devices. To this end, each display (810, 820, 900) can be synchronized in real time under the control of the processor (830).

[0327] Additionally, the AR content circulates seamlessly without visual interruption and can move in various sequences between the first display module (810), the second display module (820), and the CID display (900). For example, the AR content can move between devices in a fixed order, and then unfold in the same way in the reverse direction.

[0328] This configuration controls the UI layer so that, despite the physical separation of active display areas between hardware elements, it is perceived by the user as a single, integrated interface. In particular, content is designed to transition visually intuitively and naturally, regardless of differences in resolution or size among the display devices.

[0329] Additionally, the processor (830) can control the direction, speed, and position of the content in real time according to user input (e.g., gesture, touch, voice, etc.).

[0330] Additionally, the processor (830) can adaptively automatically adjust the direction, speed, and position of the content according to driving conditions such as driving mode, vehicle speed, and external light. For example, during night driving, information is emphasized around the screen areas of the first display module (810), and during daytime or when stopped, the central content can be extended and displayed on the screen area of ​​the second display module (820) or the CID display (900).

[0331] Figure 21 illustrates an example in which the amount of information or the display height of the content displayed in the third screen area (821) is adjusted according to vehicle driving status information or driver needs, according to an embodiment of the present invention.

[0332] Referring to FIG. 21, the first and second screen areas (812) of the first display module (810) display vehicle driving status and basic route guidance information. The third screen area (821) of the second display module (820) may display some information in a limited manner.

[0333] This is configured so as not to obstruct the driver's view by automatically reducing the height or amount of information in the third screen area (821) according to the vehicle driving environment or the need to secure external visibility. For example, in cases such as night driving, bad weather, or entering a complex intersection, the amount of information may be displayed in the third screen area (821) in a minimized form.

[0334] FIG. 22 is an example illustrating a state in which the amount of information and the display size of the third screen area (821) are enlarged according to the driver's needs.

[0335] The same basic driving information and guide information are maintained in the first and second screen areas of the first display module (810). Additionally, the third screen area (821) of the second display module (820) has expanded height and width so that an expanded navigation screen containing additional information such as more map information, estimated time to reach the destination, and traffic conditions can be displayed.

[0336] In this way, while the third screen area (821) is operating in cooperative display mode, it naturally visualizes in correspondence with the depth value of the first or second screen area (812), and content can be seamlessly expanded and displayed. Additionally, the amount of information to be displayed in the third screen area (821) may be dynamically adjusted according to the driver's voice command, gesture, or automatic recognition based on environment sensors.

[0337] Consequently, the vehicle display device (800) is designed to dynamically adjust the amount of information and display size of the third screen area (821) to minimize the driver's cognitive burden while driving and to provide visually rich information when necessary.

[0338] In independent display mode, the third screen area (821) displays individual content (e.g., movies, media, etc.) tailored to the passenger in the front seat. On the other hand, in cooperative display mode, driver-centric content is consistently displayed, and the indiscriminate enlargement of the content size displayed in the third screen area (821) is restricted to prevent visual distraction.

[0339] In addition, the amount of information, display method, and size of the content displayed on the third screen area (821) can be customized according to the driver's needs. Specifically, the driver can directly change the display settings of the third screen area (821) through a touchscreen, gesture recognition, voice commands, or physical buttons provided on the vehicle's steering wheel or center console.

[0340] For example, when a driver inputs a voice command such as “zoom in on map” or “get route information in detail,” the size of the content displayed in the third screen area (821) is enlarged, and the route information that was previously displayed briefly can be expanded to include a detailed route, real-time traffic information, estimated arrival time, etc.

[0341] Conversely, you can switch to a brief view mode that displays only minimal information through commands such as “zoom out” or “show briefly.”

[0342] In addition, the level of displayed information may be automatically changed according to the driving profile set by the user (e.g., city driving, highway driving, long-distance driving, etc.).

[0343] In addition, when driving in the city, detailed content including various surrounding POI information, signal prediction, and lane change guidance is displayed, and when driving at high speed, it can be automatically controlled to display only minimal information in order to prioritize visibility.

[0344] In this way, the vehicle display device (800) of the present invention can flexibly configure the display of content in the third screen area (821) through a driver-customized UI adjustment function, and accordingly provides a balance between driving safety and information delivery efficiency.

[0345] Hereinafter, FIGS. 23 and 24 are drawings illustrating an example in which, according to an embodiment of the present invention, when content (e.g., audiovisual content such as a movie) is displayed on a second display module (820), the aspect ratio and display area of ​​the screen are dynamically adjusted according to the type of content or playback conditions.

[0346] FIG. 23 illustrates an example where the content is horizontally elongated or multiple contents are displayed together at the same time, and the content is divided and displayed in the left-right direction on the second display module (820).

[0347] For example, the driver can simultaneously check weather information, news headlines, and multi-view content while driving. To this end, the third screen area (821) of the second display module (820) may be configured to have a plurality of horizontally divided content display layer screens (2310). In this independent display mode, the screen expansion of the layer screens (2310) displayed in the third screen area (821) may be limited so as not to interfere with driving.

[0348] On the other hand, FIG. 24 shows an example in which a single concentrated content (e.g., a movie, a live performance video, etc.) is displayed with a wide aspect ratio across the entire third screen area of ​​the second display module (820).

[0349] In this way, when the immersion of the content is important, the display on the third screen area (821) of the second display module (820) is variably expanded according to the characteristics / attributes of the content. At this time, the display information (e.g., driving information, guide) of the first display module (810) may be designed to be relatively reduced or have its screen depth adjusted so as not to obstruct the user's field of vision.

[0350] Meanwhile, when the concentrated content is expanded and displayed, not only is the display within the third screen area (821) displayed on the front, but the third screen area (821) itself may also increase. However, this operation may be accompanied by restriction initiation conditions such as vehicle parking or stopping.

[0351] Additionally, the processor (830) can automatically adjust the display ratio according to the type of content, or control whether the screen splitting method or content expansion by the second display module (820) is controlled according to user input (e.g., content settings, voice commands, gestures, etc.). This allows for a flexible visual experience that satisfies both driving safety and immersion, even when providing entertainment-centric content.

[0352] Meanwhile, FIGS. 23 and 24 illustrate a case where the vehicle's display mode is set to an independent display mode. That is, a case where the first display module (810) and the second display module (820) operate to display content individually.

[0353] In this way, the content displayed by the second display module in independent display mode may have its aspect ratio automatically adjusted according to its type (e.g., movies, advertisements, news, etc.), or the size and layout of the screen may be modified by user operation.

[0354] For example, if there is user input or a change in settings through the CID display (900), the third screen area (821) of the second display module may be expanded or reduced to suit the user's preferences or viewing environment. This operates as an optional feature to enhance the entertainment experience of the passenger in the front seat and has the advantage of allowing the aspect ratio and content placement to be flexibly changed in real time.

[0355] On the other hand, when the vehicle is operating in cooperative display mode, the first display module (810) and the second display module (820) are linked with the driver as the center and display content. That is, with the highest priority given to ensuring safe driving, changes to the size or aspect ratio of the content or screen displayed in the third screen area (821) may be restricted.

[0356] For example, to prevent immersive content such as movies from expanding excessively and obstructing the driver's view, the content is displayed only within a defined range, and the system automatically controls changes to the screen layout or adjustments to the aspect ratio to be kept below a certain level.

[0357] These settings can be controlled to optimize the balance between visual immersion and safety by reflecting various environmental factors, such as the vehicle's driving conditions, external lighting, and driver concentration, as well as user preferences.

[0358] Meanwhile, although not illustrated in the drawings, according to another embodiment of the present invention, if the content displayed between the first display module (810), the second display module (820), and the CID display (900) is identical or duplicate, the content can be controlled to be displayed preferentially on any one of the display modules according to the importance of the content or user settings.

[0359] For example, during driving, the first display module (810) can be set to have the highest priority so that essential driving information is concentrated on the HUD in front of the driver, and the remaining information is displayed on the third screen area (821) of the second display module (820) and / or the CID display (900). This prevents content duplication and allows only the information necessary for the driver's main field of vision to be efficiently provided.

[0360] According to another embodiment, the brightness or color contrast of the screen can be configured to be automatically adjusted according to the type of content displayed in each screen area or external illumination conditions. For example, since the first display module (810) displays AR information integrated with the external field of view, the transparency or contrast can be adjusted according to the ambient brightness.

[0361] On the other hand, the second display module (820) can be controlled with relatively high brightness and vivid color contrast to enhance immersion when movie or image content is displayed. Such adjustment can be flexibly executed based on user settings or sensor-based automatic judgment.

[0362] According to another embodiment, the configuration of the screen area of ​​the display device and the method of displaying content can be controlled to change automatically depending on the driving mode of the vehicle. For example, when the vehicle is in normal driving mode (ECO), the display module (810, 820) operates independently and user-customized content can be displayed.

[0363] On the other hand, in autonomous driving mode, the display module (810, 820) switches to a cooperative display mode so that route, map, sensor information, etc. can be displayed in an integrated manner. In this way, the information configuration and display strategy of the entire display system can be dynamically optimized according to the vehicle's driving environment or the user's driving style.

[0364] According to another embodiment of the present invention, after content is temporarily expanded or moved to a specific screen area (e.g., a third screen area (821)), it can be controlled to automatically return to the original screen area (e.g., a second screen area (812)) when certain conditions are satisfied. For example, after a driver briefly expands music content to the third screen area (821) to listen to it, the content may be reduced back to its original position and displayed when a certain amount of time has passed, a user's return input is recognized, or the music content application is closed. Such a return path setting provides visual consistency and contributes to enhancing the continuity of the user experience.

[0365] As described above, according to the vehicle display device of an embodiment of the present invention, specifically, according to a vehicle display device and its operation method according to some embodiments of the present invention, the first display module and the second display module can display content in conjunction while being arranged independently of each other within the vehicle, thereby allowing the flow of information to be naturally maintained without relying on a single display. Accordingly, various information, such as driving information, driver warnings, or infotainment content, can be organically switched or expanded between physically separated screens, providing the user with an intuitive and highly immersive interface environment. Furthermore, the display mode of each display module can be dynamically switched according to the vehicle's driving status, external environment, or user interaction, and the size, position, and amount of information of the content can be dynamically adjusted. Through this, it is possible to provide information necessary during driving intensively or to distribute content customized for the driver and the passenger in the front seat, respectively, thereby significantly improving safety and user convenience. Moreover, advanced cooperative display functions can be provided, such as synchronizing and displaying the same content across two or more screen areas in real time, or selectively separating only certain elements within the content to display on another screen. This enables more customized UI design by considering driver attention through a distributed structure based on content semantic units. Additionally, it has the advantage of allowing the role of each screen to be configured more flexibly.

[0366] Accordingly, according to the present invention, the limitations of the information provision method of existing vehicle display systems can be overcome, and a multi-layered user interface environment capable of switching between various display modes and moving, expanding, and distributing content can be implemented.

[0367] The above-described invention can be implemented as computer-readable code (or an application or software) on a medium on which a program is recorded. The method of operation of the autonomous vehicle display device described above can be realized by code stored in memory, etc.

[0368] Computer-readable media include all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include Hard Disk Drives (HDDs), Solid State Disks (SSDs), Silicon Disk Drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and also include those implemented in the form of carrier waves (e.g., transmission over the Internet). Furthermore, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be interpreted restrictively in all respects and should be considered exemplary. The scope of the invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the invention are included within the scope of the invention.

Claims

1. A vehicle display device installed in the windshield area of ​​a vehicle, A first display module forming a first screen area and a second screen area that display vehicle driving status information and driving guide information in AR form; A second display module that is disposed separately from the first display module and forms a third screen area that displays extended content for at least one of the first screen area or the second screen area in a hover form; It includes a processor that controls the operation of the first display module and the second display module and the display of content, and The above processor is, By selecting at least one of different display modes, the first display module and the second display module each display content, or Controlling the content formed by the first display module to be continuously moved or extended and displayed on the second display module, Vehicle display device.

2. In Paragraph 1, The above processor is, Controlling so that when switching from a first display mode to a second display mode, a portion of the content is continuously switched and displayed from the first screen area or the second screen area to the third screen area. Vehicle display device.

3. In Paragraph 2, The above processor is, In the second display mode, controlling to display at least one detailed information among the driving status information displayed in the first screen area in the third screen area, Vehicle display device.

4. In Paragraph 2, The above processor is, In the second display mode, controlling to display at least one detailed information among the driving guide information displayed in the second screen area in the third screen area, Vehicle display device.

5. In Paragraph 2, The above processor is, In the second display mode above, controlling the content to move in the reverse direction from the third screen area to the first screen area or the second screen area of ​​the first display module, Vehicle display device.

6. In Paragraph 1, The above processor is, Controlling the movement speed of content when moving content between screen areas of the first and second display modules, Vehicle display device.

7. In Paragraph 1, The above processor is, Display control that ensures seamless transition between screens when moving continuous playback content between the screen areas of the first and second display modules. Vehicle display device.

8. In Paragraph 1, The above processor is, Controlling the screen display layers of the first display module and the second display module to synchronize and display the same content. Vehicle display device.

9. In Paragraph 1, The above processor is, Generating a control signal that enables the same content to be synchronously controlled in the first and second display modules based on user input, Vehicle display device.

10. In Paragraph 1, The above processor is, Controlling so that some of the multiple visual information constituting a single content is displayed in the first screen area or the second screen area, and the remainder is displayed in the third screen area. Vehicle display device.

11. In Paragraph 1, The above processor is, Controlling the operation of the second display module to dynamically adjust the display area or display ratio of the third screen area according to the type of content displayed, Vehicle display device.

12. In Paragraph 1, The above processor is, Controlling the operation of the second display module to adjust the amount of information of the content within the third screen area based on at least one of the vehicle's driving state, road state, and driver's eye movement state provided by the vehicle. Vehicle display device.

13. In Paragraph 1, The above processor is, Controlling to perform real-time synchronization between the first display module and the second display module via wired or wireless communication, Vehicle display device.

14. In Paragraph 1, The above processor is, Switching the display mode of the first and second display modules based on at least one of the vehicle's external illumination, weather, and time information. Vehicle display device.

15. In Paragraph 2, The above processor is, Controlling so that a part area and the remaining area of ​​the same application screen are divided and displayed in the second screen area and the third screen area above, Vehicle display device.

16. In Paragraph 15, The above processor is, Controlling to continuously display related destination or route guidance information in the third screen area as the notification object displayed in the second screen area moves to the third screen area, Vehicle display device.

17. In Paragraph 1, The above processor is, While operating in independent display mode, content for the passenger in the front seat is displayed in the third screen area, and Controlling to display content for the driver in the third screen area while operating in cooperative display mode, Vehicle display device.

18. In Paragraph 17, The above processor is, While operating in the above independent display mode, the size of the content displayed in the third screen area can be adjusted, and Controlling so that the adjustment of the content displayed in the third screen area is restricted while operating in the above cooperative display mode, Vehicle display device.

19. In Paragraph 1, The above processor is, Controlling so that when the content of the first or second screen area moves to the third screen area, the size of the content is changed and displayed. Vehicle display device.

20. In Paragraph 1, The above processor is, Controlling the size of the content display area within the third screen area to change according to the attribute information of the above content, Vehicle display device.

Images