Vehicle display device and method for operating same

Abstract

A vehicle display device is disclosed. The vehicle display device according to an embodiment of the present invention comprises: a housing having a recessed inner space formed therein; a display disposed on one side of the inner space of the housing; a communication module configured to receive vehicle information from a vehicle; a first reflection module coupled to one side of the display in the inner space and disposed such that graphics emitted from the first area of the display are refracted so as to form a first screen area; a second reflection module coupled to one side of the first reflection module in the inner space and disposed such that graphics emitted from the second area of the display are refracted so as to form a second screen area; and a processor for controlling operations thereof. The processor controls the first and second reflection modules so as to display information having different depth values on the first and second screen areas on the basis of the received vehicle information when the display is driven. Accordingly, different screen areas are used independently or in conjunction with each other, thereby providing more diversified user environments and user experiences.

Description

Vehicle display device and its operating method

[0001] The present invention relates to a vehicle display device, and more specifically, to a vehicle display device implemented to form a plurality of screens using graphics output from one display module.

[0002] A vehicle is a device that allows the user to move in the desired direction. A representative example is an automobile.

[0003] Meanwhile, various sensors and electronic devices are being installed in vehicles to enhance the convenience of users. In particular, research is actively underway on Advanced Driver Assistance Systems (ADAS) to enhance user convenience. Furthermore, development of autonomous vehicles (AVs) is also actively underway.

[0004] Autonomous driving refers to a system that enables a vehicle to make its own decisions and drive accordingly. Autonomous driving can be categorized into stages ranging from non-automation to full automation, depending on the degree to which the system participates in driving and the degree to which the driver controls the vehicle.

[0005] Autonomous driving has transformed the perception of vehicles as spaces for dwelling, rather than simply a means of transportation. Furthermore, the trend toward installing larger displays in vehicles has become widespread, allowing drivers to freely enjoy a variety of infotainment options. Furthermore, research and development are being conducted to provide a more diverse user experience when using these displays.

[0006] The present invention aims to solve the above-mentioned problems and other problems.

[0007] According to some embodiments of the present invention, an object of the present invention is to provide a vehicle display device capable of providing multiple usage environments with a single display and an operating method thereof.

[0008] In addition, according to some embodiments of the present invention, it is an object to provide a vehicle display device and an operating method thereof that operate so as to selectively or multiply utilize different types of usage environments formed through one display.

[0009] In addition, according to some embodiments of the present invention, it is an object to provide a vehicle display device and an operating method thereof in which a position at which 3D graphics are floated can be varied depending on a user's viewing angle, type of content, and movement.

[0010] In addition, according to some embodiments of the present invention, it is an object of the present invention to provide a vehicle display device and an operating method thereof that can visually intuitively determine whether information displayed on different types of screens is linked.

[0011] In addition, according to some embodiments of the present invention, it is an object to provide a vehicle display device and an operating method thereof that can provide various user environments and user experiences by using different screen areas independently or in conjunction with each other.

[0012] To this end, the vehicle display device according to an embodiment of the present invention can generate multiple screens having different depth values ​​by refracting or reflecting graphics projected onto one display through different reflective modules.

[0013] Specifically, a vehicle display device according to an embodiment of the present invention includes a housing having a recessed inner space formed therein; a display disposed on one side of the inner space of the housing; a communication module for receiving vehicle information from a vehicle; and a first reflective module coupled to one side of the display in the inner space and arranged so that graphics emitted from a first area of ​​the display are refracted to form a first screen area; a second reflective module coupled to one side of the first reflective module in the inner space and arranged so that graphics emitted from a second area of ​​the display are reflected to form a second screen area; and a processor electrically coupled to the display and the first and second reflective modules to control their respective operations. In addition, the processor controls the first and second reflective modules to display information with different depth values ​​on the first and second screen areas based on the received vehicle information when the display is driven.

[0014] In an embodiment, the processor may determine whether each piece of information to be displayed in the first and second screen areas is linked, and control the first and second reflective modules to change the depth value according to the determination.

[0015] In an embodiment, the first screen area is a prism area, and the second screen area is a floating area where a virtual (AR) image is displayed below the prism area. In addition, the processor may adjust the depth value through the first and second reflection modules so that the images to be displayed in the prism area and the floating area are located on the same plane based on the fact that each piece of information to be displayed in the prism area and the floating area is linked to each other.

[0016] In an embodiment, based on the fact that each piece of information to be displayed in the prism area and the floating area is linked to each other, an image to be displayed in the floating area can be displayed by moving from top to bottom so as to be seamlessly connected in the prism area.

[0017] In an embodiment, the processor may control the display and the first and second reflective modules so that content related to the vehicle information is displayed in the prism area and the execution result of the content is displayed in the floating area based on the fact that each piece of information to be displayed in the prism area and the floating area are linked to each other.

[0018] In an embodiment, driving guidance information is displayed as content related to the vehicle information in the prism area, and driving guidance information expanded in the floating area may be displayed as the execution result based on a change in the importance level of the driving guidance information.

[0019] In an embodiment, the prism region is formed to receive a touch input, and the processor can control the display and the first and second reflective modules to display an execution result matching the touch input in a corresponding floating region based on a touch input for content displayed in the prism region.

[0020] In an embodiment, when the linkage of each piece of information displayed in the prism area and the floating area is terminated, the image of the prism area continues to be displayed and the image of the floating area moves to the boundary between the prism area and the floating area and disappears.

[0021] In an embodiment, based on the fact that each piece of information to be displayed in the prism area and the floating area is not linked to each other, the image of the floating area may be displayed by starting from the middle of the floating area and spreading up and down.

[0022] In an embodiment, based on the fact that each piece of information to be displayed in the prism area and the floating area is not linked to each other, the image of the floating area may be displayed by moving from the bottom to the top of the floating area.

[0023] In an embodiment, the processor may adjust the depth value so that, when the display is driven while the vehicle is stopped or in autonomous driving mode based on the received vehicle information, the images to be displayed on the first and second screen areas are seamlessly connected and positioned on the same plane.

[0024] In an embodiment, the processor may control the first and second reflective modules to selectively display information at different depth values ​​in the first and second screen areas, respectively, based on the importance of the vehicle information.

[0025] In an embodiment, the processor may control the operation of the second reflective module to limit the display in the second screen area based on a driving condition included in the vehicle information while displaying information with different depth values ​​in the first and second screen areas.

[0026] According to a vehicle display device according to an embodiment of the present invention, a single display module can selectively or simultaneously perform multiple different display modes. For example, a single display can selectively or simultaneously display real and virtual images.

[0027] In addition, according to the vehicle display device according to an embodiment of the present invention, the position of the floating 3D virtual image can be varied depending on the user's viewing angle and the type or movement of the content, thereby displaying the graphic image so as to match the user's viewing angle and maximize the sense of immersion and floating effect.

[0028] In addition, according to the vehicle display device according to an embodiment of the present invention, by adjusting the depth and displaying it according to whether real and virtual images are linked to each other, it is possible to visually intuit whether information displayed on different types of screens is linked.

[0029] Specifically, a vehicle display device according to an embodiment of the present invention can display information linked to a prism region and a floating region from a single source image so that it appears seamlessly as a single connected screen. Furthermore, the execution result of content displayed in the prism region can also be displayed in the floating region. Furthermore, depending on whether the vehicle's alert / alarm level is elevated, information displayed only in the prism region can be expanded and displayed in the floating region, or images can no longer be displayed in the floating region. Accordingly, by using different screen regions independently or in conjunction with each other, a more diverse user environment and experience can be provided.

[0030] Figures 1 and 2 are exemplary block diagrams for explaining the configuration of a vehicle related to the present invention.

[0031] FIG. 3 is an exemplary drawing showing a vehicle display device installed and operated in a vehicle according to the present invention.

[0032] Figure 4 is an exemplary block diagram for explaining the detailed configuration of a vehicle display device according to the present invention.

[0033] Figure 5 is a side cross-sectional view of a vehicle display device according to the present invention.

[0034] FIG. 6 is a side view of a prism display area and a floating display area formed by driving a vehicle display device according to the present invention.

[0035] FIG. 7 is an exemplary drawing for explaining a plurality of display areas according to the display mode of the vehicle display device according to the present invention.

[0036] FIG. 8 is a side view of a vehicle display device disposed in a cluster / CID area of ​​a vehicle according to the present invention.

[0037] Figure 9 is an exemplary flowchart for explaining an operation method of a vehicle display device according to the present invention.

[0038] FIGS. 10, 11, and 12 are various examples of vehicle display devices for implementing multiple display modes with one display according to the present invention.

[0039] FIG. 13 is a conceptual diagram illustrating a method for changing the position of an AR image of a floating area in a vehicle display device according to the present invention.

[0040] FIG. 14 and FIG. 15 are drawings for explaining how information in a prism area is expanded to a floating area or how information in a floating area is reduced to a prism area and displayed according to an embodiment of the present invention.

[0041] FIG. 16 is a drawing showing an example in which vehicle navigation information is displayed in conjunction with a prism area and a floating area according to an embodiment of the present invention.

[0042] FIG. 17 and FIG. 18 are exemplary drawings showing expanded warning information displayed in a floating area according to a warning level corresponding to a detected vehicle speed in an embodiment of the present invention.

[0043] FIG. 19 is an exemplary drawing showing expanded warning information displayed in a floating area based on the inter-vehicle distance of vehicles in an embodiment of the present invention.

[0044] FIGS. 20 and 21 are exemplary drawings for explaining the prism area and floating area allocated to the driver's seat passenger and the passenger's seat passenger, respectively, in an embodiment of the present invention.

[0045] FIG. 22 is an exemplary drawing showing an expanded display of the execution result of an entertainment function in a floating area based on the driving status of a vehicle in an embodiment of the present invention.

[0046] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0047] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0048] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0049] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0050] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0051] Figures 1 and 2 are exemplary block diagrams for explaining a vehicle and a vehicle configuration related to the present invention.

[0052] Referring to FIG. 1, the vehicle (100) may include wheels that rotate by a power source and a steering input device (510) for controlling the direction of travel of the vehicle (100).

[0053] The vehicle (100) may be an autonomous vehicle. The vehicle (100) may be switched between an autonomous driving mode and a manual driving mode based on user input. For example, the vehicle (100) may be switched from a manual mode to an autonomous driving mode, or from an autonomous driving mode to a manual mode, based on user input received through a user interface device (hereinafter, referred to as a "user terminal") (200).

[0054] The vehicle (100) can be switched to autonomous driving mode or manual driving mode based on driving situation information. The driving situation information can be generated based on object information provided by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on the driving situation information generated by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on driving situation information received through the communication device (400).

[0055] The vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on information, data, and signals provided from an external device.

[0056] When the vehicle (100) is operated in autonomous driving mode, the autonomous vehicle (100) may be operated based on the driving system (700). For example, the autonomous vehicle (100) may be operated based on information, data, or signals generated from the driving system (710), the exit system (740), and the parking system (750).

[0057] When the vehicle (100) is driven in manual mode, the autonomous vehicle (100) can receive user input for driving through the driving control device (500). Based on the user input received through the driving control device (500), the vehicle (100) can be driven.

[0058] A vehicle (100) may include a user interface device (200), an object detection device (300), a communication device (400), a driving operation device (500), a vehicle driving device (600), a driving system (700), a navigation system (770), a sensing unit (120), a vehicle interface unit (130), a memory (140), a control unit (170), and a power supply unit (190).

[0059] Depending on the embodiment, the vehicle (100) may include other components in addition to the components described herein, or may not include some of the components described herein.

[0060] The user interface device (200) is a device for communication between a vehicle (100) and a user. The user interface device (200) can receive user input and provide information generated in the vehicle (100) to the user. The vehicle (100) can implement a UI (User Interfaces) or UX (User Experience) through the user interface device (hereinafter, referred to as a 'user terminal') (200).

[0061] The user interface device (200) may include an input unit (210), an internal camera (220), a biometric detection unit (230), an output unit (250), and a processor (270). Depending on the embodiment, the user interface device (200) may include other components in addition to the described components, or may not include some of the described components.

[0062] The input unit (210) is for receiving information from a user, and data collected from the input unit (210) can be analyzed by a processor (270) and processed into a user's control command.

[0063] The input unit (210) may be placed inside the vehicle. For example, the input unit (210) may be placed in an area of ​​a steering wheel, an area of ​​an instrument panel, an area of ​​a seat, an area of ​​each pillar, an area of ​​a door, an area of ​​a center console, an area of ​​a head lining, an area of ​​a sun visor, an area of ​​a windshield, or an area of ​​a window.

[0064] The input unit (210) may include a voice input unit (211), a gesture input unit (212), a touch input unit (213), and a mechanical input unit (214).

[0065] The voice input unit (211) can convert a user's voice input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170). The voice input unit (211) can include one or more microphones.

[0066] The gesture input unit (212) can convert a user's gesture input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0067] The gesture input unit (212) may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input. According to an embodiment, the gesture input unit (212) may detect a user's three-dimensional gesture input. To this end, the gesture input unit (212) may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.

[0068] The gesture input unit (212) can detect a user's 3D gesture input through a TOF (Time of Flight) method, a structured light method, or a disparity method.

[0069] The touch input unit (213) can convert a user's touch input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0070] The touch input unit (213) may include a touch sensor for detecting a user's touch input. In some embodiments, the touch input unit (213) may be formed integrally with the display unit (251), thereby implementing a touch screen. Such a touch screen may provide both an input interface and an output interface between the vehicle (100) and the user.

[0071] The mechanical input unit (214) may include at least one of a button, a dome switch, a jog wheel, and a jog switch. An electrical signal generated by the mechanical input unit (214) may be provided to a processor (270) or a control unit (170). The mechanical input unit (214) may be placed on a steering wheel, a center fascia, a center console, a cockpit module, a door, etc.

[0072] The internal camera (220) can capture images of the vehicle interior. The processor (270) can detect the user's status based on the images of the vehicle interior. The processor (270) can obtain information about the user's gaze from the images of the vehicle interior. The processor (270) can detect the user's gestures from the images of the vehicle interior.

[0073] The biometric detection unit (230) can obtain the user's biometric information. The biometric detection unit (230) includes a sensor capable of obtaining the user's biometric information, and can use the sensor to obtain the user's fingerprint information, heartbeat information, etc. The biometric information can be used for user authentication.

[0074] The output unit (250) is for generating output related to visual, auditory, or tactile sensations. The output unit (250) may include at least one of a display unit, an audio output unit (252), and a haptic output unit (253).

[0075] Meanwhile, the display unit may be used to mean a vehicle display device (800) according to the present invention or a plurality of displays thereof. Alternatively, a vehicle display device (800) according to an embodiment of the present invention may be included as one of the display units.

[0076] In addition, the user interface device (200) may be understood as having the same concept as the vehicle display device (800) according to the present invention. In this case, at least some of the components included in the user interface device (200) of FIG. 1 and the components of the vehicle display device (800) of FIG. 3 may be understood as having the same concept.

[0077] The display unit can display graphic objects corresponding to various pieces of information. The display unit can include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0078] The display unit can be formed as a layer structure or integrally formed with the touch input unit (213), thereby implementing a touch screen.

[0079] The display unit may be implemented as a HUD (Head Up Display). If the display unit is implemented as a HUD, the display unit may include a projection module to output information through an image projected onto a windshield or window.

[0080] The display unit may include a transparent display. The transparent display may be attached to a windshield or a window. The transparent display may have a predetermined transparency and display a predetermined screen. In order to have transparency, the transparent display may include at least one of a transparent TFEL (Thin Film Electroluminescent), a transparent OLED (Organic Light-Emitting Diode), a transparent LCD (Liquid Crystal Display), a transparent display, and a transparent LED (Light Emitting Diode) display. The transparency of the transparent display may be adjusted.

[0081] Meanwhile, the user interface device (200) may include a plurality of display units. In this case, the plurality of display units may be located in various areas within the vehicle.

[0082] The audio output unit (252) converts an electric signal provided from the processor (270) or the control unit (170) into an audio signal and outputs the converted signal. To this end, the audio output unit (252) may include one or more speakers.

[0083] The haptic output unit (253) generates a tactile output. For example, the haptic output unit (253) can operate by vibrating a steering wheel, a seat belt, or a seat so that a user can perceive the output.

[0084] The processor (hereinafter, referred to as the 'control unit') (270) can control the overall operation of each unit of the user interface device (200). That is, the user interface device (200) can be operated under the control of the control unit (170).

[0085] Depending on the embodiment, the user interface device (200) may include a plurality of processors (270) or may not include a processor (270).

[0086] If the user interface device (200) does not include a processor (270), the user interface device (200) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0087] The object detection device (300) is a device for detecting objects located outside a vehicle (100). The objects may be various objects related to the operation of the vehicle (100). For example, the objects may include lanes, other vehicles, pedestrians, two-wheeled vehicles, traffic signals, lights, roads, structures, speed bumps, terrain, animals, etc.

[0088] Meanwhile, objects can be classified into moving objects and fixed objects. For example, moving objects may include concepts such as other vehicles and pedestrians. For example, fixed objects may include concepts such as traffic signals, roads, and structures.

[0089] The object detection device (300) may include a camera (310), a radar (320), a lidar (330), an ultrasonic sensor (340), an infrared sensor (350), and a processor (370).

[0090] Depending on the embodiment, the object detection device (300) may include other components in addition to the described components, or may not include some of the described components.

[0091] The camera (310) may be positioned at an appropriate location outside the vehicle to capture images of the vehicle's exterior. The camera (310) may be a mono camera, a stereo camera (310a), an AVM (Around View Monitoring) camera (310b), or a 360-degree camera.

[0092] For example, the camera (310) may be positioned inside the vehicle, close to the front windshield, to capture an image of the front of the vehicle. Alternatively, the camera (310) may be positioned around the front bumper or radiator grill.

[0093] For example, the camera (310) may be positioned inside the vehicle, close to the rear glass, to capture images of the rear of the vehicle. Alternatively, the camera (310) may be positioned around the rear bumper, trunk, or tailgate.

[0094] For example, the camera (310) may be positioned close to at least one of the side windows inside the vehicle to obtain an image of the side of the vehicle. Alternatively, the camera (310) may be positioned around a side mirror, fender, or door.

[0095] The camera (310) can provide the acquired image to the processor (370).

[0096] The radar (320) may include an electromagnetic wave transmitter and receiver. The radar (320) may be implemented in a pulse radar or continuous wave radar manner based on the principle of radio wave emission. Among continuous wave radar methods, the radar (320) may be implemented in a frequency modulated continuous wave (FMCW) manner or a frequency shift keying (FSK) manner depending on the signal waveform.

[0097] The radar (320) can detect an object using electromagnetic waves, based on a TOF (Time of Flight) method or a phase-shift method, and can detect the location of the detected object, the distance to the detected object, and the relative speed.

[0098] The radar (320) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0099] The lidar (330) may include a laser transmitter and receiver. The lidar (330) may be implemented using a TOF (Time of Flight) method or a phase-shift method.

[0100] The lidar (330) can be implemented as a driven or non-driven type.

[0101] When implemented as a drive type, the lidar (330) is rotated by a motor and can detect objects around the vehicle (100).

[0102] When implemented in a non-driven manner, the lidar (330) can detect an object located within a predetermined range relative to the vehicle (100) through optical steering. The vehicle (100) can include a plurality of non-driven lidars (330).

[0103] Lidar (330) can detect an object based on a time-of-flight (TOF) method or a phase-shift method using laser light as a parameter, and can detect the position of the detected object, the distance to the detected object, and the relative speed.

[0104] The lidar (330) can be placed at an appropriate location outside the vehicle to detect objects located in front, behind, or to the side of the vehicle.

[0105] The ultrasonic sensor (340) may include an ultrasonic transmitter and a receiver. The ultrasonic sensor (340) may detect an object based on ultrasonic waves, and may detect the location of the detected object, the distance from the detected object, and the relative speed.

[0106] The ultrasonic sensor (340) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0107] The infrared sensor (350) may include an infrared transmitter and a receiver. The infrared sensor (340) may detect an object based on infrared light, and may detect the location of the detected object, the distance to the detected object, and the relative speed.

[0108] The infrared sensor (350) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0109] The processor (370) can control the overall operation of each unit of the object detection device (300).

[0110] The processor (370) can detect and track an object based on the acquired image. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object through an image processing algorithm.

[0111] The processor (370) can detect and track an object based on the reflected electromagnetic waves that are returned when the transmitted electromagnetic waves are reflected by the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the electromagnetic waves.

[0112] The processor (370) can detect and track an object based on the reflected laser light that is reflected back by the transmitted laser beam from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the laser light.

[0113] The processor (370) can detect and track an object based on the reflected ultrasonic waves that are returned when the transmitted ultrasonic waves are reflected off the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the ultrasonic waves.

[0114] The processor (370) can detect and track an object based on the reflected infrared light that is reflected back by the transmitted infrared light from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the infrared light.

[0115] Depending on the embodiment, the object detection device (300) may include multiple processors (370) or may not include a processor (370). For example, each of the camera (310), radar (320), lidar (330), ultrasonic sensor (340), and infrared sensor (350) may individually include a processor.

[0116] If the object detection device (300) does not include a processor (370), the object detection device (300) can be operated under the control of the processor or control unit (170) of the device in the vehicle (100).

[0117] The object detection device (400) can be operated under the control of the control unit (170).

[0118] The communication device (400) is a device for communicating with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

[0119] The communication device (400) may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element to perform communication.

[0120] The communication device (400) may include a short-range communication unit (410), a location information unit (420), a V2X communication unit (430), an optical communication unit (440), a broadcast transmission / reception unit (450), and a processor (470).

[0121] Depending on the embodiment, the communication device (400) may include other components in addition to the described components, or may not include some of the described components.

[0122] The short-range communication unit (410) is a unit for short-range communication. The short-range communication unit (410) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.

[0123] The short-range communication unit (410) can form a short-range wireless communication network (Wireless Area Networks) to perform short-range communication between the vehicle (100) and at least one external device.

[0124] The location information unit (420) is a unit for obtaining location information of a vehicle (100). For example, the location information unit (420) may include a GPS (Global Positioning System) module or a DGPS (Differential Global Positioning System) module.

[0125] The V2X communication unit (430) is a unit for performing wireless communication with a server (V2I: Vehicle to Infrastructure), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit (430) may include an RF circuit capable of implementing protocols for communication with infrastructure (V2I), communication between vehicles (V2V), and communication with pedestrians (V2P).

[0126] The optical communication unit (440) is a unit for communicating with an external device via light. The optical communication unit (440) may include an optical transmission unit that converts an electrical signal into an optical signal and transmits it to the outside, and an optical reception unit that converts a received optical signal into an electrical signal.

[0127] According to an embodiment, the light transmitting unit may be formed to be integrated with a lamp included in the vehicle (100).

[0128] The broadcast transmitter / receiver (450) is a unit for receiving broadcast signals from an external broadcast management server via a broadcast channel, or transmitting broadcast signals to the broadcast management server. The broadcast channels may include satellite channels and terrestrial channels. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals.

[0129] The processor (470) can control the overall operation of each unit of the communication device (400).

[0130] Depending on the embodiment, the communication device (400) may include a plurality of processors (470) or may not include a processor (470).

[0131] If the communication device (400) does not include a processor (470), the communication device (400) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0132] Meanwhile, the communication device (400) may implement a vehicle display device together with the user interface device (200). In this case, the vehicle display device may be referred to as a telematics device or an AVN (Audio Video Navigation) device.

[0133] The communication device (400) can be operated under the control of the control unit (170).

[0134] The driving control device (500) is a device that receives user input for driving.

[0135] When in manual mode, the vehicle (100) can be driven based on signals provided by the driving control device (500).

[0136] The driving control device (500) may include a steering input device (510), an acceleration input device (530), and a brake input device (570).

[0137] The steering input device (510) can receive input for the direction of travel of the vehicle (100) from the user. The steering input device (510) is preferably formed in the form of a wheel so that steering input can be provided by rotation. Depending on the embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

[0138] The acceleration input device (530) can receive an input from a user for accelerating the vehicle (100). The brake input device (570) can receive an input from a user for decelerating the vehicle (100). The acceleration input device (530) and the brake input device (570) are preferably formed in the form of a pedal. Depending on the embodiment, the acceleration input device or the brake input device may also be formed in the form of a touch screen, a touch pad, or a button.

[0139] The driving operation device (500) can be operated under the control of the control unit (170).

[0140] The vehicle driving device (600) is a device that electrically controls the driving of various devices in the vehicle (100).

[0141] The vehicle driving device (600) may include a power train driving unit (610), a chassis driving unit (620), a door / window driving unit (630), a safety device driving unit (640), a lamp driving unit (650), and an air conditioning driving unit (660).

[0142] Depending on the embodiment, the vehicle drive device (600) may include additional components other than the described components, or may not include some of the described components.

[0143] Meanwhile, the vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0144] The power train drive unit (610) can control the operation of the power train device.

[0145] The power train drive unit (610) may include a power source drive unit (611) and a transmission drive unit (612).

[0146] The power source driving unit (611) can perform control over the power source of the vehicle (100).

[0147] For example, if a fossil fuel-based engine is the power source, the power source drive unit (610) can perform electronic control of the engine. This can control the engine output torque, etc. The power source drive unit (611) can adjust the engine output torque according to the control of the control unit (170).

[0148] For example, if an electric energy-based motor is the power source, the power source driving unit (610) can perform control over the motor. The power source driving unit (610) can adjust the rotation speed, torque, etc. of the motor according to the control of the control unit (170).

[0149] The transmission drive unit (612) can perform control over the transmission. The transmission drive unit (612) can adjust the state of the transmission. The transmission drive unit (612) can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

[0150] Meanwhile, when the engine is the power source, the transmission drive unit (612) can adjust the gear engagement state in the forward (D) state.

[0151] The chassis drive unit (620) can control the operation of the chassis device. The chassis drive unit (620) can include a steering drive unit (621), a brake drive unit (622), and a suspension drive unit (623).

[0152] The steering drive unit (621) can perform electronic control of the steering apparatus within the vehicle (100). The steering drive unit (621) can change the direction of travel of the vehicle.

[0153] The brake drive unit (622) can perform electronic control of the brake apparatus within the vehicle (100). For example, the speed of the vehicle (100) can be reduced by controlling the operation of the brakes placed on the wheels.

[0154] Meanwhile, the brake driving unit (622) can individually control each of the plurality of brakes. The brake driving unit (622) can control the braking force applied to the plurality of wheels differently.

[0155] The suspension drive unit (623) can perform electronic control of the suspension apparatus within the vehicle (100). For example, when there is a curve in the road surface, the suspension drive unit (623) can control the suspension apparatus to reduce vibration of the vehicle (100). Meanwhile, the suspension drive unit (623) can individually control each of the plurality of suspensions.

[0156] The door / window actuator (630) can perform electronic control of a door apparatus or window apparatus in a vehicle (100).

[0157] The door / window driving unit (630) may include a door driving unit (631) and a window driving unit (632).

[0158] The door driving unit (631) can control the door device. The door driving unit (631) can control the opening and closing of a plurality of doors included in the vehicle (100). The door driving unit (631) can control the opening or closing of a trunk or tail gate. The door driving unit (631) can control the opening or closing of a sunroof.

[0159] The window driving unit (632) can perform electronic control of a window apparatus. It can control the opening or closing of a plurality of windows included in a vehicle (100).

[0160] The safety device driving unit (640) can perform electronic control of various safety devices in the vehicle (100).

[0161] The safety device drive unit (640) may include an airbag drive unit (641), a seat belt drive unit (642), and a pedestrian protection device drive unit (643).

[0162] The airbag driving unit (641) can perform electronic control of the airbag apparatus within the vehicle (100). For example, the airbag driving unit (641) can control the airbag to deploy when a danger is detected.

[0163] The seat belt drive unit (642) can perform electronic control of the seat belt apparatus within the vehicle (100). For example, the seat belt drive unit (642) can control the passenger to be secured to the seat (110FL, 110FR, 110RL, 110RR) using the seat belt when a danger is detected.

[0164] The pedestrian protection device drive unit (643) can perform electronic control of the hood lift and pedestrian airbag. For example, the pedestrian protection device drive unit (643) can control the hood lift up and the pedestrian airbag to deploy when a collision with a pedestrian is detected.

[0165] The lamp driving unit (650) can perform electronic control of various lamp apparatuses within the vehicle (100).

[0166] The air conditioning drive unit (660) can perform electronic control of the air conditioning device (air cinditioner) within the vehicle (100). For example, the air conditioning drive unit (660) can control the air conditioning device to operate and supply cool air to the vehicle when the temperature inside the vehicle is high.

[0167] The vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0168] The vehicle driving device (600) can be operated under the control of the control unit (170).

[0169] The driving system (700) is a system that controls various operations of the vehicle (100). The driving system (700) can be operated in autonomous driving mode.

[0170] The driving system (700) may include a driving system (710), an exiting system (740), and a parking system (750).

[0171] Depending on the embodiment, the driving system (700) may include other components in addition to the described components, or may not include some of the described components.

[0172] Meanwhile, the driving system (700) may include a processor. Each unit of the driving system (700) may individually include a processor.

[0173] Meanwhile, depending on the embodiment, if the driving system (700) is implemented in software, it may be a sub-concept of the control unit (170).

[0174] Meanwhile, according to an embodiment, the driving system (700) may be a concept including at least one of a user interface device (200), an object detection device (300), a communication device (400), a vehicle driving device (600), and a control unit (170).

[0175] The driving system (710) can drive the vehicle (100).

[0176] The driving system (710) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100).

[0177] The exit system (740) can perform exit of a vehicle (100).

[0178] The exit system (740) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100).

[0179] The parking system (750) can perform parking of a vehicle (100).

[0180] The parking system (750) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100).

[0181] A navigation system (770) can provide navigation information. The navigation information can include at least one of map information, set destination information, route information based on the set destination, information on various objects along the route, lane information, and current vehicle location information.

[0182] The navigation system (770) may include memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system (770).

[0183] According to an embodiment, the navigation system (770) may receive information from an external device via the communication device (400) and update previously stored information.

[0184] Depending on the embodiment, the navigation system (770) may be classified as a subcomponent of the user interface device (200).

[0185] The sensing unit (120) can sense the status of the vehicle. The sensing unit (120) can include a posture sensor (e.g., a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight detection sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, etc.

[0186] The sensing unit (120) can obtain sensing signals for vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward / backward information, battery information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illumination, pressure applied to an accelerator pedal, pressure applied to a brake pedal, etc.

[0187] The sensing unit (120) may further include, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.

[0188] The vehicle interface unit (130) can serve as a conduit for various types of external devices connected to the vehicle (100). For example, the vehicle interface unit (130) may be equipped with a port capable of connecting to a mobile terminal, and may be connected to the mobile terminal through the port. In this case, the vehicle interface unit (130) can exchange data with the mobile terminal.

[0189] Meanwhile, the vehicle interface unit (130) may serve as a conduit for supplying electrical energy to a connected mobile terminal. When the mobile terminal is electrically connected to the vehicle interface unit (130), the vehicle interface unit (130) may provide the mobile terminal with electrical energy supplied from the power supply unit (190) under the control of the control unit (170).

[0190] The memory (140) is electrically connected to the control unit (170). The memory (140) can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory (140) can be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory (140) can store various data for the overall operation of the vehicle (100), such as programs for processing or controlling the control unit (170).

[0191] Depending on the embodiment, the memory (140) may be formed integrally with the control unit (170) or implemented as a sub-component of the control unit (170).

[0192] The control unit (170) can control the overall operation of each unit within the vehicle (100). The control unit (170) can be referred to as an ECU (Electronic Control Unit).

[0193] The power supply unit (190) can supply power required for the operation of each component under the control of the control unit (170). In particular, the power supply unit (190) can receive power from a battery or the like inside the vehicle.

[0194] One or more processors and control units (170) included in the vehicle (100) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0195] Meanwhile, the vehicle display device (800) according to the present invention can form virtual and real images in multiple different types of screen areas using a single display module. Furthermore, by combining multiple screen areas, a single display module can provide a multi-display effect.

[0196] FIG. 3 is an exemplary drawing showing a vehicle display device (800) installed and operated in a vehicle according to the present invention.

[0197] The vehicle display device (800) may be installed to correspond to the dashboard of the driver's seat of the vehicle (100) or may be installed in a rectangular shape extending from the dashboard of the driver's seat to the passenger seat.

[0198] A vehicle display device (800) includes a housing (801) having a recessed inner space formed therein, and a display may be placed on one side of the inner space of the housing (801). For example, the display of the vehicle display device (800) may be placed on the upper part of the inner space of the housing (801) with the front of the display facing downward.

[0199] The housing (801) is implemented to have an inner space recessed inward, thereby forming a natural darkroom space. Accordingly, the real and virtual images displayed on the first and second screen areas formed by the first and second reflective modules (820, 840) described below can be displayed more clearly.

[0200] The inner space of the housing (801) may be implemented in a shielded manner, while the outer space facing the driver's seat may be implemented in an open manner. In addition, the inner space of the housing (801) may be formed so that the space becomes narrower as it deepens toward the inside, and becomes wider as it goes toward the outside.

[0201] The housing (801) may have multiple screen areas formed in its inner space according to the operation of the display. In an embodiment, some of the multiple screen areas may be formed to extend beyond the inner space of the housing (801).

[0202] The plurality of screen areas may include a first screen area (821) formed above the inner space of the housing (801) and a second screen area (841) formed below the first screen area (821).

[0203] The first screen area (821) is a prism screen area formed by refracting graphics displayed in a portion of the display through a prism, thereby allowing a real image to be displayed. Furthermore, the second screen area (841) is a floating screen area formed by reflecting graphics displayed in another portion of the display through a 3D plate, thereby allowing a virtual image to be output.

[0204] In the prism screen area, a real image, for example, which is formed by polarized light refracted through a prism and reflected through a mirror, may be displayed on the prism. In addition, in the floating screen area, a 3D virtual image (AR) formed based on graphic light of a display reflected through a 3D plate, for example, may be displayed within the inner space of the recessed housing (801), or at least a portion of the image may be displayed outside the inner space. In the former case, the prism screen area and the floating screen area may be arranged on the same line, and in the latter case, these screen areas may not be arranged on the same line.

[0205] The first screen area (821) may be formed only at a location corresponding to the driver's seat or may be formed to correspond to the driver's seat and the passenger seat. The second screen area (841) may be formed at a location corresponding to the driver's seat and the passenger seat.

[0206] The first screen area (821) and the second screen area (841) may be formed selectively or simultaneously. When the first and second screen areas (821, 841) are formed together, the associated content may be displayed as different types of images, for example, real and virtual images.

[0207] FIG. 4 is an exemplary block diagram for explaining the detailed configuration of a vehicle display device (800) according to the present invention.

[0208] A vehicle display device (800) may include a housing (801), a display (810), a communication unit (830), a first reflection module (820), a second reflection module (840), a processor (850), a rotation control unit (860), and a sensor (870). In addition, the vehicle display device (800) may communicate with a vehicle (100) through the communication unit (830). In addition, the vehicle display device (800) may be implemented to form a first screen area (821) / second screen area (841) / multi-screen area (821, 841) through the first reflection module (820) and / or the second reflection module (840).

[0209] The housing (801) constitutes a frame of the vehicle display device (800) and is formed to include an inner space recessed therein.

[0210] The display (810) may be placed on one side of the inner space of the housing (801), for example, on the upper part of the inner space. At this time, the back surface of the display (810) may be coupled to the ceiling of the inner space of the housing (801), and the front surface of the display (810) may be placed facing the floor.

[0211] The display (810) may be arranged to be tilted at a predetermined angle so as not to be parallel to the floor. To this end, the ceiling of the inner space of the housing (801) may be formed to be tilted at a predetermined angle relative to the floor. In this way, by forming the display (810) to be tilted at a predetermined angle relative to the floor, the floating effect of the 3D AR image displayed on the second screen area formed by the second reflective module (840) is further maximized.

[0212] The communication unit (830) can receive data related to the vehicle status and driving from a vehicle (100) in which a vehicle display device (800) is installed. In addition, the communication unit (830) can transmit data related to the operating status and driving of the vehicle display device (800) to the vehicle (100). To this end, the communication unit (830) may be implemented to include a transmission module and a reception module, or a transceiver capable of both transmission and reception.

[0213] The first reflective module (820) may be arranged to be combined with one side of the display (810) in the inner space of the housing (801). The first reflective module (820) may be arranged so that light of graphics emitted from the first area of ​​the display (810) is refracted to form a first screen area. The first screen area refers to a prism area in which a real image of linearly polarized light corresponding to the graphics of the display (810) refracted through the prism is displayed. Hereinafter, the "first screen area" may be referred to as a 'prism area', a 'prism display', a 'prism screen', or a 'prism screen area'.

[0214] The first reflective module (820) may include a prism and a reflector to form a first screen area. The first screen area is formed above the second screen area described below, so that graphics emitted from the first area of ​​the display (810) can be output as real images.

[0215] The second reflective module (840) may be arranged to be combined with one side of the first reflective module (820) in the inner space of the housing (801). The second reflective module (840) may be arranged to reflect light of graphics emitted from the second area of ​​the display (810) to form a second screen area. The second screen area refers to an AR floating area in which a virtual (AR) image is displayed in the inner space of the housing (801) by being connected to the first screen area. Hereinafter, the “second screen area” may be referred to as a “floating area,” a “floating screen,” a “floating display,” a “floating screen area,” a “virtual screen area,” or an “AR floating area.”

[0216] The second reflective module (840) may include a 3D plate and a reflector to form a second screen area. In this case, the second screen area is formed below the first screen area, so that graphics emitted from the second area of ​​the display (810) can be output as a virtual image, i.e., a 3D AR image.

[0217] The processor (850) controls the overall operation of the display (810), the first reflective module (820), and the second reflective module (840). The processor (850) may be placed on the inner surface of the inner space of the housing (801) or on the outer surface of the back surface of the housing (801).

[0218] The processor (850) can control whether the display (810) is driven when the vehicle is started or based on a request. When the display (810) is driven, the processor (850) can control the operation of the first reflection module (820) and / or the second reflection module (840), so that the graphics displayed on the display (810) appear as real and / or virtual images through the first screen area and / or the second screen area.

[0219] When the display (810) is driven, the processor (850) can control the operation of at least one of the first and second reflective modules (820, 840) according to set conditions, thereby changing whether the first and second screen areas are activated. Accordingly, the occupants of the vehicle (100) can check the graphics displayed through the display (810) in the first screen area / second screen area / multi-screen area.

[0220] The processor (850) can control the operation of the rotation control unit (860) to change the position of the second screen area formed through the second reflection module (840). Meanwhile, the rotation control unit (860) can also be implemented as a function of the processor (850).

[0221] The rotation control unit (860) can control the rotation of the second reflection module (840) so that the reflection angle or optical path length formed by the second reflection module (840) with the display (810) is changed. To this end, the second reflection module (840) can be implemented to be rotatable by being coupled to a rotation driving means on one side of the rotation control unit (860).

[0222] As the rotation of the second reflection module (840) is adjusted by the operation of the rotation control unit (860), the position of the second screen area formed through the second reflection module (840) can be changed. Accordingly, the 3D virtual image displayed on the second screen area can move back and forth.

[0223] The rotation control unit (860) may be configured to include a coupling means for coupling with the second reflection module (860), a rotation means for rotating the second reflection module (860), and a support means for supporting the plate when rotating the second reflection module (860).

[0224] The sensor (870) may include a sensor for detecting input to the display (810) and a sensor for detecting (hovering) input to the first and second screen areas. In addition, the sensor (870) may further include a camera sensor, an IR sensor, an IMS sensor, etc. for recognizing the subject performing the input or monitoring the status of the driver / passenger.

[0225] In some examples, the sensor (870) may include a vehicle camera sensor, an IR sensor, or an IMS sensor. The vehicle display device (800) may recognize the passenger's field of view through the sensor (870) and transmit information about the same to the processor (850). Then, the processor (850) may adjust the position at which the second screen area is formed by changing the position of the second reflective module (840) based on the passenger's field of view.

[0226] Meanwhile, the vehicle display device (800) may further include a front cover (802). In this case, the front cover (802) may be shielded so that the inner space of the housing (801) is not visible when the display (810) is not operated, and may be operated so that the inner space of the housing (801) is exposed when the display (810) is operated.

[0227] In this way, the vehicle display device (800) according to an embodiment of the present invention can selectively or simultaneously implement composite content of virtual and real images with one display module by refracting part of the graphics emitted from one display (810) placed on one side of the internal space of the housing (801) through the first reflection module and reflecting part of the graphics through the second reflection module.

[0228] FIG. 5 is a side cross-sectional view of a vehicle display device (800) according to the present invention. Specifically, FIG. 5 is a side view of a "package" configuration for outputting graphics displayed on a single display positioned above the vehicle display device (800) through a prism screen and a floating screen.

[0229] A display (810) tilted to form a predetermined angle with the floor may be placed on the upper part of the package. That is, the display (810) may be placed on the upper part in a state of being tilted at a predetermined angle so as not to be parallel to the floor. Accordingly, the floating effect of a 3D virtual image displayed on a floating area formed through a second reflective module (840) described later may be expressed more three-dimensionally and prominently. In addition, since the front of the display (810) is placed on the upper part so that it faces the floor, the graphic light emitted on the front of the display (810) when the display (810) is driven is emitted in a vertical direction.

[0230] A processor (850), for example, a PCB, for controlling the operation of a vehicle display device (800) is disposed on the back surface of the package. The processor (850) controls the operation of the display (810) and the activation and operation of the first and second reflective modules (820, 840). The processor (850) is electrically coupled to one side of the display (810) and may be disposed so as to form a vertical line with the display (810) disposed above.

[0231] The first reflective module (820) can operate to display a real-world image on the prism by refracting graphic light emitted to a portion of the display (810) through a prism vertically coupled to one side of the display (810).

[0232] The prism of the first reflection module (820) is a projection body made by cutting a transparent, transmissive material at a precise angle and plane, and disperses the light of the graphic output to the first area of ​​the display (810) to change the optical path. The prism of the first reflection module (820) is arranged to form a perpendicular shape to the display (810) and may have, for example, a triangular prism shape. Accordingly, the light of the graphic output to the first area of ​​the display (810) is refracted to form a first screen area (or prism area) (821) on the surface of the prism that forms a right angle to the display (810). In an embodiment, depending on the number of reflection mirrors coupled to the prism, the image of the graphic output to the first area of ​​the display (810) is inverted or displayed in the same shape on the first screen area.

[0233] The second reflective module (840) is coupled to one side of the first reflective module (820) and includes a 3D plate positioned to form a predetermined angle with the display (810). The 3D plate, for example, a 3D hologram plate, can reflect light of graphics projected to another area of ​​the display (810), for example, the second area, to display a virtual image, i.e., a 3D virtual image, at a location corresponding to the passenger's viewing angle.

[0234] At this time, the first screen area formed through the first reflection module (820) and the second screen area formed through the second reflection module (840) have different depths. Specifically, the first screen area (821) is formed on the front surface of the prism of the first reflection module (820), while the second screen area (841) is formed in a 3D space formed by reflection through the 3D plate of the second reflection module (840). At this time, a part of the second screen area may be located on the same plane as the first screen area.

[0235] Meanwhile, the package may be placed within a housing (801, FIG. 4) including a recessed inner space. With this housing (801) structure, the second reflective module (840) reflects the light of the graphic emitted from the display (810) through the 3D hologram plate and forms an image at the bottom, thereby naturally blocking external light.

[0236] Meanwhile, although not shown, the package may further include a light absorbing portion for absorbing light of graphics emitted from the display (810) and a back plate coupled to the back surface of the 3D plate of the second reflective module (840).

[0237] At this time, the material of the back plate may be a UTG (ultra-thin glass) plate material, and may perform the function of supporting the 3D hologram plate on the back.

[0238] In addition, the light absorption unit is arranged to form a dark room on the left and right sides of the housing (801) so as to absorb light scattered by the graphics emitted from the display (810). The light absorption unit reduces the reflected brightness of the light from the graphics, thereby improving the contrast of the 3D virtual image displayed on the second screen area (841).

[0239] The processor (850) of the package can control the rotation of the 3D plate of the second reflection module (840) to change the angle formed between the plate and the display (810). Based on the change in the angle formed between the 3D plate of the second reflection module (840) and the display (810), the position of the 3D virtual image displayed on the second screen area (841) can be changed. To this end, one side of the second reflection module (840) can be coupled with a rotation control unit (860, FIG. 4) and driven to rotate the 3D plate of the second reflection module (840) based on a signal transmitted from the processor (850).

[0240] In some embodiments, the package may have a rotatable structure or include a drive cover so that the configuration of the package is shielded when the display (810) is not operated, and at least a portion of the first and second screen areas (821, 841) formed by the first and second reflective modules (820, 840) is exposed when the display (810) is operated.

[0241] Continuing with reference to FIG. 5, the package may be implemented such that it is placed within a housing (801) having a recessed inner space, such that a floating area formed through the second reflective module (840) is displayed within the recessed inner space.

[0242] Additionally, as described above, a portion of the floating area whose position has changed as the 3D plate of the second reflective module (840) rotates may be implemented to be displayed beyond the recessed inner space. Accordingly, a portion of the 3D floating content displayed in the floating area may be imaged beyond the recessed inner space of the housing (801).

[0243] The vehicle display device (800) reflects / refracts graphics emitted from the display (810) positioned at the top through the first and second reflective modules (820, 840), which are prisms and 3D plates, to form 3D virtual and real images in the prism area (821) and the floating area (841), thereby enabling real and virtual images to be implemented independently or simultaneously with a single display.

[0244] The light of the graphic emitted from the display (810) may be refracted through one or more lenses and prisms to form an eye box. To this end, an incident optical module for forming a curvature and an optical path may be further included. For example, the lens and prism may be arranged at a predetermined angle (e.g., a right angle) with the display so as to have a curvature and an optical path for forming an eye box for the graphic displayed in the first area of ​​the display (810).

[0245] Additionally, the light of the graphic emitted from the display (810) may be reflected through the 3D plate and the reflective mirror to form an eye box for displaying a virtual image. At this time, a combiner for compensating for chromatic aberration and focal length may be combined. The combiner may include a 3D plate, for example, a 3D hologram plate, and a reflective mirror for reflecting the refracted light of the graphic emitted through the prism.

[0246] At this time, the reflective mirror can be configured in the form of a flat plate or film. The reflective surface of the reflective mirror is formed on the front surface of the 3D plate facing the user's eyes, thereby compensating for chromatic aberration and focal length. In addition, in the present invention, since the graphic light of the display (810) positioned on the upper part of the package is refracted through a prism or directly irradiated onto the 3D plate, chromatic aberration due to wavelength separation hardly occurs.

[0247] FIG. 6 is a side view of a prism display area (821) and a floating display area (841) formed according to the operation of a display device (800).

[0248] As illustrated in FIG. 6, the prism display area (821) may be formed on the upper portion of the recessed inner space of the housing (801), and the floating display area (841) may be formed on the lower portion of the recessed inner space of the housing (801).

[0249] The size of the floating display area (841) may be formed to be larger than the size of the prism display area (821). A real image may be displayed in the prism display area (821), and a virtual image with depth, i.e., a 3D AR image, may be displayed in the floating display area (841).

[0250] The prism display area (821) and the floating display area (841) can be used selectively or driven simultaneously.

[0251] To this end, the processor (850) of the vehicle display device (800) can change whether the first and second screen areas, i.e., the prism display area (821) and the floating display area (841), are activated by controlling the operation of at least one of the first and second reflective modules (820, 840) according to preset conditions when the display (810) is driven.

[0252] At this time, the preset conditions are related to the driving status of the vehicle (100) in which the vehicle display device (800) is installed. For example, the preset conditions may be matched to various situations in which the driving status of the vehicle requires a warning / alarm.

[0253] The processor (850) can activate the first reflection module (820) while the vehicle is in the first driving state based on information related to the vehicle driving state received through the communication unit (830) to display the vehicle driving state in the prism display area (821).

[0254] Here, the first driving state refers to a normal driving state after the vehicle is started, and means a normal driving situation that does not require a warning / alarm.

[0255] Continuing, when the vehicle changes from the first driving state to the second driving state according to information related to the vehicle driving state received through the communication unit (830), both the first and second reflective modules (820, 840) can be activated to control the first and second reflective modules (820, 840) to display the vehicle driving state together in the prism display area (821) and the AR floating display area (840).

[0256] Here, the second driving state refers to a driving situation requiring a warning / alarm while the vehicle is driving. For example, the processor (850) may determine that the second driving state is in effect when a warning / alarm is required due to a violation of the speed limit, a sharp curve ahead, or the appearance of an object around the vehicle. Once the situation is resolved, the processor may determine that the vehicle has transitioned to the first driving state.

[0257] In addition, according to information related to the vehicle driving state received through the communication unit (830), the second reflection module (840) can be activated while the vehicle (100) is in the third driving state to display an AR virtual image in the AR floating display area (840) and control to display a graphic object related to the AR virtual image in the prism display area (821).

[0258] Here, the third driving state may mean a state in which the entertainment function is executed while the vehicle is stopped.

[0259] In another embodiment, the processor (850) of the vehicle display device (800) may determine to display either one of the prism display area (821) and the AR floating display area (840), or both, depending on the type of content output to the display (810). For example, a content type related to a vehicle status may be displayed in the prism display area (821), and an entertainment content type may be displayed in the AR floating display area (840).

[0260] In another embodiment, the processor (850) of the vehicle display device (800) may decide to display either the prism display area (821) or the AR floating display area (840), or both, based on a user's input / request.

[0261] As described above, the vehicle display device (800) according to an embodiment of the present invention can selectively provide a usage environment of multiple displays with one display.

[0262] FIG. 7 is an exemplary drawing for explaining multiple display areas according to the display mode of the vehicle display device (800).

[0263] The vehicle display device (800) can operate in a 'prism display mode' that displays a real image in a prism screen area, a 'floating display mode' that displays a virtual image in a floating screen area, or a 'multi-display mode' that displays a real image and a virtual image simultaneously in the prism screen area and the floating screen area, depending on set conditions.

[0264] Here, the set conditions may be related to the driving status of the vehicle, as described above, or may be associated with the type of content to be captured, or may correspond to user input / request.

[0265] Meanwhile, the vehicle display device (800) can control the floating screen area (841) formed through the second reflective module (840) to be displayed at positions corresponding to the driver's seat and the passenger's seat, respectively, in the recessed inner space of the housing (801).

[0266] Specifically, referring to FIG. 7, the floating screen area (841) can be divided into a first floating area (841a) positioned to correspond to the driver's seat, a third floating area (841c) positioned to correspond to the passenger seat, and a second floating area (841b) positioned to correspond between the driver's seat and the passenger seat.

[0267] The first floating area (841a) may be an area used by the driver's seat passenger, and the third floating area (841c) may be a display area used by the passenger in the passenger seat. Additionally, the second floating area (841b) may be a display area shared by the driver's seat and passenger in the passenger seat.

[0268] The first floating area (841a) displays a 3D AR image that is floated to correspond to the viewing angle of the driver's seat passenger. Furthermore, the third floating area (841c) displays a 3D AR image that is floated to correspond to the viewing angle of the passenger in the passenger seat. Furthermore, the second floating area (841b) displays a 3D AR image that is floated to correspond to a preset viewing angle, for example, a viewing angle set to correspond to the driver's seat or the passenger seat.

[0269] The contents displayed in the first to third floating areas (841a, 841b, 841c) can be independently controlled for display.

[0270] In addition, the vehicle can operate in SPM (Switchable Privacy Mode, SPM) mode so that the first floating area (841a) is not visible from the passenger seat, and the content displayed in the third floating area (841c) is not visible from the driver's seat. At this time, 3D content can be displayed in the second floating area (841b) at a viewing angle that can be viewed from both the driver's seat and the passenger seat.

[0271] FIG. 8 is a side view of a vehicle display device (800) disposed in a cluster / CID area of ​​a vehicle (100) according to the present invention. As illustrated in FIG. 8, a housing (801) of the vehicle display device may be disposed at a position corresponding to the dashboard of the driver's seat. The housing (801) may be formed to have an inner space recessed inwardly, for example, such that the basic volume is approximately 23 liters.

[0272] Although not shown in detail, when the vehicle display device (800) is driven, a prism display area (821) in which a real image is displayed and a floating display area (841) in which a virtual image, i.e. a 3D AR image, is displayed are formed in the inner space of the housing (801) open toward the passenger's visual angle, and can be provided to the user's eye box.

[0273] When the vehicle display device (800) is not in operation, the housing (801) can be rotated or shielded through the front cover so that the inner space of the housing (801) is hidden.

[0274] The vehicle display device (800) can selectively activate a prism display area (821) and a floating display area (841) to provide graphics illuminated on a display (810) positioned on the upper portion of the inner space of the housing (801) to a user's viewing angle.

[0275] To this end, the vehicle display device (800) can be controlled so that graphics emitted in the first area of ​​the display (810) are refracted through a prism and then a real image is displayed on the surface of the prism.

[0276] In addition, the vehicle display device (800) can be controlled to display a 3D AR image in the inner space of the housing (801) that matches the user's eye level after the graphic emitted in the second area of ​​the display (810) is refracted through a prism, reflected through a 3D plate, and then passes through a reflective polarizing plate and / or an absorbent polarizing plate.

[0277] Below, FIG. 9 is an exemplary flowchart for explaining the operation method of a vehicle display device (800) according to the present invention.

[0278] Referring to FIG. 9, the operating method of a vehicle display device (800) according to an embodiment of the present invention begins with a step of driving a display positioned on one side of the inner space of a housing (801, FIG. 4) (S10). As the display (810) is driven, graphics are emitted on the front surface.

[0279] To this end, the display (810) of the vehicle display device (800) may be formed with a structure in which the front is positioned on the inner upper part of the inner space of the housing (801) with the front facing the ground, but has an inclination that is not parallel to the ground.

[0280] In this way, by positioning the display (810) on the inner upper portion of the inner space of the housing (801), the light of the emitted graphic can have a curvature and an optical path for forming an eye box. Accordingly, an optical path is formed so that the light of the graphic emitted by the display (810) is directed toward the 3D plate of the second reflective module (840) without being dispersed.

[0281] In addition, since the display (810) placed on the top is formed in a structure that is not parallel to the ground but rather inclined, the floating effect of the 3D AR image appearing in the floating display area (841) formed through the second reflective module (840) is maximized.

[0282] Continuing, the vehicle display device (800) can operate so that the graphics emitted in the first area of ​​the display (810) are refracted through the first reflective module (820) to form a first screen area (S20).

[0283] In addition, the vehicle display device (800) can operate so that graphics emitted from the second area of ​​the display (810) are reflected through the second reflection module (840) to form a second screen area (S30).

[0284] The formation of the first and second screen areas in this way can be said to mean that the graphics emitted by the display (810) are ready to be imaged in either the first or second screen areas.

[0285] In this way, when the preparation for focusing on one or all of the plurality of screen areas is completed, the vehicle display device (800) can control at least one of the first and second screen areas formed through the first and second reflective modules (820, 840) to be activated based on whether the set conditions are satisfied (S40).

[0286] Specifically, for example, a first screen area formed through a first reflective module (820) may be activated to display only a vehicle driving status, so that a real-world image may be displayed on the surface of the prism. In addition, for example, a second screen area formed through a second reflective module (840) may be activated to display a warning / alarm during vehicle driving or to provide guidance on a dangerous situation, so that a floating 3D AR image may be displayed in the recessed inner space of the housing (801). At this time, the recessed inner space of the housing (801) with its side shielded naturally provides a darkroom effect, so that the floating 3D AR image may be displayed more clearly.

[0287] Meanwhile, FIGS. 10, 11, and 12 are various structural examples of a vehicle display device (100) for implementing multiple display modes with one display according to an embodiment of the present invention.

[0288] FIG. 10 is a basic structure of a housing (801) of a vehicle display device (800), in which a display (810) is arranged on the upper portion of a recessed inner space of the housing (801), and a processor (850) may be included on the back surface of the inner space. In addition, a first reflective module (820) coupled to one side of the display (810) and including a prism is arranged to be perpendicular to the display (810) in the same vertical direction in which light is emitted from the display (810). In addition, a second reflective module (840) coupled to one side of the first reflective module (820) and reflecting light refracted through the prism of the first reflective module (820) may be arranged to form a predetermined angle with the display (810). At this time, the second reflective module (840) may be formed by including a 3D hologram plate and a reflective mirror (not shown) that are placed in the inner space of the housing (801) and formed to face the front of the display (810).

[0289] In an embodiment, the processor (850) can control the prism of the first reflection module (820) to refract linear polarization corresponding to graphics emitted in the first area of ​​the display (810) to form a first screen area while the first reflection module (820) is activated.

[0290] In addition, the processor (850) can control the 3D plate of the second reflection module (840) to reflect the linear polarization refracted through the graphic or prism emitted to the second area of ​​the display (810) while the second reflection module (840) is activated to form a second screen area that displays a 3D virtual (AR) image.

[0291] The first screen area formed through the first reflective module (820) is formed on top of the second screen area formed through the second reflective module (840) and extends to the first area of ​​the display (810).

[0292] In addition, the second screen area formed through the second reflection module (840) is formed below the first screen area formed through the first reflection module (820), and the 3D AR content displayed in the second screen area may be formed only within the inner space of the housing (801) or may be formed so that a portion thereof extends beyond the inner space.

[0293] FIG. 11(a) is an exemplary structure in which only the first screen area formed through the prism of the first reflective module (820) is used when the vehicle display device (800) is driven by the display (810). In FIG. 11(a), the housing (801') is folded or rotated so that the 3D hologram plate is parallel to the display (810), so that the volume of the housing (801') can be minimized. This housing (801') structure can be called a minimum slim package, and the graphic emitted by the display (810) is refracted through the prism and displayed as a real image on the front surface. For example, when the 3D hologram plate of the second reflective module rotates so that the inner space of the housing (801') is reduced to a minimum, the volume of the minimum slim package can be changed to 9 liters.

[0294] Meanwhile, (b) of FIG. 11 shows a state in which both the first and second reflective modules (820, 840) are operated and the corresponding first and second screen areas are activated in accordance with the operation of the display (810) of the vehicle display device (800). At this time, the processor (850) may be arranged on the outer rear surface of the housing (801") so as to be coupled to one side of the display (810).

[0295] Additionally, according to an embodiment, a UTG plate may be combined on the front side of the 3D plate of the second reflective module (840) to form an optical path of the eye box. Additionally, although not shown, a light absorption plate may be further provided adjacent to the 3D plate of the second reflective module (840) to further absorb linearly polarized light not reflected through the 3D plate.

[0296] Continuing with reference to FIG. 12, the package of the vehicle display device (800) can be implemented with a slimmer structure by being formed integrally with the air duct of the driver's seat of the vehicle (100) on the dashboard. In this way, when modularized together with the vehicle's air purifier, the package and housing can be implemented to have a volume of 11 liters, which is slightly larger than the volume of the minimum slim package described above.

[0297] In the above, examples and structures of a vehicle display device (800) according to an embodiment of the present invention that displays graphics of different types in multiple display areas through one display have been examined.

[0298] Hereinafter, with reference to FIG. 13, a method for changing the position of an AR image displayed in a floating display area in a vehicle display device (800) according to the present invention will be specifically described.

[0299] A real image can be displayed on the surface of a prism in the first screen area formed through the first reflection module (820), and a 3D virtual (AR) image with depth can be displayed in the second screen area formed through the second reflection module (840).

[0300] In an embodiment of the present invention, a 3D virtual (AR) image displayed in the second screen area can be displayed while moving in the x-axis, y-axis, and z-axis directions within the inner space of the housing (801). To this end, the 3D hologram plate of the second reflection module (840) is implemented to be rotatable so that the angle formed between it and the display (810) can be adjusted.

[0301] Specifically, as illustrated in FIG. 13, the first reflective module (820) is fixed to one side of the display (810), and the second reflective module (840) is arranged in a rotatable structure in the inner space of the housing (801). One side of the second reflective module (840) is fixed adjacent to the first reflective module (820), and is formed so that the distance from the display (810) increases from the one side to the other side. In addition, the second reflective module (840) is formed so that the angle between it and the facing display (810) can be changed according to the operation of the rotation control unit (860).

[0302] The processor (850) of the vehicle display device (800) can transmit a signal to the rotation control unit (860) to adjust the rotation of the second reflection module (840) so that the angle between the second reflection module (840) and the display (810) is changed.

[0303] The rotation control unit (860) may include a coupling means coupled to one side of the 3D plate of the second reflection module (840), a driving means providing a driving force for rotation to the 3D plate, and a support means supporting the 3D plate while the 3D plate rotates.

[0304] When the rotation control unit (860) operates according to the driving signal transmitted from the processor (850), the 3D plate of the second reflection module (840) can rotate by a set angle in a clockwise or counterclockwise direction based on the information included in the driving signal.

[0305] This is an exemplary drawing showing the basic position of the second reflective module (840) in the inner space of the housing (801) of Fig. 13 (a). When the 3D plate of the second reflective module (840) is placed in a predetermined basic position, the second screen area (841) where 3D AR content is displayed can be displayed, for example, at the entrance of the inner space of the housing (801).

[0306] In an embodiment, the processor (850) can control the rotation of the second reflection module (840) through the rotation control unit (860) to change the angle between the display (810) and the 3D plate, and based on this, control the position of the second screen area (841) where 3D AR content is displayed to move forward and backward based on the inner space of the housing (801).

[0307] Figure 13 (b) is an example in which the 3D plate of the second reflective module (840) is rotated clockwise by a certain angle from the basic position so that the angle between the display (810) and the 3D plate becomes larger.

[0308] As the size of the angle between the 3D plate of the display (810) and the second reflective module (840) increases, the position of the second screen area (841) formed through the second reflective module (840), i.e., the floating display area, protrudes forward. Accordingly, at least a portion of the 3D AR image displayed on the second screen area (841) may be displayed outside the inner space of the housing (801).

[0309] Meanwhile, (c) of FIG. 13 is an example in which the 3D plate of the second reflective module (840) is rotated counterclockwise by a certain angle from the basic position so that the angle between the display (810) and the 3D plate becomes smaller.

[0310] As the size of the angle between the display (810) and the 3D plate of the second reflective module (840) decreases, the position of the second screen area (841) formed through the second reflective module (840), i.e., the floating display area, is pushed rearward and displayed. Accordingly, the 3D AR image displayed on the second screen area (841) can be displayed further inside the inner space of the housing (801).

[0311] Figure 13 (d) illustrates a 3D AR image (1301) displayed on the second screen area, i.e., the floating display area (841), moving forward and backward (1302) in the inner space of the housing (801) according to the rotation of the 3D plate of the second reflective module (840). At this time, the graphics displayed on the first screen area, i.e., the prism display area, formed through the first reflective module (820) are continuously displayed on the same plane.

[0312] In this way, movement of the 3D AR image according to a change in the position of the 3D plate of the second reflective module (840) can be performed based on various conditions.

[0313] In an embodiment, the processor (850) of the vehicle display device (800) may adjust the rotation of the second reflective module (840) so that the position of the second screen area is variable based on the view angle information (e.g., eye box / eye level) of the passenger detected by the IMS (internal camera) or DMS sensor of the vehicle (100) received from the vehicle (100). To this end, the processor (850) may calculate the refraction, curvature, and optical path matching the view angle information of the passenger detected through the IMS / DMS sensor, and adjust the position of the 3D plate of the second reflective module (840) when the display (810) is driven.

[0314] In addition, in the embodiment, the processor (850) of the vehicle display device (800) may activate the first and second screen areas formed through the first and second reflective modules (820, 840) when the display (810) is driven. Next, the processor (850) may display a real first graphic image on the first screen area (821), i.e., the prism display area, and may adjust the rotation of the second reflective module (840) so that the position of the floating display area adaptively changes based on the movement of the virtual second graphic image displayed on the second screen area (841), i.e., the floating display area.

[0315] For example, if the 3D AR image displayed on the floating display area is a 3D content type implemented to move back and forth, the 3D plate of the second reflective module (840) can rotate to correspond to such a movement pattern. Accordingly, the 3D virtual (AR) image can operate to move back and forth based on the recessed inner space of the housing (801), as shown in (d) of FIG. 13. To this end, the 3D plate of the second reflective module (840) can be driven to rotate according to a pattern preset for each content.

[0316] Also, for example, in the case of content where it is effective to display a 3D (AR) virtual image so that it protrudes toward the driver, the position may be changed in a direction where the angle between the 3D plate of the second reflective module (840) and the display (810) increases. Similarly, in the case of content where it is effective to display a 3D virtual (AR) image so that it is retracted into the housing (801), the position may be changed in a direction where the angle between the 3D plate of the second reflective module (840) and the display (810) decreases. For example, the 3D plate of the second reflective module (840) may rotate clockwise / counterclockwise to exhibit the effect of the 3D virtual (AR) image zooming in / out. Alternatively, the 3D plate of the second reflective module (840) may remain fixed and the housing including the package may rotate in a specific direction to exhibit the same / similar effect.

[0317] Meanwhile, the aforementioned package may be formed to have a structure that can rotate together with the dashboard of the vehicle (100). In this case, the recessed inner space of the housing (801) may be exposed or shielded in response to the rotation of the package. As another example, a front cover may be further provided to shield the recessed inner space of the housing (801).

[0318] Below, various embodiments of displaying information by having different depth values ​​in the prism area and the floating area or by changing the depth value according to an embodiment of the present invention will be examined.

[0319] Referring back to FIG. 2, as described above, the prism region is a first screen region where information is displayed on the prism through graphics displayed on the display (810). In addition, the floating region is a second screen region where graphics displayed on the display (810) are reflected through the 3D plate to display a virtual image, i.e., a floating AR image, in the inner space of the housing (801).

[0320] Information in the prism region and information in the floating region are displayed with a phase difference of 180 degrees. Specifically, the graphic output on the display (810) positioned on the upper part of the inner space of the housing (801), i.e., the source image, is displayed as an image with a phase difference of 180 degrees in the prism region and the floating region.

[0321] Additionally, each image displayed in the prism region and the prism region is displayed with different depth values. The image displayed in the prism region is a real image, and the image displayed in the floating region is a virtual image reflected through the 3D plate, and the images displayed in each of the multiple regions have different depth values.

[0322] The prism area can be divided into a "Driver Essential Zone," where essential vehicle driving information is displayed, and a "Control Zone," where touch input and other controls are available. The Driver Essential Zone within the prism area can display information such as vehicle speed and RPM. Additionally, the Control Zone within the prism area can display HVAC controls, menu icons, and other information.

[0323] The floating area can be divided into a sharing zone, a driver private zone, and a passenger private zone, which are included in the field of view of both the driver and the passenger.

[0324] In addition, the information displayed in the floating area may move in the x, y, and z-axis directions or the depth value of the 3D content may change according to the rotation / movement of the 3D plate of the second reflection module (840) as illustrated in FIG. 13.

[0325] In embodiments of the present invention, information displayed in the prism region may be displayed while expanding into the floating region. Similarly, information displayed in the floating region may be displayed while shrinking into the prism region.

[0326] In an embodiment of the present invention, a vehicle display device (800) may display a real image and a virtual image on a first screen area (i.e., a prism area) (821) and a second screen area (i.e., a floating area), respectively, using graphics emitted from a display (810) obliquely arranged on one side, for example, the upper side, of the inner space of the housing as a source image.

[0327] To this end, the graphic emitted from the first area of ​​the display (810) is refracted through the first reflective module (820) to form the first screen area (821). In addition, the graphic emitted from the second area of ​​the display (810) is reflected through the second reflective module (840) or is refracted in the first reflective module and then reflected in the second reflective module (840) to form the second screen area (840).

[0328] A processor (850) positioned at the rear of the inner space of the housing (801) can control the display (810) to display information having different depth values ​​on the first and second screen areas (821, 841) formed through the first and second reflective modules (820, 840) based on vehicle information received from the vehicle (100) when the display (810) is driven.

[0329] In an embodiment, information that is psychologically linked to each other can be displayed in the first and second screen areas (821, 841).

[0330] In this regard, FIGS. 14 and 15 are drawings for explaining that information in a prism area (821) is expanded to a floating area (841), or information in a floating area (841) is reduced to a prism area and displayed.

[0331] The processor (850) can determine information to be displayed on the first and second screen areas (821, 841) based on the received vehicle information. In addition, the processor (850) can determine whether the information to be displayed on the first and second screen areas (821, 841) are linked to each other.

[0332] Here, the information to be displayed being linked to each other includes the content selected in the first screen area (821) being executed in the second screen area (841).

[0333] In addition, the fact that the information to be displayed is linked to each other includes the information displayed in the first screen area (821) being displayed in a different format (type) in the second screen area (841).

[0334] In addition, the fact that the information to be displayed is linked to each other includes that the information displayed in the first screen area (821) is expanded and displayed in the second screen area (841) by satisfying preset conditions.

[0335] In an embodiment, the processor (850) may determine whether each piece of information to be displayed in the first and second screen areas, i.e., the prism area (821) and the floating area (841), is linked, and may control the first and second reflection modules (820, 840) so that at least one of the depth values ​​of the real image displayed in the prism area (821) and the virtual image displayed in the floating area (841) is changed according to the determination.

[0336] Referring to FIG. 14, when the vehicle display device (800) is driven, information linked to information displayed in the prism area (821) formed on the upper portion of the housing (801) can be displayed by seamlessly extending from the prism area (821) to the floating area (841).

[0337] At this time, the information displayed in the floating area (841) formed at the bottom of the prism area (821) may be displayed as if it were to spread downward from the prism area (821). Accordingly, the user can intuitively perceive that the information displayed in the prism area (821) and the floating area (841) are linked to each other.

[0338] Additionally, when information linked to the floating area (841) is seamlessly displayed, a highlighting effect (e.g., changing the size, color, or size of the image, or an on / off blinking effect) may be displayed on the information displayed on the matching prism area (821). Accordingly, the user can visually intuit which information the information displayed on the floating area (841) is linked to in the prism area (821).

[0339] Continuing with reference to FIG. 15, when the information displayed in the prism area (821) is linked to each other and the information displayed in the floating area (841) changes or disappears, the operation of the display (810) and the first and second reflective modules (820, 840) can be controlled so that the information before the change or before the disappearance moves toward the prism area (821).

[0340] At this time, preset visual effects may also be output to the linked information displayed in the prism area (821). For example, if one image is displayed seamlessly connected to the prism area (821) and the floating area (841), and then the portion displayed in the floating area (841) changes or disappears, the information displayed in the matching portion of the prism area (821) may also be correspondingly reduced, changed, or removed. Accordingly, it is possible to visually intuit which information is disconnected in the prism area (821).

[0341] Meanwhile, in FIGS. 14 and 15, in the subregions where information linked to each other is displayed in the prism region (821) and the floating region (841), the depth value can be adjusted so that the images are located on the same plane. On the other hand, the images of each subregion where information not linked to each other is displayed in the prism region (821) and the floating region (841) may have different depth values ​​and / or be located on different planes.

[0342] Accordingly, it is possible to visually intuitively perceive information displayed in the prism area (821) and the floating area (841) or information linked to each other.

[0343] Fig. 16 is a drawing showing an example in which vehicle navigation information is displayed in a prism area (821) and a floating area (841).

[0344] In the prism area (821), a real image in which the source image is refracted by the prism is displayed, and in the floating area (841), a virtual image formed by the source image being directly reflected through the 3D plate or reflected through the 3D plate after passing through the prism (refracted), i.e., virtual 3D content is displayed.

[0345] The processor (850) can adjust each depth value so that each image to be displayed in the prism area (821) and the floating area (841) is located on the same plane through the first and second reflection modules (820, 840) based on the fact that each piece of information to be displayed in the prism area (821) and the floating area (841) is linked to each other.

[0346] In an embodiment, the processor (850) can determine that each piece of information to be displayed in the prism area (821) and the floating area (841) is linked to each other, and based on the determination, the image to be displayed in the floating area (841) can be displayed by moving from top to bottom so as to be seamlessly connected in the prism area (821).

[0347] Referring to FIG. 16, a navigation screen can be seamlessly displayed so as to be connected to the prism area and floating area of ​​the display (810) corresponding to the driver's seat and the passenger's seat of the vehicle (100). At this time, a menu content (1610) related to navigation screen control can be displayed in the upper prism area (821), and connected thereto, a navigation execution screen (1620) that is seamlessly connected to the menu content (1610) can be displayed as a virtual (AR) image in the floating area (841) so as to have a depth value on the same plane.

[0348] Although not illustrated in detail, the menu content for executing navigation may be displayed in the upper prism area (821), and in response to a selection in the prism area (821), the navigation execution screen may be seamlessly displayed in the floating area (841). At this time, the navigation execution screen may be displayed by expanding downwards from the point where the selection is accepted in the prism area (821) as the starting position. Accordingly, the user may intuitively perceive that the prism area (821) and the floating area (841) are linked.

[0349] In another embodiment, the processor (850) determines that each piece of information to be displayed in the prism area (821) and the floating area (841) is linked to each other, and based on the determination, content related to vehicle information may be displayed in the prism area (821), and the execution result of the content may be displayed in the matching floating area (841).

[0350] Below, FIGS. 17 and 18 are exemplary drawings that display expanded warning information in a floating area according to a warning level corresponding to a vehicle speed.

[0351] Also, Fig. 19 is an example drawing that displays extended warning information in a floating area based on the inter-vehicle distance of the vehicles.

[0352] Graphics emitted from the display (810), i.e., source images, can be independently displayed in the prism area (821) and the floating area (841) via the first and second reflection modules (820, 840). That is, although there is only one source image, multiple screen areas are independently driven.

[0353] The processor (850) can determine which information to display in which screen area. In addition, the processor (850) can preset criteria for determining information to display in the prism area (821) and the floating area (841), and display information in each screen area according to the set criteria when the display (810) is driven.

[0354] In addition, in the embodiment, the processor (850) may receive vehicle status information from the vehicle (100) and control the first and second reflective modules (820, 840) to selectively display information in the first and second screen areas (821, 841), respectively, with different depth values ​​based on the importance of the vehicle information included in the received vehicle status information.

[0355] For example, important information among the status information of the received vehicle that should not be affected by the surrounding brightness can be displayed in a prism area (821) that does not require a darkroom effect. In addition, for example, important information related to safety among the status information of the received vehicle can be adjusted in the position of the graphic emitted on the display (810) so that it is displayed in the prism area (821). In addition, for example, other driving information of the vehicle or content defined / set by the user can be displayed in a floating area (841) that is displayed as a virtual (AR) image.

[0356] Referring to FIG. 17, for example, vehicle status information (1710) that is always displayed while the vehicle is driving may be displayed on a narrow prism area (821) formed on the upper portion of the housing (801). For example, information to be displayed on the prism area (821) may include vehicle speed (e.g., 55 m / h), RPM, remaining fuel / battery amount, vehicle status alarms, etc.

[0357] Meanwhile, in the floating area (841) formed widely below the prism area (821) in the housing (801), information displayed in the prism area (821) can be displayed as primary information, and more expanded secondary information can be displayed as a virtual (AR) image.

[0358] Referring to FIG. 18, for example, if the speed (e.g., 80 m / h) (1810) displayed in the prism area (821) exceeds the allowable speed, a numeric image (1820) indicating the current vehicle speed may be expanded and displayed in the floating area (841). At this time, the image displayed in the floating area (841) may vary depending on the importance / warning level.

[0359] For example, as the degree to which the current vehicle speed exceeds the allowable speed increases, the size of the image displayed in the floating area (841) can be expanded and the alarm level can be increased. Conversely, as the degree to which the current vehicle speed exceeds the allowable speed decreases, the display (810) and the second reflective module (840) can be controlled to reduce the size of the image displayed in the floating area (841) or to no longer display it.

[0360] Continuing, referring to FIG. 19, as an example of the execution result of the content (1910) displayed in the prism area (821), an example of a driving warning image (1920) due to a decrease in the inter-vehicle distance is displayed in 3D in the corresponding floating area (841).

[0361] Specifically, the processor (850) of the vehicle display device (800) can control the display (810) and the first reflective module (820) to display driving guidance information as content related to vehicle information in the prism area (821).

[0362] In addition, the processor (850) may determine that the importance level of the driving guidance information has changed based on the vehicle status information, and based on this, display the extended driving guidance information in the floating area (841) as an execution result of the content of the prism area (821). To this end, the processor (850) may adjust the 3D plate of the display (810) and the second reflective module (840) so that the extended driving guidance information can be displayed as a 3D image at a location matching the content of the prism area (821).

[0363] Meanwhile, in order to implement that the images displayed in the prism area (821) and the floating area (841) are displayed on the same plane, the processor (850) can drive the rotation control unit (860) so that the 3D plate of the second reflection module (840) rotates as illustrated in FIG. 13.

[0364] For example, as shown in FIG. 19, if the distance between a vehicle and a preceding vehicle (or an obstacle) is determined to be within a standard value and a warning alarm is required, a warning image (1920) may be displayed in a floating area (841) on the same plane as the content (1910) related to the inter-vehicle distance (distance to the obstacle) in the prism area (821).

[0365] Although not shown in detail, as the warning / caution level increases, the 3D plate of the second reflective module (840) can be rotated back and forth to control the second reflective module (840) so that the warning image (1920) moves back and forth relative to the inner space of the housing (801).

[0366] In addition, in an embodiment, the processor (850) may determine that the linkage of each piece of information displayed in the prism area (821) and the floating area (841) has ended. In addition, based on the determination that the linkage has ended, the processor (850) may control the operation of the first and second reflective modules (820, 840) so that the information in the prism area (821) remains displayed while the 3D image in the floating area (841) moves to the boundary between the prism area (821) and the floating area (841) and disappears.

[0367] In this way, the vehicle display device according to an embodiment of the present invention can display information linked to each other in the prism area and the floating area from a single source image so that it appears seamlessly as a single connected screen. Furthermore, the execution result of content displayed in the prism area can also be displayed in the floating area. Furthermore, depending on whether the vehicle's alert / alarm level is increased, information displayed only in the prism area can be expanded and displayed in the floating area, or images can no longer be displayed in the floating area. Accordingly, different screen areas can be used independently, and the user can visually and intuitively determine whether information is linked.

[0368] Below, FIGS. 20 and 21 are example drawings for explaining the prism area and floating area allocated to the driver's seat passenger and the passenger's seat passenger, respectively.

[0369] In an embodiment of the present invention, the vehicle display device (800) can be implemented so that the prism area and floating area corresponding to the driver's seat and the floating area corresponding to the passenger seat are distinguished from each other.

[0370] For example, FIG. 20 includes a prism area (821) and a floating area (841a) for the driver (hereinafter, 'first floating area (841a)') and a common floating area (841b) (hereinafter, 'second floating area (841b)').

[0371] Also, for example, FIG. 21 includes a prism region (821) and a floating region (841c) for an auxiliary passenger (hereinafter, 'third floating region (841c)') and a common floating region (841b) (hereinafter, 'second floating region (841b)').

[0372] Vehicle information (2010), such as information related to the vehicle's status or important driving-related information, can be commonly displayed on the prism area (821) on the upper portion of the housing (801) illustrated in FIGS. 20 and 21. The prism area (821) may be formed only at a location corresponding to the driver's seat, as illustrated, or, although not illustrated, may be formed to extend to the passenger seat. In the latter case, the vehicle information (2010) may be displayed only at a location corresponding to the driver's seat.

[0373] In FIGS. 20 and 21, the first to third floating areas (841a, 841b, 841c) can be formed independently, and different, unlinked contents can be displayed. To this end, if an auxiliary seat passenger is not detected, the processor (850) can activate only the first and second floating areas (841a, 841b), as illustrated in FIG. 20. In addition, if an auxiliary seat passenger is detected, the processor (850) can activate only the second and third floating areas (841b, 841c), or all of the first to third floating areas (841a, 841b, 841c), as illustrated in FIG. 21.

[0374] The first floating area (841a) may display the execution results of vehicle-related content. For example, as illustrated in FIG. 20, warning notification information (2021) indicating low battery / charging may be displayed as a 3D image.

[0375] The second floating area (841b) may display the execution results of common driving-related content. For example, as illustrated in FIGS. 20 and 21 , a navigation screen (2022) guiding a vehicle to a destination may be displayed as a moving 3D image.

[0376] The third floating area (841c) may display entertainment execution results for the passenger seat. For example, as illustrated in FIG. 21, an advertisement screen (2023) provided by a nearby POI based on the vehicle's current location may be displayed as a 3D video image.

[0377] Meanwhile, each piece of information displayed in the prism area (821) and the floating area (841) can be displayed independently without being linked to each other.

[0378] The processor (850) can control the 3D plate of the display (810) and the second reflective module (840) so that the image displayed in the floating area (841) spreads up and down starting from the middle of the floating area, based on the determination that each piece of information displayed in the prism area (821) and the floating area (841) is not linked.

[0379] In another embodiment, the processor (850) may control the 3D plate of the display (810) and the second reflective module (840) so that the displayed image of the floating area (841) moves upward from the bottom of the floating area based on the determination that the information displayed in the prism area (821) and the floating area (841) are not linked.

[0380] In this way, by providing a visual effect in which the image displayed in the floating area (841) starts from a distance from the prism area (821), the user can intuitively see that the information in the prism area (821) and the floating area (841) are not linked to each other.

[0381] Meanwhile, in one embodiment, the prism area (821) of the vehicle display device (800) may be formed such that the prism is layered with a touch sensor / proximity sensor to enable touch input.

[0382] In this case, at least a portion of the prism area (821) and the floating area (841) may be linked based on a touch input to the content displayed in the prism area (821).

[0383] Specifically, the processor (850) can control the display (810) and the first and second reflective modules (820, 840) to display execution results matching the touch input in the corresponding floating area (841) based on a touch input for content displayed in the prism area (821) formed to enable touch input. Now, it can be said that each piece of information displayed in the prism area (821) and the floating area (841) are linked to each other.

[0384] Subsequently, the processor (841) may control the display (810) and the first and second reflective modules (820, 840) so that the execution results displayed in the corresponding floating area (841) are changed or disappear based on the continuous touch input applied to the content displayed in the prism area (821). In the latter case, it can be said that each piece of information displayed in the prism area (821) and the floating area (841) is now unlinked.

[0385] Meanwhile, for driving safety, the operation of some screen areas by the vehicle display device (800) may be restricted. To this end, the formation of the floating area and / or the displayed information may be determined differently based on the driving status of the vehicle.

[0386] While the vehicle is driving in the performance driving mode, the processor (850) of the vehicle display device (800) can control the operation of the display (810) and the first and second reflective modules (820, 840) to display vehicle information in the prism area (821) and to keep the floating area (841) in an inactive state or to locally display only notification information according to the driving situation.

[0387] On the other hand, while the vehicle is stationary or driving in autonomous driving mode, the processor (850) of the vehicle display device (800) can display minimum vehicle information in the prism area (821) and display an execution screen of an entertainment function in the floating area (841).

[0388] Figure 22 is an example drawing that displays the execution result of an entertainment function by expanding it to a floating area based on the driving status of the vehicle.

[0389] In an embodiment, the processor (850) of the vehicle display device (800) may control the second reflection module (840) to limit the display of the floating area based on the driving conditions included in the received vehicle information while displaying information / images having different depth values ​​in the first and second screen areas (821, 841), i.e., the prism area and the floating area.

[0390] For example, if it is determined that the vehicle is driving and not in autonomous driving mode based on the received vehicle information, the vehicle display device (800) may drive the second reflective module (840) to drive the floating area in a limited driving mode that limits the driver's field of view.

[0391] In addition, when the display (810) is driven while the vehicle is stopped or in autonomous driving mode based on vehicle information received by the vehicle display device (800), the processor (850) can adjust the depth values ​​of multiple screen areas so that images to be displayed on the first and second screen areas (821, 841) are seamlessly connected and positioned on the same plane.

[0392] To this end, the processor (850) can control the refraction angle / reflection path of the first reflection module (820) and / or adjust the position of the 3D plate of the second reflection module (820, 840) and / or the light path incident on the user's eyes.

[0393] Referring to FIG. 22, while the vehicle is stopped and the menu content (2210) including vehicle information is displayed in the prism area (821), no information is displayed in the first floating area (841a) and an entertainment screen (2230) may be displayed in the second floating area (841b) as a result of executing the content selected from the menu content (2210) in the prism area (821).

[0394] Also, although not shown, when the vehicle is stopped, the entertainment screen (2230) of the second floating area (841b) may be extended to the first floating area (841a) and displayed according to additional input applied to the menu content (2210) of the prism area (821). That is, while the vehicle is not moving, the entertainment screen / image may also be displayed on the floating area for the driver's seat.

[0395] In this case, the entertainment screen (2230) displayed in the first and second floating areas (841a, 841b) can move in the x, y, and z-axis directions within the housing (801) as illustrated in FIG. 13. In this case, the menu content (2210) of the prism area (821) matching at least one of the first and second floating areas (841a, 841b) can also be correspondingly varied. For example, a content menu related to the entertainment function can be displayed at a location corresponding to the driver's seat in the prism area (821).

[0396] As described above, the vehicle display device and its operating method according to the embodiments of the present invention can selectively or simultaneously perform multiple different display modes with a single display module. For example, real and virtual images can be selectively or simultaneously displayed with a single display. Furthermore, by adjusting the depth of the display based on whether the real and virtual images are linked, it is possible to visually intuit whether information displayed on different types of screens is linked. Specifically, when information linked to a single source image is displayed in a prism region and a floating region, it can be displayed seamlessly as if it were a single, connected screen. Furthermore, the execution results of content displayed in the prism region can be displayed in the floating region. Furthermore, depending on whether the vehicle's alert / alarm level is elevated, information displayed only in the prism region can be expanded to the floating region for display, or images can no longer be displayed in the floating region. Accordingly, by using different screen regions independently or in conjunction with each other, a more diverse user environment and experience can be provided.

[0397] The present invention described above can be implemented as computer-readable code on a medium in which a program is recorded. Computer-readable media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and also include media implemented in the form of carrier waves (e.g., transmission via the Internet). In addition, the computer may include a processor of a vehicle display device (800). Therefore, the above detailed description should not be construed as limiting in all respects, but should be considered as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are intended to be included in the scope of the present invention.

Claims

1. A housing having a recessed inner space formed therein; A display placed on one side of the inner space of the above housing; A communication module that receives vehicle information from the vehicle; and A first reflective module coupled to one side of the display in the inner space and arranged so that graphics emitted from a first area of ​​the display are refracted to form a first screen area; A second reflective module coupled to one side of the first reflective module in the inner space and arranged to emit light in a second area of ​​the display to reflect graphics and form a second screen area; The display is electrically coupled to the first and second reflective modules, and includes a processor for controlling the respective operations, The above processor, When the display is driven, the first and second reflective modules are controlled to display information having different depth values ​​on the first and second screen areas based on the received vehicle information. Vehicle display device.

2. In paragraph 1, The above processor, Determine whether each piece of information to be displayed in the first and second screen areas is linked, and control the first and second reflection modules so that the depth value is changed according to the determination. Vehicle display device.

3. In paragraph 2, The above first screen area is a prism area, The above second screen area is a floating area where a virtual (AR) image is displayed below the prism area, The above processor, Based on the fact that each piece of information to be displayed in the prism area and the floating area is linked to each other, the depth value is adjusted so that each image to be displayed in the prism area and the floating area is located on the same plane through the first and second reflection modules. Vehicle display device.

4. In paragraph 3, Based on the fact that each piece of information to be displayed in the prism area and the floating area is linked to each other, the image to be displayed in the floating area is displayed by moving from top to bottom so as to be seamlessly connected in the prism area. Vehicle display device.

5. In paragraph 3, The above processor, Based on the fact that each piece of information to be displayed in the prism area and the floating area is linked to each other, the display and the first and second reflective modules are controlled so that content related to the vehicle information is displayed in the prism area and the execution result of the content is displayed in the floating area. Vehicle display device.

6. In paragraph 5, Driving guidance information is displayed in the prism area as content related to the vehicle information, Based on the change in the importance level of the above driving guidance information, the driving guidance information expanded in the above floating area is displayed as the execution result. Vehicle display device.

7. In paragraph 5, The above prism area is formed to receive touch input, The above processor, Controlling the display and the first and second reflective modules to display an execution result matching the touch input in a corresponding floating area based on a touch input for content displayed in the prism area. Charang display device.

8. In paragraph 3, When the linkage of each piece of information displayed in the prism area and the floating area is terminated, the image of the prism area continues to be displayed and the image of the floating area moves to the boundary of the prism area and the floating area and disappears. Vehicle display device.

9. In paragraph 3, Based on the fact that each piece of information to be displayed in the prism area and the floating area is not linked to each other, the image of the floating area is displayed by starting from the middle of the floating area and spreading up and down. Vehicle display device.

10. In paragraph 3, Based on the fact that each piece of information to be displayed in the prism area and the floating area is not linked to each other, the image of the floating area is displayed by moving from the bottom to the top of the floating area. Vehicle display device.

11. In paragraph 1, The above processor, When the display is driven while the vehicle is stopped or in autonomous driving mode based on the received vehicle information, the depth value is adjusted so that the images to be displayed on the first and second screen areas are seamlessly connected and located on the same plane. Vehicle display device.

12. In paragraph 1, The above processor, Based on the importance of the vehicle information, the first and second reflective modules are controlled to selectively display information with different depth values ​​in the first and second screen areas, respectively. Vehicle display device.

13. In paragraph 1, The above processor, While displaying information with different depth values ​​in the first and second screen areas, the operation of the second reflective module is controlled to limit the display in the second screen area based on the driving situation included in the vehicle information. Vehicle display device.

Images