Vehicle display device and method of operating the same
By using multiple reflection modules and processor control in the vehicle display device to generate multiple screens with different depth values, the problem of insufficient user experience in the prior art is solved, flexible multi-mode display and information association are realized, and the user experience is improved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2024-09-10
- Publication Date
- 2026-05-01
AI Technical Summary
Existing vehicle display devices are unable to provide a variety of usage environments and user experiences, cannot flexibly adjust the position of 3D graphics according to the user's viewing angle and content type, and lack sufficient correlation between information on different screens.
By using different reflection modules on a single display to refract or reflect patterns, multiple screens with different depth values can be generated. The processor controls the reflection modules to adjust the depth values and information correlation, thus achieving multiple display modes.
It enables seamless switching and information association between different types of screens on the same display, enhancing the user experience and immersion, and providing more diverse user environments and interaction methods.
Smart Images

Figure CN121970102A_ABST
Abstract
Description
Vehicle display device and its operation method Technical Field
[0001] The present invention relates to a vehicle display device, and more particularly, to a vehicle display device implemented by forming a plurality of screens using graphics emitted from a display module. Background Technology
[0002] A vehicle is a device that moves in the direction desired by the user. A typical example is a car.
[0003] On the other hand, there is a trend towards installing various sensors and electronic devices to enhance the convenience of vehicle users. In particular, research on Advanced Driver Assistance Systems (ADAS) is actively underway to improve driving convenience. Furthermore, the development of autonomous vehicles is also progressing rapidly.
[0004] Autonomous driving refers to a system in which a vehicle can make its own judgments and drive itself. This autonomous driving can be divided into progressive stages, from non-automatic to fully automated, based on the degree of system involvement and the degree of driver control.
[0005] Autonomous driving has transformed our perception of vehicles, moving them beyond simple mobile devices to become stations or spaces. Furthermore, installing large-screen displays in vehicles is becoming a trend, allowing users to freely enjoy various infotainment features as the vehicle moves autonomously. Moreover, research and development are underway to provide more diverse usage environments for these displays. Summary of the Invention
[0006] The problem that the invention aims to solve
[0007] The purpose of this invention is to solve the aforementioned problems and other issues.
[0008] According to some embodiments of the present invention, one object is to provide a vehicle display device and a method of operation thereof capable of providing a plurality of usage environments from a single display.
[0009] In addition, according to some embodiments of the present invention, one object is to provide a vehicle display device and a method thereof that can selectively or multiple times utilize different types of usage environments formed by a single display.
[0010] In addition, according to some embodiments of the present invention, one objective is to provide a vehicle display device and its operation method that can change the floating position of 3D graphics according to the user's viewing angle, content type, and movement.
[0011] In addition, according to some embodiments of the present invention, one objective is to provide a vehicle display device and its operation method that can visually and directly confirm whether a plurality of pieces of information displayed on screens of different types are related.
[0012] In addition, according to some embodiments of the present invention, one object is to provide a vehicle display device and its operation method that can use different screen areas independently or in combination to provide various user environments and user experiences.
[0013] Technical solutions to the problem
[0014] Therefore, the vehicle display device of this invention refracts or reflects the image emitted from a display through different reflection modules, thereby generating a plurality of screens with different depth values.
[0015] Specifically, the vehicle display device of this invention includes: a housing having a recessed inner space formed therein; a display disposed on one side of the inner space of the housing; a communication module for receiving vehicle information from a vehicle; a first reflection module configured to be combined with the inner space on one side of the display, causing an image emitted from a first area of the display to be refracted and form a first screen area; a second reflection module configured to be combined with the inner space on one side of the first reflection module, causing an image emitted from a second area of the display to be reflected and form a second screen area; and a processor electrically coupled to the display, the first reflection module, and the second reflection module, controlling the operation of each of the display, the first reflection module, and the second reflection module. Furthermore, the processor controls the first reflection module and the second reflection module to display information in the first screen area and the second screen area at different depth values based on the received vehicle information when the display is driven.
[0016] In one embodiment, the processor can determine whether the information to be displayed in the first screen area and the second screen area is associated or not, and control the first reflection module and the second reflection module according to the determination to change the depth value.
[0017] In this embodiment, the first screen area is a prism area, and the second screen area is a floating area below the prism area displaying a virtual reality (AR) image. Furthermore, the processor can adjust the depth value via the first and second reflection modules based on the correlation between various information to be displayed in the prism area and the floating area, ensuring that the images to be displayed in the prism area and the floating area are on the same plane.
[0018] In one embodiment, based on the correlation between various pieces of information to be displayed in the prism region and the floating region, the image to be displayed in the floating region can be moved from top to bottom to seamlessly connect with the prism region.
[0019] In one embodiment, the processor can control the display, the first reflection module, and the second reflection module to correlate the various pieces of information to be displayed in the prism area and the floating area, so as to display content related to the vehicle information in the prism area and the execution result of the content in the floating area.
[0020] In one embodiment, driving guidance information, which is related to the vehicle information, can be displayed in the prism area; based on changes in the importance level of the driving guidance information, expanded driving guidance information can be displayed as the execution result in the floating area.
[0021] In one embodiment, the prism region may be configured to receive touch input; the processor may control the display, the first reflection module, and the second reflection module based on the touch input to the content displayed in the prism region, so as to display the execution result matching the touch input in the corresponding floating area.
[0022] In an embodiment, when the association of the various information displayed in the prism region and the floating region ends, the image in the prism region can continue to be displayed, and the image in the floating region can move toward the boundary between the prism region and the floating region and disappear.
[0023] In one embodiment, since the information to be displayed in the prism region and the floating region is not related to each other, the image in the floating region can be displayed by unfolding vertically from the middle of the floating region.
[0024] In one embodiment, since the information to be displayed in the prism region and the floating region is not related to each other, the image in the floating region can be moved from the bottom to the top of the floating region for display.
[0025] In an embodiment, the processor can adjust the depth value based on the received vehicle information when the display is driven in a stopped or autonomous driving mode, so that the images to be displayed in the first screen area and the second screen area are seamlessly connected and located on the same surface.
[0026] In one embodiment, the processor can control the first reflection module and the second reflection module according to the importance of the vehicle information, so as to selectively display information with different depth values in the first screen area and the second screen area respectively.
[0027] In one embodiment, while the processor displays information with different depth values in the first screen area and the second screen area, it can control the driving of the second reflection module based on the driving conditions contained in the vehicle information to limit the display in the second screen area.
[0028] Invention Effects
[0029] According to embodiments of the present invention, a vehicle display device can selectively or simultaneously execute a plurality of display modes that are different from each other by a single display module. For example, it can selectively or simultaneously display real images and virtual images by a single display.
[0030] Furthermore, according to the vehicle display device of the present invention, the position of the 3D virtual image that floats with the type of content or moves is changed according to the user's field of vision, thereby enabling the graphic image to be displayed in a way that matches the user's field of vision, maximizing the sense of immersion and the floating effect.
[0031] Furthermore, the vehicle display device according to embodiments of the present invention can adjust the sense of depth and display based on whether real and virtual images are related to each other, thereby enabling direct visual confirmation of whether multiple pieces of information displayed on screens of different types are related.
[0032] Specifically, the vehicle display device of this invention can be displayed seamlessly like a connected screen when displaying related information from a source image in a prism area and a floating area. Additionally, the execution result of the content displayed in the prism area can also be displayed in the floating area. Furthermore, depending on whether the vehicle's attention / alarm level is increased, information displayed only in the prism area can be expanded to the floating area, or the image can no longer be displayed in the floating area. Thus, different screen areas can be used independently or in conjunction, providing a more diverse user environment and user experience. Attached Figure Description
[0033] Figures 1 and 2 are example block diagrams illustrating the configuration of a vehicle related to the present invention.
[0034] Figure 3 is an example diagram showing the configuration of a vehicle display device according to the present invention installed in and driven in a vehicle.
[0035] Figure 4 is an example block diagram illustrating the detailed configuration of the vehicle display device of the present invention.
[0036] Figure 5 is a side sectional view of the vehicle display device of the present invention.
[0037] Figure 6 is a side view of the shape of the driving-forming prism display area and the floating display area of the vehicle display device according to the present invention.
[0038] Figure 7 is an example diagram illustrating a plurality of display areas for explaining the display mode of the vehicle display device according to the present invention.
[0039] Figure 8 is a side view of a vehicle display device configured in the dashboard / CID area of a vehicle according to the present invention.
[0040] Figure 9 is an example flowchart illustrating the operation method of the vehicle display device according to the present invention.
[0041] Figures 10, 11 and 12 are various examples of a vehicle display device that implements a plurality of display modes using a single display according to the present invention.
[0042] Figure 13 is a conceptual diagram illustrating a method for changing the position of an AR image in a floating area in a vehicle display device according to the present invention.
[0043] Figures 14 and 15 are diagrams illustrating how information from the prism region is expanded into the floating region or information from the floating region is reduced to the prism region according to embodiments of the present invention.
[0044] Figure 16 is a diagram illustrating an example of how vehicle navigation information is associated with and displayed in relation to a prism area and a floating area according to an embodiment of the present invention.
[0045] Figures 17 and 18 are example diagrams showing warning information expanded to a floating area according to the warning level corresponding to the sensed vehicle speed in an embodiment of the present invention.
[0046] Figure 19 is an example diagram of a warning message that expands to a floating area based on the vehicle's inter-vehicle distance in an embodiment of the present invention.
[0047] Figures 20 and 21 are example diagrams illustrating the prism regions and floating regions respectively assigned to the driver's seat passenger and the front passenger in embodiments of the present invention.
[0048] Figure 22 is an example diagram in which the execution result of the entertainment function is expanded and displayed in a floating area based on the vehicle's driving state in an embodiment of the present invention. Detailed Implementation
[0049] The embodiments disclosed in this specification will be described in detail below with reference to the accompanying drawings. Here, identical or similar constituent elements are given the same reference numerals regardless of the drawing numbers, and repeated descriptions of them will be omitted. The suffixes "module" and "part" used for constituent elements in the following description are assigned or used interchangeably only for ease of writing and do not inherently have a distinguishing meaning or function. Furthermore, in the process of describing the embodiments disclosed in this specification, if it is determined that a detailed description of related well-known technologies would obscure the essence of the embodiments disclosed in this specification, a detailed description of those technologies will be omitted. Moreover, the accompanying drawings are only for ease of understanding of the embodiments disclosed in this specification and should not be used to limit the technical ideas disclosed in this specification. Rather, they should be understood to cover all modifications, equivalents, and even substitutions included within the scope of the invention's ideas and techniques.
[0050] The terms "first," "second," etc., which contain ordinal numbers, can be used to describe various constituent elements, but the constituent elements are not limited by the terms. The terms are used only for the purpose of distinguishing one constituent element from other constituent elements.
[0051] When a component is mentioned as being "connected" or "coupled" to another component, it may mean that it is directly connected or coupled to the other component, but it can also be understood as meaning that there are other components between them. Conversely, when a component is mentioned as being "directly connected" or "directly coupled" to another component, it should be understood as meaning that there are no other components between them.
[0052] Unless the context clearly indicates otherwise, the singular form should include the plural form.
[0053] In this application, terms such as “comprising” or “having” are used only to specify the presence of features, figures, steps, operations, constituent elements, components or combinations thereof described in the specification, and are not intended to preclude the possibility of the presence or addition of one or more other features or figures, steps, operations, constituent elements, components or combinations thereof.
[0054] Figures 1 and 2 are example block diagrams illustrating the vehicle and its configuration in relation to the present invention.
[0055] Referring to FIG1, the vehicle 100 may include: wheels, which are rotated by a power source; and a steering input device 510 for adjusting the direction of travel of the vehicle 100.
[0056] Vehicle 100 may be an autonomous vehicle. Vehicle 100 may switch to autonomous driving mode or manual mode based on user input. For example, vehicle 100 may switch from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on user input received through user interface device (hereinafter referred to as "user terminal") 200.
[0057] Vehicle 100 can switch between autonomous driving mode and manual mode based on driving condition information. The driving condition information can be generated based on object information provided by object detection device 300. For example, vehicle 100 can switch from manual mode to autonomous driving mode or vice versa based on driving condition information generated in object detection device 300. Alternatively, vehicle 100 can switch from manual mode to autonomous driving mode or vice versa based on driving condition information received via communication device 400.
[0058] Vehicle 100 can switch from manual mode to autonomous driving mode or vice versa based on information, data and signals provided by external devices.
[0059] When vehicle 100 is operating in autonomous mode, autonomous vehicle 100 can operate based on operating system 700. For example, autonomous vehicle 100 can operate based on information, data, or signals generated in driving system 710, vehicle dispatch system 740, and parking system 750.
[0060] When the vehicle 100 is operating in manual mode, the autonomous vehicle 100 can receive user input for driving via the driving control device 500. Based on the user input received via the driving control device 500, the vehicle 100 can operate.
[0061] The vehicle 100 may include a user interface device 200, an object detection device 300, a communication device 400, a driving operation device 500, a vehicle drive device 600, a running system 700, a navigation system 770, a sensing unit 120, a vehicle interface unit 130, a memory 140, a control unit 170, and a power supply unit 190.
[0062] According to the embodiments, the vehicle 100 may include other constituent elements in addition to those described in this specification, or may exclude some of the constituent elements described.
[0063] User interface device 200 is a device for communication between vehicle 100 and user. User interface device 200 receives user input and can provide information generated in vehicle 100 to user. Vehicle 100 can implement UI (User Interfaces) or UX (User Experience) through user interface device (hereinafter, may be referred to as "user terminal") 200.
[0064] User interface device 200 may include an input unit 210, an internal camera 220, a biometric sensor 230, an output unit 250, and a processor 270. According to an embodiment, user interface device 200 may include other components besides those described, or may exclude some of the described components.
[0065] The input unit 210 is used to receive information from the user. The data collected in the input unit 210 is analyzed by the processor 270 and can be processed into the user's control commands.
[0066] The input unit 210 can be configured inside the vehicle. For example, the input unit 210 can be configured in an area of the steering wheel, an area of the instrument panel, an area of the seat, an area of each pillar, an area of the door, an area of the center console, an area of the headlining, an area of the sun visor, an area of the windshield, or an area of the window, etc.
[0067] The input unit 210 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.
[0068] The voice input unit 211 can convert the user's voice input into an electrical signal. The converted electrical signal can be provided to the processor 270 or the control unit 170. The voice input unit 211 may include one or more microphones.
[0069] The gesture input unit 212 can convert the user's gesture input into an electrical signal. The converted electrical signal can be provided to the processor 270 or the control unit 170.
[0070] The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for sensing user gesture input. According to an embodiment, the gesture input unit 212 can sense three-dimensional gesture input from the user. For this purpose, the gesture input unit 212 may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.
[0071] The gesture input unit 212 can sense the user's three-dimensional gesture input through TOF (Time of Flight), structured light, or disparity methods.
[0072] The touch input unit 213 can convert the user's touch input into electrical signals. The converted electrical signals can be provided to the processor 270 or the control unit 170.
[0073] The touch input unit 213 may include a touch sensor for sensing user touch input. According to an embodiment, the touch input unit 213 is integrally formed with the display unit 251, thereby realizing a touchscreen. This touchscreen can together provide an input interface and an output interface between the vehicle 100 and the user.
[0074] The mechanical input unit 214 may include at least one of a button, a dome switch, a roller, and a roller switch. The electrical signal generated by the mechanical input unit 214 can be provided to the processor 270 or the control unit 170. The mechanical input unit 214 may be configured in the steering wheel, central instrument panel, center console, cockpit module, door, etc.
[0075] The interior camera 220 can acquire images of the vehicle's interior. The processor 270 can sense the user's state based on the images of the vehicle's interior. The processor 270 can acquire the user's gaze information from the images of the vehicle's interior. The processor 270 can sense the user's gestures from the images of the vehicle's interior.
[0076] The biometric sensing unit 230 can acquire a user's biometric information. The biometric sensing unit 230 includes a sensor capable of acquiring a user's biometric information, such as fingerprint information and heart rate information. This biometric information can be used for user authentication.
[0077] The output unit 250 is used to generate outputs related to vision, hearing, or touch. The output unit 250 may include at least one of a display unit, a sound output unit 252, and a tactile output unit 253.
[0078] On the other hand, the display unit may refer to the vehicle display device 800 of the present invention or a plurality of displays thereof. Alternatively, the vehicle display device 800 of the embodiments of the present invention may also be included as one of the display units.
[0079] Furthermore, on the other hand, the user interface device 200 can be understood as having the same concept as the vehicle display device 800 of the present invention. In this case, at least a portion of the plurality of constituent elements included in the user interface device 200 of FIG. 1 and the plurality of constituent elements of the vehicle display device 800 of FIG. 3 can be understood as having the same concept.
[0080] The display unit can display graphic objects corresponding to various information. The display unit may include at least one of liquid crystal display (LCD), thin film transistor-liquid crystal display (TFTLCD), organic light-emitting diode (OLED), flexible display, 3D display, and e-ink display.
[0081] The display unit and the touch input unit 213 can be formed into a layer structure or integrally formed, thereby realizing a touch screen.
[0082] The display unit can be implemented using a HUD (Head-Up Display). When the display unit is implemented using a HUD, it has a transmission module that can output information through images transmitted to the windshield or window.
[0083] The display unit may include a transparent display. The transparent display may be attached to a windshield or window. The transparent display has a specified transparency level and can display a specified image. To achieve transparency, the transparent display may include at least one of the following: transparent TFEL (Thin Film Electroluminescent), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, and transparent LED (Light Emitting Diode) display. The transparency of the transparent display is adjustable.
[0084] On the other hand, the user interface device 200 may include a plurality of display units. In this case, the plurality of display units may be located in various areas within the vehicle.
[0085] The sound output unit 252 converts the electrical signals provided by the processor 270 or the control unit 170 into audio signals and outputs them. For this purpose, the sound output unit 252 may include more than one speaker.
[0086] The tactile output unit 253 generates tactile output. For example, the tactile output unit 253 can make the user recognize the output by causing the steering wheel, seat belt, or seat to vibrate.
[0087] The processor (hereinafter referred to as the "control unit") 270 can control the overall operation of each unit of the user interface device 200. That is, the user interface device 200 can operate according to the control of the control unit 170.
[0088] According to an embodiment, the user interface device 200 may include a plurality of processors 270, or may not include processors 270.
[0089] If the user interface device 200 does not include the processor 270, the user interface device 200 can operate according to the control of the processor or control unit 170 of other devices in the vehicle 100.
[0090] The object detection device 300 is a device for detecting objects located outside the vehicle 100. Objects can be various objects related to the operation of the vehicle 100. For example, objects may include lanes, other vehicles, pedestrians, two-wheeled vehicles, traffic signals, lights, roads, structures, speed bumps, terrain features, animals, etc.
[0091] On the other hand, objects can be classified into moving objects and stationary objects. For example, moving objects can include concepts such as other vehicles and pedestrians. Stationary objects can include concepts such as traffic signals, roads, and structures.
[0092] The object detection device 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.
[0093] According to the embodiments, the object detection device 300 may include other components in addition to the components described, or may exclude some of the components described.
[0094] To acquire images of the vehicle's exterior, camera 310 can be positioned appropriately outside the vehicle. Camera 310 can be a single camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360-degree camera.
[0095] For example, to acquire an image of the area in front of the vehicle, camera 310 can be positioned inside the vehicle near the windshield. Alternatively, camera 310 can be positioned around the front bumper or radiator grille.
[0096] For example, to acquire an image of the area behind the vehicle, camera 310 can be positioned inside the vehicle near the rear window. Alternatively, camera 310 can be positioned around the rear bumper, trunk, or tailgate.
[0097] For example, to acquire images of the side of the vehicle, camera 310 can be positioned inside the vehicle near at least one side window. Alternatively, camera 310 can be positioned around a rearview mirror, fender, or door.
[0098] The camera 310 can provide the acquired images to the processor 370.
[0099] Radar 320 may include an electromagnetic wave transmitter and a receiver. Based on the principle of radio wave transmission, radar 320 can be implemented as either a pulse radar or a continuous wave radar. In the continuous wave radar mode, radar 320 can be implemented using either FMCW (Frequency Modulated Continuous Wave) or FSK (Frequency Shift Keying) modes, depending on the signal waveform.
[0100] Radar 320 can detect objects using electromagnetic waves as a medium, based on TOF (Time of Flight) or phase-shift methods. It can detect the position of the detected object, the distance between the detected objects, and the relative speed.
[0101] To sense objects located in front of, behind, or to the side of the vehicle, the radar 320 can be configured at an appropriate location on the exterior of the vehicle.
[0102] The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented in a TOF (Time of Flight) mode or a phase-shift mode.
[0103] The LiDAR 330 can be implemented as either driven or non-driven.
[0104] When implemented as a driven system, the lidar 330 is rotated by a motor and can detect objects around the vehicle 100.
[0105] When implemented as a non-driven system, the lidar 330 can utilize optical steering to detect objects within a defined range relative to the vehicle 100. The vehicle 100 may include a plurality of non-driven lidars 330.
[0106] The LiDAR 330 can use laser as the light medium to detect objects based on TOF (Time of Flight) or phase-shift methods. It can detect the position of the detected object, the distance between the detected objects, and the relative speed.
[0107] To sense objects located in front of, behind, or to the side of the vehicle, the LiDAR 330 can be configured at an appropriate location on the exterior of the vehicle.
[0108] The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. Based on the ultrasonic detection object, the ultrasonic sensor 340 can detect the position of the detected object, the distance between the ultrasonic sensor and the detected object, and the relative speed.
[0109] To sense objects located in front of, behind, or to the side of the vehicle, the ultrasonic sensor 340 can be configured at an appropriate location on the exterior of the vehicle.
[0110] The infrared sensor 350 may include an infrared transmitter and a receiver. Based on infrared light, the infrared sensor 350 detects objects and can detect the position of the detected object, the distance between the two objects, and their relative speed.
[0111] In order to sense objects located in front of, behind or to the side of the vehicle, the infrared sensor 350 can be configured at an appropriate location on the exterior of the vehicle.
[0112] The processor 370 can control the overall operation of each unit of the object detection device 300.
[0113] Processor 370 can detect and track objects based on acquired images. Processor 370 can perform actions such as distance calculation and relative velocity calculation between itself and objects using image processing algorithms.
[0114] Processor 370 can detect and track objects based on reflected electromagnetic waves returned by the object after the transmitted electromagnetic waves are reflected. Processor 370 can perform actions such as distance calculation and relative velocity calculation between itself and the object based on the electromagnetic waves.
[0115] Processor 370 can detect and track objects based on the reflected laser light returned by the object after the emitted laser light is reflected back. Processor 370 can perform actions such as distance calculation and relative speed calculation between itself and the object based on the laser light.
[0116] Processor 370 can detect and track objects based on reflected ultrasonic waves that are reflected back from the object after being emitted. Processor 370 can perform actions such as distance calculation and relative speed calculation between itself and the object based on the ultrasonic waves.
[0117] Processor 370 can detect and track objects based on reflected infrared light returned by the object after the emitted infrared light is reflected. Processor 370 can perform actions such as distance calculation and relative speed calculation between itself and the object based on the infrared light.
[0118] According to an embodiment, the object detection device 300 may include a plurality of processors 370 or may not include processors 370. For example, the camera 310, radar 320, lidar 330, ultrasonic sensor 340, and infrared sensor 350 may each include a processor.
[0119] In the absence of a processor 370, the object detection device 300 can operate according to the control of a processor or control unit 170 within the vehicle 100.
[0120] The object detection device 300 can operate according to the control of the control unit 170.
[0121] The communication device 400 is a device for performing communication with external devices. Here, the external device may be another vehicle, a mobile terminal, or a server.
[0122] In order to perform communication, the communication device 400 may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element.
[0123] The communication device 400 may include a short-range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transceiver unit 450, and a processor 470.
[0124] According to the embodiments, the communication device 400 may include other components in addition to the components described, or may exclude some of the components described.
[0125] The short-range communication unit 410 is a unit for short-range communication. The short-range communication unit 410 can support short-range communication using at least one of the following technologies: Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus).
[0126] The short-range communication unit 410 can perform short-range communication between the vehicle 100 and at least one external device by forming a short-range wireless area network.
[0127] The location information unit 420 is a unit used to acquire the location information of the vehicle 100. For example, the location information unit 420 may include a GPS (Global Positioning System) module or a DGPS (Differential Global Positioning System) module.
[0128] The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), other vehicles (V2V: Vehicle to Vehicle), or pedestrians (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include RF circuitry capable of implementing V2I communication protocols with infrastructure, V2V communication protocols with vehicles, and V2P communication protocols with pedestrians.
[0129] The optical communication unit 440 is a unit for communicating with external devices using light as a medium. The optical communication unit 440 may include: an optical transmitting unit that converts electrical signals into optical signals and transmits them to the outside; and an optical receiving unit that converts received optical signals into electrical signals.
[0130] According to an embodiment, the light transmitting unit may be integrally formed with a lamp included in the vehicle 100.
[0131] The broadcast transceiver unit 450 is a unit used to receive broadcast signals from an external broadcast management server or to send broadcast signals to the broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel. The broadcast signal may include TV broadcast signals, wireless broadcast signals, and data broadcast signals.
[0132] The processor 470 can control the overall operation of each unit of the communication device 400.
[0133] According to an embodiment, the communication device 400 may include a plurality of processors 470, or may not include processors 470.
[0134] If the communication device 400 does not include the processor 470, the communication device 400 can operate according to the control of the processor or control unit 170 of other devices in the vehicle 100.
[0135] On the other hand, the communication device 400 can be used together with the user interface device 200 to implement a vehicle display device. In this case, the vehicle display device can be named a telematics device or an AVN (Audio Video Navigation) device.
[0136] The communication device 400 can operate under the control of the control unit 170.
[0137] The driving control device 500 is a device that receives user input for driving.
[0138] In manual mode, vehicle 100 can operate based on signals provided by driving control device 500.
[0139] The driving control device 500 may include a steering input device 510, an acceleration input device 530, and a braking input device 570.
[0140] The steering input device 510 can receive the driving direction input of the vehicle 100 from the user. The steering input device 510 is preferably configured as a wheel to enable steering input by rotation. According to an embodiment, the steering input device may also be configured as a touch screen, touchpad, or button.
[0141] The accelerator input device 530 can receive input from the user for accelerating the vehicle 100. The brake input device 570 can receive input from the user for decelerating the vehicle 100. The accelerator input device 530 and the brake input device 570 are preferably configured as pedals. According to an embodiment, the accelerator input device or the brake input device may also be configured as a touchscreen, touchpad, or button.
[0142] The driving control device 500 can operate according to the control unit 170.
[0143] The vehicle drive unit 600 is a device that drives various devices within the electrically controlled vehicle 100.
[0144] The vehicle drive unit 600 may include a power transmission drive unit 610, a chassis drive unit 620, a door / window drive unit 630, a safety device drive unit 640, a light drive unit 650, and an air conditioning drive unit 660.
[0145] According to the embodiments, the vehicle drive unit 600 may include other components in addition to the components described, or may exclude some of the components described.
[0146] On the other hand, the vehicle drive unit 600 may include a processor. Each of the various units of the vehicle drive unit 600 may individually include a processor.
[0147] The power transmission drive unit 610 can control the operation of the power transmission device.
[0148] The power transmission drive unit 610 may include a power source drive unit 611 and a transmission drive unit 612.
[0149] The power source drive unit 611 can control the power source of the vehicle 100.
[0150] For example, when a fossil fuel-based engine is used as the power source, the power source drive unit 610 can perform electronic control of the engine. This allows for control of the engine's output torque, etc. The power source drive unit 611 can adjust the engine's output torque according to the control unit 170.
[0151] For example, when the power source is an electric motor, the power source drive unit 610 can control the motor. The power source drive unit 610 can adjust the motor's speed, torque, etc., according to the control unit 170.
[0152] The transmission drive unit 612 can control the transmission. The transmission drive unit 612 can adjust the state of the transmission. The transmission drive unit 612 can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or park (P).
[0153] On the other hand, when the engine is the power source, the transmission drive unit 612 can adjust the gear engagement state in the forward D state.
[0154] The chassis drive unit 620 can control the movement of the chassis assembly. The chassis drive unit 620 may include a steering drive unit 621, a braking drive unit 622, and a suspension drive unit 623.
[0155] The steering drive unit 621 can electronically control the steering apparatus within the vehicle 100. The steering drive unit 621 can change the direction of travel of the vehicle.
[0156] The brake drive unit 622 can perform electronic control of the brake apparatus within the vehicle 100. For example, the speed of the vehicle 100 can be reduced by controlling the operation of the brakes located on the wheels.
[0157] On the other hand, the brake drive unit 622 can control each of the plurality of brakes individually. The brake drive unit 622 can control the braking force applied to the plurality of wheels differently from each other.
[0158] The suspension drive unit 623 can perform electronic control of the suspension apparatus within the vehicle 100. For example, when the road surface is curved, the suspension drive unit 623 can reduce the vibration of the vehicle 100 by controlling the suspension apparatus. On the other hand, the suspension drive unit 623 can control each of the plurality of suspensions individually.
[0159] The door / window drive unit 630 can perform electronic control of the door apparatus or window apparatus inside the vehicle 100.
[0160] The door / window drive unit 630 may include a door drive unit 631 and a window drive unit 632.
[0161] The door drive unit 631 can control the door assembly. The door drive unit 631 can control the opening and closing of a plurality of doors included in the vehicle 100. The door drive unit 631 can control the opening and closing of the trunk or tailgate. The door drive unit 631 can control the opening and closing of the sunroof.
[0162] The window drive unit 632 can perform electronic control of the window apparatus. It can control the opening or closing of a plurality of windows, including those in the vehicle 100.
[0163] The safety device drive unit 640 can perform electronic control of various safety devices within the vehicle 100.
[0164] The safety device drive unit 640 may include an airbag drive unit 641, a seat belt drive unit 642, and a pedestrian protection device drive unit 643.
[0165] The airbag actuator 641 can electronically control the airbag apparatus within the vehicle 100. For example, the airbag actuator 641 can be controlled to deploy the airbag when a hazard is sensed.
[0166] The seatbelt drive unit 642 can electronically control the seatbelt apparatus within the vehicle 100. For example, the seatbelt drive unit 642 can be controlled to secure the passenger to the seat 110FL, 110FR, 110RL, or 110RR using the seatbelt when a hazard is detected.
[0167] The pedestrian protection device drive unit 643 can electronically control the hood lift and the pedestrian airbag. For example, the pedestrian protection device drive unit 643 can be controlled to raise the hood lift and deploy the pedestrian airbag when a collision with a pedestrian is detected.
[0168] The lamp drive unit 650 can perform electronic control of various lamp apparatuses within the vehicle 100.
[0169] The air conditioning drive unit 660 can electronically control the air conditioning unit inside the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning drive unit 660 can control the air conditioning unit to operate and supply cool air to the vehicle interior.
[0170] The vehicle drive unit 600 may include a processor. Each of the various units of the vehicle drive unit 600 may individually include a processor.
[0171] The vehicle drive unit 600 can operate under the control of the control unit 170.
[0172] The operating system 700 is a system that controls various operations of the vehicle 100. The operating system 700 can operate in automatic driving mode.
[0173] The operating system 700 may include a driving system 710, a vehicle dispatch system 740, and a parking system 750.
[0174] According to the embodiments, the operating system 700 may include other components in addition to the components described, or may exclude some of the components described.
[0175] On the other hand, the operating system 700 may include a processor. Each of the various units in the operating system 700 may individually include a processor.
[0176] On the other hand, according to the embodiment, when the operating system 700 is implemented by software, it may also be a subordinate concept of the control unit 170.
[0177] On the other hand, according to an embodiment, the operating system 700 may be a concept including at least one of a user interface device 200, an object detection device 300, a communication device 400, a vehicle drive device 600, and a control unit 170.
[0178] The driving system 710 can control the driving of vehicle 100.
[0179] The driving system 710 can receive navigation information from the navigation system 770 and provide control signals to the vehicle drive unit 600, thereby enabling the driving of the vehicle 100. The driving system 710 can also receive object information from the object detection device 300 and provide control signals to the vehicle drive unit 600, thereby enabling the driving of the vehicle 100. Furthermore, the driving system 710 can receive signals from external devices via the communication device 400 and provide control signals to the vehicle drive unit 600, thereby enabling the driving of the vehicle 100.
[0180] The vehicle dispatch system 740 can dispatch vehicle 100.
[0181] The vehicle dispatch system 740 can receive navigation information from the navigation system 770 and provide control signals to the vehicle drive unit 600, thereby enabling the dispatch of vehicle 100. The vehicle dispatch system 740 can also receive object information from the object detection device 300 and provide control signals to the vehicle drive unit 600, thereby enabling the dispatch of vehicle 100. Furthermore, the vehicle dispatch system 740 can receive signals from external devices via the communication device 400 and provide control signals to the vehicle drive unit 600, thereby enabling the dispatch of vehicle 100.
[0182] Parking system 750 can park 100 vehicles.
[0183] The parking system 750 can receive navigation information from the navigation system 770 and provide control signals to the vehicle drive unit 600, thereby enabling the parking of the vehicle 100. The parking system 750 can also receive object information from the object detection device 300 and provide control signals to the vehicle drive unit 600, thereby enabling the parking of the vehicle 100. Furthermore, the parking system 750 can receive signals from external devices via the communication device 400 and provide control signals to the vehicle drive unit 600, thereby enabling the parking of the vehicle 100.
[0184] The navigation system 770 can provide navigation information. The navigation information may include at least one of the following: map information, set destination information, route information set based on the destination, information on various objects on the route, lane information, and the vehicle's current location information.
[0185] The navigation system 770 may include a memory and a processor. The memory can store navigation information. The processor can control the operation of the navigation system 770.
[0186] According to an embodiment, the navigation system 770 can receive information from an external device via the communication device 400 and can update pre-stored information.
[0187] According to the embodiments, the navigation system 770 can also be classified as a subordinate component of the user interface device 200.
[0188] The sensing unit 120 can sense the state of the vehicle. The sensing unit 120 may include attitude sensors (e.g., yaw sensor, roll sensor, pitch sensor), collision sensors, wheel sensors, speed sensors, tilt sensors, weight sensors, heading sensors, yaw sensors, gyro sensors, position modules, vehicle forward / reverse sensors, battery sensors, fuel sensors, tire sensors, steering sensors based on steering wheel rotation, vehicle interior temperature sensors, vehicle interior humidity sensors, ultrasonic sensors, illuminance sensors, accelerator pedal position sensors, brake pedal position sensors, etc.
[0189] The sensing unit 120 can acquire sensing signals such as vehicle posture information, vehicle collision information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / reverse information, battery information, fuel information, tire information, vehicle light information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illuminance, pressure applied to the accelerator pedal, and pressure applied to the brake pedal.
[0190] In addition, the sensing unit 120 may also include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a coolant temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.
[0191] The vehicle interface unit 130 can function as a conduit for various types of external devices connected to the vehicle 100. For example, the vehicle interface unit 130 may have a port capable of connecting to a mobile terminal, through which data can be exchanged. In this case, the vehicle interface unit 130 can exchange data with the mobile terminal.
[0192] On the other hand, the vehicle interface unit 130 can function as a channel for supplying power to the connected mobile terminal. When the mobile terminal is electrically connected to the vehicle interface unit 130, the vehicle interface unit 130 can supply power from the power supply unit 190 to the mobile terminal under the control of the control unit 170.
[0193] The memory 140 is electrically connected to the control unit 170. The memory 140 can store basic data of the unit, control data for the unit's operation control, and input / output data. In terms of hardware, the memory 140 can be various storage devices such as ROM, RAM, EPROM, flash memory drive, and hard disk drive. The memory 140 can store various data related to the overall operation of the vehicle 100, such as programs for processing or controlling the control unit 170.
[0194] According to an embodiment, the memory 140 may be integrally formed with the control unit 170, or may be implemented by a lower-level component of the control unit 170.
[0195] The control unit 170 can control the overall operation of various units within the vehicle 100. The control unit 170 can be named ECU (Electronic Control Unit).
[0196] The power supply unit 190 can supply the power required for the operation of each component according to the control of the control unit 170. In particular, the power supply unit 190 can receive power from the battery or the like inside the vehicle.
[0197] The vehicle 100 may include one or more processors and control units 170 that can be implemented using at least one of ASICs (application-specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field-programmable gate arrays), processors, controllers, microcontrollers, microprocessors, and electrical units for performing other functions.
[0198] On the other hand, the vehicle display device 800 of the present invention can utilize a single display module to form virtual and real images in a plurality of screen areas of different types. Furthermore, by combining a plurality of screen areas, a single display module can provide the effect of multiple displays.
[0199] Figure 3 is an example diagram showing the configuration of the vehicle display device 800 according to the present invention installed in a vehicle and driven.
[0200] The vehicle display device 800 can be configured to correspond to the dashboard of the driver's seat of the vehicle 100 or to be rectangular to extend from the dashboard of the driver's seat to the passenger seat.
[0201] The vehicle display device 800 may include a housing 801 having a recessed interior space, and a display may be disposed on one side of the interior space of the housing 801. As an example, the display of the vehicle display device 800 may be configured such that it is located in the upper part of the interior space of the housing 801, with the front of the display facing downwards.
[0202] The cover 801 is designed to have an inwardly recessed inner space, thereby forming a natural darkroom space. As a result, the real and virtual images displayed in the first and second screen areas formed by the first reflection module 820 and the second reflection module 840, as described below, can be displayed with greater clarity.
[0203] The interior space of the cover 801 can be configured such that the inside is covered and the space opens outward toward the driver's seat. Furthermore, the interior space of the cover 801 can be configured such that the space narrows towards the inner side and widens towards the outer side.
[0204] Within the inner space of the housing 801, a plurality of screen areas can be formed according to the drive of the display. In an embodiment, a portion of the plurality of screen areas can be formed offset from the inner space of the housing 801.
[0205] The plurality of screen regions may include a first screen region 821 formed on the upper side of the inner space of the cover 801 and a second screen region 841 formed on the lower part of the first screen region 821.
[0206] The first screen area 821, as a prism screen area formed by the refraction of graphics in a portion of the display, can display a real image. Additionally, the second screen area 841, as a floating screen area formed by the reflection of graphics in other areas of the display using a 3D board, can output a virtual image.
[0207] In the prism screen area, for example, a real image formed by polarized light refracted by a prism and reflected by a mirror can be displayed above the prism. Additionally, in the floating screen area, for example, a 3D virtual image (AR) formed based on graphic light reflected from a display via a 3D panel can be displayed within the recessed housing 801, or at least a portion of it can be displayed off-center from the interior space. In the former case, the prism screen area and the floating screen area can be configured on the same line; in the latter case, these screen areas may not be configured on the same line.
[0208] The first screen area 821 can be formed only in the position corresponding to the driver's seat, or it can be formed in a position corresponding to both the driver's seat and the passenger seat. The second screen area 841 can be formed in the position corresponding to both the driver's seat and the passenger seat.
[0209] The first screen area 821 and the second screen area 841 can be selectively formed or formed simultaneously. When the first screen area 821 and the second screen area 841 are formed together, the related content can be displayed as images of different forms, such as real images and virtual images.
[0210] Figure 4 is an example block diagram illustrating the detailed configuration of the vehicle display device 800 of the present invention.
[0211] The vehicle display device 800 may include a housing 801, a display 810, a communication unit 830, a first reflection module 820, a second reflection module 840, a processor 850, a rotation adjustment unit 860, and a sensor 870. Furthermore, the vehicle display device 800 can communicate with the vehicle 100 via the communication unit 830. Additionally, the vehicle display device 800 may be configured to form a first screen area 821, a second screen area 841, or multiple screen areas 821 and 841 through the first reflection module 820 and / or the second reflection module 840.
[0212] The cover 801 forms the frame of the vehicle display device 800 and includes a recessed interior space inside.
[0213] The display 810 can be configured on one side of the inner space of the housing 801, for example, at the upper part of the inner space. In this case, the back of the display 810 can be attached to the top surface of the inner space of the housing 801, and the front of the display 810 can be configured to face the ground.
[0214] The display 810 can be configured to tilt at a predetermined angle, not parallel to the ground. For this purpose, the top surface of the inner space of the housing 801 can be formed to tilt at a predetermined angle to the ground. As described above, since the display 810 is formed to tilt at a predetermined angle relative to the ground, the floating effect of the 3D AR image displayed in the second screen area formed by the second reflection module 840 is maximized.
[0215] The communication unit 830 can receive data related to the vehicle's status and driving from the vehicle 100, which is equipped with the vehicle display device 800. Furthermore, the communication unit 830 can transmit data related to the operation status and driving of the vehicle display device 800 to the vehicle 100. Therefore, the communication unit 830 can be implemented by having a transmitting module and a receiving module, or by including a transceiver capable of both transmitting and receiving.
[0216] The first reflection module 820 can be configured to be integrated with one side of the display 810 within the inner space of the housing 801. The first reflection module 820 can be configured to refract light from a pattern emitted from a first area of the display 810 to form a first screen area. The first screen area refers to the prism area that displays a real image of linearly polarized light corresponding to the pattern of the display 810 refracted by the prism. Hereinafter, the "first screen area" may be referred to as "prism area," "prism display," "prism screen," or "prism screen area."
[0217] To form the first screen area, the first reflection module 820 may include a prism and a reflector. The first screen area may be formed above the second screen area described below, and the graphic emitted from the first area of the display 810 is output as a real image.
[0218] The second reflection module 840 can be configured to be combined with one side of the first reflection module 820 within the inner space of the housing 801. The second reflection module 840 can be configured to reflect light from a graphic emitted from the second area of the display 810 to form a second screen area. The second screen area refers to an AR floating area connected to the first screen area and displaying virtual (AR) images within the inner space of the housing 801. Hereinafter, the "second screen area" can be named "floating area," "floating screen," "floating display," "floating screen area," "virtual image screen area," or "AR floating area."
[0219] To form the second screen area, the second reflection module 840 may include a 3D plate and a reflector. In this case, the second screen area can be formed below the first screen area, and the graphic emitted from the second area of the display 810 can be output as a virtual image, i.e., a 3D AR image.
[0220] The processor 850 controls the operation of the display 810, the first reflection module 820, and the second reflection module 840. The processor 850 can be configured on the inner side of the inner space of the housing 801 or on the outer side of the back of the housing 801.
[0221] The processor 850 can control whether the display 810 is driven when the vehicle is started or upon request. The processor 850 can control the operation of the first reflection module 820 and / or the second reflection module 840 when the display 810 is driven, so that the graphics displayed on the display 810 are displayed as real images and / or virtual images through the first screen area and / or the second screen area.
[0222] When the display 810 is driven, the processor 850 controls the operation of at least one of the first reflection module 820 and the second reflection module 840 according to set conditions to change the activation or deactivation of the first screen area and the second screen area. Thus, the occupants of the vehicle 100 can view the graphics displayed on the display 810 in the first screen area / second screen area / multi-screen area.
[0223] The processor 850 can control the position of the second screen area formed by the second reflection module 840 by controlling the movement of the rotation adjustment unit 860. Alternatively, the rotation adjustment unit 860 can also be implemented as a function of the processor 850.
[0224] The rotation adjustment unit 860 can adjust the rotation of the second reflection module 840 to change the reflection angle or light path length formed by the second reflection module 840 and the display 810. Therefore, the second reflection module 840 can be configured to be coupled to a rotation drive device on one side of the rotation adjustment unit 860 and be capable of rotation.
[0225] As the rotation adjustment unit 860 is driven, the rotation of the second reflection module 840 is adjusted, thereby changing the position of the second screen area formed by the second reflection module 840. Consequently, the 3D virtual image displayed in the second screen area can be moved back and forth.
[0226] The rotation adjustment unit 860 may include a coupling device for engaging with the second reflection module 860, a rotation device for rotating the second reflection module 860, and a support device for the support plate when the second reflection module 860 rotates.
[0227] Sensor 870 may include a sensor for sensing input to display 810, and a sensor for sensing (hover) input to a first screen area and a second screen area. Additionally, sensor 870 may also include a camera sensor, IR sensor, IMS sensor, etc., for identifying the entity performing the input or for monitoring the status of the driver / passenger.
[0228] In some examples, sensor 870 may include a vehicle camera sensor, an IR sensor, or an IMS sensor. The vehicle display device 800 can identify the occupant's field of view using sensor 870 and transmit this information to processor 850. Processor 850 can then adjust the position of the second reflection module 840 based on the occupant's field of view, thereby adjusting the position of the area forming the second screen.
[0229] On the other hand, the vehicle display device 800 may also include a front cover 802. In this case, the front cover 802 can be shielded when the display 810 is not driven, so that the inner space of the cover 801 is not visible, and can be driven when the display 810 is driven, so that the inner space of the cover 801 is exposed.
[0230] Thus, in the vehicle display device 800 of this embodiment of the invention, a portion of the graphic emitted from a display 810 disposed on one side of the interior space of the housing 801 is refracted by a first reflection module and a portion is reflected by a second reflection module, thereby enabling a combination of virtual and real images to be selectively or simultaneously realized by a display module.
[0231] Figure 5 is a side sectional view of the vehicle display device 800 of the present invention. Specifically, Figure 5 is a side view of the vehicle display device 800, showing a "package" for outputting graphics displayed on a single display located on the upper part of the device through a prism screen and a floating screen.
[0232] A display 810 can be disposed on the upper part of the package, tilted at a predetermined angle to the ground. That is, the display 810 can be disposed on the upper part in a state where it is tilted at a predetermined angle and not parallel to the ground. As a result, the floating effect of the 3D virtual image displayed in the floating area formed by the second reflection module 840 (described later) can be presented more three-dimensionally and prominently. In addition, by disposing the front of the display 810 on the upper part and facing the ground, the graphic light emitted from the front of the display 810 when the display 810 is driven is emitted in a vertical direction.
[0233] A processor 850, such as a PCB, for controlling the drive of the vehicle display device 800 is disposed on the back side of the package. The processor 850 controls the drive of the display 810, and the activation and operation of the first reflection module 820 and the second reflection module 840. The processor 850 can be electrically connected to one side of the display 810 and can be perpendicular to the display 810 disposed on the upper part.
[0234] The first reflection module 820 can be configured to display a real image on the prism by refracting graphic light emitted from a portion of the display 810 through a prism that is vertically coupled to one side of the display 810.
[0235] The prism of the first reflection module 820, acting as a projector formed by precisely cutting through a transparent, translucent material at precise angles and planes, alters the light path by dispersing the light of the image output to the first area of the display 810. The prism of the first reflection module 820 can be configured to be perpendicular to the display 810, for example, it can be a triangular prism shape. Thus, the light of the image output to the first area of the display 810 is refracted, and a first screen area (or prism area) 821 can be formed on the surface of the prism perpendicular to the display 810. In an embodiment, depending on the number of reflective mirrors incorporated with the prism, the image of the image output to the first area of the display 810 is either inverted or displayed in the same shape in the first screen area.
[0236] The second reflection module 840 includes a 3D plate coupled to one side of the first reflection module 820 and configured to form a predetermined angle with the display 810. The 3D plate, such as a 3D holographic plate, can display a virtual image, i.e., a 3D virtual image, at a position corresponding to the occupant's field of vision by reflecting light from a pattern emitted from other areas of the display 810, such as the second area.
[0237] At this time, the first screen area formed by the first reflection module 820 and the second screen area formed by the second reflection module 840 have different depths. Specifically, the first screen area 821 is formed on the front surface of the prism of the first reflection module 820, while the second screen area 841 is formed in the 3D space formed by reflection from the 3D plate of the second reflection module 840. A portion of the second screen area can be located on the same surface as the first screen area.
[0238] On the other hand, the package can be configured within a housing 801 (FIG. 4) that includes a recessed inner space. Together with this housing 801 structure, the second reflective module 840 images the light from the graphic emitted by the display 810 at the lower end by reflecting it through the 3D holographic plate, thereby naturally blocking external light.
[0239] On the other hand, although not shown, the package may also include a light-absorbing section for absorbing light from the pattern emitted from the display 810 and a back plate attached to the back of the 3D plate of the second reflective module 840.
[0240] At this time, the back panel can be made of UTG (ultra-thin film reinforced glass) material, which can perform the function of supporting the 3D holographic panel from the back.
[0241] Additionally, the light-absorbing section can be configured to form dark chambers on the left and right sides of the cover 801, absorbing light reflected and diffused from the graphic emitted by the display 810. The light-absorbing section improves the contrast of the 3D virtual image displayed in the second screen area 841 by reducing the brightness of the reflected light from the graphic.
[0242] The packaged processor 850 can control the rotation of the 3D plate of the second reflection module 840 to change the angle formed between it and the display 810. Based on the change in the angle formed by the rotation of the 3D plate of the second reflection module 840 and the display 810, the position of the 3D virtual image displayed in the second screen area 841 can be changed. For this purpose, one side of the second reflection module 840 is connected to a rotation adjustment unit 860 (FIG. 4), and the rotation of the 3D plate of the second reflection module 840 can be driven based on signals transmitted from the processor 850.
[0243] In some embodiments, the package may have a rotatable structure or include a drive cover to shield the package when the display 810 is not driven, and expose at least a portion of the first screen region 821 and the second screen region 841 formed by the first reflection module 820 and the second reflection module 840 when the display 810 is driven.
[0244] Referring again to Figure 5, the encapsulation can be implemented as follows: it is disposed within a housing 801 having a recessed inner space, and a floating area formed by the second reflection module 840 is displayed within the recessed inner space.
[0245] Additionally, as previously mentioned, it can be implemented such that, as the 3D plate of the second reflection module 840 rotates, a portion of the floating area whose position changes is deviated from the recessed inner space for display. Thus, a portion of the 3D floating content displayed in the floating area can be imaged away from the recessed inner space of the housing 801.
[0246] The vehicle display device 800 uses a prism and a 3D plate, which serve as the first reflection module 820 and the second reflection module 840, to reflect / refract the luminous pattern on the display 810 located on the upper part, so that the 3D virtual image and the real image are imaged onto the prism area 821 and the floating area 841, thereby enabling the real image and the virtual image to be displayed independently or simultaneously by a single display.
[0247] Light emanating from a graphic on display 810 can be refracted by one or more lenses and prisms to form an eyebox. For this purpose, an incident optics module for forming curvature and light path may also be included. For example, the lenses and prisms may be configured to have a predetermined angle (e.g., a right angle) with the display to have curvature and light path for forming an eyebox for a graphic displayed in a first area of display 810.
[0248] Additionally, the light emitted by the pattern on the display 810 can be reflected by the 3D panel and a mirror to form an eye box for displaying a virtual image. At this point, a combiner for compensating for chromatic aberration and focal length can be incorporated. The combiner may include a 3D panel, such as a 3D holographic panel, and a mirror for reflecting the light of the refracted pattern illuminated by a prism.
[0249] At this point, the reflective mirror can be configured as a flat plate or a film shape. The reflective surface of the reflective mirror can be formed on the front side of the 3D panel facing the user's eyes, thereby compensating for chromatic aberration and focal length. In addition, in this invention, the graphic light from the display 810 disposed on the upper part of the package is refracted by a prism or directly irradiated onto the 3D panel, so chromatic aberration caused by wavelength separation almost does not occur.
[0250] Figure 6 is a side view of the prism display area 821 and the floating display area 841 formed by the drive of the display device 800.
[0251] As shown in Figure 6, the prism display area 821 can be formed in the upper part of the recessed inner space of the cover 801, and the floating display area 841 can be formed in the lower part of the recessed inner space of the cover 801.
[0252] The size of the floating display area 841 can be larger than that of the prism display area 821. Real images can be displayed in the prism display area 821, while virtual images with depth, i.e., 3DAR images, can be displayed in the floating display area 841.
[0253] The prism display area 821 and the floating display area 841 can be used selectively or driven simultaneously.
[0254] Therefore, when the display 810 is driven, the processor 850 of the vehicle display device 800 controls the operation of at least one of the first reflection module 820 and the second reflection module 840 according to preset conditions, thereby changing whether the first screen area and the second screen area, namely the prism display area 821 and the floating display area 841, are activated or not.
[0255] At this time, the preset conditions are related to the driving status of the vehicle 100 equipped with the vehicle display device 800. For example, the driving status of the vehicle can be matched with various conditions required for a warning / alarm in the preset conditions.
[0256] The processor 850 can activate the first reflection module 820 to display the vehicle's driving status in the prism display area 821 during the period when the vehicle is in a first driving state, based on information related to the vehicle's driving status received through the communication unit 830.
[0257] Here, the first driving state refers to the normal driving state after the vehicle is started, which is the normal driving condition that does not require warnings / alarms.
[0258] Next, based on the information related to the vehicle driving status received through the communication unit 830, if the vehicle changes from the first driving state to the second driving state, the first reflection module 820 and the second reflection module 840 can be controlled to display the vehicle driving status together in the prism display area 821 and the AR floating display area 840 by activating both the first reflection module 820 and the second reflection module 840.
[0259] Here, the second driving state refers to a driving situation that requires a warning / alarm during vehicle operation. For example, if the processor 850 needs a warning / alarm due to a violation of the vehicle's speed limit, a sharp turn ahead, or the appearance of an object around the vehicle, it can determine that it is in the second driving state. If the corresponding situation is resolved, it can determine that it has switched to the first driving state.
[0260] Alternatively, it can be controlled such that, based on information related to the vehicle's driving status received through the communication unit 830, the second reflection module 840 is activated during the period when the vehicle 100 is in the third driving state to display an AR virtual image in the AR floating display area 840 and display a graphic object related to the AR virtual image in the prism display area 821.
[0261] Here, the third driving state can refer to the state in which the entertainment function is performed when the vehicle is stationary.
[0262] As another embodiment, the processor 850 of the vehicle display device 800 can determine whether to display one or both of the prism display area 821 and the AR floating display area 840, depending on the type of content output to the display 810. For example, content related to vehicle status can be displayed in the prism display area 821, while entertainment content can be displayed in the AR floating display area 840.
[0263] As another embodiment, the processor 850 of the vehicle display device 800 can determine, based on user input / request, one of the display prism display area 821 and the AR floating display area 840, or display both.
[0264] As described above, the vehicle display device 800 of this embodiment of the invention can selectively provide a usage environment for a plurality of displays from a single display.
[0265] Figure 7 is an example diagram illustrating a plurality of display areas according to the display mode of the vehicle display device 800.
[0266] The vehicle display device 800 can operate in a "prism display mode" that displays a real image in the prism screen area, or in a "floating display mode" that displays a virtual image in the floating screen area, or in a "multi-display mode" that displays both real and virtual images in the prism screen area and the floating screen area, depending on the set conditions.
[0267] Here, as mentioned above, the set conditions may be related to the vehicle's driving status, the type of content to be imaged, or correspond to user input / requests.
[0268] On the other hand, the vehicle display device 800 can be controlled such that the floating screen area 841 formed by the second reflection module 840 is displayed in the recessed inner space of the cover 801 at positions corresponding to the driver's seat and the passenger seat, respectively.
[0269] Specifically, referring to Figure 7, the floating screen area 841 can be divided into a first floating area 841a corresponding to the driver's seat, a third floating area 841c corresponding to the passenger seat, and a second floating area 841b corresponding to the area between the driver's seat and the passenger seat.
[0270] The first floating area 841a can be the area used by the driver, and the third floating area 841c can be the display area used by the front passenger. Additionally, the second floating area 841b can be a display area shared by both the driver and front passenger.
[0271] A 3D AR image is displayed in the first floating area 841a, corresponding to the field of vision of the driver's seat occupant. A 3D AR image is displayed in the third floating area 841c, corresponding to the field of vision of the passenger's seat occupant. Additionally, a 3D AR image is displayed in the second floating area 841b, corresponding to a preset field of vision angle, such as one corresponding to the driver's seat or the passenger's seat.
[0272] The content displayed in the first to the third floating areas 841a, 841b, and 841c can be controlled and displayed independently.
[0273] Additionally, it can operate in SPM (Switchable Privacy Mode) mode, so that the content displayed in the first floating area 841a is not visible from the passenger seat, and the content displayed in the third floating area 841c is not visible from the driver's seat. In this case, 3D content can be displayed in the second floating area 841b at a viewing angle that can be seen by both the driver's and passenger's seats.
[0274] Figure 8 is a side view of a vehicle display device 800 disposed in the dashboard / CID area of a vehicle 100 according to the present invention. As shown in Figure 8, the cover 801 of the vehicle display device can be disposed at a position corresponding to the dashboard of the driver's seat. For example, the cover 801 can be formed to have an inwardly recessed inner space, so as to have a basic volume of about 23L.
[0275] Although not specifically shown, the inner space of the cover 801, which opens toward the occupant's field of vision when the vehicle display device 800 is driven, can form a prism display area 821 for displaying real images and a floating display area 841 for displaying virtual images, i.e., 3D AR images, and provide them to the user's eye box.
[0276] When the vehicle display device 800 is not driven, the cover 801 can be rotated or covered by the front cover to hide the interior space of the cover 801.
[0277] In order to provide the user with a viewing angle by displaying a graphic illuminated by the display 810 located in the upper part of the interior space of the housing 801, the vehicle display device 800 can selectively activate the prism display area 821 and the floating display area 841.
[0278] Therefore, the vehicle display device 800 can be controlled such that the pattern emitting light in the first area of the display 810 is refracted by a prism and then a real image is displayed on the surface of the prism.
[0279] Additionally, the vehicle display device 800 can be controlled such that the graphic emitting light in the second area of the display 810 is refracted by a prism, reflected by a 3D plate, and then, after passing through a reflective polarizing plate and / or an absorptive polarizing plate, displayed as a 3D AR image within the inner space of a housing 801 that matches the user's eye level.
[0280] Hereinafter, FIG9 is an example flowchart for illustrating the operation method of the vehicle display device 800 according to the present invention.
[0281] Referring to FIG9, the operation method of the vehicle display device 800 according to an embodiment of the present invention discloses a step (S10) of driving a display disposed on one side of the inner space of the housing 801 (FIG. 4). According to the driving of the display 810, graphics are emitted from the front.
[0282] Therefore, the display 810 of the vehicle display device 800 can be configured such that it is positioned on the upper inner side of the inner space of the housing 801, facing the ground and having an incline that is not parallel to the ground.
[0283] In this way, the display 810 can be configured on the upper inner side of the inner space of the housing 801, so that the light of the luminous pattern is used to form the curvature and light path of the eye box. Thus, the light path is formed so that the light of the luminous pattern on the display 810 is not dispersed, but directed toward the 3D plate of the second reflection module 840.
[0284] In addition, the display 810 located on the upper part is formed in a tilted structure that is not parallel to the ground, thereby maximizing the floating effect of the 3D AR image displayed in the floating display area 841 formed by the second reflection module 840.
[0285] Next, the vehicle display device 800 can operate such that the graphic emitted in the first area of the display 810 is refracted by the first reflection module 820 and forms the first screen area (S20).
[0286] In addition, the vehicle display device 800 can operate such that the graphic emitted in the second area of the display 810 is reflected by the second reflection module 840 and forms a second screen area (S30).
[0287] Thus, forming the first screen area and the second screen area can mean that the graphic emitted by the drive of the display 810 has completed the preparation for imaging onto either the first screen area or the second screen area.
[0288] Thus, if preparations are completed to image onto one or all of the plurality of screen areas, the vehicle display device 800 can be controlled to activate at least one of the first screen area and the second screen area formed by the first reflection module 820 and the second reflection module 840, depending on whether the set conditions are met (S40).
[0289] Specifically, for example, to display only the vehicle's driving status, a first screen area formed by the first reflection module 820 is activated, allowing a real image to be displayed on the surface of the prism. Additionally, for example, to display warnings / alarms or guide dangerous situations while the vehicle is in motion, a second screen area formed by the second reflection module 840 can be activated, allowing a floating 3D AR image to be displayed in the recessed inner space of the housing 801. At this time, the recessed inner space of the housing 801, with its sides obscured, naturally provides a darkroom effect, further enhancing the clarity of the floating 3D AR image.
[0290] On the other hand, Figures 10, 11 and 12 are various structural examples of a vehicle display device 100 that uses a single display to implement a plurality of display modes according to embodiments of the present invention.
[0291] Figure 10 shows the basic structure of the housing 801 of the vehicle display device 800. A display 810 can be disposed in the upper part of the recessed inner space of the housing 801, and a processor 850 can be included in the rear part of the inner space. Furthermore, a first reflective module 820, which is attached to one side of the display 810 and includes a prism, is configured to be perpendicular to the display 810, similar to the direction perpendicular to the light emitted by the display 810. Additionally, a second reflective module 840, which is attached to one side of the first reflective module 820 and reflects the light refracted by the prism of the first reflective module 820, can be configured to form a predetermined angle with the display 810. In this case, the second reflective module 840 can be formed to include a 3D holographic panel disposed in the inner space of the housing 801 and facing the front of the display 810, and a reflecting mirror (not shown).
[0292] In an embodiment, the processor 850 can be controlled such that, when the first reflection module 820 is activated, the prism of the first reflection module 820 refracts the linearly polarized light corresponding to the pattern emitting light in the first area of the display 810 and forms the first screen area.
[0293] Additionally, the processor 850 can be controlled such that, when the second reflection module 840 is activated, the 3D plate of the second reflection module 840 reflects the graphic emitted in the second area of the display 810 or the linearly polarized light refracted by the prism and forms a second screen area for displaying 3D virtual (AR) images.
[0294] The first screen area formed by the first reflection module 820 is formed above the second screen area formed by the second reflection module 840 and extends from the first area of the display 810.
[0295] In addition, the second screen area formed by the second reflection module 840 is formed below the first screen area formed by the first reflection module 820. The 3D AR content displayed in the second screen area can be formed only in the inner space of the cover 801 or partially off the inner space.
[0296] Figure 11(a) shows an example structure of the vehicle display device 800 using only the first screen area formed by the prism of the first reflective module 820, driven by the display 810. In Figure 11(a), the cover 801' is in a state where the 3D holographic plate is folded or rotated to be parallel to the display 810, which minimizes the volume of the cover 801'. This cover 801' structure can be called a minimum thinness package, where the pattern emitted by the display 810 is refracted by the prism and displayed as a real image on the front. For example, when the 3D holographic plate of the second reflective module is rotated and the internal space of the cover 801' is reduced to a minimum, the volume of the minimum thinness package can be changed to 9L.
[0297] On the other hand, Figure 11(b) shows a state in which the first reflection module 820 and the second reflection module 840 are both activated according to the driving of the display 810 of the vehicle display device 800, and the corresponding first screen area and second screen area are activated. At this time, the processor 850 can be configured to be combined with one side of the display 810 on the outer back side of the housing 801".
[0298] Additionally, according to an embodiment, a UTG plate can be bonded to the front of the 3D plate of the second reflective module 840 to form the light path of the eye box. Furthermore, although not shown, a light-absorbing plate may also be added adjacent to the 3D plate of the second reflective module 840 to absorb linearly polarized light that is not reflected by the 3D plate.
[0299] Next, referring to Figure 12, the package of the vehicle display device 800 is integrally formed with the air duct of the driver's seat of the vehicle 100 on the dashboard, thereby enabling a thinner structure. As described above, when modularized together with the vehicle's air purifier, the package and housing can be implemented with a volume of 11L, which is slightly larger than the aforementioned minimum thinnest package.
[0300] The above describes an embodiment and structure of the vehicle display device 800 of the present invention, which displays graphics of different types in a plurality of display areas through a single display.
[0301] Hereinafter, with reference to FIG13, a method for changing the position of an AR image displayed in a floating display area in the vehicle display device 800 of the present invention will be specifically described.
[0302] In the first screen area formed by the first reflection module 820, a real image is displayed on the surface of the prism, and in the second screen area formed by the second reflection module 840, a 3D virtual (AR) image with depth can be displayed.
[0303] In an embodiment of the invention, the 3D virtual (AR) image displayed in the second screen area can be moved and displayed within the inner space of the housing 801 along the x-axis, y-axis, and z-axis directions. For this purpose, the 3D holographic plate of the second reflection module 840 is made rotatable to adjust the angle formed with the display 810.
[0304] Specifically, as shown in Figure 13, the first reflective module 820 is fixed to one side of the display 810, and the second reflective module 840 is configured to rotate within the inner space of the housing 801. One side of the second reflective module 840 is fixed adjacent to the first reflective module 820, and the distance between it and the display 810 increases as it moves towards the other side. Furthermore, the angle between the second reflective module 840 and the opposing display 810 can be changed by the rotation adjustment unit 860.
[0305] The processor 850 of the vehicle display device 800 can transmit a signal for adjusting the rotation of the second reflection module 840 to the rotation adjustment unit 860 to change the angle between the second reflection module 840 and the display 810.
[0306] The rotation adjustment unit 860 may include a coupling device that engages with one side of the 3D plate of the second reflection module 840, a drive device that provides a driving force for rotating the 3D plate, and a support device that supports the 3D plate during rotation.
[0307] If the rotation adjustment unit 860 operates according to the drive signal transmitted from the processor 850, the 3D board of the second reflection module 840 can rotate by a set angle in a clockwise or counterclockwise direction based on the information contained in the drive signal.
[0308] Figure 13(a) is an example diagram showing the basic position of the second reflective module 840 in the inner space of the housing 801. With the 3D plate of the second reflective module 840 configured in the set basic position, the second screen area 841 for displaying 3D AR content can be displayed, for example, at the entrance of the inner space of the housing 801.
[0309] In an embodiment, the processor 850 can control the rotation of the second reflection module 840 by adjusting the rotation of the rotation adjustment unit 860 to change the angle formed by the display 810 and the 3D board, and based on this, move the position of the second screen area 841 displaying 3D AR content back and forth with reference to the inner space of the cover 801.
[0310] Figure 13(b) shows an example where the 3D plate of the second reflection module 840 is rotated clockwise by a constant angle from its base position, thereby further increasing the angle between the display 810 and the 3D plate.
[0311] Thus, if the angle between the display 810 and the 3D plate of the second reflection module 840 increases, the position of the second screen area 841 formed by the second reflection module 840, i.e., the floating display area, will protrude forward. As a result, at least a portion of the 3D AR image displayed in the second screen area 841 can be displayed off-center from the inner space of the housing 801.
[0312] On the other hand, Figure 13(c) is an example of the second reflection module 840 rotating its 3D plate from its base position by a constant angle in the counterclockwise direction, thereby further reducing the angle between the display 810 and the 3D plate.
[0313] Thus, if the angle formed by the display 810 and the 3D plate of the second reflection module 840 decreases, the position of the second screen area 841 formed by the second reflection module 840, i.e., the floating display area, is shifted rearward. Consequently, the 3D AR image displayed in the second screen area 841 can be displayed further inside the inner space of the housing 801.
[0314] Figure 13(d) shows the configuration in which the 3D AR image 1301 displayed in the second screen area, i.e., the floating display area 841, moves along the front-to-back direction 1302 within the inner space of the housing 801, according to the rotation of the 3D plate of the second reflection module 840. At this time, the graphic displayed in the first screen area, i.e., the prism display area, formed by the first reflection module 820, continues to be displayed on the same plane.
[0315] As described above, the movement of the 3D AR image caused by the change in position of the 3D plate of the second reflection module 840 can be performed based on various conditions.
[0316] In one embodiment, the processor 850 of the vehicle display device 800 can adjust the rotation of the second reflection module 840 to change the position of the second screen area based on the occupant's field of view information (e.g., eye box / eye level) received from the vehicle 100 by the vehicle 100's IMS (interior view camera) or DMS (dual view camera) sensors. To this end, the processor 850 calculates refraction, curvature, and light path that match the occupant's field of view information sensed by the IMS / DMS sensors, thereby enabling adjustment of the 3D plate position of the second reflection module 840 when the display 810 is driven.
[0317] Additionally, in this embodiment, the processor 850 of the vehicle display device 800 can drive the first screen area and the second screen area formed by the first reflection module 820 and the second reflection module 840 in an active state when the display 810 is driven. Then, the processor 850 can adjust the rotation of the second reflection module 840 to adaptively change the position of the floating display area based on the movement of the first graphic image displayed as a real image in the first screen area 821, i.e., the prism display area, and the second graphic image displayed as a virtual image in the second screen area 841, i.e., the floating display area.
[0318] For example, in the case of 3D content type where a 3D AR image displayed in a floating display area moves back and forth, the 3D plate of the second reflection module 840 can rotate to correspond to this movement mode. Thus, as shown in FIG13(d), the 3D virtual (AR) image can move back and forth relative to the recessed inner space of the housing 801. For this purpose, the 3D plate of the second reflection module 840 can be driven to rotate according to a preset pattern for each content.
[0319] Additionally, for example, when the 3D (AR) virtual image is displayed prominently towards the driver, the position can be changed in the direction that the angle between the 3D plate of the second reflection module 840 and the display 810 increases. Similarly, when the 3D virtual (AR) image is displayed inwardly towards the inside of the housing 801, the position can be changed in the direction that the angle between the 3D plate of the second reflection module 840 and the display 810 decreases. As an example, to achieve a magnified / reduced effect on the 3D virtual (AR) image, the 3D plate of the second reflection module 840 can be rotated clockwise / counterclockwise. Alternatively, the 3D plate of the second reflection module 840 can remain fixed while the housing, including the encapsulation, rotates in a specific direction, thereby achieving the same / similar effect.
[0320] On the other hand, the aforementioned package can be configured to rotate with the dashboard of the vehicle 100. In this case, corresponding to the rotation of the package, the recessed inner space of the cover 801 can be exposed or concealed. As another example, a front cover for concealing the recessed inner space of the cover 801 may also be provided.
[0321] The following describes various embodiments of the present invention in which information is displayed by having different depth values in the prism region and the floating region, or by changing the depth values.
[0322] Referring again to Figure 2, as previously described, the prism area is the first screen area where the graphic displayed on the display 810 shows information above the prism. Additionally, the floating area is the second screen area where the graphic displayed on the display 810 is reflected by the 3D panel and displays a virtual image, i.e., a floating AR image, within the inner space of the housing 801.
[0323] The information in the prism region and the information in the floating region are displayed as being 180 degrees out of phase. Specifically, the graphic output by the display 810 located in the upper part of the inner space of the housing 801, i.e., the source image, is displayed in the prism region and the floating region as images that are 180 degrees out of phase with each other.
[0324] Furthermore, the images displayed in the prism region and the individual images displayed in the prism region each have different depth values. The image displayed in the prism region is a real image, while the image displayed in the floating region is a virtual image reflected by the 3D panel. The images displayed in the multiple regions each have different depth values.
[0325] The prism area can be divided into a "DriverEssential Zone" that displays essential vehicle driving information and a "Control Zone" for touch input and other operations. The DriverEssential Zone can display information such as vehicle speed and RPM. The Control Zone can display information such as HVAC controls and menu icons.
[0326] The floating area can be divided into the shared area included in all the field of vision of the driver and passengers, the driver's private area, and the passenger's private area.
[0327] Additionally, as shown in Figure 13, the information displayed in the floating area can move or change the depth value of the 3D content along the x, y, and z axes as the 3D plate of the second reflection module 840 rotates / moves.
[0328] In embodiments of the present invention, information displayed in the prism region can be expanded and displayed in the floating region. Similarly, information displayed in the floating region can be reduced in size and displayed in the prism region.
[0329] In an embodiment of the present invention, the vehicle display device 800 uses a graphic emitted from a display 810, which is tilted at the top and located on one side of the inner space of the housing, as the source image, and displays a real image and a virtual image in a first screen area (i.e., the prism area) 821 and a second screen area (i.e., the floating area), respectively.
[0330] Therefore, the pattern emitted from the first area of the display 810 is refracted by the first reflection module 820 to form the first screen area 821. Additionally, the pattern emitted from the second area of the display 810 is reflected by the second reflection module 840 or refracted by the first reflection module and then reflected by the second reflection module 840 to form the second screen area 840.
[0331] The processor 850, located at the rear of the inner space of the housing 801, can control the display 810 to display information with different depth values in the first screen area 821 and the second screen area 841 formed by the first reflection module 820 and the second reflection module 840, based on vehicle information received from the vehicle 100 when the display 810 is driven.
[0332] In this embodiment, related information can be seamlessly displayed in the first screen area 821 and the second screen area 841.
[0333] Relatedly, Figures 14 and 15 are diagrams used to illustrate the expansion of information in prism region 821 into floating region 841 or the reduction of information in floating region 841 into prism region.
[0334] The processor 850 can determine the information to be displayed in the first screen area 821 and the second screen area 841 based on the received vehicle information. Additionally, the processor 850 can determine whether the information to be displayed in the first screen area 821 and the second screen area 841 is related to each other.
[0335] Here, the information to be displayed is related to each other, including the content selected from the first screen area 821 being executed in the second screen area 841.
[0336] In addition, the information to be displayed is related to each other, including information displayed in the first screen area 821, which is displayed in the second screen area 841 only in a different form (type).
[0337] In addition, the information to be displayed is related to each other, including the information displayed in the first screen area 821 meeting the preset conditions and expanding to the second screen area 841.
[0338] In an embodiment, the processor 850 can determine whether the information to be displayed in the first screen area and the second screen area, namely the prism area 821 and the floating area 841, is associated or not, and based on the determination, control the first reflection module 820 and the second reflection module 840 to change at least one of the depth values of the real image displayed in the prism area 821 and the virtual image displayed in the floating area 841.
[0339] Referring to FIG14, when the vehicle display device 800 is driven, information associated with the information displayed in the prism region 821 formed on the upper part of the cover 801 can be seamlessly expanded from the prism region 821 to the floating region 841.
[0340] At this time, the information displayed in the floating area 841 formed at the lower part of the prism area 821 can be displayed as if it were unfolding downwards from the prism area 821. Thus, the user can directly confirm that the information displayed in the prism area 821 and the floating area 841 are related to each other.
[0341] Furthermore, when information associated with floating area 841 is displayed seamlessly, information displayed in the matching prism area 821 can display highlighting effects (e.g., image size, color, size changes, or on / off flashing effects). Thus, the user can visually and directly confirm which information displayed in prism area 821 is associated with the information displayed in floating area 841.
[0342] Next, referring to FIG15, when the information associated with the information displayed in the prism region 821 and the information displayed in the floating region 841 changes or disappears, the operation of the display 810, the first reflection module 820 and the second reflection module 840 can be controlled to move the information before the change or the disappearance toward the prism region 821.
[0343] At this time, the associated information displayed in the prism area 821 can also output pre-set visual effects. For example, when an image is seamlessly connected and displayed in the prism area 821 and the floating area 841, and then the portion displayed in the floating area 841 changes or disappears, the information of the matching portion displayed in the prism area 821 can also be correspondingly reduced, changed, or removed. Thus, it can be visually confirmed directly which information in the prism area 821 has been decoupled.
[0344] On the other hand, in Figures 14 and 15, the depth values in the partial regions of prism region 821 and floating region 841 that display information related to each other can be adjusted so that multiple images are located on the same plane. On the other hand, the images in the partial regions of prism region 821 and floating region 841 that display information unrelated to each other can have different depth values and / or be located on different planes.
[0345] Therefore, information displayed continuously or related to each other in the prism area 821 and the floating area 841 can be visually confirmed directly.
[0346] Figure 16 is a diagram showing an example of vehicle navigation information being connected and displayed in prism area 821 and floating area 841.
[0347] The prism area 821 displays the real image of the source image refracted by the prism, and the floating area 841 displays the virtual image formed by the source image being reflected directly by the 3D board or by the prism and then reflected by the 3D board, i.e., virtual 3D content.
[0348] The processor 850 can correlate the various information to be displayed in the prism region 821 and the floating region 841 with each other, and adjust the various depth values through the first reflection module 820 and the second reflection module 840 so that the various images to be displayed in the prism region 821 and the floating region 841 are on the same plane.
[0349] In one embodiment, the processor 850 can determine that the various pieces of information to be displayed in the prism region 821 and the floating region 841 are related to each other. Based on this determination, the image to be displayed in the floating region 841 is moved from top to bottom to seamlessly connect with the prism region 821.
[0350] Referring to Figure 16, the navigation screen can be seamlessly displayed by connecting the prism area and floating area of the corresponding display 810 between the driver's seat and the passenger seat of the vehicle 100. At this time, menu content 1610 related to navigation screen control can be displayed in the upper prism area 821, and in connection with this, virtual (AR) images can be displayed in the floating area 841, so that the navigation execution screen 1620, which is seamlessly connected to the menu content 1610, has a depth value on the same plane.
[0351] Although not specifically shown, the upper prism area 821 displays the menu content for navigation. In response to a selection in the prism area 821, the navigation execution screen can be seamlessly displayed in the floating area 841. At this time, the navigation execution screen can expand downwards from the position where the selection was made in the prism area 821. Thus, the user can directly confirm the linkage between the prism area 821 and the floating area 841.
[0352] In another embodiment, the processor 850 determines that the various pieces of information to be displayed in the prism region 821 and the floating region 841 are related to each other. Based on this determination, content related to vehicle information can be displayed in the prism region 821, and the execution result of the content can be displayed in the matching floating region 841.
[0353] Below, Figures 17 and 18 are example diagrams showing expanded warning messages displayed in floating areas according to the warning level corresponding to the vehicle speed.
[0354] Additionally, Figure 19 is an example diagram showing an expanded warning message in a floating area based on the vehicle's inter-vehicle distance.
[0355] The graphic emitted by the display 810, i.e., the source image, can be independently displayed in the prism region 821 and the floating region 841 via the first reflection module 820 and the second reflection module 840, respectively. That is, there is one source image, but multiple screen regions are driven independently.
[0356] The processor 850 can determine which information to display in which screen area. In addition, the processor 850 can preset a reference for determining the information to be displayed in the prism area 821 and the floating area 841, and when the display 810 is driven, the information can be displayed in each screen area according to the preset reference.
[0357] In addition, in this embodiment, the processor 850 can receive vehicle status information from the vehicle 100, and control the first reflection module 820 and the second reflection module 840 to selectively display information in the first screen area 821 and the second screen area 841 respectively with different depth values, according to the importance of the vehicle information contained in the received vehicle status information.
[0358] For example, important information in the received vehicle status information that should not be affected by ambient brightness can be displayed in the prism area 821, where a darkroom effect is not required. Additionally, for example, important safety-related information in the received vehicle status information can have the position of the illuminated graphics on the display 810 adjusted for display in the prism area 821. Furthermore, for example, driving information of other vehicles or user-defined / set content can be displayed in the floating area 841, which is shown as a virtual reality (AR) image.
[0359] Referring to Figure 17, for example, a narrow prism area 821 formed in the upper part of the cover 801 can display vehicle status information 1710 that is always displayed during vehicle operation. For example, vehicle speed (e.g., 55 m / h), RPM, remaining fuel / electricity, vehicle status alarms, etc., can be included as information to be displayed in the prism area 821.
[0360] On the other hand, the floating region 841, which is formed more widely below the prism region 821 from the cover 801, can display the information displayed in the prism region 821 as primary information, and the more expanded secondary information as a virtual (AR) image.
[0361] Referring to Figure 18, for example, if the speed (e.g., 80 m / h) 1810 displayed in the prism region 821 exceeds the permissible speed, a digital image 1820 representing the current vehicle speed can be expanded and displayed in the floating region 841. At this time, the image displayed in the floating region 841 can be changed according to the importance / warning level.
[0362] For example, as the degree to which the current vehicle speed exceeds the permissible speed increases, the size of the image displayed in the floating area 841 can be enlarged and the alarm level increased. On the other hand, if the degree to which the current vehicle speed exceeds the permissible speed decreases, the display 810 and the second reflection module 840 can be controlled to reduce the size of the image displayed in the floating area 841 or to stop displaying it altogether.
[0363] Next, referring to FIG19, as an example of the execution result of the content 1910 displayed in the prism area 821, a driving warning image 1920 caused by the decrease in inter-vehicle distance is displayed in 3D in the corresponding floating area 841.
[0364] Specifically, the processor 850 of the vehicle display device 800 can control the display 810 and the first reflection module 820 to display driving guidance information as content related to vehicle information in the prism area 821.
[0365] Furthermore, the processor 850 can determine that the importance level of the driving guidance information has changed based on the vehicle's status information. Based on this, the driving guidance information expanded in the floating area 841 can be displayed as the execution result of the content in the prism area 821. To this end, the processor 850 can adjust the 3D plate of the display 810 and the second reflection module 840 so that the expanded driving guidance information is displayed as a 3D image at a position that matches the content of the prism area 821.
[0366] On the other hand, in order to display the images in the prism region 821 and the floating region 841 on the same plane, as shown in FIG13, the processor 850 can drive the rotation adjustment unit 860 to rotate the 3D plate of the second reflection module 840.
[0367] For example, as shown in Figure 19, when it is determined that the separation distance between the vehicle and the vehicle in front (or the obstacle) has decreased to within the reference value and a warning alarm is required, a warning image 1920 can be displayed in a floating area 841 on the same surface that matches the content 1910 related to the vehicle-to-obstacle distance (distance to the obstacle) of the prism area 821.
[0368] Although not specifically shown, the second reflection module 840 can be controlled to rotate its 3D plate back and forth as the warning / attention level increases, thereby moving the warning image 1920 back and forth relative to the inner space of the enclosure 801.
[0369] Additionally, in this embodiment, the processor 850 can determine that the association between the various pieces of information displayed in the prism region 821 and the floating region 841 has ended. Furthermore, based on the determination of the end of the association, the processor 850 can control the driving of the first reflection module 820 and the second reflection module 840 so that the information in the prism region 821 remains displayed, and the 3D image in the floating region 841 moves towards the boundary between the prism region 821 and the floating region 841 and disappears.
[0370] As described above, the vehicle display device of this embodiment can be displayed seamlessly like a connected screen when displaying related information from a source image in the prism area and the floating area. Additionally, the execution result of the content displayed in the prism area can also be displayed in the floating area. Furthermore, depending on whether the vehicle's attention / alarm level increases, information displayed only in the prism area can be expanded to the floating area or the image can no longer be displayed in the floating area. Thus, different screen areas can be used independently, allowing the user to visually directly confirm the correlation of information.
[0371] The following Figures 20 and 21 are example diagrams used to illustrate the prism regions and floating regions respectively assigned to the driver's seat occupant and the front passenger occupant.
[0372] In an embodiment of the present invention, the vehicle display device 800 may be configured to distinguish between the prism area and the floating area corresponding to the driver's seat and the floating area corresponding to the passenger seat.
[0373] For example, Figure 20 includes a prism region 821, a floating region 841a for the driver (hereinafter, "first floating region 841a"), and a common floating region 841b (hereinafter, "second floating region 841b").
[0374] Additionally, for example, Figure 21 includes a prism region 821, a floating region 841c for the front passenger (hereinafter, "third floating region 841c"), and a common floating region 841b (hereinafter, "second floating region 841b").
[0375] The prism region 821 on the upper part of the cover 801 shown in Figures 20 and 21 can jointly display vehicle information 2010, such as information related to the vehicle's status or important information related to driving. As shown, the prism region 821 may be formed only in the position corresponding to the driver's seat, although not shown, it may also be formed to extend long to the passenger seat. In the latter case, the vehicle information 2010 may also be displayed only in the position corresponding to the driver's seat.
[0376] In Figures 20 and 21, the first to third floating regions 841a, 841b, and 841c can be formed independently, displaying different content that is unrelated to each other. Therefore, if the front passenger is not detected, as shown in Figure 20, the processor 850 can activate only the first floating region 841a and the second floating region 841b. Conversely, as shown in Figure 21, if the front passenger is detected, the processor 850 can activate only the second floating region 841b and the third floating region 841c, or activate all of the first to third floating regions 841a, 841b, and 841c.
[0377] The execution results of vehicle-related content can be displayed in the first floating area 841a. For example, as shown in Figure 20, a low battery / charging warning alarm message 2021 can be displayed as a 3D image.
[0378] The execution results of common content related to driving can be displayed in the second floating area 841b. For example, as shown in Figures 20 and 21, the navigation screen 2022 that guides the vehicle to its destination can be displayed as a moving 3D image.
[0379] The third floating area 841c can display the entertainment performance results for the front passenger. For example, as shown in Figure 21, the advertising screen 2023 provided from the surrounding POIs can be displayed as a 3D video image based on the vehicle's current position.
[0380] On the other hand, the information displayed in the prism area 821 and the floating area 841 can be displayed independently and are not related to each other.
[0381] The processor 850 can control the 3D board of the display 810 and the second reflection module 840 based on the fact that the information displayed in the prism region 821 and the floating region 841 are not related, so that the image displayed in the floating region 841 unfolds vertically from the middle of the floating region.
[0382] In another embodiment, the processor 850 can control the 3D plate of the display 810 and the second reflection module 840 based on the determination that the information displayed in the prism region 821 and the floating region 841 is not related, so that the image displayed in the floating region 841 moves from the bottom to the top of the floating region.
[0383] As described above, the visual effect of the image displayed in the floating area 841 being separated and starting in the prism area 821 is provided, so that the user can directly confirm that the individual pieces of information in the prism area 821 and the floating area 841 are not related to each other.
[0384] On the other hand, in one embodiment, the prism region 821 of the vehicle display device 800 can be formed such that the prism is stacked with a touch sensor / proximity sensor to enable touch input.
[0385] In this case, at least a portion of the prism region 821 and the floating region 841 can be associated based on touch input to the content displayed in the prism region 821.
[0386] Specifically, the processor 850 can control the display 810, the first reflection module 820, and the second reflection module 840 based on the touch input displayed in the prism region 821, which is formed as a touch input area, to display the execution result matching the touch input in the corresponding floating area 841. In this case, it can be said that the various pieces of information displayed in the prism region 821 and the floating area 841 are interconnected.
[0387] Next, the processor 841 can control the display 810, the first reflection module 820, and the second reflection module 840 based on continuous touch input applied to the content displayed in the prism region 821, so that the execution result displayed in the corresponding floating region 841 changes or disappears. In the latter case, it can be said that the association between the various pieces of information displayed in the prism region 821 and the floating region 841 is then decoupled.
[0388] On the other hand, for driving safety, the driving of a portion of the screen area of the vehicle display device 800 can be restricted. Therefore, the formation of the floating area and / or the information displayed can be determined differently based on the vehicle's driving state.
[0389] While the vehicle is driving in driving mode, the processor 850 of the vehicle display device 800 can drive the display 810, the first reflection module 820 and the second reflection module 840 to display vehicle information in the prism area 821, while the floating area 841 remains inactive or only partially displays notification information based on driving conditions.
[0390] On the other hand, when the vehicle is stationary or driving in autonomous driving mode, the processor 850 of the vehicle display device 800 can display minimum vehicle information in the prism area 821 and display the execution screen of the entertainment function in the floating area 841.
[0391] Figure 22 is an example diagram showing the expanded display of the entertainment function execution results in a floating area based on the vehicle's driving status.
[0392] In one embodiment, during the display of information / images with different depth values in the first screen area 821 and the second screen area 841, i.e., the prism area and the floating area, the processor 850 of the vehicle display device 800 controls the second reflection module 840 to limit the display of the floating area based on the driving conditions contained in the received vehicle information.
[0393] For example, if the vehicle is determined to be in motion and not in autonomous driving mode based on the received vehicle information, the vehicle display device 800 can drive the second reflection module 840 to drive the floating area in a limiting drive mode that restricts the driver's field of vision.
[0394] In addition, based on the vehicle information received by the vehicle display device 800, when the display 810 is driven in a stopped or autonomous driving mode, the processor 850 can adjust the depth values of a plurality of screen areas so that the images to be displayed in the first screen area 821 and the second screen area 841 are seamlessly connected and located on the same surface.
[0395] For this purpose, the processor 850 can control the refraction angle / reflection path of the first reflection module 820 and / or adjust the position of the 3D plate of the second reflection modules 820 and 840 and / or the light path incident on the user's eyes.
[0396] Referring to Figure 22, when the vehicle is stopped, during the period when the menu content 2210 containing vehicle information is displayed in the prism area 821, the information may not be displayed in the first floating area 841a, and the entertainment screen 2230, which is the result of the execution of the content selected from the menu content 2210 in the prism area 821, may be displayed in the second floating area 841b.
[0397] Additionally, although not illustrated, when the vehicle is stationary, the entertainment screen 2230 in the second floating area 841b can be expanded to the first floating area 841a based on additional input applied to the menu content 2210 of the prism area 821. That is, entertainment screens / images can also be displayed in the floating area used for the driver's seat when the vehicle is not in motion.
[0398] In this configuration, as shown in Figure 13, the entertainment screen 2230 displayed in the first floating region 841a and the second floating region 841b can move within the housing 801 along the x, y, and z axes. In this configuration, the menu content 2210 of the prism region 821, which matches at least one of the first floating region 841a and the second floating region 841b, can also be changed accordingly. For example, a menu related to entertainment functions can be displayed in the prism region 821 at a position corresponding to the driver's seat.
[0399] As described above, the vehicle display device and its operation method according to embodiments of the present invention can selectively or simultaneously execute a plurality of display modes that are different from each other by a single display module. For example, a single display can selectively or simultaneously display real images and virtual images. Furthermore, the display depth perception is adjusted according to whether the real images and virtual images are related to each other, thereby allowing direct visual confirmation of the correlation between multiple pieces of information displayed on screens of different types. Specifically, when displaying related information from a source image in a prism area and a floating area, it is displayed seamlessly as if it were a single connected screen. Additionally, the execution result of the content displayed in the prism area can also be displayed in the floating area. Furthermore, depending on whether the vehicle's attention / alarm level is enhanced, information displayed only in the prism area can be expanded to the floating area or the image can no longer be displayed in the floating area. Thus, different screen areas can be used independently or in conjunction, providing a more diverse user environment and user experience.
[0400] The aforementioned invention can be implemented using computer-readable code stored in a medium containing a program. Computer-readable media include all types of storage devices storing data that can be read by a computer system. Examples of computer-readable media include HDDs (Hard Disk Drives), SSDs (Solid State Disks), SDDs (Silicon Disk Drives), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and can also be implemented in the form of a carrier wave (e.g., internet-based transmission). Furthermore, the computer may also include a processor for the vehicle display device 800. Therefore, the detailed description above should not be construed as limiting in all respects, but rather as exemplary. The scope of this specification should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of this specification should fall within the scope of this invention.
Claims
1. A vehicle display device, wherein, include: The cover has a recessed inner space inside; A display is disposed on one side of the interior space of the enclosure; The communication module receives vehicle information from the vehicle. And a first reflection module, configured to combine with one side of the display in the inner space, so that the pattern emitting light from a first area of the display is refracted and forms a first screen area; The second reflection module is configured to combine with one side of the first reflection module in the inner space, so that the graphic emitted from the second area of the display is reflected and forms a second screen area. And a processor, electrically connected to the display, the first reflection module and the second reflection module, to control the operation of the display, the first reflection module and the second reflection module respectively; The processor controls the first reflection module and the second reflection module to display information with different depth values in the first screen area and the second screen area based on the received vehicle information when the display is driven.
2. The vehicle display device according to claim 1, wherein, The processor determines whether the information to be displayed in the first screen area and the second screen area is associated, and controls the first reflection module and the second reflection module to change the depth value based on the determination.
3. The vehicle display device according to claim 2, wherein, The first screen area is a prism area; the second screen area is a floating area below the prism area that displays virtual images. The processor correlates the various pieces of information to be displayed in the prism region and the floating region with each other, and adjusts the depth value through the first reflection module and the second reflection module so that the various images to be displayed in the prism region and the floating region are located on the same plane.
4. The vehicle display device according to claim 3, wherein, Based on the correlation between the various pieces of information to be displayed in the prism region and the floating region, the image to be displayed in the floating region moves from top to bottom to seamlessly connect with the prism region.
5. The vehicle display device according to claim 3, wherein, The processor, based on the correlation between various pieces of information to be displayed in the prism area and the floating area, controls the display, the first reflection module, and the second reflection module to display content related to the vehicle information in the prism area and the execution result of the content in the floating area.
6. The vehicle display device according to claim 5, wherein, Driving guidance information is displayed in the prism area as content related to the vehicle information; Based on the change in the importance level of the driving guidance information, the expanded driving guidance information is displayed as the execution result in the floating area.
7. The vehicle display device according to claim 5, wherein, The prism region is configured to receive touch input; the processor controls the display, the first reflection module, and the second reflection module based on the touch input to the content displayed in the prism region, so as to display the execution result matching the touch input in the corresponding floating area.
8. The vehicle display device according to claim 3, wherein, When the association of the information displayed in the prism region and the floating region ends, the image in the prism region continues to be displayed, and the image in the floating region moves toward the boundary between the prism region and the floating region and disappears.
9. The vehicle display device according to claim 3, wherein, Since the information to be displayed in the prism area and the floating area is not related to each other, the image in the floating area is displayed vertically starting from the middle of the floating area.
10. The vehicle display device according to claim 3, wherein, Since the information to be displayed in the prism area and the floating area is not related to each other, the image in the floating area moves from the bottom to the top of the floating area for display.
11. The vehicle display device according to claim 1, wherein, Based on the received vehicle information, when the display is driven in a stopped or autonomous driving mode, the processor adjusts the depth value so that the images to be displayed in the first screen area and the second screen area are seamlessly connected and located on the same surface.
12. The vehicle display device according to claim 1, wherein, The processor controls the first reflection module and the second reflection module according to the importance of the vehicle information, so as to selectively display information with different depth values in the first screen area and the second screen area respectively.
13. The vehicle display device according to claim 1, wherein, While the processor displays information with different depth values in the first screen area and the second screen area, it controls the driving of the second reflection module according to the driving conditions contained in the vehicle information to limit the display in the second screen area.