Vehicle display device having multiple displays and method of operation thereof

Abstract

This invention discloses a display device for a vehicle and a method for operating it. The vehicle display device of this embodiment is configured to be mounted on a vehicle's dashboard and includes a plurality of displays formed on the front of the device and a processor. The plurality of displays includes a first display, a second display configured to be partially flexible, and a third display unit configured to change the size of the displayed image. When the second displays of the plurality of displays are in a flat first state, if vehicle movement is sensed, the processor controls the change of the first state to a second state different from the first state. Furthermore, the processor can determine a request for a change to the second state based on at least one of vehicle detection data, the content displayed on the plurality of displays, and an input request. In this case, the processor can determine whether a change to the second state is feasible based on the vehicle's driving conditions and control the plurality of displays to perform a change to the determined state.

Description

Technical Field

[0001] The present invention relates to a vehicle display device having a plurality of displays and a method of operating the same, and more specifically, to a vehicle display device having a plurality of displays whose shape can change according to circumstances and a method of operating the same. Background Technology

[0002] A vehicle is a device that moves in the direction desired by the user. A typical example is a car.

[0003] On the other hand, there is a trend towards installing various sensors and electronic devices to enhance the convenience of vehicle users. In particular, research on Advanced Driver Assistance Systems (ADAS) is actively underway to improve driving convenience. Furthermore, the development of autonomous vehicles is also progressing rapidly.

[0004] Autonomous driving refers to a system in which a vehicle can make its own judgments and drive itself. This autonomous driving can be divided into progressive stages, from non-automatic to fully automated, based on the degree of system involvement and the degree of driver control.

[0005] Autonomous driving has changed our perception of vehicles, transforming them from simple moving devices into stationary spaces. Furthermore, installing large-screen displays in vehicles is becoming a trend, allowing users to freely enjoy various infotainment features as the vehicle moves autonomously. As mentioned above, when installing large displays, the design should ensure that they do not obstruct the driver's view while still satisfying the user's infotainment needs. Summary of the Invention

[0006] The problem to be solved

[0007] The purpose of this invention is to solve the aforementioned problems and other issues.

[0008] According to some embodiments of the present invention, the object of the present invention is to provide a vehicle display device having a plurality of displays that can change shape to ensure the driver's field of vision while improving the infotainment experience in various situations, and a method of operating the same thereof.

[0009] In addition, according to some embodiments of the present invention, another object of the present invention is to provide a vehicle display device having a plurality of displays and a method of operating the thereof, wherein the plurality of displays can be adapted to the vehicle's driving conditions, the needs of the passengers and the content / services provided in an optimal shape.

[0010] Technical solutions to the problem

[0011] Therefore, the vehicle display device and its operating method according to embodiments of the present invention can drive at least a plurality of displays, including a flexible display panel, to transform into an optimal form based on at least one of the vehicle's driving conditions, the characteristics of the content or service to be displayed, and an input request.

[0012] The vehicle display device can be driven to display different forms depending on whether the vehicle is moving or parked.

[0013] In addition, when transforming the form of multiple displays based on the attributes of the requested content / service or the user's direct request, the vehicle display device considers the vehicle's driving conditions to determine whether the form transformation is feasible.

[0014] Specifically, the vehicle display device of this invention includes: a body capable of being mounted on the dashboard of a vehicle; a plurality of displays formed on the front of the body, including a first display, a second display configured to be partially flexible, and a third display configured to change the size of the displayed image; and a processor. The processor, in response to sensing vehicle movement, can change the first form to a second form different from the first form while the second display of the plurality of displays is in a flat first form. It determines a request to change to the second form based on at least one of vehicle detection data, content displayed on the plurality of displays, and an input request. It then confirms whether the change to the second form is feasible based on the vehicle's driving conditions and controls the plurality of displays to perform the change to the determined form.

[0015] In one embodiment, the second configuration may be a structure in which the second display moves relative to the first direction and is at least partially bent. Additionally, the processor may transmit signals for a change to the second configuration to a plurality of the displays in response to vehicle driving sensing signals.

[0016] In one embodiment, the first configuration may be a structure in which the second display moves relative to a second direction opposite to the first direction and becomes flat. Additionally, the processor may transmit signals for changing to the first configuration to a plurality of the displays in response to a vehicle stop signal.

[0017] In an embodiment, the change request of the second form can occur based on at least one of the following: vehicle driving mode based on the vehicle's detection data, attributes of the content displayed on the plurality of displays, and user input requests for the plurality of displays. Additionally, the processor can consider the vehicle's driving conditions related to the vehicle's detection data to determine whether to accept the occurring change request of the second form.

[0018] In one embodiment, the third display may be a structure supported by a first frame and a second frame configured to move relative to the first frame. Additionally, the processor may generate a shape change request event based on the attributes of the content displayed on the plurality of displays and input requests, causing the front exposed area to change with the relative movement of the second frame, thereby changing the screen size of the third display.

[0019] In one embodiment, the processor can identify the content displayed on the plurality of displays as infotainment attributes, and generate a form change request event for changing the screen size of the third display based on an input request for the second display.

[0020] In an embodiment, the second display can operate in one of the following modes: a flat panel mode where the display is a plane, a first bending mode where at least a portion of the display has a different degree of curvature, and a second bending mode. In the second mode, the processor can generate a shape change request event for the second display to change from the first bending mode to the second bending mode based on a usage request for the third display.

[0021] In an embodiment, when a region of the second display is touched in the second state, the processor can recognize it as a use request for the third display and generate a form change request event for changing to a second bending mode in which the curvature of the curved portion of the second display changes and the lower end rises and falls.

[0022] In one embodiment, the second display may be a structure that changes the screen orientation of the display by rotating relative to the main body. Additionally, the processor may generate a shape change request event for the second display to restore its curvature and change the screen orientation by relative rotation, based on at least one of the attributes of the content displayed on the plurality of displays and a user input request.

[0023] In one embodiment, during the period when a driving attention pattern is sensed based on the detection data, the processor may determine whether to maintain the second mode or the current mode. Here, the driving attention pattern may include driver driving on a general road based on the detection data.

[0024] In an embodiment, during a period when the driving attention mode is not sensed, the processor may, based on at least one of the attributes of the content of the expandable screen and a user input request, sequentially or simultaneously make a first request to change the display orientation of the second display and a second request to change the screen size of the third display.

[0025] In an embodiment, the second form change request may include a request to expand at least one of the contents onto two or more displays among the first to third displays after a form change based on the first and second requests. Additionally, during periods when the driver is sensed to be driving based on the vehicle's driving conditions, the processor may control the process so that at least one of the contents is not expanded onto the first display.

[0026] In an embodiment, when at least one of the contents is extended to the second display and the third display according to the second form change request, the processor determines the display mode of the content based on the content's attributes and the form to be changed, and changes the clipping area used for screen extension according to the determined display mode and executes the change.

[0027] In one embodiment, the processor can detect driver movement based on vehicle driving conditions and maintain the current configuration of the plurality of displays based on at least one of the stated contents being driving restriction content. In this case, the processor can display at least one of the stated contents by executing a switchable privacy mode (SPM) for the third display.

[0028] In an embodiment, after the change to the second form, the processor may, taking into account the vehicle's driving status based on the vehicle's detection data, control a plurality of displays to transform the changed form back to the previous state or the second form.

[0029] Invention Effects

[0030] According to the vehicle display device and its operation method according to embodiments of the present invention, the configuration of a plurality of displays is changed to an optimal configuration to match the vehicle's driving conditions, the needs of the passengers, and the content / services provided, thereby ensuring the driver's field of vision and improving the infotainment experience in various situations.

[0031] Furthermore, the vehicle display device and its operation method according to embodiments of the present invention provide an experience in which the form changes according to the current driving mode of the vehicle, thereby providing related content or services in a more efficient and seamless format.

[0032] Furthermore, according to the vehicle display device and its operation method according to embodiments of the present invention, the passenger in the front passenger seat does not need to request the operation of the display, and the driver and passenger can operate the display by linking their respective devices with the display without interfering with each other.

[0033] Furthermore, the vehicle display device and its operation method according to embodiments of the present invention can provide a variety of experiences, enabling the vehicle interior to be used as an office space such as a video conferencing space, a large-screen viewing space providing extended screen content, etc., as needed. Attached Figure Description

[0034] Figure 1 This is an example block diagram used to illustrate the configuration of a vehicle related to the present invention.

[0035] Figure 2a This is an example diagram of the display device of the present invention installed in a vehicle.

[0036] Figure 2b This is an example block diagram illustrating the specific configuration of the vehicle display device of the present invention.

[0037] Figure 2c and Figure 2d A diagram illustrating a display section of the present invention having a structure that can move up and down and is partially flexible.

[0038] Figure 3 and Figure 4 This is a diagram illustrating an example of a second display unit in a vehicle display device of the present invention being implemented at a size in one of a first configuration and a second configuration.

[0039] Figure 5 This is an example diagram illustrating the morphological deformation of the third display section in the vehicle display device of the present invention when the size changes.

[0040] Figure 6 This is an example diagram illustrating the morphological deformation of the second display section in the vehicle display device of the present invention when the orientation changes. Figure 7 yes Figure 6 An example diagram showing the morphological deformation of the third display section, where the size of the third display section further changes.

[0041] Figure 8 This is an example flowchart illustrating the operation method of a vehicle display device with morphological variations related to the present invention.

[0042] Figure 9 This diagram illustrates the morphological deformation in the vehicle display device of the present invention, in which the size of the third display unit corresponding to the passenger seat is changed by operating the second display unit.

[0043] Figure 10This is a diagram illustrating the morphological deformation of the second display unit in the vehicle display device of the present invention, which changes the degree of curvature of the second display unit according to an input request for the third display unit.

[0044] Figure 11 It is a block diagram used to illustrate the comprehensive control of morphological deformation among multiple displays based on various situations that may occur in a vehicle.

[0045] Figure 12 It is a block diagram used to illustrate the feasibility and range of variation of morphological deformation among multiple displays depending on whether the vehicle is in motion and the driving mode.

[0046] Figure 13 This is a flowchart illustrating how a request for a change of form is processed based on the vehicle's driving status, the attributes of the displayed content, and the input request.

[0047] Figure 14a It is a flowchart illustrating various operation modes for displaying content on multiple displays according to a requested display mode.

[0048] Figure 14b This is a flowchart illustrating how content can be seamlessly displayed on multiple monitors according to a requested display mode. Figure 15a and Figure 15b It is used to explain about Figure 14b The cropping region can be applied variably. Detailed Implementation

[0049] The embodiments disclosed in this specification will be described in detail below with reference to the accompanying drawings. Here, identical or similar constituent elements are given the same reference numerals regardless of the drawing numbers, and repeated descriptions of them will be omitted. The suffixes "module" and "part" used for constituent elements in the following description are assigned or used interchangeably only for ease of writing and do not inherently have a distinguishing meaning or function. Furthermore, in the process of describing the embodiments disclosed in this specification, if it is determined that a detailed description of related well-known technologies would obscure the essence of the embodiments disclosed in this specification, a detailed description of those technologies will be omitted. Moreover, the accompanying drawings are only for ease of understanding of the embodiments disclosed in this specification and should not be used to limit the technical ideas disclosed in this specification. Rather, they should be understood to cover all modifications, equivalents, and even substitutions included within the scope of the invention's ideas and techniques.

[0050] The terms "first," "second," etc., which contain ordinal numbers, can be used to describe various constituent elements, but the constituent elements are not limited by the terms. The terms are used only for the purpose of distinguishing one constituent element from other constituent elements.

[0051] When a component is mentioned as being "connected" or "coupled" to another component, it may mean that it is directly connected or coupled to the other component, but it can also be understood as meaning that there are other components between them. Conversely, when a component is mentioned as being "directly connected" or "directly coupled" to another component, it should be understood as meaning that there are no other components between them.

[0052] Unless the context clearly indicates otherwise, the singular form should include the plural form.

[0053] In this application, terms such as “comprising” or “having” are used only to specify the presence of features, figures, steps, operations, constituent elements, components or combinations thereof described in the specification, and are not intended to preclude the possibility of the presence or addition of one or more other features or figures, steps, operations, constituent elements, components or combinations thereof.

[0054] Figure 1 This is an example block diagram used to illustrate the configuration of a vehicle related to the present invention.

[0055] Reference Figure 1 The vehicle 100 may include: wheels that are rotated by a power source; and a steering input device 510 for adjusting the direction of travel of the vehicle 100.

[0056] Vehicle 100 may be an autonomous vehicle. Vehicle 100 may switch to autonomous driving mode or manual mode based on user input. For example, vehicle 100 may switch from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on user input received through user interface device (hereinafter referred to as "user terminal") 200.

[0057] Vehicle 100 can switch between autonomous driving mode and manual mode based on driving status information. The driving status information can be generated based on object information provided by object detection device 300. For example, vehicle 100 can switch from manual mode to autonomous driving mode or vice versa based on driving status information generated in object detection device 300. Alternatively, vehicle 100 can switch from manual mode to autonomous driving mode or vice versa based on driving status information received via communication device 400.

[0058] Vehicle 100 can switch from manual mode to autonomous driving mode or vice versa based on information, data and signals provided by external devices.

[0059] When vehicle 100 is operating in autonomous mode, autonomous vehicle 100 can operate based on operating system 700. For example, autonomous vehicle 100 can operate based on information, data, or signals generated in driving system 710, vehicle dispatch system 740, and parking system 750.

[0060] When the vehicle 100 is operating in manual mode, the autonomous vehicle 100 can receive user input for driving via the driving control device 500. Based on the user input received via the driving control device 500, the vehicle 100 can operate.

[0061] The vehicle 100 may include a user interface device 200, an object detection device 300, a communication device 400, a driving operation device 500, a vehicle drive device 600, an operating system 700, a navigation system 770, a detection unit 120, a vehicle interface unit 130, a memory 140, a control unit 170, and a power supply unit 190.

[0062] According to the embodiments, the vehicle 100 may include other constituent elements in addition to those described in this specification, or may exclude some of the constituent elements described.

[0063] User interface device 200 is a means for communication between vehicle 100 and user. User interface device 200 receives user input and can provide information generated in vehicle 100 to user. Vehicle 100 can implement UI (User Interfaces) or UX (User Experience) through user interface device (hereinafter, may be referred to as "user terminal") 200.

[0064] User interface device 200 may include an input unit 210, an internal camera 220, a biometric sensor 230, an output unit 250, and a processor 270. According to an embodiment, user interface device 200 may include other components besides those described, or may exclude some of the described components.

[0065] The input unit 210 is used to receive information from the user. The data collected in the input unit 210 is analyzed by the processor 270 and can be processed into the user's control commands.

[0066] The input unit 210 can be located inside the vehicle. For example, the input unit 210 can be located in an area of ​​the steering wheel, an area of ​​the instrument panel, an area of ​​the seat, an area of ​​each pillar, an area of ​​the door, an area of ​​the center console, an area of ​​the headlining, an area of ​​the sun visor, an area of ​​the windshield, or an area of ​​the window, etc.

[0067] The input unit 210 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.

[0068] The voice input unit 211 can convert the user's voice input into an electrical signal. The converted electrical signal can be provided to the processor 270 or the control unit 170. The voice input unit 211 may include one or more microphones.

[0069] The gesture input unit 212 can convert the user's gesture input into an electrical signal. The converted electrical signal can be provided to the processor 270 or the control unit 170.

[0070] The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for sensing user gesture input. According to an embodiment, the gesture input unit 212 can sense three-dimensional gesture input from the user. For this purpose, the gesture input unit 212 may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.

[0071] The gesture input unit 212 can sense the user's three-dimensional gesture input through TOF (Time of Flight), structured light, or disparity methods.

[0072] The touch input unit 213 can convert the user's touch input into electrical signals. The converted electrical signals can be provided to the processor 270 or the control unit 170.

[0073] The touch input unit 213 may include a touch sensor for sensing user touch input. According to an embodiment, the touch input unit 213 is integrally formed with the display unit 251, thereby realizing a touchscreen. This touchscreen can together provide an input interface and an output interface between the vehicle 100 and the user.

[0074] The mechanical input unit 214 may include at least one of a button, a dome switch, a dial, and a toggle switch. The electrical signals generated by the mechanical input unit 214 can be provided to the processor 270 or the control unit 170. The mechanical input unit 214 may be arranged in the steering wheel, central instrument panel, center console, cockpit module, door, etc.

[0075] The interior camera 220 can acquire images of the vehicle's interior. The processor 270 can sense the user's state based on the images of the vehicle's interior. The processor 270 can acquire the user's gaze information from the images of the vehicle's interior. The processor 270 can sense the user's gestures from the images of the vehicle's interior.

[0076] The biometric sensing unit 230 can acquire a user's biometric information. The biometric sensing unit 230 includes a sensor capable of acquiring a user's biometric information, such as fingerprint information and heart rate information. This biometric information can be used for user authentication.

[0077] The output unit 250 is used to generate outputs related to vision, hearing, or touch. The output unit 250 may include at least one of a display unit, a sound output unit 252, and a tactile output unit 253.

[0078] On the other hand, the display unit may refer to the vehicle display device 800 of the present invention or a plurality of displays thereof. Alternatively, the vehicle display device 800 of the present invention may also be included as one of the display units.

[0079] Furthermore, on the other hand, the user interface device 200 can be understood as having the same concept as the vehicle display device 800 of the present invention. In this case, Figure 1 The user interface device 200 includes a plurality of constituent elements and Figure 2b At least some of the plurality of constituent elements of the vehicle display device 800 can be understood as the same concept.

[0080] The display unit can display graphic objects corresponding to various information. The display unit may include at least one of liquid crystal display (LCD), thin film transistor-liquid crystal display (TFTLCD), organic light-emitting diode (OLED), flexible display, 3D display, and e-ink display.

[0081] The display unit and the touch input unit 213 can be formed into a layer structure or integrally formed, thereby realizing a touch screen.

[0082] The display can be implemented using a HUD (Head-Up Display). When the display is implemented using a HUD, the display has a transmission module that can output information through images transmitted to the windshield or window.

[0083] The display unit may include a transparent display. The transparent display may be attached to a windshield or window. The transparent display has a specified transparency level and can display a specified image. To achieve transparency, the transparent display may include at least one of the following: transparent TFEL (Thin Film Electroluminescent), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, and transparent LED (Light Emitting Diode) display. The transparency of the transparent display is adjustable.

[0084] On the other hand, the user interface device 200 may include a plurality of display units. In this case, the plurality of display units may be located in various areas within the vehicle.

[0085] The sound output unit 252 converts the electrical signals provided by the processor 270 or the control unit 170 into audio signals and outputs them. For this purpose, the sound output unit 252 may include more than one speaker.

[0086] The tactile output unit 253 generates tactile output. For example, the tactile output unit 253 can make the user recognize the output by causing the steering wheel, seat belt, or seat to vibrate.

[0087] The processor (hereinafter referred to as the "control unit") 270 can control the overall operation of each unit of the user interface device 200. That is, the user interface device 200 can operate according to the control of the control unit 170.

[0088] According to an embodiment, the user interface device 200 may include a plurality of processors 270, or may not include processors 270.

[0089] If the user interface device 200 does not include the processor 270, the user interface device 200 can operate according to the control of the processor or control unit 170 of other devices in the vehicle 100.

[0090] The object detection device 300 is a device for detecting objects located outside the vehicle 100. Objects can be various objects related to the operation of the vehicle 100. For example, objects may include lanes, other vehicles, pedestrians, two-wheeled vehicles, traffic signals, lights, roads, structures, speed bumps, terrain features, animals, etc.

[0091] On the other hand, objects can be classified into moving objects and stationary objects. For example, moving objects can include concepts such as other vehicles and pedestrians. Stationary objects can include concepts such as traffic signals, roads, and structures.

[0092] The object detection device 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.

[0093] According to the embodiments, the object detection device 300 may include other components in addition to the components described, or may exclude some of the components described.

[0094] To acquire images of the vehicle's exterior, camera 310 can be positioned appropriately outside the vehicle. Camera 310 can be a single camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360-degree camera.

[0095] For example, to acquire an image of the front of the vehicle, camera 310 can be positioned inside the vehicle's interior near the windshield. Alternatively, camera 310 can be positioned around the front bumper or radiator grille.

[0096] For example, to acquire an image of the area behind the vehicle, camera 310 can be positioned inside the vehicle near the rear window. Alternatively, camera 310 can be positioned around the rear bumper, trunk, or tailgate.

[0097] For example, to acquire images of the side of the vehicle, camera 310 can be positioned inside the vehicle near at least one side window. Alternatively, camera 310 can be positioned around a rearview mirror, fender, or door.

[0098] The camera 310 can provide the acquired images to the processor 370.

[0099] Radar 320 may include an electromagnetic wave transmitter and a receiver. Based on the principle of radio wave transmission, radar 320 can be implemented as either a pulse radar or a continuous wave radar. In the continuous wave radar mode, radar 320 can be implemented using either FMCW (Frequency Modulated Continuous Wave) or FSK (Frequency Shift Keying) modes, depending on the signal waveform.

[0100] Radar 320 can detect objects using electromagnetic waves as a medium, based on TOF (Time of Flight) or phase-shift methods. It can detect the position of the detected object, the distance between the detected objects, and the relative speed.

[0101] To sense objects located in front of, behind, or to the side of the vehicle, the radar 320 can be positioned at an appropriate location on the exterior of the vehicle.

[0102] The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented in a TOF (Time of Flight) mode or a phase-shift mode.

[0103] The LiDAR 330 can be implemented as either driven or non-driven.

[0104] When implemented as a driven system, the lidar 330 is rotated by a motor and can detect objects around the vehicle 100.

[0105] When implemented as a non-driven system, the lidar 330 can utilize optical steering to detect objects within a defined range relative to the vehicle 100. The vehicle 100 may include a plurality of non-driven lidars 330.

[0106] The LiDAR 330 can use laser as the light medium to detect objects based on TOF (Time of Flight) or phase-shift methods. It can detect the position of the detected object, the distance between the detected objects, and the relative speed.

[0107] To sense objects located in front of, behind, or to the side of the vehicle, the LiDAR 330 can be positioned at an appropriate location on the exterior of the vehicle.

[0108] The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. Based on the ultrasonic detection object, the ultrasonic sensor 340 can detect the position of the detected object, the distance between the ultrasonic sensor and the detected object, and the relative speed.

[0109] To sense objects located in front of, behind, or to the side of the vehicle, the ultrasonic sensor 340 can be positioned at an appropriate location on the exterior of the vehicle.

[0110] The infrared sensor 350 may include an infrared transmitter and a receiver. Based on infrared light, the infrared sensor 350 detects objects and can detect the position of the detected object, the distance between the two objects, and their relative speed.

[0111] In order to sense objects located in front of, behind or to the side of the vehicle, the infrared sensor 350 can be positioned at an appropriate location on the exterior of the vehicle.

[0112] The processor 370 can control the overall operation of each unit of the object detection device 300.

[0113] Processor 370 can detect and track objects based on acquired images. Processor 370 can perform actions such as distance calculation and relative velocity calculation between itself and objects using image processing algorithms.

[0114] Processor 370 can detect and track objects based on reflected electromagnetic waves returned by the object after the transmitted electromagnetic waves are reflected. Processor 370 can perform actions such as distance calculation and relative velocity calculation between itself and the object based on the electromagnetic waves.

[0115] Processor 370 can detect and track objects based on the reflected laser light returned by the object after the emitted laser light is reflected back. Processor 370 can perform actions such as distance calculation and relative speed calculation between itself and the object based on the laser light.

[0116] Processor 370 can detect and track objects based on reflected ultrasonic waves that are reflected back from the object after being emitted. Processor 370 can perform actions such as distance calculation and relative speed calculation between itself and the object based on the ultrasonic waves.

[0117] Processor 370 can detect and track objects based on reflected infrared light returned by the object after the emitted infrared light is reflected. Processor 370 can perform actions such as distance calculation and relative speed calculation between itself and the object based on the infrared light.

[0118] According to an embodiment, the object detection device 300 may include a plurality of processors 370 or may not include processors 370. For example, the camera 310, radar 320, lidar 330, ultrasonic sensor 340, and infrared sensor 350 may each include a processor.

[0119] In the absence of a processor 370, the object detection device 300 can operate according to the control of a processor or control unit 170 within the vehicle 100.

[0120] The object detection device 300 can operate according to the control of the control unit 170.

[0121] The communication device 400 is a device for performing communication with external devices. Here, the external device may be another vehicle, a mobile terminal, or a server.

[0122] In order to perform communication, the communication device 400 may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element.

[0123] The communication device 400 may include a short-range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transceiver unit 450, and a processor 470.

[0124] According to the embodiments, the communication device 400 may include other components in addition to the components described, or may exclude some of the components described.

[0125] The short-range communication unit 410 is a unit for short-range communication. The short-range communication unit 410 can support short-range communication using at least one of the following technologies: Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus).

[0126] The short-range communication unit 410 can perform short-range communication between the vehicle 100 and at least one external device by forming a short-range wireless area network.

[0127] The location information unit 420 is a unit used to acquire the location information of the vehicle 100. For example, the location information unit 420 may include a GPS (Global Positioning System) module or a DGPS (Differential Global Positioning System) module.

[0128] The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infrastructure), other vehicles (V2V: Vehicle to Vehicle), or pedestrians (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include RF circuitry capable of implementing V2I communication with infrastructure, V2V communication between vehicles, and V2P communication protocols with pedestrians.

[0129] The optical communication unit 440 is a unit for communicating with external devices using light as a medium. The optical communication unit 440 may include: an optical transmitting unit that converts electrical signals into optical signals and transmits them to the outside; and an optical receiving unit that converts received optical signals into electrical signals.

[0130] According to an embodiment, the light transmitting unit may be integrally formed with a lamp included in the vehicle 100.

[0131] The broadcast transceiver unit 450 is a unit used to receive broadcast signals from an external broadcast management server or to send broadcast signals to the broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel. The broadcast signal may include TV broadcast signals, wireless broadcast signals, and data broadcast signals.

[0132] The processor 470 can control the overall operation of each unit of the communication device 400.

[0133] According to an embodiment, the communication device 400 may include a plurality of processors 470, or may not include processors 470.

[0134] If the communication device 400 does not include the processor 470, the communication device 400 can operate according to the control of the processor or control unit 170 of other devices in the vehicle 100.

[0135] On the other hand, the communication device 400 can be used together with the user interface device 200 to implement a vehicle display device. In this case, the vehicle display device can be named a telematics device or an AVN (Audio Video Navigation) device.

[0136] The communication device 400 can operate under the control of the control unit 170.

[0137] The driving control device 500 is a device that receives user input for driving.

[0138] In manual mode, vehicle 100 can operate based on signals provided by driving control device 500.

[0139] The driving control device 500 may include a steering input device 510, an acceleration input device 530, and a braking input device 570.

[0140] The steering input device 510 can receive the driving direction input of the vehicle 100 from the user. The steering input device 510 is preferably configured as a wheel to enable steering input by rotation. According to an embodiment, the steering input device may also be configured as a touch screen, touchpad, or button.

[0141] The accelerator input device 530 can receive input from the user for accelerating the vehicle 100. The brake input device 570 can receive input from the user for decelerating the vehicle 100. The accelerator input device 530 and the brake input device 570 are preferably configured as pedals. According to an embodiment, the accelerator input device or the brake input device may also be configured as a touchscreen, touchpad, or button.

[0142] The driving control device 500 can operate according to the control unit 170.

[0143] The vehicle drive unit 600 is a device that drives various devices within the electrically controlled vehicle 100.

[0144] The vehicle drive unit 600 may include a power transmission drive unit 610, a chassis drive unit 620, a door / window drive unit 630, a safety device drive unit 640, a light drive unit 650, and an air conditioning drive unit 660.

[0145] According to the embodiments, the vehicle drive unit 600 may include other components in addition to the components described, or may exclude some of the components described.

[0146] On the other hand, the vehicle drive unit 600 may include a processor. Each of the various units of the vehicle drive unit 600 may individually include a processor.

[0147] The power transmission drive unit 610 can control the operation of the power transmission device.

[0148] The power transmission drive unit 610 may include a power source drive unit 611 and a transmission drive unit 612.

[0149] The power source drive unit 611 can control the power source of the vehicle 100.

[0150] For example, when a fossil fuel-based engine is used as the power source, the power source drive unit 610 can perform electronic control of the engine. This allows for control of the engine's output torque, etc. The power source drive unit 611 can adjust the engine's output torque according to the control unit 170.

[0151] For example, when the power source is an electric motor, the power source drive unit 610 can control the motor. The power source drive unit 610 can adjust the motor's speed, torque, etc., according to the control unit 170.

[0152] The transmission drive unit 612 can control the transmission. The transmission drive unit 612 can adjust the state of the transmission. The transmission drive unit 612 can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or park (P).

[0153] On the other hand, when the engine is the power source, the transmission drive unit 612 can adjust the gear meshing state in the forward D state.

[0154] The chassis drive unit 620 can control the movement of the chassis assembly. The chassis drive unit 620 may include a steering drive unit 621, a braking drive unit 622, and a suspension drive unit 623.

[0155] The steering drive unit 621 can perform electronic control of the steering apparatus within the vehicle 100. The steering drive unit 621 can change the direction of travel of the vehicle.

[0156] The brake drive unit 622 can perform electronic control of the brake apparatus within the vehicle 100. For example, the speed of the vehicle 100 can be reduced by controlling the operation of the brakes arranged on the wheels.

[0157] On the other hand, the brake drive unit 622 can control each of the plurality of brakes individually. The brake drive unit 622 can control the braking force applied to the plurality of wheels differently from each other.

[0158] The suspension drive unit 623 can perform electronic control of the suspension apparatus within the vehicle 100. For example, when the road surface is curved, the suspension drive unit 623 can reduce the vibration of the vehicle 100 by controlling the suspension apparatus. On the other hand, the suspension drive unit 623 can control each of the plurality of suspensions individually.

[0159] The door / window drive unit 630 can perform electronic control of the door apparatus or window apparatus inside the vehicle 100.

[0160] The door / window drive unit 630 may include a door drive unit 631 and a window drive unit 632.

[0161] The door drive unit 631 can control the door assembly. The door drive unit 631 can control the opening and closing of a plurality of doors included in the vehicle 100. The door drive unit 631 can control the opening and closing of the trunk or tailgate. The door drive unit 631 can control the opening and closing of the sunroof.

[0162] The window drive unit 632 can perform electronic control of the window apparatus. It can control the opening or closing of a plurality of windows, including those in the vehicle 100.

[0163] The safety device drive unit 640 can perform electronic control of various safety devices within the vehicle 100.

[0164] The safety device drive unit 640 may include an airbag drive unit 641, a seat belt drive unit 642, and a pedestrian protection device drive unit 643.

[0165] The airbag actuator 641 can electronically control the airbag apparatus within the vehicle 100. For example, the airbag actuator 641 can be controlled to deploy the airbag when a hazard is sensed.

[0166] The seatbelt drive unit 642 can electronically control the seatbelt apparatus within the vehicle 100. For example, the seatbelt drive unit 642 can be controlled to secure the passenger to the seat 110FL, 110FR, 110RL, or 110RR using the seatbelt when a hazard is detected.

[0167] The pedestrian protection device drive unit 643 can electronically control the hood lift and the pedestrian airbag. For example, the pedestrian protection device drive unit 643 can be controlled to raise the hood lift and deploy the pedestrian airbag when a collision with a pedestrian is detected.

[0168] The lamp drive unit 650 can perform electronic control of various lamp apparatuses within the vehicle 100.

[0169] The air conditioning drive unit 660 can electronically control the air conditioning unit inside the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning drive unit 660 can control the air conditioning unit to operate and supply cool air to the vehicle interior.

[0170] The vehicle drive unit 600 may include a processor. Each of the various units of the vehicle drive unit 600 may individually include a processor.

[0171] The vehicle drive unit 600 can operate under the control of the control unit 170.

[0172] The operating system 700 is a system that controls various operations of the vehicle 100. The operating system 700 can operate in autonomous driving mode.

[0173] The operating system 700 may include a driving system 710, a vehicle dispatching system 740, and a parking system 750.

[0174] According to the embodiments, the operating system 700 may include other components in addition to the components described, or may exclude some of the components described.

[0175] On the other hand, the operating system 700 may include a processor. Each of the various units in the operating system 700 may individually include a processor.

[0176] On the other hand, according to the embodiment, when the operating system 700 is implemented by software, it may also be a subordinate concept of the control unit 170.

[0177] On the other hand, according to an embodiment, the operating system 700 may be a concept including at least one of a user interface device 200, an object detection device 300, a communication device 400, a vehicle drive device 600, and a control unit 170.

[0178] The driving system 710 can drive the vehicle 100.

[0179] The driving system 710 can receive navigation information from the navigation system 770 and provide control signals to the vehicle drive unit 600, thereby enabling the driving of the vehicle 100. The driving system 710 can also receive object information from the object detection device 300 and provide control signals to the vehicle drive unit 600, thereby enabling the driving of the vehicle 100. Furthermore, the driving system 710 can receive signals from external devices via the communication device 400 and provide control signals to the vehicle drive unit 600, thereby enabling the driving of the vehicle 100.

[0180] The vehicle dispatch system 740 can dispatch vehicle 100.

[0181] The vehicle dispatch system 740 can receive navigation information from the navigation system 770 and provide control signals to the vehicle drive unit 600, thereby enabling the dispatch of vehicle 100. The vehicle dispatch system 740 can also receive object information from the object detection device 300 and provide control signals to the vehicle drive unit 600, thereby enabling the dispatch of vehicle 100. Furthermore, the vehicle dispatch system 740 can receive signals from external devices via the communication device 400 and provide control signals to the vehicle drive unit 600, thereby enabling the dispatch of vehicle 100.

[0182] Parking system 750 can park 100 vehicles.

[0183] The parking system 750 can receive navigation information from the navigation system 770 and provide control signals to the vehicle drive unit 600, thereby enabling the parking of the vehicle 100. The parking system 750 can also receive object information from the object detection device 300 and provide control signals to the vehicle drive unit 600, thereby enabling the parking of the vehicle 100. Furthermore, the parking system 750 can receive signals from external devices via the communication device 400 and provide control signals to the vehicle drive unit 600, thereby enabling the parking of the vehicle 100.

[0184] The navigation system 770 can provide navigation information. The navigation information may include at least one of the following: map information, set destination information, route information set based on the destination, information on various objects on the route, lane information, and the vehicle's current location information.

[0185] The navigation system 770 may include a memory and a processor. The memory can store navigation information. The processor can control the operation of the navigation system 770.

[0186] According to an embodiment, the navigation system 770 can receive information from an external device via the communication device 400 and can update pre-stored information.

[0187] According to the embodiments, the navigation system 770 can also be classified as a subordinate component of the user interface device 200.

[0188] The detection unit 120 can sense the state of the vehicle. The detection unit 120 may include attitude sensors (e.g., yaw sensor, roll sensor, pitch sensor), collision sensors, wheel sensors, speed sensors, tilt sensors, weight sensors, heading sensors, yaw sensors, gyro sensors, position modules, vehicle forward / reverse sensors, battery sensors, fuel sensors, tire sensors, steering sensors based on steering wheel rotation, vehicle interior temperature sensors, vehicle interior humidity sensors, ultrasonic sensors, illuminance sensors, accelerator pedal position sensors, brake pedal position sensors, etc.

[0189] The detection unit 120 can acquire sensing signals such as vehicle posture information, vehicle collision information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / reverse information, battery information, fuel information, tire information, vehicle light information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illuminance, pressure applied to the accelerator pedal, and pressure applied to the brake pedal.

[0190] In addition, the detection unit 120 may also include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a coolant temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.

[0191] The vehicle interface unit 130 can function as a conduit for various types of external devices connected to the vehicle 100. For example, the vehicle interface unit 130 may have a port capable of connecting to a mobile terminal, through which data can be exchanged. In this case, the vehicle interface unit 130 can exchange data with the mobile terminal.

[0192] On the other hand, the vehicle interface unit 130 can function as a channel for supplying power to the connected mobile terminal. When the mobile terminal is electrically connected to the vehicle interface unit 130, the vehicle interface unit 130 can supply power from the power supply unit 190 to the mobile terminal under the control of the control unit 170.

[0193] The memory 140 is electrically connected to the control unit 170. The memory 140 can store basic data of the unit, control data for the unit's operation control, and input / output data. In terms of hardware, the memory 140 can be various storage devices such as ROM, RAM, EPROM, flash memory drive, and hard disk drive. The memory 140 can store various data related to the overall operation of the vehicle 100, such as programs for processing or controlling the control unit 170.

[0194] According to an embodiment, the memory 140 may be integrally formed with the control unit 170, or may be implemented by a lower-level component of the control unit 170.

[0195] The control unit 170 can control the overall operation of various units within the vehicle 100. The control unit 170 can be named ECU (Electronic Control Unit).

[0196] The power supply unit 190 can supply the power required for the operation of each component according to the control of the control unit 170. In particular, the power supply unit 190 can receive power from the battery or the like inside the vehicle.

[0197] The vehicle 100 may include one or more processors and control units 170 that can be implemented using at least one of ASICs (application-specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field-programmable gate arrays), processors, controllers, microcontrollers, microprocessors, and electrical units for performing other functions.

[0198] Figure 2a This is an example diagram showing the vehicle display device 800 of the present invention installed in a vehicle. Additionally, Figure 2b This is an example block diagram illustrating the detailed configuration of the display device of the present invention.

[0199] On the other hand, it can be understood that the vehicle display device 800 has the same characteristics as described above. Figure 1The user interface device 200 described herein is of the same or similar concept. However, the vehicle display device 800 described in this embodiment is mounted on the dashboard of the vehicle 100 and includes a plurality of displays.

[0200] like Figure 2a As shown, the display device 800 of this embodiment can be installed in the dashboard of a vehicle 100. The vehicle display device 800 can be implemented as including a plurality of displays in the dashboard, the plurality of displays extending along the length direction to correspond to the driver's seat position to the passenger seat position.

[0201] For example, the vehicle display device 800 can be installed on the vehicle's dashboard and display various devices used to control the driving of the vehicle or information required for driving the vehicle, or information necessary to provide convenience to the vehicle occupants, on a plurality of displays, namely display units 851.

[0202] Display unit 851 may include a first display unit 851a, a second display unit 851b, and a third display unit 851c, and these displays may be included within a frame. Additionally, as... Figure 2a As shown, the display unit 851 can be implemented as a wing type. Furthermore, the display unit 851 can be implemented as a seamless connection in the horizontal direction.

[0203] Reference Figure 2b The vehicle display device 800 may include a wireless communication unit 810, an input unit 820, a detection unit 840, an output unit 850, an interface unit 860, a memory 870, a control unit 880, and a power supply unit 890, etc. Figure 2b The components shown are not essential for realizing the vehicle display device. Therefore, the vehicle display device described in this specification may have more or fewer components than those listed above.

[0204] More specifically, the wireless communication unit 810 in the aforementioned components may include one or more modules enabling wireless communication between the vehicle display device 800 and a wireless communication system, between the vehicle display device 800 and other vehicle display devices 800, or between the vehicle display device 800 and an external server. Furthermore, the wireless communication unit 810 may include one or more modules connecting the vehicle display device 800 to one or more networks.

[0205] This wireless communication unit 810 may include at least one of the following modules: a broadcast receiving module 811, a mobile communication module 812, a wireless network module 813, a short-range communication module 814, and a location information module 815.

[0206] The input unit 820 may include a camera 821 or image input unit for image signal input, a microphone 822 or audio input unit for audio signal input, and a user input unit 823 for receiving information from the user (e.g., a touch key, a mechanical key, etc.). Voice or image data collected by the input unit 820 can be analyzed and processed into user control commands.

[0207] The detection unit 840 may include one or more sensors for detecting at least one of the following: information within the vehicle display device, information about the surrounding environment surrounding the vehicle display device, and user information. For example, the detection unit 840 may include at least one of the following: a proximity sensor 841, an illumination sensor 842, a touch sensor, an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor (IR sensor), a fingerprint sensor, an ultrasonic sensor, an optical sensor (e.g., a camera, see 821), a microphone (see 822), a battery gauge, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, a radiation monitoring sensor, a thermal sensor, a gas sensor, etc.), and a chemical sensor (e.g., an electronic nose, a health care sensor, a biometric sensor, etc.). On the other hand, the vehicle display device disclosed in this specification can combine information detected by at least two of such sensors.

[0208] The output unit 850 is used to generate outputs related to vision, hearing, or touch, and may include at least one of a display unit 851, a sound output unit 852, a haptic module 853, and a light output unit 854. The display unit 851 may be formed in a layered structure with the touch sensor or integrally formed therewith, thereby realizing a touch screen. This touch screen functions as a user input unit 823 that provides an input interface between the vehicle display device 800 and the user, while also providing an output interface between the vehicle display device 800 and the user.

[0209] The interface section 860 serves as a pathway for various types of external devices connected to the vehicle display device 800. This interface section 860 may include at least one of the following: a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device with an identification module, an audio I / O port, a video I / O port, and a headphone port. The vehicle display device 800 can connect to the interface section 860 and correspondingly perform appropriate controls related to the connected external device. Additionally, the memory 870 stores data supporting various functions of the vehicle display device 800. The memory 870 may store multiple application programs (or applications) running on the vehicle display device 800, data for the operation of the vehicle display device 800, and instructions. At least some of these application programs can be downloaded from an external server using wireless communication. Furthermore, at least a portion of such an application may be present in the vehicle display device 800 at the factory for the basic functions of the vehicle display device 800 (e.g., incoming and outgoing call functions, message receiving and sending functions). On the other hand, the application may be stored in the memory 870, installed on the vehicle display device 800, and driven by the control unit 880 to perform the actions (or functions) of the vehicle display device.

[0210] Typically, in addition to actions related to the application, the control unit 880 also controls the overall operation of the vehicle display device 800. The control unit 880 can process signals, data, information, etc., input or output through the aforementioned components, or drive the application stored in the memory 870, thereby providing or processing suitable information or functions to the user.

[0211] In addition, the control unit 880 can control the application stored in the memory 870 in order to drive it. Figure 2b At least some of the constituent elements described herein. Furthermore, the control unit 880 can combine and operate at least two of the constituent elements included in the vehicle display device 800 in order to drive the application.

[0212] The power supply unit 890, under the control of the control unit 880, receives external power and supplies power to the various components included in the vehicle display device 800. At least a portion of these components can cooperate with each other to implement the operation, control, or control methods of the vehicle display device according to the various embodiments described below. Furthermore, the operation, control, or control methods of the vehicle display device 800 can be displayed on the vehicle display device by driving at least one application program stored in the memory 870.

[0213] Before describing the various embodiments implemented by the vehicle display device 800 described above, please refer to the following: Figure 2b A more specific explanation of the constituent elements listed above will be provided.

[0214] First, the wireless communication unit 810 will be described. The broadcast receiving module 811 of the wireless communication unit 810 receives broadcast signals and / or broadcast-related information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel. To simultaneously receive broadcasts from at least two broadcast channels or switch between broadcast channels, the vehicle display device 800 may provide two or more of these broadcast receiving modules.

[0215] The broadcast management server can refer to a server that generates and sends broadcast signals and / or broadcast-related information, or a server that receives generated broadcast signals and / or broadcast-related information and sends them to the vehicle display device. The broadcast signals include not only TV broadcast signals, radio broadcast signals, and data broadcast signals, but also broadcast signals in the form of combining data broadcast signals with TV broadcast signals or radio broadcast signals.

[0216] The broadcast signal can be encoded according to at least one of the technical standards (or broadcasting methods, such as ISO, IEC, DVB, ATSC, etc.) used for transmitting and receiving digital broadcast signals, and the broadcast receiving module 811 can receive the digital broadcast signal in a manner that is suitable for the technical specifications specified in the technical standard.

[0217] The broadcast-related information may refer to information related to a broadcast channel, broadcast program, or broadcast service provider. The broadcast-related information may also be provided via a mobile communication network. In this case, it can be received by the mobile communication module 812. The broadcast-related information may exist in various forms, such as the EPG (Electronic Program Guide) for DMB (Digital Multimedia Broadcasting) or the ESG (Electronic Service Guide) for DVB-H (Digital Video Broadcast-Handled). The broadcast signal and / or broadcast-related information received by the broadcast receiving module 811 can be stored in the memory 860.

[0218] The mobile communication module 812 transmits and receives radio signals from at least one of a base station, an external terminal, and a server on a mobile communication network established according to technical standards or communication methods for mobile communication (e.g., GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.). The radio signals may include voice call signals, video call signals, or data in various forms transmitted and received according to text / multimedia messages.

[0219] The wireless network module 813 refers to a module used for wireless internet connectivity, which can be built into or externally placed in the vehicle display device 800. The wireless network module 813 is implemented to transmit and receive wireless signals in a communication network based on wireless internet technology.

[0220] As wireless internet technologies, such as WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct (Wireless Fidelity Direct), DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., the wireless network module 813 transmits and receives data based on at least one wireless internet technology, including those not listed above. From the perspective of realizing wireless Internet connection based on WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. through mobile communication network, it can also be understood that the wireless network module 813 that performs wireless Internet connection through the mobile communication network is a type of the mobile communication module 812.

[0221] The short-range communication module 814 is used for short-range communication and can support short-range communication using at least one of the following technologies: Bluetooth (Bluetooth™ Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus). This short-range communication module 814 can support wireless communication between the vehicle display device 800 and the wireless communication system, between the vehicle display device 800 and other vehicle display devices 800, or between networks where the vehicle display device 800 and other vehicle display devices 800 (or external servers) reside. The short-range wireless communication network can be a wireless personal area network (BPAN).

[0222] The location information module 815 is used to obtain the location (or current location) of the vehicle display device. Representative examples of location information modules include GPS (Global Positioning System) modules or Wi-Fi (Wireless Fidelity) modules. For example, if GPS is used, the vehicle display device can obtain its location using signals transmitted by Global Positioning System satellites. As another example, if a Wi-Fi module is used, the vehicle display device can obtain its location based on information from a wireless access point (AP) that transmits and receives wireless signals with the Wi-Fi module. As needed, the location information module 815 can, in order to obtain data about the location of the vehicle display device, replace or additionally perform any function of other modules in the wireless communication unit 810. The location information module 815 is a module used to obtain the location (or current location) of the vehicle display device, and is not limited to modules that directly calculate or obtain the location of the vehicle display device.

[0223] Next, the input unit 820 is used to input image information (or signals), audio information (or signals), data, or information input by the user. For image information input, the vehicle display device 800 may have one or more cameras 821. The cameras 821 process image frames such as still images or videos obtained by the image sensor in video call mode or shooting mode. The processed image frames may be displayed on the display unit 851 or stored in the memory 870. On the other hand, the multiple cameras 821 provided on the vehicle display device 800 may be arranged in a matrix structure. Through such a matrix structure of cameras 821, the vehicle display device 800 may be input with multiple image information having various angles or focal points. Alternatively, the multiple cameras 821 may be arranged in a stereoscopic structure to obtain left and right images for realizing stereoscopic images.

[0224] Microphone 822 processes external sound signals into electronic voice data. The processed voice data can be used differently depending on the function being executed (or the application being run) in the vehicle display device 800. On the other hand, microphone 822 can implement various noise removal algorithms for removing noise that occurs during the process of inputting external sound signals.

[0225] The user input unit 823 receives information from the user. If information is input through the user input unit 823, the control unit 880 can control the operation of the vehicle display device 800 to correspond to the input information. This user input unit 823 may include a mechanical input mechanism (or mechanical keys, such as buttons, dome switches, knobs, toggle switches, etc. located on the front, back, or side of the vehicle display device 800) and a touch input mechanism. For example, a touch input mechanism may consist of virtual keys, soft keys, or visual keys displayed on the touchscreen through software processing, or it may consist of touch keys located outside the touchscreen. On the other hand, the virtual keys or visual keys may be displayed on the touchscreen in various shapes, for example, as graphics, text, icons, videos, or combinations thereof.

[0226] On the other hand, the detection unit 840 detects at least one of the following: information within the vehicle display device, information about the surrounding environment of the vehicle display device, and user information, and generates a corresponding detection signal. The control unit 880 can control the driving or operation of the vehicle display device 800 based on this detection signal, or perform data processing, functions, or actions related to the application installed on the vehicle display device 800. A representative sensor among the various sensors that the detection unit 840 may include will be further described.

[0227] First, the proximity sensor 841 refers to a sensor that detects objects approaching a designated detection surface or detects the presence of objects nearby using electromagnetic force or infrared radiation without mechanical contact. This proximity sensor 841 can be arranged within the interior area of ​​a vehicle display device surrounded by the aforementioned touchscreen or near the touchscreen.

[0228] Examples of proximity sensors 841 include transmissive photoelectric sensors, direct reflection photoelectric sensors, specular reflection photoelectric sensors, high-frequency oscillation proximity sensors, capacitive proximity sensors, magnetic proximity sensors, and infrared proximity sensors. When the touchscreen is capacitive, the proximity sensor 841 can be configured to detect the approach of a conductive object by utilizing the change in the electric field caused by the object's proximity. In this case, the touchscreen (or touch sensor) itself can be classified as a proximity sensor.

[0229] On the other hand, for ease of explanation, the act of recognizing an object as being on the touchscreen when it approaches the touchscreen without actually touching it is called a "proximity touch," and the act of an object actually making contact with the touchscreen is called a "contact touch." The position on the touchscreen where an object is approaching and touching refers to the position of the object perpendicularly to the touchscreen when it is approached and touched. The proximity sensor 841 can sense proximity touches and proximity touch patterns (e.g., proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Furthermore, the control unit 880 can process the data (or information) corresponding to the proximity touch actions and proximity touch patterns sensed by the proximity sensor 841 as described above, and output visual information corresponding to the processed data on the touchscreen. Additionally, the control unit 880 can control the vehicle display device 800 to process different actions or data (or information) depending on whether a touch at the same position on the touchscreen is a proximity touch or a contact touch.

[0230] The touch sensor senses touch (or touch input) applied to the touch screen (or display unit 851) using at least one of various touch methods, such as resistive, capacitive, infrared, ultrasonic, and magnetic field methods.

[0231] As an example, a touch sensor can be configured to convert changes in pressure applied to a specific area of ​​the touchscreen or changes in capacitance occurring at that specific area into an electrical input signal. The touch sensor can also be configured to detect the position, area, pressure, and capacitance of a touch object applied to the touchscreen on the touch sensor. Here, the touch object is the object that applies the touch to the touch sensor, such as a finger, a stylus pen, or a pointer.

[0232] As described above, when there is touch input to the touch sensor, a corresponding signal is sent to the touch controller. After processing the signal, the touch controller transmits the corresponding data to the control unit 880. Thus, the control unit 880 can determine which area of ​​the display unit 851 has been touched, etc. Here, the touch controller can be a component independent of the control unit 880, or it can be the control unit 880 itself.

[0233] On the other hand, the control unit 880 can perform different or the same controls depending on the type of the object being touched by the touchscreen (or touch keys located outside the touchscreen). Whether to perform different or the same controls depending on the type of the object being touched can depend on the current operating state of the vehicle display device 800 or the application being run.

[0234] On the other hand, the aforementioned touch sensors and proximity sensors can detect various types of touches on the touchscreen, either independently or in combination, such as short touch, long touch, multi-touch, drag touch, flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc.

[0235] An ultrasonic sensor can use ultrasonic waves to identify the location information of a sensed object. On the other hand, the control unit 880 can calculate the location of the wave source using information sensed by an optical sensor and a plurality of ultrasonic sensors. The location of the wave source can be calculated using the property that light travels faster than ultrasound; that is, the time it takes for light to reach the optical sensor is much faster than the time it takes for ultrasound to reach the ultrasonic sensor. More specifically, the location of the wave source can be calculated using the time difference between the arrival time of light and ultrasound, with light as the reference signal.

[0236] On the other hand, the configuration of the input unit 820 will be described. The camera 821 includes at least one of a camera sensor (e.g., CCD, CMOS, etc.), a photoelectric sensor (or image sensor), and a laser sensor.

[0237] The camera 821 and the laser sensor can be combined to sense touch on a three-dimensional image of a sensing object. A photoelectric sensor can be stacked on the display element, configured to scan the movement of a sensing object approaching the touchscreen. More specifically, the photoelectric sensor can mount photodiodes and transistors in rows / columns, and use electrical signals that change according to the amount of light applied to the photodiodes to scan the contents placed on the photoelectric sensor. That is, the photoelectric sensor can calculate the coordinates of the sensing object based on the change in light intensity, thereby obtaining the position information of the sensing object.

[0238] Display unit 851 displays (outputs) information processed in vehicle display device 800. For example, display unit 851 may display running screen information of an application driven by vehicle display device 800, or UI (User Interface) or GUI (Graphic User Interface) information based on such running screen information.

[0239] Alternatively, the display unit 851 may be a stereoscopic display unit that displays stereoscopic images.

[0240] The stereoscopic display unit can apply three-dimensional display methods such as stereoscopic mode (glasses mode), automatic stereoscopic mode (glasses-free mode), and projection mode (holographic mode).

[0241] The audio output unit 852 can output audio data received from the wireless communication unit 810 or stored in the memory 870 in various modes, including call signal reception, call mode, recording mode, voice recognition mode, and broadcast reception mode. The audio output unit 852 also outputs audio signals related to functions performed by the vehicle display device 800 (e.g., call signal reception tone, message reception tone, etc.). This audio output unit 852 may include a receiver, a speaker, a buzzer, etc.

[0242] The haptic module 853 generates a variety of tactile effects that the user can perceive. A representative example of the tactile effects generated by the haptic module 853 is vibration. The intensity and mode of the vibration generated by the haptic module 853 can be controlled according to the user's selection or the settings of the control unit 880. For example, the haptic module 853 can synthesize different vibrations and output them, or it can output them sequentially.

[0243] In addition to vibration, the tactile module 853 can also produce various tactile effects, such as the effects of vertically moving pins relative to the skin surface, the jetting or suction of air through the nozzle or inlet, contact with the skin surface, contact with electrodes, electrostatic forces, and the reproduction of hot and cold sensations using elements that can absorb or generate heat.

[0244] The haptic module 853 can also be configured to transmit tactile effects not only through direct contact but also through the muscular sensation of the user's fingers or arms. Depending on the configuration of the vehicle display device 800, two or more haptic modules 853 can be provided.

[0245] The light output unit 854 uses light from the light source of the vehicle display device 800 to output a signal for notifying that an event has occurred. Examples of events occurring in the vehicle display device 800 include message reception, call signal reception, missed call, reminder, schedule reminder, email reception, and application-based information reception.

[0246] The signal output by the light output unit 854 is emitted as monochromatic or multi-color light by the vehicle display device towards the front or back. The signal output can be terminated by the vehicle display device sensing a user event.

[0247] The interface unit 860 serves as a pathway to all external devices connected to the vehicle display device 800. The interface unit 860 receives data or power from external devices and transmits it to various components within the vehicle display device 800, or transmits data from within the vehicle display device 800 to external devices. For example, the interface unit 860 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting devices with identification modules, an audio I / O port, a video I / O port, and a headphone port.

[0248] On the other hand, the identification module is a chip that stores various information for authenticating the access rights of the vehicle display device 800, and may include a user identification module (UIM), a subscriber identity module (SIM), a universal subscriber identity module (USIM), etc. The device with the identification module (hereinafter referred to as the "identification device") can be manufactured in the form of a smart card. Therefore, the identification device can be connected to the vehicle display device 800 via the interface section 860.

[0249] The memory 870 can store programs for the operation of the control unit 880, and can also temporarily store input / output data (e.g., phone book, messages, still images, videos, etc.). The memory 870 can store data on various modes of vibration and sound output when touch input occurs on the touch screen.

[0250] The memory 870 can store data about the changing modes that can be achieved through the plurality of displays constituting the display unit 851. Furthermore, the memory 870 can store various conditions for the changing modes of the plurality of displays, such as driving, driving stopped, specific driving modes (e.g., autonomous driving mode, parking mode, etc.), requested content / service attributes, and requests based on user input. Additionally, the memory 870 can also store data related to the changing modes according to control commands from the control unit 880, in order to memorize that mode.

[0251] The memory 870 may include at least one type of storage medium selected from flash memory, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory), random access memory (RAM), SRAM (static random access memory), read-only memory (ROM), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only memory), magnetic storage, magnetic disk, and optical disk. The vehicle display device 800 may also be associated with a web storage device that performs the storage functions of the memory 870 on the internet.

[0252] On the other hand, as mentioned above, the control unit 880 typically controls actions related to the application and the overall operation of the vehicle display device 800. For example, the control unit 880 may, when the state of the vehicle display device meets set conditions, operate in a locked state that restricts the user from inputting control commands to the application, or unlock that state.

[0253] In addition, the control unit 880 can perform control and processing related to voice calls, data communication, video calls, etc., or perform pattern recognition processing on handwriting input or drawing input on the touch screen so that it can be recognized as text and images.

[0254] In addition, the control unit 880 can control the driving mode of each of the plurality of displays in order to change the form of the display unit 851.

[0255] Specifically, the control unit 880 can determine the optimal display configuration based on the vehicle's driving status (such as vehicle detection data), the attributes of the requested content / service, and user input requests. Furthermore, the control unit 880 can consider the vehicle's current driving conditions to determine whether the configuration can be changed to the determined configuration, and then control the change to the corresponding configuration by transmitting control commands to at least a portion of the plurality of displays.

[0256] Furthermore, in order to implement the various embodiments described below on the vehicle display device 800 of the present invention, the control unit 880 can control any one of the aforementioned constituent elements or control them in combination.

[0257] Display unit 851 displays (outputs) information processed in vehicle display device 800. For example, display unit 851 may be the running screen information of an application driven in vehicle display device 800, or UI (User Interface) or GUI (Graphical User Interface) information based on such running screen information.

[0258] The display unit 851 may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0259] Furthermore, the display unit 851 may exist in more than two forms depending on the implementation of the vehicle display device 800. In this case, the plurality of display units may be arranged separately or integrally on one side of the vehicle display device 800, or they may be arranged on different sides of each other.

[0260] The display unit 851 may include a touch sensor that senses touch on the display unit 851, enabling it to receive control commands input via touch. Thus, if the display unit 851 is touched, the touch sensor senses the touch, and the control unit 880 can generate control commands corresponding to the touch. The content input via touch can be text or numbers, indicators in various modes, or specified menu items, etc.

[0261] The display unit 851 is configured to include a plurality of displays having a first display unit 851a, a second display unit 851b, and a third display unit 851c. Furthermore, at least a portion of the plurality of displays may be flexible displays. Additionally, at least a portion of the plurality of displays is configured to be able to move relative to each other, rotate relative to each other, bend outwards / inwards, or pop up / pop down according to control commands, thereby changing the shape of the display unit 851.

[0262] The first display unit 851a, the second display unit 851b, and the third display unit 851c can each display different content. In addition, two or more of the first display unit 851a, the second display unit 851b, and the third display unit 851c can be used as an extended screen to connect / link together the display of one or more related contents.

[0263] At least a portion of the first display unit 851a, the second display unit 851b, and the third display unit 851c can be driven into a different mode according to the control command of the control unit 880. In this case, the content displayed on at least a portion of the first display unit 851a, the second display unit 851b, and the third display unit 851c can be adjusted to have a screen ratio, screen size, screen orientation, and content attributes that match the changed mode.

[0264] The microphone 822 is configured to receive the user's voice, other sounds, etc. The microphone 822 can be configured to receive stereo sound by being positioned in a plurality of locations.

[0265] The interface section 860 serves as a pathway for connecting the vehicle display device 800 to external devices. For example, the interface section 860 may be at least one of the following: a connection terminal for connecting to other devices (e.g., headphones, external speakers); a port for short-range communication (e.g., an infrared port, Bluetooth port, Wireless LAN port, etc.); or a power supply terminal for supplying power to the vehicle display device 800. This interface section 860 may also be implemented as a socket for accommodating external cards such as a SIM (Subscriber Identification Module) or UIM (User Identity Module), or a memory card for information storage.

[0266] At least one antenna for wireless communication may be provided in the vehicle display device. The antenna may be built into the vehicle display device or formed in the housing. For example, it constitutes a broadcast receiver module 811 (see reference). Figure 2b The antenna, as part of the display device, can be configured to extend from the vehicle display device. Alternatively, the antenna can be formed as a thin film and attached to the inner side of the housing, or it can be configured as a housing containing conductive material to function as an antenna.

[0267] On the other hand, the “driving of the vehicle” disclosed in this specification may include driving after the vehicle is started, driving at a speed above a specified speed, temporary stopping while driving (due to traffic jams, waiting at a signal, etc.), driving for parking, and also includes autonomous driving and manual driving.

[0268] Additionally, the “driving stop” disclosed in this specification may include situations where the vehicle stops before it is started, after it is started but before driving begins, or after a temporary stop during driving that exceeds a specified time.

[0269] Furthermore, the "shape change" or "shape deformation" disclosed in this specification refers to a situation where at least a portion of a plurality of displays moves relative to each other, rotates, bends outward / inward, pops out / pops in, rolls up / rolls down, thereby changing the structural shape of at least a portion of the display section. This "shape change" or "shape deformation" includes situations where the shape of only one of the plurality of displays changes and situations where the shapes of the plurality of displays change sequentially / simultaneously.

[0270] Furthermore, the control and display of each of the "proportion of displays" disclosed in this specification are performed independently. The "proportion of displays" disclosed in this specification are located on the front of the same frame of the display device and have a structure extending horizontally in the position of the vehicle's dashboard. Additionally, at least a portion of the "proportion of displays" disclosed in this specification has a structure capable of independent relative movement or rotation, in which case various configurations can be formed according to the shape combination between the displays.

[0271] Specifically, the plurality of displays are implemented as including a first display unit located at a position corresponding to the driver's seat, a third display unit located at a position corresponding to the passenger seat, and a second display unit located between the first display unit and the third display unit.

[0272] For example, the "first display unit" disclosed in this specification may be an instrument cluster. Alternatively, the "second display unit" disclosed in this specification may be named CID (Center Information Display), and the "third display unit" may be named PID (Passenger Information Display).

[0273] Figure 2c and Figure 2d This is a diagram illustrating the specific operation of a display, such as a second display unit 851b (or CID), which has a structure that can move in the vertical direction and is partially flexible in the display device of the present invention.

[0274] First, refer to Figure 2c The second display unit 851b is fixed to the frame F on the back and operates to move vertically relative to the frame according to the control signal.

[0275] When the second display unit 851b moves upward relative to the guide rail (not shown), the display surface becomes flat and forms the first shape A.

[0276] On the other hand, when the second display portion 851b moves relative to the guide rail (not shown) and the rollers R1, R2 on both sides of the lower portion, the second display portion 851b becomes a second shape B in which at least a portion of the display surface is bent outward. Although Figure 2c Not shown in the diagram, but the outward curve of the second display section 851b can be located higher than the center. Additionally, although... Figure 2c Although not shown in the diagram, the outwardly curved lower part of the second display unit 851b can be supported by a triangular lower support.

[0277] If a configuration change request (or configuration change event) occurs, the control unit 880 of the vehicle display device 800 analyzes and identifies the configuration contained in the request, confirms the vehicle's driving status, and generates control commands to be transmitted to multiple displays.

[0278] If a control command for changing to the second shape B is received from the control unit 880 of the vehicle display device 800, the second display unit 851b performs a downward sliding action and at least a portion of it bends outward. As described above, if the second display unit 851b becomes the second shape B, it will not obstruct the driver's view while driving, and touch operation becomes easier through the outward-bending lower part.

[0279] If the second display unit 851b receives a control command from the control unit 880 to change to the first shape A while in the second shape B state, the outwardly curved portion of the second display unit 851b unfolds and moves upward relative to the first shape. As described above, if the second display unit 851b becomes the first shape A, there is no distorted image, thus providing a larger image.

[0280] On the other hand, although Figure 2c and Figure 2d Not shown in detail, but the control unit 880 may include a curvature adjustment unit that can change the degree of curvature of the second display unit 851b. The curvature adjustment unit can change the degree of curvature so that the second display unit 851b is positioned relative to the support B (…). Figure 3 Based on this, it bends or unfolds further upwards.

[0281] Therefore, the control unit 880 may be located extending toward the rear of the frame and may include a display driver IC for driving the second display unit 851b. Additionally, the curvature adjustment unit may include a plurality of guide rails, connecting rods, connecting rod supports, bearings, bending modules, etc., for changing the degree of curvature of the second display unit 851b according to signals received from the display driver IC.

[0282] The following describes in detail various examples of how the shape of the display unit 851 changes according to the shape change of at least a portion of the plurality of displays.

[0283] Figure 3 and Figure 4 This is a diagram illustrating an example of how the second display unit 851b changes and is implemented in one of the first and second forms.

[0284] Figure 5 This is an example diagram illustrating the morphological deformation of the third display unit 851c as its dimensions change.

[0285] Figure 6 This is an example diagram illustrating the shape deformation of the second display unit 851b when the orientation changes. Figure 7 It is used for explanation Figure 6 An example diagram showing the morphological deformation of the third display section 851c, where the dimensions have further changed.

[0286] On the other hand, in the illustrated embodiment, the first to third display units 851a, 851b, and 851c are fixed to the same frame F on the back and are located on the same horizontal line. Furthermore, although a predetermined space is spaced between the first to third display units 851a, 851b, and 851c for ease of explanation, in the embodiment, the first to third display units 851a, 851b, and 851c are connected without gaps, allowing for seamless display when the entire assembly is used as an extended screen.

[0287] First, refer to Figure 3 and Figure 4 The following provides a detailed explanation of the situations in which the vehicle display device 800 forms a first form and a second form.

[0288] Figure 4 This is an example of a first configuration showing the display surface of the second display unit 851b in a flat state.

[0289] When the vehicle is stopped, the display unit 851 of the vehicle display device 800 can display images... Figure 4 That forms the first state. At this point, vehicle stopping can include situations where the vehicle has been started but before it has started moving, when it is parked, or when it has stopped for more than the prescribed time while in motion.

[0290] In the first configuration, the second display unit 851b has a flat display surface and is relatively moved upward relative to the lower support B. At this time, if the second display unit 851b moves from... Figure 3 If the shape changes, the second display section 851b can be operated such that the outwardly curved portion of the second display section 851b unfolds and moves upward along a plurality of rollers located between the second display section 851b and the lower support B. As the second display section 851b moves upward relative to the frame F, its upper surface can be higher than the height of the frame F. At this time, the heights of the first display section 851a and the third display section 851c can be lower than the height of the second display section 851b. In addition, as the second display section 851b moves relative to the frame F, at least a portion (e.g., the lower part) of the lower support B can be exposed.

[0291] Furthermore, in the first configuration, the entire second display unit 851b can be used as a large screen. For example, in the first configuration, infotainment screens such as navigation screens, menu screens, movie screens, and audio playback screens can be displayed on the entire second display unit 851b. Additionally, in the first configuration, the second display unit 851b can be used as an extended screen together with other display units, namely the first display unit 851a and the third display unit 851c, or as a large screen related to the same content, depending on the request and the attributes of the content, and considering the current driving conditions of the vehicle.

[0292] Figure 3 This is an example of a second form in which at least a portion of the display surface of the second display unit 851b is bent outwards.

[0293] When the vehicle is in motion, the display section 851 of the vehicle display device 800 may form at least a portion of the second display section 851b deformed into a second form having an outwardly bent shape. At this time, vehicle motion may include starting to move after the vehicle is started, moving in parking mode, moving slowly, or stopping briefly while moving (e.g., waiting at a traffic light, traffic congestion, etc.).

[0294] In the second configuration, the second display unit 851b moves downward relative to the lower support B and forms a state in which at least a portion of the display surface is bent, i.e., bent outward. In this case, the position of the outwardly bent area of ​​the second display unit 851b (hereinafter referred to as the "bent area") can vary depending on the shape and height of the lower support B.

[0295] The display area of ​​the second display portion 851b, which is divided based on the curved region, may be non-uniform for stable deformation. For example, it may be bent outward so that, based on the curved region, the size of the lower region (hereinafter, "second region") of the second display portion 851b is larger than the size of the upper region (hereinafter, "first region") of the second display portion 851b.

[0296] In the second configuration, the first and second regions of the second display unit 851b can each display content with different attributes. Furthermore, curved areas may not display images to prevent image distortion, or scaling adjustments may be automatically performed for seamless display.

[0297] Specifically, the first area of ​​the second display unit 851b can display requested / set content or a service screen, while the second area of ​​the second display unit 851b can display an input screen for touch operation (e.g., a control panel, menu, list, keyboard, etc.). The input screen in the second area facilitates interaction with the screen displayed in the first area. In this case, if the second mode changes to the first mode according to a control command, the input screen displayed in the divided second area can disappear, and the second display unit 851b automatically becomes a large screen.

[0298] In the second configuration, the curvature of the second display unit 851b can be varied. The shape of the second display unit 851b can be any one of the following: a flat panel with a planar display surface; a first curved panel with at least a portion bending outwards with a first curvature; or a second curved panel with at least a portion bending outwards with a second curvature. Specific operational details related to the changes in the first and second curved panels will be explained later. Figure 10 A detailed explanation will be provided.

[0299] On the other hand, when changing from the second form to the first form, the outwardly bent portion of the second display unit 851b unfolds while the second display unit 851b slides upward relative to the rollers on both sides based on the lower support B. At this time, the outwardly bent portion can unfold proportionally to the degree of relative movement of the second display unit 851b.

[0300] When changing from the second mode to the first mode, the content displayed on the second display unit 851b can change. For example, in the second mode, a scaled-down content / service screen can be displayed in the first area of ​​the second display unit 851b, and an input screen (e.g., a touch panel, mouse panel, or control panel) for interacting with the screen displayed in the first area can be displayed in the second area. In this case, for example, based on touch input to the second area, a card-shaped widget can be scrolled left and right in the first area. Alternatively, icons of frequently used applications or widgets can also be displayed in the second area. Then, if changing to the first mode, the input screen in the second area of ​​the second display unit 851b disappears, and the content / service screen previously displayed in the first area expands to full screen.

[0301] Furthermore, changes to the second form can occur not only through changes to content / service attributes or direct requests based on input requests, but also when a need to use the third display unit 851c is identified. Here, the need to use the third display unit 851c can include the user's (passenger's) desire to use it and the driver's desire to use it.

[0302] For example, in the first configuration, if a driver's desire to use the third display unit 851c is sensed (e.g., based on the driver's line of sight from the front camera), the display unit 851 can be transformed into a second configuration, enabling a portion of the second display unit 851b (e.g., the second area) to be used as an input area. In this case, the image previously displayed in the first area of ​​the second display unit 851b (e.g., a navigation screen) is displayed in a scaled-down state, and an input screen for interacting with the content displayed on the third display unit 851c (e.g., widgets, applications, etc.) is displayed in the second area. Thus, the driver can easily perform screen operations on the third display unit 851c corresponding to the passenger seat position when needed.

[0303] The following describes another example of a form transformation of the display unit 851. These form transformations can be named a third form, a form transformation (change) corresponding to a change request for the second form, or a form transformation.

[0304] Figure 5 This is a diagram illustrating the shape deformation of the third display unit 851c in the display device 800 as its size changes.

[0305] The third display unit 851c can pop upwards according to the control command of the control unit 880, so that the display size increases upwards as the exposed area of ​​the display surface increases. In addition, when the third display unit 851c is in the popped-out state, it can pop in according to the control command of the control unit 880, so that the display size decreases downwards as the exposed area of ​​the display surface decreases.

[0306] Therefore, the third display unit 851c may include a first frame and a second frame, and the flexible display module may be supported by the first frame and the second frame, which is configured to move relative to the first frame. Additionally, the third display unit 851c may include a pair of sliders for guided vertical sliding relative to each other. Although not shown in detail, each pair of sliders may each include a horizontal plate, a vertical plate bent or curved downwards from the inner edge of the horizontal plate, and a "U"-shaped guide rail embedded in the outer edge of the horizontal plate.

[0307] As the third display unit 851c pops upward, the first and second frames move away from each other. After a pair of sliders move integrally with the second frame, the guide rail is fixed in the insertion slot, and the increased size of the third display unit 851c is maintained. The variable length L of the third display unit 851c can vary depending on the vehicle's driving conditions and the attributes of the requested content / service and / or input requests. As the variable length L gradually increases with the exposed area of ​​the third display unit 851c, the content displayed on the third display unit 851c also expands.

[0308] When the variable length L of the third display unit 851c is reduced to its minimum, the upper ends of the first display unit 851a and the upper ends of the third display unit 851c can be on the same line. Furthermore, when the variable length L of the third display unit 851c is extended to its maximum, the upper end of the third display unit 851c can be located at the highest position among the plurality of displays, or it can be on the same line as the upper end of the second display unit 851b when it is moved to the top in portrait mode.

[0309] As another example, the third display unit 851c can be operated such that a portion of the display panel remains bent in a U-shape within the frame space, thereby expanding or shrinking the displayed image. In this case, the third display unit 851c is not rolled up as a whole, but rather a portion is always exposed, thus minimizing the risk of panel damage.

[0310] Figure 6 This is an example diagram illustrating the shape deformation of the second display unit 851b when the display direction changes. Additionally, Figure 7 This is used to explain the dimensions of the third display unit 851c from... Figure 6 Example diagrams showing further changes in shape and deformation.

[0311] The second display unit 851b can perform a relative rotation movement R to change the display orientation based on the control instructions of the control unit 880.

[0312] Therefore, although not shown in detail, one or more plates, rotating shafts, axes, brackets, sliders, and motors for providing rotational force may be provided on the back of the second display unit 851b as constituent elements for changing the display direction to either a portrait mode or a landscape mode.

[0313] For example, if the control unit 880 of the vehicle display device 800 receives a control command requesting a change in form corresponding to the lateral mode, a rotational force can be generated on the second display unit 851b to apply a rotational force in the horizontal direction (left-right direction), thereby changing the display direction to lateral. In this case, all or part of the lower bracket B can be exposed, and both sides of the second display unit 851b can overlap with a portion of the first display unit 851a and the third display unit 851c, respectively.

[0314] Similarly, if the control unit 880 of the vehicle display device 800 receives a control command requesting a change in configuration corresponding to the longitudinal mode, a rotational force can be generated on the second display unit 851b to apply a rotational force in the vertical direction (up-down direction), thereby changing the display direction to longitudinal. In this case, the second display unit 851b can be seamlessly connected to both sides of the first display unit 851a and the third display unit 851c.

[0315] The relative rotation of this second display section 851b is independent of the aforementioned relative up-down movement (and outward bending) of the second display section 851b.

[0316] For example, the second display unit 851b may, based on a control command, perform a transformation to a horizontal mode after the aforementioned change to the first mode. Alternatively, for example, the second display unit 851b may, based on a control command, transform to a vertical mode and then perform the aforementioned transformation to the second mode.

[0317] On the other hand, although not shown in detail, when deforming into a horizontal mode, the second display unit 851b can move a predetermined distance to the left or right.

[0318] When the second display unit 851b switches to landscape mode, it may obscure at least a portion of the first display unit 851a and the third display unit 851c. Therefore, the second display unit 851b can selectively move further to the left or right during relative rotation, thereby operating to avoid overlapping with at least one display.

[0319] Specifically, if a configuration change request is received to change the second display unit 851b to landscape mode, the control unit 880 can consider the display status of the first display unit 851a and the third display unit 851c, the attributes of the displayed content, and the vehicle's driving conditions to determine the display that will not obstruct the screen, and select the horizontal movement direction of the second display unit 851b when it rotates relative to the other display unit and generate a control command based on the determination result.

[0320] Reference Figure 7 The deformation requests for the second display unit 851b and the third display unit 851c can be executed sequentially or simultaneously, or the deformation request for the third display unit 851c can be generated based on additional input after the deformation of the second display unit 851b.

[0321] Specifically, the second display unit 851b switches to a horizontal mode, and simultaneously / in turn, the shape of the third display unit 851c can be modified to increase the variable length L.

[0322] Or, in Figure 7 In its current configuration, the second display unit 851b can be switched to a portrait mode, and simultaneously / in sequence, the configuration of the third display unit 851c changes to a variable length L that decreases. This can represent a return to the first configuration, for example, it can occur based on a usage end command from the vehicle display device 800.

[0323] According to the embodiment, the sequential shape transformation requests of the second display unit 851b and the third display unit 851c can occur in accordance with the attributes of a specific content / service. For example, when the screen extension mode is selected on the third display unit 851c while the vehicle is stationary, the second display unit 851b can switch to landscape mode, and the third display unit 851c can simultaneously / sequentially pop up in shape transformation.

[0324] As described above, the vehicle display device 800 of this embodiment can transform into a second form different from the first form when the second display section 851b of the plurality of displays is in a flat first form, by sensing the movement of the vehicle. Then, if a change request for the second form occurs, after confirming whether it is applicable based on the vehicle's driving conditions, the device performs a transformation to the form corresponding to the request.

[0325] Figure 8 This is a representative flowchart used to illustrate the operation method of the display device related to various morphological transformations. The "plural displays" disclosed below may refer to the display unit 851 of the vehicle display device 800 or the first to third display units 851a, 851b, 851c.

[0326] As mentioned above, the vehicle display device 800 of the present invention ( Figure 1It includes a plurality of displays. Among the plurality of displays, the first display unit 851a is located at a position corresponding to the instrument panel of the driver's seat, the third display unit 851c is located at a position corresponding to the position of the passenger seat, and the second display unit 851b is located between the first display unit 851a and the third display unit 851c, forming a large screen.

[0327] Here, the second display unit 851b has a structure in which at least a portion is flexible, can move up and down, and can change its display orientation by relative rotation. Furthermore, the third display unit 851c has a structure in which the size of the image can be changed by relative vertical movement. Through the combination of the shapes and structures of the second display unit 851b and the third display unit 851c as described above, various morphological transformations can be achieved.

[0328] The processor (or control unit) 880 of the vehicle display device 800 can perform shape deformation by generating control commands for shape deformation according to various conditions and transmitting them to a plurality of displays.

[0329] Specifically, the control unit 880 can transmit control signals for changing the shape and structure of the second display unit 851b and the third display unit 851c to the corresponding modules for the structural change operation. As a result, the second display unit 851b and the third display unit 851c can operate to perform structural changes individually or sequentially / simultaneously, thereby achieving a shape deformation that matches the request.

[0330] On the other hand, the following, in reference Figure 8 Unless otherwise stated, the steps described herein are based on the assumption that they are performed by the control unit 880 of the vehicle display device 800. Furthermore, changes to the shape and structure of the plurality of displays are performed independently. Additionally, various changes to the shape and structure of a single display (e.g., relative rotation, vertical movement, outward bending) are also performed independently.

[0331] Reference Figure 8 First, the plurality of displays of the vehicle display device 800 can be controlled to change to a second form (8100) different from the first form when the second display 851b is in a flat first form by sensing the movement of the vehicle.

[0332] Here, the first configuration can be an initial (basic) configuration or a structure where the second display moves relative to a second direction opposite to the first direction and becomes flat. In this case, the first direction can be the direction in which the second display unit 851b slides downwards along the lower support B. The second direction refers to the direction in which the second display unit 851b moves upwards against the lower support B. Furthermore, the initial (basic) configuration can refer to the default configuration.

[0333] The processor (or control unit 880) can transmit signals for changing to a first mode to a plurality of displays in response to a vehicle stop signal. The stop signal can occur before the vehicle starts, after starting and before driving begins, when the driving stop time exceeds a predetermined time, or when the vehicle stops.

[0334] For example, if the driver enters the vehicle 100 and starts the engine, the vehicle display device 800 becomes "on," and at least some of the multiple displays in the first configuration show a welcome screen. Then, the instrument panel screen can be displayed on the first display unit 851a.

[0335] If vehicle movement is detected, the processor (or control unit 880) requests a change from the first mode to the second mode. Specifically, the processor (or control unit 880) may, in response to the vehicle's movement sensing signal, transmit a signal for changing to the second mode to a plurality of displays. At this time, the movement sensing signal may occur after the vehicle is started, after the start of movement following the start of the vehicle, or during the movement process.

[0336] Here, the second configuration can be a structure in which the second display portion 851b moves relative to the first direction and at least a portion of the second display portion 851b is bent. Here, the first direction can refer to the direction in which the second display portion 851b slides downward along the lower support B. In addition, the bending of at least a portion refers to a predetermined portion of the second display portion 851b bending inward to an outward bending that contacts the surface of the lower support B.

[0337] For example, if the plurality of displays are in the first configuration, and the driver starts driving in drive (D) after displaying a welcome screen and an instrument panel screen, the plurality of displays can be transformed into a second configuration to avoid obstructing the driver's view. If the driver changes to the second configuration as described above, then, as previously mentioned, the second display unit 851b is divided into a first area for displaying content (e.g., a navigation screen) and a second area for interactive operation, based on the curved area.

[0338] Next, during the vehicle's operation, the vehicle display device 800 can determine the existence of a change request in the second form based on the vehicle's detection data, the content / services displayed on the plurality of displays, and at least one of the input requests (8200).

[0339] Specifically, the second type of change request can be generated based on at least one of the vehicle's driving status, the attributes of the requested content / service, and direct input requests.

[0340] As an example, if the requested content / service includes the attribute of extended screen mode, a mode change request may occur, which changes the second display unit 851b to landscape mode and causes the third display unit 851c to pop up.

[0341] As another example, based on direct input requests such as the use needs of the third display unit 851c, the form can be modified so that the second display unit 851b is bent or the degree of bending is increased in order to facilitate interaction.

[0342] As another example, in the use of extended screen mode, it can automatically transform into a second form according to the change in driving status after the autonomous driving mode ends, so as to avoid obstructing the driver's vision.

[0343] On the other hand, in the embodiments, regarding the priority of requests for changes in the form of multiple displays, the driving status based on vehicle detection data takes precedence over content / service attributes and direct input requests. This is to prioritize vehicle driving safety over providing convenient infotainment when both demands exist simultaneously.

[0344] As described above, if a change request for a second form is determined, the control unit 880 considers the current driving conditions of the vehicle and determines whether the form transformation based on the received change request for the second form is feasible (8300), and then executes the change to the determined form (8400).

[0345] Specifically, when there is a request to change the form that would obstruct the driver's view while the vehicle is in motion, the processor (or control unit 880) may display on either the second display unit 851b or the third display unit 851c that the requested form cannot be changed.

[0346] In this embodiment, the processor (or control unit 880) can control a plurality of displays to change their configuration according to the driving state corresponding to the vehicle's detection data. For example, in a parking mode while driving, a configuration change event can occur that changes the second display unit 851b to a horizontal or vertical mode to facilitate guidance along the parking direction.

[0347] Additionally, in this embodiment, the processor (or control unit 880) can control a plurality of displays to change their form in accordance with the attributes of the requested content / service.

[0348] For example, if a video conferencing mode is performed using multiple displays while the vehicle is parked or stationary, the shape of the second display unit 851b can be changed to landscape mode, and simultaneously / in sequence, the third display unit 851c pops up as shown in the image. Figure 7The shape is deformed. As described above, after the shape change, the second display unit 851b can display the speaker's information, and the third display unit 851c can display the camera footage of the meeting participants. In addition, when the first display unit 851a is extended, a speaker mode screen such as a preview of the speaker's information or the speech manuscript can be displayed.

[0349] As another example, if the screen extension mode is executed while watching a movie through the second display unit 851b, the third display unit 851c pops in, thereby enabling large-screen movie viewing using the first to third display units 851 on the same horizontal line. However, since the movie is being viewed through the second display unit 851b at this time, it is predicated on the vehicle being stationary.

[0350] As another example, if the ambient mode is executed while the vehicle is parked or stationary, the second display unit 851b can switch to landscape mode, and the third display unit 851c can display a window showing... Figure 7 The shape is deformed. In this case, relevant environmental images (e.g., campfire light and shadow, aurora, forest, sky, universe, etc.) can be seamlessly displayed in the first to third display units 851, and the ambient light matching the displayed environmental image can be output to the vehicle.

[0351] As another example, if the multi-view mode is executed when the vehicle is parked or docked, in the state where the second display unit 851b switches to landscape mode and the third display unit 851c pops up, the second display unit 851b displays a multi-view image (e.g., sports, games, etc.) or an audio list, and the third display unit 851c can display the image / audio selected from the multi-view image or audio list in full screen.

[0352] As another example, if the second display unit 851b is in its second configuration and text input is required for the content / service displayed on the second display unit 851b or the third display unit 851c, the processor (or control unit 880) can recognize this content attribute and generate a configuration request event. Specifically, when the second display unit 851b or the third display unit 851c outputs a text input request screen, a configuration deformation that increases the curvature of the second display unit 851b can be performed. As described above, if the curved area of ​​the second display unit 851b bends further in the horizontal direction, an input area (e.g., a virtual keyboard) appears in the second area of ​​the lower region of the curved area. This creates an easier interactive environment for input. At this time, if no input is made within a specified period or the text input request screen displayed on the second display unit 851b or the third display unit 851c switches to another screen, the curvature of the second display unit 851b can automatically return to its original state based on a control signal generated by the processor (or control unit 880).

[0353] Additionally, in this embodiment, the processor (or control unit 880) can control a plurality of displays to change their configuration based on direct input.

[0354] For example, the variable length L of the third display unit 851c, which is shaped like a touch gesture, can be increased or decreased based on the touch gesture applied to the second display unit 851b. As a specific example, if a two-finger swipe is applied to the second display unit 851b while a widget or application icon is displayed in the first area, the widget or application icon in the first area can be displayed to match the screen size of the popped-in third display unit 851c. Conversely, if a three-finger swipe is applied to the second display unit 851b while an icon or application icon is displayed in the first area, the third display unit 851c pops up and transforms into an expanded screen state, after which the icon or application icon in the first area is displayed. Here, the two-finger and three-finger swipe inputs can be replaced by other touch gestures or input methods that are different from each other.

[0355] According to an embodiment, morphological deformations that occur simultaneously or sequentially with a plurality of displays can be executed through a single direct input.

[0356] For example, if a swipe-up gesture is applied while the second display unit 851b is in landscape mode, the second display unit 851b will rotate to landscape mode, and the third display unit 851c will pop up. In this case, the aspect ratio and the displayed UI can be automatically adjusted to match the landscape mode and the pop-up aspect ratio. Similarly, if a swipe-down gesture is applied while the second display unit 851b is in portrait mode, the second display unit 851b will rotate to portrait mode, and the third display unit 851c will pop in. In this case, the aspect ratio and the displayed UI can be automatically adjusted to match the changed portrait mode and the pop-up aspect ratio.

[0357] On the other hand, when multiple different driving conditions occur in relation to the form change requests of multiple displays, the processor (or control unit 880) of the vehicle display device 800 can change to a specific form or maintain the current form state (no form change) according to a preset priority order.

[0358] Specifically, when the plurality of displays are in the second form, a change request for the second form may occur based on any one of the following: the vehicle driving mode (e.g., driving start, autonomous driving mode, parking mode, etc.) based on vehicle detection data, the attributes of the content displayed on the plurality of displays (e.g., screen extension mode, input request screen, etc.), or the user input request for the plurality of displays (e.g., specific gesture, etc.). Alternatively, a change request for the second form may occur based on two or more of these factors.

[0359] In this situation, the processor (or control unit 880) can consider the vehicle's driving status related to the vehicle's detection data to determine whether to accept the second form change request. That is, the current driving state and driving conditions of the vehicle are used as the highest priority to decide whether to change or maintain the form. On the other hand, if second form change requests with the same priority are received in sequence, a second form change request is generated based on the subsequently requested form change request.

[0360] On the other hand, if it is determined that the requested change to the second form cannot be accepted based on the current driving condition of the vehicle, the processor (or control unit 880) can display a feedback response corresponding to the request through the relevant display unit (and speaker).

[0361] Figure 9 This is a specific example of changing the shape and size of the third display unit 851c corresponding to the passenger seat by operating the second display unit 851b of the vehicle display device 800.

[0362] The third display unit 851c is supported by a first frame and a second frame that is configured to move relative to the first frame, and the exposed area of ​​the front of the display module increases / decreases according to the relative movement of the second frame, thereby changing the display size.

[0363] Specifically, the exposed area of ​​the display module gradually increases as the second frame moves away from the first frame (e.g., pops up / rolls up), thereby expanding the screen size of the third display unit 851c. Subsequently, if the second frame moves closer to the first frame (e.g., pops in / rolls down), the screen size of the third display unit 851c shrinks as the exposed area of ​​the display module gradually decreases.

[0364] The processor (or control unit 880) can generate a shape change request event based on the displayed content attributes and input requests, so as to change the front exposed area according to the relative movement of the second frame, thereby changing the screen size of the third display unit.

[0365] As one embodiment, the processor (or control unit 880) can identify the content displayed on the plurality of displays as infotainment attributes, and generate a mode change request event for changing the screen size of the third display unit 851c based on the input request to the second display unit 851b.

[0366] At this time, the input request for the second display unit 851b may include a request to transmit content-related data for displaying the content to be displayed on the second display unit 851b to the third display unit 851c.

[0367] exist Figure 9 In the second form state where the second display unit 851b is bent outward, the content screen 901 can be displayed in the first area, while the second area can be used as a control panel.

[0368] At this time, if a specific gesture is applied to the second area (e.g., a three-finger upward flick to input 911), the vertical length L1 of the third display unit 851c increases, and the content screen displayed in the first area of ​​the second display unit 851b can be displayed on the expanded content screen 902 of the third display unit 851c. The content screen 902 of the third display unit 851c can be an infotainment screen such as a widget, application icon, or navigation screen. Furthermore, the content screen 901 displayed in the first area of ​​the second display unit 851b can remain displayed.

[0369] On the other hand, if the input request to the second display unit 851b as described above is executed by the driver, then any driving obstruction that might be caused by the passenger in the front seat operating the second display unit 851b is eliminated. In this case, the passenger in the front seat can perform interaction and screen viewing on the third display unit 851c without operating the screen displayed on the second display unit 851b.

[0370] Next, in Figure 9 In this process, if a specific gesture is applied to the second area of ​​the second display unit 851b in its second state (e.g., a three-finger downward swipe input 912), a shape deformation is performed that reduces the vertical length L2 of the expanded third display unit 851c. At this time, the display is adjusted to a screen ratio and UI screen 903 that matches the size of the reduced third display unit 851c. Furthermore, the control panel area displayed in the second area of ​​the second display unit 851b can also be scaled down to correspond to the size of the reduced third display unit 851c.

[0371] On the other hand, according to the embodiment, the second area of ​​the second display unit 851b can also be used as an interaction area for the expanded or reduced third display unit 851c. For example, if the driver wants to perform an operation on the content displayed on the third display unit 851c through the second area of ​​the second display unit 851b, the interaction area for the third display unit 851c can be overlaid on the control panel. In this case, the overlaid interaction area can disappear when the content displayed on the third display unit 851c, such as the widget screen, disappears or when no input is received within a specified period of time.

[0372] Figure 10 This is a diagram illustrating the morphological deformation of the vehicle display device 800, which changes the degree of curvature of the second display unit 851b according to an input request to the third display unit 851c.

[0373] The second display unit 851b can adopt one of the following states according to the control command of the control unit 880: a flat panel mode, a first bending mode with a first curvature size according to the degree of bending, and a second bending mode with a second curvature size.

[0374] At this time, the first bending mode can correspond to the second state, and the second curvature size can be a curvature value / range larger than the first curvature size. Furthermore, the second curvature of the second bending mode can be the maximum curvature that the display module of the second display unit 851b can drive. The first and second curvature sizes can be set during manufacturing or through user settings. Additionally, conditions matching changes to the flat panel mode, the first bending mode, and the second bending mode can be set through user settings.

[0375] When the second display unit 851b undergoes a shape deformation due to changes in the degree of curvature, the control unit 880 can adjust it to match the aspect ratio of the displayed screen.

[0376] According to an embodiment, the control unit 880 can generate a mode change request event based on a usage request (e.g., an input request) for the third display unit 851c when multiple displays are in a second mode, so as to change the second display unit 851b from the first bending mode to the second bending mode. Similarly, the control unit 880 can generate a mode change request event based on a usage cancellation request (e.g., an input end) for the third display unit 851c, so as to change from the second bending mode to the first bending mode.

[0377] According to an embodiment, when multiple displays are in a second configuration, and a region of the second display unit 851b, such as the lower part of the curved region (i.e., the second region), is touched, the control unit 880 can recognize this as a request to use the third display unit 851c. Accordingly, as... Figure 10 As shown, as the curvature of the curved portion of the second display unit 851b increases, the lower end, i.e. the second region, can be further raised and lowered in the horizontal direction with reference to the lower end bracket B, thereby executing a shape deformation request to change to the second bending mode.

[0378] At this time, in the second bending mode, an interactive area (e.g., a virtual keyboard) corresponding to the use request for the third display unit 851c can be superimposed and displayed in the second area. Afterwards, if the use request for the third display unit 851c is cancelled, the superimposed interactive area (e.g., the virtual keyboard) can disappear and the second display unit 851b can be restored to the shape deformation of the first bending mode.

[0379] On the other hand, if the curvature of the second display unit 851b increases, causing the second area to rise and fall further in the horizontal direction, it may obstruct the driver's view. Therefore, the vehicle's driving conditions can be taken into account, and the request for a change in form can be rejected, or the system can be set to drive when the vehicle is stopped or parked.

[0380] Figure 11 It is a block diagram used to illustrate the comprehensive control of morphological deformation among multiple displays based on various situations that may occur in a vehicle.

[0381] Reference Figure 11 The display unit 851 of the vehicle display device 800 is implemented as a plurality of displays including a first display unit, a second display unit, and a third display unit. Hereinafter, they can be named as instrument panel, CID, and PID respectively based on their installation positions, as described above. That is, the instrument panel will be referred to as the first display unit 851a, the CID as the second display unit 851b, and the PID as the third display unit 851c.

[0382] As mentioned above, the display unit 851 is driven such that each of the plurality of displays can independently change its shape and structure, and can take on various forms (e.g., relative movement, relative rotation, outward / inward bending, pop-out / pop-in, roll-up / roll-down, etc.) according to more than one combination. The display unit 851 is driven according to control commands based on form change requests generated by the integrated control unit 1110.

[0383] The integrated control unit 1110 takes into account various driving conditions of the vehicle to comprehensively control the driving of the shape of the CID (second display unit) and PID (third display unit). The integrated control unit 1110 performs the same functions as the processor (or control unit 880) of the aforementioned vehicle display device 800, and can be understood as having the same constituent elements.

[0384] The integrated control unit 1110 includes a driving condition judgment unit 1121, a CID and PID default setting unit 1122, a driver condition judgment unit 1123, and a display mode setting unit 1124 based on infotainment content / services. The integrated control unit 1110 can identify the requested mode by integrating the decisions from the plurality of judgment units and setting units (1121 to 1124), and ultimately determine whether it can be changed to that mode. Afterwards, the integrated control unit 1110 transmits the drive command for mode change to the display unit 851.

[0385] The driving condition determination unit 1121 identifies the vehicle's driving status and driving mode. For example, the driving condition determination unit 1121 determines whether the vehicle is in autonomous driving mode or driving on a road, and transmits this information to the integrated control unit 1110. To this end, the driving condition determination unit 1121 can operate based on detection data 1131 obtained from in-vehicle sensors, ECU, OBD, etc.

[0386] The CID and PID default setting unit 1122 can set the default mode to suit various driving conditions of the vehicle. For example, the CID and PID default setting unit 1122 can set the default mode based on detection data obtained by vehicle sensors 1132, such as ICM (motion sensor) and DMS (distance sensor). In addition, the CID and PID default setting unit 1122 can also set the default mode based on the judgment and setting of the driver condition judgment unit 1123 and the infotainment content / service display mode setting unit 1124.

[0387] For example, the CID and PID default setting unit 1122 can preset various default modes taken when the vehicle is driving and when it is stopped, as sensed by the vehicle sensor 1132, the default mode taken when the PID is requested, the default mode matched according to the vehicle's driving mode conditions, the default mode matched according to the driver's condition, and the default mode matched according to the attributes of the requested content / service.

[0388] The driver condition assessment unit 1123 transmits the analysis results of data related to vehicle detection data, such as driver condition (e.g., whether the driver is looking ahead, yawning, dozing off, smoking, or distracted) collected by internal cameras included in the DMS (Driver Monitoring System) and / or IMS (Interior Monitoring System), to the integrated control unit 1110. The integrated control unit 1110 can perform a morphological change or decide not to accept a morphological change request in order to guide the driver's driving based on the analysis results of the driver condition assessment unit 1123.

[0389] User input unit 1133 receives direct input from the driver / passenger for morphological transformation. For example, input methods for user input unit 1133 may include operation of one of a plurality of displays, including not only touch gestures (including hover touch), but also gaze-based input, voice commands, camera-based gestures, etc. Additionally, user input unit 1133 may also include an interactive area temporarily overlaid on a region of another display (e.g., CID) based on an input request for a specific display (e.g., PID).

[0390] The display mode setting unit 1124 sets a mode that matches the attributes of the content (e.g., extended screen mode). To this end, the attribute unit 1134 can distinguish, for example, whether the content's attributes are driving-related content such as navigation, infotainment that is not directly related to driving, or extended screen mode, and pass this information to the display mode setting unit 1124.

[0391] On the other hand, data related to the judgment conditions and settings of the driving condition judgment unit 1121, the CID and PID default setting unit 1122, the driver condition judgment unit 1123, and the display mode setting unit 1124 according to infotainment content / service can be stored in memory, etc.

[0392] The integrated control unit 1110 can control the drive of CID and PID to change its mode according to driving conditions such as driving status, content / service attributes or requests.

[0393] For example, if the condition for converting the CID to a longitudinal mode based on the operation of the PID is met, the integrated control unit 1110 can control the drive to restore the CID to the flat mode and simultaneously rotate the display to switch to a lateral mode while raising or lowering the CID. Additionally, for example, in the vehicle standby mode (e.g., before starting / after starting and before driving begins), the drive can be controlled to form a first state where the CID is in both the flat and longitudinal modes and the PID is in the spring-in state. Furthermore, for example, during vehicle driving, the shape deformation can be controlled to form a second state where the CID is in the first bending mode and the PID is in the spring-in state, or the CID can change to the second bending mode.

[0394] When a shape change for multiple displays is required based on a shape change request, each display can be driven independently. Therefore, the integrated control unit 1110 can selectively perform simultaneous control or sequential control. For example, the integrated control unit 1110 can drive the PID after driving the CID, or drive the CID and PID simultaneously.

[0395] In the event of conflicting or multiple requests for shape transformation / holding, the integrated control unit 1110 can execute shape transformation / holding according to a pre-set priority order.

[0396] Furthermore, the integrated control unit 1110 can set different default modes according to user settings. For example, when the driver is riding alone, the personalized setting is to use CID & PID as a main screen mode, and when the vehicle is sensing movement, the mode in which the second bending mode is applied in CID can be executed as the default mode, instead of the second mode in which CID is the first bending mode.

[0397] Furthermore, the integrated control unit 1110 can determine whether the content being displayed while the vehicle is in motion is in portrait or landscape mode, and maintain or change the current orientation accordingly. In this case, the integrated control unit 1110 can readjust the screen ratio and UI to match the display orientation and display them. For example, as the CID is adjusted to a screen ratio corresponding to the vertical orientation of the screen in portrait mode, any blank space on the left or right side can be used as an interactive area.

[0398] In addition, if the content is related to driving restrictions, the integrated control unit 1110 can decide to display the content without changing its form.

[0399] Specifically, during the period when a driving attention mode is sensed based on vehicle detection data, the integrated control unit 1110 can decide to maintain the second mode (or the set default mode) or the current mode. Here, the driving attention mode may refer to the driver's driving on a general road based on vehicle detection data.

[0400] On the other hand, if the driving attention mode is not sensed, the integrated control unit 1110 may generate, sequentially or simultaneously, a first request for changing the display orientation of the CID and a second request for changing the screen size of the PID, based on at least one of the attributes of the content of the expandable screen and the user's input request.

[0401] the following, Figure 12 It is a flowchart used to illustrate the possibility and range of morphological deformation among multiple displays depending on whether the vehicle is in motion and the driving mode.

[0402] Reference Figure 12 The vehicle display device 800 can receive vehicle information (1201) through various vehicle sensors (e.g., OBD, ECU, etc.).

[0403] The vehicle display device 800 senses whether the vehicle is traveling at a speed above a specified speed based on the received vehicle information (1202). For example, if the vehicle's speed is 10 km / h, it then determines whether the road is a road suitable for autonomous driving (1203).

[0404] If the road allows autonomous driving, the mode range is expanded to include both CID and PID (1205). Conversely, if the road is not autonomous, it is checked whether it is a highway (1204). If it is a highway, it is set to only allow PID to be driven during driving (1206). Conversely, if it is determined that it is not a highway, the driver-attention driving mode is executed, and the driving mode display setting is maintained, such as the second mode (or default mode) (1207).

[0405] Then, based on driving conditions, the variable range of CID and PID configurations (1208) is stored. This is to comprehensively control CID and PID, and to pre-save changeable display modes based on driving conditions.

[0406] Specifically, in autonomous driving mode, since the driver's duty of attention is further reduced, the range of morphological changes can be set so that both CID and PID can be activated. On the other hand, when the use of PID is performed independently by the passenger in the front seat, PID can be activated in a privacy mode (SPM) state when it pops up. At this time, if autonomous driving mode ends, in order to ensure the driver's visibility, PID is automatically activated to pop in, while CID returns to the longitudinal mode and the second morphological state of outward bending.

[0407] Furthermore, as a concrete example, the morphological change range can be set during driving to allow for free manipulation of the CID. If a driver's desire to use the PID is sensed, a morphological deformation can be performed, increasing the curvature of the CID to facilitate its use as an interaction area. For instance, if the driver gazes at the PID while driving, this can be recognized as a usage intention, further increasing the curvature of the CID in its second morphological state, thus switching to a second curvature mode. Subsequently, if it is recognized that there has been no interaction with the PID or no gazing at the PID for a specified period, the curvature of the CID can be reduced to its original state, thus restoring the second morphological state.

[0408] As described above, if the range of changeable form is preset according to various driving conditions, then when a form change event occurs based on the request input or the attributes of the content / service, it can be taken into account and the form change request can be quickly determined to be accepted and driven or not accepted.

[0409] the following, Figure 13 This is a flowchart illustrating how a request for a change of form is processed based on the vehicle's driving status, the attributes of the displayed content, and the input request. On the other hand, Figure 13 The actions shown are executed by the processor (or control unit 880) of the vehicle display device 800.

[0410] The processor (or control unit 880) of the vehicle display device 800 can recognize the display expansion request included in the configuration change request.

[0411] Therefore, a change request for the second form may include a change request to a specific form based on the drivers of a plurality of displays, and a request to expand the display of related content across at least two of the plurality of displays. For example, a form change request to rotate the CID to landscape mode and pop out the PID may include a request to expand the display of content currently shown in the CID or PID onto both the CID and PID.

[0412] On the other hand, the processor (or control unit 880) can, based on the vehicle's driving conditions, limit at least one content from being extended to the first display unit 851a, i.e., the instrument panel, during the period when the driver is being driven.

[0413] For example, if a request to expand the screen to the instrument panel and PID is sensed while the vehicle is in motion, the instrument panel display remains unchanged. Conversely, if the request is made as described above, but the vehicle is not in motion, the functionality related to the content being played in the CID can be expanded and displayed to the instrument panel and PID after the configuration change.

[0414] Reference Figure 13 This shows that the vehicle display device 800 senses the occurrence of a shape change event (1301).

[0415] Determine if the form change event is a direct input event (1302). If it is a direct input event, transmit it to the integrated control unit 1110. Figure 11 And confirm whether it is feasible to use the form directly input (1303).

[0416] Conversely, if the form change event is not a direct input, it is determined whether the form change is based on content / service linkage (1304). If it is a form change based on content / service linkage, the appropriate form is determined based on the driving conditions corresponding to the specific attribute.

[0417] Specifically, if it is a content / service attribute related to video conferencing (1306), it can be determined that the CID is in landscape mode and the PID pops up to enable multiple displays to be seamlessly connected.

[0418] Additionally, if the content / service attribute is related to screen extended video and audio (1307), it can be displayed in a PID pop-up format that matches the dashboard, so that the CID, PID, and the playback screen and related list in the dashboard can be displayed seamlessly and clearly.

[0419] Additionally, if it is a content / service attribute (1308) related to an environment image used for relaxation, the CID can be converted to landscape mode and the PID can be popped up to make the environment image seamlessly connected in CID and PID.

[0420] Additionally, if the content / service attributes are related to multi-view audiovisual content (1309), such as sports multi-view or game multi-view, it can be determined that the CID is driven in landscape mode and the PID pops up in form, so that the multi-view image can be easily displayed in the CID and the selected screen can be displayed in full screen in the PID.

[0421] Alternatively, if it is a content / service attribute related to in-app text input (1310), it can be determined to be a second curved pattern in which the CID bends further upward in the horizontal direction, making it easy for the driver or passenger to input text without screen obstruction. In this case, an interactive area such as a virtual keyboard is overlaid in the second area below the second curved pattern. When the input is clearly finished or no input is made within a specified time period, the overlaid interactive area disappears and the CID returns to the form of the first curved pattern.

[0422] As described above, if a suitable configuration is determined, then through the integrated control unit 1110 ( Figure 11 (1311) To confirm whether the change to the form is feasible. If it is within the range of form change, the CID and PID can be driven independently to perform form deformation (1320). Conversely, if the determined form is outside the range of deformability, the current form state of the CID / PID is maintained (1312).

[0423] On the other hand, in cases where the form change event is neither a direct input nor a content / service linkage, the Integrated Control Department 1110 ( Figure 11 Confirm the default mode and execute the drive. For example, if the vehicle is in motion, the drive will be in the second mode; when the vehicle stops, the drive will be in the first mode.

[0424] On the other hand, when the vehicle is parked and the second display is in landscape mode, the interaction related to content use can be expanded. For example, the first display 851a and the third display 851c can be easily expanded to allow for searching content and vertical movement by inputting to the second display 851b, such as swiping, touching, or waving.

[0425] Regarding this, Figure 14a It is a flowchart illustrating various operation modes for displaying content on multiple displays according to a requested display mode.

[0426] in addition, Figure 14b This is a flowchart illustrating how content can be seamlessly displayed on multiple monitors according to a requested display mode. Figure 15a and Figure 15b It is used to explain about Figure 14b The cropping region can be applied variably.

[0427] In addition, unless otherwise stated, Figure 14a and Figure 14b The various actions in the flowchart are executed by the processor (or control unit 880) of the vehicle display device 800.

[0428] First, refer to Figure 14a The vehicle display device 800 receives vehicle information (1401). At the same time, the vehicle display device 800 receives content information displayed on a plurality of displays (1402).

[0429] Next, it is determined whether the multiple displays are used as a multi-monitor setup (1403). If they are displayed independently, the normal display mode is executed (1407).

[0430] If multiple displays are used as multiple displays, it is determined whether the content is subject to driving restrictions (1404). Here, driving-restricted content can refer to infotainment content that is unrelated to vehicle movement, such as audio playback, audio-visual movies, or the running screen of a specific application (not navigation). On the other hand, driving-restricted content is only applicable when the vehicle is in motion. Therefore, even for the driving-restricted content listed above, as long as the vehicle is parked, multiple displays can be used as extended screens.

[0431] If the content is not subject to driving restrictions (or, if the vehicle is parked), confirm whether the displayed content is seamless (1405). Here, seamless content refers to content that has attributes such as extended screen mode, where one piece of content is connected to multiple displays for display.

[0432] If the content is not displayed seamlessly, then the normal display mode is executed (1407). If the content is displayed seamlessly, then the seamless display mode is determined (1408). Then, the attribute information of the current content is received (409), the display driving mode is determined (410), and the corresponding screen ratio and UI are adjusted and the content is displayed.

[0433] On the other hand, when driving is restricted, the PID display is separated from the instrument panel and CID and used independently. For this purpose, the PID operates in a switchable privacy mode (SPM) (1406). Thus, the driver cannot see the content displayed on the PID, thereby not interfering with driving, while the passenger in the front seat can freely view and listen to content.

[0434] On the other hand, even if it's not a driving-related restriction, the instrument panel and CID / PID can be used separately or in conjunction based on input or settings. When used separately, the driver's primary device can automatically link with the CID, and the passenger's secondary device can automatically link with the PID, allowing for independent control via their respective devices. Alternatively, while the vehicle is parked, the driver can use the instrument panel and CID to view / listen to primary information, while the passenger can freely view / listen to secondary information via the PID when SPM is activated.

[0435] On the other hand, refer to Figure 14b , Figure 15a as well as Figure 15b This explains a method for seamless display that takes into account shape deformation when using multiple displays to display driving-related images.

[0436] When at least one piece of content is extended to the second display unit 851b and the third display unit 851c according to a form change request, the vehicle display device 800 can determine the display mode of the content based on the attributes of the content and the form to be changed, and then apply the content after changing the cropping area used for screen extension according to the determined display mode.

[0437] For example, the display can be extended to a horizontal mode for the second display unit 851b and a pop-up mode for the third display unit 851c. In this case, when displaying a driving-related image of the front of the vehicle, it is necessary to perform cropping and joining according to the screen ratio to achieve seamless connection.

[0438] Specifically, refer to Figure 14b The vehicle display device 800 can receive image information collected by the vehicle's front camera (1411). Additionally, the vehicle display device 800 can receive information regarding the current display mode (1412).

[0439] Confirm that the current display mode is single monitor mode (1413). If so, set a single cropping area (1414). At this point, cropping is only considered for the screen ratio of one monitor.

[0440] Conversely, in multi-monitor mode, multiple cropping regions (1415) are set corresponding to the linked multiple monitors. Specifically, multiple cropping regions are set for the received image information according to the driving conditions of each monitor, and the setting of multiple cropping regions can include image size or position adjustment, editing of a portion of the area, transparency adjustment, etc.

[0441] Based on the set single or multiple cropping regions, the cropping region is (1416), and calibration is performed on the cropped region (1417). Then, AR rendering is performed using an AR renderer (not shown) or the like (1418), and then displayed on a single or multiple monitor screen (1419).

[0442] Figure 15a The diagram shows a scenario where the cropped front image is seamlessly displayed in the first portion 1501 and the second portion 1502, respectively, in the portrait mode of the second display unit 851b and the pop-in state of the third display unit 851c.

[0443] Figure 15b The diagram shows a situation where, in the horizontal mode of the second display unit 851b and in the form where the third display unit 851c pops up in a shape equivalent to a variable length L, the cropped front image is seamlessly displayed in the first deformed portion 1503 and the second deformed portion 1504, respectively.

[0444] As described above, according to embodiments of the vehicle display device and its operation method, the configuration of a plurality of displays is changed to an optimal configuration to match the vehicle's driving conditions, the needs of passengers, and the content / services provided, thereby ensuring the driver's field of vision and improving the infotainment experience according to the situation. Furthermore, a configuration that changes according to the vehicle's current driving mode is provided, enabling a more efficient and seamless experience of providing relevant content or services. Additionally, the passenger in the front passenger seat does not need to request display operation; the driver and passenger can operate their respective devices in conjunction with the displays without interfering with each other. Furthermore, various experiences can be provided, allowing the vehicle interior to be used as an office space such as for video conferencing, or a large-screen viewing space providing extended screen content, etc., as needed.

[0445] The aforementioned invention can be implemented using computer-readable code stored in a medium containing a program. Computer-readable media include all types of storage devices storing data that can be read by a computer system. Examples of computer-readable media include HDDs (Hard Disk Drives), SSDs (Solid State Disks), SDDs (Silicon Disk Drives), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and can also be implemented in the form of a carrier wave (e.g., internet-based transmission). Additionally, the computer may also include a controller / processor for the vehicle display device 800. Therefore, the detailed description above should not be construed as limiting in all respects, but rather as exemplary. The scope of this specification should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of this specification should fall within the scope of this invention.

Claims

1. A vehicle display device characterized by comprising: include: The main body can be installed on the vehicle's dashboard; A plurality of displays are formed on the front of the main body, including a first display, a second display configured to be partially flexible, and a third display configured to change the size of the display screen. as well as processor, In response to sensing vehicle movement, the processor, while the second displays of the plurality of displays are in a flat first configuration, changes the first configuration to a second configuration different from the first configuration. The processor determines that there is a change request of the second type based on the vehicle's detection data, the content displayed on a plurality of displays, and at least one of the input requests. The processor determines whether the change to the second form is feasible based on the vehicle's driving conditions, and controls a plurality of the displays to perform the change according to the determined form.

2. The vehicle display device according to claim 1, characterized in that, The second configuration is a structure in which the second display moves relative to the first direction and is at least partially bent; The processor transmits signals for changing to the second mode to a plurality of the displays in response to vehicle driving sensing signals.

3. The vehicle display device according to claim 2, characterized in that, The first configuration is a structure in which the second display moves relative to a second direction opposite to the first direction and becomes flat. The processor transmits signals for changing to the first configuration to the plurality of displays in response to a vehicle stop signal.

4. The vehicle display device according to claim 1, characterized in that, The change request in the second form occurs based on at least one of the following: the vehicle driving mode based on the vehicle's detection data, the attributes of the content displayed on the plurality of displays, and the user input request for the plurality of displays; The processor considers the vehicle's driving status in relation to the vehicle's detection data to determine whether to accept the change request for the second form.

5. The vehicle display device according to claim 4, characterized in that, The third display is supported by a first frame and a second frame that is configured to move relative to the first frame. The processor generates a shape change request event based on the attributes of the content displayed on the plurality of displays and input requests, so that the front exposed area changes with the relative movement of the second frame, thereby changing the screen size of the third display.

6. The vehicle display device according to claim 5, characterized in that, The processor identifies the content displayed on the plurality of displays as infotainment, and generates a format change request event for changing the screen size of the third display based on an input request for the second display.

7. The vehicle display device according to claim 4, characterized in that, The second display is capable of operating in one of the following modes: a flat panel mode where the display is a plane, a first bending mode where at least a portion of the display has a different degree of bending, and a second bending mode. In the second mode, the processor generates a mode change request event for the second display to change from the first bending mode to the second bending mode based on the usage request for the third display.

8. The vehicle display device according to claim 7, characterized in that, When a region of the second display is touched in the second state, the processor recognizes it as a use request for the third display and generates a form change request event for changing to a second bending mode in which the curvature of the curved portion of the second display changes and the lower end rises and falls.

9. The vehicle display device according to claim 4, characterized in that, The second display is configured to change the screen orientation by rotating relative to the main body; The processor generates a shape change request event for the second display to restore curvature and change the screen orientation of the display by relative rotation, based on at least one of the attributes of the content displayed on the plurality of displays and a user input request.

10. The vehicle display device according to claim 4, characterized in that, During the period when a driving attention mode is sensed based on the detection data, the processor determines whether to maintain the second mode or the current mode; The driving attention mode includes driver driving on general roads based on the detection data.

11. The vehicle display device according to claim 10, characterized in that, During the period when the driving attention mode is not sensed, the processor uses a first request to change the display orientation of the second display and a second request to change the screen size of the third display, either sequentially or simultaneously, based on at least one of the attributes of the content of the expandable screen and a user input request.

12. The vehicle display device according to claim 11, characterized in that, The second type of change request includes: A request to expand at least one of the contents to be displayed on two or more displays, from the first display to the third display, after a morphological change according to the first request and the second request. During the period when the driver is sensed to be driving based on the vehicle's driving conditions, the processor controls at least one of the contents not to be extended to the first display.

13. The vehicle display device according to claim 12, characterized in that, In the case where at least one of the contents is extended to the second display and the third display in accordance with the second form change request. The processor determines the display mode of the content based on its attributes and the form to be changed, and changes the cropping area used for screen expansion according to the determined display mode.

14. The vehicle display device according to claim 11, characterized in that, The processor detects the driver's movement based on the vehicle's driving status and maintains the current configuration of the plurality of displays based on at least one of the contents being driving restriction content; The processor displays at least one of the contents by executing a switchable privacy mode for the third display.

15. The vehicle display device according to claim 1, characterized in that, After the change to the second form, the processor considers the vehicle's driving status based on the vehicle's detection data and controls a plurality of displays to transform the changed form back to the previous state or the second form.

16. A method for operating a vehicle display device, The vehicle display device includes a plurality of displays formed on the front of a body that can be mounted on the dashboard of a vehicle; The plurality of said displays include: First display; The second display is designed to be partially flexible; as well as The third monitor is configured to be able to change the size of the displayed image. The operation method of the vehicle display device includes: In a state where the second display of the plurality of displays forms a flat first shape, the step of changing the plurality of displays to a second shape different from the first shape by sensing the movement of the vehicle; The step of determining a change request for the second form based on vehicle detection data, the content displayed on multiple displays, and at least one of the input requests; and The feasibility of the second form change is determined based on the vehicle's driving conditions, and the step of changing to the determined form is executed.

Images