Vehicle display device having multiple displays and operation method thereof

Abstract

A display device for a vehicle and an operation method thereof are disclosed. A display device for a vehicle according to an embodiment of the present invention comprises: multiple displays formed on the front side of the main body and formed to be mountable on a vehicle dashboard; and a processor. The multiple displays comprise: a first display; a second display, a part of which is bendable; and a third display with a display screen size that is variable. When driving of the vehicle is detected while the second display among the multiple displays is in a first form factor that is flat, the processor controls the second display to change to a second form factor that is different from the first form factor. In addition, the processor may determine that there is a request for a change to the second form factor on the basis of at least one of sensing data of the vehicle, content displayed on the multiple displays, and an input request. In such a case, the processor may identify whether a change to the second form factor is possible on the basis of a driving situation of the vehicle, and may control the multiple displays to change to the form factor according to the determination.

Description

Vehicle display device having multiple displays and its operating method

[0001] The present invention relates to a vehicle display device having a plurality of displays and an operating method thereof, and more particularly, to a vehicle display device having a plurality of displays whose form factor varies depending on the situation and an operating method thereof.

[0002] A vehicle is a device that allows the user to move in the desired direction. A representative example is an automobile.

[0003] Meanwhile, various sensors and electronic devices are being installed in vehicles to enhance the convenience of users. In particular, research is actively underway on Advanced Driver Assistance Systems (ADAS) to enhance user convenience. Furthermore, development of autonomous vehicles (AVs) is also actively underway.

[0004] Autonomous driving refers to a system that enables a vehicle to make its own decisions and drive accordingly. Autonomous driving can be categorized into stages ranging from non-automation to full automation, depending on the degree to which the system participates in driving and the degree to which the driver controls the vehicle.

[0005] Autonomous driving has transformed the perception of vehicles as spaces for dwelling, rather than simply a means of transportation. Furthermore, the trend toward installing larger displays in vehicles has become increasingly prevalent, allowing drivers to freely enjoy a variety of infotainment options. When installing such large displays, they must be designed to satisfy the user's full infotainment experience without obstructing the driver's view.

[0006] The present invention aims to solve the above-mentioned problems and other problems.

[0007] According to some embodiments of the present invention, an object of the present invention is to provide a vehicle display device having a plurality of displays with variable form factors so as to secure a driver's field of vision while improving the infotainment experience depending on the situation, and an operating method thereof.

[0008] In addition, according to some embodiments of the present invention, another object is to provide a vehicle display device having a plurality of displays in which the plurality of displays can be optimally transformed according to the driving conditions of the vehicle, the needs of passengers, and the content / services provided, and a method of operating the same.

[0009] To this end, the vehicle display device and its operating method in an embodiment of the present invention can drive a plurality of displays including at least a flexible display panel to be transformed into an optimal form factor according to at least one of a driving condition of the vehicle, characteristics of content or service to be displayed, and a request based on an input.

[0010] The vehicle display device can be driven to form different form factors depending on whether the vehicle is moving or stopped.

[0011] In addition, the vehicle display device checks whether form factor transformation is possible by considering the driving conditions of the vehicle when transforming the form factor of multiple displays according to the properties of the requested content / service or a direct request from the user.

[0012] Specifically, a vehicle display device according to an embodiment of the present invention includes: a main body mountable on a dashboard of a vehicle; a plurality of displays formed on a front surface of the main body, the plurality of displays including a first display, a second display provided so as to be bendable at a portion thereof, and a third display provided so as to be variable in the size of a display screen; and a processor. The processor may control the plurality of displays to change to a second form factor different from the first form factor in response to detection of driving of a vehicle while the second display of the plurality of displays forms a flat first form factor, and determine whether there is a request to change the second form factor based on at least one of sensing data of the vehicle, content displayed on the plurality of displays, and an input request, and determine whether a change to the second form factor is possible based on a driving situation of the vehicle, and execute a change to a form factor according to the determination.

[0013] In an embodiment, the second form factor may be a structure in which the second display moves relative to the first direction and at least a portion thereof is bent. In addition, the processor may transmit a signal to the plurality of displays for changing to the second form factor in response to a vehicle driving detection signal.

[0014] In an embodiment, the first form factor may be a structure in which the second display moves relative to the first direction and becomes flat. In addition, the processor may transmit a signal to the plurality of displays to change to the first form factor in response to a vehicle stop signal.

[0015] In an embodiment, the request for changing the second form factor may be generated based on at least one of a vehicle driving mode based on sensing data of the vehicle, properties of content displayed on the plurality of displays, and a user input request for the plurality of displays. In addition, the processor may determine whether to accept the request for changing the second form factor generated by considering the driving conditions of the vehicle related to the sensing data of the vehicle.

[0016] In an embodiment, the third display may be a structure supported by a first frame and a second frame formed to be relatively movable with respect to the first frame. In addition, the processor may generate a form factor change request event so that the screen size of the third display is changed by varying the front exposure area according to the relative movement of the second frame based on the properties of the content displayed on the plurality of displays and an input request.

[0017] In an embodiment, the processor may recognize that the content displayed on the plurality of displays is an infotainment attribute, and may generate a form factor change request event for changing the screen size of the third display based on an input request for the second display.

[0018] In an embodiment, the second display is operable in one of a flat mode in which the display is flat, a first bending mode in which at least a portion of the display has a different degree of bending, and a second bending mode, and the processor is operable to generate a form factor change request event for causing the second display to change from the first bending mode to the second bending mode based on a usage request for the third display in the second form factor.

[0019] In an embodiment, the processor may recognize a request for use of the third display when a portion of the second display is touched in the second form factor state, and generate a form factor change request event for changing to a second bending mode in which the curvature of the bent portion of the second display is changed and the lower portion is raised and lowered.

[0020] In an embodiment, the second display may be configured to change the screen orientation of the display by rotating relative to the main body. In addition, the processor may generate a form factor change request event, based on at least one of the properties of the content displayed on the plurality of displays and a user input request, to restore the bending of the second display and rotate it relative to change the screen orientation of the display.

[0021] In an embodiment, the processor may determine to maintain the second form factor or the current form factor while a driving attention mode is detected based on the sensing data. Here, the driving attention mode may include driver driving on a general road based on the sensing data.

[0022] In an embodiment, the processor may sequentially or simultaneously generate a first request to change the display orientation of the second display and a second request to change the screen size of the third display based on at least one of a property of the screen-scalable content and a user input request while the driving attention mode is not detected.

[0023] In an embodiment, the request for changing the second form factor may include a request for expanding and displaying the at least one content on two or more of the first to third displays after the form factor change according to the first and second requests. In addition, the processor may control the at least one content not to be expanded to at least the first display while the driver's driving is detected according to the driving conditions of the vehicle.

[0024] In an embodiment, when the processor expands the at least one content to the second and third displays in response to the second form factor change request, the processor may determine a display mode of the content based on the properties of the content and the shape of the form factor to be changed, and may perform the process by varying the crop area for screen expansion in accordance with the determined display mode.

[0025] In an embodiment, the processor may maintain the current form factor of the plurality of displays based on the detection of driver activity and the presence of at least one content that is driving regulation content, depending on the driving conditions of the vehicle. In this case, the processor may execute a switchable privacy mode (SPM) for the third display to display at least one content.

[0026] In an embodiment, the processor may control the plurality of displays to transform the changed form factor into a previous state or the second form factor by considering the driving situation of the vehicle identified based on the sensing data of the vehicle after the change of the second form factor.

[0027] According to a vehicle display device and its operating method according to an embodiment of the present invention, the form factors of multiple displays are optimally changed according to the driving conditions of the vehicle, the needs of passengers, and the content / services provided, thereby satisfying both securing the driver's field of vision and improving the infotainment usability according to the situation.

[0028] In addition, according to the vehicle display device and its operating method according to an embodiment of the present invention, the form factor is changed according to the current driving mode of the vehicle, providing an experience in which related contents or services are provided in a more efficient and seamless format.

[0029] In addition, according to the vehicle display device and its operating method according to an embodiment of the present invention, the passenger in the passenger seat does not need to separately request display operation, and the driver and the driver can operate their respective devices by linking the displays without interfering with each other.

[0030] Furthermore, according to the vehicle display device and its operating method according to an embodiment of the present invention, it is possible to provide various experiences that can be used in a desired form, such as an office space for video conferencing, a large-screen viewing space for providing screen expanded content, etc.

[0031] Figure 1 is an exemplary block diagram for explaining the configuration of a vehicle related to the present invention.

[0032] Figure 2a is an exemplary drawing of a display device according to the present invention mounted on a vehicle.

[0033] Figure 2b is an exemplary block diagram for explaining the detailed configuration of a vehicle display device according to the present invention.

[0034] FIG. 2c and FIG. 2d are drawings for explaining a display unit having a structure that is movable up and down and partially bendable according to the present invention.

[0035] FIGS. 3 and 4 are drawings for explaining an example in which a second display unit is implemented in one of the first form factor and the second form factor in a vehicle display device according to the present invention.

[0036] FIG. 5 is an exemplary drawing for explaining a form factor variation in which the size of the third display unit is variable in a vehicle display device according to the present invention.

[0037] FIG. 6 is an exemplary drawing for explaining a form factor deformation in which the direction of the second display unit is changed in a vehicle display device according to the present invention, and FIG. 7 is an exemplary drawing for explaining a form factor deformation in which a size change of the third display unit in FIG. 6 additionally occurs.

[0038] FIG. 8 is an exemplary flowchart for explaining an operation method of a vehicle display device related to a form factor modification related to the present invention.

[0039] FIG. 9 is a drawing for explaining a form factor modification that changes the size of a third display unit corresponding to an auxiliary seat by using an operation on a second display unit in a vehicle display device according to the present invention.

[0040] FIG. 10 is a drawing for explaining a form factor modification that changes the degree of bending of a second display unit according to an input request for a third display unit in a vehicle display device according to the present invention.

[0041] Figure 11 is a block diagram illustrating integrated control of form factor transformation between multiple displays according to various situations that may occur in a vehicle.

[0042] Figure 12 is a block diagram illustrating the possibility and range of form factor variations between multiple displays depending on whether the vehicle is in motion and the driving mode.

[0043] Figure 13 is a flowchart illustrating processing a request based on the driving conditions of the vehicle, the properties of the displayed content, and the input request when a form factor change request occurs.

[0044] FIG. 14a is a flowchart illustrating various operation modes for displaying content on multiple displays depending on the display mode of the requested form factor.

[0045] FIG. 14b is a flowchart for explaining seamless display of content on multiple displays according to the display mode of the requested form factor, and FIGS. 15a and 15b are drawings for explaining variable application of a crop area in relation to FIG. 14b.

[0046] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0047] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0048] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0049] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0050] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0051] Figure 1 is an exemplary block diagram for explaining the configuration of a vehicle related to the present invention.

[0052] Referring to FIG. 1, the vehicle (100) may include wheels that rotate by a power source and a steering input device (510) for controlling the direction of travel of the vehicle (100).

[0053] The vehicle (100) may be an autonomous vehicle. The vehicle (100) may be switched between an autonomous driving mode and a manual driving mode based on user input. For example, the vehicle (100) may be switched from a manual mode to an autonomous driving mode, or from an autonomous driving mode to a manual mode, based on user input received through a user interface device (hereinafter, referred to as a "user terminal") (200).

[0054] The vehicle (100) can be switched to autonomous driving mode or manual driving mode based on driving situation information. The driving situation information can be generated based on object information provided by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on the driving situation information generated by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on driving situation information received through the communication device (400).

[0055] The vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on information, data, and signals provided from an external device.

[0056] When the vehicle (100) is operated in autonomous driving mode, the autonomous vehicle (100) may be operated based on the driving system (700). For example, the autonomous vehicle (100) may be operated based on information, data, or signals generated from the driving system (710), the exit system (740), and the parking system (750).

[0057] When the vehicle (100) is driven in manual mode, the autonomous vehicle (100) can receive user input for driving through the driving control device (500). Based on the user input received through the driving control device (500), the vehicle (100) can be driven.

[0058] A vehicle (100) may include a user interface device (200), an object detection device (300), a communication device (400), a driving operation device (500), a vehicle driving device (600), a driving system (700), a navigation system (770), a sensing unit (120), a vehicle interface unit (130), a memory (140), a control unit (170), and a power supply unit (190).

[0059] Depending on the embodiment, the vehicle (100) may include other components in addition to the components described herein, or may not include some of the components described herein.

[0060] The user interface device (200) is a device for communication between a vehicle (100) and a user. The user interface device (200) can receive user input and provide information generated in the vehicle (100) to the user. The vehicle (100) can implement a UI (User Interfaces) or UX (User Experience) through the user interface device (hereinafter, referred to as a 'user terminal') (200).

[0061] The user interface device (200) may include an input unit (210), an internal camera (220), a biometric detection unit (230), an output unit (250), and a processor (270). Depending on the embodiment, the user interface device (200) may include other components in addition to the described components, or may not include some of the described components.

[0062] The input unit (210) is for receiving information from a user, and data collected from the input unit (210) can be analyzed by a processor (270) and processed into a user's control command.

[0063] The input unit (210) may be placed inside the vehicle. For example, the input unit (210) may be placed in an area of ​​a steering wheel, an area of ​​an instrument panel, an area of ​​a seat, an area of ​​each pillar, an area of ​​a door, an area of ​​a center console, an area of ​​a head lining, an area of ​​a sun visor, an area of ​​a windshield, or an area of ​​a window.

[0064] The input unit (210) may include a voice input unit (211), a gesture input unit (212), a touch input unit (213), and a mechanical input unit (214).

[0065] The voice input unit (211) can convert a user's voice input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170). The voice input unit (211) can include one or more microphones.

[0066] The gesture input unit (212) can convert a user's gesture input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0067] The gesture input unit (212) may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input. According to an embodiment, the gesture input unit (212) may detect a user's three-dimensional gesture input. To this end, the gesture input unit (212) may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.

[0068] The gesture input unit (212) can detect a user's 3D gesture input through a TOF (Time of Flight) method, a structured light method, or a disparity method.

[0069] The touch input unit (213) can convert a user's touch input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0070] The touch input unit (213) may include a touch sensor for detecting a user's touch input. In some embodiments, the touch input unit (213) may be formed integrally with the display unit (251), thereby implementing a touch screen. Such a touch screen may provide both an input interface and an output interface between the vehicle (100) and the user.

[0071] The mechanical input unit (214) may include at least one of a button, a dome switch, a jog wheel, and a jog switch. An electrical signal generated by the mechanical input unit (214) may be provided to a processor (270) or a control unit (170). The mechanical input unit (214) may be placed on a steering wheel, a center fascia, a center console, a cockpit module, a door, etc.

[0072] The internal camera (220) can capture images of the vehicle interior. The processor (270) can detect the user's status based on the images of the vehicle interior. The processor (270) can obtain information about the user's gaze from the images of the vehicle interior. The processor (270) can detect the user's gestures from the images of the vehicle interior.

[0073] The biometric detection unit (230) can obtain the user's biometric information. The biometric detection unit (230) includes a sensor capable of obtaining the user's biometric information, and can use the sensor to obtain the user's fingerprint information, heartbeat information, etc. The biometric information can be used for user authentication.

[0074] The output unit (250) is for generating output related to visual, auditory, or tactile sensations. The output unit (250) may include at least one of a display unit, an audio output unit (252), and a haptic output unit (253).

[0075] Meanwhile, the display unit may be used to mean a vehicle display device (800) according to the present invention or a plurality of displays thereof. Alternatively, a vehicle display device (800) according to an embodiment of the present invention may be included as one of the display units.

[0076] In addition, the user interface device (200) may be understood as having the same concept as the vehicle display device (800) according to the present invention. In this case, at least some of the components included in the user interface device (200) of FIG. 1 and the components of the vehicle display device (800) of FIG. 2b may be understood as having the same concept.

[0077] The display unit can display graphic objects corresponding to various pieces of information. The display unit can include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0078] The display unit can be formed as a layer structure or integrally formed with the touch input unit (213), thereby implementing a touch screen.

[0079] The display unit may be implemented as a HUD (Head Up Display). If the display unit is implemented as a HUD, the display unit may include a projection module to output information through an image projected onto a windshield or window.

[0080] The display unit may include a transparent display. The transparent display may be attached to a windshield or a window. The transparent display may have a predetermined transparency and display a predetermined screen. In order to have transparency, the transparent display may include at least one of a transparent TFEL (Thin Film Electroluminescent), a transparent OLED (Organic Light-Emitting Diode), a transparent LCD (Liquid Crystal Display), a transparent display, and a transparent LED (Light Emitting Diode) display. The transparency of the transparent display may be adjusted.

[0081] Meanwhile, the user interface device (200) may include a plurality of display units. In this case, the plurality of display units may be located in various areas within the vehicle.

[0082] The audio output unit (252) converts an electric signal provided from the processor (270) or the control unit (170) into an audio signal and outputs the converted signal. To this end, the audio output unit (252) may include one or more speakers.

[0083] The haptic output unit (253) generates a tactile output. For example, the haptic output unit (253) can operate by vibrating a steering wheel, a seat belt, or a seat so that a user can perceive the output.

[0084] The processor (hereinafter, referred to as the 'control unit') (270) can control the overall operation of each unit of the user interface device (200). That is, the user interface device (200) can be operated under the control of the control unit (170).

[0085] Depending on the embodiment, the user interface device (200) may include a plurality of processors (270) or may not include a processor (270).

[0086] If the user interface device (200) does not include a processor (270), the user interface device (200) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0087] The object detection device (300) is a device for detecting objects located outside a vehicle (100). The objects may be various objects related to the operation of the vehicle (100). For example, the objects may include lanes, other vehicles, pedestrians, two-wheeled vehicles, traffic signals, lights, roads, structures, speed bumps, terrain, animals, etc.

[0088] Meanwhile, objects can be classified into moving objects and fixed objects. For example, moving objects may include concepts such as other vehicles and pedestrians. For example, fixed objects may include concepts such as traffic signals, roads, and structures.

[0089] The object detection device (300) may include a camera (310), a radar (320), a lidar (330), an ultrasonic sensor (340), an infrared sensor (350), and a processor (370).

[0090] Depending on the embodiment, the object detection device (300) may include other components in addition to the described components, or may not include some of the described components.

[0091] The camera (310) may be positioned at an appropriate location outside the vehicle to capture images of the vehicle's exterior. The camera (310) may be a mono camera, a stereo camera (310a), an AVM (Around View Monitoring) camera (310b), or a 360-degree camera.

[0092] For example, the camera (310) may be positioned inside the vehicle, close to the front windshield, to capture an image of the front of the vehicle. Alternatively, the camera (310) may be positioned around the front bumper or radiator grill.

[0093] For example, the camera (310) may be positioned inside the vehicle, close to the rear glass, to capture images of the rear of the vehicle. Alternatively, the camera (310) may be positioned around the rear bumper, trunk, or tailgate.

[0094] For example, the camera (310) may be positioned close to at least one of the side windows inside the vehicle to obtain an image of the side of the vehicle. Alternatively, the camera (310) may be positioned around a side mirror, fender, or door.

[0095] The camera (310) can provide the acquired image to the processor (370).

[0096] The radar (320) may include an electromagnetic wave transmitter and receiver. The radar (320) may be implemented in a pulse radar or continuous wave radar manner based on the principle of radio wave emission. Among continuous wave radar methods, the radar (320) may be implemented in a frequency modulated continuous wave (FMCW) manner or a frequency shift keying (FSK) manner depending on the signal waveform.

[0097] The radar (320) can detect an object using electromagnetic waves, based on a TOF (Time of Flight) method or a phase-shift method, and can detect the location of the detected object, the distance to the detected object, and the relative speed.

[0098] The radar (320) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0099] The lidar (330) may include a laser transmitter and receiver. The lidar (330) may be implemented using a TOF (Time of Flight) method or a phase-shift method.

[0100] The lidar (330) can be implemented as a driven or non-driven type.

[0101] When implemented as a drive type, the lidar (330) is rotated by a motor and can detect objects around the vehicle (100).

[0102] When implemented in a non-driven manner, the lidar (330) can detect an object located within a predetermined range relative to the vehicle (100) through optical steering. The vehicle (100) can include a plurality of non-driven lidars (330).

[0103] Lidar (330) can detect an object based on a time-of-flight (TOF) method or a phase-shift method using laser light as a parameter, and can detect the position of the detected object, the distance to the detected object, and the relative speed.

[0104] The lidar (330) can be placed at an appropriate location outside the vehicle to detect objects located in front, behind, or to the side of the vehicle.

[0105] The ultrasonic sensor (340) may include an ultrasonic transmitter and a receiver. The ultrasonic sensor (340) may detect an object based on ultrasonic waves, and may detect the location of the detected object, the distance from the detected object, and the relative speed.

[0106] The ultrasonic sensor (340) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0107] The infrared sensor (350) may include an infrared transmitter and a receiver. The infrared sensor (340) may detect an object based on infrared light, and may detect the location of the detected object, the distance to the detected object, and the relative speed.

[0108] The infrared sensor (350) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0109] The processor (370) can control the overall operation of each unit of the object detection device (300).

[0110] The processor (370) can detect and track an object based on the acquired image. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object through an image processing algorithm.

[0111] The processor (370) can detect and track an object based on the reflected electromagnetic waves that are returned when the transmitted electromagnetic waves are reflected by the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the electromagnetic waves.

[0112] The processor (370) can detect and track an object based on the reflected laser light that is reflected back by the transmitted laser beam from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the laser light.

[0113] The processor (370) can detect and track an object based on the reflected ultrasonic waves that are returned when the transmitted ultrasonic waves are reflected off the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the ultrasonic waves.

[0114] The processor (370) can detect and track an object based on the reflected infrared light that is reflected back by the transmitted infrared light from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the infrared light.

[0115] Depending on the embodiment, the object detection device (300) may include multiple processors (370) or may not include a processor (370). For example, each of the camera (310), radar (320), lidar (330), ultrasonic sensor (340), and infrared sensor (350) may individually include a processor.

[0116] If the object detection device (300) does not include a processor (370), the object detection device (300) can be operated under the control of the processor or control unit (170) of the device in the vehicle (100).

[0117] The object detection device (400) can be operated under the control of the control unit (170).

[0118] The communication device (400) is a device for communicating with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

[0119] The communication device (400) may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element to perform communication.

[0120] The communication device (400) may include a short-range communication unit (410), a location information unit (420), a V2X communication unit (430), an optical communication unit (440), a broadcast transmission / reception unit (450), and a processor (470).

[0121] Depending on the embodiment, the communication device (400) may include additional components other than the described components, or may not include some of the described components.

[0122] The short-range communication unit (410) is a unit for short-range communication. The short-range communication unit (410) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.

[0123] The short-range communication unit (410) can form a short-range wireless communication network (Wireless Area Network) to perform short-range communication between the vehicle (100) and at least one external device.

[0124] The location information unit (420) is a unit for obtaining location information of a vehicle (100). For example, the location information unit (420) may include a GPS (Global Positioning System) module or a DGPS (Differential Global Positioning System) module.

[0125] The V2X communication unit (430) is a unit for performing wireless communication with a server (V2I: Vehicle to Infrastructure), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit (430) may include an RF circuit capable of implementing protocols for communication with infrastructure (V2I), communication between vehicles (V2V), and communication with pedestrians (V2P).

[0126] The optical communication unit (440) is a unit for communicating with an external device via light. The optical communication unit (440) may include an optical transmission unit that converts an electrical signal into an optical signal and transmits it to the outside, and an optical reception unit that converts a received optical signal into an electrical signal.

[0127] According to an embodiment, the light transmitting unit may be formed to be integrated with a lamp included in the vehicle (100).

[0128] The broadcast transmitter / receiver (450) is a unit for receiving broadcast signals from an external broadcast management server via a broadcast channel, or transmitting broadcast signals to the broadcast management server. The broadcast channels may include satellite channels and terrestrial channels. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals.

[0129] The processor (470) can control the overall operation of each unit of the communication device (400).

[0130] Depending on the embodiment, the communication device (400) may include a plurality of processors (470) or may not include a processor (470).

[0131] If the communication device (400) does not include a processor (470), the communication device (400) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0132] Meanwhile, the communication device (400) may implement a vehicle display device together with the user interface device (200). In this case, the vehicle display device may be referred to as a telematics device or an AVN (Audio Video Navigation) device.

[0133] The communication device (400) can be operated under the control of the control unit (170).

[0134] The driving control device (500) is a device that receives user input for driving.

[0135] When in manual mode, the vehicle (100) can be driven based on signals provided by the driving control device (500).

[0136] The driving control device (500) may include a steering input device (510), an acceleration input device (530), and a brake input device (570).

[0137] The steering input device (510) can receive input for the direction of travel of the vehicle (100) from the user. The steering input device (510) is preferably formed in the form of a wheel so that steering input can be provided by rotation. Depending on the embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

[0138] The acceleration input device (530) can receive an input from a user for accelerating the vehicle (100). The brake input device (570) can receive an input from a user for decelerating the vehicle (100). The acceleration input device (530) and the brake input device (570) are preferably formed in the form of a pedal. Depending on the embodiment, the acceleration input device or the brake input device may also be formed in the form of a touch screen, a touch pad, or a button.

[0139] The driving operation device (500) can be operated under the control of the control unit (170).

[0140] The vehicle driving device (600) is a device that electrically controls the driving of various devices in the vehicle (100).

[0141] The vehicle driving device (600) may include a power train driving unit (610), a chassis driving unit (620), a door / window driving unit (630), a safety device driving unit (640), a lamp driving unit (650), and an air conditioning driving unit (660).

[0142] Depending on the embodiment, the vehicle drive device (600) may include additional components other than the described components, or may not include some of the described components.

[0143] Meanwhile, the vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0144] The power train drive unit (610) can control the operation of the power train device.

[0145] The power train drive unit (610) may include a power source drive unit (611) and a transmission drive unit (612).

[0146] The power source driving unit (611) can perform control over the power source of the vehicle (100).

[0147] For example, if a fossil fuel-based engine is the power source, the power source drive unit (610) can perform electronic control of the engine. This can control the engine output torque, etc. The power source drive unit (611) can adjust the engine output torque according to the control of the control unit (170).

[0148] For example, if an electric energy-based motor is the power source, the power source driving unit (610) can perform control over the motor. The power source driving unit (610) can adjust the rotation speed, torque, etc. of the motor according to the control of the control unit (170).

[0149] The transmission drive unit (612) can perform control over the transmission. The transmission drive unit (612) can adjust the state of the transmission. The transmission drive unit (612) can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

[0150] Meanwhile, when the engine is the power source, the transmission drive unit (612) can adjust the gear engagement state in the forward (D) state.

[0151] The chassis drive unit (620) can control the operation of the chassis device. The chassis drive unit (620) can include a steering drive unit (621), a brake drive unit (622), and a suspension drive unit (623).

[0152] The steering drive unit (621) can perform electronic control of the steering apparatus within the vehicle (100). The steering drive unit (621) can change the direction of travel of the vehicle.

[0153] The brake drive unit (622) can perform electronic control of the brake apparatus within the vehicle (100). For example, the speed of the vehicle (100) can be reduced by controlling the operation of the brakes placed on the wheels.

[0154] Meanwhile, the brake driving unit (622) can individually control each of the plurality of brakes. The brake driving unit (622) can control the braking force applied to the plurality of wheels differently.

[0155] The suspension drive unit (623) can perform electronic control of the suspension apparatus within the vehicle (100). For example, when there is a curve in the road surface, the suspension drive unit (623) can control the suspension apparatus to reduce vibration of the vehicle (100). Meanwhile, the suspension drive unit (623) can individually control each of the plurality of suspensions.

[0156] The door / window actuator (630) can perform electronic control of a door apparatus or window apparatus in a vehicle (100).

[0157] The door / window driving unit (630) may include a door driving unit (631) and a window driving unit (632).

[0158] The door driving unit (631) can control the door device. The door driving unit (631) can control the opening and closing of a plurality of doors included in the vehicle (100). The door driving unit (631) can control the opening or closing of a trunk or tail gate. The door driving unit (631) can control the opening or closing of a sunroof.

[0159] The window driving unit (632) can perform electronic control of a window apparatus. It can control the opening or closing of a plurality of windows included in a vehicle (100).

[0160] The safety device driving unit (640) can perform electronic control of various safety devices in the vehicle (100).

[0161] The safety device drive unit (640) may include an airbag drive unit (641), a seat belt drive unit (642), and a pedestrian protection device drive unit (643).

[0162] The airbag driving unit (641) can perform electronic control of the airbag apparatus within the vehicle (100). For example, the airbag driving unit (641) can control the airbag to deploy when a danger is detected.

[0163] The seat belt drive unit (642) can perform electronic control of the seat belt apparatus within the vehicle (100). For example, the seat belt drive unit (642) can control the passenger to be secured to the seat (110FL, 110FR, 110RL, 110RR) using the seat belt when a danger is detected.

[0164] The pedestrian protection device drive unit (643) can perform electronic control of the hood lift and pedestrian airbag. For example, the pedestrian protection device drive unit (643) can control the hood lift up and the pedestrian airbag to deploy when a collision with a pedestrian is detected.

[0165] The lamp driving unit (650) can perform electronic control of various lamp apparatuses within the vehicle (100).

[0166] The air conditioning drive unit (660) can perform electronic control of the air conditioning device (air cinditioner) within the vehicle (100). For example, the air conditioning drive unit (660) can control the air conditioning device to operate and supply cool air to the vehicle when the temperature inside the vehicle is high.

[0167] The vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0168] The vehicle driving device (600) can be operated under the control of the control unit (170).

[0169] The driving system (700) is a system that controls various operations of the vehicle (100). The driving system (700) can be operated in autonomous driving mode.

[0170] The driving system (700) may include a driving system (710), an exiting system (740), and a parking system (750).

[0171] Depending on the embodiment, the driving system (700) may include other components in addition to the described components, or may not include some of the described components.

[0172] Meanwhile, the driving system (700) may include a processor. Each unit of the driving system (700) may individually include a processor.

[0173] Meanwhile, depending on the embodiment, if the driving system (700) is implemented in software, it may be a sub-concept of the control unit (170).

[0174] Meanwhile, according to an embodiment, the driving system (700) may be a concept including at least one of a user interface device (200), an object detection device (300), a communication device (400), a vehicle driving device (600), and a control unit (170).

[0175] The driving system (710) can drive the vehicle (100).

[0176] The driving system (710) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100).

[0177] The exit system (740) can perform exit of a vehicle (100).

[0178] The exit system (740) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100).

[0179] The parking system (750) can perform parking of a vehicle (100).

[0180] The parking system (750) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100).

[0181] A navigation system (770) can provide navigation information. The navigation information can include at least one of map information, set destination information, route information based on the set destination, information on various objects along the route, lane information, and current vehicle location information.

[0182] The navigation system (770) may include memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system (770).

[0183] According to an embodiment, the navigation system (770) may receive information from an external device via the communication device (400) and update previously stored information.

[0184] Depending on the embodiment, the navigation system (770) may be classified as a subcomponent of the user interface device (200).

[0185] The sensing unit (120) can sense the status of the vehicle. The sensing unit (120) can include a posture sensor (e.g., a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight detection sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, etc.

[0186] The sensing unit (120) can obtain sensing signals for vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward / backward information, battery information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illumination, pressure applied to an accelerator pedal, pressure applied to a brake pedal, etc.

[0187] The sensing unit (120) may further include, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.

[0188] The vehicle interface unit (130) can serve as a conduit for various types of external devices connected to the vehicle (100). For example, the vehicle interface unit (130) may be equipped with a port capable of connecting to a mobile terminal, and may be connected to the mobile terminal through the port. In this case, the vehicle interface unit (130) can exchange data with the mobile terminal.

[0189] Meanwhile, the vehicle interface unit (130) may serve as a conduit for supplying electrical energy to a connected mobile terminal. When the mobile terminal is electrically connected to the vehicle interface unit (130), the vehicle interface unit (130) may provide the mobile terminal with electrical energy supplied from the power supply unit (190) under the control of the control unit (170).

[0190] The memory (140) is electrically connected to the control unit (170). The memory (140) can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory (140) can be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory (140) can store various data for the overall operation of the vehicle (100), such as programs for processing or controlling the control unit (170).

[0191] Depending on the embodiment, the memory (140) may be formed integrally with the control unit (170) or implemented as a sub-component of the control unit (170).

[0192] The control unit (170) can control the overall operation of each unit within the vehicle (100). The control unit (170) can be referred to as an ECU (Electronic Control Unit).

[0193] The power supply unit (190) can supply power required for the operation of each component under the control of the control unit (170). In particular, the power supply unit (190) can receive power from a battery or the like inside the vehicle.

[0194] One or more processors and control units (170) included in the vehicle (100) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0195] Fig. 2a is an exemplary drawing of a vehicle display device (800) according to the present invention mounted on a vehicle. Fig. 2b is an exemplary block diagram for explaining the detailed configuration of the display device according to the present invention.

[0196] Meanwhile, the vehicle display device (800) can be understood as having the same or similar concept as the user interface device (200) described in FIG. 1 above. However, the vehicle display device (800) described in the embodiment of the present invention is mounted on the dashboard of the vehicle (100) and includes a plurality of displays.

[0197] As illustrated in FIG. 2A, a display device (800) according to an embodiment of the present invention may be mounted on a dashboard in a vehicle (100). The vehicle display device (800) may be implemented to include a plurality of displays on the dashboard that extend longitudinally from the driver's seat position to correspond to the passenger seat position.

[0198] A vehicle display device (800) can be mounted on, for example, a dashboard of a vehicle and control various devices used for driving the vehicle or display information necessary for operating the vehicle or information necessary for providing convenience to vehicle passengers on a plurality of displays, i.e., a display unit (851).

[0199] The display unit (851) may include a first display unit (851a), a second display unit (851b), and a third display unit (851c), which may be included within a single frame. Furthermore, the display unit (851) may be implemented in a wing type form, as illustrated in FIG. 2A. Furthermore, the display unit (851) may be implemented to be psychologically connected in a horizontal direction.

[0200] Referring to FIG. 2b, the vehicle display device (800) may include a wireless communication unit (810), an input unit (820), a sensing unit (840), an output unit (850), an interface unit (860), a memory (870), a control unit (880), and a power supply unit (890). The components illustrated in FIG. 2b are not essential for implementing the vehicle display device, and thus, the vehicle display device described in this specification may have more or fewer components than the components listed above.

[0201] More specifically, among the above components, the wireless communication unit (810) may include one or more modules that enable wireless communication between the vehicle display device (800) and a wireless communication system, between the vehicle display device (800) and another vehicle display device (800), or between the vehicle display device (800) and an external server. In addition, the wireless communication unit (810) may include one or more modules that connect the vehicle display device (800) to one or more networks.

[0202] This wireless communication unit (810) may include at least one of a broadcast reception module (811), a mobile communication module (812), a wireless Internet module (813), a short-range communication module (814), and a location information module (815).

[0203] The input unit (820) may include a camera (821) or a video input unit for inputting a video signal, a microphone (822) or an audio input unit for inputting an audio signal, and a user input unit (823, for example, a touch key, a mechanical key, etc.) for receiving information from a user. Voice data or image data collected by the input unit (820) may be analyzed and processed into a user's control command.

[0204] The sensing unit (840) may include one or more sensors for sensing at least one of information within the vehicle display device, information about the surrounding environment surrounding the vehicle display device, and user information. For example, the sensing unit (840) may include at least one of a proximity sensor (841), an illumination sensor (842), a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor (G-sensor), a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor (IR sensor), a fingerprint recognition sensor, an ultrasonic sensor, an optical sensor (e.g., a camera (see 821)), a microphone (see 822), a battery gauge, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, a radiation detection sensor, a heat detection sensor, a gas detection sensor, etc.), and a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric recognition sensor, etc.). Meanwhile, the vehicle display device disclosed in this specification can utilize information sensed by at least two of these sensors in combination.

[0205] The output unit (850) is for generating output related to visual, auditory, or tactile sensations, and may include at least one of a display unit (851), an audio output unit (852), a haptic module (853), and an optical output unit (854). The display unit (851) may be formed as a layer structure with a touch sensor or formed as an integral part, thereby implementing a touch screen. This touch screen may function as a user input unit (823) that provides an input interface between the vehicle display device (800) and a user, and at the same time, provide an output interface between the vehicle display device (800) and a user.

[0206] The interface unit (860) serves as a passage for various types of external devices connected to the vehicle display device (800). The interface unit (860) may include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, and an earphone port. The vehicle display device (800) may perform appropriate control related to the connected external device in response to the external device being connected to the interface unit (860). In addition, the memory (870) stores data supporting various functions of the vehicle display device (800). The memory (870) may store a plurality of application programs (or applications) running on the vehicle display device (800), data for the operation of the vehicle display device (800), and commands. At least some of these applications may be downloaded from an external server via wireless communication. Furthermore, at least some of these applications may be present on the vehicle display device (800) from the time of shipment for the basic functions of the vehicle display device (800) (e.g., incoming and outgoing calls, message reception and outgoing messages). Meanwhile, the applications may be stored in the memory (870), installed on the vehicle display device (800), and driven by the control unit (880) to perform operations (or functions) of the vehicle display device.

[0207] In addition to the operations related to the above-described application program, the control unit (880) typically controls the overall operation of the vehicle display device (800). The control unit (880) processes signals, data, information, etc. input or output through the components described above, or operates an application program stored in the memory (870), thereby providing or processing appropriate information or functions to the user.

[0208] In addition, the control unit (880) can control at least some of the components discussed with reference to FIG. 2B to drive an application program stored in the memory (870). Furthermore, the control unit (880) can operate at least two or more of the components included in the vehicle display device (800) in combination to drive the application program.

[0209] The power supply unit (890) receives external power under the control of the control unit (880) and supplies power to each component included in the vehicle display device (800). At least some of the components may cooperate with each other to implement the operation, control, or control method of the vehicle display device according to various embodiments described below. In addition, the operation, control, or control method of the vehicle display device (800) may be implemented on the vehicle display device by driving at least one application program stored in the memory (870).

[0210] Below, before examining various embodiments implemented through the vehicle display device (800) discussed above, the components listed above will be examined in more detail with reference to FIG. 2b.

[0211] First, regarding the wireless communication unit (810), the broadcast reception module (811) of the wireless communication unit (810) receives broadcast signals and / or broadcast-related information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel. Two or more of the broadcast reception modules may be provided in the vehicle display device (800) for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

[0212] The above broadcast management server may refer to a server that generates and transmits broadcast signals and / or broadcast-related information, or a server that receives previously generated broadcast signals and / or broadcast-related information and transmits them to a vehicle display device. The broadcast signals may include not only TV broadcast signals, radio broadcast signals, and data broadcast signals, but may also include broadcast signals in the form of TV broadcast signals or radio broadcast signals combined with data broadcast signals.

[0213] The above broadcast signal may be encoded according to at least one of the technical standards (or broadcasting methods, for example, ISO, IEC, DVB, ATSC, etc.) for transmitting and receiving digital broadcast signals, and the broadcast receiving module (811) may receive the digital broadcast signal using a method suitable for the technical specifications set forth in the above technical standards.

[0214] The above broadcast-related information may refer to information related to a broadcast channel, broadcast program, or broadcast service provider. The above broadcast-related information may also be provided via a mobile communication network. In this case, it may be received by the mobile communication module (812). The above broadcast-related information may exist in various forms, such as, for example, the Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or the Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). The broadcast signal and / or broadcast-related information received via the broadcast reception module (811) may be stored in the memory (860).

[0215] The mobile communication module (812) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to technical standards or communication methods for mobile communication (e.g., GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.). The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

[0216] The wireless Internet module (813) refers to a module for wireless Internet access, and can be built into or externally installed in the vehicle display device (800). The wireless Internet module (813) is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

[0217] Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), and LTE-A (Long Term Evolution-Advanced). The wireless Internet module (813) transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above. From the perspective that wireless Internet access through WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is achieved through a mobile communication network, the wireless Internet module (813) that performs wireless Internet access through the mobile communication network can be understood as a type of the mobile communication module (812).

[0218] The short-range communication module (814) is for short-range communication, and can support short-range communication using at least one of Bluetooth (Bluetooth™ Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies. The short-range communication module (814) can support wireless communication between the vehicle display device (800) and a wireless communication system, between the vehicle display device (800) and another vehicle display device (800), or between the vehicle display device (800) and a network where another vehicle display device (800, or an external server) is located through a short-range wireless communication network (Wireless Area Network). The short-range wireless communication network may be a Wireless Personal Area Network.

[0219] The location information module (815) is a module for obtaining the location (or current location) of the vehicle display device, and representative examples thereof include a GPS (Global Positioning System) module or a WiFi (Wireless Fidelity) module. For example, if the vehicle display device utilizes a GPS module, the location of the vehicle display device can be obtained using signals transmitted from GPS satellites. As another example, if the vehicle display device utilizes a Wi-Fi module, the location of the vehicle display device can be obtained based on information from a wireless access point (AP) that transmits or receives wireless signals with the Wi-Fi module. If necessary, the location information module (815) may perform any function of other modules of the wireless communication unit (810) to obtain data regarding the location of the vehicle display device as a substitute or in addition. The location information module (815) is a module used to obtain the location (or current location) of the vehicle display device, and is not limited to a module that directly calculates or obtains the location of the vehicle display device.

[0220] Next, the input unit (820) is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, the vehicle display device (800) may be equipped with one or more cameras (821). The camera (821) processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a shooting mode. The processed image frames may be displayed on the display unit (851) or stored in a memory (870). Meanwhile, the plurality of cameras (821) provided in the vehicle display device (800) may be arranged to form a matrix structure, and through the cameras (821) forming the matrix structure in this way, a plurality of image information having various angles or focal points may be input to the vehicle display device (800). In addition, the plurality of cameras (821) may be arranged in a stereo structure to obtain left and right images for implementing a three-dimensional image.

[0221] The microphone (822) processes external acoustic signals into electrical voice data. The processed voice data can be utilized in various ways depending on the function (or application program) being performed by the vehicle display device (800). Meanwhile, the microphone (822) can implement various noise removal algorithms to remove noise generated during the process of receiving external acoustic signals.

[0222] The user input unit (823) is for receiving information from the user. When information is input through the user input unit (823), the control unit (880) can control the operation of the vehicle display device (800) to correspond to the input information. The user input unit (823) may include a mechanical input means (or a mechanical key, for example, a button located on the front, rear, or side of the vehicle display device (800), a dome switch, a jog wheel, a jog switch, etc.) and a touch input means. As an example, the touch input means may be composed of a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or a touch key placed on a part other than the touch screen. Meanwhile, the virtual key or visual key may be displayed on the touch screen in various forms, and may be formed of, for example, graphics, text, icons, videos, or a combination thereof.

[0223] Meanwhile, the sensing unit (840) senses at least one of information within the vehicle display device, information about the surrounding environment surrounding the vehicle display device, and user information, and generates a sensing signal corresponding thereto. Based on this sensing signal, the control unit (880) can control the driving or operation of the vehicle display device (800), or perform data processing, functions, or operations related to an application program installed in the vehicle display device (800). Representative sensors among the various sensors that can be included in the sensing unit (840) will be examined in more detail.

[0224] First, a proximity sensor (841) refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing nearby without mechanical contact by using the force of an electromagnetic field or infrared rays. This proximity sensor (841) may be placed in an internal area of ​​a vehicle display device covered by the touch screen described above or near the touch screen.

[0225] Examples of proximity sensors (841) include a transmissive photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high-frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is capacitive, the proximity sensor (841) may be configured to detect the proximity of a conductive object by a change in an electric field caused by the object's proximity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

[0226] Meanwhile, for the convenience of explanation, an act of bringing an object close to the touch screen without touching it so that it is recognized that the object is located on the touch screen is called a "proximity touch," and an act of actually making contact with the touch screen is called a "contact touch." The position at which an object is touched close to the touch screen means the position at which the object corresponds vertically to the touch screen when the object is touched close to the touch screen. The proximity sensor (841) can detect a proximity touch and a proximity touch pattern (e.g., proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement status, etc.). Meanwhile, the control unit (880) processes data (or information) corresponding to the proximity touch action and proximity touch pattern detected through the proximity sensor (841) as described above, and further outputs visual information corresponding to the processed data on the touch screen. Furthermore, the control unit (880) can control the vehicle display device (800) so that different actions or data (or information) are processed depending on whether a touch on the same point on the touch screen is a proximity touch or a contact touch.

[0227] The touch sensor detects a touch (or touch input) applied to a touch screen (or display unit (851)) using at least one of various touch methods, such as a resistive method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method.

[0228] As an example, a touch sensor may be configured to convert changes in pressure applied to a specific portion of a touch screen or electrostatic capacity generated at a specific portion, etc., into an electrical input signal. The touch sensor may be configured to detect a location, area, pressure at the time of touch, electrostatic capacity at the time of touch, etc., at which a touch target that applies a touch to the touch screen is touched on the touch sensor. Here, the touch target is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, etc.

[0229] In this way, when there is a touch input to the touch sensor, the corresponding signal(s) is sent to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the control unit (880). As a result, the control unit (880) can determine which area of ​​the display unit (851) has been touched, etc. Here, the touch controller may be a separate component from the control unit (880) or may be the control unit (880) itself.

[0230] Meanwhile, the control unit (880) may perform different or identical controls depending on the type of touch target that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different or identical controls depending on the type of touch target may be determined based on the current operating status of the vehicle display device (800) or the running application program.

[0231] Meanwhile, the touch sensor and proximity sensor discussed above can independently or in combination sense various types of touches, such as short (or tap) touch, long touch, multi-touch, drag touch, flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. on the touch screen.

[0232] An ultrasonic sensor can recognize the location information of a detection target using ultrasonic waves. Meanwhile, the control unit (880) can calculate the location of a wave generation source using information detected by a light sensor and multiple ultrasonic sensors. The location of the wave generation source can be calculated by taking advantage of the fact that light is much faster than ultrasonic waves, that is, the time it takes for light to reach the light sensor is much faster than the time it takes for ultrasonic waves to reach the ultrasonic sensor. More specifically, the location of the wave generation source can be calculated by using the time difference between the time at which ultrasonic waves arrive and the time at which light is a reference signal.

[0233] Meanwhile, the camera (821) as seen in the configuration of the input unit (820) includes at least one of a camera sensor (e.g., CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

[0234] A camera (821) and a laser sensor can be combined with each other to detect the touch of a sensing target on a three-dimensional stereoscopic image. The photo sensor can be laminated on a display element, and the photo sensor is configured to scan the movement of a sensing target close to the touch screen. More specifically, the photo sensor scans the contents placed on the photo sensor by using an electrical signal that changes according to the amount of light applied to the photo diode by mounting a photo diode and a TR (transistor) in rows / columns. That is, the photo sensor performs coordinate calculation of the sensing target according to the amount of change in light, and through this, the location information of the sensing target can be acquired.

[0235] The display unit (851) displays (outputs) information processed in the vehicle display device (800). For example, the display unit (851) may display execution screen information of an application program running in the vehicle display device (800), or UI (User Interface) or GUI (Graphical User Interface) information according to such execution screen information.

[0236] Additionally, the display unit (851) may be configured as a stereoscopic display unit that displays a stereoscopic image.

[0237] The above stereoscopic display unit can be applied with a three-dimensional display method such as a stereoscopic method (glasses method), an autostereoscopic method (glasses-free method), or a projection method (holographic method).

[0238] The audio output unit (852) can output audio data received from the wireless communication unit (810) or stored in the memory (870) in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, etc. The audio output unit (852) also outputs an audio signal related to a function performed in the vehicle display device (800) (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit (852) may include a receiver, a speaker, a buzzer, etc.

[0239] The haptic module (853) generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module (853) may be vibration. The intensity and pattern of the vibration generated by the haptic module (853) may be controlled by the user's selection or the settings of the control unit (880). For example, the haptic module (853) may synthesize and output different vibrations or output them sequentially.

[0240] In addition to vibration, the haptic module (853) can generate various tactile effects, such as effects caused by stimulation such as pin arrays moving vertically with respect to the contact skin surface, air injection or suction through nozzles or suction ports, brushing against the skin surface, contact with electrodes, electrostatic force, and effects caused by reproduction of hot and cold sensations using elements capable of absorbing or exotherming heat.

[0241] The haptic module (853) can not only transmit tactile effects through direct contact, but can also be implemented so that the user can feel the tactile effects through the kinesthetic senses of the fingers or arms. Two or more haptic modules (853) may be provided depending on the configuration of the vehicle display device (800).

[0242] The light output unit (854) outputs a signal to notify the occurrence of an event using light from a light source of the vehicle display device (800). Examples of events occurring in the vehicle display device (800) may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, and information reception through an application.

[0243] The signal output by the light output unit (854) is implemented by the vehicle display device emitting light of a single color or multiple colors to the front or rear. The signal output may be terminated when the vehicle display device detects the user's event confirmation.

[0244] The interface unit (860) acts as a passageway for all external devices connected to the vehicle display device (800). The interface unit (860) receives data from an external device, supplies power, and transmits it to each component inside the vehicle display device (800), or allows data inside the vehicle display device (800) to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, an earphone port, etc. may be included in the interface unit (860).

[0245] Meanwhile, the identification module is a chip that stores various information for authenticating the use of the vehicle display device (800), and may include a user identity module (UIM), a subscriber identity module (SIM), a universal subscriber identity module (USIM), etc. A device equipped with an identification module (hereinafter referred to as the "identification device") may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the vehicle display device (800) through the interface unit (860).

[0246] The memory (870) can store a program for the operation of the control unit (880), and can also temporarily store input / output data (e.g., phonebook, messages, still images, videos, etc.). The memory (870) can store data regarding various patterns of vibration and sound output when a touch input is made on the touch screen.

[0247] The memory (870) can store data related to a changeable form factor through a plurality of displays constituting the display unit (851). In addition, the memory (870) can store data related to various conditions under which the form factors of the plurality of displays are changed, such as driving, stopping driving, a specific driving mode (e.g., autonomous driving mode, parking mode, etc.), properties of requested content / services, requests by user input, etc. In addition, the memory (870) can store related data to remember a changed form factor according to a control command of the control unit (880).

[0248] The memory (870) may include at least one type of storage medium among a flash memory type, a hard disk type, an SSD (Solid State Disk type), an SDD (Silicon Disk Drive type), a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. The vehicle display device (800) may also be operated in relation to web storage that performs the storage function of the memory (870) on the Internet.

[0249] Meanwhile, as previously discussed, the control unit (880) controls operations related to applications and, typically, the overall operation of the vehicle display device (800). For example, if the state of the vehicle display device satisfies a set condition, the control unit (880) may execute or release a lock state that restricts the user's input of control commands for applications.

[0250] In addition, the control unit (880) can perform control and processing related to voice calls, data communications, video calls, etc., or perform pattern recognition processing that can recognize handwriting input or drawing input performed on a touch screen as characters and images, respectively.

[0251] Additionally, the control unit (880) can control the driving mode for each of the plurality of displays to change the form factor of the display unit (851).

[0252] Specifically, the control unit (880) can determine the optimal display form factor based on the vehicle's driving status, such as vehicle sensing data, the properties of the requested content / service, and user input requests. In addition, the control unit (880) can determine whether a change to the determined form factor is possible by considering the current driving status of the vehicle, and then control to change to the corresponding form factor by transmitting a control command to at least some of the multiple displays.

[0253] Furthermore, the control unit (880) can control one or more of the components described above in combination to implement various embodiments described below on the vehicle display device (800) according to the present invention.

[0254] The display unit (851) displays (outputs) information processed in the vehicle display device (800). For example, the display unit (851) may display execution screen information of an application program running in the vehicle display device (800), or UI (User Interface) or GUI (Graphical User Interface) information according to such execution screen information.

[0255] The display unit (851) may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0256] In addition, two or more display units (851) may exist depending on the implementation form of the vehicle display device (800). In this case, the vehicle display device (800) may have multiple display units spaced apart from each other or arranged integrally on one surface, or may be arranged on different surfaces.

[0257] The display unit (851) may include a touch sensor that detects a touch on the display unit (851) so that a control command can be input by a touch method. Using this, when a touch is made on the display unit (851), the touch sensor detects the touch, and the control unit (880) may generate a control command corresponding to the touch based on this. The content input by the touch method may be characters or numbers, or instructions or designable menu items in various modes.

[0258] The display unit (851) is configured to include a plurality of displays including a first display unit (851a), a second display unit (851b), and a third display unit (851c). In addition, at least some of the plurality of displays may be flexible displays. In addition, at least some of the plurality of displays are implemented to enable relative movement, relative rotation, bending-out / in, or pop-up / down according to a control command so as to change the form factor of the display unit (851).

[0259] Different content can be displayed on each of the first display unit (851a), the second display unit (851b), and the third display unit (851c). In addition, two or more of the first display unit (851a), the second display unit (851b), and the third display unit (851c) can be used as extended screens, so that a single content or related content can be connected / linked and displayed.

[0260] At least some of the first display unit (851a), the second display unit (851b), and the third display unit (851c) can be driven to change the form factor based on a control command of the control unit (880). In this case, the content displayed on at least some of the first display unit (851a), the second display unit (851b), and the third display unit (851c) can be adjusted to have a screen ratio, screen size, screen orientation, and content properties suitable for the changed form factor.

[0261] The microphone (822) is configured to receive the user's voice, other sounds, etc. The microphone (822) may be provided in multiple locations and configured to receive stereo sound.

[0262] The interface unit (860) serves as a passage that can connect the vehicle display device (800) to an external device. For example, the interface unit (860) may be at least one of a connection terminal for connection with another device (e.g., earphones, external speakers), a port for short-range communication (e.g., an infrared port (IrDA Port), a Bluetooth port, a wireless LAN port, etc.), or a power supply terminal for supplying power to the vehicle display device (800). This interface unit (860) may also be implemented in the form of a socket that accommodates an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module), or a memory card for storing information.

[0263] A vehicle display device may be equipped with at least one antenna for wireless communication. The antenna may be built into the vehicle display device or formed in a case. For example, an antenna forming part of a broadcast reception module (811, see FIG. 2B) may be configured to be retractable from the vehicle display device. Alternatively, the antenna may be formed in a film form and attached to the inner surface of the housing, or a case including a conductive material may be configured to function as an antenna.

[0264] Meanwhile, the “vehicle driving” disclosed in this specification may include starting the vehicle after starting it, driving at a certain speed or higher, stopping while driving (due to waiting at a traffic light, traffic congestion, etc.), and driving for parking, and includes both autonomous driving and manual driving.

[0265] Additionally, the “vehicle stopping” disclosed herein may include a case where a certain period of time has passed before the vehicle is started, before the vehicle starts to drive after the vehicle is started, or after a temporary stop during driving.

[0266] Additionally, the "form factor change" or "form factor deformation" disclosed herein means that at least some of the plurality of displays are relatively moved, rotated, bent out / in, popped up / down, or rolled up / down, thereby changing the structural shape of at least some of the display portions. Such "form factor change" or "form factor deformation" includes both cases where the shape of only one of the plurality of displays is changed and cases where the shapes of the plurality of displays are sequentially / simultaneously changed.

[0267] In addition, the "multiple displays" disclosed herein are each independently controlled and displayed. The "multiple displays" disclosed herein are positioned on the front of the same frame of the display device and have a structure extending horizontally at a location on the vehicle's dashboard. In addition, at least some of the "multiple displays" disclosed herein are independently relatively movable or rotatable, and in this case, a more diverse form factor can be formed depending on the shape combination between the displays.

[0268] Specifically, the plurality of displays are implemented to include a first display unit positioned to correspond to the driver's seat position, a third display unit positioned to correspond to the passenger seat position, and a second display positioned between the first and third display units.

[0269] For example, the "first display unit" disclosed in this specification may be a cluster. In addition, the "second display unit" disclosed in this specification may be named a CID (Center Information Display), and the "third display unit" may be named a PID (Passenger Information Display).

[0270] FIG. 2c and FIG. 2d are drawings for explaining the specific operation of a display, for example, a second display unit (851b) (or CID), having a structure that is movable in the vertical direction and partially bendable in the display device according to the present invention.

[0271] First, referring to FIG. 2c, the second display unit (851b) is fixed to the frame (F) on the back and operates to move up and down relative to the control signal.

[0272] When the second display unit (851b) moves upward along the guide rail (not shown), the display surface becomes flat and takes the first shape (A).

[0273] Meanwhile, when the second display unit (851b) slides downward along the guide rail (not shown) and the rollers (R1, R2) on both sides of the lower portion and moves relative to each other, the second shape (B) is formed in which at least a portion of the display surface is bent out. Although not shown in Fig. 2c, the bending out of the second display unit (851b) may be located above the center. In addition, although not shown in Fig. 2c, the lower portion of the bending out of the second display unit (851b) may be supported by a triangular lower support.

[0274] When a form factor change request occurs (or, when a form factor change event occurs), the control unit (880) of the vehicle display device (800) analyzes and recognizes the shape of the form factor included in the request, checks the driving situation of the vehicle, and generates a control command to be transmitted to multiple displays.

[0275] When a control command for changing to the second shape (B) is received from the control unit (880) of the vehicle display device (800), the second display unit (851b) slides downward and at least a portion thereof bends out. In this way, when the second display unit (851b) becomes the second shape (B), touch operation through the lower portion of the bending-out becomes easy without obstructing the driver's view while driving.

[0276] When a control command for changing the second display unit (851b) to the first shape (A) is received from the control unit (880) while the second display unit (851b) is in the second shape (B), the bent-out portion of the second display unit (851b) is unfolded and an upward relative movement operation is performed. In this way, when the second display unit (851b) becomes the first shape (A), there is no screen distortion, so a large screen can be provided.

[0277] Meanwhile, although not illustrated in detail in FIGS. 2C and 2D , the control unit (880) may include a curvature adjustment unit capable of changing the degree of bending, i.e., the degree of curvature, of the second display unit (851b). The curvature adjustment unit may change the degree of curvature so that the second display unit (851b) is further bent or straightened in an upward direction with respect to the stand (B, FIG. 3 ).

[0278] To this end, the control unit (880) may be positioned to extend toward the rear surface of the frame and may include a display driving IC for driving the second display unit (851b). In addition, the curvature adjustment unit may additionally include a plurality of guide rails, links, link brackets, bearings, bending modules, etc. for changing the degree of curvature of the second display unit (851b) according to a signal received from the display driving IC.

[0279] Below, various examples in which the form factor of the display unit (851) is transformed according to a shape change of at least some of the multiple displays will be specifically described.

[0280] FIG. 3 and FIG. 4 are drawings for explaining an example in which the second display unit (851b) is variable and implemented as one of the first form factor and the second form factor.

[0281] Figure 5 is an exemplary drawing for explaining a form factor variation in which the size of the third display unit (851c) is variable.

[0282] FIG. 6 is an exemplary drawing for explaining a form factor deformation in which the direction of the second display unit (851b) changes, and FIG. 7 is an exemplary drawing for explaining a form factor deformation in which a size change of the third display unit (851c) additionally occurs in FIG. 6.

[0283] Meanwhile, in the illustrated embodiments, the first to third display units (851a, 851b, 851c) are fixed to the same frame (F) on the back and are positioned on the same horizontal line. In addition, although a certain space is provided between the first to third display units (851a, 851b, 851c) for the convenience of explanation, in the embodiments, the first to third display units (851a, 851b, 851c) are connected without any empty space, so that when the entirety is used as one extended screen, they can be displayed seamlessly.

[0284] First, with reference to FIGS. 3 and 4, we will specifically examine the case where the vehicle display device (800) forms the first form factor and the second form factor.

[0285] Figure 4 is an example showing a first form factor in which the display surface of the second display unit (851b) is flat.

[0286] When the vehicle is stopped, the display unit (851) of the vehicle display device (800) can form a first form factor as shown in Fig. 4. At this time, the vehicle stop may include a case where the vehicle is stopped for a certain period of time after starting the vehicle before driving, while parked, or while driving.

[0287] In the first form factor, the second display unit (851b) forms a state in which the display surface is flat and is moved upward relative to the lower stand (B). At this time, when the second display unit (851b) is changed from a shape as in FIG. 3, the bent-out portion of the second display unit (851b) may be opened and may move upward along a plurality of rollers positioned between the second display unit (851b) and the lower stand (B). As the second display unit (851b) moves upward relative to the upper surface, the second display unit (851b) may be positioned higher than the height of the frame (F). At this time, the heights of the first and third display units (851a, 851c) may be positioned lower than the second display unit (851b). In addition, at least a portion (e.g., the lower portion) of the lower stand (B) may be exposed due to the relative movement of the second display unit (851b).

[0288] Also, in the first form factor, the entire second display unit (851b) can be used as a large screen. For example, in the first form factor, infotainment screens such as a navigation screen, a menu screen, a movie screen, and a music playback screen can be displayed on the entire second display unit (851b). Also, in the first form factor, the second display unit (851b) can be used as a single extended screen or a large screen related to the same content together with other displays, i.e., the first and third display units (851a, 851c), taking into account the current driving situation of the vehicle according to the request and the properties of the content.

[0289] FIG. 3 is an example showing a second form factor in which at least a portion of the display surface of the second display unit (851b) is bent out.

[0290] When the vehicle is driven, the display unit (851) of the vehicle display device (800) may form a second form factor that is deformed so that at least a portion of the second display unit (851b) has a bent-out shape. In this case, the vehicle driving may include starting the vehicle after starting the vehicle, driving including parking mode, driving slowly, and stopping for a short period of time while driving (e.g., waiting at a traffic light, traffic congestion, etc.).

[0291] In the second form factor, the second display unit (851b) moves downward relative to the lower stand (B) and forms a state in which at least a portion of the display surface is bent inward, i.e., a bent-out state. At this time, the position of the area where the second display unit (851b) is bent out (hereinafter referred to as the "bending area") may vary depending on the shape and height of the lower stand (B).

[0292] The display area of ​​the second display unit (851b), which is distinguished based on the above-mentioned bending area, may not be uniform for stable deformation. For example, the second display unit (851b) may be bent out so that the size of the lower area (hereinafter, "second area") of the second display unit (851b) is larger than that of the upper area (hereinafter, "first area") of the second display unit (851b) based on the bending area.

[0293] In the second form factor, content with different properties can be displayed distinctly in the first and second areas of the second display unit (851b). Furthermore, the bending area may not display images without distortion, or may automatically adjust the magnification for seamless display.

[0294] Specifically, a requested / set content or service screen may be displayed in the first area of ​​the second display unit (851b), and an input screen for touch operation (e.g., a control panel, a menu, a list, a keyboard, etc.) may be displayed in the second area of ​​the second display unit (851b). The input screen of the second area may facilitate interaction with the screen displayed in the first area. In this case, when the second form factor is changed to the first form factor based on a control command, the input screen displayed in the separated second area may disappear and the second display unit (851b) may automatically change to a large screen.

[0295] In the second form factor, the degree of curvature of the second display portion (851b) can be changed. The shape of the second display portion (851b) can take one of a flat mode in which the display surface is planar, a first bending mode in which at least a portion is bent out to have a first curvature, and a second bending mode in which the second curvature is bent out. A specific operation description related to the change of the first bending mode and the second bending mode will be described in more detail below with reference to FIG. 10.

[0296] Meanwhile, when changing from the second form factor to the first form factor, the bent out portion of the second display unit (851b) is unfolded, and the second display unit (851b) slides upward relative to the lower stand (B) along the rollers on both sides. At this time, the bent out portion can unfold in proportion to the degree of relative movement of the second display unit (851b).

[0297] When changing from the second form factor to the first form factor, the content displayed on the second display unit (851b) may change. For example, in the second form factor, a reduced content / service screen may be provided in the first area of ​​the second display unit (851b), and an input screen (e.g., a control panel such as a touch panel or a mouse panel) for interacting with the screen displayed in the first area may be provided in the second area. In this case, for example, a widget in a card format may be scrolled left and right in the first area based on a touch input to the second area. Alternatively, icons of frequently used applications or widgets may be displayed in the second area. Continuing, when changing to the first form factor, the input screen in the second area of ​​the second display unit (851b) may disappear, and the content / service screen displayed in the first area may be expanded to display in full screen.

[0298] Additionally, a change to the second form factor may occur when a need to use the third display unit (851c) is recognized, in addition to a direct change request based on the properties of the content / service or an input request. Here, the need to use the third display unit (851c) may include both the passenger's and the driver's intent to use it.

[0299] For example, when a need for the driver to use the third display unit (851c) is detected in the first form factor state (e.g., driver's gaze through the front camera, etc.), the display unit (851) can be transformed into the second form factor so that a part of the second display unit (851b) (e.g., the second area) can be used as an input area. In this case, the screen that was previously displayed (e.g., a navigation screen) is displayed in a reduced screen state in the first area of ​​the second display unit (851b), and an input screen for interacting with the content (e.g., widgets, applications, etc.) displayed on the third display unit (851c) is displayed in the second area. Accordingly, the driver can also easily perform screen manipulation on the third display unit (851c) corresponding to the passenger seat position when necessary.

[0300] Below, examples of further form factor variations of the display unit (851) will be discussed. These may be referred to as form factor variations (changes) corresponding to a change request of the third form factor, the second form factor, or form factor variations.

[0301] FIG. 5 is a drawing for explaining a form factor variation in which the size of the third display (851c) in the display device (800) is variable.

[0302] The third display (851c) may be popped up in accordance with a control command from the control unit (880), and the display size may increase as the exposure area of ​​the display surface increases. In addition, the third display (851c) may be popped down in a popped-up state in accordance with a control command from the control unit (880), and the display size may be reduced as the exposure area of ​​the display surface decreases.

[0303] To this end, the third display (851c) may include a first frame and a second frame, and the flexible display module may be supported by the first frame and the second frame formed to be relatively movable with respect to the first frame. In addition, the third display (851c) may include a pair of sliders that guide the sliders to slide up and down. At this time, although not shown in detail, each of the pair of sliders may include a horizontal plate, a vertical plate that is bent downwardly or rounded from an inner edge of the horizontal plate, and a "ㄷ"-shaped guide rail may be fitted to an outer edge of the horizontal plate.

[0304] When the third display (851c) pops up, the first and second frames move away from each other, and after a pair of sliders move as one body with the second frame, the guide rail is fixed to the insertion groove, and the shape of the third display (851c) with an increased size is maintained. The variable length (L) of the third display (851c) may vary depending on the properties of the requested content / service and / or the input request, taking into account the driving conditions of the vehicle. As the exposure area of ​​the third display unit (851c) gradually increases and the variable length (L) gradually changes, the content displayed on the third display unit (851c) also expands.

[0305] When the variable length (L) of the third display (851c) is reduced to the minimum, the upper end of the first display unit (851a) and the upper end of the third display (851c) can be positioned on the same line. In addition, when the variable length (L) of the third display (851c) is expanded to the maximum, the upper end of the third display (851c) can be positioned on the same line as the upper end of the highest position among the plurality of displays or when the second display unit (851b) is moved as high as possible in portrait mode.

[0306] In another example, the third display (851c) may operate in a manner such that a portion of the display panel remains bent within the frame, for example in a U-shape, while the display screen expands or contracts. In this case, the entire third display (851c) is not rolled up, and a portion of the panel remains exposed at all times, reducing the risk of panel breakage.

[0307] Fig. 6 is an exemplary drawing for explaining a form factor variation in which the display direction of the second display unit (851b) changes. In addition, Fig. 7 is an exemplary drawing for explaining a form factor variation in which the size of the third display unit (851c) additionally changes in the form factor of Fig. 6.

[0308] The second display unit (851b) can perform relative rotation movement (R) to change the display direction based on a control command of the control unit (880).

[0309] To this end, although not shown in detail, the rear of the second display unit (851b) may additionally be provided with components for changing the display orientation to either portrait mode or landscape mode, such as one or more plates, a rotation axis, a shaft, a bracket, a slider, and a motor for providing rotational force.

[0310] For example, when a control command corresponding to a landscape mode is received as a request for a form factor change by the control unit (880) of the vehicle display device (800), a rotational force is generated so that a rotational force is applied in a horizontal direction (left-right direction) to the second display unit (851b), so that the display direction can be changed to the landscape direction. In this case, the lower holder (B) may be fully or partially exposed, and each of the two sides of the second display unit (851b) may overlap with a portion of the first and third display units (851a, 851c).

[0311] Similarly, when a control command corresponding to a portrait mode is received as a request for a form factor change by the control unit (880) of the vehicle display device (800), a rotational force is generated so that a rotational force is applied in a vertical direction (up and down direction) to the second display unit (851b), so that the display direction can be changed to a portrait direction. In this case, the second display unit (851b) can be seamlessly connected to both sides of the first and third display units (851a, 851c).

[0312] This relative rotation of the second display unit (851b) is performed independently of the up-and-down relative movement (and bending-out) of the second display unit (851b) described above.

[0313] For example, the second display unit (851b) may, based on a control command, subsequently perform a form factor transformation from the aforementioned first form factor to the landscape mode. Alternatively, for example, the second display unit (851b) may, based on a control command, subsequently perform a transformation from the aforementioned second form factor to the portrait mode.

[0314] Meanwhile, when the form factor is transformed into landscape mode, the second display unit (851b) can move to the left or right by a certain distance, although not shown in detail.

[0315] When the second display unit (851b) is switched to landscape mode, it may cover at least a portion of the first and third display units (851a, 851c). Accordingly, by selectively moving the second display unit (851b) further to the left or right during relative rotation, it may operate so as not to overlap with at least one display.

[0316] Specifically, when a request to change the form factor of the second display unit (851b) to landscape mode is received, the control unit (880) determines a display that will not cause screen obscuration by considering the display status of the first and third display units (851a, 851c), the properties of the displayed content, and the driving conditions of the vehicle, and generates a control command by selecting a horizontal movement direction during relative rotational movement of the second display unit (851b) based on the determination.

[0317] Referring to FIG. 7, the request for deformation of the second display unit (851b) and the request for deformation of the third display unit (851c) may be performed sequentially or simultaneously, or the request for deformation of the third display unit (851c) may be generated based on an additional input after deformation of the second display unit (851b).

[0318] Specifically, the form factor can be modified so that the second display unit (851b) is switched to landscape mode and the variable length (L) of the third display unit (851c) is increased simultaneously / sequentially.

[0319] Alternatively, in the form factor state of FIG. 7, the form factor may be modified such that the second display unit (851b) is switched to portrait mode and the variable length (L) of the third display unit (851c) is reduced simultaneously / sequentially. This may mean restoration to the first form factor, and may occur, for example, based on a command to terminate use of the vehicle display device (800).

[0320] According to an embodiment, the sequential form factor transformation request of the second and third display units (851b, 851c) may occur in accordance with the properties of specific content / services. For example, when the screen expansion mode is selected on the third display unit (851c) while the vehicle is stationary, the second display unit (851b) may be switched to landscape mode and the form factor transformation may be performed such that the third display unit (851c) pops up simultaneously / sequentially.

[0321] In this way, the vehicle display device (800) according to an embodiment of the present invention can detect the driving of a vehicle while the second display unit (851b) of the plurality of displays forms a flat first form factor, and change it to a second form factor different from the first form factor. Then, when a request for a change in the second form factor occurs, it is checked whether it is applicable according to the driving situation of the vehicle, and then a change to a form factor corresponding to the request is executed.

[0322] Below, Fig. 8 is a representative flowchart for explaining the operation method of a display device related to various form factor variations. The term "multiple displays" disclosed below is used to mean the display unit (851) of the vehicle display device (800) or the first to third display units (851a, 851b, 851c).

[0323] The vehicle display device (800, FIG. 1) of the present invention comprises a plurality of displays as described above. The plurality of displays are configured such that the first display unit (851a) corresponds to the cluster of the driver's seat, the third display unit (851c) corresponds to the position of the passenger seat, and the second display unit (851b) is positioned between the first and third display units (851a, 851c), thereby forming a large screen.

[0324] Here, at least a portion of the second display unit (851b) has a structure in which the display direction can be varied by bending, moving up and down, and relatively rotating. In addition, the third display unit (851c) has a structure in which the screen size can be varied by relative vertical movement. Various form factor variations are possible through a combination of the shape structures of the second and third display units (851b, 851c).

[0325] The processor (or control unit) (880) of the vehicle display device (800) can execute form factor transformation by generating control commands for form factor transformation according to various situations and transmitting them to multiple displays.

[0326] Specifically, the control unit (880) can transmit control signals for changing the shape structure of the second and third display units (851b, 851c) to corresponding modules for each structure change operation. Accordingly, the second and third display units (851b, 851c) operate to perform structure changes separately or sequentially / simultaneously, thereby achieving a form factor transformation according to the request.

[0327] Meanwhile, each step described below with reference to FIG. 8 is assumed to be performed by the control unit (880) of the vehicle display device (800) unless otherwise described. Furthermore, the shape structure changes for each of the multiple displays are performed independently. Furthermore, various shape structure changes for a single display (e.g., relative rotation, vertical movement, bending-out) are also performed independently.

[0328] Referring to FIG. 8, first, a plurality of displays of a vehicle display device (800) can detect the driving of a vehicle while the second display (851b) forms a flat first form factor and control the plurality of displays to change to a second form factor different from the first form factor (8100).

[0329] Here, the first form factor may be an initial (basic) form factor state or a structure in which the second display moves relatively to the second direction opposite to the first direction and becomes flat. At this time, the first direction may be a direction in which the second display unit (851b) slides downward along the lower stand (B). In addition, the second direction refers to a direction in which the second display unit (851b) moves upward against the lower stand (B). In addition, the initial (basic) form factor state may refer to a form factor set as default.

[0330] The processor (or control unit (880)) may transmit a signal to multiple displays to change to the first form factor in response to a vehicle stop signal. In this case, the vehicle stop signal may occur before the vehicle is started, before starting to drive after starting, when the vehicle is stopped for a certain period of time during driving, or when the vehicle is parked.

[0331] For example, when a driver gets into a vehicle (100) and turns on the engine, the vehicle display device (800) is turned on, and a welcome screen is displayed on at least some of the multiple displays in the first form factor. Subsequently, a cluster screen may be displayed on the first display unit (851a).

[0332] When the vehicle is detected to be in motion, the processor (or control unit (880)) requests that the first form factor be transformed into the second form factor. Specifically, the processor (or control unit (880)) transmits a signal to multiple displays to change to the second form factor in response to the vehicle's motion detection signal. At this time, the motion detection signal may be generated after the vehicle is started, when the vehicle starts driving, or during driving.

[0333] Here, the second form factor may be a structure in which the second display unit (851b) moves relatively in a first direction and at least a portion thereof is bent. Here, the first direction may refer to a direction in which the second display unit (851b) slides downward along the lower stand (B). In addition, the bending of at least a portion thereof means bending-out in which a preset portion of the second display unit (851b) is bent inward so as to contact the surface of the lower stand (B).

[0334] For example, when a welcome screen and a cluster screen are displayed while multiple displays are in the first form factor, and then when drive (D) driving is initiated, the multiple displays can be transformed into the second form factor so as not to obstruct the driver's view. When changed to the second form factor in this way, the second display unit (851b) is divided into a first area where content (e.g., a navigation screen) is displayed and a second area for interaction operation based on the bending area as described above.

[0335] Continuing, while the vehicle is driving, the vehicle display device (800) may determine that there is a request for a change in the second form factor based on at least one of the vehicle's sensing data, content / services displayed on multiple displays, and input requests (8200).

[0336] Specifically, a request for a change in the second form factor may be generated based on at least one of the driving state of the vehicle, the properties of the requested content / service, and the direct input request.

[0337] For example, if the requested content / service includes an attribute of an extended screen mode, a form factor change request may be made to change the second display unit (851b) to landscape mode and pop up the third display unit (851c).

[0338] As another example, in response to a direct input request, such as when the need to use the third display unit (851c) is detected, the form factor of the second display unit (851b) may be bent or the degree of bending may be changed to increase for easy interaction.

[0339] As another example, when the driving status changes from autonomous driving mode to extended screen mode, the vehicle can automatically transform into a second form factor so as not to obstruct the driver's view.

[0340] Meanwhile, in embodiments, requests for form factor changes for multiple displays may prioritize driving conditions based on vehicle sensing data over content / service attributes and direct input requests. This prioritizes vehicle driving safety over convenient infotainment when these needs exist simultaneously.

[0341] When it is determined that there is a request for a change in the second form factor, the control unit (880) checks whether a form factor change according to the received request for a change in the second form factor is possible by considering the current driving situation of the vehicle (8300), and then executes a change to the form factor according to the determination (8400).

[0342] Specifically, when there is a request to change the form factor that obstructs the driver's view while the vehicle is driving, the processor (or control unit (880)) may display on one of the second and third display units (851b, 851c) that the form factor cannot be changed to the requested form factor.

[0343] In an embodiment, the processor (or control unit (880)) may control multiple displays to change their form factors based on driving conditions corresponding to sensing data of the vehicle. For example, in parking mode while driving, a form factor change event may occur that changes the second display unit (851b) to landscape or portrait mode to facilitate guidance depending on the parking direction.

[0344] Additionally, in an embodiment, the processor (or control unit (880)) may control multiple displays to change their form factors according to the properties of the requested content / service.

[0345] For example, when a video conference mode is performed using multiple displays while the vehicle is parked or stopped, a form factor change may be performed as in FIG. 7, in which the second display unit (851b) changes its shape to landscape mode and the third display unit (851c) pops up simultaneously / sequentially. After the form factor is changed in this way, presenter materials may be displayed on the second display unit (851b), and the cam screens of conference participants may be displayed on the third display unit (851c). In addition, when the first display unit (851a) is used in an expanded manner, a presenter mode screen such as a preview of presenter materials or a script may be displayed.

[0346] As another example, when the screen expansion mode is performed while watching a movie screen through the second display unit (851b), a form factor in which the third display unit (851c) pops down is performed, enabling viewing of a movie on a large screen using the first to third display units (851) on the same horizontal line. However, since the movie screen is being watched through the second display unit (851b), it is assumed that the vehicle is stopped.

[0347] As another example, when the Ambient mode is performed while the vehicle is parked or stopped, a form factor transformation as shown in FIG. 7 may be performed in which the second display unit (851b) is switched to landscape mode and the third display unit (851c) pops up. In this case, related ambient images (e.g., fireflies, aurora, forests, sky, space, etc.) may be seamlessly displayed on the first to third display units (851), and at this time, ambient light matching the displayed ambient images may be output inside the vehicle.

[0348] As another example, when the multi-view mode is performed while the vehicle is parked or stopped, the second display unit (851b) is switched to landscape mode and the third display unit (851c) is in a pop-up form factor state, a multi-view image (e.g., sports, games, etc.) or a music source list may be displayed on the second display unit (851b), and a video / music source selected from the multi-view image or music source list may be displayed in full screen on the third display unit (851c).

[0349] As another example, when a text input is required for content / service displayed on the second display unit (851b) or the third display unit (851c) while the second display unit (851b) is in the second form factor, the processor (or the control unit (880)) may recognize the content property and generate a form factor request event. Specifically, when a text input request screen is output on the second display unit (851b) or the third display unit (851c), the form factor may be modified so that the bending degree of the second display unit (851b) increases. In this way, when the bending area of ​​the second display unit (851b) is further bent in the horizontal direction, an input area (e.g., a virtual keyboard) appears in the second area, which is a lower area of ​​the bending area. Accordingly, an interaction environment in which input is easier is created. At this time, if there is no input for a certain period of time or the text input request screen displayed on the second display unit (851b) or the third display unit (851c) is switched to another screen, the bending degree of the second display unit (851b) can be automatically restored to its original state based on a control signal from the processor (or the control unit (880)).

[0350] Additionally, in an embodiment, the processor (or control unit (880)) can control multiple displays to change their form factors based on direct input.

[0351] For example, the form factor may be transformed so that the variable length (L) of the third display unit (851c) increases or decreases based on a touch gesture on the second display unit (851b). As a specific example, when a widget or application icon is displayed in the first area of ​​the second display unit (851b) and a two-finger flicking input is applied to the second area, the widget or application icon of the first area is displayed to fit the screen size of the third display unit (851c) in a pop-down state. On the other hand, when a three-finger flicking input is applied to the second area and a widget or application icon is displayed in the first area of ​​the second display unit (851b), the third display unit (851c) is transformed into a form factor in a pop-up, screen-expanded state, and then the widget or application icon of the first area is displayed. Here, the two-finger, three-finger flicking inputs can be replaced with other distinct touch gestures or input methods.

[0352] In some embodiments, form factor modifications may be performed such that multiple displays are driven simultaneously / sequentially via a single direct input.

[0353] For example, when a swipe up gesture is applied in a form factor state in which the second display unit (851b) is in landscape mode, a form factor transformation may be performed in which the second display unit (851b) is relatively rotated to be in landscape mode and the third display unit (851c) is popped up. At this time, the screen ratio and the displayed UI may be automatically adjusted to match the landscape mode and the popped-up screen ratio. Similarly, when a swipe down gesture is applied in a form factor state in which the second display unit (851b) is in portrait mode, a form factor transformation may be performed in which the second display unit (851b) is relatively rotated to be in portrait mode and the third display unit (851c) is popped down. At this time, the screen ratio and the displayed UI may be automatically adjusted to match the changed portrait mode and the popped-down screen ratio.

[0354] Meanwhile, when multiple different driving conditions occur in relation to a request for changing the form factor of multiple displays, the processor (or control unit (880)) of the vehicle display device (800) can change to a specific form factor according to a preset priority or maintain the current form factor state (without changing the form factor).

[0355] Specifically, a request to change the second form factor may be generated based on any one of a vehicle driving mode (e.g., driving start, autonomous driving mode, parking mode, etc.) based on sensing data of the vehicle while the plurality of displays are in the second form factor, a property of content displayed on the plurality of displays (e.g., screen makeup mode, input request screen, etc.), a user input request for the plurality of displays (e.g., a specific gesture, etc.), or a request to change the second form factor may be generated based on two or more of them.

[0356] In this case, the processor (or control unit (880)) can determine whether to accept a request to change the second form factor by considering the vehicle's driving conditions related to the vehicle's sensing data. In other words, the processor determines whether to change or maintain the form factor by giving the highest priority to the vehicle's current driving condition and driving conditions. Meanwhile, if requests to change the second form factor with the same priority are sequentially received, a request to change the second form factor is generated based on the form factor change request requested later.

[0357] Meanwhile, if it is determined that the request for a change in the requested second form factor cannot be accepted in consideration of the current driving conditions of the vehicle, the processor (or the control unit (880)) may display a feedback response corresponding to the request through the related display unit (and speaker).

[0358] FIG. 9 is a specific example of a form factor modification that changes the size of a third display unit (851c) corresponding to the passenger seat by using manipulation of a second display unit (851b) of a vehicle display device (800).

[0359] The third display unit (851c) is supported by a first frame and a second frame formed to be able to move relative to the first frame, and the front exposure area of ​​the display module increases / decreases according to the relative movement of the second frame, thereby changing the display size.

[0360] Specifically, as the second frame moves relative to the first frame (e.g., upwardly popping / rolling up), the front exposure area of ​​the display module gradually increases, thereby expanding the screen size of the third display unit (851c). Thereafter, as the second frame moves relative to the first frame (e.g., upwardly popping down / rolling down), the front exposure area of ​​the display module gradually decreases, thereby reducing the screen size of the third display unit (851c).

[0361] The processor (or control unit (880)) can generate a form factor change request event to change the screen size of the third display unit by changing the front exposure area according to the relative movement of the second frame based on the displayed content properties and the input request.

[0362] In one embodiment, the processor (or control unit (880)) may recognize that the content displayed on the multiple displays is an infotainment attribute and generate a form factor change request event to change the screen size of the third display unit (851c) based on an input request for the second display unit (851b).

[0363] At this time, the input request for the second display unit (851b) may include a request for transmission of content-related data for displaying the content displayed on the second display unit (851b) on the third display unit (851c).

[0364] In Fig. 9, the content screen (901) is displayed in the first area in the second form factor state in which the second display unit (851b) is bent out, and the second area can be used as a control panel.

[0365] At this time, when a specific gesture (e.g., an upward three-finger flicking input (911)) is applied to the second area, the vertical length (L1) of the third display unit (851c) increases, and the content screen displayed in the first area of ​​the second display unit (851b) may be displayed as an expanded content screen (902) of the third display unit (851c). The content screen (902) of the third display unit (851c) may be an infotainment screen such as a widget, an application icon, or a navigation screen. In addition, the content screen (901) displayed in the first area of ​​the second display unit (851b) may be continuously maintained.

[0366] Meanwhile, when an input request for the second display unit (851b) is made by the driver, any potential driving disturbance caused by the passenger in the passenger seat performing operations on the second display unit (851b) is eliminated. Now, the passenger in the passenger seat can interact and view the screen on the third display unit (851c) without operating the screen displayed on the second display unit (851b).

[0367] Continuing, in FIG. 9, when a specific gesture (e.g., a downward three-finger flicking input (912)) is applied to the second area of ​​the second display unit (851b) in the second form factor state, a form factor transformation is performed in which the vertical length (L2) of the expanded third display unit (851c) is reduced. At this time, a screen (903) adjusted with a screen ratio and UI suitable for the size of the reduced third display unit (851c) is displayed. In addition, the control panel area displayed in the second area of ​​the second display unit (851b) may also be displayed in a reduced size corresponding to the size of the reduced third display unit (851c).

[0368] Meanwhile, depending on the embodiment, the second area of ​​the second display unit (851b) may also be used as an interaction area for the expanded or reduced third display unit (851c). For example, when the driver attempts to manipulate content displayed on the third display unit (851c) through the second area of ​​the second display unit (851b), the interaction area for the third display unit (851c) may be layered over the control panel. At this time, the layered interaction area may disappear when the content displayed on the third display unit (851c), for example, the widget screen, disappears or there is no input for a certain period of time.

[0369] FIG. 10 is a drawing for explaining a form factor modification that changes the degree of bending of a second display unit (851b) according to an input request for a third display unit (851c) in a vehicle display device (800).

[0370] The second display unit (851b) can assume one of the following states based on the control command of the control unit (880): a flat mode, a first bending mode having a first curvature size according to the degree of bending, and a second bending mode having a second curvature size.

[0371] At this time, the first bending mode may correspond to the second form factor state, and the second curvature size may be a curvature value / range greater than the first curvature size. In addition, in the second bending mode, the second curvature may be the maximum curvature that the display module of the second display unit (851b) can drive. The first and second curvature sizes may be set during manufacturing or by user settings. In addition, conditions matching the changes in the flat mode, the first bending mode, and the second bending mode may be set by user settings.

[0372] When the form factor is deformed such that the degree of bending of the second display unit (851b) changes, the control unit (880) can control the display screen ratio to be adjusted accordingly.

[0373] According to an embodiment, the control unit (880) may generate a form factor change request event so that the second display unit (851b) changes from the first bending mode to the second bending mode based on a use request (e.g., input request) for the third display unit (851c) when multiple displays are in the second form factor. Similarly, the control unit (880) may generate a form factor change request event so that the second display unit (851b) changes from the second bending mode to the first bending mode based on a use release request (e.g., input termination) for the third display unit (851c).

[0374] According to an embodiment, the control unit (880) may recognize a touch on an area of ​​the second display unit (851b), for example, a second area below the bending area, when multiple displays are in the second form factor, as a request to use the third display unit (851c). Accordingly, as illustrated in FIG. 10, a form factor transformation request may be performed to change to a second bending mode in which the degree of curvature of the bent portion of the second display unit (851b) increases and the lower portion, i.e., the second area, is further elevated (U) in the horizontal direction with respect to the lower stand (B).

[0375] At this time, in the second bending mode, an interaction area (e.g., a virtual keyboard) corresponding to a request for use of the third display unit (851c) may be layered and displayed in the second area. Thereafter, when the request for use of the third display unit (851c) is released, a form factor transformation may be performed in which the layered interaction area (e.g., a virtual keyboard) disappears and the second display unit (851b) is restored to the first bending mode.

[0376] Meanwhile, since the bending degree of the second display unit (851b) increases and the second area is further raised and lowered in the horizontal direction, which may obstruct the driver's view, a request for a form factor change may not be accepted in consideration of the vehicle's driving situation, or the vehicle may be set to operate when stopped or parked.

[0377] Figure 11 is a block diagram illustrating integrated control of form factor transformation between multiple displays according to various situations that may occur in a vehicle.

[0378] Referring to FIG. 11, the display unit (851) of the vehicle display device (800) is implemented with a plurality of displays including a first display unit, a second display unit, and a third display unit, which may be hereinafter referred to as a cluster, a CID, and a PID based on their installation locations as described above. That is, hereinafter, the cluster refers to the first display unit (851a), the CID refers to the second display unit (851b), and the PID refers to the third display unit (851c).

[0379] The display unit (851) is driven so that each of the plurality of displays can independently change its shape structure as described above and can assume various form factors based on one or more combinations (e.g., relative movement, relative rotation, bending-out / in, pop-up / pop-down, roll-up / down, etc.). The display unit (851) is driven based on a control command according to a form factor change request generated by the integrated control unit (1110).

[0380] The integrated control unit (1110) comprehensively controls the operation of the CID (second display unit) and PID (third display unit) shapes, taking into account various driving situations of the vehicle. The integrated control unit (1110) performs the same function as the processor (or control unit (880)) of the vehicle display device (800) described above, and can be understood as the same component.

[0381] The integrated control unit (1110) includes a driving situation judgment unit (1121), a CID and PID default setting unit (1122), a driver situation judgment unit (1123), and an infotainment content / service-specific display mode setting unit (1124). The integrated control unit (1110) integrates decisions made by multiple judgment and setting units (1121 to 1124) to recognize the requested form factor and make a final judgment as to whether a change to the corresponding form factor is possible. Then, the integrated control unit (1110) transmits a driving command for changing the form factor to the display unit (851).

[0382] The driving situation determination unit (1121) recognizes the vehicle's driving status and driving mode. For example, the driving situation determination unit (1121) determines whether the vehicle is in autonomous driving mode or driving on a road, and transmits this information to the integrated control unit (1110). To this end, the driving situation determination unit (1121) may operate based on sensing data (1131) acquired by internal vehicle sensors, ECUs, OBDs, etc.

[0383] The CID and PID default setting unit (1122) can set the default form factor to match the various driving situations of the vehicle. For example, the CID and PID default setting unit (1122) can set the default form factor based on sensing data from a vehicle sensor (1132), such as an ICM (motion sensor), a DMS (distance sensor), etc. In addition, the CID and PID default setting unit (1122) can additionally set the default form factor according to the judgment and setting of the driver situation judgment unit (1123) and the infotainment content / service-specific display mode setting unit (1124).

[0384] For example, the CID and PID default setting unit (1122) can preset the default form factors taken when the vehicle is in motion and stopped as detected by the vehicle sensor (1132), the default form factor taken when PID use is requested, the default form factor matched according to the vehicle's driving mode conditions, the default form factor matched according to the driver's situation, and the default form factor matched according to the properties of the requested content / service.

[0385] The driver situation judgment unit (1123) transmits the analysis results of data related to the driver's situation (e.g., whether looking forward, yawning, drowsiness, smoking, or distraction) collected through the vehicle's sensing data, such as the internal camera included in the DMS (Driver monitoring system) and / or IMS (Interior monitoring system), to the integrated control unit (1110). The integrated control unit (1110) may execute form factor modification to guide the driver's driving based on the analysis results of the driver situation judgment unit (1123), or may decide not to accept a form factor change request.

[0386] The user input unit (1133) receives direct input from the driver / passenger for form factor modification. For example, the input method of the user input unit (1133) may include manipulation of one of the multiple displays, such as touch gestures (including hover touch), as well as input by gaze fixation, voice commands, camera-based gestures, etc. In addition, the user input unit (1133) may additionally include an interaction area temporarily layered on a portion of another display unit (e.g., CID) in response to an input request for a specific display unit (e.g., PID).

[0387] The infotainment content / service-specific display mode setting unit (1124) sets a form factor matching the content-specific properties (e.g., screen expansion mode). To this end, the content-specific property unit (1134) can, for example, distinguish whether the content's properties are driving-related content such as navigation, infotainment not directly related to driving, or extended screen mode, and transmit the information to the infotainment content / service-specific display mode setting unit (1124).

[0388] Meanwhile, data related to the judgment conditions, settings, etc. of the driving situation judgment unit (1121), CID and PID default setting unit (1122), driver situation judgment unit (1123), and infotainment content / service-specific display mode setting unit (1124) may be stored in memory, etc.

[0389] The integrated control unit (1110) can control the operation of the CID and PID to change the form factor according to driving conditions such as driving conditions, properties of content / service, or requests.

[0390] For example, if a form factor driving condition for switching the CID to portrait mode based on an operation on the PID is satisfied, the integrated control unit (1110) can control the driving to restore the CID to flat mode and relatively rotate the display to switch to landscape mode while raising and lowering the CID. In addition, for example, the driving can be controlled to form a first form factor in which the CID is in flat mode and portrait mode and the PID is in a pop-down state in a vehicle standby mode (e.g., before starting / after starting and before starting driving). In addition, for example, during vehicle driving, the form factor deformation can be controlled to form a second form factor in which the CID is in a first bending mode and the PID is popped down, or the CID is changed to a second bending mode.

[0391] When the integrated control unit (1110) needs to perform shape changes for multiple displays in response to a form factor change request, it can selectively perform either simultaneous control or sequential control since each display can be driven independently. For example, the integrated control unit (1110) can drive the PID after driving the CID, or drive the CID and PID simultaneously.

[0392] The integrated control unit (1110) can perform form factor transformation / maintenance according to preset priorities when there are conflicting / multiple form factor transformation / maintenance requests.

[0393] Additionally, the integrated control unit (1110) can set a different default form factor according to user settings. For example, when the CID and PID are personalized to a single home screen mode when the driver is riding alone, when the vehicle is detected to be in motion, instead of the second form factor in which the CID is in the first bending mode, a form factor in which the CID is in the second bending mode can be used as the default form factor.

[0394] Additionally, the integrated control unit (1110) can determine whether content being displayed while the vehicle is in portrait or landscape mode, and maintain or change the current form factor accordingly. In this case, the integrated control unit (1110) can readjust the screen ratio and UI to match the display orientation. For example, when the CID adjusts the screen ratio to correspond to the top and bottom of the screen in portrait mode, the left and right margins, if any, can be used as interaction areas.

[0395] Additionally, the integrated control unit (1110) may determine not to change the form factor only for content display if the content is driving regulation content.

[0396] Specifically, the integrated control unit (1110) may determine to maintain the second form factor (or the set default form factor) or the current form factor while the driving attention mode is detected based on the vehicle's sensing data. Here, the driving attention mode may refer to driver driving on a general road based on the vehicle's sensing data.

[0397] Meanwhile, if the driving attention mode is not detected, the integrated control unit (1110) may sequentially or simultaneously generate a first request for changing the display direction of the CID and a second request for changing the screen size of the PID based on at least one of the properties of the content that can be expanded on the screen and the user's input request.

[0398] Below, Fig. 12 is a flowchart for explaining the possibility and range of form factor changes between multiple displays depending on whether the vehicle is driving and the driving mode.

[0399] Referring to FIG. 12, the vehicle display device (800) can receive vehicle information (1201) by various vehicle sensors (e.g., OBD, ECU, etc.).

[0400] The vehicle display device (800) detects whether the vehicle is traveling at a certain speed or higher based on the received vehicle information (1202). For example, if the vehicle's driving speed is 10 km / h, it then determines whether the road is suitable for autonomous driving (1203).

[0401] If the road is capable of autonomous driving, the form factor variation range is expanded to enable both CID and PID operation (1205). Conversely, if autonomous driving is not possible, it is further confirmed whether the road is a highway (1204). If it is a highway, only PID operation is enabled during driving (1206). Conversely, if it is determined to be non-highway, the driver's attention driving mode is activated and the driving mode display settings, such as the second form factor (or default form factor) state, are maintained (1207).

[0402] Next, the range of possible form factor variations of the CID and PID is stored based on the driving situation (1208). This is to memorize display modes that can be changed based on the driving situation in advance for integrated control of the CID and PID.

[0403] Specifically, in autonomous driving mode, the driver's responsibility for careful driving is further reduced, so the form factor change range can be set to allow both the CID and PID to operate. Meanwhile, if the PID is used independently by the passenger in the front seat, the privacy mode (SPM) can be turned on when the PID pops up. When autonomous driving mode ends, the PID automatically pops down to secure the driver's field of vision, and the CID is restored to its second form factor state, which is vertical and bent out.

[0404] Also, as a specific example, the form factor change range of the CID can be set so that it can be operated freely even while driving. When the driver's need to use the PID is detected, the form factor can be changed to a structure in which the degree of bending of the CID increases so that the CID can be easily used as an interaction area. For example, when the driver gazes at the PID while driving, the intention to use it can be recognized, and the degree of bending of the CID in the second form factor state can be further increased and changed to the second bending mode. Thereafter, when it is recognized that there is no interaction with the PID or no gaze on the PID for a certain period of time, the degree of bending of the CID can be reduced to its original value and operated to return to the second form factor state.

[0405] By pre-setting the range of form factor changes possible for each driving situation in this way, when a form factor change event occurs based on a request input or the properties of content / service, it is possible to quickly decide whether to accept the form factor change request and execute the operation or not by considering this.

[0406] Below, FIG. 13 is a flowchart illustrating processing of a request based on the vehicle's driving conditions, the properties of the displayed content, and the input request when a form factor change request occurs. Meanwhile, the operation illustrated in FIG. 13 is performed by the processor (or control unit (880)) of the vehicle display device (800).

[0407] The processor (or control unit (880)) of the vehicle display device (800) can recognize a display expansion request included in a form factor change request.

[0408] To this end, a request for a change in the second form factor may include a request for changing to a specific form factor based on the operation of multiple displays, along with a request for expanding the display of related content on at least two of the multiple displays. For example, a request for changing the form factor to rotate the CID to landscape mode and pop up the PID may include a request for expanding the display of content currently displayed on the CID or PID on the CID and PID.

[0409] Meanwhile, the processor (or control unit (880)) may limit at least one content from being expanded to at least the first display unit (851a), i.e., the cluster, while the driver's driving is detected according to the driving situation of the vehicle.

[0410] For example, if a request for screen extension to the cluster and PID is detected, the cluster screen remains displayed as is if the vehicle is in motion. Conversely, if the vehicle is not in motion when such a request is made, the functions related to the content screen playing on the CID may be extended to the cluster and PID after the form factor change.

[0411] Referring to FIG. 13, the vehicle display device (800) is initiated by detecting the occurrence of a form factor change event (1301).

[0412] It is determined whether the form factor change event is an event based on direct input (1302), and if it is a direct input, it is transmitted to the integrated control unit (1110, Fig. 11) to check whether the form factor is possible based on direct input (1303).

[0413] On the other hand, if the form factor change event is not a direct input, it is determined whether the form factor change is due to content / service linkage (1304). If the form factor change is due to content / service linkage, the appropriate form factor is determined based on the operating conditions corresponding to specific properties.

[0414] Specifically, if the content / service attribute is related to video conferencing (1306), the CID may be determined to take a form factor in which the PID pops up in landscape mode so that multiple displays can be seamlessly connected.

[0415] Additionally, if the content / service attribute is related to viewing screen extended video (1307), the screens of the CID, PID, and cluster can take the form factor of the PID popping down in alignment with the cluster to seamlessly display the playback screen and related list at a glance.

[0416] Additionally, if the content / service property is related to ambient video for relaxation (1308), the CID may be switched to landscape mode and the PID may take a pop-up form factor so that the ambient video is seamlessly connected to the CID and PID.

[0417] Also, if it is a content / service attribute related to multi-view viewing (1309), for example, in the case of sports multi-view or game multi-view, the CID may be determined to be a form factor in which the CID operates in landscape mode and the PID pops up so that the multi-view image can be displayed on the CID and the selected one can be displayed in full screen on the PID.

[0418] Alternatively, if the content / service property is related to text input within the application (1310), the CID may be determined to have a form factor in which it is bent upwards in a horizontal direction to facilitate text input without obstructing the screen for the driver or passenger. In this case, an interaction area such as a virtual keyboard may be layered on the lower second area transformed into the second bending mode, and when the input is explicitly terminated or there is no input for a certain period of time, the layered interaction area disappears and the CID is restored to the first bending mode.

[0419] Once an appropriate form factor is determined, the integrated control unit (1110, Fig. 11) determines whether a change to the corresponding form factor is possible (1311). If the form factor falls within the possible range of form factor transformation, the CID and PID are independently driven to execute form factor transformation (1320). On the other hand, if the determined form factor falls outside the possible range of transformation, the current form factor status of the CID / PID is maintained (1312).

[0420] Meanwhile, if the form factor change event is neither a direct input nor a content / service linkage, the integrated control unit (1110, Fig. 11) checks the default form factor and performs operation. For example, when driving, it operates with the second form factor, and when stopped, it operates with the first form factor.

[0421] Meanwhile, when the vehicle is stationary and the second display is in landscape mode, interactions related to content use can be expanded. For example, content exploration and vertical depth movement can be easily performed through the first and third displays (851a, 851c) that allow expanded use based on inputs to the second display unit (851b), such as swiping, touching, or flicking inputs.

[0422] In this regard, FIG. 14a is a flowchart for explaining various operation modes for displaying content on multiple displays according to the display mode of the requested form factor.

[0423] Also, FIG. 14b is a flowchart for explaining seamlessly displaying content on multiple displays according to the display mode of the requested form factor, and FIGS. 15a and 15b are drawings for explaining variably applying a crop area in relation to FIG. 14b.

[0424] Additionally, each operation in the flowcharts of FIGS. 14a and 14b is performed by the processor (or control unit (880)) of the vehicle display device (800) unless otherwise described.

[0425] First, referring to FIG. 14a, the vehicle display device (800) receives vehicle information (1401). In addition, the vehicle display device (800) receives content information displayed on multiple displays (1402).

[0426] Next, it is determined whether multiple displays are used as a multi-display (1403). If they are displayed independently, normal display mode (1407) is performed.

[0427] When multiple displays are used as multi-displays, it is determined whether the content is a driving regulation content (1404). Here, driving regulation content may refer to content with infotainment properties unrelated to vehicle driving, such as music playback, movie viewing, or the execution screen of a specific application (not navigation). Meanwhile, driving regulation content applies only when the vehicle is in motion. Therefore, even if the driving regulation content listed above is in motion, multiple displays can be used as extended screens when the vehicle is parked.

[0428] If the content is not a driving regulation content (or the vehicle is parked), it is checked whether the displayed content is seamless display content (1405). Here, seamless display content refers to content that has the property of being displayed by connecting a single content to multiple displays, such as in extended screen mode.

[0429] If the content is not seamless display content, normal display mode (1407) is performed. If the content is seamless display content, seamless display mode (1408) is determined. Thereafter, attribute information of the current content is received (409), the display driving mode is determined (410), and the corresponding screen ratio and UI, etc. are adjusted to display the content.

[0430] Meanwhile, for content regulated by driving regulations, the PID display is used independently, separate from the cluster and CID. To achieve this, the PID operates in switchable privacy mode (SPM) (1406). This prevents the driver from seeing the content displayed on the PID, allowing the passenger in the front seat to freely view the content without interfering with driving.

[0431] Meanwhile, even if the content is not subject to driving regulations, the cluster and CID can be used separately or in conjunction with the PID based on input or settings. When separated, the driver's primary terminal is automatically linked to the CID, and the passenger's secondary terminal is automatically linked to the PID, enabling independent control through each terminal. Alternatively, even while the vehicle is parked, the driver can view primary content through the cluster and CID, while the passenger can freely view secondary content through the PID with SPM activated.

[0432] Meanwhile, referring to FIG. 14b and FIG. 15a and FIG. 15b, a method for performing seamless display while taking into account form factor deformation when displaying driving-related images using multiple displays will be described.

[0433] When the vehicle display device (800) expands at least one content to the second and third display units (851b, 851c) in response to a request for a form factor change, the display mode of the content can be determined based on the properties of the content and the form of the form factor to be changed, and the crop area for screen expansion can be varied and applied according to the determined display mode.

[0434] For example, when the second and third display units (851b, 851c) are expanded in a horizontal mode and a pop-up form factor state and display a front view of the vehicle as a driving-related image, cropping and connection according to the screen ratio must be performed for seamless connection.

[0435] Specifically, referring to FIG. 14b, the vehicle display device (800) can receive image information collected through the vehicle's front camera (1411). In addition, the vehicle display device (800) can receive information about the current display mode (1412).

[0436] Check whether the current display mode is a single display (1413), and if so, set a single crop area (1414). At this point, cropping should be performed based on the aspect ratio of only one display.

[0437] On the other hand, in multi-display mode, a multi-crop area corresponding to the linked multi-display is set (1415). Specifically, multiple crop areas are set for the received image information according to the operating conditions of each display. The setting of the multi-crop area may include adjusting the size or position of the image, editing a portion of the image, and adjusting transparency.

[0438] The area is cropped according to the set single crop area or multi-crop area (1416), and calibration is performed on the cropped area (1417). After this, AR rendering is performed using an AR renderer (not shown) or the like (1418), and then displayed on the screen of a single display or multi-display (1419).

[0439] FIG. 15a shows that in a form factor in which the second display unit (851b) is in portrait mode and the third display unit (851c) is in a pop-down state, the cropped front image is seamlessly displayed in the first part (1501) and the second part (1502), respectively.

[0440] FIG. 15b shows that in the horizontal mode of the second display unit (851b) and in the form factor where the third display unit (851c) is popped up by a variable length (L), the cropped front image is seamlessly displayed in the first deformable portion (1503) and the second deformable portion (1504), respectively.

[0441] As described above, according to the vehicle display device and its operating method according to an embodiment of the present invention, the form factors of multiple displays can be optimally changed according to the driving conditions of the vehicle, the needs of the passengers, and the content / services provided, thereby satisfying both the driver's field of vision and the enhanced infotainment experience depending on the situation. In addition, as the form factor changes according to the current driving mode of the vehicle, it provides an experience in which related content or services are provided in a more efficient and seamless format. In addition, the passenger in the front seat does not need to separately request display operation, and the driver and the driver can operate their respective devices by linking their displays without disturbing each other. Furthermore, it can provide a variety of experiences in which the vehicle interior can be used in a desired form, such as an office space for video conferencing, or a large-screen viewing space for providing expanded screen content.

[0442] The present invention described above can be implemented as computer-readable code on a medium having a program recorded thereon. Computer-readable media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and also include media implemented in the form of carrier waves (e.g., transmission via the Internet). In addition, the computer may include a controller / processor of a personal driving system (800). Therefore, the above detailed description should not be construed as limiting in all respects, but should be considered as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are intended to be included in the scope of the present invention.

Claims

1. A body that can be mounted on the vehicle dashboard; A plurality of displays formed on the front surface of the main body, including a first display, a second display provided so that a portion thereof can be bent, and a third display provided so that the size of the display screen can be varied; and In response to detecting that the vehicle is being driven, the second display of the plurality of displays forms a flat first form factor, and changes to a second form factor different from the first form factor, determining that there is a request for a change in the second form factor based on at least one of the sensing data of the vehicle, the content displayed on the multiple displays, and the input request; A processor that controls the plurality of displays to determine whether a change in the second form factor is possible based on the driving conditions of the vehicle and to execute a change to the form factor according to the determination. A vehicle's display device.

2. In paragraph 1, The second form factor is a structure in which the second display moves relative to the first direction and at least a portion of the second display is bent. The above processor, In response to a vehicle driving detection signal, characterized in that a signal for changing to the second form factor is transmitted to the plurality of displays. Vehicle display device.

3. In paragraph 2, The above first form factor is a structure in which the second display moves relative to the first direction and becomes flat. The above processor, In response to a vehicle stop signal, a signal for changing to the first form factor is transmitted to the plurality of displays, characterized in that: Vehicle display device.

4. In paragraph 1, The request for change of the above second form factor is, It occurs based on at least one of the vehicle driving mode based on the sensing data of the vehicle, the properties of the content displayed on the plurality of displays, and the user input request for the plurality of displays. The above processor, Characterized in that it determines whether to accept a request for a change in the second form factor by considering the driving situation of the vehicle related to the sensing data of the vehicle. Vehicle display device.

5. In paragraph 4, The third display is supported by a first frame and a second frame formed to be relatively movable with respect to the first frame, The above processor, A method characterized in that a form factor change request event is generated to change the screen size of the third display by changing the front exposure area according to the relative movement of the second frame based on the properties of the content displayed on the plurality of displays and the input request. Vehicle display device.

6. In paragraph 5, The above processor, A method characterized in that it recognizes that the content displayed on the plurality of displays is an infotainment attribute and generates a form factor change request event for changing the screen size of the third display based on an input request for the second display. Vehicle display device.

7. In paragraph 4, The second display is operable in one of a flat mode in which the display is flat, a first bending mode in which at least a portion of the display has a different degree of bending, and a second bending mode. The above processor, Characterized in that, based on a usage request for the third display in the second form factor, the second display generates a form factor change request event for changing from the first bending mode to the second bending mode. Vehicle display device.

8. In paragraph 7, The above processor, In the second form factor state, when a touch is made on an area of ​​the second display, a request for use of the third display is recognized, and a form factor change request event is generated to change to a second bending mode in which the curvature of the bent portion of the second display is changed and the lower portion is raised and lowered. Vehicle display device.

9. In paragraph 4, The second display is provided so that the screen direction of the display can be changed by rotating relative to the main body. The above processor, A method characterized in that, based on at least one of the properties of the content displayed on the plurality of displays and a user's input request, a form factor change request event is generated in which the bending of the second display is restored and the screen orientation of the display is changed by relative rotation. Vehicle display device.

10. In paragraph 4, The above processor, Based on the above sensing data, it is determined to maintain the second form factor or the current form factor while the driving attention mode is detected, The above driving attention mode is characterized by including driver driving on a general road based on the sensing data. Vehicle display device.

11. In paragraph 10, The above processor, While the above driving caution mode is not detected, A method of controlling a display direction of a second display and a second display, the method comprising: sequentially or simultaneously generating a first request for changing the display direction of the second display and a second request for changing the screen size of the third display based on at least one of a property of content capable of screen expansion and a user's input request; Vehicle display device.

12. In paragraph 11, The request for change of the above second form factor is, A request for displaying at least one content expanded on two or more of the first to third displays after the form factor change according to the first and second requests, The above processor, Characterized in that the at least one content is controlled not to be expanded to at least the first display while the driver driving is detected according to the driving situation of the vehicle. Vehicle display device.

13. In paragraph 12, The above processor, When extending said at least one content to said second and third displays in response to said second form factor change request, A method of determining a display mode of a content based on the properties of the content and the form factor to be changed, characterized in that the crop area for screen expansion is varied according to the determined display mode. Vehicle display device.

14. In paragraph 11, The above processor, Maintaining the current form factor of the plurality of displays based on the driving situation of the vehicle, wherein the driver driving is detected and at least one of the contents is driving regulation content. characterized in that the switchable privacy mode (SPM) is executed for the third display to display the at least one content. Vehicle display device.

15. In paragraph 1, The above processor, After the second form factor is changed, the plurality of displays are controlled to transform the changed form factor to the previous state or the second form factor by considering the driving situation of the vehicle identified based on the sensing data of the vehicle. Vehicle display device.

16. A method of operating a vehicle display device including a plurality of displays, including a first display, a second display provided so that a portion thereof can be bent, and a third display provided so that the size of the display screen can be varied, formed on the front of a body mountable on a vehicle dashboard, A step of detecting driving of the vehicle while the plurality of displays form a first form factor in which the second display is flat, and changing the plurality of displays to a second form factor different from the first form factor; A step of determining that there is a request for a change in the second form factor based on at least one of sensing data of the vehicle, content displayed on a plurality of displays, and an input request; and A step of determining whether a change in the second form factor is possible based on the driving conditions of the vehicle and executing a change to the form factor according to the determination is included. Method of operation of a vehicle display device.

Images