Display device for vehicle and control method therefor

Abstract

Embodiments of the present invention comprise: a camera; a stretchable display panel including a touch sensor; a mechanism unit including at least one pin that moves in the direction perpendicular to the rear surface of the stretchable display panel; and a processor that controls the operations of the display panel and the mechanism unit, identifies a user touching the display panel, determines a driver seat or passenger seat control mode, outputs a driving control signal for controlling the movement of the at least one pin in the driver seat or passenger seat control mode, outputs an operation control signal for carrying out a function corresponding to the user's touch input in a protruding area of the display panel according to the movement of the at least one pin, and outputs a feedback control signal for feedback output set for execution of the function in the driver seat control mode.

Description

Vehicle display device and method for controlling the same

[0001] Embodiments of the present invention relate to a display device.

[0002] As display devices that visually display electrical signals evolve, a variety of display devices with superior characteristics, such as thinness, weight reduction, and low power consumption, are being introduced. For example, flexible display devices that can be folded or rolled are being introduced. Recently, active research and development is underway on stretchable display devices capable of transforming into various forms.

[0003] The information disclosed in the background art is intended only to enhance understanding of the background, and therefore the information discussed in the background art does not necessarily constitute prior art.

[0004] Embodiments of the present invention can provide a display device capable of controlling an in-vehicle device without interfering with the driver's driving.

[0005] Aspects of some embodiments relate to electronic devices including display devices and, for example, stretchable display devices, and methods of controlling the same.

[0006] Additional aspects will be described in some of the following descriptions, some will become apparent from the description, or may be learned by practicing the embodiments presented.

[0007] According to some embodiments of the present invention, a vehicle display device includes: at least one camera; a display panel that is stretchable and includes a touch sensor; a mechanism including at least one pin that moves in a vertical direction with respect to a rear surface of the display panel; and a processor that controls operations of the display panel and the mechanism. The processor identifies a user touching the display panel based on an image signal acquired from the at least one camera, and determines a driver's seat control mode or a passenger's seat control mode according to the identified user. In the driver's seat control mode and the passenger's seat control mode, the processor outputs a driving control signal for controlling movement of the at least one pin of the mechanism, and outputs an operation control signal for performing a function corresponding to a touch of the user inputted in a protruding area of ​​the display panel according to movement of the at least one pin. In the driver's seat control mode, the processor further outputs a feedback control signal for outputting feedback set for performing the function.

[0008] In some embodiments, the protruding region includes a central region having the highest height and a peripheral region around the central region, and the peripheral region may have a sloped surface and gradually decrease in height from the central region.

[0009] In some embodiments, the processor may output an operation control signal for controlling on / off of the function in response to a touch of the central area, and may output an operation control signal for controlling the height of the function in response to a drag of the peripheral area.

[0010] In some embodiments, the function may include at least one of temperature control, volume control, and radio frequency control.

[0011] In some embodiments, the mechanism may include a single pin positioned corresponding to the protruding region.

[0012] In some embodiments, the mechanism includes at least one first pin positioned corresponding to a central region of the protruding region and a plurality of second pins positioned corresponding to the peripheral region, and a movement distance of the first pin may be longer than a movement distance of the second pins.

[0013] In some embodiments, the at least one camera may be positioned above the display panel or below the display panel.

[0014] In some embodiments, the touch sensor may be at least one of a capacitive touch sensor, a resistive touch sensor, an acoustic touch sensor, an infrared touch sensor, and a pressure touch sensor.

[0015] In some embodiments, the functionality may further include video playback.

[0016] In some embodiments, in the passenger seat control mode, when the function corresponding to the user's touch input in the protruding area of ​​the display panel is the image playback, the processor outputs a driving control signal for controlling the movement of the at least one pin of the mechanism, and the display panel can be modified to provide a first display area inclined toward the driver's seat and a second display area inclined toward the passenger seat according to the movement of the at least one pin.

[0017] In some embodiments, a method for controlling a vehicle display device includes: at least one camera; a display panel that is flexible and includes a touch sensor; and a mechanical part including at least one pin that moves in a vertical direction with respect to a rear surface of the display panel; wherein the control method includes: identifying a user touching the display panel based on an image signal acquired from the at least one camera, and determining a driver's seat control mode or a passenger's seat control mode according to the identified user; outputting, in the driver's seat control mode, a driving control signal for controlling movement of the at least one pin of the mechanical part; and outputting, in the driver's seat control mode, an operation control signal for performing a function corresponding to a touch of the user input in a protruding area of ​​the display panel according to movement of the at least one pin, and a feedback control signal for outputting a feedback set for performing the function.

[0018] In some embodiments, in the passenger seat control mode, the feedback control signal may not be output.

[0019] In some embodiments, the protruding region includes a central region having the highest height and a peripheral region around the central region, and the peripheral region may have a sloped surface and gradually decrease in height from the central region.

[0020] In some embodiments, the motion control signal output step may include a step of outputting a motion control signal for controlling on / off of the function in response to a touch of the central area, and a step of outputting a motion control signal for controlling the height of the function in response to a drag of the peripheral area.

[0021] In some embodiments, the function may include at least one of temperature control, volume control, and radio frequency control.

[0022] In some embodiments, the mechanism may include a single pin positioned corresponding to the protruding region.

[0023] In some embodiments, the mechanism includes at least one first pin positioned corresponding to a central region of the protruding region and a plurality of second pins positioned corresponding to the peripheral region, and a movement distance of the first pin may be longer than a movement distance of the second pins.

[0024] In some embodiments, the at least one camera may be positioned above the display panel or below the display panel.

[0025] In some embodiments, the touch sensor may be at least one of a capacitive touch sensor, a resistive touch sensor, an acoustic touch sensor, an infrared touch sensor, or a pressure touch sensor.

[0026] In some embodiments, the function further includes video playback, and the method may further include, when the function corresponding to the user's touch input in the protruding area of ​​the display panel in the passenger seat control mode is the video playback, a step of outputting a driving control signal for controlling movement of the at least one pin of the mechanism; and a step of providing an image according to a user selection in the second display area of ​​the display panel, which is deformed to provide a first display area inclined toward the driver's seat and a second display area inclined toward the passenger seat according to the movement of the at least one pin.

[0027] According to embodiments of the present invention, a display device can be provided that safely controls in-vehicle devices without interfering with the driver's driving. Of course, the scope of the present invention is not limited by these effects.

[0028] FIG. 1 is a perspective view schematically illustrating a display device according to some embodiments.

[0029] Figures 2a and 2b are perspective views showing the display device of Figure 1 extended in the first direction.

[0030] Figure 2c is a perspective view showing the display device of Figure 1 extended in the second direction.

[0031] Figure 2d is a perspective view showing the display device of Figure 1 extended in the first direction and the second direction.

[0032] Figure 2e is a perspective view showing the display device of Figure 1 extended in the third direction.

[0033] FIG. 3 is a perspective view schematically illustrating an embodiment of a vehicle electronic device including a stretchable display device according to some embodiments.

[0034] FIG. 4 is a cross-sectional view schematically illustrating a vehicle display device according to some embodiments.

[0035] FIG. 5 is a schematic diagram illustrating a vehicle display device according to some embodiments.

[0036] FIG. 6 is a schematic diagram illustrating a display layer according to some embodiments.

[0037] FIGS. 7A to 8B are schematic drawings illustrating deformation of a stretching structure and a display panel according to some embodiments.

[0038] FIG. 9 is a schematic drawing showing a cross-section of a stretching structure (SS) and a display panel (DP) taken along line I-I' of FIG. 8b.

[0039] FIGS. 10A to 11C are schematic drawings illustrating camera arrangements according to some embodiments.

[0040] FIGS. 12 and 13 are schematic drawings illustrating touch on a protruding area of ​​a display panel for function control according to some embodiments.

[0041] FIG. 14 is a diagram illustrating the operation of a feedback system according to some embodiments.

[0042] FIG. 15 is a schematic diagram illustrating a method for controlling a vehicle display device according to some embodiments.

[0043] Fig. 16 is a schematic diagram illustrating a method for controlling a vehicle display device according to some embodiments.

[0044] Figure 17 is a schematic diagram illustrating deformation of a stretching structure according to some embodiments.

[0045] Figure 18 is a drawing schematically showing a deformation of a display panel according to some embodiments.

[0046] According to some embodiments of the present invention, a vehicle display device includes: at least one camera; a display panel that is stretchable and includes a touch sensor; a mechanism including at least one pin that moves in a vertical direction with respect to a rear surface of the display panel; and a processor that controls operations of the display panel and the mechanism. The processor identifies a user touching the display panel based on an image signal acquired from the at least one camera, and determines a driver's seat control mode or a passenger's seat control mode according to the identified user. In the driver's seat control mode and the passenger's seat control mode, the processor outputs a driving control signal for controlling movement of the at least one pin of the mechanism, and outputs an operation control signal for performing a function corresponding to a touch of the user inputted in a protruding area of ​​the display panel according to movement of the at least one pin. In the driver's seat control mode, the processor further outputs a feedback control signal for outputting feedback set for performing the function.

[0047] Some embodiments of the present invention are capable of various modifications and multiple embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention, as well as methods for achieving them, will become clearer with reference to the embodiments described in detail below, along with the drawings. However, the embodiments of the present invention are not limited to the embodiments disclosed below and may be implemented in various forms.

[0048] In the examples below, the terms first, second, etc. are not used in a limiting sense, but are used for the purpose of distinguishing one component from another.

[0049] In the examples below, singular expressions include plural expressions unless the context clearly indicates otherwise.

[0050] In the examples below, terms such as “include” or “have” mean that a feature or component described in the specification is present, and do not preclude the possibility that one or more other features or components may be added.

[0051] In the following examples, when a part such as a film, region, component, etc. is said to be on or above another part, it includes not only a case where it is directly on top of the other part, but also a case where another film, region, component, etc. is interposed in between.

[0052] In this specification, “A and / or B” refers to the case where it is A, or B, or both A and B. In addition, in this specification, “at least one of A and B” refers to the case where it is A, or B, or both A and B.

[0053] In the following embodiments, when X and Y are said to be connected, it may include cases where X and Y are electrically connected, directly or indirectly, cases where X and Y are functionally connected, and cases where X and Y are physically connected. Here, X and Y may be objects (e.g., devices, components, circuits, wiring, electrodes, terminals, conductive films, layers, etc.). Therefore, it is not limited to a given connection relationship, for example, a connection relationship shown in the drawings or detailed description, and may also include connection relationships other than those shown in the drawings or detailed description.

[0054] Cases where X and Y are electrically connected may include, for example, cases where X and Y are directly connected and cases where one or more elements (e.g., switches, transistors, capacitors, inductors, resistors, diodes, etc.) that enable electrical connection between X and Y are connected between X and Y.

[0055] In the following examples, the x-direction, y-direction, and z-direction are not limited to directions along the three axes on the orthogonal coordinate system, but can be interpreted in a broad sense that includes them. For example, the x-direction, y-direction, and z-direction may be orthogonal to each other, but may also refer to different directions that are not orthogonal to each other.

[0056] In some embodiments of this specification, where implementations are otherwise feasible, specific process sequences may be performed in a different order than described. For example, two processes described in succession may be performed substantially simultaneously, or in a reverse order from the described order.

[0057] For convenience of explanation, the sizes of components in the drawings may be exaggerated or reduced. For example, the sizes and thicknesses of each component shown in the drawings are arbitrarily indicated for convenience of explanation, and thus the present invention is not necessarily limited to what is shown.

[0058] It will be appreciated that the combinations of each block of the drawings and the flowchart drawings according to the embodiments can be performed by computer program instructions. These computer program instructions can be installed in a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing equipment, so that the instructions executed by the processor of the computer or other programmable data processing equipment create a means for performing the functions described in the flowchart block(s). These computer program instructions can also be stored in a computer-readable memory or a computer-readable memory that can direct a computer or other programmable data processing equipment to perform the functions in a specific manner, so that the instructions using the computer or stored in the computer-readable memory can also produce an article of manufacture that includes an instruction means for performing the functions described in the flowchart block(s). Since the computer program instructions may be installed on a computer or other programmable data processing device, a series of operational steps may be performed on the computer or other programmable data processing device to create a computer-executable process, and the instructions that cause the computer or other programmable data processing device to perform the steps for performing the functions described in the flowchart block(s) may also provide steps for performing the functions described in the flowchart block(s).

[0059] Additionally, each block may represent a module, segment, or portion of code that contains one or more executable instructions for performing a specific logical function(s). It should also be noted that in some alternative implementation examples, the functions described in the blocks may occur out of order. For example, two blocks depicted in succession may actually be executed substantially concurrently, or the blocks may sometimes be executed in reverse order, depending on their respective functions.

[0060] Here, the term '~ unit' used in this embodiment means a software or hardware component such as an FPGA or ASIC, and the '~ unit' performs certain roles. However, the '~ unit' is not limited to software or hardware. The '~ unit' may be configured to be on an addressable storage medium and may be configured to regenerate one or more processors. Thus, as an example, the '~ unit' includes components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, the components and '~ units' may be implemented to regenerate one or more CPUs within a device or a secure multimedia card.

[0061] Fig. 1 is a perspective view schematically illustrating a display device (1) according to some embodiments. Figs. 2a and 2b are perspective views illustrating the display device (1) of Fig. 1 in a state extended in a first direction. Fig. 2c is a perspective view illustrating the display device (1) of Fig. 1 in a state extended in a second direction. Fig. 2d is a perspective view illustrating the display device (1) of Fig. 1 in a state extended in the first and second directions. Fig. 2e is a perspective view illustrating the display device (1) of Fig. 1 in a state extended in a third direction.

[0062] Referring to FIG. 1, a display device (1) may be a stretchable display device that can be expanded or contracted in various directions without damage to the display device (1). The display device (1) may include a display area (DA) and a non-display area (NDA). The display area (DA) may include a plurality of pixels. The display device (1) may provide a predetermined image using light emitted from the plurality of pixels. The non-display area (NDA) may be arranged outside the display area (DA) (e.g., at the periphery or outside the footprint). The non-display area (NDA) may entirely surround the display area (DA).

[0063] The display device (1) can be stretched in a first direction (e.g., the x direction and / or the -x direction) by an external force applied by an external object or a user without damaging the display device (1). In some embodiments, as illustrated in FIGS. 2A and 2B, the display area (DA) and / or the non-display area (NDA) of the display device (1) can be stretched in the first direction (e.g., the x direction and / or the -x direction). For example, as illustrated in FIG. 2A, the display device (1) can be stretched along the x direction and the -x direction, or can be stretched in the x direction or the -x direction while one side of the display device (1) is fixed. FIG. 2B illustrates an example in which the display device (1) is stretched along the x direction while one side is fixed.

[0064] The display device (1) can be stretched in a second direction (e.g., in the y direction and / or the -y direction) by an external force applied by an external object or a user without damaging the display device (1). In some embodiments, as illustrated in FIG. 2C, the display area (DA) and / or the non-display area (NDA) of the display device (1) can be stretched in the y direction and the -y direction. In some embodiments, the display device (1) can be stretched in the y direction or the -y direction while one side of the display device (1) is fixed.

[0065] The display device (1) can be extended in a plurality of directions, for example, a first direction (e.g., the x direction and / or the -x direction) and a second direction (e.g., the y direction and / or the -y direction) by an external force applied by an external object or a part of a human body. As illustrated in Fig. 2d, the display area (DA) and / or the non-display area (NDA) of the display device (1) can be extended in the ±x direction and the ±y direction.

[0066] The display device (1) may be elongated in a third direction (e.g., the z direction or the -z direction) by an external force applied by an external object or a part of a human body. In some embodiments, FIG. 2e illustrates that a part of the display device (1), for example, a part of the display area (DA), protrudes in the z direction. In some embodiments, a part of the display device (1), for example, a part of the display area (DA), may protrude along the -z direction (or recess along the z direction).

[0067] Although FIGS. 2A to 2E illustrate the display device (1) extending in the first, second, and / or third directions, embodiments according to the present invention are not limited thereto. In some embodiments, the display device (1) may be variously deformed into an irregular shape, such as being bent or twisted along two or more axes.

[0068] FIG. 3 is a perspective view schematically illustrating an embodiment of a vehicle electronic device including a stretchable display device according to some embodiments.

[0069] As illustrated in FIG. 3, the dashboard in a vehicle may include a center fascia (10), a cluster (instrument panel) (20) on the driver's seat, and / or a board (30) on the passenger's seat. Since the display device (1) according to some embodiments can extend in various directions, it may be used in at least one of the center fascia (10), the cluster (20), or the board (30) on the passenger's seat, regardless of the shape of the internal frame of the vehicle. The configuration of the vehicle interior and the dashboard illustrated in FIG. 3 is exemplary, and the configuration of the vehicle interior is not limited thereto.

[0070] In some embodiments, the display device (1) may be applied to a vehicle display device (3) as a vehicle electronic device. The vehicle display device (3) may be a CID (Center Information Display) implemented in a center fascia (10). The center fascia (10) is a central area of ​​the dashboard that separates the interior of the vehicle from the engine compartment. The vehicle display device (3) may be a display device that can display and control the operating status of various devices in the vehicle, such as the vehicle's AVN (Audio, Video, Navigation), air conditioner, and heater. The vehicle display device (3) may display digital multimedia broadcasting (DMB) and moving images, such as movies.

[0071] Although FIG. 3 illustrates that the center fascia (10), the cluster (20), and the passenger seat board (30) are each separated, embodiments of the present invention are not limited thereto. In some embodiments, two or more selected from the cluster (20), the center fascia (10), and the passenger seat board (30) may be integrally connected. For example, the vehicle display device (3) may extend from the center fascia (10) to the driver's seat cluster (20) and / or the passenger seat board (30) and be integrally formed with the cluster (20) and / or the passenger seat board (30).

[0072] Fig. 4 is a cross-sectional view schematically illustrating a vehicle display device (3) according to some embodiments. Fig. 5 is a schematic view schematically illustrating a vehicle display device (3) according to some embodiments. Fig. 6 is a schematic view schematically illustrating a display layer (DPL) according to some embodiments.

[0073] Referring to Fig. 4, a vehicle display device (3) may include a display panel (DP) and a mechanism (SSL) under the display panel (DP). The display panel (DP) may include a display layer (DPL), an encapsulation layer (ENL), and a touch input layer (TSL). The display panel (DP) may be a stretchable display panel. To ensure the elasticity of the display panel (DP), the display layer (DPL), the encapsulation layer (ENL), and the touch input layer (TSL) may be formed of an elastic material. A display area (DA) and a non-display area (NDA) corresponding to the display area (DA) and the non-display area (NDA) of the display device (1) may be defined in the display panel (DP).

[0074] A plurality of pixels may be arranged on a display layer (DPL). The display layer (DPL) includes a substrate (100) as illustrated in FIG. 6, and a plurality of pixels (PX) may be arranged in a display area (DA) of the substrate (100). In some embodiments, a pixel (PX) may include a plurality of sub-pixels that emit different light.

[0075] The plurality of sub-pixels may include a first sub-pixel (PX1) emitting light in a first color, a second sub-pixel (PX2) emitting light in a second color, and a third sub-pixel (PX3) emitting light in a third color. For example, the first sub-pixel (PX1) may be a red pixel, the second sub-pixel (PX2) may be a green pixel, and the third sub-pixel (PX3) may be a blue pixel. The first sub-pixel (PX1), the second sub-pixel (PX2), and the third sub-pixel (PX3) may each include a pixel circuit and a light-emitting element (display element) electrically connected to the pixel circuit. The pixel circuit may include a plurality of transistors and at least one capacitor, and may be a pixel driver circuit that controls driving of the light-emitting element.

[0076] A pixel (PX) can be the smallest repeating unit of subpixels having a predetermined arrangement. Multiple subpixels can be arranged in a stripe arrangement, pentile arrangement, etc. ® An image can be implemented by arranging in one of various forms, such as an array, a diamond array, or a mosaic array. In some embodiments, a pixel or subpixel refers to a light-emitting element, and the arrangement structure of a subpixel can be understood as the arrangement structure of the light-emitting element. Hereinafter, the arrangement structure of a subpixel refers to the arrangement structure of the light-emitting element, and the light emission of a pixel or subpixel can refer to the light emission of the light-emitting element.

[0077] A plurality of gate lines (GL) and a plurality of data lines (DL) may be arranged in a display area (DA) of a substrate (100). Each sub-pixel may be connected to at least one corresponding gate line (GL) among the plurality of gate lines (GL) and to a corresponding data line (DL) among the plurality of data lines (DL).

[0078] The gate lines (GL) can each extend in the x-direction (row direction) and be connected to pixels (PX) located in the same row. The gate lines (GL) can each transmit a gate signal to the pixels (PX) in the same row. The data lines (DL) can each extend in the y-direction (column direction) and be connected to sub-pixels located in the same column. The data lines (DL) can each transmit a data signal to each of the sub-pixels in the same column in synchronization with the gate signal.

[0079] In FIG. 6, a pixel (PX) is illustrated as being connected to one gate line (GL), but this is exemplary, and a pixel (PX) may be connected to two or more gate lines (GL).

[0080] The encapsulation layer (ENL) can be disposed on the light emitting element and can be disposed to cover the display area (DA) and the non-display area (NDA).

[0081] In some embodiments, the encapsulation layer (ENL) may be a thin film encapsulation layer including an inorganic encapsulation layer and / or an organic encapsulation layer. In some embodiments, the encapsulation layer (ENL) may include a structure in which an inorganic encapsulation layer including an inorganic insulating material, an organic encapsulation layer including an organic insulating material, and an inorganic encapsulation layer including an inorganic insulating material are laminated. In some embodiments, the encapsulation layer (ENL) may include an organic material such as a resin, and may be a single layer including the aforementioned organic material. In some embodiments, the encapsulation layer (ENL) may include a urethane epoxy acrylate. The encapsulation layer (ENL) may include a photosensitive material, such as a photoresist.

[0082] In some embodiments, the encapsulation layer (ENL) may be a sealing substrate. The sealing substrate may be positioned so as to face the substrate on which the pixels are arranged with the light-emitting elements interposed therebetween. A gap may exist between the sealing substrate and the light-emitting elements.

[0083] A touch input layer (TSL) may be disposed on an encapsulation layer (ENL). The touch input layer (TSL) may include a touch sensor (TS, FIG. 5). In some embodiments, the touch sensor (TS) may be at least one of a capacitive touch sensor, a resistive touch sensor, an acoustic wave touch sensor, an infrared touch sensor, or a pressure touch sensor. In some embodiments, the touch sensor (TS) may be formed directly on the encapsulation layer (ENL), in which case an adhesive layer such as an optically clear adhesive (OCA) may not be interposed between the touch sensor (TS) and the encapsulation layer (ENL). In some embodiments, the touch sensor (TS) may be formed separately on a touch substrate and then bonded to the encapsulation layer (ENL) via an adhesive layer such as an optically clear adhesive (OCA). The display panel (DP) may be configured as a display panel integrated with a touch panel, and may be used as an output device and / or an input device.

[0084] The mechanism (SSL) may be disposed under the display panel (DP). The mechanism (SSL) may be disposed under the substrate (100, FIG. 6) of the display layer (DPL). The mechanism (SSL) may include at least one stretching structure (SS, FIG. 5) that moves in a direction perpendicular to the rear surface of the display panel (DP). The stretching structure (SS) may linearly move in a direction toward the rear surface of the display panel (DP) (hereinafter, “projection direction”) and in a direction away from the rear surface (hereinafter, “return direction”).

[0085] As illustrated in Fig. 5, the vehicle display device (3) may include a display driver (DDC) for controlling pixels (PX) of a display area (DA), a touch driver (TDC) for controlling a touch sensor (TS), a structure driver (SDC) for controlling a stretching structure (SS), a camera (CAM), and a processor (PRC). The vehicle display device (3) may further include a feedback system (FS).

[0086] A display driver (DDC) can drive pixels (PX) of a display area (DA) under the control of a processor (PRC). A plurality of pixels (PX) can display image signals received from the display driver (DDC). The display driver (DDC) can include a gate driver (112), a data driver (114), and a controller (116).

[0087] The gate driver (112) is connected to a plurality of gate lines (GL), and can generate a gate signal in response to a gate control signal (GCS) from the controller (116) and sequentially supply the gate signal to the gate lines (GL). Although Fig. 6 illustrates two gate drivers (112) facing each other arranged in a non-display area (NDA), embodiments of the present invention are not limited thereto. In some embodiments, one gate driver (112) may be arranged on one side of the non-display area (NDA).

[0088] The data driver (114) is connected to a plurality of data lines (DL) and can supply a data signal to the data lines (DL) in response to a data control signal (DCS) from the controller (116). The data signal supplied to the data line (DL) can be supplied to a sub-pixel to which a gate signal is supplied. The data driver (114) can convert image data or corrected image data having a grayscale input from the controller (116) into a data signal in the form of a voltage or current.

[0089] The controller (116) may include an interface conversion circuit and a timing controller. The controller (116) may receive an image signal from the processor (PRC), convert the data format of the image signal to match the interface specifications of the vehicle display device (3), and output the image data. The controller (116) may generate control signals (GCS, DCS) based on signals input from an external source (e.g., the processor (PRC)) and supply the control signals to the gate driver (112) and the data driver (114). The gate control signal (GCS) output to the gate driver (112) may include a plurality of clock signals and a gate start signal. The data control signal (DCS) output to the data driver (114) may include a plurality of clock signals and a data start signal.

[0090] In some embodiments, the display driver (DDC) may be provided in the non-display area (NDA) of the substrate (100). The gate driver (112), data driver (114), and controller (116) of the display driver (DDC) may be formed in the form of separate integrated circuit chips or a single integrated circuit chip and may be placed on a flexible printed circuit board (FPCB) electrically connected to a pad placed on one side of the substrate (100).

[0091] In some embodiments, part or all of the gate driver (112) may be formed directly in the non-display area (NDA) of the substrate (100) during the process of forming transistors constituting the pixel circuit in the display area (DA). The data driver (114) and the controller (116) may be formed in the form of separate integrated circuit chips or a single integrated circuit chip and placed on an FPCB connected to one side of the substrate (100). In some embodiments, the data driver (114) and the controller (116) may be placed directly on the substrate (100) in a COP (Chip On Plastic) manner.

[0092] The touch driver (TDC) can detect a characteristic change (e.g., a capacitance change, a resistance change, an ultrasonic change, an infrared change, or a light change) for a specific position of the touch sensor (TS) and transmit the same to the processor (PRC). The touch driver (TDC) can receive a voltage or current corresponding to the characteristic change from the touch sensor (TS) and transmit the characteristic change for each position calculated based on the voltage or current as touch detection data to the processor (PRC). The touch driver (TDC) can determine whether there is a touch and the touch position from the touch detection data. For this purpose, the touch driver (TDC) may include a microprocessor (MPU) or a microcontroller (MCU).

[0093] The structure driver (SDC) can control the movement of the stretching structure (SS) in response to a control signal from the processor (PRC). The structure driver (SDC) can apply an external force to the display panel (DP) by moving the stretching structure (SS) in a protruding direction, and a part of the display panel (DP) can be stretched and protruded in a direction perpendicular to the substrate (100). The structure driver (SDC) can remove the external force applied to the display panel (DP) by moving the stretching structure (SS) in a returning direction, and the stretched display panel (DP) can be contracted and restored to a flat state before being stretched.

[0094] The camera (CAM) can capture still images and moving images. In some embodiments, at least one camera (CAM) may be disposed above the display panel (DP). In some embodiments, at least one camera (CAM) may be disposed below the display panel (DP). The camera (CAM) may include an image sensor. The image sensor may include a photoelectric conversion element such as a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The camera (CAM) may output an electrical signal of the image sensor to a processor (PRC). A color filter and a lens that receive an optical signal may be provided in front of the image sensor. In some embodiments, a plurality of cameras (CAM) may be distributedly disposed at positions capable of detecting a part of the body (e.g., a hand or a finger) of a user (driver) in the driver's seat and at positions capable of detecting a part of the body of a user (passenger) in the passenger seat.

[0095] In some embodiments, the camera (CAM) may be replaced with a proximity sensor, or both a camera (CAM) and a proximity sensor may be provided. A proximity sensor is a sensor that detects the presence of an object approaching the detection surface or an object present nearby without mechanical contact using the force of an electromagnetic field or infrared rays.

[0096] A feedback system (FS) can provide feedback to the driver in the form of various tactile effects and / or audio signals that the driver can feel when an event occurs in which the driver approaches a vehicle display device (3). The feedback system (FS) can include a haptic feedback generating device (312) and / or an audio output device (314).

[0097] The haptic feedback generating device (312) may include an actuator that is driven to generate haptic feedback. The haptic feedback generating device (312) may receive a driving control signal for driving the actuator from the processor (PRC) and output haptic feedback. The haptic feedback may be provided to the user in the form of vibration, tactile sensation, or heat of the vehicle display device (3). In some embodiments, the actuator is linked to the mechanism (SSL), and the stretching structure (SS) may be moved by the actuator.

[0098] The audio output device (314) is a device for outputting audio signals, and may include, for example, a speaker used for general purposes such as multimedia playback or recording playback, and a receiver used exclusively for phone reception. In some embodiments, the receiver may be formed integrally with or separately from the speaker. The audio output device (314) may receive a feedback control signal from the processor (PRC) and output feedback as an audio signal.

[0099] The processor (PRC) may include one or more of a central processing unit (CPU) or an application processor (AP). The processor (PRC) may further include one or more of a graphic processing unit (GPU), a communication processor (CP), and an image signal processor (ISP). The processor (PRC) may further include a neural processing unit (NPU). The neural processing unit is a processor specialized in processing artificial intelligence models, and the artificial intelligence models can be generated through machine learning. The artificial intelligence models may include multiple artificial neural network layers. The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware architecture, the AI ​​model may additionally or alternatively include a software architecture. The processor (PRC) may be implemented as a single integrated configuration (e.g., a single chip) of at least two of the aforementioned processing units and processors, or each of the aforementioned processing units and processors may be implemented as independent configurations (e.g., multiple chips). The processor (PRC) may be implemented as a graphics card, a system-on-chip (SOC), or the like.

[0100] The processor (PRC) can control the overall operation of the vehicle display device (3).

[0101] The processor (PRC) can detect an object approaching and / or touching the vehicle display device (3) by processing an image signal from a camera (CAM). The processor (PRC) can identify the user by determining whether the detected object is a user on the driver's side or a passenger on the passenger's side. In some embodiments, the processor (PRC) can identify the user based on the position and / or movement direction of the object detected from sequentially input image signals. The method for user identification is not particularly limited, and various methods for identifying the driver and passenger can be applied.

[0102] The processor (PRC) can determine the control mode of the vehicle display device (3). The control mode can include a driver's seat control mode when the identified user is a driver and a passenger's seat control mode when the identified user is a passenger. The driver's seat control mode can be a feedback-on mode that provides feedback on the performance result of a function corresponding to the driver's touch input. The passenger's seat control mode can be a feedback-off mode that does not provide feedback on the performance result of a function corresponding to the passenger's touch input. By providing feedback in the driver's seat control mode, the driver can control the function without directly looking at the vehicle display device (3), thereby reducing the risk of an accident. By not providing feedback in the passenger's seat control mode, the power consumption of the vehicle display device (3) can be reduced.

[0103] The processor (PRC) can generate a driving control signal and output it to the structure driver (SDC) in each of the driver's seat control mode and the passenger's seat control mode. In some embodiments, the processor (PRC) can output image data to be displayed on the protruding area (hereinafter, "protruding area") of the display panel (DP) by the stretching structure (SS) to the display driver (DDC).

[0104] The processor (PRC) can generate a feedback control signal in driver control mode and output it to the feedback system (FS).

[0105] The processor (PRC) can output an operation control signal to activate a function (e.g., volume control, temperature control, radio frequency control, etc.) corresponding to a user's touch input in each of the driver's seat control mode and the passenger seat control mode to a device (e.g., audio output device, air conditioner / heater, radio, etc.) that performs the corresponding function.

[0106] The vehicle display device (3) may further include at least one sensor. The sensor may include a sensor that detects the vehicle's indoor and outdoor environment (humidity, wind, etc.), a fingerprint sensor, etc. In some embodiments, the processor (PRC) may additionally use fingerprint detection information from the fingerprint sensor in a process of identifying a user based on an image signal from a camera (CAM). Fingerprint information of the driver and / or passenger may be registered in advance in the vehicle display device (3).

[0107] FIGS. 7A to 8B are schematic drawings illustrating deformations of a stretching structure (SS) and a display panel (DP) according to some embodiments. FIG. 9 is a schematic drawing illustrating a cross-section and a planar protrusion area of ​​a stretching structure (SS) and a display panel (DP) taken along line I-I' of FIG. 8B.

[0108] The stretching structure (SS) may include at least one pin (PN). In one embodiment, the pin (PN) may have a cylindrical shape. A portion of the pin (PN) facing the display panel (DP) may have a three-dimensionally rounded surface, such as a flat surface or a hemispherical surface. The pin (PN) may move vertically in a protruding direction (①) and a returning direction (②) with respect to the back surface of the display panel (DP). The pin (PN) may move vertically by a physical moving means, such as an actuator.

[0109] Before the pin (PN) moves (i.e., before the display panel (DP) protrudes), the upper surface of the pin (PN) may be spaced apart from the display panel (DP) by a predetermined gap, or may be in contact with the back surface of the display panel (DP). By the movement of the pin (PN) in the protruding direction (①), a protruding area (PDA) of a predetermined height may be defined in the display area (DA) of the display panel (DP). The protruding area (PDA) may include a central area (CA) having the highest protruding height from the non-protruding surface of the display panel (DP) and a peripheral area (PA) surrounding the central area (CA). The central area (CA) may include a vertex of the protruding area (PDA). The peripheral area (PA) may be an inclined surface whose protruding height gradually decreases as it moves away from the central area (CA) in all directions. FIG. 7a illustrates an example in which the planar central area (CA) and the peripheral area (PA) surrounding the central area (CA) are circular. Embodiments according to the present invention are not limited thereto, and the shape of the planar protruding area (PDA), the central area (CA), and the peripheral area (PA) may be in various shapes, such as a square, a polygon, or an oval.

[0110] In some embodiments, the stretching structure (SS) may include one or more pins (PN) spaced apart at a predetermined interval as illustrated in FIG. 7A, or as illustrated in FIG. 7B, where one pin (PN) may correspond to one protruding area (PDA). As the pin (PN) moves in the protruding direction, the protruding area (PDA) of the display panel (DP) may extend and protrude in the protruding direction. FIG. 7B illustrates a stretching structure (SS) including three pins (PN) and three protruding areas (PDAs) corresponding to the positions of the three pins (PN).

[0111] In some embodiments, the stretching structure (SS) may be an embossed structure in which a plurality of pins (PN) are arranged, as illustrated in FIGS. 8A and 8B . As illustrated in FIG. 8B , a plurality of pins (PN) may correspond to one protruding area (PDA). As the pins (PN) arranged in the protruding area (PDA) move in the protruding direction, the protruding area (PDA) of the display panel (DP) may be elongated and protruded in the protruding direction.

[0112] The pins (PN) arranged in the protruding area (PDA) may include a central pin (PN1) and peripheral pins (PN2, PN3, PN4) whose protruding heights (movement distances) become shorter as they get farther away from the central pin (PN1). Among the pins (PN) arranged in the protruding area (PDA), the protruding height (movement distance) of the central pin (PN1) may be the longest, and the pins (PN2, PN3, PN4) around the central pin (PN1) may have protruding heights (movement distances) that become shorter as they get farther away from the central pin (PN1). Accordingly, the protruding area (PDA) may have a shape having an inclined surface. In Fig. 8b, some of the pins (PN1, PN2, PN3, PN4) of the protruding area (PDA) are separately indicated for convenience of understanding.

[0113] The central area (CA) of the protruding area (PDA) may include at least an area corresponding to the position of the central pin (PN1). In some embodiments, as illustrated in FIG. 9, the central area (CA) may correspond to the positions of the central pin (PN1) and the peripheral pins (PN2) closest to the central pin (PN1), and the peripheral area (PA) may correspond to the positions of the remaining peripheral pins (PN3, PN4). The range (number) of pins corresponding to the central area (CA) and the peripheral area (PA) may vary depending on the pin arrangement shape, pin arrangement spacing, pin structure (thickness of pins, shape of pins, etc.).

[0114] Figures 10a to 11c are schematic drawings illustrating camera arrangements according to some embodiments. At least one camera (CAM) may be integrally provided in a vehicle display device (3).

[0115] As illustrated in FIGS. 10A to 10C, at least one camera (CAM) may be positioned on the upper portion of the display panel (DP). At least one camera (CAM) may be positioned to correspond to a non-display area (NDA) of the display panel (DP). FIG. 10A is an example in which at least one camera (CAM) is positioned to correspond to the upper non-display area (NDA), FIG. 10B is an example in which at least one camera (CAM) is positioned to correspond to the lower non-display area (NDA), and FIG. 10C is an example in which at least one camera (CAM) is positioned to correspond to the left and right non-display areas (NDAs). Embodiments according to the present invention are not limited thereto, and at least one camera (CAM) may be appropriately distributed and positioned in the non-display area (NDA) at an optimal position for detecting the driver and the passenger.

[0116] At least one camera (CAM) may be disposed under the display panel (DP). As illustrated in FIGS. 11A to 11C , at least one camera (CAM) may be disposed in the display area (DA) of the display panel (DP). FIGS. 11B and 11C illustrate the area (A) of FIG. 11A . Alternatively, at least one camera (CAM) may be disposed in the display area (DA) and the non-display area (NDA). In some embodiments, at least one camera (CAM) may be disposed under the substrate (100) of the display panel (DP).

[0117] The display area (DA) may include first areas (11) and a second area (12) between the first areas (11). A plurality of sub-pixels constituting a pixel (PX) may be arranged in the first area (11). The second area (12) may be a transparent area. Signal lines (e.g., gate lines, data lines, voltage lines, etc.) that provide signals to the pixels (PX) arranged in the first areas (11) may be arranged in the second area (12). In the second area (12), a portion of at least one inorganic insulating layer and at least one organic insulating layer of the display panel (DP) may be removed.

[0118] In some embodiments, as illustrated in FIG. 11b, the subpixels may be arranged in a stripe structure in the display area (DA), and a pixel (PX) may include one first subpixel (PX1), one second subpixel (PX2), and one third subpixel (PX3). In some embodiments, as illustrated in FIG. 11c, the subpixels may be arranged in a pentile structure in the display area (DA). ® The structure can be arranged in a manner that a pixel (PX) can include one first subpixel (PX1), two second subpixels (PX2), and one third subpixel (PX3).

[0119] As illustrated in FIGS. 11b and 11c, at least one camera (CAM) may be arranged corresponding to the second region (12) so as not to overlap with sub-pixels. At least one camera (CAM) may not overlap with the light-emitting element and pixel circuit of the sub-pixel. At least one camera (CAM) may not overlap with the signal line of the second region (12).

[0120] FIGS. 12 and 13 are schematic drawings illustrating a touch on a protruding area (PDA) of a display panel (DP) for function control according to one embodiment.

[0121] Referring to FIG. 12, a user can control a specific function by touching and / or dragging the protruding area (PDA) of the display panel (DP). The user can select on or off the function by touching the central area (CA). After the function is turned on, the user can adjust the height of the function by dragging the peripheral area (PA) up and down. Here, "touch" means a state in which the user's finger or a stylus pen is in contact with the display panel (DP). And, "drag" means an action of moving the touch point while maintaining the touch on the display panel (DP). For example, the user can adjust the height of the function by sliding up and down in the direction of the arrow while touching a part of the peripheral area (PA). In some embodiments, the functions may be multiple, such as volume control, temperature control, and radio frequency control, and at least one protruding area (PDA) may be provided corresponding to the multiple functions.

[0122] For example, as illustrated in Fig. 13, a first protruding area (PDA1) and a second protruding area (PDA2) may be protruded on the display panel (DP). The first protruding area (PDA1) may function as a user interface for a temperature control function, and the second protruding area (PDA2) may function as a user interface for a volume control function and a radio frequency control function.

[0123] The heater and air conditioner can be turned on / off by the user touching the central area (CA) of the first protruding area (PDA1). The heater temperature can be increased and decreased (Htem+ and Htem-) by the user dragging the left peripheral area (PA) up and down. The air conditioner temperature can be increased and decreased (Ctem+ and Ctem-) by the user dragging the right peripheral area (PA) up and down.

[0124] The volume can be turned on / off and the radio can be turned on / off by the user touching the central area (CA) of the second protruding area (PDA2). The volume can be increased and decreased (Volume+ and Volume-) by the user dragging up and down the left peripheral area (PA). The radio frequency can be increased and decreased (Frequency+ and Frequency-) by the user dragging up and down the right peripheral area (PA).

[0125] In some embodiments, a menu icon (MN) may be provided on each protruding area (PDA) before and / or after the display panel (DP) protrudes. FIG. 13 exemplarily illustrates a first menu icon (MN1) corresponding to a first protruding area (PDA1) and a second menu icon (MN2) corresponding to a second protruding area (PDA2). The first menu icon (MN1) may be a user interface for a temperature control function, and the second menu icon (MN2) may be a user interface for a volume control function and a radio frequency control function.

[0126] The menu icon (MN) may include a switch menu (SM) for selecting on / off of a function and a control menu (CM) for controlling the height of the function. The control menu (CM) may have a shape surrounding the switch menu (SM). The switch menu (SM) may correspond to the central area (CA) of the protruding area (PDA), and the control menu (CM) may correspond to the peripheral area (PA) of the protruding area (PDA). By providing the menu icon (MN), the user can easily recognize the location to touch for controlling a specific function. The processor (PRC) may determine a touch of the central area (CA) of the protruding area (PDA) and a touch of the switch menu (SM) of the menu icon (MN) as input signals for performing the same function, and may determine a drag of the peripheral area (PA) of the protruding area (PDA) and a drag of the control menu (CM) of the menu icon (MN) as input signals for performing the same function.

[0127] The user interface of the menu icon (MN) illustrated in Fig. 13 is exemplary, and various types of user interfaces may be provided for user convenience. The provision of the menu icon (MN) is optional, and the menu icon (MN) may not be provided on the display panel (DP) due to power consumption considerations.

[0128] FIG. 14 is a diagram illustrating the operation of a feedback system according to some embodiments.

[0129] In some embodiments, the vehicle display device (3) may be configured to provide haptic feedback and / or audio feedback in response to a touch input in a certain area of ​​the protruding area (PDA) of the display panel (DP). For example, as illustrated in FIG. 14, the vehicle display device (3) may provide haptic feedback and / or audio feedback when a touch input is detected in an area (H) between the center of the protruding area (PDA) of the display panel (DP) and a position at a certain height from the non-protruding surface of the display panel (DP).

[0130] In some embodiments, haptic feedback and / or audio feedback may be controlled based on the height control of the function. For example, when a drag from the bottom to the top of the peripheral area (PA) of the protruding area (PDA) for volume control is detected, vibration may be increased and / or a voice prompt "volume up" may be output. The user can recognize whether the desired volume control function is being properly controlled without having to look at the vehicle display device (3) through the feedback. If the feedback determines that the desired control is not being performed, the user can touch again and receive feedback.

[0131] Fig. 15 is a schematic diagram illustrating aspects of a method for controlling a vehicle display device (3) according to some embodiments. While Fig. 15 illustrates various operations of the method for controlling a vehicle display device, embodiments according to the present invention are not limited thereto, and, without departing from the spirit and scope of the embodiments according to the present invention, unless otherwise specified or suggested, according to various embodiments, the method may include additional or fewer operations, and the order of the operations may vary.

[0132] Fig. 15 is a control method performed by a processor (PRC) of a vehicle display device (3). In the following, a detailed description of the same content as that described with reference to Figs. 1 to 14 is omitted.

[0133] When a touch event of the display panel (DP) is detected (S50), the processor (PRC) can identify the user touching the display panel (DP) based on the image signal input from the camera (CAM) and determine the control mode according to the identified user (S60).

[0134] A touch event may include a direct touch of the display panel (DP) by a user, or a case where a part of the user's body approaches the display panel (DP) within a predetermined distance for a touch. A touch event may be detected based on a touch input of a touch sensor (TS), or may be detected based on an image signal acquired by a camera (CAM). In some embodiments, if the display panel (DP) includes a proximity sensor, a touch event may be detected based on detection data of the proximity sensor.

[0135] In some embodiments, the camera (CAM) may periodically acquire image signals while the vehicle is in operation (driving and stopping) and provide them to the processor (PRC). In some embodiments, when an object is detected in the camera (CAM) standby mode, the camera (CAM) may switch to wake-up mode and thereafter periodically acquire image signals and provide them to the processor (PRC).

[0136] The processor (PRC) processes the image signal from the camera (CAM) to extract users and identify them. If the extracted user is identified as a driver, the processor (PRC) switches to driver control mode. If the extracted user is identified as a passenger, the processor (PRC) switches to passenger control mode.

[0137] In some embodiments, the processor (PRC) can verify the identified user by comparing fingerprint detection information from the fingerprint sensor with a previously registered user fingerprint.

[0138] In the driver's seat control mode, the processor (PRC) can generate a driving control signal for driving the mechanism (SSL) and output it to the structure driver (SDC) (S71).

[0139] In some embodiments, the processor (PRC) may generate a display control signal for providing a menu icon (MN) and output it to the display driver (DDC) prior to detecting a touch event and / or concurrently or subsequent to outputting a drive control signal. The processor (PRC) may output image data corresponding to at least one menu icon (MN) to the display driver (DDC).

[0140] The structure driver (SDC) can initiate the driving of the stretching structure (SS) in response to the driving control signal and control the movement of the stretching structure (SS). The stretching structure (SS) (at least one pin (PN)) located in at least one preset protruding area (PDA) of the display panel (DP) can move by a preset distance. The protruding area (PDA) of the display panel (DP) can be stretched and protruded by the operation of the stretching structure (SS).

[0141] Optionally, the display driver (DDC) can provide image data to at least one projection area (PDA) in response to a display control signal, thereby causing the display panel (DP) to display a menu icon (MN).

[0142] The processor (PRC) can generate and output an operation control signal and a feedback control signal for performing a function corresponding to a touch signal input from a touch driver (TDC) (S73).

[0143] The processor (PRC) can receive a touch signal including whether a touch has occurred and a touch location from the touch driver (TDC). The processor (PRC) can determine a touch type from the touch signal and determine a function corresponding to the touch signal based on the touch location and touch type. The touch type can include touch and drag. The processor (PRC) can output an operation control signal for turning on / off a function assigned to a touched protruding area (PDA) and controlling the height of the function to a device that performs the function.

[0144] The processor (PRC) can generate a feedback control signal for a feedback output set for performing a function and output it to the feedback system (FS). The feedback system (FS) can output haptic feedback and / or audio feedback according to the feedback control signal.

[0145] The processor (PRC) can generate and output a control mode termination signal when no touch event is detected for a certain period of time (S80). The processor (PRC) can generate and output a control mode termination signal to the structure driver (SDC) and the display driver (DDC) when no user is detected for a certain period of time in the video signal from the camera (CAM) and / or when there is no touch input from the touch sensor (TS) for a certain period of time. The structure driver (SDC) controls the movement of the stretching structure (SS) in response to the control mode termination signal, and the display panel (DP) can be restored to a flat state. The display driver (DDC) does not provide video data to the display panel (DP) in response to the control mode termination signal, so that the menu icon (MN) may not be displayed on the display panel (DP).

[0146] The operation of the processor (PRC) in the passenger seat control mode differs from the driver seat control mode in that no feedback is provided to the user. Since the other operations are the same as the driver seat control mode, a detailed description is omitted.

[0147] In the passenger seat control mode, the processor (PRC) can generate a driving control signal and output it to the structure driver (SDC) (S75), and the structure driver (SDC) controls the movement of the stretching structure (SS) in response to the driving control signal, and at least one protruding area (PDA) of the display panel (DP) can be protruded by the operation of the stretching structure (SS).

[0148] In some embodiments, the processor (PRC) may output image data and display control signals to the display driver (DDC) prior to detecting a touch event and / or concurrently or subsequent to outputting the drive control signal, so that a menu icon (MN) may be displayed on at least one protruding area (PDA).

[0149] The processor (PRC) can generate and output an operation control signal for performing a function corresponding to a touch signal input from a touch driver (TDC) (S77). The processor (PRC) can determine a function corresponding to the touch signal based on the touch location and touch type, and output an operation control signal for turning on / off and controlling the height of the function assigned to the touched protruding area (PDA) to a device performing the function.

[0150] The processor (PRC) can generate and output a control mode termination signal when no touch event is detected for a certain period of time (S80). The structure driver (SDC) controls the movement of the stretching structure (SS) in response to the control mode termination signal, and the display panel (DP) can be restored to a flat state. The display driver (DDC) does not provide image data to the display panel (DP) in response to the control mode termination signal, so that the menu icon (MN) may not be displayed on the display panel (DP).

[0151] Fig. 16 is a schematic diagram illustrating a method for controlling a vehicle display device according to some embodiments. While Fig. 16 illustrates various operations of the method for controlling a vehicle display device, embodiments according to the present invention are not limited thereto, and, without departing from the spirit and scope of the embodiments according to the present invention, unless otherwise specified or suggested, according to various embodiments, the method may include additional or fewer operations, and the order of the operations may vary.

[0152] Fig. 17 is a schematic diagram illustrating a deformation of a stretching structure (SS) according to some embodiments. Fig. 18 is a schematic diagram illustrating a deformation of a display panel (DP) according to some embodiments.

[0153] Fig. 16 is an example in which the passenger seat control mode includes a function control mode and an image playback mode by the processor (PRC) of the vehicle display device (3). Hereinafter, a description of the operation of the driver seat control mode is omitted.

[0154] Referring to Fig. 16, as illustrated in Fig. 15, when the control mode is determined to be the passenger seat control mode (S60), the processor (PRC) can generate a driving control signal for driving the mechanism (SSL) and output it to the structure driver (SDC) (S75). Under the control of the structure driver (SDC), the stretching structure (SS) can move, and at least one protruding area (PDA) of the display panel (DP) can protrude.

[0155] The protruding area (PDA) may include at least one protruding area for function control and a protruding area for entertainment playback. The protruding area for entertainment playback may be a user interface for selecting video, such as digital multimedia broadcasting (DMB) and movies.

[0156] In some embodiments, the processor (PRC) may generate a display control signal for providing a menu icon and output it to the display driver (DDC) prior to detecting a touch event and / or concurrently or subsequent to outputting a drive control signal. The processor (PRC) may output image data corresponding to at least one menu icon to the display driver (DDC). The menu icon corresponding to each protruding area (PDA) may include a control function menu icon and an entertainment menu icon. The entertainment menu icon may be a user interface for selecting a moving picture such as a digital multimedia broadcasting (DMB) and a movie.

[0157] The processor (PRC) receives a touch signal corresponding to a touch input of a protruding area (PDA) from a touch driver (TDC) and can determine a function control mode or an image playback mode (S76).

[0158] In the function control mode, the processor (PRC) can generate an operation control signal for performing a function corresponding to a touch signal and output it to a device performing the function, as described with reference to FIG. 15 (S77). The processor (PRC) can generate a control mode termination signal when no touch event is detected for a certain period of time and output it to the structure driver (SDC) and the display driver (DDC) (S80).

[0159] In the video playback mode, the processor (PRC) can generate a driving control signal set to the video playback mode and output it to the structure driver (SDC) (S91). Under the control of the structure driver (SDC), as illustrated in FIG. 17, with respect to the reference pin (PNr) having the longest protrusion height (movement distance) in the stretching structure (SS), the reference pin (PNr), the pins (PNd) on the driver's side, and the pins (PNp) on the passenger's side can each move in the protrusion direction (①) with respect to the back surface of the display panel (DP) by a preset distance.

[0160] As illustrated in Fig. 18, the display panel (DP) on the upper portion of the stretching structure (SS) can be stretched in the protruding direction (①) by the movement distance of the pins (PN), and can provide a driver's seat display area (S1) inclined toward the driver's seat and a passenger's seat display area (S2) inclined toward the passenger's seat, with the area corresponding to the position of the reference pin (PNr) as the boundary. The passenger's seat display area (S2) can have a larger area than the driver's seat display area (S1). The inclination of the passenger's seat display area (S2) can be smaller than the inclination of the driver's seat display area (S1).

[0161] The processor (PRC) can provide a menu for video playback in the passenger seat display area (S2) (S92), and can receive a touch signal corresponding to selection of the video playback menu from the touch driver (TDC) (S93).

[0162] The processor (PRC) can provide an image according to a selected menu based on a touch signal to the passenger display area (S2) (S94). While the image is provided to the passenger display area (S2), the driver display area (S1) may have its display function turned off, or at least one piece of information other than the image may be provided to the driver display area (S1). For example, as illustrated in FIG. 15, when a touch event is detected (S50), the processor (PRC) identifies a user based on an image signal from a camera (CAM), switches to the driver control mode if the user is a driver (S60), and performs steps 71 to 80 on the driver display area (S1) according to the driver control mode. At least one protruding area (PDA) in the driver display area (S1) is protruded by a stretching structure (SS), and the processor (PRC) can control the performance of a function corresponding to the driver's touch input to the protruding area (PDA).

[0163] The processor (PRC) can generate and output a termination signal when the video is terminated and / or when the video is forcibly terminated (S95).

[0164] By controlling the vehicle display device (3) according to Fig. 16, contents with different functions can be provided to the driver's seat display area (S1) and the passenger seat display area (S2), respectively.

[0165] Embodiments of the present invention can reduce the weight of a vehicle and improve fuel efficiency by performing in-vehicle function control (temperature control, volume control, radio frequency control, etc.) using a stretchable display device that receives touch input, compared to function control using mechanical parts.

[0166] Embodiments of the present invention identify a driver using a video signal, and utilize a freely deformable stretchable display device and a feedback system, so that the driver can use the operating section (protruding area) of the display device while looking ahead.

[0167] While the present invention has been described with reference to the embodiments illustrated in the drawings, these are merely exemplary, and those skilled in the art will understand that various modifications and equivalent alternative embodiments are possible. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

Claims

1. Camera; A stretchable display panel including a touch sensor; A mechanism including at least one pin that moves in a vertical direction with respect to the back surface of the stretchable display panel; and A processor for controlling the operation of the stretchable display panel and mechanism; The above processor, Identifying a user touching the stretchable display panel based on a video signal acquired from at least one camera, and determining a driver's seat control mode or a passenger's seat control mode according to the identified user, In the above driver's seat control mode and the passenger's seat control mode, Outputting a driving control signal for controlling the movement of at least one pin of the above mechanism, Outputting an operation control signal for performing a function corresponding to the user's touch input in the protruding area of ​​the stretchable display panel according to the movement of at least one pin; A vehicle display device, wherein the processor further outputs a feedback control signal for feedback output set for performing the function in the driver's seat control mode.

2. In paragraph 1, A vehicle display device, wherein the protruding region includes a central region having the highest height and a peripheral region around the central region, and the peripheral region has a gradually decreasing height from the central region and has an inclined surface.

3. In paragraph 2, A vehicle display device, wherein the processor outputs an operation control signal for controlling on / off of the function in response to a touch in the central area, and outputs an operation control signal for controlling the height of the function in response to a drag in the peripheral area.

4. In paragraph 3, A vehicle display device, wherein the above function includes at least one of temperature control, volume control, or radio frequency control.

5. In paragraph 2, A vehicle display device, wherein the above mechanism includes a single pin positioned corresponding to the protruding area.

6. In paragraph 2, The above mechanism includes at least one first pin positioned corresponding to the central region of the protruding region and a plurality of second pins positioned corresponding to the peripheral region, A vehicle display device, wherein the movement distance of the first pin is longer than the movement distance of the second pin.

7. In paragraph 1, A vehicle display device, wherein the camera is disposed above the stretchable display panel or below the stretchable display panel.

8. In paragraph 7, A vehicle display device, wherein the above touch sensor is at least one of a capacitive touch sensor, a resistive touch sensor, an acoustic wave touch sensor, an infrared touch sensor, or a pressure touch sensor.

9. In paragraph 4, A vehicle display device further comprising the above function of video playback.

10. In the 9th paragraph, in the passenger seat control mode, The processor outputs a driving control signal for controlling movement of at least one pin of the mechanism based on the function corresponding to the user's touch input in the protruding area of ​​the stretchable display panel being the image playback, A vehicle display device, wherein the stretchable display panel is deformed to provide a first display area inclined toward the driver's seat and a second display area inclined toward the passenger seat according to movement of at least one pin.

11. In a method for controlling a vehicle display device, The above vehicle display device is, camera; A stretchable display panel including a touch sensor; and A mechanism including at least one pin that moves in a vertical direction with respect to the back surface of the stretchable display panel; The above control method is, A step of identifying a user touching the stretchable display panel based on a video signal acquired from at least one camera, and determining a driver's seat control mode or a passenger's seat control mode according to the identified user; In the driver's seat control mode, a step of outputting a driving control signal for controlling movement of at least one pin of the mechanism; and A method for controlling a vehicle display device, comprising: a step of outputting an operation control signal for performing a function corresponding to the user's touch input in the protruding area of ​​the stretchable display panel according to movement of the at least one pin in the driver's seat control mode; and a feedback control signal for outputting a feedback signal set for performing the function.

12. In paragraph 11, A control method for a vehicle display device, wherein in the above passenger seat control mode, the feedback control signal is not output.

13. In paragraph 11, A control method for a vehicle display device, wherein the protruding region includes a central region having the highest height and a peripheral region around the central region, and the peripheral region has a sloped surface and gradually decreases in height from the central region.

14. In the 12th paragraph, the operation control signal output step is, A method for controlling a vehicle display device, comprising: a step of outputting a motion control signal for controlling on / off of the function in response to a touch of the central area; and outputting a motion control signal for controlling the height of the function in response to a drag of the peripheral area.

15. In paragraph 14, A method for controlling a vehicle display device, wherein the above function includes at least one of temperature control, volume control, or radio frequency control.

16. In paragraph 13, A control method for a vehicle display device, wherein the above mechanism includes a single pin positioned corresponding to the protruding area.

17. In paragraph 13, The above mechanism includes at least one first pin positioned corresponding to the central region of the protruding region and a plurality of second pins positioned corresponding to the peripheral region, A control method for a vehicle display device, wherein the movement distance of the first pin is longer than the movement distance of the second pin.

18. In paragraph 11, A method for controlling a vehicle display device, wherein the camera is disposed above the stretchable display panel or below the stretchable display panel.

19. In paragraph 15, A method for controlling a vehicle display device, wherein the above touch sensor is at least one of a capacitive touch sensor, a resistive touch sensor, an acoustic wave touch sensor, an infrared touch sensor, or a pressure touch sensor.

20. In paragraph 15, The above function further includes video playback, In the passenger seat control mode, a step of outputting a driving control signal for controlling movement of at least one pin of the mechanism based on the function corresponding to the user's touch input in the protruding area of ​​the stretchable display panel being the image playback; and A method for controlling a vehicle display device, further comprising: providing an image according to a user selection in the second display area of ​​the stretchable display panel, which is deformed to provide a first display area inclined toward the driver's seat and a second display area inclined toward the passenger seat according to movement of at least one pin.

Images