Vehicle display device and operating method thereof

Abstract

A vehicle display device according to one embodiment of the present invention comprises: a first display disposed in a frame corresponding to the driver seat and the passenger seat in a vehicle, and provided in the longitudinal direction to correspond to the driver seat and the passenger seat; a second display which is coupled to one side of the frame and which moves between the driver seat and the passenger seat in the horizontal direction of the frame through the operation of a driving module; a reception unit for receiving passenger monitoring information on the basis of vehicle DMS sensing information; and a control unit for controlling the operation of each of the first and second displays and the driving module. Here, the control unit can display a first screen on the first display, recognize the passenger sitting in the passenger seat on the basis of the received passenger monitoring information, and determine whether to generate a second screen for the passenger seat on at least a portion of the first display on the basis of the recognition results.

Description

Vehicle display device and its operating method

[0001] The present invention relates to a vehicle display device, and more particularly, to a vehicle display device configured to monitor vehicle occupants and perform different actions, and an operating method thereof.

[0002] A vehicle is a device that allows the user to move in the desired direction. A representative example is an automobile.

[0003] Meanwhile, various sensors and electronic devices are being installed in vehicles to enhance the convenience of users. In particular, research is actively being conducted on Advanced Driver Assistance Systems (ADAS) to enhance user convenience. Furthermore, development of autonomous vehicles (AVs) is also actively underway.

[0004] Furthermore, as the amount of time spent in vehicles continues to increase, more and more users are viewing their vehicles not simply as a means of transportation, but as spaces themselves. Accordingly, research is being conducted to utilize large displays in vehicles to provide a more immersive and diverse infotainment experience.

[0005] There is a need for all passengers in the vehicle to use the displays installed for convenience more conveniently and selectively according to the situation.

[0006] The present invention aims to solve the above-mentioned problems and other problems.

[0007] According to some embodiments of the present invention, an object is to provide a vehicle display device and an operating method thereof that operate so that both a driver and a passenger in the front seat of a vehicle can conveniently and selectively control the screen.

[0008] In addition, according to some embodiments of the present invention, another purpose is to provide a vehicle display device and an operating method thereof that can automatically generate a screen for an auxiliary seat passenger on a large screen of a front seat based on the presence of an auxiliary seat passenger in a vehicle.

[0009] In addition, according to some embodiments of the present invention, another object is to provide a vehicle display device and an operating method thereof that can be moved based on the presence of an passenger in the passenger seat of a vehicle.

[0010] In addition, according to some embodiments of the present invention, another object is to provide a vehicle display device and an operating method thereof, which are implemented so that the vehicle display device can operate differently according to the operation of the linked console depending on the presence or absence of an auxiliary seat passenger of the vehicle.

[0011] To this end, a vehicle display device according to an embodiment of the present invention is configured to determine whether to generate a screen for passengers based on the results of monitoring passengers in the vehicle.

[0012] Specifically, a vehicle display device according to an embodiment of the present invention includes a first display disposed in a frame formed to correspond to a driver's seat and a passenger's seat in a vehicle and installed in a rectangular shape to correspond to the driver's seat and the passenger's seat, a second display coupled to one side of the frame and configured to move between the driver's seat and the passenger's seat along the horizontal direction of the frame through the operation of a drive module, a receiving unit that receives monitoring information of an occupant based on DMS sensing information of the vehicle, and a control unit that controls the respective operations of the first display unit, the second display unit, and the drive module. In addition, the control unit can display a first screen on the first display unit, recognize an occupant of the passenger's seat based on the received monitoring information, and determine whether to generate a second screen for the passenger's seat on at least a portion of the first display unit based on the recognition result.

[0013] In an embodiment, the control unit may apply a different screen control target of the first display unit corresponding to an input of the second display unit depending on whether the passenger in the auxiliary seat is recognized.

[0014] In an embodiment, the control unit may execute a passenger mode based on the recognition of a passenger in the passenger seat based on the received monitoring information, and display the second screen in an area of ​​the first display unit corresponding to the passenger seat.

[0015] In an embodiment, the second display unit is coupled to the first driving module and the second driving module, respectively, and moves between the driver's seat and the passenger seat along the horizontal direction of the frame according to the operation of the first driving module, and can be changed to a state in which at least a portion is introduced into the internal space of the frame or withdrawn to the outside according to the operation of the second driving module. In addition, the control unit can control the operation of the second driving module so that at least a portion of the second display unit is changed to a state in which it is withdrawn to the outside of the frame based on each control signal in response to the execution of the passenger mode, and can control the operation of the first driving module so that the second display unit moves to a position corresponding to the passenger seat along the horizontal direction of the frame.

[0016] In an embodiment, the control unit may control the operation of the second drive module so that the second display unit is introduced into the internal space of the frame when it is determined that the recognized passenger seat occupant has not moved for a predetermined period of time or is in a sleeping state based on the received monitoring information in the passenger mode.

[0017] In an embodiment, the control unit may generate a second screen for the passenger seat on the first display unit based on the passenger seat being recognized, and then display the first screen on the entire first display unit instead of the second screen for the passenger seat based on the passenger seat being in a state of inactivity or sleep for a predetermined period of time.

[0018] In an embodiment, the vehicle display device further includes an input unit for controlling movement of the second display unit, and the control unit determines not to display the second screen based on the received monitoring information that an occupant in the passenger seat is not recognized, and controls the first screen based on an input to the input unit according to the determination.

[0019] In an embodiment, the vehicle display device may further include a communication unit that receives a signal corresponding to an operation of the input unit by communicating with an input unit that selectively controls either the operation of the drive module of the second display unit or the screen of the first display unit according to a set condition. In this case, the control unit may receive a signal matching the operation of the input unit, and may perform an operation of the drive module for movement of the second display unit in a first condition and perform screen control of the first display unit in a second condition according to the recognition result of the passenger in the auxiliary seat.

[0020] In an embodiment, the control unit may determine that the first condition is satisfied based on the recognition of the passenger in the passenger seat based on the received monitoring information, display the second screen in an area of ​​the first display unit corresponding to the passenger seat, and control the operation of the drive module to move the second display unit to a position corresponding to the passenger seat along the horizontal direction of the frame based on the received first operation signal.

[0021] In an embodiment, the control unit may display the control screen of the second screen on the second display unit based on the second display unit moving to a position corresponding to the auxiliary seat in the first condition.

[0022] In an embodiment, the control unit may display the control screen of the first screen on the second display unit based on the first condition being satisfied, the first operation signal not being received, or the second operation signal being received that matches the operation of the drive module for moving the second display unit to a position corresponding to the driver's seat along the horizontal direction of the frame.

[0023] In an embodiment, the control unit may determine that the second condition is satisfied based on the fact that the passenger in the auxiliary seat is not recognized based on the received monitoring information, perform screen control of the first display unit based on the received signal, and display the control screen of the first display unit on the second display unit.

[0024] In an embodiment, the second display unit is coupled to the first driving module and the second driving module, respectively, and moves between the driver's seat and the passenger seat along the horizontal direction of the frame according to the operation of the first driving module, and can be changed to a state in which at least a portion is introduced into the internal space of the frame or withdrawn to the outside according to the operation of the second driving module. In this case, the control unit can generate a first control signal to operate the second driving module so that the second display unit is changed to a state in which it is introduced into the internal space of the frame based on recognizing that the driver is driving based on the received monitoring information and that the driving speed of the vehicle is higher than a predetermined driving speed.

[0025] In addition, a vehicle display device according to another embodiment of the present invention includes a first display disposed in a frame formed to correspond to a driver's seat and a passenger's seat in a vehicle and installed in a rectangular shape to correspond to the driver's seat and the passenger's seat, a second display coupled to one side of the frame and configured to move between the driver's seat and the passenger's seat along the horizontal direction of the frame through the operation of a drive module, a receiving unit that receives monitoring information of an occupant based on DMS sensing information of a vehicle, and a control unit that controls the respective operations of the first display unit, the second display unit, and the drive module, wherein the control unit can display a first screen on the first display unit, recognize an occupant of the passenger's seat based on the received monitoring information, and determine whether to operate the drive module according to an input for moving the second display unit based on the recognition result.

[0026] In an embodiment, the control unit may determine whether to generate a second screen for the passenger seat on at least a portion of the first display unit based on the recognition result of the passenger in the passenger seat.

[0027] In an embodiment, the control unit may execute a passenger mode based on the recognition of a passenger in the auxiliary seat based on the received monitoring information, and control the operation of the drive module for movement of the second display unit based on a control signal generated based on an input to an input unit matching the drive module.

[0028] In an embodiment, the control unit may limit the operation of the driving module according to a control signal generated based on an input to an input unit matching the driving module based on the fact that an occupant of the auxiliary seat is not recognized based on the received monitoring information, and control the first screen displayed on the first display unit according to the generated control signal.

[0029] According to the vehicle display device and its operating method according to the present invention, when it is recognized that there is a passenger in the passenger seat of a vehicle, a screen for the passenger in the passenger seat is automatically generated on a first display installed in a rectangular shape in the front seat, so that the passenger in the passenger seat can immediately receive the desired service without additional operation.

[0030] In addition, according to the vehicle display device and its operating method according to the present invention, when it is recognized that a passenger in the passenger seat of a vehicle is present, a second display implemented to be movable is automatically implemented to approach the passenger seat, thereby allowing the passenger in the passenger seat to easily control a second screen for the passenger in the passenger seat through the moved second display.

[0031] In addition, according to the vehicle display device and its operating method according to the present invention, when the passenger seat of the vehicle is not recognized, the movable second display is controlled so that it can be used to control the screen for the driver, so that the second display can be utilized not only for the passenger seat but also for the driver, thereby expanding the user experience and usability.

[0032] FIG. 1 is a block diagram for reference in explaining a display device of a vehicle related to an embodiment of the present invention.

[0033] FIG. 2 is a block diagram for explaining the detailed configuration of a vehicle display device according to an embodiment of the present invention and the operation of an input device linked thereto.

[0034] FIG. 3 is a drawing showing a vehicle display device according to an embodiment of the present invention installed in a vehicle.

[0035] FIGS. 4A and 4B are exemplary drawings for explaining that a vehicle display device according to an embodiment of the present invention moves in different directions.

[0036] FIG. 5 is a flowchart for explaining a method for controlling a screen of a vehicle display device depending on whether an auxiliary seat passenger is detected according to an embodiment of the present invention.

[0037] FIG. 6 is a drawing showing an example of providing a screen of a display in a split mode based on the detection of an auxiliary seat passenger according to an embodiment of the present invention.

[0038] FIG. 7 is a drawing showing an example of a passenger in the passenger seat controlling a screen of a first display using a second display according to an embodiment of the present invention.

[0039] FIGS. 8 and 9 are exemplary drawings showing movement of the second display when the passenger seat is not detected or is drowsy, according to an embodiment of the present invention.

[0040] FIG. 10 is a drawing showing an example of a driver controlling a screen of a first display using a second display according to an embodiment of the present invention.

[0041] FIG. 11 is another flowchart for explaining a method of moving a vehicle display device depending on whether an auxiliary seat passenger is detected according to an embodiment of the present invention.

[0042] Figures 12a and 12b are exemplary conceptual diagrams specifically explaining the movement method of Figure 11.

[0043] FIG. 13a is a conceptual diagram for explaining a console for controlling display or movement of a vehicle display device according to an embodiment of the present invention, and FIGS. 13b to 13e are conceptual diagrams for explaining operation of the related console.

[0044] FIG. 13f is a block diagram showing a detailed configuration related to a plurality of driving modules for moving a vehicle display device in different directions according to an embodiment of the present invention.

[0045] FIG. 14 is a conceptual diagram illustrating that, according to an embodiment of the present invention, movement of a second display is controlled based on operation of a console in response to detection of a passenger in the passenger seat.

[0046] FIG. 15 is another flowchart for explaining a method for selectively performing movement of a vehicle display device and screen control of a first display depending on whether an auxiliary seat passenger is detected according to an embodiment of the present invention.

[0047] FIGS. 16A to 16C are exemplary conceptual diagrams for explaining movement control of a vehicle display device according to a passenger execution mode, according to an embodiment of the present invention.

[0048] FIGS. 17A and 17B are exemplary conceptual diagrams for explaining screen control of a first display corresponding to operation of a console according to a driver execution mode, according to an embodiment of the present invention.

[0049] FIG. 18 is an exemplary drawing for explaining that a display device of a vehicle according to an embodiment of the present invention is linked with a rear seat display device of a vehicle.

[0050] FIG. 1 is a block diagram for reference in explaining a vehicle related to an embodiment of the present invention.

[0051] Referring to FIG. 1, the vehicle (100) may include wheels that rotate by a power source and a steering input device (510) for controlling the direction of travel of the vehicle (100).

[0052] The vehicle (100) may be an autonomous vehicle. The vehicle (100) may be switched between an autonomous driving mode and a manual driving mode based on user input. For example, the vehicle (100) may be switched from a manual mode to an autonomous driving mode, or from an autonomous driving mode to a manual mode, based on user input received through a user interface device (hereinafter, referred to as a "user terminal") (200).

[0053] The vehicle (100) can be switched to autonomous driving mode or manual driving mode based on driving situation information. The driving situation information can be generated based on object information provided by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on the driving situation information generated by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on driving situation information received through the communication device (400).

[0054] The vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on information, data, and signals provided from an external device.

[0055] When the vehicle (100) is operated in autonomous driving mode, the autonomous vehicle (100) may be operated based on the driving system (700). For example, the autonomous vehicle (100) may be operated based on information, data, or signals generated from the driving system (710), the exit system (740), and the parking system (750).

[0056] When the vehicle (100) is driven in manual mode, the autonomous vehicle (100) can receive user input for driving through the driving control device (500). Based on the user input received through the driving control device (500), the vehicle (100) can be driven.

[0057] The overall length refers to the length from the front to the rear of the vehicle (100), the overall width refers to the width of the vehicle (100), and the overall height refers to the length from the bottom of the wheel to the roof. In the following description, the overall length direction (L) may refer to the direction that serves as a reference for measuring the overall length of the vehicle (100), the overall width direction (W) may refer to the direction that serves as a reference for measuring the overall width of the vehicle (100), and the overall height direction (H) may refer to the direction that serves as a reference for measuring the overall height of the vehicle (100).

[0058] As illustrated in FIG. 1, a vehicle (100) may include a user interface device (hereinafter, referred to as a 'user terminal') (200), an object detection device (300), a communication device (400), a driving operation device (500), a vehicle driving device (600), a driving system (700), a navigation system (770), a sensing unit (120), a vehicle interface unit (130), a memory (140), a control unit (170), and a power supply unit (190).

[0059] Depending on the embodiment, the vehicle (100) may include other components in addition to the components described herein, or may not include some of the components described herein.

[0060] The user interface device (200) is a device for communication between a vehicle (100) and a user. The user interface device (200) can receive user input and provide information generated in the vehicle (100) to the user. The vehicle (100) can implement a UI (User Interfaces) or UX (User Experience) through the user interface device (hereinafter, referred to as a 'user terminal') (200).

[0061] The user interface device (200) may include an input unit (210), an internal camera (220), a biometric detection unit (230), an output unit (250), and a processor (270). Depending on the embodiment, the user interface device (200) may include other components in addition to the described components, or may not include some of the described components.

[0062] The input unit (210) is for receiving information from a user, and data collected from the input unit (210) can be analyzed by a processor (270) and processed into a user's control command.

[0063] The input unit (210) may be placed inside the vehicle. For example, the input unit (210) may be placed in an area of ​​a steering wheel, an area of ​​an instrument panel, an area of ​​a seat, an area of ​​each pillar, an area of ​​a door, an area of ​​a center console, an area of ​​a head lining, an area of ​​a sun visor, an area of ​​a windshield, or an area of ​​a window.

[0064] The input unit (210) may include a voice input unit (211), a gesture input unit (212), a touch input unit (213), and a mechanical input unit (214).

[0065] The voice input unit (211) can convert a user's voice input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170). The voice input unit (211) can include one or more microphones.

[0066] The gesture input unit (212) can convert a user's gesture input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0067] The gesture input unit (212) may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input. According to an embodiment, the gesture input unit (212) may detect a user's three-dimensional gesture input. To this end, the gesture input unit (212) may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.

[0068] The gesture input unit (212) can detect a user's 3D gesture input through a TOF (Time of Flight) method, a structured light method, or a disparity method.

[0069] The touch input unit (213) can convert a user's touch input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0070] The touch input unit (213) may include a touch sensor for detecting a user's touch input. In some embodiments, the touch input unit (213) may be formed integrally with the display unit (251), thereby implementing a touch screen. Such a touch screen may provide both an input interface and an output interface between the vehicle (100) and the user.

[0071] The mechanical input unit (214) may include at least one of a button, a dome switch, a jog wheel, and a jog switch. An electrical signal generated by the mechanical input unit (214) may be provided to a processor (270) or a control unit (170). The mechanical input unit (214) may be placed on a steering wheel, a center fascia, a center console, a cockpit module, a door, etc.

[0072] The internal camera (220) can capture images of the vehicle interior. The processor (270) can detect the user's status based on the images of the vehicle interior. The processor (270) can obtain information about the user's gaze from the images of the vehicle interior. The processor (270) can detect the user's gestures from the images of the vehicle interior.

[0073] The biometric detection unit (230) can obtain the user's biometric information. The biometric detection unit (230) includes a sensor capable of obtaining the user's biometric information, and can use the sensor to obtain the user's fingerprint information, heartbeat information, etc. The biometric information can be used for user authentication.

[0074] The output unit (250) is for generating output related to visual, auditory, or tactile sensations. The output unit (250) may include at least one of a display unit (251), an audio output unit (252), and a haptic output unit (253).

[0075] The display unit (251) can display graphic objects corresponding to various pieces of information. The display unit (251) can include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0076] The display unit (251) can implement a touch screen by forming a mutual layer structure with the touch input unit (213) or forming it as an integral part.

[0077] The display unit (251) may be implemented as a HUD (Head Up Display). When the display unit (251) is implemented as a HUD, the display unit (251) may be equipped with a projection module to output information through an image projected onto a windshield or window.

[0078] The display unit (251) may include a transparent display. The transparent display may be attached to a windshield or a window. The transparent display may have a predetermined transparency and display a predetermined screen. In order to have transparency, the transparent display may include at least one of a transparent TFEL (Thin Film Electroluminescent), a transparent OLED (Organic Light-Emitting Diode), a transparent LCD (Liquid Crystal Display), a transparent display, and a transparent LED (Light Emitting Diode) display. The transparency of the transparent display may be adjusted.

[0079] Meanwhile, the user interface device (200) may include a plurality of display units (251a to 251g).

[0080] The display unit (251) may be arranged in one area of ​​the steering wheel, one area of ​​the instrument panel (521a, 251b, 251e), one area of ​​the seat (251d), one area of ​​each pillar (251f), one area of ​​the door (251g), one area of ​​the center console, one area of ​​the head lining, one area of ​​the sun visor, or may be implemented in one area of ​​the windshield (251c), one area of ​​the window (251h).

[0081] The audio output unit (252) converts an electric signal provided from the processor (270) or the control unit (170) into an audio signal and outputs the converted signal. To this end, the audio output unit (252) may include one or more speakers.

[0082] The haptic output unit (253) generates a tactile output. For example, the haptic output unit (253) can operate by vibrating a steering wheel, a seat belt, or a seat (110FL, 110FR, 110RL, 110RR) so that the user can perceive the output.

[0083] The processor (hereinafter, referred to as a “control unit”) (270) can control the overall operation of each unit of the user interface device (200). Depending on the embodiment, the user interface device (200) may include a plurality of processors (270) or may not include a processor (270).

[0084] If the user interface device (200) does not include a processor (270), the user interface device (200) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0085] Meanwhile, the user interface device (200) may be referred to as a vehicle display device. The user interface device (200) may be operated under the control of the control unit (170).

[0086] The object detection device (300) is a device for detecting objects located outside a vehicle (100). The objects may be various objects related to the operation of the vehicle (100). The objects may include lanes, other vehicles, pedestrians, two-wheeled vehicles, traffic signals, lights, roads, structures, speed bumps, terrain, animals, etc.

[0087] A road may include slopes such as road surfaces, curves, uphill and downhill slopes, etc.

[0088] Structures may be objects located along roads and fixed to the ground. For example, structures may include streetlights, street trees, buildings, utility poles, traffic lights, and bridges.

[0089] Landforms may include mountains, hills, etc.

[0090] Meanwhile, objects can be classified into moving objects and fixed objects. For example, moving objects may include concepts such as other vehicles and pedestrians. For example, fixed objects may include concepts such as traffic signals, roads, and structures.

[0091] The object detection device (300) may include a camera (310), a radar (320), a lidar (330), an ultrasonic sensor (340), an infrared sensor (350), and a processor (370).

[0092] Depending on the embodiment, the object detection device (300) may include other components in addition to the described components, or may not include some of the described components.

[0093] The camera (310) may be positioned at an appropriate location outside the vehicle to capture images of the vehicle's exterior. The camera (310) may be a mono camera, a stereo camera (310a), an AVM (Around View Monitoring) camera (310b), or a 360-degree camera.

[0094] For example, the camera (310) may be positioned inside the vehicle, close to the front windshield, to capture an image of the front of the vehicle. Alternatively, the camera (310) may be positioned around the front bumper or radiator grill.

[0095] For example, the camera (310) may be positioned inside the vehicle, close to the rear glass, to capture images of the rear of the vehicle. Alternatively, the camera (310) may be positioned around the rear bumper, trunk, or tailgate.

[0096] For example, the camera (310) may be positioned close to at least one of the side windows inside the vehicle to obtain an image of the side of the vehicle. Alternatively, the camera (310) may be positioned around a side mirror, fender, or door.

[0097] The camera (310) can provide the acquired image to the processor (370).

[0098] The radar (320) may include an electromagnetic wave transmitter and receiver. The radar (320) may be implemented in a pulse radar or continuous wave radar manner based on the principle of radio wave emission. Among continuous wave radar methods, the radar (320) may be implemented in a frequency modulated continuous wave (FMCW) manner or a frequency shift keying (FSK) manner depending on the signal waveform.

[0099] The radar (320) can detect an object using electromagnetic waves, based on a TOF (Time of Flight) method or a phase-shift method, and can detect the location of the detected object, the distance to the detected object, and the relative speed.

[0100] The radar (320) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0101] The lidar (330) may include a laser transmitter and receiver. The lidar (330) may be implemented using a TOF (Time of Flight) method or a phase-shift method.

[0102] The lidar (330) can be implemented as a driven or non-driven type.

[0103] When implemented as a drive type, the lidar (330) is rotated by a motor and can detect objects around the vehicle (100).

[0104] When implemented in a non-driven manner, the lidar (330) can detect an object located within a predetermined range relative to the vehicle (100) through optical steering. The vehicle (100) can include a plurality of non-driven lidars (330).

[0105] Lidar (330) can detect an object based on a time-of-flight (TOF) method or a phase-shift method using laser light as a parameter, and can detect the position of the detected object, the distance to the detected object, and the relative speed.

[0106] The lidar (330) can be placed at an appropriate location outside the vehicle to detect objects located in front, behind, or to the side of the vehicle.

[0107] The ultrasonic sensor (340) may include an ultrasonic transmitter and a receiver. The ultrasonic sensor (340) may detect an object based on ultrasonic waves, and may detect the location of the detected object, the distance from the detected object, and the relative speed.

[0108] The ultrasonic sensor (340) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0109] The infrared sensor (350) may include an infrared transmitter and a receiver. The infrared sensor (340) may detect an object based on infrared light, and may detect the location of the detected object, the distance to the detected object, and the relative speed.

[0110] The infrared sensor (350) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0111] The processor (370) can control the overall operation of each unit of the object detection device (300).

[0112] The processor (370) can detect and track an object based on the acquired image. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object through an image processing algorithm.

[0113] The processor (370) can detect and track an object based on the reflected electromagnetic waves that are returned when the transmitted electromagnetic waves are reflected by the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the electromagnetic waves.

[0114] The processor (370) can detect and track an object based on the reflected laser light that is reflected back by the transmitted laser beam from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the laser light.

[0115] The processor (370) can detect and track an object based on the reflected ultrasonic waves that are returned when the transmitted ultrasonic waves are reflected off the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the ultrasonic waves.

[0116] The processor (370) can detect and track an object based on the reflected infrared light that is reflected back by the transmitted infrared light from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the infrared light.

[0117] Depending on the embodiment, the object detection device (300) may include multiple processors (370) or may not include a processor (370). For example, each of the camera (310), radar (320), lidar (330), ultrasonic sensor (340), and infrared sensor (350) may individually include a processor.

[0118] If the object detection device (300) does not include a processor (370), the object detection device (300) can be operated under the control of the processor or control unit (170) of the device in the vehicle (100).

[0119] The object detection device (400) can be operated under the control of the control unit (170).

[0120] The communication device (400) is a device for communicating with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

[0121] The communication device (400) may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element to perform communication.

[0122] The communication device (400) may include a short-range communication unit (410), a location information unit (420), a V2X communication unit (430), an optical communication unit (440), a broadcast transmission / reception unit (450), and a processor (470).

[0123] Depending on the embodiment, the communication device (400) may include other components in addition to the described components, or may not include some of the described components.

[0124] The short-range communication unit (410) is a unit for short-range communication. The short-range communication unit (410) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.

[0125] The short-range communication unit (410) can form a short-range wireless communication network (Wireless Area Networks) to perform short-range communication between the vehicle (100) and at least one external device.

[0126] The location information unit (420) is a unit for obtaining location information of a vehicle (100). For example, the location information unit (420) may include a GPS (Global Positioning System) module or a DGPS (Differential Global Positioning System) module.

[0127] The V2X communication unit (430) is a unit for performing wireless communication with a server (V2I: Vehicle to Infrastructure), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit (430) may include an RF circuit capable of implementing protocols for communication with infrastructure (V2I), communication between vehicles (V2V), and communication with pedestrians (V2P).

[0128] The optical communication unit (440) is a unit for communicating with an external device via light. The optical communication unit (440) may include an optical transmission unit that converts an electrical signal into an optical signal and transmits it to the outside, and an optical reception unit that converts a received optical signal into an electrical signal.

[0129] According to an embodiment, the light transmitting unit may be formed to be integrated with a lamp included in the vehicle (100).

[0130] The broadcast transmitter / receiver (450) is a unit for receiving broadcast signals from an external broadcast management server via a broadcast channel, or transmitting broadcast signals to the broadcast management server. The broadcast channels may include satellite channels and terrestrial channels. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals.

[0131] The processor (470) can control the overall operation of each unit of the communication device (400).

[0132] Depending on the embodiment, the communication device (400) may include a plurality of processors (470) or may not include a processor (470).

[0133] If the communication device (400) does not include a processor (470), the communication device (400) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0134] Meanwhile, the communication device (400) may implement a vehicle display device together with the user interface device (200). In this case, the vehicle display device may be referred to as a telematics device or an AVN (Audio Video Navigation) device.

[0135] The communication device (400) can be operated under the control of the control unit (170).

[0136] The driving control device (500) is a device that receives user input for driving.

[0137] When in manual mode, the vehicle (100) can be driven based on signals provided by the driving control device (500).

[0138] The driving control device (500) may include a steering input device (510), an acceleration input device (530), and a brake input device (570).

[0139] The steering input device (510) can receive input for the direction of travel of the vehicle (100) from the user. The steering input device (510) is preferably formed in the form of a wheel so that steering input can be provided by rotation. Depending on the embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

[0140] The acceleration input device (530) can receive an input from a user for accelerating the vehicle (100). The brake input device (570) can receive an input from a user for decelerating the vehicle (100). The acceleration input device (530) and the brake input device (570) are preferably formed in the form of a pedal. Depending on the embodiment, the acceleration input device or the brake input device may also be formed in the form of a touch screen, a touch pad, or a button.

[0141] The driving operation device (500) can be operated under the control of the control unit (170).

[0142] The vehicle driving device (600) is a device that electrically controls the driving of various devices in the vehicle (100).

[0143] The vehicle driving device (600) may include a power train driving unit (610), a chassis driving unit (620), a door / window driving unit (630), a safety device driving unit (640), a lamp driving unit (650), and an air conditioning driving unit (660).

[0144] Depending on the embodiment, the vehicle drive device (600) may include additional components other than the described components, or may not include some of the described components.

[0145] Meanwhile, the vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0146] The power train drive unit (610) can control the operation of the power train device.

[0147] The power train drive unit (610) may include a power source drive unit (611) and a transmission drive unit (612).

[0148] The power source driving unit (611) can perform control over the power source of the vehicle (100).

[0149] For example, if a fossil fuel-based engine is the power source, the power source drive unit (610) can perform electronic control of the engine. This can control the engine output torque, etc. The power source drive unit (611) can adjust the engine output torque according to the control of the control unit (170).

[0150] For example, if an electric energy-based motor is the power source, the power source driving unit (610) can perform control over the motor. The power source driving unit (610) can adjust the rotation speed, torque, etc. of the motor according to the control of the control unit (170).

[0151] The transmission drive unit (612) can perform control over the transmission. The transmission drive unit (612) can adjust the state of the transmission. The transmission drive unit (612) can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

[0152] Meanwhile, when the engine is the power source, the transmission drive unit (612) can adjust the gear engagement state in the forward (D) state.

[0153] The chassis drive unit (620) can control the operation of the chassis device. The chassis drive unit (620) can include a steering drive unit (621), a brake drive unit (622), and a suspension drive unit (623).

[0154] The steering drive unit (621) can perform electronic control of the steering apparatus within the vehicle (100). The steering drive unit (621) can change the direction of travel of the vehicle.

[0155] The brake drive unit (622) can perform electronic control of the brake apparatus within the vehicle (100). For example, the speed of the vehicle (100) can be reduced by controlling the operation of the brakes placed on the wheels.

[0156] Meanwhile, the brake driving unit (622) can individually control each of the plurality of brakes. The brake driving unit (622) can control the braking force applied to the plurality of wheels differently.

[0157] The suspension drive unit (623) can perform electronic control of the suspension apparatus within the vehicle (100). For example, when there is a curve in the road surface, the suspension drive unit (623) can control the suspension apparatus to reduce vibration of the vehicle (100). Meanwhile, the suspension drive unit (623) can individually control each of the plurality of suspensions.

[0158] The door / window actuator (630) can perform electronic control of a door apparatus or window apparatus in a vehicle (100).

[0159] The door / window driving unit (630) may include a door driving unit (631) and a window driving unit (632).

[0160] The door driving unit (631) can control the door device. The door driving unit (631) can control the opening and closing of a plurality of doors included in the vehicle (100). The door driving unit (631) can control the opening or closing of a trunk or tail gate. The door driving unit (631) can control the opening or closing of a sunroof.

[0161] The window driving unit (632) can perform electronic control of a window apparatus. It can control the opening or closing of a plurality of windows included in a vehicle (100).

[0162] The safety device driving unit (640) can perform electronic control of various safety devices in the vehicle (100).

[0163] The safety device drive unit (640) may include an airbag drive unit (641), a seat belt drive unit (642), and a pedestrian protection device drive unit (643).

[0164] The airbag driving unit (641) can perform electronic control of the airbag apparatus within the vehicle (100). For example, the airbag driving unit (641) can control the airbag to deploy when a danger is detected.

[0165] The seat belt drive unit (642) can perform electronic control of the seat belt apparatus within the vehicle (100). For example, the seat belt drive unit (642) can control the passenger to be secured to the seat (110FL, 110FR, 110RL, 110RR) using the seat belt when a danger is detected.

[0166] The pedestrian protection device drive unit (643) can perform electronic control of the hood lift and pedestrian airbag. For example, the pedestrian protection device drive unit (643) can control the hood lift up and the pedestrian airbag to deploy when a collision with a pedestrian is detected.

[0167] The lamp driving unit (650) can perform electronic control of various lamp apparatuses within the vehicle (100).

[0168] The air conditioning drive unit (660) can perform electronic control of the air conditioning device (air cinditioner) within the vehicle (100). For example, the air conditioning drive unit (660) can control the air conditioning device to operate and supply cool air to the vehicle when the temperature inside the vehicle is high.

[0169] The vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0170] The vehicle driving device (600) can be operated under the control of the control unit (170).

[0171] The driving system (700) is a system that controls various operations of the vehicle (100). The driving system (700) can be operated in autonomous driving mode.

[0172] The driving system (700) may include a driving system (710), an exiting system (740), and a parking system (750).

[0173] Depending on the embodiment, the driving system (700) may include other components in addition to the described components, or may not include some of the described components.

[0174] Meanwhile, the driving system (700) may include a processor. Each unit of the driving system (700) may individually include a processor.

[0175] Meanwhile, depending on the embodiment, if the driving system (700) is implemented in software, it may be a sub-concept of the control unit (170).

[0176] Meanwhile, according to an embodiment, the driving system (700) may be a concept including at least one of a user interface device (200), an object detection device (300), a communication device (400), a vehicle driving device (600), and a control unit (170).

[0177] The driving system (710) can drive the vehicle (100).

[0178] The driving system (710) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100).

[0179] The exit system (740) can perform exit of a vehicle (100).

[0180] The exit system (740) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100).

[0181] The parking system (750) can perform parking of a vehicle (100).

[0182] The parking system (750) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100).

[0183] A navigation system (770) can provide navigation information. The navigation information can include at least one of map information, set destination information, route information based on the set destination, information on various objects along the route, lane information, and current vehicle location information.

[0184] The navigation system (770) may include memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system (770).

[0185] According to an embodiment, the navigation system (770) may receive information from an external device via the communication device (400) and update previously stored information.

[0186] Depending on the embodiment, the navigation system (770) may be classified as a subcomponent of the user interface device (200).

[0187] The sensing unit (120) can sense the status of the vehicle. The sensing unit (120) can include a posture sensor (e.g., a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight detection sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, etc.

[0188] The sensing unit (120) can obtain sensing signals for vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward / backward information, battery information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illumination, pressure applied to an accelerator pedal, pressure applied to a brake pedal, etc.

[0189] The sensing unit (120) may further include, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.

[0190] The vehicle interface unit (130) can serve as a conduit for various types of external devices connected to the vehicle (100). For example, the vehicle interface unit (130) may be equipped with a port capable of connecting to a mobile terminal, and may be connected to the mobile terminal through the port. In this case, the vehicle interface unit (130) can exchange data with the mobile terminal.

[0191] Meanwhile, the vehicle interface unit (130) may serve as a conduit for supplying electrical energy to a connected mobile terminal. When the mobile terminal is electrically connected to the vehicle interface unit (130), the vehicle interface unit (130) may provide the mobile terminal with electrical energy supplied from the power supply unit (190) under the control of the control unit (170).

[0192] The memory (140) is electrically connected to the control unit (170). The memory (140) can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory (140) can be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory (140) can store various data for the overall operation of the vehicle (100), such as programs for processing or controlling the control unit (170).

[0193] Depending on the embodiment, the memory (140) may be formed integrally with the control unit (170) or implemented as a sub-component of the control unit (170).

[0194] The control unit (170) can control the overall operation of each unit within the vehicle (100). The control unit (170) can be referred to as an ECU (Electronic Control Unit).

[0195] The power supply unit (190) can supply power required for the operation of each component under the control of the control unit (170). In particular, the power supply unit (190) can receive power from a battery or the like inside the vehicle.

[0196] One or more processors and control units (170) included in the vehicle (100) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0197] Meanwhile, in embodiments of the present invention, 'driver', 'passenger', 'driver or passenger (driver / passenger)' means a driver, passenger, co-passenger, or passenger riding in a vehicle capable of autonomous driving according to an embodiment of the present invention, and may be one or more.

[0198] Additionally, in embodiments of the present invention, the term "vehicle" is used to refer to a vehicle capable of autonomous driving through artificial intelligence (AI) or a vehicle capable of receiving such services. Furthermore, in embodiments of the present invention, the "vehicle" can freely switch between manual driving by the driver, fully autonomous driving, and semi-autonomous driving.

[0199] In embodiments of the present invention, the 'vehicle display device' is a display device placed on the front seat of a vehicle (100), and may be formed to be movable in different directions.

[0200] The vehicle display device may be used to mean a movable Center Information Display (CID), or to include both a movable CID and a Head Unit Display (HUD), or to include all of a movable CID, a HUD, and an operation unit related to movement of the CID.

[0201] The vehicle display device may be configured such that the display can move in different directions.

[0202] A vehicle display device includes a display for displaying various screens, and can control the screens displayed on the HUD through the display. Furthermore, the vehicle display device may be implemented with a movable CID to control the screens displayed on the HUD.

[0203] The vehicle display device can generate a signal to move the CID according to the operation of an operation unit installed at another location in the vehicle.

[0204] The vehicle display device can be activated or deactivated by moving in different directions from the front seat of the vehicle and can be used as a flexible controller that can be used by the driver's seat passenger or controlled by the passenger's seat passenger.

[0205] Additionally, the vehicle display device may be operable to switch the screen of the HUD as the front seat of the vehicle moves in different directions.

[0206] FIG. 2 is a block diagram illustrating a vehicle display device (800) related to an embodiment of the present invention.

[0207] In FIG. 2, the vehicle display device (800) can communicate with the components of the vehicle (100) and can be installed, for example, in the front seat inside the vehicle (100).

[0208] The vehicle display device (800) of FIG. 2 may include a communication unit (810), a display unit (820), a plurality of driving units (830), a sensing unit (830), and a control unit (850). In addition, the vehicle display device (800) may be understood to include an input device (860) installed at another location within the vehicle (100). In this case, the vehicle display device (800) may receive a signal generated according to an operation on the input device (860) and perform an operation based on the received signal.

[0209] The vehicle display device (800) may include a first display (825) and a second display (820) implemented to be movable in different directions to display information related to a visual image output to the first display (825) or to function as a controller. Alternatively, in some embodiments, it may be understood that the vehicle display device (800) operates in conjunction with the first display (825), assuming that the vehicle display device (800) and the first display (825) installed in the vehicle (100) are separate devices.

[0210] The first display (825) may be referred to as a rectangular display mounted on a frame containing a cluster in the front seat of the vehicle. In this case, the cluster may be displayed integrally on the rectangular display. In addition, the first display (825) may be understood as a component included in the vehicle display device (800) or as a component separate from the vehicle display device (800).

[0211] Meanwhile, the display unit (820) disclosed in the following description or the display unit (820) of the vehicle display device (800) refers to a second display (820) configured to be movable in different directions unless otherwise described. The first display (825) formed in a longitudinal direction to include the cluster of the front seats of the vehicle is referred to separately from the display unit (820).

[0212] In FIG. 2, when the first display (or rectangular display) is included in the configuration of the vehicle display device (800), the screen output to the first display (825) can be controlled through the display unit (820).

[0213] The communication unit (810) can receive sensing values ​​and / or control values ​​from the vehicle (100) and / or various sensors within the vehicle (100) and various devices / systems such as Advanced Driver Assistance Systems (ADAS) and Driver Monitoring Systems (DMS).

[0214] For example, the communication unit (810) may receive, as the control value, a driving signal for operating a plurality of driving units (830) from an input device (860) separately installed within the vehicle (100). As another example, the communication unit (810) may receive, as the sensing value, a sensing value for operating or limiting the operation of a plurality of driving units (830) in relation to driving safety.

[0215] The display unit (820) is configured to display a screen and move in different directions. As described above, the display unit (820) refers to a second display (820).

[0216] Specifically, the display unit (820) can move between the driver's seat and the passenger seat of the vehicle (100) (first movement direction) or can be moved inward or exposed to the outside based on the provided frame (second movement direction). At this time, the movement in the first and second movement directions is performed independently of each other.

[0217] The plurality of driving units (830) may include a first driving module (830a) and a second driving module (830) that operate to allow the display unit (820) of the vehicle display device (800) to move in different directions.

[0218] The first driving module (830a) and the second driving module (830b) operate independently according to different driving signals. The first driving module (830a) and the second driving module (830b) each provide driving force to the display unit (820) to move the display unit (820) in different directions. To this end, the first driving module (830a) and the second driving module (830b) may each include a motor.

[0219] According to an embodiment, the first driving module (830a) operates to move the display unit (820) in a first direction. According to an embodiment, the second driving module (830b) operates to move the display unit (820) in a second direction different from the first direction.

[0220] Here, the first direction may be a horizontal (left-right) movement direction of the display unit (820), and the second direction may be a vertical (vertical) movement direction of the display unit (820). Alternatively, the first direction may be a movement direction of the display unit (820) between the driver's seat (or center) and the passenger seat of the vehicle, and the second direction may be a movement direction of the display unit (820) so as to be introduced into the internal space of the frame or exposed to the outside from the internal space.

[0221] The first driving module (830a) may include a driving motor (hereinafter, “first driving motor”) that drives the display unit (820) to move in a horizontal direction (left-right direction). Specifically, the first driving motor is driven by a control signal of the control unit (850) that receives the first driving signal, thereby moving the moving frame included in the first driving module (830a) in a horizontal direction (left-right direction), thereby causing the display unit (820) mounted on the moving frame to move in the first direction.

[0222] The second driving module (830b) may include a driving motor (hereinafter, “second driving motor”) that drives the display unit (820) to move in the up-and-down direction (vertical direction). Specifically, the second driving motor is driven by a control signal of the control unit (850) that receives the second driving signal, thereby moving the moving frame included in the second driving module (830b) in the up-and-down direction (vertical direction), thereby causing the display unit (820) mounted on the moving frame to move in the second direction.

[0223] The first driving motor and the second driving motor may be arranged in different directions to provide driving force to move the display unit (820) in different directions. For example, the first driving motor and the second driving motor may be arranged in directions orthogonal to each other.

[0224] In addition, at least one of the first driving motor and the second driving motor is arranged in the same frame as the display unit (820), and can move together with the display unit (820) according to the movement of the frame.

[0225] Meanwhile, the control unit (850) can control the first driving motor to generate rotational forces in different directions based on the detailed direction information included in the first driving signal.

[0226] For example, the display unit (820) can be moved from the driver's seat (or, center) toward the passenger seat by controlling the first driving motor to rotate in the first rotation direction. Also, for example, the display unit (820) can be moved from the passenger seat toward the driver's seat (or, center) by controlling the first driving motor to rotate in the second rotation direction.

[0227] In addition, the control unit (850) can control the second driving motor to generate rotational forces in different directions based on detailed direction information included in the second driving signal.

[0228] For example, the display unit (820) can be moved from the driver's seat (or center) toward the passenger seat by controlling the second driving motor to rotate in the first rotation direction. Also, for example, the display unit (820) can be moved from the passenger seat toward the driver's seat (or center) by controlling the first driving motor to rotate in the second rotation direction.

[0229] In addition, the control unit (850) can generate a control signal to control the screen displayed on the first display (825) according to the movement of the display unit (820) and transmit the generated control signal to the second display (820).

[0230] The sensing unit (830) can detect an input to the vehicle display device (800). In addition, the sensing unit (830) can detect the movement of the second display unit (820) according to the operation of the plurality of driving units (830).

[0231] The sensing unit (830) can detect the movement distance and relative position of the second display unit (820) according to the driving of the first driving module (830a). In addition, the sensing unit (830) can detect the movement distance and relative position of the second display unit (820) according to the driving of the second driving module (830b).

[0232] The sensing unit (830) can transmit the sensing values ​​detected according to the operation of the plurality of driving units (830) to the control unit (850), thereby determining the movement distance and relative position of the second display unit (820).

[0233] The sensing unit (830) can detect whether the movement distance and relative position of the second display unit (820) have reached a preset threshold distance and threshold position and transmit the result to the control unit (850).

[0234] When the second display unit (820) reaches the critical distance and critical position, the control unit (850) can recognize that the second display unit (820) can no longer move in a direction exceeding the critical distance and critical position. Accordingly, when a driving signal for moving in a direction exceeding the critical distance and critical position is received, the control unit (850) can control to perform an operation according to the movement restriction.

[0235] The control unit (850) controls the overall operation of the vehicle display device (800). The control unit (850) can communicate with the vehicle (100) to receive sensing information and status information of the vehicle (100), and transmit information about the status and operation of the vehicle display device (800) to the vehicle (100). In addition, the control unit (850) can communicate with the DMS system (110) of the vehicle (100) to receive monitoring results of the status of the driver / passenger, and control the operation of the vehicle display device (800) differently based on the received monitoring results.

[0236] The control unit (850) can generate a driving signal to drive a plurality of driving units (830) to move the display unit (820). The control unit (850) can generate a first driving signal to drive the first driving module (830a) to move the display unit (820) in a first direction. In addition, the control unit (850) can generate a second driving signal to drive the second driving module (830b) to move the display unit (820) in a second direction different from the first direction.

[0237] The control unit (850) can control the screens displayed on the first and second display units (820, 825).

[0238] The control unit (850) can control the operation of each of the plurality of driving units (830) based on the first driving signal and / or the second driving signal received through the communication unit (810). Specifically, the control unit (850) controls the operation of the first driving module (830a) based on the first driving signal, and controls the operation of the second driving module (830b) based on the second driving signal.

[0239] The control unit (850) controls the first driving module (830a) to operate based on the first driving signal, thereby allowing the second display unit (820) to move in the first direction. At this time, the first direction includes detailed direction information. Based on the detailed direction information of the first direction, the control unit (850) controls the operation of the first driving module (830a) so that the second display unit (820) moves from the driver's seat (or center) of the vehicle (100) to the passenger seat, or from the passenger seat to the driver's seat (or center).

[0240] In addition, the control unit (850) controls the second drive module (830a) to operate based on the second drive signal, thereby allowing the second display unit (820) to move in the second direction. At this time, the second direction includes detailed direction information. Based on the detailed direction information of the second direction, the control unit (850) controls the operation of the second drive module (830b) so that the second display unit (820) moves from inside the frame of the vehicle (100) to be exposed to the outside or to be introduced into the internal space of the frame.

[0241] The input device (860) may be implemented to receive user manipulation for moving the display unit (820). The input device (860) may be installed in a different location of the vehicle (100) from the vehicle display device (800). In addition, the input device (860) may be implemented to receive user manipulation for controlling the lower surface of at least one of the first and second displays (820, 825).

[0242] For example, the input device (860) may be mounted parallel to the driver's seat and the passenger's seat, and may be vertically spaced from the vehicle display device (800). In addition, for example, the input device (860) may be mounted in a position that is convenient for the driver's seat and the passenger's seat occupants to operate by hand without changing their posture.

[0243] In this specification, the input device (860) may be referred to by other names such as 'console (900)', 'console display', and 'input unit'. The input device (860) may be used as an input device that controls the movement of the vehicle display device (800). In addition, the input device (860) may be used as an input device that controls the lower surface of at least one of the first and second displays (820, 825).

[0244] In an embodiment, the input device (860) may be implemented as a separate device from the vehicle display device (800). In this case, the input device (860) and the vehicle display device (800) may perform wired / wireless communication so that the vehicle display device (800) can move in different directions depending on the operation of the input device (860).

[0245] The operation of the input device (860) may be performed in a manner that matches the operation method corresponding to the direction of movement of the vehicle display device (800) so as to intuitively control the direction of movement of the vehicle display device (800). For example, the operation of the input device (860) may be a tilting operation for the direction in which the vehicle display device (800) is to be moved.

[0246] The input device (860) can communicate with the vehicle display device (800) through a communication module (not shown). A signal generated by an operation on the input device (860) can be received by the communication unit (810) of the vehicle display device (800) through the communication module (not shown).

[0247] Specifically, a signal corresponding to a user operation applied through an input device (860) may be converted into a driving signal through a control unit (850) and transmitted to a plurality of driving units (830). Based on different operations applied to the input device (860), different driving modules of the plurality of driving units (830) may operate.

[0248] For example, when a first signal generated by a first operation on an input device (860) is transmitted to a vehicle display device (800), the control unit (850) can transmit a first driving signal corresponding to the received first signal to the first driving module (830a) to control the display unit (820) to move in the first direction.

[0249] Here, the first operation may include different direction information, for example, one of the directions corresponding to the driver's seat (center) and the other corresponding to the passenger seat. In addition, the first direction may be one of multiple directions in which the display unit (820) moves between the driver's seat (center) and the passenger seat.

[0250] Also, for example, when a second signal generated according to a second operation on the input device (860) is transmitted to the vehicle display device (800), the control unit (850) can transmit a second driving signal corresponding to the received second signal to the second driving module (830a) to control the display unit (820) to move in the second direction.

[0251] Here, the second operation may include different direction information, for example, one of the directions corresponding to the vehicle dashboard and the other corresponding to the rear seat of the vehicle. In addition, the second direction may be one of multiple directions in which the display unit (820) moves into the internal space of the frame in which the components of the vehicle display device (800) are built, or moved outward from the internal space.

[0252] FIG. 3 is a drawing showing a vehicle display device (800) according to an embodiment of the present invention installed in a vehicle (100).

[0253] As illustrated in FIG. 3, a vehicle display device (800) is formed to include a second display (820) that is connected to one side of a frame (802) formed to correspond to the driver's seat (or center) and the passenger seat in the vehicle (100) and is configured to perform screen control for a rectangular display installed within the frame, i.e., a first display (825).

[0254] In Fig. 3, the frame (802) is formed to correspond to a cluster and can be formed to extend from the driver's seat to the passenger seat of the vehicle (100). In addition, a rectangular display, i.e., a first display (825), is installed in front of the frame (802).

[0255] A cabin may be formed inside the frame (802), and a slot (801) may be formed horizontally at the bottom of the frame (802). The second display (820) may move left and right along the slot (801) according to a driving signal. In addition, the second display (820) may be introduced into the cabin through the slot (801) or may be withdrawn from the cabin to the outside through the slot (801) according to another driving signal.

[0256] At least a portion of the vehicle display device (800) may be positioned within the internal cabin of the frame (802). For example, a plurality of drive modules for moving the vehicle display device (800) in different directions and a portion of the frame including the drive modules may be positioned within the internal cabin of the frame (802). In this case, the plurality of drive modules and the frame may move in different directions within the internal cabin of the frame (802) as the vehicle display device (800) moves in different directions.

[0257] The vehicle display device (800) may include a Center Information Display (CID). In this specification, the Center Information Display (CID) may be referred to as a display unit (820), i.e., a second display (820).

[0258] The second display (820) may be positioned between the driver's seat (or center) and the passenger seat, and may be configured to move between the passenger seat and the driver's seat according to a driving signal. Specifically, the second display (820) may move left and right along a slit (801) formed on one side of the frame, for example, at the bottom of the frame.

[0259] Additionally, the second display (820) can be moved to be introduced into the slit (801) of the frame (802) or exposed from the internal space of the frame (802) to the outside of the slit (801) based on another driving signal.

[0260] Components of the vehicle display device (800) described above with reference to FIG. 2 may be built into the internal space of the frame (802).

[0261] For example, each driving motor constituting a plurality of driving units (830) that provide driving force for moving the vehicle display device (800) in different directions, and a fixed / movable frame, etc. may be located in the internal space of the frame (802).

[0262] In addition, for example, a control unit for controlling the movement and screen of a vehicle display device (800), i.e., a processor (850), may be provided in the internal space of the frame (802). Here, the processor (850) may include, for example, a single SoC (System on a Chip), MCU (Micro Controller Unit) including a hypervisor, a CPU (Data Processing Unit), an RT core, an AP core, an NPU, a GPU, etc. In addition, the processor (850) may be linked with software for one or more AI learning models.

[0263] In an embodiment, the processor (850) may control the movement and screen of the vehicle display device (800), as well as generate a screen control signal for the rectangular display, i.e., the first display (825), according to the movement and / or operation of the second display (820).

[0264] For example, the processor (850) can control the screen displayed on the rectangular display (825) to be different depending on whether the second display (820) is moved to the driver's seat (or center) or the passenger seat.

[0265] In the initial state, the second display (820) may be inserted into the inner cabin of the frame (802) at a position corresponding to the driver's seat (or center).

[0266] In an embodiment, when the vehicle (100) is turned on, the second display (820) may gradually move in a direction in which it is exposed toward the outside from the slot (801) of the frame (802). Along with or sequentially with this movement, the screen of the second display (820) of the vehicle display device (800) may be turned on. At this time, it can be said that the vehicle (100) turning on operation generates the second driving signal.

[0267] While the vehicle (100) is driving, the second display (820) can move in the horizontal direction of the frame (802) along the slot (801) based on the received first driving signal. In addition, the second display (820) can move in the vertical direction (up and down) so as to be re-introduced into the internal space of the slot (801) based on the received second driving signal.

[0268] At this time, the first driving signal and the second driving signal may be generated according to a preset input method, for example, a designated gesture input, a voice command, a touch input to the display unit (820), and different operations to the input device (860).

[0269] In an embodiment, when it is recognized that the vehicle (100) is turned off or has entered parking mode, the second display (820) may return to the set initial state. For example, if the second display (820) of the vehicle display device (800) is exposed to the outside of the slot (801), it may move to be drawn into the interior space of the slot (801). In addition, if the second display (820) has moved to the passenger seat, it may move to a position corresponding to the driver's seat (or center). Along with or sequentially with these operations, the screen of the second display (820) of the vehicle display device (800) may be turned off. At this time, it can be said that the operation of turning off the vehicle's (100) generates the first driving signal and / or the second driving signal depending on the current position of the second display (820) of the vehicle display device (800).

[0270] FIGS. 4A and 4B are exemplary drawings illustrating movement in different directions of a vehicle display device (800) according to an embodiment of the present invention. Here, movement of the vehicle display device (800) in different directions means that the display unit (820), i.e., the second display, moves in different directions.

[0271] Specifically, FIG. 4a is an example of a vehicle display device (800) moving in a direction in which it is introduced into or withdrawn from the internal space of the slot (801) of the frame (hereinafter, “second movement direction”).

[0272] And, FIG. 4b is an example in which a vehicle display device (800) moves along the horizontal direction of a slot (801) between the driver's seat (or center) and the passenger seat (hereinafter, 'first movement direction').

[0273] First, referring to FIG. 4b, the vehicle display device (800) moves in the first movement direction along the slot (801) in response to the first driving module operating according to the received first driving signal.

[0274] Here, the first moving direction includes the vehicle display device (800) moving from the driver's seat (or center) to the passenger seat and from the passenger seat to the driver's seat (or center).

[0275] For example, in FIG. 4b, the vehicle display device (800) can move from the center (or driver's seat) of the vehicle (100) toward the passenger seat based on the first driving signal (a). Also, for example, in FIG. 4b, the vehicle display device (800) can move from the passenger seat of the vehicle (100) toward the center (or driver's seat) based on the first driving signal (b).

[0276] Meanwhile, FIG. 4b illustrates embodiments in which the vehicle display device (800) moves in the first movement direction while being exposed to the outside from the slot (801), but the vehicle display device (800) can move in the first movement direction while being inserted into the inside of the slot (801).

[0277] In this case, in order to allow the vehicle display device (800) to be externally recognized as moving in the first movement direction, a portion of the vehicle display device (800) may be moved in a state in which it is exposed to the outside of the slot (801). Alternatively, while the vehicle display device (800) is moved in the first movement direction while being inserted into the slot (801), an LED (not shown) provided around the slot (801) may be illuminated along the movement direction. Alternatively, while the vehicle display device (800) is moved in the first movement direction while being inserted into the slot (801), a display indicating movement may be output at the bottom of the rectangular display (825, FIG. 3).

[0278] Continuing with reference to FIG. 4a, the vehicle display device (800) operates the second driving module in response to the received second driving signal, so that the vehicle display device (800) moves in the second movement direction.

[0279] Here, the second movement direction includes a movement direction in which the vehicle display device (800) is introduced into the internal space of the slot (801) and a movement direction in which the vehicle display device (800) is withdrawn from the slot (801) and exposed to the outside.

[0280] For example, in FIG. 4a, the vehicle display device (800) can move from the center (or driver's seat) of the vehicle (100) toward the passenger seat in the internal space of the slot (801) based on the second driving signal (a). Also, for example, in FIG. 4b, the vehicle display device (800) can move from the passenger seat of the vehicle (100) toward the center (or driver's seat) based on the first driving signal (b).

[0281] In an embodiment, the vehicle display device (800) of FIG. 4A can control the driving of the second driving module to change from one of an inward state in which only the first area of ​​the display unit (820, FIG. 2) is exposed to the outside of the slit (801) to an outward state in which the exposure area is gradually expanded from the first area to the second area, according to a second driving signal.

[0282] According to the second driving signal, a portion of the vehicle display device (800) may be flexibly bent and exposed to the outside of the slit (801) or introduced into the inside of the slit (801).

[0283] When the vehicle display device (800) is exposed to the outside of the slit (801) in response to the second driving signal, the screen of the vehicle display device (800) may be turned on at that time. Thereafter, when the vehicle display device (800) is drawn into the inside of the slit (801) in response to the second driving signal, the screen of the vehicle display device (800) may be turned off at that time.

[0284] Meanwhile, FIG. 4a illustrates embodiments in which the vehicle display device (800) is exposed to the outside or inserted into the inside from the slot (801) at a position corresponding to the driver's seat (or center), but the vehicle display device (800) may also move in a second movement direction in which it is exposed to the outside or inserted into the inside from the slot (801) at a position corresponding to the 'passenger seat'.

[0285] In the embodiment, the vehicle display device (800) moves in the first movement direction or the second movement direction independently.

[0286] For example, the vehicle display device (800) may sequentially move in a first movement direction and / or a second movement direction based on the time at which the first driving signal and the second driving signal are received. In addition, for example, when the first driving signal and the second driving signal are received simultaneously, the vehicle display device (800) may move in one direction and then move in the other direction based on a preset standard.

[0287] Also, for example, when the first driving signal and the second driving signal are received simultaneously, the vehicle display device (800) can move simultaneously in directions corresponding to each of them. For example, when the first and second driving signals are received simultaneously, the vehicle display device (800) can simultaneously perform an operation of being drawn into or drawn out of the slit (801) while moving between the driver's seat (or sensor (Center)) and the passenger seat.

[0288] In this way, the vehicle display device (800) can move in different directions simultaneously because the driving modules for moving in different directions are provided separately.

[0289] As shown in Fig. 4b, the driving force of the first driving motor included in the first driving module is provided to the first driving module to move the vehicle display device (800) in the first movement direction. In addition, separately, as shown, the driving force of the second driving motor included in the second driving module is provided to the second driving module to move the vehicle display device (80) in the second movement direction.

[0290] The vehicle display device (800) receives a first driving signal as a control signal for generating driving force to the first driving motor. In addition, the vehicle display device (800) receives a second driving signal as a control signal for generating driving force to the second driving motor.

[0291] Here, the first driving signal and the second driving signal can be generated by various methods. For example, a driving signal matching each method can be generated based on at least one of gesture input, voice command, touch input for the display of the vehicle display device (800), button input, and operation of the operation unit (860).

[0292] For this purpose, data for driving signals matching each input can be stored in advance in the memory (not shown) of the vehicle display device (800).

[0293] In an embodiment, when the driving module corresponding to the generated driving signal operates, the movement direction of the vehicle display device (800) according to the operation of the driving module can be displayed on the display unit of the vehicle display device (800).

[0294] For example, while the vehicle display device (800) moves from the driver's seat (or center) toward the passenger seat in response to the first driving signal, a display indicating the corresponding moving direction (e.g., a rightward arrow image) may be output to the display unit (820, FIG. 2).

[0295] Alternatively, for example, while the vehicle display device (800) is pulled outward from the inside of the slit (801) of the frame in response to a second drive signal, a display indicating the corresponding moving direction (e.g., a downward arrow image) may be displayed on the bottom of a rectangular display mounted on the frame, i.e., the first display (825).

[0296] Hereinafter, with reference to FIG. 5, a method for controlling the screen of a vehicle display device (800) according to whether an auxiliary seat passenger is detected according to an embodiment of the present invention will be specifically described.

[0297] A vehicle display device (800) according to an embodiment of the present invention includes a first display (825) installed in a rectangular shape in the front seat of a vehicle and a display unit, i.e., a second display (820), formed to be movable in different directions. In addition, unless otherwise described, each operation illustrated in FIG. 5 may be performed through a control unit (850) of the vehicle display device (800).

[0298] The vehicle display device (800) can receive monitoring results according to the operation of a passenger monitoring system in the vehicle (100), for example, a DMS system (110), through a communication unit (810).

[0299] When the vehicle display device (800) is activated, the first screen is displayed on the first display (825) that is installed in a long direction to correspond to the driver's seat and the passenger's seat (10).

[0300] Here, the first screen may be a cluster screen containing vehicle status information and / or a screen for the driver, such as a navigation screen. In this case, the first screen may be displayed on the entire first display (825).

[0301] Meanwhile, as a condition for displaying the first screen on the first display (825), it may be required that the ignition of the linked vehicle (100) be turned on. However, the ignition of the vehicle (100) being turned on may be a starting condition for activating the first display (825) and not a maintenance condition. Alternatively, even after the ignition of the vehicle (100) is switched to the off state, the activation of the first display (825) and the display of the first screen may be maintained for a certain period of time.

[0302] Continuing, the vehicle display device (800) can detect the presence or absence of an passenger in the passenger seat by receiving monitoring information of the DMS system (110) of the vehicle (100), for example, sensing data of the DMS, through the receiving unit (20).

[0303] Here, the DMS (Driver Monitoring System) system recognizes the presence of the driver and passengers through a camera mounted on the interior dashboard of the vehicle (100), and can identify the emotional state, attention, etc. of the recognized driver / passenger through facial recognition.

[0304] The vehicle display device (800) can receive monitoring information from the vehicle's DMS system (110) in real time / periodically to recognize the presence of passengers in the driver's seat and passenger seat and their behavior and emotional states.

[0305] For example, the vehicle display device (800) can detect the absence or presence of a passenger in the passenger seat based on sensing data from the DMS within the vehicle (100). In addition, after the passenger in the passenger seat is detected, the vehicle display device (800) can recognize a change in the behavioral state of the passenger in the passenger seat based on sensing data from the DMS received subsequently, or determine that the passenger in the passenger seat is no longer detected.

[0306] Next, the vehicle display device (800) can generate a second screen for the passenger in the passenger seat on at least a portion of the first display (825) based on the recognition result of the passenger in the passenger seat (30).

[0307] Here, the second screen is an infotainment screen that can be independently controlled for the passenger in the passenger seat, and may include various screens for the passenger in the passenger seat, such as a navigation screen, a menu screen, and various entertainment screens that are distinct from those in the driver's seat.

[0308] Also, here, the creation of a second screen on the first display (825) means that a screen for the passenger seat, distinct from the first screen, is displayed at a location corresponding to the passenger seat. Accordingly, the screen of the first display (825) now operates from full screen mode to split mode, so that the first screen and the second screen are displayed separately.

[0309] That is, when a passenger is detected in the passenger seat of the vehicle (100), the screen of the first display (825) is automatically divided into a first screen for the driver and a second screen for the passenger, without any axle operation by the passenger or driver. Accordingly, a high-level user experience that can better satisfy user needs is provided.

[0310] Meanwhile, in the embodiment, if the passenger in the passenger seat is no longer detected based on the subsequently received DMS sensing data, the screen mode of the first display (825) may be returned to the full mode. That is, since it is determined that the second screen for the passenger in the passenger seat is no longer necessary, only the first screen (e.g., cluster screen + navigation screen for the driver) may be displayed again on the entire first display (825).

[0311] In this way, the vehicle display device (800) according to the present invention operates so that, when the large screen installed in the front seat of the vehicle (100), i.e., the first display (825), recognizes the presence of a passenger in the passenger seat, it automatically generates and provides a screen for the passenger in the passenger seat. Accordingly, the driver or passenger in the passenger seat can immediately receive the desired service without any additional operation.

[0312] FIG. 6 is an example of providing a screen of a first display (825) of a vehicle display device (800) in a split mode based on detection of a passenger in the passenger seat of a vehicle (100).

[0313] In an embodiment, the control unit (850) of the vehicle display device (800) may execute the passenger execution mode based on the presence of a passenger in the passenger seat recognized based on DMS sensing data of the vehicle (100). Upon execution of the passenger execution mode, the screen of the first display (825) is switched from full mode to split mode, and a second screen for the passenger in the passenger seat is generated at a location corresponding to the passenger seat of the vehicle.

[0314] At this time, the display area of ​​the first screen displayed on the first display (825) is reduced to the remaining area excluding the area of ​​the second screen.

[0315] Referring to FIG. 6, when the first display (825) of the vehicle display device (800) operates in split mode, a first screen (910) for the driver, for example, a navigation screen for driving, is displayed in the left and center areas, and a second screen (920) for the passenger in the passenger seat, for example, a menu screen for executing infotainment, is displayed in the right area corresponding to the passenger seat.

[0316] At this time, the second display (820) configured to be movable may be inserted into the internal space of the frame (802), as illustrated in FIG. 6.

[0317] Alternatively, in another embodiment, when an interaction of a passenger in the passenger seat with respect to a second screen displayed on the first display (825) is detected, the second display (820) may be pulled out of the frame (802) through a slot (801) formed in the frame (802) and moved toward a position corresponding to the passenger seat. Accordingly, convenience may be provided so that the passenger in the passenger seat may control the second screen of the first display (825) using the second display (820).

[0318] In this regard, FIG. 7 shows an example in which a passenger in the passenger seat controls the screen of the first display (825) using the second display (820) while the screen of the first display (825) is provided in a split mode.

[0319] In an embodiment, the second display (820) of the vehicle display device (800) may display different control screens / execution screens depending on whether a second screen is generated on the first display (820).

[0320] Specifically, the control unit (850) of the vehicle display device (800) can apply a different screen control target of the first display (825) corresponding to the input of the second display (820) depending on whether the passenger in the passenger seat is recognized.

[0321] For example, the control unit (850) may generate a control signal by matching the screen control corresponding to the input of the second display (820) to the second screen of the first display (825) based on the recognition of the presence of an auxiliary seat passenger. Alternatively, for example, the control unit (850) may provide a control signal by matching the screen control corresponding to the input of the second display (820) to the first screen of the first display (825) based on the recognition of the absence of an auxiliary seat passenger.

[0322] Referring to FIG. 7, when the first display (825) is divided into a first screen (910) for the driver and a second screen (921) for the passenger in the passenger seat based on detection of the passenger in the passenger seat, the passenger in the passenger seat can attempt to interact with the second screen (921).

[0323] When an interaction attempt on the second screen (921) is detected, the vehicle display device (800) operates a plurality of driving units (830) to move the second display (820) configured to be movable to a position corresponding to the passenger seat.

[0324] As shown in (a) of FIG. 7, when the second display (820) is moved to a position corresponding to the passenger seat, the second screen (921) for the passenger seat displayed on the first display (825), for example, the control screen / execution screen (922) for the app execution menu screen, is displayed on the second display (820).

[0325] Accordingly, as illustrated in (b) of FIG. 7, the passenger in the auxiliary seat can control the second screen of the first display (825) through a touch input to the second display (922). For example, based on a horizontal swiping touch input to the current control screen / execution screen (922) of the second display (820), the menu screen (923) changed so that the application “D” is centered is controlled to be displayed on the second screen of the first display (825).

[0326] In this case, the control screen / execution screen (924) of the application “D” is adaptively displayed on the second display (820). At this time, the control screen / execution screen (924) may include detailed information or execution information about the selectable “D” application.

[0327] As described above, the vehicle display device (800) can detect a passenger in the front seat of a vehicle and generate a second screen for the passenger in the front seat on the first display, and control the second screen through the second display implemented to enable the passenger in the front seat to move.

[0328] The vehicle display device (800) can update the presence and status of the passenger in the passenger seat based on sensing data received from the DMS system of the vehicle (100) even after generating a second screen for the passenger in the passenger seat on the first display (825).

[0329] In this regard, FIGS. 8 and 9 are examples showing movement of the second display (820) based on the recognition that the passenger in the passenger seat is not detected or is in a drowsy state after the second screen is generated on the first display (825).

[0330] In an embodiment, the vehicle display device (800) may control a plurality of driving units (830) to drive the second display (820) in a predetermined direction depending on whether or not an auxiliary passenger is detected in the vehicle. For example, the control unit (850) of the vehicle display device (800) may operate the first and second driving modules (830a, 830b) to return the second display (820) to its initial position and state when the auxiliary passenger is no longer detected based on DMS sensing data.

[0331] In addition, in the embodiment, the vehicle display device (800) may control the control unit (850) to simultaneously / sequentially drive the second display (820) in a predetermined direction and switch the screen mode of the first display (825) back to the full mode depending on whether or not the passenger in the vehicle is detected. For example, the control unit (850) of the vehicle display device (800) may control the screen so that the second display (820) returns to the initial position and state and simultaneously / sequentially the second screen generated on the first display (825) disappears when the passenger in the vehicle is no longer detected based on DMS sensing data.

[0332] Here, based on the DMS sensing data, the case where the passenger in the passenger seat is no longer detected includes not only the absence of the passenger in the passenger seat, but also the case where the passenger in the passenger seat is estimated to no longer use the second screen of the first display (825).

[0333] For example, if the front passenger is detected to have reclined the seat and closed his or her eyes, the DMS sensing data may be used to determine that the passenger is drowsy, and after a predetermined period of time, it may be determined that the front passenger is no longer detected.

[0334] In this case, the screen of the first display (825) gradually switches from split mode to full mode.

[0335] At this time, the screen of the first display (825) gradually switches to full mode, which may include, for example, seamlessly switching the second screen to a portion of the first screen. Alternatively, it may include, for example, gradually dimming the brightness of the second screen and switching to a portion of the first screen after a certain period of time. At this time, the sound for the second screen is maintained for a certain period of time, so that if there is a subsequent interaction from the passenger in the front seat, the first display (825) can be controlled to quickly display the second screen again.

[0336] Referring to FIGS. 8 and 9, the vehicle display device (800) can recognize that the passenger in the passenger seat is no longer detected based on the vehicle's DMS sensing data while the second screen (920) for the passenger in the passenger seat is displayed on the first display (825) and the control screen / execution screen of the second screen (920) is displayed on the second display (820).

[0337] For example, if the passenger in the front seat is recognized as not moving for a predetermined period of time or is in a sleeping state (e.g., with eyes closed) through the vehicle interior camera, the vehicle display device (800) may determine that the passenger in the front seat has no intention of using the second display (820), and control the drive module so that the second display (820) is hidden in the internal space of the frame.

[0338] For example, as shown in FIG. 8, while the second screen (920) is still being displayed on the first display (825), the second display (820) can be operated to be hidden in a direction (M1) corresponding to the internal space of the frame. To this end, a control signal is generated to operate the second driving module (830b) of the vehicle display device (800) to correspond to M1. Before the second display (820) is hidden, the screen is switched to an inactive state.

[0339] Then, as shown in FIG. 9, the control unit (850) operates the first driving module (830a) so that the second display (825) returns to its initial position, i.e., the position corresponding to the driver's seat (or center).

[0340] Meanwhile, the operating sequence of the first and second driving modules (830a, 830b) described above may differ. For example, the second display (820) may be moved to its initial position in an exposed state by the operation of the first driving module (830a), and then the second driving module (830b) may be operated to conceal the second display (820). Alternatively, the first and second driving modules (830a, 830b) may operate simultaneously.

[0341] In this way, while the second display (825) returns to its initial position, the screen mode of the first display (825) is switched to full mode. Accordingly, the expanded first screen (910') is displayed on the first display (820).

[0342] As another embodiment, the passenger execution mode of the first display (825) may be intentionally disabled based on an input to the vehicle display device (800). In such a case, the second display (820) may not be hidden and may be used to control the first screen of the first display (825).

[0343] In this regard, FIG. 10 is a drawing showing an example of a driver controlling the screen of a first display (825) using a second display (820).

[0344] While the first display (825) is in full-screen mode, a first screen (1010) for the driver is displayed across the entire first display (825). The first screen (1010) includes a cluster screen related to the vehicle's driving status. At this time, the driver can interact with the first screen (1010) using the exposed second display (820).

[0345] For example, referring to FIG. 10, the second display (820) is positioned in the driver's seat (or center) in an exposed state, and a control screen / execution screen (1011) related to the "App A" widget screen displayed in the center of the first display (825) operating in full screen mode is displayed.

[0346] Instead of directly interacting with the first display (825), the driver can control the screen of the first display (825) using a second display (820) located closer to the driver's seat.

[0347] For example, as shown in (a) of FIG. 10, through a touch input, for example, a horizontal sliding touch input, on the control screen / execution screen (1011) of the second display (820), the widget screen displayed in the center of the first display (825) is changed to the "App B" widget screen, as shown in (b) of FIG. 10, and the screen-controlled first screen (1012) is displayed. In this case, the screen of the second display (820) is switched to the control screen / execution screen (1013) related to the screen-controlled first screen (1012).

[0348] As described above, the vehicle display device (800) according to an embodiment of the present invention can operate to conceal the second display or to be used for screen control of the first display when it is determined that the front passenger is no longer detected. This further expands usability by allowing the second display to be fully utilized not only for the front passenger but also for the driver.

[0349] Above, we have specifically examined a method for controlling the screen of a first display based on detection of a front passenger seat occupant in a vehicle. Below, we will describe examples of a method for controlling movement of a second display based on detection of a front passenger seat occupant in a vehicle.

[0350] Figure 11 is another flowchart for explaining a method of moving a vehicle display device depending on whether an auxiliary seat passenger is detected.

[0351] Also, FIGS. 12a and 12b are exemplary conceptual diagrams specifically explaining the movement method of FIG. 11.

[0352] First, referring to FIG. 11, a vehicle display device (800) according to an embodiment of the present invention includes a first display (825) installed in a rectangular shape to correspond to the driver's seat and the passenger's seat, and a second display (820) configured to move between the driver's seat and the passenger's seat. In addition, unless otherwise described, each operation illustrated in FIG. 11 can be performed through the control unit (850) of the vehicle display device (800).

[0353] First, when the vehicle display device (800) is activated, a first screen is displayed on the first display (825) (1110). At this time, the activation of the vehicle display device (800) can be connected to enable communication with the DMS system of the vehicle (100) based on the vehicle being turned on.

[0354] Continuing, the vehicle display device (800) can receive monitoring results according to the operation of the vehicle's DMS system (110) through the communication unit (810). In addition, the vehicle display device (800) can recognize whether an passenger in the passenger seat is present based on the received sensing data of the DMS system (110) (1120).

[0355] When a passenger is seated in the passenger seat, the presence of the passenger can be detected using the seat weight sensor. However, using sensing data from the DMS system (110) to detect the presence of the passenger can be said to include monitoring whether the passenger wants to use the first display (825).

[0356] For example, the vehicle display device (800) can recognize the presence of a passenger in the front seat based on monitoring information about the vehicle occupants. Also, for example, the vehicle display device (800) can recognize that the passenger in the front seat is no longer detected based on sensing data from the DMS system (110). Also, for example, the vehicle display device (800) can recognize whether the passenger in the front seat is in a state, for example, drowsy, based on sensing data from the DMS system (110).

[0357] In an embodiment, the presence and status monitoring of the passenger seat based on the DMS sensing data in step (1120) may be initiated and maintained with at least the first display (825) being activated and the first screen being displayed.

[0358] Next, the vehicle display device (800) can determine whether to move the second display (820) configured to move between the driver's seat and the passenger's seat based on the recognition result of the passenger in the passenger seat (1130).

[0359] Specifically, the vehicle display device (800) can execute passenger mode when a passenger in the passenger seat is detected based on DMS sensing data, and execute driver mode otherwise.

[0360] When the passenger mode is activated, the control unit (850) of the vehicle display device (800) can operate the first drive module (830a) to move the second display (820) to a position corresponding to the passenger seat. At this time, if the second display (820) is hidden in the internal space of the frame (802), the second drive module (830b) can be additionally operated to expose the second display (820) to the outside of the frame (802).

[0361] Referring to FIGS. 12a and 12b, there is an example in which the second display (820) moves when the presence of a passenger in the passenger seat is detected based on DMS sensing data while the first screen (1210) is displayed on the first display (825) of the vehicle display device (800).

[0362] First, the second drive module (830b) is operated to move the second display (820) in the direction (M2) in which it is pulled outward through a slot formed in the frame.

[0363] Then, the first driving module (830a) is operated to move the second display (820) horizontally (M3) along the slot toward the passenger seat. Then, the screen mode of the first display (825) may be changed to a split mode, and a preparation screen (1210'), for example, a modified first screen, may be displayed.

[0364] At this time, the control unit (850) of the vehicle display device (800) may operate the first and second drive modules (830a, 830b) in a different order than the above. For example, after operating the first drive module (830a) so that the second display (820) moves in the horizontal direction (M3) while being hidden, the second drive module (830b) may be operated. Alternatively, the first and second drive modules (830a, 830b) may be operated simultaneously.

[0365] In driver mode, the control unit (850) of the vehicle display device (800) may operate or not operate the plurality of driving units (830) so that the second display (820) is positioned at a position corresponding to the driver's seat (or, center). That is, if the second display (820) is positioned at a position corresponding to the driver's seat (or, center), which is the initial position, it is determined that the second display (820) does not move. On the other hand, if the passenger mode is switched to the driver's mode while the second display (820) is positioned at a position corresponding to the passenger seat, it is determined that the second display (820) moves to the initial position, and at least the driving of the first driving module (830a) can be controlled.

[0366] Meanwhile, in some embodiments, the vehicle display device (800) may control the movement of the second display (820) only based on the recognition of the passenger in the passenger seat. In such a case, if it is determined that the passenger in the passenger seat intends to use the first display (825) after the second display (820) has moved to the passenger seat position, then the first display (825) may be operated to display a second screen for the passenger in the passenger seat.

[0367] Here, the intention of the passenger seat occupant to use the first display (825) may include, for example, an input to an area of ​​the first display (825) (e.g., a display area corresponding to the passenger seat) or an input to a moved second display (820).

[0368] As described above, the vehicle display device (800) according to an embodiment of the present invention is implemented so that, when the presence of a passenger in the passenger seat is detected, the second display automatically moves toward the passenger seat, allowing the passenger to easily control the screen for the passenger. Accordingly, the passenger in the passenger seat can use the second display to control the screen of the first display without additional manipulation, providing a convenient user experience while also enhancing usability.

[0369] FIG. 13a is a conceptual diagram for explaining a console (900) for controlling the display or movement of a vehicle display device (800) according to an embodiment of the present invention, and FIGS. 13b to 13e are conceptual diagrams for explaining the operation of the related console.

[0370] The console (900) used in this specification refers to an operating unit or input device for manipulating the operation of a vehicle display device (800).

[0371] In one embodiment, the console (900) illustrated in FIG. 13a may be understood as the same device as the input device (860) of FIG. 2. In this case, the console (900) may be understood as being integral with the vehicle display device (800).

[0372] In another embodiment, the console (900) may be understood as a separate input device distinct from the vehicle display device (800). In such a case, the console (900) may be connected wired / wirelessly to enable communication with the vehicle display device (800) while it is on.

[0373] The console (900) may be positioned between the driver's seat and the passenger's seat in the front of the vehicle (100), as illustrated in FIG. 13a. Accordingly, both the driver in the driver's seat and the passenger in the passenger's seat can easily operate the console (900) without changing their posture.

[0374] The console (900) may include an operating unit (910) configured to move and / or tilt within the frame. In addition, although not shown, the console (900) may be equipped with a sensor for detecting movement and / or tilting of the operating unit (910). In addition, the console (900) may be equipped with a processor (not shown) and a communication module (not shown) for generating a signal corresponding to the detected sensing value and transmitting the signal to the vehicle display device (800).

[0375] Depending on the direction of movement of the operating unit (910), different signals can be transmitted from the console (900) to the vehicle display device (800).

[0376] For example, as the operating unit (910) moves from the driver's seat (or center) toward the passenger seat, a first driving signal may be generated to move the vehicle display device (800) from the driver's seat (or center) to the passenger seat. Then, the vehicle display device (800) may move toward the passenger seat along the horizontal direction of the slot (801) of the frame (802) based on the first driving signal.

[0377] Also, for example, as the operating unit (910) moves from the passenger seat toward the driver's seat (or the center), a second driving signal may be generated to move the vehicle display device (800) from the passenger seat toward the driver's seat (or the center). Then, the vehicle display device (800) may move toward the driver's seat (or the center) along the horizontal direction of the slot (801) of the frame (802) based on the second driving signal.

[0378] Depending on the tilting direction of the operating unit (910), different signals can be transmitted from the console (900) to the vehicle display device (800).

[0379] For example, as the operating unit (910) tilts downward (or toward the rear seat of the vehicle (100)), a second driving signal may be generated to pull the vehicle display device (800) outward through the slot (801) from the inner space of the frame (802). Then, the vehicle display device (800) is gradually pulled outward through the slot (801) of the frame (802) based on the second driving signal.

[0380] Also, for example, as the operating unit (910) tilts upward (or toward the front HUD of the vehicle (100)), a second driving signal may be generated to move the vehicle display device (800) into the internal space of the frame (802). Then, the vehicle display device (800) is gradually introduced into the internal space of the frame (802) through the slot (801) of the frame (802) based on the second driving signal.

[0381] The vehicle display device (800) can receive a signal according to the operation of the console (900) from the console (900) through the communication unit (810).

[0382] Specifically, the vehicle display device (800) generates a first driving signal based on a first signal according to a first operation of the console (900), and controls the operation of the first driving module (830a) based on the generated first driving signal, thereby moving the vehicle display device (800) in the first movement direction.

[0383] Here, the first signal according to the first operation of the console (900) is a signal that triggers the vehicle display device (800) to move horizontally along the slot (801) with respect to the frame (802). In addition, the generated first drive signal triggers the operation of the first drive module (830a) so that the vehicle display device (800) moves horizontally along the slot (801). Accordingly, the vehicle display device (800) performs a movement operation in the first movement direction, moving between the driver's seat (or, center) and the passenger seat.

[0384] The vehicle display device (800) generates a second driving signal based on a second signal according to a second operation of the console (900), and controls the operation of the second driving module (830b) based on the generated second driving signal, thereby moving the vehicle display device (800) in the second movement direction.

[0385] Here, the second signal according to the second operation of the console (900) is a signal that triggers the vehicle display device (800) to be pulled out from the slot (801) with respect to the frame (802) or to be drawn into the internal space along the slot (801) (i.e., to move vertically). In addition, the generated second driving signal triggers the operation of the second driving module (830b) so that the vehicle display device (800) is drawn into the internal space of the slot (801) or drawn out. Accordingly, the vehicle display device (800) performs a movement operation in the second movement direction, such that it is drawn out from the slot (802) or moves into the internal space of the slot (802).

[0386] Meanwhile, as described above, the first and second driving signals for moving the vehicle display device (800) in different directions can be generated through various input methods. Below, a specific method for controlling the movement of the vehicle display device (800) by generating the first and second driving signals based on manipulation of the console will be described.

[0387] FIGS. 13b to 13e are drawings for explaining that the vehicle display device (800) moves in different directions, i.e., vertically or horizontally, according to various operations of the console (900).

[0388] Specifically, FIGS. 13d and 13e are examples of generating a first driving signal for moving the vehicle display device (800) in a first movement direction based on a first signal according to a first operation of the console (900). Here, moving the vehicle display device (800) in the first movement direction means moving between the driver's seat (or center) and the passenger seat of the vehicle (100).

[0389] And, FIG. 13b and FIG. 13c are examples of generating a first driving signal for moving the vehicle display device (800) in a second movement direction based on a second signal according to a second operation of the console (900). Here, moving the vehicle display device (800) in the second movement direction means moving so as to be hidden in the internal space of the frame in which the vehicle display device (800) is located or exposed to the outside from the internal space.

[0390] The console (900) can be used as an operating unit or input device for controlling the movement of the vehicle display device (800) as shown in FIGS. 13b to 13e.

[0391] The console (900) is connected to enable communication when the vehicle display device (800) is activated, and can receive a signal corresponding to an input to the operation unit (910) of the console (900). The vehicle display device (800) operates at least one of a plurality of driving units (830) based on the received signal, thereby causing the vehicle display device (800) to move in a direction matching the input.

[0392] When the vehicle display device (800) becomes inactive, the console (900) may be disconnected from the vehicle display device (800) and may be switched to a state in which it cannot receive a signal corresponding to an input to the operation unit (910) of the console (900).

[0393] The console (900) includes an operating unit (910) formed to be able to move left, right, up, and down or tilt within a fixed frame as shown in FIGS. 13b to 13e.

[0394] In an embodiment, the fixed frame may have a horizontally elongated oval shape. On the other hand, the operating unit (910) located within the fixed frame may have a circular shape. Specifically, the horizontal length of the fixed frame may be formed to be longer than the operating unit (910) so that the operating unit (910) can move horizontally. On the other hand, the vertical length of the fixed frame may be formed to be similar to the operating unit (910) so that the operating unit (910) can only tilt vertically.

[0395] The operating unit (910) may be referred to as a "moving frame" in that it is formed to be movable compared to the fixed frame. Furthermore, the operating unit (910) may be referred to as a "controller" in that it is a module formed to be tiltable through user input. In the following, it should be noted that the terms "operating unit (910)," "moving frame," and "controller" may all be used interchangeably with the same meaning.

[0396] From now on, a specific method of generating a first driving signal for moving a vehicle display device (800) based on a first signal according to a first operation on the console (900) will be described with reference to FIGS. 13d and 13e.

[0397] Referring to FIGS. 13d and 13e, a console (900) located between a driver's seat and a passenger's seat in a vehicle (100) can detect a first operation in which an operation unit (910) within a fixed frame moves left / right or tilts, and generate a first signal according to the first operation.

[0398] Specifically, referring to FIG. 13d, the movable frame (910) of the console (900) is initially fixed at a position corresponding to the driver's seat (or center) within the fixed frame and can move to a position corresponding to the passenger seat.

[0399] Through user input, based on the fact that the moving frame (910) has moved to a position corresponding to the passenger seat (a), a sensor (not shown) provided in the console (900) can detect a change in the position of the moving frame (910). At this time, the moving frame (910) does not tilt in the up-and-down direction but maintains a horizontal position (b). Accordingly, the sensor of the console (900) generates a first tilting signal that matches the movement of the moving frame (910) that moves / tilts only in the right direction. The generated first tilting signal is transmitted to the vehicle display device (800) through the communication module. When the first tilting signal is transmitted to the control unit (850) through the communication unit (810) of the vehicle display device (800), a first driving signal corresponding to the first tilting signal is generated. The control unit (850) transmits the generated first driving signal to the first driving module (830a). At this time, the first driving signal corresponding to the first tilting signal includes detailed direction information, and the driving direction of the motor of the first driving module (830a) is determined accordingly. According to the operation of the first driving module (830a), the vehicle display device (800) moves horizontally toward the passenger seat along the slot (801) of the frame (802) (c).

[0400] Referring to FIG. 13e, the movable frame (910) of the console (900) can be moved to a position corresponding to the driver's seat (or center) while being fixed at a position corresponding to the passenger seat within the fixed frame.

[0401] Through user operation, based on the fact that the moving frame (910) has been moved to a position corresponding to the driver's seat (or center) (a), a sensor (not shown) provided in the console (900) can detect a change in the position of the moving frame (910). At this time, the moving frame (910) does not tilt up and down but remains horizontal (b). Accordingly, the sensor of the console (900) generates a second tilting signal that matches the movement of the moving frame (910) that moves / tilts only in the left direction. The generated second tilting signal is transmitted to the vehicle display device (800) through the communication module. When the second tilting signal is transmitted to the control unit (850) through the communication unit (810) of the vehicle display device (800), a first driving signal corresponding to the second tilting signal is generated. The control unit (850) transmits the generated first driving signal to the first driving module (830a). At this time, the first driving signal corresponding to the second tilting signal includes detailed direction information, and the driving direction of the motor of the first driving module (830a) is determined accordingly. According to the operation of the first driving module (830a), the vehicle display device (800) moves horizontally toward the driver's seat (or center) along the slot (801) of the frame (802) (c).

[0402] Continuing, a specific method of generating a second driving signal for moving a vehicle display device (800) based on a second signal according to a second operation on the console (900) will be described with reference to FIGS. 13b and 13c.

[0403] Referring to FIGS. 13b and 13c, a console (900) located between the driver's seat and the passenger seat in a vehicle (100) can detect a second operation in which the upper / lower portion of the operating unit (910) within the fixed frame is tilted, and generate a second signal according to the detected second operation.

[0404] Specifically, referring to FIG. 13b, the lower part of the movable frame (910) of the console (900) can be tilted while being fixed at a position corresponding to the driver's seat (or center) or passenger seat within the fixed frame.

[0405] Based on the tilting of the lower portion of the moving frame (910) through such user manipulation (a), a sensor (not shown) provided in the console (900) can detect a change in the position of the moving frame (910). At this time, the moving frame (910) does not move left and right, but the lower portion of the moving frame (910) is tilted vertically (b). As the lower portion of the moving frame (910) is tilted, an angular change (e.g., 10 degrees or more) can be detected through the sensor (not shown) of the moving frame (910). The console (900) generates a third tilting signal matching the movement of the tilted moving frame (910). The generated third tilting signal is transmitted to the vehicle display device (800) through the communication module. When the third tilting signal is transmitted to the control unit (850) via the communication unit (810) of the vehicle display device (800), a second driving signal corresponding to the third tilting signal is generated. The control unit (850) transmits the generated second driving signal to the second driving module (830b). At this time, the second driving signal corresponding to the third tilting signal includes detailed direction information, and the driving direction of the motor of the second driving module (830b) is determined accordingly. According to the operation of the second driving module (830b), the vehicle display device (800) is pulled outward from the inner space of the frame (802) along the slot (801) of the frame (802) of the vehicle (c).

[0406] Referring to FIG. 13c, the upper part of the movable frame (910) of the console (900) can be tilted while being fixed at a position corresponding to the driver's seat (or center) or passenger seat within the fixed frame.

[0407] Based on the tilting of the upper portion of the moving frame (910) through such user manipulation (a), a sensor (not shown) provided in the console (900) can detect a change in the position of the moving frame (910). At this time, the moving frame (910) does not move left and right, but only the upper portion of the moving frame (910) is tilted vertically (b). As the upper portion of the moving frame (910) is tilted, an angular change (e.g., 10 degrees or more) can be detected through the sensor (not shown) of the moving frame (910). The console (900) can generate a fourth tilting signal matching the movement of the tilted moving frame (910). The generated fourth tilting signal is transmitted to the vehicle display device (800) through the communication module. When the fourth tilting signal is transmitted to the control unit (850) through the communication unit (810) of the vehicle display device (800), a second driving signal corresponding to the fourth tilting signal is generated. The control unit (850) transmits the generated second driving signal to the second driving module (830b). At this time, the second driving signal corresponding to the fourth tilting signal includes detailed direction information, and the driving direction of the motor of the second driving module (830b) is determined accordingly. According to the operation of the second driving module (830b), the vehicle display device (800) is gradually introduced into the internal space of the frame (802) of the vehicle through the slot (801) of the frame (802) (c).

[0408] Meanwhile, if it is unclear whether the upper part or the lower part of the moving frame (910) is tilted, the console (900) can generate a third tilting signal or a fourth tilting signal based on the angular difference of the moving frame (910) according to the tilting.

[0409] For example, if the angle change of the lower portion of the moving frame (910) of the console (900) is greater, a third tilting signal may be generated to pull the vehicle display device (800) out of the frame (802). Also, for example, if the angle change of the upper portion of the moving frame (910) of the console (900) is greater, a fourth tilting signal may be generated to pull the vehicle display device (800) into the inner space of the frame (802).

[0410] In this way, the first driving signal and the second driving signal by the vehicle display device (800) are determined according to the movement / tilting direction applied to the moving frame (910) or controller of the console (900).

[0411] The vehicle display device (800) determines the driving direction of the first driving module (830a) corresponding to the first driving signal and / or the driving direction of the second driving module (830b) corresponding to the second driving signal based on each tilting direction information according to the operation of the console (900).

[0412] In an embodiment, the control unit (850) of the vehicle display device (800) may generate a first driving signal for causing the display unit (820) of the vehicle display device (800) to move in a driving direction from the driver's seat toward the passenger seat, based on direction information corresponding to the first tilting direction included in the first signal according to the first operation of the console (900). That is, as described above with reference to FIG. 15c, the vehicle display device (800) may be controlled to move toward the passenger seat based on the first tilting signal generated from the console (900).

[0413] In addition, in the embodiment, the control unit (850) of the vehicle display device (800) may generate a first driving signal for causing the display unit (820) of the vehicle display device (800) to move in a direction from the passenger seat toward the driver's seat based on direction information corresponding to the second tilting direction included in the first signal according to the first operation of the console (900). That is, as described above with reference to FIG. 15d, the vehicle display device (800) may be controlled to move toward the driver's seat (or, center) based on the second tilting signal generated from the console (900).

[0414] In an embodiment, the control unit (850) of the vehicle display device (800) may generate a second driving signal to cause the display unit (820) of the vehicle display device (800) to move in a direction in which the display unit (820) is pulled out from the internal space of the frame (802) to the outside, based on direction information corresponding to the third tilting direction included in the second signal according to the second operation of the console (900). That is, as described above with reference to FIG. 15A, the vehicle display device (800) may be controlled to gradually move in a direction in which the display unit (820) is exposed to the outside from the internal space of the frame (802).

[0415] In addition, in the embodiment, the control unit (850) of the vehicle display device (800) may generate a second driving signal for causing the display unit (820) of the vehicle display device (800) to gradually move in a direction in which the display unit (820) of the vehicle display device (800) is gradually drawn into the internal space of the frame (802), based on direction information corresponding to the fourth tilting direction included in the second signal according to the second operation of the console (900). That is, as described above with reference to FIG. 15b, the vehicle display device (800) may be controlled to gradually move in a direction in which the display unit (820) is drawn into the internal space of the frame (802).

[0416] Meanwhile, in the vehicle display device (800) according to an embodiment of the present invention, based on the sensing data of the vehicle DMS system, if the passenger seat occupant is not recognized, the operation corresponding to the operation of the console (900) described above is applied to screen control of the first display (825) instead of the movement of the second display (820). In this case, the direction of the screen and / or selection movement of the first display (825) can be determined based on the direction information included in the operation of the console (900).

[0417] Below, FIG. 13f is a block diagram showing a detailed configuration related to a plurality of driving modules for moving a vehicle display device (800) in different directions according to an embodiment of the present invention.

[0418] Specifically, this is a drawing for explaining motor control related to movement of a vehicle display device (800) in relation to the embodiments described with reference to FIGS. 13b to 13e above.

[0419] In FIG. 13f, the DCS may be a server for communicating so that the operation of the vehicle display device (800) can be linked with other devices within the vehicle (100). The DCS provides communication so that the vehicle (100) and the vehicle display device (800) can operate in conjunction with each other, or so that the vehicle display device (800) can operate in conjunction with a rear seat display device (not shown) of the vehicle.

[0420] In FIG. 13f, the motor control unit can control the respective operations of the plurality of driving units (830) to move the vehicle display device (800) in different directions. In addition, the motor control unit of FIG. 13f can be used in the same sense as the control unit (850) of the vehicle display device (800).

[0421] In FIG. 13F, the first motor control unit can control the operation of the first drive module (830a) of the plurality of drive units (830). In addition, the first motor control unit can control the first motor linked to the first drive module (830a). In an embodiment, the first drive module (830a) can be understood to include the linked first motor and the first motor control unit (or, first motor controller) for controlling the first motor.

[0422] In FIG. 13F, the second motor control unit can control the operation of the second driving module (830b) among the plurality of driving units (830). In addition, the second motor control unit can control the second motor linked to the second driving module (830b). In an embodiment, the second driving module (830b) can be understood to include a linked second motor and a second motor control unit (or first motor controller) for controlling the second motor.

[0423] In addition, in FIG. 13f, the first sensor can detect the driving of the first motor and / or the degree of horizontal movement of the vehicle display device (800) resulting therefrom. In addition, the second sensor can detect the driving of the second motor and / or the degree of vertical movement of the vehicle display device (800) resulting therefrom.

[0424] Meanwhile, each signal according to the first operation and / or the second operation of the console (900) may include information on the degree of movement of the display unit (820), i.e., the distance of movement, according to the degree of tilting of each operation for the console (900).

[0425] Here, the tilting degree of each of the above operations may include at least one of the tilting intensity (tilting angle and tilting pressure), the degree of movement, and the tilting maintenance time applied to the operation unit (910) of the console (900).

[0426] In addition, the movement distance information refers to the degree of movement of the vehicle display device (800) that matches each driving signal. For example, the movement distance information may include the distance that the vehicle display device (800) moves horizontally according to the first driving signal. In addition, the movement distance information may include the distance that the vehicle display device (800) moves vertically according to the second driving signal.

[0427] The control unit (850) of the vehicle display device (800) can determine the driving distance of the driving module (830a or 830b) corresponding to the first driving signal or the second driving signal based on distance information included in a signal (e.g., one of the first tilting signal to the fourth tilting signal) received from the console (900). Based on the determined driving distance of the driving module (830a or 830b), the movement distance (movement degree) of the display unit (820) changes.

[0428] In an embodiment, the control unit (850) of the vehicle display device (800) may generate a first driving signal to operate the display unit (820) of the vehicle display device (800) to move a first distance in the horizontal direction based on distance information corresponding to the first tilting degree included in the first signal by the console (900). In this case, the vehicle display device (800) may detect that the display unit (820) has moved the first distance through the first sensor.

[0429] In addition, in an embodiment, the control unit (850) of the vehicle display device (800) may generate a first driving signal to operate the display unit (820) of the vehicle display device (800) to move horizontally by a second distance different from the first distance based on distance information corresponding to the second tilting degree included in the first signal by the console (900). In this case, the vehicle display device (800) may detect that the display unit (820) has moved by the second distance through the first sensor.

[0430] In addition, in an embodiment, the control unit (850) of the vehicle display device (800) may generate a second driving signal to operate the display unit (820) of the vehicle display device (800) to be vertically moved into or pulled out from the internal space of the frame (802) by a first size, based on distance information corresponding to the first tilting degree included in the second signal by the console (900). In this case, the vehicle display device (800) may detect that the display unit (820) has moved by the first distance through the second sensor.

[0431] In addition, in an embodiment, the control unit (850) of the vehicle display device (800) may generate a second driving signal to operate the display unit (820) of the vehicle display device (800) to be moved into or out of the internal space of the frame (802) by a second size different from the first size, based on distance information corresponding to the second tilting degree included in the second signal by the console (900). In this case, the vehicle display device (800) may detect that the display unit (820) has moved by the second distance through the second sensor.

[0432] In an embodiment, the motor control unit can control the first motor control unit and the second motor control unit to operate independently.

[0433] The motor control unit operates so that the first motor control unit drives the first motor based on the first driving signal. In addition, the motor control unit operates so that the second motor control unit drives the second motor based on the second driving signal.

[0434] The vehicle display device (800) can process multiple signals according to preset criteria when the first driving signal and the second driving signal are received simultaneously.

[0435] In an embodiment, the control unit (850) of the vehicle display device (800) may operate to sequentially drive the remaining drive modules after the driving of one of the drive modules is completed based on the time at which the drive signals of the first drive module and the second drive module are received.

[0436] For example, if the first driving signal and the second driving signal are received sequentially, the vehicle display device (800) may first move horizontally according to the first driving signal and then move vertically according to the second driving signal. Here, the 'continuous' operation being performed includes starting movement in the second direction without delay after movement in the first direction is completed and starting movement in the second direction after a certain period of time (e.g., 0.5 seconds) after movement in the first direction is completed.

[0437] In another embodiment, the control unit (850) of the vehicle display device (800) controls the plurality of drive modules to be driven respectively based on the time at which the drive signal is received, and when it is determined that the plurality of drive signals, i.e., the first and second drive signals, are received simultaneously, the control unit (850) of the vehicle display device (800) can control the drive modules to be driven according to the set priority order.

[0438] For example, if it is determined that the first and second driving signals are received simultaneously, it is possible to drive to first perform a movement operation corresponding to a set specific direction. As a specific example, the priority of the movement direction of the vehicle display device (800) may be set to a direction in which it is pulled out from the internal space of the frame in the initial state (1st priority), a direction in which it moves between the driver's seat and the passenger seat (2nd priority), and a direction in which it is drawn into the internal space of the frame (3rd priority). In this case, if it is determined that multiple driving signals are received, the driving module may operate sequentially to match the priority of the set movement direction.

[0439] In another embodiment, the control unit (850) of the vehicle display device (800) may control each drive module corresponding to the first and second drive signals to be driven simultaneously based on the determination that the first and second drive signals have been received simultaneously.

[0440] For example, referring to FIG. 13F, the motor control unit can control the first motor control unit and the second motor control unit to be driven simultaneously based on the simultaneous reception of the first and second driving signals. In this case, for example, the vehicle display device (800) can be pulled out or pulled in from the frame (802) while moving horizontally.

[0441] As seen above, the movement of the second display (820) can be easily controlled by operating the console (900).

[0442] Meanwhile, in the present invention, the target of operation according to the operation of the console (900) may vary depending on whether the vehicle display device (800) recognizes the presence of a passenger in the passenger seat. Specifically, depending on whether the vehicle display device (800) recognizes the presence of a passenger in the passenger seat, the target of operation according to the operation of the console (900) may be determined as either the first display (825) or the second display (820).

[0443] Fig. 14 is a conceptual diagram for explaining controlling the movement of the second display (820) based on the operation of the console (900) according to the detection of the passenger in the auxiliary seat. Here, it is assumed that the console (900) has the same configuration as the input device (860) described in Fig. 2.

[0444] The vehicle display device (800) communicates with the console (900) and receives a signal matching an operation on the console (900). In addition, the vehicle display device (800) may, based on the recognition result of the passenger seat based on the DMS sensing data, perform the operation of the drive module (830a, 830b) for the movement of the second display (820) with a signal corresponding to the operation of the console (900) in a first condition, and perform screen control of the first display (825) with a signal corresponding to the operation of the console (900) in a second condition.

[0445] Here, the first condition is when the passenger in the auxiliary seat is recognized, and the second condition is when the passenger in the auxiliary seat is determined not to be recognized.

[0446] In an embodiment, the vehicle display device (800) may determine that the passenger seat occupant is not recognized based on the monitoring information received from the DMS system. Then, based on the determination of the passenger seat occupant's absence, the control target according to the operation of the console (900) is matched to the first display (825). Now, the screen of the first display (825) is controlled according to the operation of the console (900).

[0447] In addition, in the embodiment, the vehicle display device (800) may determine that a passenger in the passenger seat has been recognized based on the monitoring information received from the DMS system. Then, based on the determination of the passenger's presence, the control target according to the operation of the console (900) is matched to the second display (825). Now, the movement of the second display (820) is controlled according to the operation of the console (900).

[0448] Referring to FIG. 14, a second screen (1420) for the passenger in the passenger seat is generated in a portion of the first display (825) based on the vehicle display device (800) recognizing the presence of the passenger in the passenger seat based on sensing data of the vehicle's DMS system.

[0449] At this time, the second screen (1420) is controlled independently from the first screen (1410) for the driver and is displayed in a location corresponding to the passenger seat. The second screen (1420) may be, for example, a menu screen for selecting executable applications.

[0450] The second display (820) can be fixed at an initial position, i.e., a position corresponding to the driver's seat (or center). That is, if there is no additional operation, the second display (820) can maintain its current position and status without moving.

[0451] When the second display (820) is exposed to the outside of the frame (802), a control screen / execution screen (1411) related to either the first screen (1410) or the second screen (1420) can be displayed on the second display (820).

[0452] In this way, when a passenger in the passenger seat is detected and a second screen for the passenger in the passenger seat is created on the first display (825) (a), in response to an operation of moving the console (900) to the right, the second display (820) operates to move to the right toward the passenger seat (b).

[0453] Once the movement of the second display (820) is completed, the screen of the second display (820) now operates to display only the control screen / execution screen related to the second screen output to the first display (825). For example, the passenger in the passenger seat can perform screen control for the second screen directly on the second screen or by using the second display (820). For example, as the menu screen for selecting an executable application as the second screen changes from “App C” to “App D,” the menu screen with “App D” positioned in the center is displayed on the second screen of the first display (825), and the control screen / execution screen (1422) related to “App D” is displayed on the second display (820).

[0454] Meanwhile, although not shown, when an operation is performed to move the console (900) to the left in the state of (b) of FIG. 14, the second display (820) moves to the initial position as in (a) of FIG. 14. Then, when the movement to the position corresponding to the driver's seat (or center) is completed, the second display (820) will now display a control screen / execution screen related to the first screen (1410) for the driver.

[0455] If the presence of a passenger in the passenger seat is recognized based on the sensing data of the vehicle DMS system described above, the screen of the first display (825) operates in full mode. In addition, the screen of the first display (825) is controlled according to the operation of the console (900) of the vehicle display device (800). That is, the entire first screen (1410) of the first display (825) may be changed or the selection of items within the first screen (1410) may be changed depending on the operation direction of the console (900).

[0456] At this time, the second display (820) may be inserted into the internal space of the frame, or may be exposed to the outside through a slot formed in the frame. In the latter case, the second display (820) displays a control screen / execution screen related to the first screen of the first display (825).

[0457] Meanwhile, although not shown, when the vehicle is not driving, the first screen displayed on the first display (825) may be provided with various infotainment screens in addition to the navigation screen for the driver.

[0458] Below, FIG. 15 is another flowchart for explaining a method for selectively performing movement of a vehicle display device and screen control of a first display depending on whether an auxiliary seat passenger is detected according to an embodiment of the present invention.

[0459] Referring to FIG. 15, when the vehicle's ignition is turned on, the vehicle display device (800) activates the first display (825) to display the first screen (1510). At this time, the first screen can automatically switch from the initial setup screen to a navigation screen for driving.

[0460] Thereafter, the vehicle display device (800) can communicate with the DMS system installed in the vehicle and receive DMS sensing data as monitoring information for the vehicle's passengers. Then, the vehicle display device (800) can recognize the passenger seat passenger based on the received monitoring information (1520).

[0461] Continuing, in response to the recognition of the passenger seat occupant, the vehicle display device (800) can determine whether to move the second display (820) and whether to generate a first screen on the first display (825) (1530).

[0462] Specifically, when a passenger in the passenger seat is recognized, the vehicle display device (800) can generate a second screen for the passenger in the passenger seat on the first display (825) and control movement of the second display (820) so that it is positioned corresponding to the passenger seat. At this time, the operations of the first and second displays (825, 820) can be performed in different order or simultaneously.

[0463] Meanwhile, if it is determined that the passenger in the auxiliary seat is not recognized, the screen mode of the first display (825) can be maintained in full mode, and the second display (820) can be controlled to maintain the initial position. At this time, if an attempt by the driver to control the first screen displayed on the first display (825) using the second display (820) is detected, the second display (820) can be controlled to move so as to be pulled out of the frame. Here, the attempt to control the first screen displayed on the first display (825) may include, for example, a case where the driver's gaze is directed toward the first display (825) for a certain period of time or there is an attempt to interact with the first display (825) based on sensing data of the DMS system.

[0464] In this way, the vehicle display device (800) can apply different control target displays based on the operation of the console (900) depending on whether a passenger in the passenger seat is detected. Accordingly, convenience can be provided in a manner more suitable for the user's position. In addition, by simultaneously generating a second screen for the passenger in the passenger seat and moving the second display to control the second screen when a passenger in the passenger seat is detected, the usability of the implemented multiple displays is increased and a convenient user experience is provided.

[0465] Below, FIGS. 16a to 16c are exemplary conceptual diagrams for explaining movement control of a vehicle display device according to a passenger execution mode according to an embodiment of the present invention.

[0466] In an embodiment, the vehicle display device (800) may determine that a first condition is satisfied when a front passenger is recognized based on sensing data from the vehicle's DMS system. Here, the first condition may be that the front passenger has an intention to use the first display (825) (e.g., attempts interaction) or at least does not clearly have an intention not to use the first display (825) (e.g., detects the front passenger's drowsy state).

[0467] In this way, upon satisfaction of the first condition, the control unit (850) of the vehicle display device (800) displays a second screen for the passenger seat on the first display (825). In addition, based on the first operation signal received in accordance with the operation of the console (900), the operation of the first drive module (830a) can be controlled so that the second display (820) moves to a position corresponding to the passenger seat along the horizontal direction of the frame (802).

[0468] Referring to Fig. 16a, in response to the recognition of the passenger in the passenger seat, a second screen (1620) for the passenger in the passenger seat is generated on the first display (825) and displayed independently, separate from the first screen (1610). At this time, the second display (820) may be concealed within the interior space of the frame as illustrated, or may be exposed to the outside.

[0469] In this state, although the city is omitted, the second display (820) can be moved to a position corresponding to the passenger seat based on an operation on the linked console (900, FIG. 13a) (i.e., based on a received first operation signal). As another example, the second display (820) can also be moved to a position corresponding to the passenger seat in response to an interaction attempt by the passenger on the second screen (1620).

[0470] Specifically, the matching second drive module (830b) operates so that the second display (820), which was concealed as shown in FIG. 16b, is exposed to the outside of the frame. At this time, a control screen / execution screen (1621) related to the second screen (1620) of the first display (825) can be displayed on the second display (820) exposed to the outside.

[0471] Next, as illustrated in FIG. 16c, the matching first drive module (830a) may operate so that the second display (820) moves to a position corresponding to the passenger seat. Accordingly, the passenger in the passenger seat can easily control the second screen of the first display (825) using the screen (1621) displayed on the second display (820) without changing their posture.

[0472] In another embodiment, if the front passenger is recognized and the first condition is satisfied, but there is no attempt to operate the console (900) or interact with the front passenger, the second display (825) may remain fixed in the initial position. In this case, if the second display (825) is exposed outside the frame, it may display an existing screen, for example, a control screen / execution screen related to the first screen for the driver.

[0473] In addition, if the passenger in the passenger seat is recognized and the first condition is satisfied, but the operation of the console (900) is directed toward the driver's seat (not toward the passenger seat) (i.e., based on the received second operation signal), the second display (820) may be determined to be intended for use by the driver, and a control screen / execution screen related to the first screen for the driver may be displayed on the second display (820).

[0474] Meanwhile, the vehicle display device (800) can operate to control the screen of the first display (825) according to the operation of the linked console (900) based on the determination that the passenger seat passenger is not recognized based on the sensing data of the DMS system.

[0475] Below, FIGS. 17a and 17b are exemplary conceptual diagrams for explaining screen control of the first display corresponding to operation of the console according to the driver execution mode.

[0476] In an embodiment, the control unit (850) of the vehicle display device (800) may determine that the second condition is satisfied if the passenger in the passenger seat is not recognized based on monitoring information received from the vehicle's DMS system.

[0477] Here, the second condition may be that at least the front passenger is not detected or the front passenger clearly does not want to use the first display (825) (e.g., detection of the front passenger's drowsiness).

[0478] In this way, according to the satisfaction of the second condition, the control unit (850) of the vehicle display device (800) can limit the operation of the plurality of driving modules (830a, 830b) according to a control signal generated based on the operation of the console (900), i.e., the input device matching the plurality of driving modules (830a, 830b).

[0479] Here, limiting the operation of multiple drive modules (830a, 830b) means that the operation of the console (900) does not act as an input for controlling the movement of the second display (820).

[0480] When the passenger seat occupant is not recognized, the vehicle display device (800) may operate in driver-operated mode. In driver-operated mode, the screen of the first display (825) operates in full screen mode. Additionally, in driver-operated mode, the second display (820) operates as a control screen / operation screen for the first screen for the driver displayed on the first display (825).

[0481] In this driver execution mode, the first screen of the first display (825) is controlled based on direction information included in the operation signal generated according to the operation of the console (900). In addition, a control screen / execution screen related to the first screen is displayed on the second display (820), so that the driver can control the first screen through the second display (820).

[0482] For example, referring to FIG. 17a, while the first screen (1710) of the first display (825) is displayed in full mode in the driver execution mode, the second display (820) can remain exposed outside the frame at a position corresponding to the driver's seat (or center).

[0483] At this time, the second display (820) may display the first screen (1710), for example, a control screen / execution screen (1711) related to the selection of application “A”.

[0484] In this state, when a rightward operation input is applied to the linked console (900), as illustrated in Fig. 17b, instead of the movement of the second display (820), the first screen (1720) changed by selection of application “B” is displayed on the first display (825). In addition, the screen of the second display (820) is also switched to a control screen / execution screen (1721) related to the selection of application “B.”

[0485] Additionally, in driver execution mode, movement of the second display (820) may be restricted based on monitoring information of the vehicle DMS system. Here, the monitoring information of the vehicle DMS system during driver execution mode may include monitoring information on whether the driver is driving.

[0486] Specifically, the control unit (850) of the vehicle display device (800) can operate to conceal the second display (820) into the internal space of the frame (802) based on the recognition that the driver is driving based on the monitoring information of the received DMS system. This is to remove the second display (820) from the driver's view for safe driving.

[0487] Therefore, it can be said that the meaning that the movement of the second display (820) is limited does not mean that the second display (820) does not move, but rather that it returns to a set position and state.

[0488] Meanwhile, the vehicle display device (800) may operate to limit the movement of the second display (820) based on vehicle status information. Specifically, the vehicle display device (800) may generate a control signal to operate the second drive module (830b) so that the second display (820) is changed to a state in which it is drawn into the internal space of the frame based on the vehicle's driving speed being higher than a predetermined speed.

[0489] FIG. 18 is an exemplary drawing for explaining that a vehicle display device (800) according to an embodiment of the present invention is linked with a vehicle rear seat display device.

[0490] Meanwhile, FIG. 18 is an example block diagram for explaining that the vehicle's display device (800) operates in conjunction with the vehicle's rear seat display device.

[0491] A vehicle display device (800) according to an embodiment of the present invention may be a part of or the entire front display system (2110) located in the front seat of a vehicle (100). In this case, the front display system (2110) may be linked with a rear display device / system (2120) located in the rear seat of the vehicle (100).

[0492] To this end, the front display system (2110) may be configured to include a vehicle display device (800), a first display (825), a control board system (NVIDIA SYSTEM), a monitoring system (110), a mini PC, and a router, as illustrated in FIG. 21.

[0493] At this time, the vehicle display device (800) may include a display unit, i.e., a CID, and a motor that provides driving force for driving the CID.

[0494] The control board system (NVIDIA SYSTEM) can control the first display unit (825), i.e., the P2P screen, based on touch input to the CID of the vehicle display device (800), for example.

[0495] In addition, the control board system (NVIDIA SYSTEM) can control the operation of the vehicle display device (800) and the screen of the first display (825) based on the operation results of the vehicle monitoring system (110), for example, DMS and DIMS.

[0496] Meanwhile, the front display system (2110) can communicate with the rear display system (2120) of the vehicle (100) through a router. The front display system (2110) can control the operation of the vehicle display device (800) of the front display system (2110) based on the operating status of the rear display system (2120).

[0497] For example, when the operating status of the rear seat display system (2120) is received by the front seat display system (2110) through the router, the mini PC is involved in operating the CID motor of the vehicle display device (800), i.e., the plurality of driving units (830). Specifically, the CID motor operates to match the operation of the rear seat display system (2120) based on the driving signal generated by the mini PC.

[0498] Conversely, for example, the operational status of a vehicle display device (800) or a front display system (2110) may be transmitted to a rear display system (2120) via a router. In this case, the operation of the rear display system (2120) may be driven or limited to match the operation of the front display system (2110).

[0499] As described above, according to the vehicle display device and the operating method thereof according to the embodiment of the present invention, when the presence of a passenger in the front seat of the vehicle is recognized, a screen for the passenger in the front seat is automatically generated on the first display installed in a rectangular shape in the front seat, so that the passenger in the front seat can immediately receive the desired service without additional operation. In addition, when the presence of a passenger in the vehicle is recognized, a second display implemented to be movable is implemented to automatically approach the passenger seat, so that the passenger in the front seat can easily control the second screen for the passenger in the front seat through the moved second display. Furthermore, when the presence of a passenger in the vehicle is not recognized, the movable second display is controlled to be used to control a screen for the driver, so that the second display can be utilized not only for the passenger in the front seat but also for the driver, thereby expanding the user experience and usability.

[0500] The present invention described above can be implemented as computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and also includes media implemented in the form of carrier waves (e.g., transmission via the Internet). In addition, the computer may include a controller / processor of a vehicle display device (800). Therefore, the above detailed description should not be construed as limiting in all respects, but should be considered as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are intended to be included in the scope of the present invention.

Claims

1. A first display unit is arranged in a frame formed to correspond to the driver's seat and the passenger's seat in a vehicle and installed in a rectangular shape to correspond to the driver's seat and the passenger's seat; A second display unit coupled to one side of the frame and configured to move between the driver's seat and the passenger's seat along the horizontal direction of the frame through the operation of a driving module; A receiving unit for receiving monitoring information of a passenger based on DMS sensing information of the vehicle; and It includes a control unit that controls each operation of the first display unit, the second display unit, and the driving module, The above control unit, Displaying a first screen on the first display unit, recognizing an occupant of the passenger seat based on the received monitoring information, and determining whether to generate a second screen for the passenger seat on at least a part of the first display unit based on the recognition result. Vehicle display device.

2. In paragraph 1, The above control unit, Depending on whether the passenger in the auxiliary seat is recognized, the screen control target of the first display unit corresponding to the input of the second display unit is applied differently. Vehicle display device.

3. In paragraph 1, The above control unit, Based on the received monitoring information, the passenger mode is executed based on the recognition of the passenger in the passenger seat, and the second screen is displayed in the area of ​​the first display unit corresponding to the passenger seat. Vehicle display device.

4. In paragraph 3, The above second display unit, Each of the first driving module and the second driving module is coupled, and moves between the driver's seat and the passenger seat along the horizontal direction of the frame according to the operation of the first driving module, and changes to a state in which at least a part is introduced into the internal space of the frame or withdrawn to the outside according to the operation of the second driving module. The above control unit, In response to the execution of the above passenger mode, the operation of the second drive module is controlled so that at least a part of the second display part is changed to a state in which it is withdrawn outside the frame based on each control signal, and the operation of the first drive module is controlled so that the second display part moves to a position corresponding to the auxiliary seat along the horizontal direction of the frame, respectively. Vehicle display device.

5. In paragraph 4, The above control unit, In the above passenger mode, if it is determined that the recognized passenger seat is motionless or asleep for a predetermined period of time based on the received monitoring information, the operation of the second drive module is controlled so that the second display unit is introduced into the internal space of the frame. Vehicle display device.

6. In paragraph 1, The above control unit, After generating a second screen for the passenger seat on the first display unit based on the recognition of the passenger in the passenger seat, Based on the fact that the passenger in the auxiliary seat has not moved for a certain period of time or has been in a sleeping state for a certain period of time, the first screen is displayed on the entire first display unit instead of the second screen for the auxiliary seat. Vehicle display device.

7. In paragraph 1, It further includes an input unit for controlling the movement of the second display unit, The above control unit, Based on the received monitoring information, it is determined not to display the second screen based on the passenger in the auxiliary seat not being recognized, and the first screen is controlled based on the input to the input unit according to the determination. Vehicle display device.

8. In paragraph 1, Further comprising a communication unit that communicates with an input unit that selectively controls the operation of the drive module of the second display unit and one of the screens of the first display unit according to set conditions, and receives a signal corresponding to the operation of the input unit. The above control unit, A signal matching the operation of the input unit is received, and in the first condition, the operation of the driving module for movement of the second display unit is performed according to the recognition result of the passenger in the auxiliary seat, and in the second condition, the screen control of the first display unit is performed. Vehicle display device.

9. In paragraph 8, The above control unit, Based on the received monitoring information, it is determined that the first condition is satisfied based on the recognition of the passenger in the passenger seat, and the second screen is displayed in the area of ​​the first display unit corresponding to the passenger seat. Controlling the operation of the driving module so that the second display unit moves to a position corresponding to the auxiliary seat along the horizontal direction of the frame based on the received first operating signal. Vehicle display device.

10. In paragraph 9, The above control unit, Based on the second display unit moving to a position corresponding to the auxiliary seat in the first condition, the control screen of the second screen is displayed on the second display unit. Vehicle display device.

11. In paragraph 9, The above control unit, Based on the fact that the first condition is satisfied, and the first operation signal is not received or the second operation signal matching the operation of the drive module for moving the second display unit to a position corresponding to the driver's seat along the horizontal direction of the frame is received, the control screen of the first screen is displayed on the second display unit. Vehicle display device.

12. In paragraph 8, The above control unit, Based on the received monitoring information, it is determined that the second condition is satisfied based on the passenger in the auxiliary seat not being recognized, and the screen control of the first display unit is performed based on the received signal, and the control screen of the first display unit is displayed on the second display unit. Vehicle display device.

13. In paragraph 1, The above second display unit, Each of the first driving module and the second driving module is coupled, and moves between the driver's seat and the passenger seat along the horizontal direction of the frame according to the operation of the first driving module, and changes to a state in which at least a part is introduced into the internal space of the frame or withdrawn to the outside according to the operation of the second driving module. The above control unit, Based on the received monitoring information, recognizing that the driver is driving and the driving speed of the vehicle is higher than the set driving speed, generating a first control signal to operate the second drive module so that the second display unit is changed to a state in which it is drawn into the internal space of the frame. Vehicle display device.

14. A first display unit disposed within a frame formed to correspond to the driver's seat and the passenger's seat in a vehicle and installed in a rectangular shape to correspond to the driver's seat and the passenger's seat; A second display unit coupled to one side of the frame and configured to move between the driver's seat and the passenger's seat along the horizontal direction of the frame through the operation of a driving module; A receiving unit for receiving monitoring information of a passenger based on DMS sensing information of the vehicle; and It includes a control unit that controls each operation of the first display unit, the second display unit, and the driving module, The above control unit, Displaying the first screen on the first display unit, recognizing the passenger in the passenger seat based on the received monitoring information, and determining whether to operate the driving module according to the input for movement of the second display unit based on the recognition result. Vehicle display device.

15. In paragraph 14, The above control unit, Determining whether to generate a second screen for the passenger seat on at least a part of the first display unit based on the recognition result of the passenger in the passenger seat. Vehicle display device.

16. In paragraph 15, The above control unit, Based on the above-described received monitoring information, the passenger mode is executed based on the recognition of the passenger in the auxiliary seat, and the operation of the driving module for movement of the second display unit is controlled according to a control signal generated based on an input to an input unit matching the driving module. Vehicle display device.

17. In paragraph 14, The above control unit, Based on the received monitoring information, the operation of the driving module is restricted based on a control signal generated based on an input to an input unit matching the driving module, based on the passenger seat occupant not being recognized, and the first screen displayed on the first display unit is controlled based on the generated control signal. Vehicle display device.

Images