Cockpit system and control method thereof

Abstract

A cockpit system for a vehicle and a control method thereof are provided. The cockpit system includes: a front display disposed in front of a driver's seat and a passenger's seat of the vehicle, the front display including one or more display areas; the operating system is used for receiving an operating signal from a driver on the driver seat or a passenger on the passenger seat; a camera for monitoring the presence, absence, or movement of a driver on the driver's seat or a passenger on the passenger seat; and a controller for controlling at least one of the one or more displays of the front display or controlling the operating system in conjunction with the camera. The present disclosure may control settings of a front display or an operating system according to whether there is a passenger.

Description

[0001] Cross - reference to related applications

[0002] This application claims the benefit of Korean Patent Application No. 10 - 2023 - 0195050, filed with the Korean Intellectual Property Office on December 28, 2023, the entire disclosure of which is incorporated herein by reference for all purposes. Technical field

[0003] This embodiment relates to a display in a vehicle (e.g., an automobile, a mobile device, a mobility device, etc.) or an uncrewed aerial vehicle (UAV), and more particularly, to a cockpit system including the display. Background art

[0004] In recent years, as vehicles have become digital, many controllers are installed in vehicles, and various communication functions between the controllers allow the vehicle to be remotely located and nearby charging stations to be discovered via the Internet or a smartphone. In addition, all information about the current state of the vehicle (e.g., battery charging or pre - conditioning) can be checked in real - time with just a simple touch of a button. In addition, intelligent driving assistance systems acquire information about road driving to build a more convenient driving environment for the driver.

[0005] In this regard, a cluster is used, which provides basic functions of the vehicle (e.g., speedometer, odometer, and revolutions per minute (RPM) dashboard). For example, the cluster provides charging infrastructure network information, distance to empty (DTE), current battery status, information output, and other accurate and convenient vehicle information required for the driving environment.

[0006] In particular, vehicles recently use digital clusters of various digital cockpits to effectively represent vehicle information. Therefore, a technology for processing these digital cockpits in an integrated manner needs to be developed. Summary of the invention

[0007] The present disclosure aims to solve the above problems. According to an embodiment, the settings of the front display or the operating system can be controlled according to whether there is a passenger.

[0008] In addition, according to an embodiment of the present disclosure, by detecting the approach of a passenger to the driver's screen by a camera, arbitrary operation of the driver's screen by the passenger can be prevented.

[0009] Specifically, embodiments of the present disclosure propose a low mode to ensure the driver's forward field of view, and a system for implementing a see-through display that can provide information to the driver and passengers by transmitting light from a lower region of the front display even in the low mode.

[0010] The objectives to be achieved by the present disclosure are not limited to the above technical objectives, and those skilled in the art will clearly understand other unmentioned technical objectives from the following description.

[0011] In a general aspect of the present disclosure, a cockpit system provided in a vehicle includes: a front display disposed in front of the driver's seat and the passenger seat of the vehicle, the front display including a display area; an operating system configured to receive an operation signal from a driver on the driver's seat or a passenger on the passenger seat; a camera configured to monitor the presence, absence, or movement of a driver on the driver's seat or a passenger on the passenger seat; and a controller configured to control at least one of a plurality of displays of the front display or control the operating system in combination with the camera.

[0012] The display area of the front display may include a first shy button, a first in-vehicle infotainment (IVI) display, a second IVI display, and a second shy button.

[0013] The controller may further be configured to: determine whether a passenger is on the passenger seat through the camera; and in response to determining that the passenger is not on the passenger seat, disable the second IVI display or control the second IVI display and the first IVI display to be displayed as a combined display with each other.

[0014] The controller may further be configured to: determine whether a passenger is on the passenger seat through the camera; and in response to determining that the passenger is on the passenger seat, activate the second IVI display and enable the second IVI display to receive a control signal independently of the first IVI display.

[0015] In response to determining through the camera that a passenger has operated on the first IVI display, the controller may further be configured not to input the operation signal to the first IVI display.

[0016] In response to determining through the camera and the front display that the driver has applied the same input as a preset touch input on the first IVI display, the controller may further be configured to: control a first area of the first IVI display to receive operations from the driver and the passenger; and control a second area of the first IVI display to receive only the operation signal from the driver.

[0017] The controller can also be configured to: determine whether a passenger is on the passenger seat through a camera; disable the passenger operating system area of the operating system in response to determining that the passenger is not on the passenger seat; and activate the passenger operating system area of the operating system in response to determining that the passenger is on the passenger seat.

[0018] The controller can also be configured to: determine whether a passenger is on the passenger seat through a camera; disable the second hidden button when it is determined that the passenger is not on the passenger seat; and activate the second hidden button when it is determined that the passenger is on the passenger seat.

[0019] The controller can also be configured to: move the front display downward based on a low signal in the operation signal, and the cockpit system can further include a transparent panel configured to provide information to the driver and passengers by transmitting light from the lower area of the front display after the front display moves downward.

[0020] In another general aspect of the present disclosure, a method of controlling a cockpit system in a vehicle, the cockpit system including a front display, the front display including a first in-vehicle infotainment (IVI) display and a second IVI display, the method includes: determining whether a passenger is on the passenger seat through a camera; activating the second in-vehicle infotainment (IVI) display and controlling the second IVI display to receive a control signal independently of the first IVI display in response to determining that the passenger is on the passenger seat; and disabling the second IVI display or controlling the second IVI display and the first IVI display as a combined display with each other in response to determining that the passenger is not on the passenger seat.

[0021] The front display can further include: a first hidden button for providing functions that can be used by the driver; and a second hidden button for providing functions that can be used by the passenger.

[0022] The method can further include: disabling the second hidden button in response to determining that the passenger is not on the passenger seat; and activating the second hidden button in response to determining that the passenger is on the passenger seat.

[0023] In yet another general aspect of the present disclosure, a cockpit system for a vehicle includes: a front display disposed in front of the driver's seat and the passenger seat of the vehicle, the front display including a plurality of display areas; an operating system configured to receive operation signals from a driver on the driver's seat or a passenger on the passenger seat; a camera configured to monitor at least one of the driver on the driver's seat, the passenger on the passenger seat, or a combination thereof; and a controller configured to: determine the presence, absence, or movement of at least one of the driver on the driver's seat, the passenger on the passenger seat, or a combination thereof through the camera; and control at least one of the plurality of displays of the front display, control the operating system in combination with the camera, or a combination thereof.

[0024] The front display may include a first in-vehicle infotainment (IVI) display and a second IVI display.

[0025] The controller may further be configured to: activate the second in-vehicle infotainment (IVI) display in response to determining that a passenger is on the passenger seat, and control the second IVI display to receive control signals independent of the first IVI display; and disable the second IVI display or control the second IVI display and the first IVI display to be displayed as a single display in response to determining that a passenger is not on the passenger seat.

[0026] The front display may include a first hidden button near the driver's seat and a second hidden button near the passenger seat.

[0027] The controller may further be configured to: determine whether a passenger is on the passenger seat through the camera; disable the second hidden button when determining that a passenger is not on the passenger seat; and activate the second hidden button when determining that a passenger is on the passenger seat.

[0028] The vehicle may include at least one of an automobile, a mobile device, a mobile assistance device, or any combination thereof. Description of the Drawings

[0029] The above and other aspects, features, and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0030] Figure 1 is a diagram showing an exemplary configuration of a cockpit system according to an embodiment of the present disclosure;

[0031] Figure 2 and Figure 3 is a diagram showing the change of the front display according to the presence or absence of a passenger according to an embodiment of the present disclosure;

[0032] Figure 4A diagram showing a method for sharing an area of a pre - display according to an embodiment of the present disclosure;

[0033] Figure 5 A diagram showing the display or non - display of an operating system according to the presence or absence of a passenger according to an embodiment of the present disclosure;

[0034] Figure 6 A diagram showing the control of a pre - display according to an embodiment of the present disclosure; and

[0035] Figure 7 A diagram showing a transparent panel according to an embodiment of the present disclosure. Detailed Description of the Embodiment

[0036] Embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure can be implemented in many different forms and is not limited to the embodiments described herein. To clearly describe the disclosure in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to like components throughout the description.

[0037] Throughout the description, when a part is referred to as "including" a certain element, it means that it may also include other elements without excluding them, unless otherwise specified.

[0038] Figure 1 A diagram showing an exemplary configuration of a cockpit system according to an embodiment of the present disclosure.

[0039] Assume Figure 1 The pre - display 100 shown is disposed in front of the driver's seat and the passenger seat in a mobile device. In other words, the pre - display 100 is preferably disposed in front of the passenger seat and in front of the driver's seat in the mobile device.

[0040] In addition, according to Figure 1 The pre - display according to the illustrated embodiment may include a plurality of display areas 110, 120, 130, and 140. Although the plurality of display areas 110, 120, 130, and 140 are shown in Figure 1 as specifically including a first hidden button 110, a first in - vehicle infotainment (IVI) display 120, a second IVI display 130, and a second hidden button 140, they may be configured in various other forms.

[0041] The hidden buttons 110 and 140 generally refer to buttons configured to be recognized in the user's field of view only when needed. In Figure 1In the example, the first hidden button 110 is a hidden button that provides functions (e.g., functions related to driving control) that the driver can use when needed, while the second hidden button 140 is a hidden button that provides functions (e.g., functions related to music playback) that the passenger on the passenger seat can use when needed.

[0042] The first IVI display 120 can play clusters, cluster widgets, maps, media, and weather-related applications related to the driver's driving, and reset the area for displaying the application according to the driver's (or passenger's) operations or condition settings.

[0043] The second IVI display 130 can display applications (e.g., weather-related controls, media, and maps) that can be controlled by the passenger.

[0044] However, the above configuration of the displays is an example, and the corresponding areas can be integrally displayed according to the driver / passenger's operations or condition settings. For example, in the absence of a passenger, a single integrated image can be displayed on the first IVI display 120 and the second IVI display 130, as described later.

[0045] In an embodiment of the present disclosure, it is proposed to support a low mode in the display mode to ensure the driver's forward vision. During the low mode operation, the above front display 100 can be moved downward by a controller (not shown).

[0046] In an embodiment of the present disclosure, it is also proposed to include a transparent panel 150 as Figure 1 shown. As described above, the front display 100 can be configured such that when the current display 100 is moved downward by applying the low mode, the light from the lower area of the front display 100 provides information to the driver and the passenger through the transparent panel 150.

[0047] Assume that the information provided through the transparent panel 150 corresponds to the screens displayed by each of the first hidden button 110, the first IVI display 120, the second IVI display 130, and the second hidden button 140. However, compared with the information displayed on the upper part of the front display 100, the information provided through the transparent panel 150 is preferably simplified information. "Simplified information" may refer to information that can be implemented with a low resolution, a small amount, or a combination of both compared with the information displayed in the upper part of the front display 100.

[0048] As Figure 1 shown, the cockpit system according to an embodiment of the present disclosure may further include an operating system 160. The operating system 160 can be implemented in a projection manner.

[0049] In Figure 1In the illustrated embodiment, the operating system is shown as being divided into a driver operating system 510, a heating ventilation air conditioning (HVAC) operator 520, and a passenger operating system 530. In addition, the upper part of the operating system includes an operation button unit 540 displayed in the form of shortcuts, and the positions of the shortcuts are preferably exchanged with the positions in the form of animations in the lower part.

[0050] As Figure 1 shown, the cockpit system according to an embodiment of the present disclosure may further include a camera 170. The camera 170 may be disposed at a position capable of monitoring the driver's seat and the passenger seat. Any type of camera may be used as long as it can monitor.

[0051] Figure 2 and Figure 3 is a diagram showing changes in the front display with and without a passenger in an embodiment of the present disclosure. Figure 2 shows the setting of the front display when there is only a driver and no passenger, and Figure 3 shows the setting of the front display when there is a driver and a passenger.

[0052] First, Figure 2 (c) of is a simplified view of monitoring the driver's seat 180 and the passenger seat 190 by an in-cabin monitoring (ICM) camera. As Figure 2 (c) of shows, the camera can monitor the driver's seat and the passenger seat to allow the controller to determine whether each seat is occupied. Figure 2 (c) of shows a situation where only the driver is sitting on the driver's seat 180 and there is no passenger.

[0053] As Figure 2 (a) of shows, when it is determined that there is no passenger, the controller (not shown) may control the first IVI display 120 and the second IVI display 130 as one combined display. That is, since there is no passenger, the screen on the front display can be aligned based on the driver, thereby increasing the usability. The second hidden button 140 near the passenger seat may be inactivated.

[0054] Figure 2 (a) of shows an example in which the first IVI display 120 is separately displayed as a cluster 120-1, a cluster widget 120-2, and an IVI 120-3.

[0055] Specifically, the cluster 120-1 may display a cluster screen related to driving information (such as driving navigation information, vehicle speed, driving distance, battery status of an electric vehicle, etc.).

[0056] The cluster widget 120-2 can display information in the form of a widget. For example, it can represent warning information, a virtual personal assistant (VPA), turn by turn (TBT) navigation, an information widget, etc. However, this is an exemplary configuration, and the present disclosure is not limited thereto.

[0057] In addition, as described above, the IVI 120-3 can provide an IVI display for the driver and a second IVI display 130 for the passenger seat. Although maps, media, weather, biorhythm, battery status, and setting information are provided in the examples in Figure 2 , this is an exemplary configuration, and the present disclosure is not limited thereto. By dragging or touching in the arrow direction shown in (a) of Figure 2 , the applications can also be reordered or repositioned. In this case, obviously, the IVI parts of the first IVI display and the second IVI display move as a single screen.

[0058] As Figure 2 shown in (b) of

[0059] Figure 3 , when there is only a driver and no passengers, the second IVI display 130 can be disabled. In this case, the second hidden button 140 near the passenger seat can also be disabled. Figure 3 As shown in (c) of Figure 3 , the camera can monitor the driver's seat 180 and the passenger seat 190 to allow the controller to determine whether each seat is occupied.

[0060] As Figure 3 shown in (a) of

[0061] As Figure 3 shown in (b) of Figure 4A more detailed description will be given.

[0062] Figure 4 FIG. is a diagram showing a method of configuring a shared area on a front display according to an embodiment of the present disclosure. Figure 4 Shows the control of the first IVI display and the second display when there is a driver and a passenger, and the configuration of the shared area when there is a driver and an occupant.

[0063] First, when there is a driver and a passenger (401), allowing the passenger to arbitrarily change the screen for the driver to receive information while driving may pose a safety hazard. In this case, the controller can use a camera to determine whether the passenger is approaching the driver's side and operate the first IVI display. When the controller determines that the passenger is operating the first IVI display, the controller can block the input of the operation signal. That is, the first IVI display can be configured to be operated only by the driver and not by the passenger.

[0064] On the other hand, the driver can authorize the passenger to operate a specific area of the first IVI display. In this case, when the input is the same as the preset touch input of the camera and the front display, the input permitted by the driver can be activated. For example, a long press or drag area or application allowed in a certain direction can set that area or application as an area accessible to the passenger (402). In this case, the area set as the shared area can accept inputs from both the driver and the passenger, while the remaining area of the first IVI display can still restrictively accept only driver inputs.

[0065] Figure 5 FIG. is a diagram showing whether to display or not display the operating system 160 according to whether there is a passenger in an embodiment of the present disclosure.

[0066] In Figure 5 In the shown embodiment, the operating system is shown as being divided into a driver operating system 510, an HVAC operator 520, and a passenger operating system 530. The operating system 160 can be implemented in a projection manner.

[0067] When it is determined by the camera that only the driver is present (501), the controller can display only the driver operating system 510 and the HVAC operator 520, without displaying the passenger operating system 530.

[0068] When it is determined by the camera that both the driver and the passenger are present (502), the controller can display all of the driver operating system 510, the HVAC operator 520, and the passenger operating system 530.

[0069] Figure 6 FIG. is a diagram showing the control of the front display according to an embodiment of the present disclosure.

[0070] First, in Figure 6 In the illustrated embodiment, the display position in the standard mode 311 is preferably set to such a height that the bottom line of the display active area of the first IVI display on the front display 100 is not covered by the transparent panel 150.

[0071] Next, in Figure 6 In the illustrated embodiment, the low mode 313 is applied based on a low signal, and the front display can be moved downward to ensure the forward field of view (S320). In this case, as described above, it can be configured to provide simplified information by the light emitted from the bottom of the display through the transparent panel 150.

[0072] In an embodiment of the present disclosure, in the low mode 313, there are areas in the lower parts of the hidden buttons 110 and 140 that are covered due to the downward movement of the display, and considering the nature of the hidden buttons 110 and 140, it may not be effective to provide information by using the light from the bottoms of the hidden buttons 110 and 140 through the transparent panel 150. Therefore, different from the IVI displays 120 and 130, the hidden buttons 110 and 140 can be configured such that the positions of the existing hidden buttons are maintained in the areas not covered in the low mode 313.

[0073] Figure 6 An embodiment is shown in which the operating system 160 is implemented in a projection manner using the internal projector 410. To implement the display type operating system 160, a light emitting display (such as a light emitting diode (LED) display) can be used. However, there are many curves / surfaces in the internal space of a mobile device (especially a vehicle), and considering the internal characteristics, it is difficult to implement a light emitting display.

[0074] Therefore, in an embodiment of the present disclosure, the operating system 160 can be configured in a projection manner using the internal projector 410 in front of the mobile device. As Figure 6 shown, even in a space with various curves / surfaces, the operating system 160 can be advantageously and freely implemented.

[0075] Figure 7 is a diagram showing a transparent panel according to an embodiment of the present disclosure.

[0076] When the low mode is applied, the front display is configured to move downward and provide additional information by the light emitted from the lower area of the front display through the transparent panel 710.

[0077] Preferably, the display shows simpler information than the upper part of the forward display through the transparent panel 710 and provides a soft color as the background color, thereby providing a sense of comfort to the driver / passenger. However, when the information provided through the transparent panel 710 conveys a warning message to the driver / passenger, the transparent display preferably performs in a strong color that can provide alertness.

[0078] In Figure 7 the embodiment, in the low mode, there are areas in the lower parts of the hidden buttons 110 and 140 that are covered due to the downward movement of the display, and considering the nature of the hidden buttons 110 and 140, it may not be effective to provide information by using the light from the bottoms of the hidden buttons 110 and 140 through the transparent panel 150. Therefore, different from the IVI displays 120 and 130, it is proposed to configure the hidden buttons 110 and 140 such that the arrangement of the buttons is changed to maintain the existing functions of the hidden buttons in the areas not covered in the low mode 313.

[0079] In addition, Figure 7 the embodiment proposes that in the boundary area between multiple display areas, a separate light-emitting display (e.g., an LED display) is provided in an area where transparent display cannot be performed through the transparent panel 710. The light-emitting display 720 can be configured to provide additional information and be used as an in-vehicle mood light together with the transparent display area 710, as Figure 7 shown.

[0080] According to the above embodiments of the present disclosure, a method of changing the cockpit layout according to the display mode and a cockpit system using the method can be effectively configured.

[0081] By controlling the settings of the front display or the operating system according to whether there is a passenger, the usability during driving can be significantly improved.

[0082] In addition, according to an embodiment of the present disclosure, by detecting the approach of a passenger to the driver's screen through a camera, arbitrary operation of the driver's screen by the passenger can be prevented. The resulting prevention of dangerous situations during driving can improve safety.

[0083] Specifically, in an embodiment of the present disclosure, even during the driving mode, the forward view of the driver can be easily ensured through the low mode, and even in the low mode, information can be provided to the driver and the passenger by transmitting the light from the lower area of the front display through the transparent display.

[0084] As described above, a detailed description of the preferred embodiments of the present disclosure has been given so that those skilled in the art can implement and practice the present disclosure. Although the above description has been made with reference to the preferred embodiments of the present disclosure, those skilled in the art will understand that various modifications and changes can be made to the present disclosure without departing from the scope of the present disclosure. For example, those skilled in the art can use the configurations described in the above embodiments in combination with each other.

[0085] Therefore, the embodiments described herein are not intended to limit the present disclosure, but rather to give the broadest possible scope consistent with the principles and novel features disclosed herein.

Claims

1. A cockpit system provided in a vehicle, comprising: a front display disposed in front of a driver's seat and a passenger seat of the vehicle, the front display including a plurality of display areas; an operating system configured to receive an operating signal from a driver in the driver's seat or a passenger in the passenger seat; a camera configured to monitor the presence, absence, or movement of the driver in the driver's seat or the passenger in the passenger seat; as well as A controller is configured to control at least one of the plurality of displays of the front display, or to control the operating system in conjunction with the camera.

2. The cockpit system according to claim 1, wherein: The plurality of display areas of the front display include a first hidden button, a first in-vehicle infotainment system IVI display, a second in-vehicle infotainment system IVI display, and a second hidden button.

3. The cockpit system according to claim 2, wherein: The controller is also configured to: determining, by the camera, whether the passenger is in the passenger seat; and In response to determining that the passenger is not in the passenger seat, the second in-vehicle infotainment system IVI display is disabled or the second in-vehicle infotainment system IVI display and the first in-vehicle infotainment system IVI display are controlled to display as one display combined with each other.

4. The cockpit system according to claim 2, wherein: The controller is also configured to: determining, by the camera, whether the passenger is in the passenger seat; and In response to determining that the passenger is in the passenger seat, the second in-vehicle infotainment system IVI display is activated and enabled to receive control signals independently of the first in-vehicle infotainment system IVI display.

5. The cockpit system according to claim 4, wherein: In response to determining through the camera that the passenger has operated the first in-vehicle infotainment system IVI display, the controller is further configured not to input a signal of the operation to the first in-vehicle infotainment system IVI display.

6. The cockpit system according to claim 4, wherein: In response to determining, through the camera and the front display, that the driver has applied an input identical to a preset touch input on the first in-vehicle infotainment system IVI display, the controller is further configured to: Controlling a first area of ​​the first in-vehicle infotainment system IVI display to receive operations from the driver and the passenger; and The second area of ​​the first IVI display is controlled to receive only the operation signal of the driver.

7. The cockpit system according to claim 1, wherein: The controller is also configured to: determining, by the camera, whether a passenger is in the passenger seat; In response to determining that the passenger is not in the passenger seat, disabling a passenger operating system area of ​​the operating system; and In response to determining that the passenger is in the passenger seat, a passenger operating system region of the operating system is activated.

8. The cockpit system according to claim 2, wherein: The controller is also configured to: determining, by the camera, whether the passenger is in the passenger seat; disabling the second hidden button when it is determined that the passenger is not on the passenger seat; and When it is determined that the passenger is on the passenger seat, the second hidden button is activated.

9. The cockpit system according to claim 1, wherein: The controller is further configured to move the front display downward based on a low signal in the operation signal, and The cockpit system further includes a transparent panel configured to provide information to the driver and the passenger by transmitting light from a lower area of ​​the front display after the front display moves downward.

10. A method of controlling a cockpit system in a vehicle, the cockpit system comprising a front display, the front display comprising a first in-vehicle infotainment system (IVI) display and a second in-vehicle infotainment system (IVI) display, the method comprising: Determine if a passenger is in the passenger seat using a camera; In response to determining that the passenger is in the passenger seat, activating the second in-vehicle infotainment system IVI display and controlling the second in-vehicle infotainment system IVI display to receive control signals independently of the first in-vehicle infotainment system IVI display; and In response to determining that the passenger is not in the passenger seat, the second in-vehicle infotainment system IVI display is disabled or the second in-vehicle infotainment system IVI display and the first in-vehicle infotainment system IVI display are controlled to be one display combined with each other.

Images