Device and method for detecting non-illumination of warning light, and vehicle

Abstract

The invention relates to an apparatus and method for detecting non-illumination of a warning light, and a vehicle. An apparatus for detecting an unilluminated warning light is disclosed. A warning light display apparatus for detecting non-illumination of a warning light includes an integrated display device configured to include a cluster window and a multimedia window, and an integrated controller operatively connected to the integrated display device and configured to control the integrated display device. In response to receiving an event-related signal for triggering display of the warning light, the integrated controller transmits the event-related signal to the application for the cluster window and the application for the multimedia window, and determines whether the warning light corresponding to the event-related signal is displayed on the cluster window.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to a vehicle, and more particularly, to an apparatus and method for determining whether a warning light is displayed on an integrated monitor of a vehicle and displaying an alternative warning light on a part of the integrated monitor when the warning light is not turned on. Background Art

[0002] As the technologies of electric vehicles and autonomous driving have rapidly developed, it is expected that various occupants (hereinafter referred to as "users") will be able to perform various activities inside the vehicle. For example, the user can be a fallback-ready user (FRU), and thus can watch videos or moving images or participate in a video conference as long as he or she still knows the surrounding environment of the vehicle and can be prepared for fallback.

[0003] With the advent of the era of autonomous driving, various sensors are installed inside the vehicle. For example, cameras, microphone sensors, and thermal detection sensors can be installed to check objects inside the vehicle.

[0004] In the above environment, it is expected that ways to provide an interface for users in the vehicle will be needed in various ways. Summary of the Invention

[0005] Based on the above background, as integrated monitors have been rapidly popularized in vehicles, the present disclosure provides a method for ensuring the safety of the lighting operation of one or more warning lights in the integrated monitor of a vehicle. The integrated monitor can be referred to as an integrated screen, an integrated display device, etc., and can be controlled by an integrated controller capable of overall control of a cluster and a multimedia monitor, rather than by a cluster controller that controls the cluster where the warning light is turned on. When an unexpected operation occurs in which the warning light is not turned on, it is necessary to implement countermeasures for non-illumination of the warning light by using the integrated controller.

[0006] The technical subject to be solved by the present disclosure is not limited to the above technical solutions, and it should be noted that those skilled in the art can understand other technical subjects not described above from the following description of the present disclosure.

[0007] According to an embodiment of the present disclosure, a device for detecting the non-illumination of a warning light may include: an integrated display device configured to include a cluster window and a multimedia window; and an integrated controller operatively connected to the integrated display device and configured to control the integrated display device. The integrated controller is configured to: in response to receiving an event-related signal for triggering the display of the warning light, transmit the event-related signal to a first application for the cluster window and a second application for the multimedia window; and determine whether the warning light corresponding to the event-related signal is displayed on the cluster window.

[0008] According to another embodiment of the present disclosure, a method for detecting the non-illumination of a warning light, which is executed by a device including an integrated display device having a cluster window and a multimedia window and an integrated controller for controlling the integrated display device, the method may include: receiving an event-related signal for triggering the display of the warning light; transmitting the event-related signal to an application for the cluster window and an application for the multimedia window; and determining whether the warning light corresponding to the event-related signal is displayed on the cluster window.

[0009] The above solutions of the present disclosure are some of the embodiments of the present disclosure. Based on the detailed description of the present disclosure to be described below, various solutions other than the above solutions can be derived and understood. Brief Description of the Drawings

[0010] The included drawings are used to provide a further understanding of the present disclosure, and are incorporated in and constitute a part of this application. The drawings illustrate embodiments of the present disclosure and, together with the description, are used to explain the principles of the present disclosure.

[0011] Figure 1 is an overall block diagram of an autonomous vehicle to which an autonomous driving device can be applied.

[0012] Figure 2 is a diagram showing an example of an autonomous driving device applied to a vehicle.

[0013] Figure 3 is a diagram showing an example structure of a conventional vehicle cluster and a safety structure for coping with vehicle failures or malfunctions.

[0014] Figure 4 is a diagram showing the difference between the control structure for a vehicle cluster and a multimedia integrated monitor according to the related art and the control structure for an integrated monitor according to the present disclosure.

[0015] Figure 5 is a diagram showing a detailed structure for integrated control according to the present disclosure.

[0016] Figure 6 is a diagram showing a software structure for integrated control according to the present disclosure.

[0017] Figure 7 is a dual transmission structure of signals related to a warning light trigger event according to the present disclosure.

[0018] Figure 8 is a diagram showing an example of a warning light displayed on an integrated monitor according to the present disclosure.

[0019] Figure 9 is a flowchart showing a method for detecting an unlit state of one or more warning lights of an integrated monitor according to the present disclosure. Detailed Description of the Embodiment

[0020] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description of the present disclosure are omitted for clarity, and like reference numerals will be used throughout this specification to refer to like parts.

[0021] In the specification, when a part "includes" an element, this means that the part may also include another element, rather than excluding another element, unless otherwise stated.

[0022] Figure 1 is an overall block diagram of an autonomous driving control system of an autonomous driving device to which any one of the embodiments according to the present disclosure can be applied. Figure 2 is a diagram showing an example in which an autonomous driving device according to any one of the embodiments of the present disclosure is applied to a vehicle.

[0023] First, with reference to Figure 1 and Figure 2 the structure and function of an autonomous driving control system (e.g., an autonomous driving vehicle) of an autonomous driving device to which the present embodiment can be applied will be described.

[0024] As Figure 1 shown in, the autonomous driving vehicle 1000 can be implemented based on an autonomous driving integrated controller 600, which transmits and receives data required for autonomous driving control of the vehicle through a driving information input interface 101, a driving information input interface 201, an occupant output interface 301, and a vehicle control output interface 401. However, the autonomous driving integrated controller 600 may also be referred to as a controller, a processor, or simply a controller herein.

[0025] In the autonomous driving mode or manual driving mode of the vehicle, the autonomous driving integrated controller 600 can obtain driving information based on the manipulation of the user input unit 100 by the occupant through the driving information input interface 101. As Figure 1 shown, the user input unit 100 may include a driving mode switch 110 and a control panel 120 (for example, a navigation terminal installed in the vehicle or a smartphone or tablet owned by the occupant). Therefore, the driving information may include the driving mode information and navigation information of the vehicle.

[0026] For example, the driving mode of the vehicle determined by the manipulation of the driving mode switch 110 by the occupant (i.e., autonomous driving mode / manual driving mode or sport mode / economy mode / safety mode / normal mode) can be transmitted to the autonomous driving integrated controller 600 as driving information through the driving information input interface 101.

[0027] In addition, navigation information, such as the destination of the occupant input through the control panel 120 and the route to the destination (for example, the shortest route or preferred route selected by the occupant among the candidate routes to the destination), can be transmitted to the autonomous driving integrated controller 600 as driving information through the driving information input interface 101.

[0028] The control panel 120 can be implemented as a touch screen panel, which provides a user interface (UI) through which the occupant inputs or modifies information for the autonomous driving control of the vehicle. In this case, the driving mode switch 110 can be implemented as a touch button on the control panel 120.

[0029] In addition, the autonomous driving integrated controller 600 can obtain driving information indicating the driving state of the vehicle through the driving information input interface 201. The driving information may include: the steering angle formed when the occupant manipulates the steering wheel; the accelerator pedal stroke or brake pedal stroke formed when the occupant presses the accelerator pedal or brake pedal; and various types of information indicating the driving state and behavior of the vehicle, such as the vehicle speed, acceleration, yaw, pitch, and roll formed in the vehicle. As Figure 1 shown, the driving information can be detected by the driving information detection unit 200, which includes a steering angle sensor 210, an accelerator position sensor (APS) / pedal travel sensor (PTS) 220, a vehicle speed sensor 230, an acceleration sensor 240, and a yaw / pitch / roll sensor 250.

[0030] In addition, the driving information of the vehicle may include the position information of the vehicle. The position information of the vehicle can be obtained through a Global Positioning System (GPS) receiver 260 applied to the vehicle. Such driving information can be transmitted to the autonomous driving integration controller 600 through the driving information input interface 201 and can be used to control the driving of the vehicle in the autonomous driving mode or the manual driving mode of the vehicle.

[0031] In the autonomous driving mode or the manual driving mode of the vehicle, the autonomous driving integration controller 600 can transmit the driving state information provided to the occupant to the output unit 300 through the occupant output interface 301. That is, the autonomous driving integration controller 600 transmits the driving state information of the vehicle to the output unit 300 so that the occupant can check the autonomous driving state or the manual driving state of the vehicle based on the driving state information output through the output unit 300. The driving state information may include various types of information indicating the driving state of the vehicle, such as the current driving mode, the transmission range, and the speed of the vehicle.

[0032] If it is determined that it is necessary to alert the driver together with the above driving state information in the autonomous driving mode or the manual driving mode of the vehicle, the autonomous driving integration controller 600 transmits the alert information to the output unit 300 through the occupant output interface 301 so that the output unit 300 can output an alert to the driver. As Figure 1 shown, in order to output such driving state information and alert information both audibly and visually, the output unit 300 may include a speaker 310 and a display 320. In this case, the display 320 may be implemented as the same device as the control panel 120, or may be implemented as an independent device separate from the control panel 120.

[0033] In addition, in the autonomous driving mode or the manual driving mode of the vehicle, the autonomous driving integration controller 600 can transmit the control information for the driving control of the vehicle to the lower control system 400 applied to the vehicle through the vehicle control output interface 401. As Figure 1 shown, the lower control system 400 for the driving control of the vehicle may include an engine control system 410, a brake control system 420, and a steering control system 430. The autonomous driving integration controller 600 can transmit engine control information, brake control information, and steering control information as control information to the corresponding lower control systems 410, 420, and 430 through the vehicle control output interface 401. Therefore, the engine control system 410 can control the speed and acceleration of the vehicle by increasing or decreasing the fuel supplied to the engine. The brake control system 420 can control the braking of the vehicle by controlling the braking power of the vehicle. The steering control system 430 can control the steering of the vehicle through a steering device applied to the vehicle (for example, an Electric Power Steering (MDPS) system).

[0034] As described above, the autonomous driving integrated controller 600 according to the present embodiment can obtain driving information based on the driver's operation and driving information indicating the driving state of the vehicle through the driving information input interface 101 and the driving information input interface 201, respectively, and transmit the driving state information and warning information generated based on the autonomous driving algorithm to the output unit 300 through the occupant output interface 301. In addition, the autonomous driving integrated controller 600 can transmit the control information generated based on the autonomous driving algorithm to the lower control system 400 through the vehicle control output interface 401, thereby performing the driving control of the vehicle.

[0035] To ensure stable autonomous driving of the vehicle, it is necessary to continuously monitor the driving state of the vehicle by accurately measuring the driving environment of the vehicle and control the driving based on the measured driving environment. For this purpose, as Figure 1 shown, the autonomous driving device according to the present embodiment may include a sensor unit 500 for detecting nearby objects of the vehicle, such as nearby vehicles, pedestrians, roads, or fixed facilities (e.g., signal lights, road signs, traffic signs, or building fences).

[0036] As Figure 1 shown, the sensor unit 500 may include one or more of a LiDAR sensor 510, a radar sensor 520, or a camera sensor 530 to detect nearby objects outside the vehicle.

[0037] The LiDAR sensor 510 can transmit a laser signal to the periphery of the vehicle and detect nearby objects outside the vehicle by receiving the signal reflected and returned from the corresponding object. The LiDAR sensor 510 can detect nearby objects located within a preset distance, a preset vertical field of view, and a preset horizontal field of view pre-defined according to its specifications. The LiDAR sensor 510 may include a front LiDAR sensor 511, a top LiDAR sensor 512, and a rear LiDAR sensor 513 respectively installed at the front, top, and rear of the vehicle, but the installation position of each LiDAR sensor and the number of installed LiDAR sensors are not limited to a specific embodiment. A threshold for determining the validity of the laser signal reflected and returned from the corresponding object may be pre-stored in a memory (not shown) of the autonomous driving integrated controller 600. The autonomous driving integrated controller 600 can use the method of measuring the time it takes for the laser signal transmitted through the LiDAR sensor 510 to be reflected and returned from the corresponding object to determine the position (including the distance to the corresponding object), speed, and moving direction of the corresponding object.

[0038] The radar sensor 520 can radiate electromagnetic waves around the vehicle and detect nearby objects outside the vehicle by receiving the signals reflected and returned from the corresponding objects. The radar sensor 520 can detect nearby objects within a preset distance, a preset vertical field of view, and a preset horizontal field of view pre-defined according to its specifications. The radar sensor 520 can include a front radar sensor 521, a left radar sensor 522, a right radar sensor 523, and a rear radar sensor 524 respectively installed at the front, left, right, and rear of the vehicle, but the installation positions of each radar sensor and the number of installed radar sensors are not limited to a specific embodiment. The autonomous driving integrated controller 600 can use a method of analyzing the power of the electromagnetic waves transmitted and received through the radar sensor 520 to determine the position (including the distance to the corresponding object), speed, and moving direction of the corresponding object.

[0039] The camera sensor 530 can detect nearby objects outside the vehicle by photographing the periphery of the vehicle and detect nearby objects within a preset distance, a preset vertical field of view, and a preset horizontal field of view pre-defined according to its specifications.

[0040] The camera sensor 530 can include a front camera sensor 531, a left camera sensor 532, a right camera sensor 533, and a rear camera sensor 534 respectively installed at the front, left, right, and rear of the vehicle, but the installation positions of each camera sensor and the number of installed camera sensors are not limited to a specific embodiment. The autonomous driving integrated controller 600 can determine the position (including the distance to the corresponding object), speed, and moving direction of the corresponding object by applying pre-defined image processing to the images captured by the camera sensor 530.

[0041] In addition, an interior camera sensor 535 for capturing the interior of the vehicle can be installed at a predetermined position (e.g., the rearview mirror) inside the vehicle. The autonomous driving integrated controller 600 can monitor the behavior and state of the occupants based on the images captured by the interior camera sensor 535 and output guidance or warnings to the occupants through the output unit 300.

[0042] As Figure 1 shown, in addition to the LiDAR sensor 510, the radar sensor 520, and the camera sensor 530, the sensor unit 500 can further include an ultrasonic sensor 540, and various types of sensors can also be employed to detect nearby objects of the vehicle together with the sensors.

[0043] Figure 2An example is shown where, to aid in understanding the present embodiment, a front LiDAR sensor 511 or a front radar sensor 521 is installed at the front of the vehicle, a rear LiDAR sensor 513 or a rear radar sensor 524 is installed at the rear of the vehicle, and a front camera sensor 531, a left camera sensor 532, a right camera sensor 533, and a rear camera sensor 534 are installed at the front, left, right, and rear of the vehicle, respectively. However, as described above, the installation position of each sensor and the number of sensors installed are not limited to a specific embodiment.

[0044] In addition, to determine the state of an occupant inside the vehicle, the sensor unit 500 may further include a biosensor for detecting a biosignal of the occupant (e.g., heart rate, electrocardiogram, respiration, blood pressure, body temperature, electroencephalogram, photoplethysmogram (or pulse wave), and blood glucose). The biosensor may include a heart rate sensor, an electrocardiogram sensor, a respiration sensor, a blood pressure sensor, a body temperature sensor, an electroencephalogram sensor, a photoplethysmogram sensor, and a blood glucose sensor.

[0045] Finally, the sensor unit 500 further includes a microphone 550 having an internal microphone 551 and an external microphone 552 for different purposes.

[0046] For example, the internal microphone 551 may be used to analyze the speech of an occupant in the autonomous vehicle 1000 based on AI or to immediately respond to a direct voice command of the occupant.

[0047] Conversely, for example, the external microphone 552 may be used to appropriately respond to safe driving by analyzing various sounds generated from outside the autonomous vehicle 1000 using various analysis tools such as deep learning.

[0048] By reference, Figure 2 the symbols shown in Figure 1 may perform the same or similar functions as those shown in Figure 1 Compared with Figure 2 the relative positional relationship of each component is shown in more detail (based on the interior of the autonomous vehicle 1000).

[0049] The present disclosure proposes a new method for meeting the requirements of functional safety related to a cluster for a vehicle.

[0050] The cluster may have a warning light (also referred to as a "telltale") illumination function that receives a signal through CAN communication and displays the received signal on the cluster display. Examples of the functional safety requirements for these warning lights (telltales) are as follows:

[0051] – Unintentional non - illumination of warning lights (which varies according to vehicle specifications) should be prevented.

[0052] – Warning lights (indicator lights) include:

[0053] – IFS (AFS) indicator light – Auto - hold indicator light (yellow) – MDPS indicator light – Airbag indicator light – EPB indicator light – Main symbol (stop - lamp short - circuit) – Battery indicator light, etc.

[0054] Failure to meet these requirements may lead to dangerous situations caused by the driver's neglect of the vehicle's condition.

[0055] Figure 3 is a diagram showing an example structure of a conventional vehicle cluster and a safety structure for coping with vehicle failures or malfunctions.

[0056] In the case of a conventional vehicle cluster, the cluster controller 611 can be connected to the cluster display driver board 612 to drive the display module 321. The cluster controller 611 and the cluster display driver board 612 can be collectively referred to as the cluster platform 610.

[0057] Refer to Figure 3 , a safety integrated circuit (IC) located at the center of the cluster display driver board 612 can detect safety OSD (on - screen display) image errors and can include a safety structure that enables the output of a separate pre - stored warning light (I_safety) to the display module 321.

[0058] Figure 4 is a diagram showing the difference between the control structure for a vehicle cluster and a multimedia integrated monitor according to the related art and the control structure for an integrated monitor according to the present disclosure.

[0059] Figure 4 (a) of Figure 3 is a structural diagram showing a structure in which a multimedia platform 620 is added to

[0060] The term "integrated monitor" may refer to a single monitor that displays cluster information, information related to navigation, audio, and communication devices, and / or information related to the vehicle, as well as multimedia information required to display images or videos. However, the above - mentioned single monitor does not necessarily represent a physically integrated display panel. The integrated monitor can be referred to by several terms including an integrated screen, an integrated cluster, an integrated display device, etc.

[0061] Refer to Figure 4(a), according to the related art, although the integrated monitor 320 is introduced into the vehicle, the cluster platform 610 and the multimedia platform 620 can be separately arranged.

[0062] On the other hand, referring to Figure 4 (b), the integrated controller 630 can drive and control the integrated monitor 320. The present disclosure attempts to propose a new method related to the illumination or non - illumination of the warning light (indicator light) in the driving and control structure of the integrated monitor shown in Figure 4 (b).

[0063] Figure 5 is a diagram showing the detailed structure for integrated control according to the present disclosure. In the structure shown in Figure 4 (b), driving and controlling the integrated monitor can be referred to as "integrated control". The integrated controller 630 can be arranged for integrated control, which basically adopts the method of processing CAN data in one access point (AP). At this time, for response to functional safety, software or its logical configuration for driving a virtual machine such as a hypervisor can be installed or implemented on the AP. Each function can operate in each virtual machine or can be implemented in each virtual machine.

[0064] Figure 6 is a diagram showing the software structure or logical structure for integrated control according to the present disclosure. Figure 6 is a diagram showing the software structure or logical structure 631 installed or implemented on the AP of the integrated controller 630 according to the present disclosure.

[0065] Referring to Figure 6 , a hypervisor layer 6311, an operating system (OS) / middleware layer 6312, and an application layer 6313 can be configured on the AP. In order to use the hypervisor to drive multiple virtual machines, multiple guest operating systems (Oss) are implemented or installed in the operating system (OS) / middleware layer 6312, and the hypervisor can act as a host. Referring to Figure 6 , three guest OSs can be implemented or installed in the operating system (OS) / middleware layer 6312, where the guest (OS#1) can be used for multimedia and the guest (OS#3) can be used for the cluster. The applications of each guest are installed or implemented on each guest OS.

[0066] Figure 7 is a dual - transmission structure of signals related to the indicator light (warning light) trigger event according to the present disclosure.

[0067] Referring to Figure 7, P1 can represent the transmission path via CAN communication of a signal related to an indicator light triggering event. The cluster indicator light function can be designed to operate when transmitting a specific signal via CAN communication. Referring to the P1 path, the hypervisor can output a CAN communication signal to the cluster application (app) so that the indicator light triggering event can be passed to the cluster application. According to this signal, the indicator light (i.e., warning light) can be turned on. If the indicator light triggering event is not transmitted or is mishandled due to problems encountered in the cluster application or middleware, such incorrect operation of the indicator light triggering event cannot be detected.

[0068] To solve the above problems, the present disclosure proposes a method for adding path P2 to the above example. The hypervisor can perform video capture of the cluster window only on the signal related to the indicator light triggering event for turning on the indicator light (or warning light), and can transmit the captured result to the security detector of the multimedia application. Here, considering the time delay for driving or implementing the cluster window, video capture can be performed after a predetermined time has elapsed from the time point when the signal related to the indicator light triggering event is received.

[0069] Figure 8 is a diagram showing an example of a warning light (indicator light) displayed on an integrated monitor according to the present disclosure.

[0070] Referring to Figure 8 , the display 320 may include a cluster window 321 and a multimedia window 322. Figure 8 The indicator light (or warning light) (S) shown in

[0071] Referring to Figure 8 's (a), when a signal related to the indicator light triggering event is received, the indicator light (S) can be turned on (or displayed) on the cluster window 321. However, if the integrated monitor does not receive a signal related to the indicator light triggering event from the operating system (OS) / middleware for the cluster or the application (app) for the cluster, or if any processing error occurs, the indicator light (S) will not be lit or will not be displayed on the cluster window 321. If the indicator light (warning light) is not turned on, the user or driver of the vehicle will not be aware that a problem has occurred in the vehicle, and thus the user will continue to drive the vehicle, which may pose a potential danger.

[0072] Therefore, as Figure 8As shown in (b) thereof, if the indicator light (S) is not turned on (or not lit) in the cluster window 321 even though a signal related to the indicator light trigger event has been received by the integrated monitor, the present disclosure can detect the unlit state of the indicator light (S) and can cause the indicator light (S) to be displayed on the multimedia window 322.

[0073] The operation of the integrated controller 630 for this purpose will now be described in detail with reference to the accompanying drawings.

[0074] Upon receiving a signal related to the indicator light trigger event, the integrated controller 630 can perform video capture on the above-mentioned cluster window 321, or can perform video capture on a display including the cluster window 321, so that the captured image can be obtained.

[0075] The integrated controller 630 can detect the indicator light (warning light) image from the captured image. Since the area where the indicator light (warning light) is set to be turned on is in the cluster window 321, the integrated controller 630 can attempt to detect the indicator light image in the indicator light (warning light) area.

[0076] If the indicator light image is successfully detected, the integrated controller 630 can compare the detected indicator light image with the pre-stored indicator light information, so that the indicator light (warning light) corresponding to the detected indicator light image can be identified.

[0077] If the detection of the indicator light image is not successful, or the identification of the indicator light corresponding to the detected indicator light image is not successful, the integrated controller 630 can identify the indicator light (warning light) information corresponding to the signal related to the received indicator light trigger event. The integrated controller 630 can detect or select the identified indicator light from the pre-stored indicator light information, and can control the indicator light image corresponding to the identified indicator light to be displayed on the multimedia window 322.

[0078] That is to say, when the integrated controller 630 confirms that the indicator light (warning light) pre-arranged to be displayed on the cluster window 321 is not turned on, the integrated controller 630 can cause the corresponding indicator light (S) to be displayed on the multimedia window 322.

[0079] Figure 9It is a flowchart showing a method for detecting an unlit state of an indicator light (or warning light) of an integrated monitor according to the present disclosure. The method for detecting the unlit state of the indicator light (warning light) can be executed by a device including an integrated display device composed of a cluster window and a multimedia window and an integrated controller designed to control the integrated display device. Hereinafter, the "device" or "apparatus" will be described as executing this method. The "device" or "apparatus" can be a device for detecting an indicator light (warning light), or a device including an indicator light detection device.

[0080] Referring to Figure 9 , the device can receive a signal related to an indicator light trigger event (S910).

[0081] The device can transmit the signal related to the indicator light trigger event to an app for the cluster window and another app for the multimedia window (S920).

[0082] The device can determine whether the indicator light (warning light) corresponding to the signal related to the indicator light trigger event is displayed on the cluster window (S930).

[0083] When the indicator light (warning light) corresponding to the signal related to the indicator light trigger event is turned on, the device can complete the execution of this method. In other words, this is because the indicator light (warning light) is usually displayed on the integrated display device.

[0084] Hereinafter, a detailed procedure for determining whether the indicator light (warning light) corresponding to the signal related to the indicator light trigger event is turned on will be described in detail.

[0085] After a preset time delay from the time point when the signal related to the trigger event is transmitted, the device can capture a video or an image displayed on the integrated display device. Video capture can only be performed on the cluster window among the integrated display devices, and cannot be performed on the entire integrated display device.

[0086] The device can transfer the captured video to the app for the multimedia window. This is because the normal operation of the app for the cluster window (cluster app) cannot be guaranteed.

[0087] The device can determine whether an indicator light (warning light) is not displayed on the cluster window based on the indicator light (warning light) trigger event and the video captured by the application for the multimedia window. The device can pre-store information about all indicator light (warning light) trigger events. Therefore, the device can identify which of the indicator light (warning light) trigger events is related to the signal associated with the indicator light trigger event, and can identify the indicator light (warning light) corresponding to the identified indicator light trigger event. The device can attempt to detect the previously stored indicator light (warning light) information from the captured video. If the detection of the indicator light (warning light) information in the captured video is unsuccessful, the device can determine that the indicator light (warning light) is not displayed on the cluster window.

[0088] When the indicator light (warning light) is not displayed on the cluster window, the device can control the indicator light (warning light) corresponding to the indicator light (warning light) trigger event to be displayed on the multimedia window.

[0089] Meanwhile, the app for the cluster window and the app for the multimedia window can be implemented, installed, or operated on different customer operating systems (OS).

[0090] In addition, the device can perform the operations of the integrated controller related to the present disclosure described above Figures 4 to 8 which are not described with reference to Figure 9 for description.

[0091] Although, for ease of description, the above embodiments of the present disclosure have disclosed a device (or equipment) for controlling a user interface (UI) and components included therein to perform such control, the device (or equipment) and its components are only names, and the scope of the rights does not depend thereon.

[0092] In other words, the proposed technology of the present disclosure can be performed by a device having a name other than the control device. In addition, the above methods, solutions, etc. can be executed by software or code readable by a computer or other machines or devices for vehicle control.

[0093] In addition, as another aspect of the present disclosure, the operations of the above proposed technology can be set as code, which can be implemented, realized, or executed by a "computer" (including the general concept of a system on chip (SoC) or (micro)processor) or a computer-readable storage medium, a computer program product, etc. that stores or includes the code. The scope of the present disclosure can be extended to the code or the computer-readable storage medium or the computer program product that stores or includes the code.

[0094] A detailed description of the preferred embodiments of the present disclosure disclosed as above has been provided so that those skilled in the art can implement and realize the present disclosure.

[0095] Although the present disclosure has been described above with reference to the preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the present disclosure claimed in the claims.

[0096] Therefore, the present disclosure is not intended to be limited to the embodiments shown herein, but should conform to the broadest scope consistent with the principles and novel features disclosed herein.

[0097] It is apparent from the above description that, according to the solution to the above problems, the present disclosure can prevent the situation where one or more warning lights are not displayed on the integrated monitor.

[0098] In addition, according to the present disclosure, the situation where the warning light is not displayed in the cluster area of the integrated monitor can be detected earlier, and countermeasures to solve this situation can be initiated.

[0099] In addition, the present disclosure can only execute the recommendation function when used to turn on the warning light, thereby reducing resource consumption.

[0100] The effects of the present disclosure are not limited to the above effects. Those skilled in the art can understand other effects not described above from the description of the present disclosure.

[0101] It will be apparent to those skilled in the art that various modifications and variations can be made to the present disclosure without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is intended to cover modifications and variations of the present disclosure as long as they are within the scope of the appended claims and their equivalents.

[0102] This application claims the benefit of Korean Patent Application No. 10-2023-0167484, filed on November 28, 2023, which is incorporated herein by reference in its entirety as if fully set forth herein.

Claims

1. A device for detecting that a warning light is not illuminated, the device for detecting that a warning light is not illuminated comprising: an integrated display device configured to include a cluster window and a multimedia window; as well as an integrated controller operatively connected to the integrated display device and configured to control the integrated display device, Wherein, the integrated controller is further configured to: In response to receiving an event-related signal for triggering display of the warning light, transmitting the event-related signal to a first application for the cluster window and a second application for the multimedia window; and and It is determined whether a warning light corresponding to the event-related signal is displayed on the cluster window.

2. The device for detecting non-illumination of a warning light according to claim 1, wherein: The first application for the cluster window and the second application for the multimedia window are installed on and operate on different client operating systems.

3. The device for detecting non-illumination of a warning light according to claim 1, wherein: The integrated controller is also configured to: When it is inferred that the warning light corresponding to the event-related signal is not displayed on the cluster window, the warning light corresponding to the event-related signal is controlled to be displayed on the multimedia window.

4. The device for detecting non-illumination of a warning light according to claim 1, wherein: In order for the integrated controller to determine whether the warning light corresponding to the event-related signal is displayed on the cluster window, the integrated controller is further configured to: capturing an image displayed on the integrated display device after a predetermined time delay from a point in time when the event-related signal has been transmitted; transmitting the captured image to the second application for the multimedia window; and The second application for the multimedia window is allowed to determine whether the warning light corresponding to the event-related signal is not displayed on the cluster window based on the captured image and the event-related signal.

5. The device for detecting non-illumination of a warning light according to claim 4, wherein: The integrated controller is also configured to: attempting to detect a warning image in the captured image corresponding to the event-related signal; and In response to not detecting the warning image corresponding to the event-related signal in the captured image, it is inferred that the warning light corresponding to the event-related signal is not displayed in the cluster window.

6. A method for detecting non-illumination of a warning light, the method for detecting non-illumination of a warning light being performed by a device comprising an integrated display device and an integrated controller, the integrated display device comprising a cluster window and a multimedia window, the integrated controller being operatively connected to the integrated display device and configured to control the integrated display device, the method for detecting non-illumination of a warning light comprising the following steps: receiving, by the integrated controller, an event-related signal for triggering display of the warning light; transmitting, by the integrated controller, the event-related signal to a first application for the cluster window and a second application for the multimedia window; as well as The integrated controller determines whether a warning light corresponding to the event-related signal is displayed on the cluster window.

7. The method for detecting non-illumination of a warning light according to claim 6, wherein: The first application for the cluster window and the second application for the multimedia window are installed on and operate on different client operating systems.

8. The method for detecting non-illumination of a warning light according to claim 6, further comprising the following steps: When it is inferred that the warning light corresponding to the event-related signal is not displayed on the cluster window, the integrated controller controls the warning light corresponding to the event-related signal to be displayed on the multimedia window.

9. The method for detecting non-illumination of a warning light according to claim 6, further comprising the following steps: capturing, by the integrated controller, an image displayed on the integrated display device after a predetermined time delay from a point in time when the event-related signal has been transmitted; transmitting, by the integrated controller, the captured image to the second application for the multimedia window; as well as The second application for the multimedia window is allowed by the integrated controller to determine whether the warning light corresponding to the event-related signal is not displayed on the cluster window based on the captured image and the event-related signal.

10. The method for detecting non-illumination of a warning light according to claim 9, further comprising the following steps: Attempting, by the integrated controller, to detect a warning image in the captured image corresponding to the event-related signal; as well as In response to not detecting the warning image in the captured image, it is inferred by the integrated controller that the warning light corresponding to the event-related signal is not displayed on the cluster window.

11. A method for detecting an unilluminated vehicle with a warning light, the method comprising: an integrated display device configured to include a cluster window and a multimedia window; as well as an integrated controller operatively connected to the integrated display device and configured to control the integrated display device, Wherein, the integrated controller is further configured to: In response to receiving an event-related signal for triggering display of the warning light, transmitting the event-related signal to a first application for the cluster window and a second application for the multimedia window; and and It is determined whether a warning light corresponding to the event-related signal is displayed on the cluster window.

12. The method for detecting an unilluminated vehicle of a warning light according to claim 11, wherein: The first application for the cluster window and the second application for the multimedia window are installed on and operate on different client operating systems.

13. The method for detecting an unilluminated vehicle of a warning light according to claim 11, wherein: The integrated controller is also configured to: When it is inferred that the warning light corresponding to the event-related signal is not displayed on the cluster window, the warning light corresponding to the event-related signal is controlled to be displayed on the multimedia window.

14. The method for detecting an unilluminated vehicle of a warning light according to claim 11, wherein: In order for the integrated controller to determine whether the warning light corresponding to the event-related signal is displayed on the cluster window, the integrated controller is configured to: capturing an image displayed on the integrated display device after a predetermined time delay from a point in time when the event-related signal has been transmitted; transmitting the captured image to the second application for the multimedia window; and The second application for the multimedia window is allowed to determine whether the warning light corresponding to the event-related signal is not displayed on the cluster window based on the captured image and the event-related signal.

15. The method for detecting an unilluminated vehicle of a warning light according to claim 14, wherein: The integrated controller is configured to: attempting to detect a warning image in the captured image corresponding to the event-related signal; and In response to not detecting the warning image in the captured image, it is inferred that the warning light corresponding to the event-related signal is not displayed on the cluster window.

Images