Anomaly detection device

Abstract

This makes it possible to detect a wider variety of display anomalies while minimizing the decline in the marketability of the display. [Solution] The display control unit 10 displays an RGB color model image on the display screen of the display device, which includes blinking dots, which are pixels that periodically switch between two specific colors with different RGB values; a data comparison unit 103 identifies the difference between the RGB values ​​of the image data to be displayed as blinking dots and the expected value that would be expected as the RGB values ​​of the image data if there is no abnormality; and an abnormality detection unit 104 detects that there is an abnormality in the image display using the image data if the difference identified by the data comparison unit 103 is greater than or equal to a threshold. The display control unit 10 sets the RGB values ​​of the two specific colors of the blinking dots in the settings so that the difference between them and the RGB values ​​of the background color to be displayed as the background on the display screen is less than or equal to a specified value.

Description

Technical Field

[0001] The present disclosure relates to an abnormality detection device that detects an abnormality in video display.

Background Art

[0002] For example, Patent Document 1 discloses a technique for detecting whether or not a black screen state in which the entire display unit becomes a black image has continued for a predetermined time, by comparing a sum value obtained by sampling RGB color signals supplied to the display unit a predetermined number of times with a threshold value.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0004] Since the technique of Patent Document 1 uses the sum value of RGB color signals, it cannot detect display abnormalities such as image sticking other than the black screen state. In contrast, it is conceivable to detect display abnormalities by monitoring the video signal of blinking dots that cause a display to alternately blink with specific colors such as red and green. Moreover, in order to suppress a decrease in the marketability of the display caused by the blinking dots being conspicuous, it is conceivable to arrange the blinking dots in a portion hidden by a casing that covers the outer frame of the display. However, even with this measure, if no casing covering the outer frame of the display is provided to increase the screen size of the display, the blinking dots will become conspicuous, which may reduce the marketability of the display.

[0005] One object of the present disclosure is to provide an electronic control device that is capable of detecting more types of display abnormalities while also suppressing a decrease in the marketability of a display.

Means for Solving the Problems

[0006] The above objectives are achieved by a combination of features described in the independent claims, and the subordinate claims provide further advantageous specific examples of the disclosure. The reference numerals in parentheses in the claims indicate correspondences with specific means described in the embodiments described later as one aspect, and do not limit the technical scope of this disclosure.

[0007] To achieve the above objective, the anomaly detection device of this disclosure includes a display control unit (10) that displays an RGB color model video on the display screen of a display (1) which includes blinking dots, which are pixels that periodically switch between two specific colors with different RGB values; a data comparison unit (103) that identifies the difference between the RGB values ​​of the video data to be displayed as blinking dots and the expected values ​​that would be expected as the RGB values ​​of the video data if there were no anomalies; and an anomaly detection unit (104) that detects that there is an anomaly in the video display using video data when the difference identified by the data comparison unit is greater than or equal to a threshold. The display control unit sets the RGB values ​​of the two specific colors of the blinking dots in the settings so that the difference between them and the RGB values ​​of the background color to be displayed as the background on the display screen is less than or equal to a specified value.

[0008] With the above configuration, abnormalities in the video display are detected by looking at the difference between the RGB values ​​of the video data being displayed in a blinking dot (a pixel that periodically switches between two specific colors with different RGB values) and the expected value that would be expected for the RGB values ​​of the video data if there were no abnormalities. Therefore, it becomes possible to detect display abnormalities such as video signal sticking other than a black screen state. In addition, by setting the RGB values ​​of the two specific colors of the blinking dot so that the difference from the RGB values ​​of the background color is less than or equal to a specified value, it becomes possible to make the color of the blinking dot close to the color of the background color. Consequently, even if the blinking dot is not hidden by the display casing, it becomes less likely to be noticed by the user, and the marketability of the display is less likely to be reduced. As a result, it becomes possible to detect a wider variety of display abnormalities while suppressing the reduction in the marketability of the display. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of a schematic configuration of a display device. [Figure 2] This is a diagram illustrating an example of an output check section. [Figure 3] This is an example showing the display screen of the display unit. [Figure 4] This is an example showing the display screen of the display unit. [Figure 5] This diagram illustrates an example of the relationship between the background color and the first and second flashing colors. [Modes for carrying out the invention]

[0010] Multiple embodiments for disclosure will be described with reference to the drawings. For the sake of clarity, in some embodiments, parts having the same function as those shown in the drawings used in previous descriptions will be denoted by the same reference numerals, and their descriptions may be omitted. For parts denoted by the same reference numerals, refer to the descriptions in other embodiments.

[0011] (Embodiment 1) <Outline configuration of display device 1> Hereinafter, Embodiment 1 of the present disclosure will be described with reference to the drawings. The display device 1 shown in Figure 1 is capable of being used in a vehicle. As shown in Figure 1, the display device 1 includes a display control unit 10, a display unit 20, an interface (hereinafter referred to as I / F) unit 30, and an image generation unit 40. Each of these units may be implemented by hardware, software, or a combination thereof. The display device 1 corresponds to a display. The display device 1 is not limited to a configuration for use in a vehicle, but the following description will use the case of use in a vehicle as an example. The vehicle in which the display device 1 is used is not necessarily limited to an automobile, but the following description will use the case of use in an automobile as an example.

[0012] The display unit 20 is a display panel that displays images on a display screen based on video data input from the display control unit 10, which will be described later. In other words, it is a display panel that displays video data. For example, the display unit 20 may be a display panel located in front of the driver's seat inside the vehicle. In other words, it may be a display panel for the instrument cluster. Alternatively, the display unit 20 may be a display panel for the CID (Center Information Display) located in the center of the instrument panel of the vehicle. The display unit 20 is capable of full-color display and can be configured using, for example, a TFT liquid crystal display or an organic EL display. In the following explanation, the case where the display unit 20 is a display panel for the instrument cluster will be used as an example.

[0013] The IF unit 30 functions as an input / output interface for the display device 1 to communicate with the in-vehicle ECU (hereinafter referred to as the in-vehicle ECU). The IF unit 30 acquires vehicle information from the in-vehicle ECU and sequentially outputs that vehicle information to the image generation unit 40.

[0014] The image generation unit 40 draws a meter image showing various elemental information belonging to the vehicle information based on the vehicle information input from the IF unit 30, and sequentially outputs the video data to the display control unit 10. The meter image may also include text. The meter image corresponds to the video. Examples of elemental information include vehicle speed, engine rotation speed, fuel level, engine coolant temperature, total distance traveled, shift position, turn signal lever position, door lock status, seat belt fastening status, and light illumination status. Abnormal conditions occurring in the drive system, etc., are also included in the elemental information. If the vehicle's drive source is a motor, information such as the charge amount corresponding to the motor may be used as elemental information. The image generation unit 40 generates video data of the meter image to be displayed on the display unit 20 by arranging the images of each of these elemental information on the background image in a predetermined layout. The background image is not necessarily limited to a single color, but for example, it may be a single color.

[0015] The display control unit 10 is mainly composed of a computer equipped with, for example, a processor, volatile memory, non-volatile memory, I / O, and a bus connecting them. In this embodiment, the explanation will continue with the example where the display control unit 10 is a microcontroller. The image generation unit 40 and the display control unit 10 can each be, for example, a functional block of a single microcontroller. Note that the image generation unit 40 and the display control unit 10 may be different computers. The display control unit 10 realizes various functions by executing a program stored in the non-volatile memory.

[0016] The display control unit 10 causes the image generation unit 40 to generate video data for the meter image. This video data is video data in the RGB color model. In this embodiment, this video data is video data in the RGB888 format. The display control unit 10 displays an RGB color model video on the display screen of the display unit 20 of the display device 1, which includes blinking dots, which are pixels that periodically switch between two specific colors with different RGB values. The display control unit 10 can display an RGB color model video including blinking dots by including an image of blinking dots in a part of the meter image and generating the meter image with the image generation unit 40. Hereinafter, one of the two specific colors of the blinking dots will be called the first blinking color and the other the second blinking color. The display control unit 10 can display an RGB color model video including blinking dots by periodically switching between the first blinking color and the second blinking color included in the meter image sequentially output by the image generation unit 40. Details on how to set up the blinking dots will be described later.

[0017] Furthermore, the display control unit 10 may switch the meter image to be displayed on the display unit 20 in accordance with information received as input from an occupant via the user input device. The user input device may be an operation device that receives operation inputs from a user. The operation device may be a mechanical switch, or may be a touch switch integrated with the display unit 20. As an example, a steering switch provided on the steering wheel of the host vehicle may be used as the user input device. Note that the user input device is not limited to an operation device that receives operation inputs, as long as it is a device that receives inputs from a user. For example, the user input device may be a voice input device that receives input of voice commands from a user. Examples of inputs from an occupant include an input for switching the travel mode of the host vehicle. Examples of the travel mode include a normal mode, an eco mode, a comfort mode, and a sports mode. The eco mode is a travel mode that prioritizes fuel efficiency or power consumption over the reference normal mode. The comfort mode is a travel mode that prioritizes riding comfort over the normal mode. The sports mode is a travel mode that prioritizes driving performance over the normal mode. The display control unit 10 switches the video to be displayed on the display unit 20 to a display mode corresponding to the switching of the travel mode. For example, when the travel mode is the sports mode, the display mode switching includes displaying a video including a tachometer on the display unit 20, and displaying a video not including a tachometer in modes other than the sports mode.

[0018] As shown in FIG. 1, the display control unit 10 includes an output check unit 100 as a functional block. The output check unit 100 detects an abnormality in the video display output by the display unit 20. The output check unit 100 will be described in detail below.

[0019] <Schematic Configuration of Output Check Unit 100> Here, the schematic configuration of the output check unit 100 will be described with reference to FIG. 2. As shown in FIG. 2, the output check unit 100 includes a data conversion unit 101, an expected value storage unit 102, a data comparison unit 103, and an abnormality detection unit 104 as functional blocks.

[0020] The data conversion unit 101 converts the video data in the RGB888 format output from the image generation unit 40 into data in the RGB444 format. The data conversion unit 101 may be configured to convert the data of blinking dots in the video data into data in the RGB444 format. The data conversion unit 101 does not necessarily need to perform this conversion of blinking dots, but it is preferable to perform this conversion in order to reduce the processing load in the subsequent data comparison unit 103 and the like. The video data in the RGB888 format output from the image generation unit 40 branches into one that is input to the data conversion unit 101 and one that is output as a video.

[0021] The expected value storage unit 102 stores expected values that are expected as the RGB values of video data to be displayed as blinking dots. When adopting a configuration in which the data conversion unit 101 converts the RGB values as the expected values into data in the RGB444 format, the RGB values as the expected values may be data in the RGB444 format. A non-volatile memory may be used as the expected value storage unit 102. The expected value is a value when there is no abnormality in the video data output from the image generation unit 40. The expected value storage unit 102 is configured to store in advance respective expected values expected as the first blinking color and the second blinking color of the blinking dots.

[0022] The data comparison unit 103 identifies the difference between the RGB values ​​of the video data to be displayed as a blinking dot and the expected values ​​that would be expected for the RGB values ​​of that video data if there were no abnormalities. The RGB values ​​of the video data to be displayed as a blinking dot are the RGB values ​​of the video data that are actually output. The data comparison unit 103 identifies the difference between the RGB values ​​of the video data of the blinking dot that are actually output and the expected values ​​corresponding to that blinking dot stored in the expected value storage unit 102. When the blinking dot is scheduled to flash for the first blinking color, the data comparison unit 103 only needs to identify the difference between the RGB values ​​of the blinking dot that are actually output and the expected values ​​for the first blinking color. On the other hand, when the blinking dot is scheduled to flash for the second blinking color, the data comparison unit 103 only needs to identify the difference between the RGB values ​​of the blinking dot that are actually output and the expected values ​​for the second blinking color. The identified difference is then output to the abnormality detection unit 104. The data comparison unit 103 can determine the scheduled timings for the first and second blinking colors from the information on the switching period between the first and second blinking colors in the display control unit 10.

[0023] The anomaly detection unit 104 detects an anomaly in the video display using video data when the difference identified by the data comparison unit 103 is greater than or equal to a threshold. The threshold can be any value that can distinguish whether or not there is an anomaly in the video, and can be set arbitrarily. With this, anomalies are detected by whether or not the RGB values ​​of the blinking dots are as expected, making it possible to detect display anomalies such as sticking other than a black screen state. Sticking refers to a state in which the image does not change. When the anomaly detection unit 104 detects an anomaly in the video display, it should issue an anomaly notification. The anomaly notification can be done by lighting up a lamp or sounding a buzzer to indicate an anomaly in the video display.

[0024] <How to set up flashing dots> Next, the method by which the display control unit 10 sets the blinking dots will be explained. The display control unit 10 sets the RGB values ​​of the first and second blinking colors of the set blinking dots so that the difference between them and the RGB values ​​of the background color displayed on the display screen is less than or equal to a specified value. As a result, the RGB values ​​of the first and second blinking colors of the blinking dots are set so that the difference between them and the RGB values ​​of the background color is less than or equal to a specified value, making it possible to make the color of the blinking dots close to the color of the background color. Therefore, even if the blinking dots are not hidden by the housing of the display device 1, they will be less likely to be noticed by the user, and the marketability of the display device 1 will not be reduced. As a result, it becomes possible to detect a wider variety of display abnormalities while suppressing the reduction in the marketability of the display device 1. This display control unit 10 corresponds to an abnormality detection device.

[0025] Here, we will explain this effect using Figures 3 and 4. Figures 3 and 4 are examples showing the display screen of the display unit 20. Figure 3 shows an example where the display screen is hidden by a frame surrounding it. Figure 4 shows an example where the display screen is not hidden by a frame surrounding it. The frame surrounding the display screen is called a bezel, etc., and is made of resin or the like. Fr in Figures 3 and 4 represents this frame. Sc in Figures 3 and 4 represents the display screen. Ar in Figures 3 and 4 represents the outer frame of the display screen area. As shown in Figure 3, if the frame Fr covers a part of the display screen Sc, then if a blinking dot is placed in the part hidden by the frame Fr, the blinking dot will not be noticed by the user. However, as shown in Figure 4, if the frame Fr does not cover the display screen Sc, then it is not possible to place a blinking dot in the part hidden by the frame Fr. In contrast, in the example of this embodiment, even if a blinking dot is placed in the part hidden by the frame Fr, the blinking dot can be made less noticeable to the user. Therefore, it becomes possible to enlarge the display screen of the display device 1, detect a wider variety of display abnormalities, and suppress any decline in the marketability of the display device 1.

[0026] When the background color displayed on the display screen is black, the display control unit 10 preferably sets the RGB values ​​of the first and second flashing colors of the set flashing dots so that only the B value of RGB differs. Here, black refers to the RGB value (0,0,0) in the RGB888 format. This is because experiments have shown that even when the background color changes from black, the change in B of RGB makes it difficult to distinguish between the first and second flashing colors. Therefore, with the above configuration, the flashing dots become less noticeable to the user. As a result, it becomes possible to detect a wider variety of display abnormalities while further suppressing the deterioration of the marketability of the display device 1.

[0027] Here, an example of setting the RGB values ​​for the first and second flashing colors is described. Here, an example is shown where the background color is black. Here, "black background color" does not only mean that the background color is fixed to black, but also that the default background color is black. In this embodiment, the processing in the data comparison unit 103 is performed on the RGB values ​​in RGB444 format. Therefore, the first and second flashing colors are those in RGB888 format where any of the RGB values ​​are 16-31 and 32-47, respectively, which can be distinguished even when converted to RGB444 format. 16-31 in RGB888 format becomes 1 in RGB444 format. 32-47 in RGB888 format becomes 2 in RGB444 format. Furthermore, among the colors corresponding to 16-31 and 32-47, the colors corresponding to 31 and 32 are used to make the flashing less noticeable. Furthermore, as mentioned above, it is preferable to set the values ​​so that only the B value of RGB is different. Therefore, as shown in Figure 5, the first flashing color is set to RGB value (0,0,31) and the second flashing color is set to RGB value (0,0,32). Figure 5 is a diagram illustrating an example of the relationship between the background color and the first and second flashing colors.

[0028] If the background color is white, for example, you can do the following. Here, "white background color" refers not only to cases where the background color is fixed to white, but also to cases where the default background color is white. Furthermore, "white" here refers to the RGB value (255,255,255) in the RGB888 format. Even when the background color is white, you only need to set the B value of the RGB to a different value. As shown in Figure 5, the first blinking color should have an RGB value of (255,255,223), and the second blinking color should have an RGB value of (255,255,224). This makes it possible to distinguish between the RGB values ​​of the first and second blinking colors even when converted to the RGB444 format, while making the blinking dots difficult for the human eye to perceive.

[0029] When the background color changes, the display control unit 10 preferably switches and sets the RGB values ​​of the first and second flashing colors of the set flashing dots according to the background color. This makes it possible to display flashing dots that are difficult for the human eye to perceive, corresponding to the changing background color, even when the background color changes. As a result, it becomes possible to detect a wider variety of display abnormalities while further suppressing the deterioration of the marketability of the display device 1. To realize this configuration, for example, maps of the first and second flashing colors for multiple types of background colors can be stored in a non-volatile memory, and the display control unit 10 can switch between the first and second flashing colors for each background color in response to a change in background color. Alternatively, the expected value storage unit 102 can store expected values ​​for each background color, and the data comparison unit 103 can use the expected values ​​corresponding to the background color.

[0030] The display control unit 10 preferably sets the switching period between the first and second flashing colors of the flashing dot to a range of 1 millisecond to 600 seconds. If the switching period between the first and second flashing colors becomes too short, it becomes easier for the user to notice, and the software processing becomes heavy. On the other hand, if the switching period between the first and second flashing colors becomes too long, it becomes harder for the user to notice, but the responsiveness to abnormality notification when an abnormality occurs in the video display decreases. With the above configuration, however, it is possible to make the flashing dots harder for the user to notice, prevent the software processing from becoming heavy, and suppress the decrease in responsiveness to abnormality notification. The display control unit 10 more preferably sets the switching period between the first and second flashing colors of the flashing dot to a range of 0.5 seconds to 10 seconds. This further enhances the above-mentioned effects.

[0031] The display control unit 10 preferably displays the blinking dots in an area that is closer to the edge of the display screen of the display device 1 than the center, in an area where it is presumed that the change in background color due to the switching of video displays will be small. This makes it easier for the user to not notice the blinking dots, even if the background color changes significantly due to the transition of the display mode as described above. For example, the area in which the blinking dots are displayed may be the four corners of the display screen, as shown by C1, C2, C3, and C3 in Figure 4. As an example, the area in which the blinking dots are displayed may be the upper left corner of the display screen, as shown by C1 in Figure 4.

[0032] (Embodiment 2) Embodiment 1 shows a configuration in which the display control unit 10 is provided in the display device 1, but the invention is not limited to this configuration. For example, at least part of the functions of the display control unit 10 may be handled by an in-vehicle ECU that controls the display. In this case, this in-vehicle ECU also corresponds to an abnormality detection device.

[0033] This disclosure is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of this disclosure. Furthermore, the control unit and method described in this disclosure may be implemented by a dedicated computer comprising a processor programmed to execute one or more functions embodied by a computer program. Alternatively, the apparatus and method described in this disclosure may be implemented by a dedicated hardware logic circuit. Alternatively, the apparatus and method described in this disclosure may be implemented by one or more dedicated computers comprising a combination of a processor that executes a computer program and one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by the computer on a computer-readable non-transitional tangible recording medium. [Explanation of Symbols]

[0034] 1 Display device, 10 Display control unit (anomaly detection device), 100 Output check unit, 103 Data comparison unit, 104 Anomaly detection unit

Claims

1. A display control unit (10) displays an image of an RGB color model on the display screen of the display (1), which includes blinking dots, which are pixels that periodically switch between two specific colors with different RGB values. A data comparison unit (103) identifies the difference between the RGB values ​​of the video data to be displayed as blinking dots and the expected values ​​that would be expected as the RGB values ​​of the video data if there were no abnormalities. The system includes an anomaly detection unit (104) that detects an anomaly in the video display using the video data when the difference identified by the data comparison unit is greater than or equal to a threshold, The display control unit is an abnormality detection device that sets the RGB values ​​of the two specific colors of the blinking dot in the settings so that the difference between these values ​​and the RGB values ​​of the background color to be displayed on the display screen is less than or equal to a predetermined value.

2. An anomaly detection device according to claim 1, The display control unit is an abnormality detection device that, when the background color is black, sets the RGB values ​​of the two specific colors of the blinking dot in the settings so that only the B value of RGB is different.

3. An anomaly detection device according to claim 1, The display control unit is an abnormality detection device that, when the background color changes, switches and sets the RGB values ​​of the two specific colors of the blinking dots in the settings according to the background color.

4. An anomaly detection device according to claim 1, The display control unit is an abnormality detection device that causes the switching period of the two specific colors of the flashing dot to be within a range of 1 millisecond to 600 seconds.

5. An anomaly detection device according to claim 1, The display control unit is an anomaly detection device that causes the blinking dot to be displayed in an area that is closer to the edge of the display screen than the center, and in an area where it is presumed that there will be little change in background color due to switching of the video display.

Images