Anomaly detection apparatus and method

Abstract

An abnormality detection device and method are provided. The abnormality detection device includes a display control section (10) that causes a display screen of a display device to display an image of an RGB color model including flicker points that are pixels periodically switching between two specific colors having different RGB values; a data comparison section (103) that determines a difference between an RGB value of image data displayed as the flicker points and an expected value expected as the RGB value of the image data in a case where there is no abnormality; and an abnormality detection section (104) that detects that there is an abnormality in image display based on the image data in a case where the difference determined by the data comparison section (103) is equal to or greater than a threshold value. The display control section (10) sets the RGB values of the two specific colors of the flicker points as set to be such that a difference between the RGB values of the two specific colors and the RGB values of a background color displayed as a background on the display screen is equal to or less than a prescribed value.

Description

Technical Field

[0001] This disclosure relates to an anomaly detection apparatus and method for detecting anomalies in image displays. Background Technology

[0002] For example, Patent Document 1 discloses a technique that detects whether the black screen state, in which the entire display unit becomes a black image, has lasted for a predetermined time by comparing the total value obtained by sampling the RGB color signal provided to the display unit a predetermined number of times with a threshold.

[0003] Existing technical documents Patent documents Patent Document 1: Japanese Patent Application Publication No. 2009-044572 Summary of the Invention

[0004] In the technology of Patent Document 1, since the sum of RGB color signals is used, display anomalies such as fixation outside of black screen states cannot be detected. To address this, it is possible to detect display anomalies by monitoring image signals that cause the display to alternately flash red and green flickering points. Furthermore, to suppress the reduction in the marketability of the display due to noticeable flickering points, it is possible to position the flickering points in a portion obscured by a casing covering the display frame. However, even with this approach, if a casing covering the display frame is not used to increase the screen size, the flickering points will still be noticeable, potentially reducing the marketability of the display.

[0005] One object of this disclosure is to provide an electronic control device capable of detecting a wider range of display anomalies and also capable of suppressing the deterioration of the marketability of the display.

[0006] The above objective is achieved by the combination of features described in the independent claim, and furthermore, the subordinate claims provide more advantageous specific examples of this disclosure.

[0007] To achieve the above objectives, the anomaly detection device disclosed herein includes: a display control unit that displays an image of an RGB color model containing a flickering point on a display screen, the flickering point being a pixel that periodically switches between two specific colors with different RGB values; a data comparison unit that determines the difference between the RGB values ​​of the image data displayed as the flickering point and an expected value that is expected as the RGB values ​​of the image data under normal conditions; and an anomaly detection unit that detects an anomaly in the image display based on the image data when the difference determined by the data comparison unit is above a threshold; the display control unit sets the RGB values ​​of the two specific colors of the flickering point to a value below a predetermined value, wherein the difference between the RGB values ​​of the two specific colors and the RGB values ​​of the background color displayed as the background on the display screen is below a predetermined value.

[0008] Based on the above structure, image display abnormalities are detected by the difference between the RGB values ​​of the image data displayed at the flickering point and the expected value of the RGB values ​​of the image data under normal conditions. The flickering point is a pixel that periodically switches between two specific colors with different RGB values. Therefore, display abnormalities such as the fixation of image signals other than black screen states can also be detected. Furthermore, since the RGB values ​​of the two specific colors of the flickering point are set such that the difference between their RGB values ​​and the background color is less than a predetermined value, the hue of the flickering point can be made close to the background color. Therefore, even if the flickering point is not obscured by the monitor casing, it is difficult for the user to notice, and the monitor's marketability is not significantly reduced. As a result, more types of display abnormalities can be detected, and the reduction in monitor marketability can be prevented. Attached Figure Description

[0009] Figure 1 This is a diagram illustrating an example of the general structure of a display device.

[0010] Figure 2 This is a diagram used to illustrate an example of the output inspection unit.

[0011] Figure 3 This is an example of the display screen on the display unit.

[0012] Figure 4 This is an example of the display screen on the display unit.

[0013] Figure 5 This is a diagram used to illustrate an example of the relationship between the background color and the first and second flashing colors. Detailed Implementation

[0014] The various embodiments disclosed will be described with reference to the accompanying drawings. Furthermore, for ease of explanation, parts having the same function as those shown in the figures used in the preceding description are labeled with the same reference numerals across the various embodiments, and their descriptions are sometimes omitted. For parts labeled with the same reference numerals, reference can be made to the descriptions in other embodiments.

[0015] (Implementation Method 1) <Simplified configuration of display device 1> Hereinafter, Embodiment 1 of the present disclosure will be described using the accompanying drawings. Figure 1 The display device 1 shown can be used in a vehicle. For example... Figure 1As shown, the display device 1 includes a display control unit 10, a display unit 20, an interface (hereinafter referred to as I / F) unit 30, and an image generation unit 40. These units can be implemented by hardware, software, or a combination thereof. The display device 1 is equivalent to a monitor. The display device 1 is not limited to a vehicle-mounted structure, but the following description uses a vehicle as an example. The vehicle using the display device 1 is not necessarily limited to automobiles, but the following description uses an automobile as an example.

[0016] Display unit 20 is a display panel that displays an image represented by image data input from display control unit 10 (described later) on a display screen. In other words, it is a display panel that displays images based on image data. For example, display unit 20 can be a display panel located in front of the driver's seat inside the vehicle's passenger compartment. That is, it can be an instrument panel display panel. Furthermore, display unit 20 can also be a CID (Center Information Display) display panel located in the center of the vehicle's instrument panel. Display unit 20 is capable of full-color display and can be configured using, for example, a TFT liquid crystal display or an organic EL display. The following description will use the case where display unit 20 is an instrument panel display panel as an example.

[0017] The IF unit 30 functions as an input / output interface for communication between the display device 1 and the vehicle-mounted ECU (hereinafter referred to as the vehicle ECU). The IF unit 30 acquires vehicle information from the vehicle ECU and outputs the vehicle information sequentially to the image generation unit 40.

[0018] The image generation unit 40, based on vehicle information input from the IF unit 30, depicts an instrument panel image representing various element information belonging to the vehicle information, and sequentially outputs this image data to the display control unit 10. The instrument panel image may contain text. The instrument panel image is equivalent to an image. Element information includes, for example, vehicle speed, engine rotation speed, remaining fuel, engine coolant temperature, cumulative driving distance, gear position, steering wheel position, door lock status, seatbelt wearing status, and light illumination status. Furthermore, abnormal states arising in the driving system are also included in the element information. In addition, if the vehicle's driving source is a motor, information such as the motor's charge level can be included as element information. The image generation unit 40 generates image data for the instrument panel image to be displayed on the display unit 20 by arranging the images of each element information relative to a background image in a predetermined layout. The background image is not necessarily limited to monochrome, but can be, for example, set to monochrome.

[0019] The display control unit 10 is configured, for example, as a computer equipped with a processor, volatile memory, non-volatile memory, I / O, and a bus connecting them. In this embodiment, the example of the display control unit 10 being a microcomputer will continue to be described. The image generation unit 40 and the display control unit 10 can each be configured as a function block of a microcomputer. Alternatively, the image generation unit 40 and the display control unit 10 can be different computers. The display control unit 10 performs various functions by executing programs stored in the non-volatile memory.

[0020] The display control unit 10 causes the image generation unit 40 to generate image data of an instrument image. This image data is image data of an RGB color model. In the example of this embodiment, the image data is image data in RGB888 format. The display control unit 10 causes the display screen of the display unit 20 of the display device 1 to display an image of an RGB color model containing blinking points, wherein the blinking points are pixels that periodically switch between two specific colors with different RGB values. The display control unit 10 can generate an instrument image using the image generation unit 40 by making a portion of the instrument image contain the blinking points, thereby displaying an image of an RGB color model containing blinking points. Hereinafter, one of the two specific colors of the blinking points will be referred to as the first blinking color, and the other as the second blinking color. The display control unit 10 can display an image of an RGB color model containing blinking points by periodically switching between the first blinking color and the second blinking color contained in the instrument image output successively by the image generation unit 40. Details regarding the setting method of the blinking points will be described later.

[0021] Furthermore, the display control unit 10 can also switch the instrument image displayed on the display unit 20 based on information received from the occupant via the user input device. The user input device can be any operating device that receives operational input from the user. This operating device can be a mechanical switch or a touch switch integrated with the display unit 20. For example, a steering switch provided on the vehicle's steering system can be used as the user input device. Moreover, the user input device is not limited to any device that receives input from the user; it can be any device that receives operational input. For example, a voice input device that receives voice commands from the user can also be used. Examples of input by the occupant include input for switching the vehicle's driving mode. Driving modes include normal mode, economy mode, comfort mode, and sport mode. Economy mode prioritizes fuel efficiency or energy efficiency compared to the baseline normal mode. Comfort mode prioritizes ride comfort compared to the normal mode. Sport mode prioritizes driving performance compared to the normal mode. The display control unit 10 switches the image displayed on the display unit 20 to a display mode corresponding to the switching of the driving mode. For example, display modes can be switched such that when the driving mode is Sport mode, the display unit 20 displays an image including the tachometer, while in other modes, it displays an image without the tachometer.

[0022] like Figure 1 As shown, the display control unit 10 includes an output inspection unit 100 as a functional block. The output inspection unit 100 detects abnormalities in the image display output by the display unit 20. The output inspection unit 100 will be described in detail below.

[0023] <Output Inspection Unit 100 Overview> Here, use Figure 2 The general structure of the output inspection unit 100 will be explained. For example... Figure 2 As shown, the output inspection unit 100 includes a data conversion unit 101, an expected value storage unit 102, a data comparison unit 103, and an anomaly detection unit 104 as functional blocks.

[0024] The data conversion unit 101 converts the RGB888 format image data output from the image generation unit 40 into RGB444 format data. The data conversion unit 101 may also be configured to convert the flickering data in the image data into RGB444 format data. While the data conversion unit 101 does not necessarily need to perform this flickering data conversion, it is preferable to perform this conversion to reduce the processing load in subsequent data comparison units such as the data comparison unit 103. The RGB888 format image data output from the image generation unit 40 is branched into data input to the data conversion unit 101 and data that is output as an image.

[0025] The expectation value storage unit 102 stores the expected values ​​of the RGB values ​​of the image data displayed as flashing points. Regarding the RGB values ​​as expected values, if the data structure used is converted to RGB444 format by the data conversion unit 101, the data can be set to RGB444 format. The expectation value storage unit 102 can use non-volatile memory. The expected value is the value when there are no abnormalities in the image data output from the image generation unit 40. The expectation value storage unit 102 stores the expected values ​​of the first flashing color and the second flashing color as flashing points in advance.

[0026] The data comparison unit 103 determines the difference between the RGB value of the image data displayed as a flickering point and the expected value expected as the RGB value of the image data under normal conditions. The RGB value of the image data displayed as a flickering point is the RGB value of the actual output image data. The data comparison unit 103 determines the difference between the RGB value of the image data of the actual output flickering point and the expected value corresponding to that flickering point stored in the expected value storage unit 102. The data comparison unit 103 can determine the difference between the RGB value of the actual output flickering point and the expected value for the first flickering color at a predetermined timing when the flickering point is a first flickering color. On the other hand, the data comparison unit 103 can determine the difference between the RGB value of the actual output flickering point and the expected value for the second flickering color at a predetermined timing when the flickering point is a second flickering color. Then, the determined difference is output to the anomaly detection unit 104. The data comparison unit 103 can determine the predetermined timing of the first flickering color and the second flickering color based on the switching cycle information of the first flickering color and the second flickering color in the display control unit 10.

[0027] If the difference determined by the data comparison unit 103 is above a threshold, the anomaly detection unit 104 detects an anomaly in the image display based on the image data. The threshold can be set to a value sufficient to distinguish between an image with and without anomalies, and can be any arbitrarily set value. Therefore, anomalies are detected by checking whether the RGB values ​​of the flickering points are the expected values, thus enabling the detection of display anomalies such as static, which are not present in a black screen state. Stagnation indicates a state where the image does not change. The anomaly detection unit 104 can issue an anomaly notification when an anomaly in the image display is detected. The anomaly notification can be issued by illuminating an indicator light or emitting a beeping sound to notify of the image display anomaly.

[0028] <Regarding the setting of the blinking point> Next, the setting method of the flashing point in the display control unit 10 will be explained. The display control unit 10 sets the RGB values ​​of the first flashing color and the second flashing color of the set flashing point to a value less than or equal to the RGB value of the background color displayed as the background on the display screen. Therefore, since the RGB values ​​of the first flashing color and the second flashing color of the flashing point are set to a value less than or equal to the RGB value of the background color, the hue of the flashing point can be made close to the hue of the background color. Thus, even if the flashing point is not obscured by the housing of the display device 1, it is difficult for the user to notice it, and the marketability of the display device 1 is not easily reduced. As a result, more types of display abnormalities can be detected, and the marketability of the display device 1 can be suppressed. This display control unit 10 is equivalent to an abnormality detection device.

[0029] Here, use Figure 3 and Figure 4 Explain this effect. Figure 3 and Figure 4 This is an example of the display screen of the display unit 20. Figure 3 This diagram illustrates an example of a display screen being obscured by a frame surrounding the display screen. Figure 4 This diagram illustrates an example where the displayed image is not obscured by the frame surrounding it. The frame surrounding the displayed image is called a border, etc., and is made of resin or the like. Figure 3 and Figure 4 Fr represents the frame. Figure 3 and Figure 4 Sc indicates the display screen. Figure 3 and Figure 4 Ar represents the outer frame of the area displayed on the screen. For example... Figure 3 As shown, when the frame Fr blocks part of the display screen Sc, the user will not notice the flickering point as long as the flickering point is configured in the part covered by the frame Fr. However, as Figure 4 As shown, when the frame Fr does not block the display screen Sc, it is impossible to place the flickering point on the part covered by the frame Fr. In contrast, in the example of this embodiment, even when the flickering point is placed on the part not covered by the frame Fr, it is difficult for the user to notice the flickering point. Therefore, the display screen of the display device 1 can be made larger, more types of display anomalies can be detected, and the commercial viability of the display device 1 can be suppressed.

[0030] When the background color displayed on the screen is black, the display control unit 10 preferably sets the RGB values ​​of the first and second flashing colors of the preset flashing point to differ only in the value of B in the RGB values. Here, black refers to the RGB value (0,0,0) in the RGB888 format. This is because experiments have shown that even when the background color changes from black, it is difficult to detect that the switching between the first and second flashing colors involves a change in the B values ​​of the RGB values. Therefore, based on the above structure, the flashing point is less likely to be noticed by the user. As a result, more types of display anomalies can be detected, and the commercial viability of the display device 1 can be further suppressed.

[0031] Here, an example of setting the RGB values ​​of the first and second blinking colors will be explained. An example with a black background color is shown. The black background color is not limited to a fixed black background color, but also includes cases where the default background color is black. In this embodiment, the RGB values ​​in the data comparison unit 103 are processed in the RGB444 format. Therefore, colors corresponding to 16-31 and 32-47 in the RGB888 format, which can be distinguished even when converted to RGB444 format, are set as the first and second blinking colors. 16-31 in the RGB888 format is 1 in the RGB444 format. 32-47 in the RGB888 format is 2 in the RGB444 format. Furthermore, to make blinking difficult to detect in colors corresponding to 16-31 and 32-47, colors corresponding to 31 and 32 are used. Additionally, as mentioned above, since it is preferable to set only the B values ​​in the RGB to be different, ... Figure 5 As shown, the first flashing color is set to the RGB value (0,0,31), and the second flashing color is set to the RGB value (0,0,32). Figure 5 This is a diagram used to illustrate an example of the relationship between the background color and the first and second flashing colors.

[0032] Furthermore, when the background color is white, it can be configured as follows. The term "white background color" here is not limited to a fixed white background color, but also includes cases where the default background color is white. Additionally, the white color referred to here is the RGB value (255, 255, 255) in RGB888 format. When the background color is white, it can also be configured to only differentiate the B values ​​in the RGB values, such as... Figure 5As shown, the first flashing color can be set to the RGB value (255, 255, 223), and the second flashing color can be set to the RGB value (255, 255, 224). Therefore, even when converted to RGB444 format, the RGB values ​​of the first and second flashing colors can be distinguished, and the flashing point is difficult for the human eye to detect.

[0033] The display control unit 10 preferably switches the RGB values ​​of the first and second flashing colors of the flashing point based on the background color when the background color changes. Therefore, even when the background color changes, a flashing point that is difficult for the human eye to detect can be displayed, corresponding to the changing background color. As a result, more types of display anomalies can be detected, and the commercial viability of the display device 1 can be further suppressed. To achieve this structure, for example, the mapping of the first and second flashing colors under each of the multiple background colors can be pre-stored in non-volatile memory, and the display control unit 10 can switch the first and second flashing colors under each background color according to the change in the background color. Alternatively, the configuration can be such that the expectation value storage unit 102 stores the expectation value under each background color, and the data comparison unit 103 uses the expectation value corresponding to the background color.

[0034] The display control unit 10 preferably sets the switching period between the first and second flashing colors of the flashing point to be in the range of 1 millisecond to 600 seconds. If the switching period between the first and second flashing colors is too short, it is easily noticed by the user, or the software processing burden increases. On the other hand, if the switching period between the first and second flashing colors is too long, although it is difficult for the user to notice, the responsiveness until an abnormality notification is issued will decrease when an abnormality occurs in the image display. In contrast, according to the above structure, it is possible to make it difficult for the user to notice the flashing point, and it is possible to prevent the software processing burden from increasing, or to suppress the decrease in responsiveness until an abnormality notification is issued. More preferably, the display control unit 10 sets the switching period between the first and second flashing colors of the flashing point to be in the range of 0.5 seconds to 10 seconds. Accordingly, the above-mentioned effects can be further enhanced.

[0035] Preferably, the display control unit 10 displays the flickering point in an area further from the center of the display screen of the display device 1, in an area where the background color change is pre-estimated to be minimal due to image switching. Therefore, even if the background color changes drastically due to the aforementioned change in display mode, the flickering point is less likely to be noticed by the user. For example, the area displaying the flickering point could be as follows: Figure 4 The areas shown in C1, C2, C3, and C4 are the four corner areas of the display screen. As an example, the area displaying the flashing point could be as follows: Figure 4 The upper left area in the four corners of the display screen as shown in C1.

[0036] (Implementation Method 2) In Embodiment 1, a structure is shown in which a display control unit 10 is provided in the display device 1, but the embodiment is not limited thereto. For example, it may be configured such that an on-board ECU that controls the display performs at least a portion of the functions of the display control unit 10. In this case, the on-board ECU also functions as an anomaly detection device.

[0037] Furthermore, this disclosure is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included within the technical scope of this disclosure. Additionally, the control unit and method described in this disclosure can also be implemented using a dedicated computer configured to perform one or more functions embodied in a computer program. Alternatively, the apparatus and method described in this disclosure can also be implemented using dedicated hardware logic circuitry. Alternatively, the apparatus and method described in this disclosure can also be implemented using one or more dedicated computers configured as a combination of a processor executing a computer program and one or more hardware logic circuits. Furthermore, the computer program can also be stored as instructions executed by a computer on a computer-readable non-transitional tangible recording medium.

Claims

1. An anomaly detection device, characterized in that, have: The display control unit causes the display screen to show an image of an RGB color model containing flashing points, which are pixels that periodically switch between two specific colors with different RGB values. The data comparison unit determines the difference between the RGB value of the image data displayed as the flashing point and the expected value expected as the RGB value of the image data under normal circumstances. as well as An anomaly detection unit detects an anomaly in the image display based on the image data when the difference determined by the data comparison unit is above a threshold. The display control unit sets the RGB values ​​of the two specific colors of the flashing point to be such that the difference between the RGB values ​​of the two specific colors and the RGB values ​​of the background color displayed as the background on the display screen is below a predetermined value.

2. The anomaly detection device according to claim 1, characterized in that, When the background color is black, the display control unit sets the RGB values ​​of the two specific colors of the flashing point to be different only for the B value in the RGB.

3. The anomaly detection device according to claim 1, characterized in that, When the background color changes, the display control unit switches the RGB values ​​of the two specific colors of the flashing point according to the background color.

4. The anomaly detection device according to claim 1, characterized in that, The display control unit sets the switching period of the two specific colors of the flashing point to be in the range of 1 millisecond to 600 seconds.

5. The anomaly detection device according to any one of claims 1 to 4, characterized in that, The display control unit causes the flashing point to be displayed in an area further from the center of the display screen, in an area where the background color change is pre-estimated to be minimal due to the switching of the image display.

6. The anomaly detection device according to claim 1, characterized in that, The anomaly detection device also includes a data conversion unit that converts the image data displayed as the flickering point from RGB888 format to RGB444 format. The data comparison unit determines the difference between the RGB value of the image data of the flickering point after conversion by the data conversion unit and the expected value.

7. The anomaly detection device according to claim 6, characterized in that, The two specific colors of the flashing point are a first flashing color and a second flashing color. The anomaly detection device also includes an expectation value storage unit for storing the expected value. The expectation value storage unit is a non-volatile memory that pre-stores the expectation value expected as the first flashing color and the expectation value expected as the second flashing color.

8. The anomaly detection device according to claim 3, characterized in that, The anomaly detection device stores the mapping of the two specific colors under each of the multiple background colors in non-volatile memory. The display control unit switches between the two specific colors based on the change in the background color and the mapping.

9. The anomaly detection device according to claim 4, characterized in that, The display control unit sets the switching period of the two specific colors of the flashing point to be in the range of 0.5 seconds to 10 seconds.

10. The anomaly detection device according to claim 5, characterized in that, The display control unit causes the flashing dots to appear in the four corners of the display screen.

11. The anomaly detection device according to claim 1, characterized in that, When the anomaly detection unit detects an anomaly in the image display, it notifies the user by turning on a light or emitting a beeping sound.

12. The anomaly detection device according to claim 2, characterized in that, When the background color is black, the RGB value of one of the two specific colors of the flashing point is (0,0,31), and the RGB value of the other is (0,0,32).

13. A method for detecting abnormalities in the display of an image on a monitor, characterized in that, include: A step of setting the RGB values ​​of two specific colors that are periodically different and are used as flashing points, such that the difference between the RGB value of the color displayed on the screen as a background is below a predetermined value; The step of displaying an image of an RGB color model containing flashing points on the display screen, wherein the flashing points are pixels that periodically switch between the two specific colors; The step of determining the difference between the RGB value of the image data displayed as the flashing point and the expected value expected as the RGB value of the image data under normal circumstances; as well as The step of detecting an anomaly in the image display based on the image data when the difference is above a threshold.

Images