Display system, image processing device, and correction data generation method

Abstract

This invention provides a "display system, image processing device, and correction data generation method" that prevents the display image from becoming difficult to see due to overlapping between the display image visible through the micropores of the coating surface and the pattern on the coating surface. [Solution] In a display system in which the display surface of a display device 2 is covered with a patterned instrument panel 3 having numerous micro-pores, the image processing device 1 reverses the gradation of the luminance distribution data that appears on the instrument panel 3 when the entire display surface is uniformly displayed in the same color, and uses the data generated by applying a low-pass filter to the inverted data as correction data to correct the image data to be displayed on the display surface with the correction data. This provides a correction effect equivalent to canceling out the pattern of the instrument panel 3, and also reduces the problem that the pattern of the correction data appears misaligned with the pattern of the instrument panel 3, making the displayed image difficult to see, even when the display surface is viewed from an angle.

Description

Technical Field

[0004] , , , , , , ,

[0005] , , , ,

[0001] The present disclosure relates to a display system, an image processing apparatus, and a correction data generation method.

Background Art

[0002] [[ID=十一]] Conventionally, there has been known a technique that provides necessary visual information by a display during use and makes it appear as if the display does not exist when not in use (see, for example, Patent Document 1). The in-vehicle display device described in Patent Document 1 is fitted into a grain pattern panel of an instrument panel of a vehicle, and the front surface of the display that emits display light to the outside when lit is covered with a grain pattern screen having a large number of fine holes through which the display light can pass. Thereby, while the screen can be seen through the fine holes of the screen when the display is lit, the grain pattern screen hides the display when the display is not lit, so that the entire instrument panel including the portion where the display is fitted is unified in a grain pattern.

[0003] In recent years, a technique in which an image is displayed on a display only when necessary as described above has been called Shytech and has attracted attention as a technique for displaying a screen on an interior portion having a pattern such as a grain pattern or a fabric pattern. However, since the interior portion where Shytech is implemented is not a display space optimized for screen display, there has been a problem that the image displayed on the screen and the pattern of the interior portion may overlap and the displayed image may be difficult to see.

Prior Art Documents

Patent Documents

[0004]

Patent Document No. 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] This disclosure was made to solve such problems, and aims to reduce the problem in a display system in which the display surface is covered with a patterned coating surface having a large number of micropores, where the display image of the display surface visible through the micropores overlaps with the pattern of the coating surface, making the display image difficult to see. [Means for solving the problem]

[0006] To solve the above-mentioned problems, this disclosure provides an image processing device for a display system in which the display surface of a display device is covered with a patterned coating surface having a large number of micropores. In this device, the luminance distribution data that appears on the coating surface when the entire display surface is uniformly displayed with the same color is grayscale inverted, and the data generated by processing the inverted data with a low-pass filter is used as correction data, and the image data to be displayed on the display surface is corrected with the correction data. [Effects of the Invention]

[0007] According to the present disclosure configured as described above, the image data to be displayed on the display surface is corrected in a way that cancels out the pattern of the covering surface with an image of the pattern inverted in grayscale from the correction data. This reduces the problem of the display image being difficult to see because the display image of the display surface seen through the micro-holes overlaps with the pattern of the covering surface, and improves the quality of the display image. In addition, since the contours of the pattern in the grayscale inverted image of the correction data are gently rounded by the processing of the low-pass filter, the problem of the pattern of the correction data appearing misaligned with the pattern of the covering surface when the display surface is viewed from an angle through the covering surface, making the display image difficult to see, can also be reduced. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram schematically shows an example of the configuration of the display system according to this embodiment. [Figure 2] This is a front view showing the instrument panel as seen from the front. [Figure 3]This is a block diagram showing an example of the functional configuration of an image processing apparatus according to this embodiment. [Figure 4] This is a diagram illustrating the method for generating correction data according to this embodiment. [Figure 5] This figure shows an example of correction processing by the image processing unit of this embodiment. [Figure 6] This diagram illustrates the cutoff frequency of a low-pass filter. [Figure 7] This diagram illustrates parallax when viewing the display surface from an oblique angle. [Modes for carrying out the invention]

[0009] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Figure 1 is a schematic diagram showing an example of the configuration of the display system according to this embodiment. In this embodiment, as an example, the configuration when the display system is applied inside a vehicle is shown. As shown in Figure 1, the display system of this embodiment is configured to include an image processing device 1, a display device 2, and an instrument panel (hereinafter abbreviated as instrument panel) 3.

[0010] The image processing device 1 is a device that processes image data to be displayed on the display surface of the display device 2, and supplies the processed image data to the display device 2. For example, the image processing device 1 receives image data generated in an in-vehicle device (not shown), performs corrections on the input image data based on correction data, and supplies the corrected image data to the display device 2. Alternatively, the image processing device 1 may store an application program for image generation, perform corrections on the image data generated by the execution of this application program based on correction data, and supply the corrected image data to the display device 2.

[0011] The display device 2 is, for example, a liquid crystal display, an organic EL display, or an LED display, and comprises a light source unit, a drive unit, and a display surface. The display device 2 receives image data from the image processing device 1 and controls the light source unit and drive unit based on the image data to display an image based on the image data on the display surface. The display surface is configured to have a display panel.

[0012] The instrument panel 3 corresponds to the covering surface in the claims, and the display device 2 is installed on the back side of the instrument panel 3 (inside the dashboard or console where the instrument panel 3 is installed), with the front of the display surface of the display device 2 covered by the instrument panel 3. The display surface of the display device 2 and the instrument panel 3 do not need to be the same size; it is sufficient that the entire display surface is covered by the instrument panel 3.

[0013] The instrument panel 3 is decorated with any pattern, such as wood grain or fabric. Furthermore, the instrument panel 3 has numerous micro-perforations that allow the display light emitted through the display surface to pass through. When the light source of the display device 2 is illuminated, the display light from the display surface passes through the micro-perforations in the instrument panel 3, allowing the display image on the display surface to be seen through the instrument panel 3. On the other hand, when the light source is not illuminated, no image is visible on the instrument panel 3, and the entire instrument panel 3 is unified with a wood grain or similar pattern.

[0014] Figure 2 is a front view showing the instrument panel 3 as seen from the front. Figure 2(a) shows the state when the light source of the display device 2 is not illuminated, and Figure 2(b) shows the state when the light source is illuminated. Note that Figure 2(b) shows the state in which an image based on uncorrected image data is displayed.

[0015] FIG. 3 is a block diagram showing a functional configuration example of the image processing apparatus 1. As shown in FIG. 3, the image processing apparatus 1 of the present embodiment includes a correction data storage unit 11 and an image processing unit 12. The image processing unit 12 executes the following-described processing by the cooperation of hardware and software. For example, the processing of the image processing unit 12 is executed by the operation of a program stored in a storage medium such as a RAM, a ROM, a hard disk, or a semiconductor memory under the control of a microcomputer configured to include a CPU, a RAM, a ROM, and the like. In addition to the microcomputer, a DSP (Digital Signal Processor), a GPU (Graphics Processing Unit), or the like may be provided.

[0016] The correction data storage unit 11 stores correction data generated in advance, for example, at the time of manufacturing the display system or at the time of mounting it on a vehicle. The correction data is generated by performing tone inversion on the data of the luminance distribution that appears on the instrument panel 3 when the entire display surface is uniformly displayed in the same color under the condition that the ambient illuminance around the instrument panel 3 is controlled to be in a predetermined state, and then performing a low-pass filter process on the inverted data.

[0017] FIG. 4 is a diagram for explaining a method of generating correction data. The generation of the correction data is performed by, for example, an image analysis apparatus (not shown). FIG. 4(a) is a front view showing the state of the instrument panel 3 as viewed from the front, and shows the state when the light source unit of the display device 2 is not lit. As described above, when the light source unit is not lit, the display image by the display device 2 cannot be seen on the instrument panel 3, and the entire instrument panel 3 is unified with a pattern such as a wood grain pattern.

[0018] First, under the condition that the ambient illuminance around the instrument panel 3 shown in FIG. 4(a) is controlled to be in a predetermined state, the instrument panel 3 is photographed with a camera from the front in a state where the entire display surface of the display device 2 is uniformly displayed in white (step S1). The condition that the ambient illuminance around the instrument panel 3 is controlled to be in a predetermined state means, for example, a state where the surface of the instrument panel 3 is uniformly irradiated with external light at a predetermined illuminance in a dark room.

[0019] Under the condition where the ambient illuminance is thus managed, the display device 2 displays a white image (hereinafter referred to as a white image) on the entire display surface. As a result, the display light of the white image passes through the fine holes of the in-panel 3 forward, and a state is obtained in which the white image and the pattern of the in-panel 3 overlap and can be seen from the front of the in-panel 3. The in-panel 3 in this state is photographed with a camera from the front.

[0020] Next, the image analysis device obtains luminance distribution data of the surface of the in-panel 3 by analyzing the photographed image data of the in-panel 3 (step S2). FIG. 4(b) shows the luminance distribution data thus obtained, that is, the luminance distribution data of the surface of the in-panel 3 obtained when a white image is displayed on the entire display surface under the condition that the ambient illuminance of the in-panel 3 is managed to be in a predetermined state. The luminance distribution data obtained here is the luminance distribution data of the region of the entire surface of the in-panel 3 that faces the entire display surface.

[0021] Next, the image analysis device performs tone inversion on the luminance distribution data of the in-panel 3 (step S3). FIG. 4(c) shows tone inversion data generated by performing tone inversion (negative-positive inversion) on the luminance distribution data of FIG. 4(b). This tone-inverted luminance distribution data is image data of a pattern having a luminance distribution in which the luminance distribution of the pattern of the in-panel 3 in the portion facing the display surface is entirely tone-inverted.

[0022] Furthermore, the image analysis device generates correction data by performing low-pass filter processing on the tone-inverted luminance distribution data (step S4). FIG. 4(d) shows the correction data finally generated by the low-pass filter processing. Details of this low-pass filter processing will be described later.

[0023] In this embodiment, the correction data generated as described above is stored in the correction data storage unit 11. Since the pattern of the instrument panel 3 installed in each vehicle differs from vehicle to vehicle, correction data reflecting the pattern of the instrument panel 3 is generated for each display system installed in each vehicle and stored in the correction data storage unit 11 of each vehicle. Alternatively, the generation of the correction data as described above may be performed by the image processing device 1.

[0024] Let's return to Figure 3 for explanation. The image processing unit 12 corrects the image data to be displayed on the display surface of the display device 2 using correction data read from the correction data storage unit 11. In the example in Figure 3, the image processing unit 12 corrects the original image data input from the in-vehicle device 100 based on the correction data stored in the correction data storage unit 11, and supplies the corrected image data (hereinafter referred to as corrected image data) to the display device 2. For example, as a correction process, the image processing unit 12 performs a process of superimposing correction data onto the original image data.

[0025] Figure 5 shows an example of correction processing by the image processing unit 12. Figure 5(a) shows the original image data input to the image processing unit 12, and Figure 5(b) shows the correction data stored in the correction data storage unit 11. The image processing unit 12 performs a process of superimposing the correction data in Figure 5(b) onto the original image data in Figure 5(a). Figure 5(c) shows the corrected image data generated by this correction. Figure 5(d) shows the state in which the instrument panel 3 is visible from the front when the corrected image is displayed on the display surface of the display device 2 based on the corrected image data.

[0026] The corrected image data shown in Figure 5(c) is image data that has been corrected to cancel out the pattern on the instrument panel 3 compared to the original image data in Figure 5(a). Therefore, when the corrected image based on this corrected image data is displayed on the display surface, the pattern on the instrument panel 3 becomes difficult to see due to the components of the correction data contained in the corrected image that are visible through the micro-perforations of the instrument panel 3, and the original image becomes easy to see without being obstructed by the pattern on the instrument panel 3, as shown in Figure 5(d).

[0027] Here, the low-pass filter will be explained in detail. In this embodiment, the low-pass filter can use a spatial frequency corresponding to the maximum parallax amount on the display surface, which is determined, for example, by the viewing angle with respect to the normal direction of the display surface and the gap thickness from the covering surface to the display surface, as its cutoff frequency. Figure 6 is a diagram illustrating the cutoff frequency of this low-pass filter.

[0028] As shown in Figure 6, a cover glass 4 and an OCA (Optical Transparent Adhesive Film) 5 are sandwiched between the display surface 2a of the display device 2 and the instrument panel 3, creating a gap between the instrument panel 3 and the display surface 2a. Let the thickness of this gap be t [mm]. Let θ be the viewing angle with respect to the normal direction of the display surface 2a. The viewing angle θ represents the angle that shows the image displayed on the display surface 2a as normally visible when viewed from an oblique angle, and is a value obtained from the specifications of the display device 2.

[0029] Here, as shown in Figure 7(a), when a user views the display surface 2a from the normal direction, the position of the pattern on the instrument panel 3 and the position of the grayscale-inverted pattern image formed by the correction data superimposed on the image data displayed on the display surface 2a appear to coincide. Therefore, the grayscale-inverted pattern image of the correction data appears to cancel out the pattern on the instrument panel 3. In contrast, as shown in Figure 7(b), when a user views the display surface 2a from an oblique angle at a position shifted from the normal direction, parallax occurs, causing the position of the pattern on the instrument panel 3 and the pattern image formed by the correction data displayed on the display surface 2a to appear misaligned.

[0030] Figure 6 shows the maximum parallax d that occurs when the display surface 2a is viewed at an oblique angle from a viewing angle θ. This maximum parallax d is expressed as d = t·tanθ [mm]. If the cutoff frequency of the low-pass filter is defined by the number of dots [px] on the display surface 2a, and the size of one dot is s [mm / px], then the cutoff frequency cf is: cf[px]=d[mm] / s[mm / px] It is represented as follows.

[0031] By setting the cutoff frequency in this way, the grayscale-inverted image of the correction data generated by the low-pass filter processing has finer pattern components removed than the maximum parallax amount d determined according to the viewing angle θ, resulting in a gently rounded outline of the pattern. Therefore, when viewing the display surface 2a from an oblique angle through the instrument panel 3, the problem of the correction data pattern appearing misaligned with the pattern on the instrument panel 3, making the displayed image difficult to see, can be reduced.

[0032] As explained in detail above, in this embodiment, when the entire display surface 2a of the display device 2 is displayed as a white image, the luminance distribution data that appears on the instrument panel 3 is grayscale inverted, and the data generated by applying a low-pass filter to the inverted luminance distribution data is used as correction data, and the image data to be displayed on the display surface 2a is corrected with the correction data.

[0033] With this configuration, the embodiment can achieve an effect equivalent to canceling out the pattern on the instrument panel 3 by using the grayscale-inverted pattern image of the correction data. Furthermore, it can achieve an effect equivalent to gently rounding the contours of the pattern in the grayscale-inverted image of the correction data by processing with a low-pass filter. As a result, whether the display surface 2a is viewed from the front or from an angle through the instrument panel 3, the problem of the display image of the display surface 2a visible through the micro-holes of the instrument panel 3 overlapping with the pattern on the instrument panel 3 and becoming difficult to see is reduced, and the quality of the display image can be improved.

[0034] In the above embodiment, an example was described in which an image of the same color displayed uniformly across the entire display surface 2a is a white image. However, the display color is not limited to white. For example, it may be gray, or a color similar to the color of the instrument panel 3.

[0035] Furthermore, although the above embodiment describes an example of applying the display system of this embodiment to the interior of a vehicle, it is not limited to this. For example, it may be applied not only to a display system in which the display device 2 is built into and fixed inside the dashboard or the like, but also to a portable display system in which the image processing device 1, display device 2, and covering surface are all configured to be portable.

[0036] Furthermore, while the above embodiment describes an example of setting a cutoff frequency determined based on the viewing angle θ, the invention is not limited to this. For example, the cutoff frequency of the low-pass filter may be set to a value determined based on an angle greater than the viewing angle θ. Conversely, the cutoff frequency of the low-pass filter may be set to a value determined based on an angle smaller than the viewing angle θ. In the latter case, the range in which fine pattern components from the correction data image are rounded off by the low-pass filter processing can be narrowed, thereby suppressing a degradation in the quality of the displayed image when the display surface 2a is viewed from the front or a similar angle. In a display system to which this embodiment is applied, the cutoff frequency of the low-pass filter can be appropriately set depending on circumstances such as the range from which the user most often views the display surface 2a.

[0037] Furthermore, the embodiments described above are merely examples of how this disclosure may be implemented, and the technical scope of this disclosure should not be limited by them. In other words, this disclosure can be implemented in various ways without departing from its essence or its main features. [Explanation of Symbols]

[0038] 1…Image processing device, 2…Display device, 2a…Display surface, 3…Instrument panel (covering surface), 4…Cover glass, 5…OCA (Optical Transparent Adhesive Film), 11…Correction data storage unit, 12…Image processing unit

Claims

1. A patterned coating surface having numerous micropores, A display device in which the display surface is covered by the above-mentioned covering surface, The system includes an image processing device that processes image data to be displayed on the above-mentioned display device, The above image processing device is A correction data storage unit stores correction data generated by grayscale inversion of the luminance distribution data that appears on the coated surface when the entire display surface of the above display device is uniformly displayed in the same color, and then applying a low-pass filter to the inverted data. The system includes an image processing unit that corrects image data to be displayed on the display surface using correction data read from the correction data storage unit. A display system characterized by the following features.

2. The display system according to claim 1, characterized in that the low-pass filter has a cutoff frequency that corresponds to the maximum parallax amount on the display surface, which is determined from the viewing angle with respect to the normal direction of the display surface and the gap thickness from the covering surface to the display surface.

3. A correction data storage unit stores correction data generated by grayscale inversion of the luminance distribution data that appears on the covering surface of a display device whose display surface is covered with a patterned covering surface having numerous micropores, when the entire display surface is uniformly displayed in the same color, and then applying a low-pass filter to the inverted data. The system includes an image processing unit that corrects image data to be displayed on the display surface using correction data read from the correction data storage unit. An image processing apparatus characterized by the following:

4. The steps include: photographing the covering surface from the front of the covering surface while the entire surface of a display device, which is covered with a patterned covering surface having numerous micropores, is displayed uniformly in the same color; The steps include: obtaining brightness distribution data from the image data of the above-mentioned coated surface, The above luminance distribution data is subjected to a step of grayscale inversion, The process includes the step of generating corrected data by applying a low-pass filter to the above-mentioned grayscale-inverted luminance distribution data. A method for generating correction data characterized by the following features.

Images