Output image adjusting device, projection device and image adjusting method

Abstract

The purpose of the present disclosure is to provide an output image adjustment device, a projection device, and an image adjustment method that improve the measurement accuracy of points representing coordinates included in a correction image compared to a case where the colors of the points projected onto a projection region 34 are uniform. An output image adjustment device (22) is provided with: a projection unit (32) that projects, onto a projection region (34), a correction image including a group of points indicating coordinates in the X direction and the Y direction, each of the points being of the same type of color as a point adjacent to the X direction and being of a different type of color from a point adjacent to the Y direction; an imaging unit (30) that captures the correction image projected onto the projection region (34); and an image adjustment unit (28) that adjusts the coordinates of the corrected image projected by the projection unit (32) on the basis of imaging data captured by the imaging unit (30).

Description

Technical Field

[0001] The present disclosure relates to an output image adjustment device, a projection device and an image adjustment method. Background Art

[0002] Patent document 1 discloses a lighting system comprising a projector 1 and a camera 2, wherein a lighting control device projects and captures a stripe pattern with periodic brightness changes in a first direction orthogonal to the projection direction of the projection device, and uses a phase shift method to correspond the captured image and the projected image in the first direction, and projects and captures a stripe pattern with periodic brightness changes in a second direction orthogonal to the first direction, and uses a phase shift method to correspond the captured image and the projected image in the second direction, thereby obtaining transformation information that determines the correspondence between pixels of the captured image and the projected image.

[0003] Prior art literature Patent Literature Patent Document 1: Japanese Patent Application Publication No. 2010-271580. Summary of the invention

[0004] Problems to be solved by the invention An object of the present disclosure is to provide an output image adjustment device, a projection device, and an image adjustment method that improve the measurement accuracy of points represented by coordinates included in a calibration image compared to a case where the colors of points projected onto a projection object are uniform.

[0005] Solutions to Solve Problems The output image adjustment device of the first mode of the present disclosure comprises: a projection unit, which projects a correction image onto a projection object, the correction image including a group of points representing coordinates of a first direction and a second direction intersecting the first direction, each of the points being of the same type of color as a point adjacent to the first direction and of a different type of color from a point adjacent to the second direction; a shooting unit, which shoots the correction image projected onto the projection object; and an image adjustment unit, which adjusts the coordinates of the corrected image projected by the projection unit based on the shooting data shot by the shooting unit.

[0006] According to the output image adjustment device of this mode, since the calibration image is projected in which the groups of points representing the coordinates are the same color in the first direction and the adjacent points in the second direction are different colors, it is difficult for the image adjustment unit to erroneously read the arrangement of the group of points from the captured data. Therefore, according to the output image adjustment device, the measurement accuracy of the points representing the coordinates included in the calibration image is improved compared to the case where the colors of the points projected onto the projection object are uniform.

[0007] Effects of the Invention According to the present disclosure, it is possible to provide an output image adjustment device, a projection device, and an image adjustment method that improve the measurement accuracy of points represented by coordinates included in a calibration image compared to a case where the colors of points projected onto a projection object are uniform. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 It is a diagram for explaining a case where the projection device according to the embodiment of the present disclosure is used. Figure 2 It is a block diagram illustrating the structure of a projection device according to an embodiment of the present disclosure. Figure 3 It is a diagram for explaining an image created by the image creating unit included in the projection device according to the first embodiment of the present disclosure. Figure 4 It is a diagram for explaining imaging data captured by the imaging unit included in the projection target according to the first embodiment of the present disclosure. Figure 5 This is a flowchart illustrating the operation procedure of the CPU according to the first embodiment of the present disclosure. Figure 6 It is a diagram for explaining an image created by an image creating unit included in a projection device according to a comparative example. Figure 7 It is a diagram for explaining imaging data captured by an imaging unit included in a projection target according to a comparative example. Figure 8 It is a diagram for explaining an image created by an image creating unit included in a projection device according to a second embodiment of the present disclosure. Fig. 9 It is a diagram for explaining an image created by an image creating unit included in a projection device according to a third embodiment of the present disclosure. Fig.10 It is a diagram for explaining an image created by an image creating unit included in a projection device according to another embodiment of the present disclosure. Fig.11 It is a diagram for explaining an image created by an image creating unit included in a projection device according to another embodiment of the present disclosure. Fig.12 It is a diagram for explaining an image created by an image creating unit included in a projection device according to another embodiment of the present disclosure. Fig.13 It is a diagram of a hue circle illustrating the hue angle. DETAILED DESCRIPTION

[0009] Hereinafter, an example of an embodiment of the present disclosure will be described with reference to the accompanying drawings. In addition, in each of the drawings, the same reference numerals are given to the same or equivalent components and parts. In addition, for the sake of convenience of description, the dimensional ratios of the drawings are exaggerated and sometimes differ from the actual ratios.

[0010] In addition, in each of the drawings, the arrow X direction is an example of a first direction of the present disclosure in the image data described later, and the arrow Y direction is an example of a second direction of the present disclosure in the image data described later. In addition, in each of the drawings, the arrow X and the arrow Y are orthogonal to each other, but the directions are not limited to this as long as the arrow X direction and the arrow Y direction intersect each other.

[0011] In each of the drawings, the arrow X′ direction is an example of a first direction of the present disclosure in the imaging data described later, and the arrow Y′ direction is an example of a second direction of the present disclosure in the imaging data described later.

[0012] In addition, in the present disclosure, the lightness L, chroma S, and hue angle H (hue value) in the image data refer to the values ​​represented by the following equations (1) to (3). In addition, R, G, and B shown in each equation are values ​​showing the brightness of red, green, and blue in each pixel, respectively. In addition, Max shown in each equation is a function showing the maximum value among the values ​​in the brackets, and Min is a function showing the minimum value among the values ​​in the brackets.

[0013] [Formula 1] L=Max(R,G,B)(1)

[0014] [Formula 2]

[0015] [Formula 3]

[0016] In addition, as shown in formula (3), when the brightness of red, green, and blue are equal, in other words, in black and white including intermediate colors such as gray, the hue angle H is not defined. In the following description, when the hue angle H is mentioned, the case where the brightness of red, green, and blue are equal is not considered. However, as shown in formulas (1) and (2), the case where the brightness of red, green, and blue are equal is also considered for lightness L and chroma S.

[0017] In addition, in the present disclosure, the lightness L, hue angle H, and chroma S of the colors in each figure are as follows (see also Figure 3 to Figure 4 , Figures 6 to 13 ).

[0018] The thickness of the arrow shown inside the outline of the image indicates the lightness L. For example, when the arrow is thin, the lightness L is low (dark), and when the arrow is thick, the lightness L is high (bright).

[0019] Regarding the hue angle H, Fig.13As shown, it is represented by the angle (direction) of the arrow shown inside the outline of the image. For example, when the arrow extends to the right (0°), it is red, when the arrow extends to the upper left (120°), it is green, and when the arrow extends to the lower left (240°), it is blue.

[0020] The saturation S is represented by the line type of the shaft (shaft) of the arrow shown inside the outline of the image. More specifically, the shaft is a dotted line, and the color with a large gap (shorter solid line part) is a color with a low saturation (a color close to the color between white and black including gray), and the color with a small gap (longer solid line part) is a color with a high saturation (color).

[0021] (structure) Figure 1 1 is a diagram for explaining a case where a projection device 20 of the present disclosure is used. As an example, the projection device 20 of the present disclosure is a so-called head-up display 10 that is arranged on a dashboard 14 of a motor vehicle and projects onto a front windshield 16 .

[0022] like Figure 1 As shown, from the perspective of the driver of the motor vehicle, the projection device 20 is arranged in front of the steering wheel 18 and projects the image toward the projection area 34 of the front windshield 16. Figure 1 As shown, the projection area 34 is set in front of the driver, and the driver can appropriately recognize necessary information by reading the image projected on the front windshield 16 .

[0023] In addition, as an example, from the driver's perspective, the windshield 16 is curved in a direction extending forward. However, from the driver's perspective, the curved shape of the windshield 16 is not necessarily symmetrical with respect to the longitudinal direction (vertical direction) and the transverse direction (horizontal direction and depth direction), and also includes the situation of deformation in any direction.

[0024] Figure 2 2 is a block diagram for explaining the structure of the projection device 20 of the present disclosure. The projection device 20 of the present disclosure includes an output image adjustment device 22 and an image generation unit 26. The output image adjustment device 22 includes a control unit 24, a projection unit 32, a camera unit 30, and an image adjustment unit 28.

[0025] The control unit 24 includes a CPU 24A (Central Processing Unit) as an example of a processor, and a RAM 24B (Random Access Memory) used as a temporary work area of ​​the CPU 24A. In addition, the control unit 24 includes a non-volatile memory 24C storing a control program for the control unit 24 to function, and an input / output interface (I / O) 24E. The CPU 24A, the RAM 24B, the non-volatile memory 24C, and the I / O 24E are connected to each other via a bus 24D.

[0026] The CPU 24A of the control unit 24 reads the control program from the nonvolatile memory 24C, and executes the overall control of the projection device 20 by the control unit 24 .

[0027] The nonvolatile memory 24C is an example of a storage device that maintains stored information even when power supplied to each memory is cut off, and for example, a semiconductor memory may be used, but a hard disk may also be used.

[0028] Furthermore, the projection unit 32 , the imaging unit 30 , the image adjustment unit 28 , and the image creation unit 26 are connected to the I / O 24E.

[0029] The projection unit 32 is a device that projects the image data produced by the image production unit 26 onto the projection area 34 of the front windshield 16 based on the operation sequence of the program executed by the CPU 24A. In addition, the projection unit 32 is a dot-matrix liquid crystal projector that transmits white light emitted from a light source lamp to a liquid crystal panel as an example, and has sub-pixels that transmit red, green, and blue colors in one pixel. In addition, each sub-pixel of the liquid crystal panel adjusts the brightness (brightness) of the transmitted light to project a color image onto the projection area 34. In addition, the image data will be described later.

[0030] The imaging unit 30 is a device that captures image data projected on the projection area 34 by the projection unit 32 based on an operation procedure of a program executed by the CPU 24A.

[0031] The image adjustment unit 28 adjusts the image data produced by the image production unit 26 based on the operation sequence of the program executed by the CPU 24A. More specifically, the image adjustment unit 28 can adjust the coordinates of the pixels included in the image data, and adjusts the image projected by the projection unit 32 by adjusting the coordinate values ​​of the image included in the image data based on the operation sequence executed by the CPU 24A.

[0032] The image generating unit 26 generates image data based on the operation procedure of the program executed by the CPU 24A. The image data generated by the image generating unit 26 includes a calibration image described later.

[0033] In addition, if Figure 2 As shown in the figure, the image production unit 26 and the image adjustment unit 28 can be executed by the same device as long as they are devices that can respectively realize the production of image data and the adjustment of image data, and can also be executed by different devices. In other words, the image production unit 26 and the image adjustment unit 28 can be functions of the program executed by the CPU 24A. In addition, in other words, the output image adjustment device 22 can also be the function of other parts of the projection device 20 except the image adjustment unit 28.

[0034] Next, refer to Figure 3 A correction image created by the output image adjustment device 22 and the output image adjustment device 22 according to the first embodiment of the present disclosure will be described.

[0035] [First embodiment] The image creation unit 26 of this embodiment creates Figure 3 The image data of the correction image shown in the figure. The correction image includes a group of points, i.e., point images, which represent the coordinates of the horizontal direction and the vertical direction intersecting the horizontal direction. Each point image has the same color as the point image adjacent to it in the horizontal direction, and has a different color from the point image adjacent to it in the vertical direction. In the following description, a point image is an image of a point composed of several pixels (for example, 2 pixels in the vertical direction and 2 pixels in the horizontal direction, for a total of 4 pixels). In addition, as Figure 3 As shown, each point image is arranged at a predetermined interval (20 pixels as an example) from the adjacent point image in either the longitudinal direction or the lateral direction. Here, the projection area 34 of the front windshield 16 is an example of a projection object in the present disclosure. In addition, the lateral direction and the longitudinal direction are examples of the first direction and the second direction in the present disclosure.

[0036] In addition, the image generation unit 26 of the present embodiment generates the color format of the image data in the form of RGB888. That is, the color of each pixel in the image data is expressed by a 256 grayscale (00 to FF) value for each of red, green, and blue. For example, when the color of each pixel is red, it is #FF0000, when it is green, it is #00FF00, and when it is blue, it is #0000FF.

[0037] In the present embodiment, the correction image includes two colors, magenta (#FF00FF) and green (#00FF00), as an example. For example, when the color of any point image is magenta, the color of the point images adjacent in the horizontal direction is also the same magenta, and the color of the point images adjacent in the vertical direction is green, that is, different colors. In addition, for example, when the color of any point image is green, the color of the point images adjacent in the horizontal direction is also the same green, and the color of the point images adjacent in the vertical direction is magenta, that is, different colors. In this way, in the present embodiment, the same color and different colors are respectively "the same type of color" and "different types of color".

[0038] In addition, in this embodiment, if Figure 3 As shown in the figure, in the image data of the correction image, the point images in the first row (point images arranged in a row) are all magenta, and the point images in the second row are all green. In addition, the same is true for the third row and the following rows, where the magenta point images and the green point images are arranged alternately. In other words, in this embodiment, the point images in the odd-numbered rows are all magenta, and the point images in the even-numbered rows are all green.

[0039] In addition, in the present embodiment, the chroma and lightness L of each point image are equal. Therefore, in the correction image of the present embodiment, the point images of the odd-numbered rows and the point images of the even-numbered rows are Fig.13 The hue angle H in the hue circle shown differs by 180°.

[0040] However, in the projection area 34 of the front windshield 16 as the projection object and the optical system of the projection device 20, the image projected from the projection device 20 may be deformed. Figure 3 The shape of the rectangular arrangement shown becomes Figure 4 In other words, the point image projected from the projection device 20 may be projected to a position different from the assumed coordinates in the projection area 34. Figure 3 In the example, each point image is added with a row after D1 (vertical, from Figure 3 from the top) and columns (horizontally, from Figure 3 For example, D113 shows the first point image from the top and the third point image from the left. Figure 3 For each point image, Figure 4 The symbol corresponding to the point image of the image data is added with a single quotation mark "'" as a symbol. For example, D113' indicates Figure 4 The point image included in the shooting data when the point image of D113 in the image is shot. Figure 3 and Figure 4 Points not shown in the figure are also given the same symbols.

[0041] Here, in the projection device 20 of the present embodiment, the coordinates of the projected image data are adjusted based on the image data captured by the image capturing device 30. Figure 5 The operation of the output image adjustment device 22 and the coordinate adjustment operation procedure according to the first embodiment of the present disclosure will be described.

[0042] (Coordinate adjustment operation sequence) The CPU 24A in this embodiment reads the program stored in the nonvolatile memory 24C and executes Figure 5 The order of operations shown.

[0043] First, in step S102, CPU 24A causes projection unit 32 to project the calibration image onto projection area 34. Then, CPU 24A proceeds to step S104.

[0044] Next, in step S104, CPU 24A captures the projected calibration image and stores the captured calibration image data in RAM 24B. Then, CPU 24A proceeds to step S106.

[0045] Next, in step S106, CPU24A determines whether the measured point image is an odd-numbered row. For example, when CPU24A first transfers to step S106 after starting to execute the coordinate adjustment operation sequence, it makes a positive determination in step S106 as obtaining the point image of the first row. In addition, when CPU24A makes a positive determination in step S106, it transfers to step S108. On the other hand, when CPU24A makes a negative determination in step S106, it transfers to step S110.

[0046] Next, in step S108 , the CPU 24A sets the process so as to obtain a magenta point image in the following step. Then, the CPU 24A proceeds to step S112 .

[0047] In addition, in step S110 , the CPU 24A sets the process so as to obtain a green point image in the subsequent step. Then, the CPU 24A proceeds to step S112 .

[0048] Next, in step S112, CPU24A obtains the coordinate values ​​of the point images of one row included in the captured data. More specifically, CPU24A obtains the row of point images in the captured data that are located at the position corresponding to the number of times S112 is reached. For example, when CPU24A first reaches S112, since step S108 is passed, the coordinate values ​​of the magenta point images that are the first row in the image data are obtained respectively. In addition, for example, when CPU24A reaches S112 for the second time, since step S110 is passed, the coordinate values ​​of the green point images that are the second row in the image data are obtained respectively. Then, CPU24A transfers to step S114.

[0049] Next, in step S114, CPU 24A determines whether the coordinates of all point images included in the photographic data have been acquired. If CPU 24A makes an affirmative determination in step S114, the process moves to step S116. On the other hand, if CPU 24A makes a negative determination in step S114, the process moves to step S106.

[0050] Next, in step S116, CPU24A adjusts the coordinates of the image data based on the coordinate values ​​of the point images obtained in step S112. More specifically, CPU24A calculates the distance between the coordinate values ​​of the point images of the photographic data obtained in step S112 and the coordinate values ​​of the point images of the correction image data for each point image included in the correction image data and the photographic data. Then, CPU24A adjusts the coordinate values ​​of each pixel included in the image data formed by the image production unit 26 based on the distance calculated in step S116. In other words, CPU24A adjusts the coordinates of the corrected image projected by the projection unit 32 based on the photographic data. After adjusting the coordinate values ​​of each pixel included in the image data, CPU24A ends the image adjustment operation sequence.

[0051] In addition, in each of the above steps, even if the color of the point image included in the shooting data shot by the shooting unit 30 is different from the color of the point image included in the correction image, as long as the difference is within the predetermined threshold, the CPU 24A determines that they are the same type of color. For example, when the color of the point included in the correction image is green (#00FF00) and the color of the point in the shooting data is #00F000, the CPU 24A determines that these colors are the same type of color. As an example, for each color of red, green, and blue, the predetermined threshold in this embodiment is set to 15 gray levels in both positive and negative directions.

[0052] (Projection Device 20 of Comparative Example) but, Figure 6 and Figure 7FIG. 2 shows a calibration image output by the projection device 20 of a comparative example of the present embodiment. Figure 6 and Figure 7 As shown, the projection device 20 of the comparative example is different from the projection device 20 of the present embodiment, and projects a white point image as a calibration image. In other words, in the projection device 20 of the comparative example, the point image is the same color as the adjacent point image in either the vertical or horizontal direction.

[0053] In addition, Figure 6 In the example, each point image is added with a row after D3 (vertical, from Figure 6 from the top) and columns (horizontally, from Figure 6 For example, D313 shows the first point image from the top and the third point image from the left. Figure 7 For each point image, Figure 6 The symbol corresponding to the point image of the image data is added with a single quotation mark "'" as a symbol. For example, D313' indicates Figure 6 The point image included in the shooting data when the point image of D313 in the image is shot. Figure 6 and Figure 7 Points not shown in the figure are also given the same symbols.

[0054] Here, the calibration image of the comparative example sometimes cannot determine which row a certain point image belongs to. Figure 7 The point image shown in D313' corresponds to Figure 6 The point image in the first row is located in the figure, but compared with the point image shown in D322', the point image in Figure 7 Therefore, in Figure 7 In the example, the first row of points is taken as the " Figure 7 The amount of the first row from the top of the Figure 7 In the case of counting the number of dots (6 in the figure), the dot image of D322' is not the dot image of D313' but the dot image of D322' is recognized as the first row. Similarly, when the dot image of the second row is counted as "from Figure 7 When counting the second row of points from the top (6 points from the seventh to the twelfth)”, the point image of D313′ is recognized as the point image of the second row.

[0055] On the other hand, according to the projection device 20 of this embodiment, the following operations and effects can be obtained.

[0056] (Function and Effect) In the output image adjustment device 22 of the present embodiment, a correction image is projected in which the groups of point images representing coordinates are of the same color in the horizontal direction and the adjacent point images in the vertical direction are of different colors. Therefore, according to the output image adjustment device 22 of the present embodiment, in step S112, it is difficult for the image adjustment unit 28 to erroneously read the configuration of the group of point images from the captured data. For example, Figure 4 Compared with the point image shown in D113', the point image shown in D122' is located at Figure 4 However, in Figure 4 By taking the first row of points as “from Figure 4 The amount of the first row of magenta from the top side ( Figure 4 6 quantities)”, so that the dot image of D122' as green will not be recognized as the dot image of the first row. Similarly, when the dot image of the second row is counted as “from Figure 4 If the number is counted as "the first row of green from the top", the point image of D113' which is magenta will not be recognized as the point image of the second row.

[0057] Therefore, according to the output image adjustment device 22, the measurement accuracy of the point image indicating the coordinates included in the calibration image is improved compared to the case where the color of the point image projected onto the projection object is uniform.

[0058] Furthermore, according to the output image adjustment device 22 of the present embodiment, since the difference in hue angle H between the point images adjacent in the vertical direction is large, it is difficult for the image adjustment unit 28 to erroneously read the position of each point image group.

[0059] Therefore, according to the output image adjustment device 22, the image adjustment unit 28 can easily recognize a group of point images of the same type based on the imaging data, compared with a case where the hue angle H between each point image and a point image adjacent in the vertical direction is small.

[0060] In addition, according to the projection device 20 of this embodiment, in the projection device 20 having an output image adjustment device 22 that captures a correction image projected onto a projection object and adjusts the corrected image, the detection accuracy of the point image representing the coordinates included in the correction image is improved.

[0061] In addition, according to the image adjustment method of this embodiment, a correction image is projected in which the groups of point images representing coordinates are of the same color in the horizontal direction and the adjacent point images in the vertical direction are of different colors. Therefore, in the operation sequence of adjusting the projected correction image, it is difficult to erroneously read the arrangement of the group of point images from the shooting data of the correction image.

[0062] Therefore, according to this image adjustment method, the measurement accuracy of the point image indicating the coordinates included in the calibration image is improved compared to the case where the color of the point image projected onto the projection object is uniform.

[0063] Next, refer to Figure 8 A correction image created by the output image adjustment device 22 and the output image adjustment device 22 according to the second embodiment of the present disclosure will be described.

[0064] [Second embodiment] Figure 8 2 is a diagram showing a calibration image according to a second embodiment of the present disclosure. In this embodiment, unlike the first embodiment, a point image has the same color as a point image adjacent to the vertical direction and has a different color from a point image adjacent to the horizontal direction.

[0065] In this embodiment, the coordinates are obtained for each column of the imaged data after the correction image projected onto the projection area 34 is captured. In other words, in this embodiment, the vertical and horizontal directions of the image data and the imaged data are different from those in the first embodiment. In addition, the other structures and operations are the same as those in the first embodiment.

[0066] (Function and Effect) In this embodiment as well, the same operations and effects as those of the first embodiment can be obtained.

[0067] Next, refer to Fig. 9 A correction image created by the output image adjustment device 22 and the output image adjustment device 22 according to the third embodiment of the present disclosure will be described.

[0068] [Third Embodiment] Fig. 9 3 is a diagram showing a correction image according to a third embodiment of the present disclosure. In this embodiment, unlike the first embodiment, the brightness L of the point image on the center side of the correction image is lower than that of the point image on the outer side of the correction image.

[0069] In addition, as an example, the hue angle H in this embodiment is the same as that in the first embodiment. In other words, the point image in this embodiment is different from the point image in the first embodiment in lightness L. In addition, other structures and operations are the same as those in the first embodiment.

[0070] like Figure 1 As shown, in the correction image projected onto the front windshield 16, the distance from the projection unit 32 to the projection object is longer on the outer side than on the central side. In other words, the correction image projected onto the projection surface from the projection unit 32 is darker on the outer side than on the inner side.

[0071] (Function and Effect) Here, according to the output image adjustment device 22 of this embodiment, the brightness L of the center side of the image in the group of point images is lower than that of the outer side of the image. Therefore, according to the output image adjustment device 22, since the difference in illumination between the point image on the center side of the image and the point image on the outer side of the image becomes smaller, the range of brightness L captured by the imaging unit 30 can be narrowed. Therefore, according to the output image adjustment device 22, it is easy to distinguish between the point image and noise of the correction image.

[0072] In this embodiment, the illumination of the region projected by the projection unit 32 in the projection target may be uniformized based on the image data captured by the image capture unit 30. In addition, the CPU 24A may detect point omission (specific point image not colored) of the projection unit 32 based on the image data captured by the image capture unit 30.

[0073] In this case, in the output image adjustment device 22 that projects the calibration image onto the projection target, the dot loss generated in the projection unit 32 that outputs the calibration image based on the imaging data is easily found.

[0074] In this embodiment, the brightness L of the correction image is adjusted to make the illumination of the region where the correction image is projected uniform. Therefore, according to the output image adjustment device 22 of this embodiment, there is no need for a separate structure for adjusting the illumination of the correction image.

[0075] In addition, in this embodiment as well, the same operations and effects as those of the first embodiment can be obtained.

[0076] In addition, in the present embodiment, the method of equalizing the illumination of the region where the correction image is projected in the projection object is not limited to this. For example, a filter may be provided on the projection unit 32 in such a way that the inner side of the projection region becomes darker, and the brightness L of any point image of the correction image may be made equal. In this case, the effect of facilitating the discrimination between the point image of the correction image and the noise can also be obtained.

[0077] [Other embodiments] In addition, in the above embodiment, an example in which the hue angle H or the lightness L is different is shown, but the embodiment of the present disclosure is not limited thereto. That is, in this embodiment, as long as any one of the point image and the point image adjacent in the vertical or horizontal direction is the same kind of color and any other one is a plurality of colors, the same action and effect as in the above embodiment can be obtained.

[0078] In other words, in the output image adjustment device 22 and the projection device 20 of the present disclosure, the points of the same type of color and the points of different types of color can be points where at least one of the hue angle H, chroma S, and lightness L is different by a predetermined threshold or more. That is, different types of colors refer to points where the hue angle H, chroma S, or lightness L is different.

[0079] For example, Fig.10 FIG. 1 is a diagram showing a calibration image according to another embodiment of the present disclosure. Fig.10 In the correction image shown, unlike the first embodiment, the colors of the dot images in the odd-numbered rows are warm colors, and the colors of the dot images in the even-numbered rows are cool colors. In other words, in this embodiment, the warm colors and the cool colors are respectively regarded as the same type of colors and different types of colors.

[0080] In addition, in this embodiment, the colors of the point images of the odd-numbered rows and the colors of the point images of the even-numbered rows are separated by at least a predetermined value in hue angle H. Fig.10 In the example, the predetermined threshold corresponds to the difference in hue angle H being a specified value.

[0081] In addition, Fig.10 In the example, there is no limit on the brightness L and chroma S of each point image. Fig.10 In the example of FIG. 1 , the brightness L or the chroma S of the point images of the odd-numbered rows and the point images of the even-numbered rows may be the same. In addition, the other structures and operations are the same as those of the first embodiment.

[0082] in addition, Fig.11 FIG. 2 is a diagram showing a calibration image according to another embodiment of the present disclosure. Fig.11 In the correction image shown, unlike the first embodiment, the colors of the dot images in the odd-numbered rows are chromatic, and the colors of the dot images in the even-numbered rows are achromatic. In other words, in this embodiment, the same color and different colors are used according to the difference in chroma S.

[0083] In addition, Fig.11 In the example of , there is no limitation on the lightness L and hue angle H of each point image. In other words, the lightness L or hue angle H of the point images in the odd-numbered rows and the point images in the even-numbered rows may be the same.

[0084] In addition, in the present embodiment, the chroma S of the color of the point image of the odd-numbered row and the color of the point image of the even-numbered row are different by at least a predetermined value. Fig.11 In the example of , the predetermined threshold corresponds to the difference in chroma S being a specified value.

[0085] in addition, Fig.12 FIG. 2 is a diagram showing a calibration image according to another embodiment of the present disclosure. Fig.12 In the correction image shown, unlike the first embodiment, the color of the dot image in the odd-numbered rows is brighter, and the color of the dot image in the even-numbered rows is darker. In other words, in this embodiment, the same color and different colors are used according to the difference in lightness L.

[0086] In addition, Fig.12 In the example of , there is no limitation on the chroma S and hue angle H of each point image. In other words, the chroma S or hue angle H of the point images in the odd-numbered rows and the point images in the even-numbered rows may be the same.

[0087] In this embodiment, the brightness L of the color of the point image of the odd-numbered row and the color of the point image of the even-numbered row differs by at least a predetermined value (%) relative to the maximum value (255 in the embodiment). Fig.12 In the example of , the predetermined threshold corresponds to a difference in brightness L relative to the maximum value being a specified value (%).

[0088] (Function and Effect) In the present embodiment, the dots of different colors differ from the dots adjacent in the vertical direction by at least a predetermined threshold value in at least one of the hue angle H, chroma S, and lightness L. Thus, the image adjustment unit 28 can detect the difference in at least one of the hue angle H, chroma S, and lightness L of the dots from the captured data, thereby determining the dots of the same type and the dots of different types, and thus it is difficult to erroneously read the arrangement of the dot group from the captured data.

[0089] Therefore, according to the output image adjustment device 22, for the color difference between the colors of points of the same type and the colors of points of different types, the measurement accuracy of the points represented by the coordinates included in the correction image is improved compared to the case where each of the hue angle H, chroma S and lightness L is less than a predetermined threshold.

[0090] (Other Modifications) In addition, as in the above-mentioned embodiment, the operation sequence of projecting the calibration image to adjust the coordinates of the calibrated image can be performed at any time. For example, it can be performed when the projection device 20 is shipped from the factory, when the motor vehicle equipped with the projection device 20 is shipped from the factory, etc., and it can also be performed by the operator or user at any time to adjust the image projected on the front windshield 16.

[0091] In the above description, the calibration image is directly projected onto the front windshield 16, but the present invention is not limited thereto, and other projection objects may be prepared for calibration and projected thereon to thereby perform image adjustment. For example, the calibration image may be outputted in a state where the outside of the front windshield 16 is covered with a dark curtain so that the image pickup unit 30 can easily read the point image.

[0092] In addition, in the above description, as the point representing the coordinate, the point image arranged at a predetermined interval from the adjacent point image is described, but the technology disclosed in the present invention is not limited to this. For example, the point image can also be arranged continuously with the adjacent point image, and is linear from a macroscopic point of view. More specifically, it can also be a grid-shaped image consisting of a group of lines extending in a first direction and arranged at intervals in a second direction, and a group of lines extending in a second direction and arranged at intervals in the first direction. In this case, by using the intersection of each line as the point representing the coordinate, the same action and effect as described above can be obtained. In addition, by being linear from a macroscopic point of view, it is easier to find the projection area 34 of the projection object and the deformation of the optical system of the projection device 20.

[0093] In addition, in the above description, the colors of the point images of the odd-numbered rows and the even-numbered rows are different, but the technology disclosed in the present invention is not limited to this. For example, the colors of the point images of the first row, the fourth row, the seventh row, ... can be set to red, and the point images of the second row, the fifth row, the eighth row, ... can be set to green, and the point images of the third row, the sixth row, the ninth row, ... can be set to blue, so that the types of colors are set to three or more. In this case, if the color of each type is different from the type of the adjacent point in the second direction, it can be repeated periodically, or it can be randomly selected.

[0094] In addition, the processing executed by CPU24A reading software (program) in the above-mentioned embodiments may also be executed by various processors other than CPU24A. As the processor in this case, FPGA (Field-Programmable Gate Array) and other PLD (Programmable Logic Device) and ASIC (Application Specific Integrated Circuit) which can change the circuit structure after manufacturing are exemplified as special circuits of processors having circuit structures specially designed for executing specific processing. In addition, the processing may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs and CPUs and FPGAs, etc.). In addition, the hardware structure of these various processors is more specifically a circuit combining circuit elements such as semiconductor elements.

[0095] In addition, in the above-mentioned embodiments, the processing program is pre-stored (installed) in the non-volatile memory 24C, but the present invention is not limited to this. The program can be provided in a non-transitory storage medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. In addition, the program can also be downloaded from an external device via a network.

[0096] The above describes the implementation mode of the present disclosure with reference to the accompanying drawings. However, anyone with common knowledge in the technical field to which the present disclosure belongs can obviously think of various modifications or application examples within the scope of the technical ideas described in the claims, and these also belong to the technical scope of the present disclosure.

[0097] In addition, preferred embodiments of the present disclosure are further described below.

[0098] (Note 1) An output image adjustment device, comprising: a projection unit that projects a calibration image onto a projection object, the calibration image including a group of points representing coordinates in a first direction and a second direction intersecting the first direction, each of the points being of the same color as a point adjacent to the first direction and of a different color from a point adjacent to the second direction; a photographing unit that photographs the calibration image projected onto a projection object; and The image adjustment unit adjusts the coordinates of the calibrated image projected by the projection unit based on the imaged data captured by the image capturing unit.

[0099] (Note 2) The output image adjustment device according to Supplementary Note 1, wherein the point of the different color is a point that is different from the point adjacent to the second direction in at least one of hue, chroma, and brightness by more than a predetermined threshold value.

[0100] (Note 3) The output image adjustment device according to Supplementary Note 1 or Supplementary Note 2, wherein the brightness of the center side of the correction image is lower than that of the outer side of the correction image.

[0101] (Note 4) A projection device, comprising: The output image adjustment device according to any one of Supplement 1 to Supplement 3; and The image production unit produces the corrected image.

[0102] (Note 5) An image adjustment method, comprising: A working sequence for projecting a calibration image onto a projection object, the calibration image comprising a group of points representing coordinates in a first direction and a second direction intersecting the first direction, each of the points being of the same color as an adjacent point in the first direction and of a different color from an adjacent point in the second direction; A working sequence for photographing the calibration image projected onto the projection object; and The operation procedure is to adjust the coordinates of the projected calibrated image based on the captured data of the captured calibration image.

[0103] (Note 6) An output image adjustment device, comprising: A projection unit, projecting a correction image extending in a first direction and a second direction intersecting the first direction onto a projection object; a photographing unit that photographs the calibration image projected onto a projection object; and The image adjustment unit makes the illumination of the region of the projection object projected by the projection unit uniform based on the imaging data captured by the imaging unit, and detects the coordinates of the pixel where the point of the projection unit is missing based on the imaging data captured by the imaging unit.

[0104] (Note 7) The output image adjustment device according to Supplementary Note 6, wherein the image adjustment unit adjusts the brightness of the correction image to make the illumination of the region of the projection target onto which the correction image is projected uniform.

[0105] (Note 8) A projection device, comprising: The output image adjustment device according to Supplement 6 or Supplement 7; and The image creating unit creates the calibration image.

[0106] (Note 9) An image adjustment method, comprising: An operation sequence of projecting a calibration image extending in a first direction and in a second direction intersecting the first direction onto a projection object; A sequence of operations for photographing the calibration image projected onto the projection object; A procedure for uniformizing the illumination of the region where the calibration image is projected in the projection target based on the captured image data; and A task sequence is to detect the coordinates of the dot-missing pixels included in the calibration image based on the captured data.

[0107] Description of Reference Numerals 10: Heads-up display 14: Dashboard 16: Front windshield 18: Steering Wheel 20: Projection device 22: Output image adjustment device 24: Control Department 26: Image Production Department 28: Image Adjustment Department 30: Photography Department 32: Projection Department 34: Projection area (an example of a projection object) 24A: CPU 24B: RAM 24C: Non-volatile memory 24D: Bus 24E: Input and output interface.

Claims

1. An output image adjustment device, wherein: have: a projection unit that projects a calibration image onto a projection object, the calibration image including a group of points representing coordinates in a first direction and a second direction intersecting the first direction, each of the points being of the same color as a point adjacent to the first direction and of a different color from a point adjacent to the second direction; a photographing unit for photographing the calibration image projected onto the projection object; as well as The image adjustment unit adjusts the coordinates of the calibrated image projected by the projection unit based on the imaged data captured by the image capturing unit.

2. The output image adjustment device according to claim 1, wherein: The point of the different color is a point that is different from the point adjacent to the second direction in at least one of hue, chroma, and lightness by more than a predetermined threshold value.

3. The output image adjustment device according to claim 1, wherein: The brightness of the center side of the correction image is lower than that of the outer side of the correction image.

4. A projection device, wherein: have: The output image adjustment device according to any one of claims 1 to 3; and The image production unit produces the corrected image.

5. An image adjustment method, wherein: include: A working sequence for projecting a calibration image onto a projection object, the calibration image comprising a group of points representing coordinates in a first direction and a second direction intersecting the first direction, each of the points being of the same color as an adjacent point in the first direction and of a different color from an adjacent point in the second direction; A working sequence for photographing the calibration image projected onto the projection object; and The operation procedure is to adjust the coordinates of the projected calibrated image based on the captured data of the captured calibration image.

Images